Patent US5719954A successfully refreshed from Google Patents.
US5719954A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Stereo matching method and disparity measuring method
Assignee: Panasonic Holdings Corp
•
Filing: 1995-06-02
•
Granted: 1998-02-17
•
Expires: 2015-06-02
Abstract
Abstract A method for measuring stereo image disparity between right and left stereo images for each of two-dimensional blocks having a rectangular shape. In particular, the method includes the steps of deciding a level of each pixel in the right and left stereo images according to a ternary value, sequentially setting a one-dimensional window having a size of N pixels along a horizontal direction in one of the right and left stereo images by overlapping N/2 pixels, determining the disparity for each one-dimensional window by determining a portion in the other of the right and left stereo images corresponding to each one-dimensional window on the basis of the ternary value obtained through the deciding step to generate a histogram of the disparities, and determining the stereo image disparity for each of the two-dimensional blocks on the basis of the histogram of the disparities.
Inventors
- 👤 Katsumasa Onda
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-07 20:48
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/50; G06T7/55; G06T7/593; G06V; G06V10/00; G06V10/10; G06V10/20; G06V10/24; G06T2207/00; G06T2207/10; G06T2207/10004; G06T2207/10012; G06V2201/00; G06V2201/12; H; H04; H04N; H04N13/00; H04N2013/0074; H04N2013/0081; H04N2013/0092; H04N2013/0096
Claims Analysis
Total Claims: 25
Claim 1
Independent Claim
132 words
A method for taking correspondence between right and left stereo images imaged by two imaging devices arranged at a predetermined horizontal distance therebetween, comprising the steps of: extracting horizontal edges from the right and left stereo images by using differentiation; deciding a level of each pixel of the extracted horizontal edges into a ternary value by using a first threshold value and a second threshold value; and determining a position in one of the right and left stereo images corresponding to that in the other of the right and left stereo images on the basis of the ternary values obtained through said deciding step, wherein said determining step includes setting a one-dimensional window having a size of N pixels along a horizontal direction in one of the right and left stereo images.
Claim 2
Independent Claim
132 words
A method for taking correspondence between right and left stereo images imaged by two imaging devices arranged at a predetermined horizontal distance therebetween, comprising the steps of: extracting horizontal edges from the right and left stereo images by using differentiation; deciding a level of each pixel of the extracted horizontal edges into a ternary value by using a first threshold value and a second threshold value; and determining a position in one of the right and left stereo images corresponding to that in the other of the right and left stereo images on the basis of the ternary values obtained through said deciding step, wherein said determining step includes setting a one-dimensional window having a size of N pixels along a horizontal direction in one of the right and left stereo images.
Claim 3
Dependent Claim
30 words
The method according to claim 1, further comprising the step of: reducing noise components of the right and left stereo images by using a low-pass filter before said extracting step.
Claim 4
Independent Claim
150 words
A method for taking correspondence between right and left stereo images imaged by two imaging devices arranged at a predetermined horizontal distance therebetween, comprising the steps of: reducing out-of-band frequency components of the right and left stereo images by using a band-pass filter to extract horizontal edges having in-band frequency components from the right and left stereo images; deciding a level of each pixel of the extracted horizontal edges into a ternary value by using a first threshold value and a second threshold value; and determining a position in one of the right and left stereo images corresponding to that in the other of the right and left stereo images on the basis of the ternary values obtained through said deciding step, wherein said determining step includes setting a one-dimensional window having a size of N pixels along a horizontal direction in one of the right and left stereo images.
Claim 5
Independent Claim
150 words
A method for taking correspondence between right and left stereo images imaged by two imaging devices arranged at a predetermined horizontal distance therebetween, comprising the steps of: reducing out-of-band frequency components of the right and left stereo images by using a band-pass filter to extract horizontal edges having in-band frequency components from the right and left stereo images; deciding a level of each pixel of the extracted horizontal edges into a ternary value by using a first threshold value and a second threshold value; and determining a position in one of the right and left stereo images corresponding to that in the other of the right and left stereo images on the basis of the ternary values obtained through said deciding step, wherein said determining step includes setting a one-dimensional window having a size of N pixels along a horizontal direction in one of the right and left stereo images.
Claim 6
Dependent Claim
43 words
The method according to claim 1, wherein said determining step includes the step of: searching, in the other of the right and left stereo images, an area having a pattern of N ternary values which is analogous to that of said one-dimensional window.
Claim 7
Dependent Claim
43 words
The method according to claim 2, wherein said determining step includes the step of: searching, in the other of the right and left stereo images, an area having a pattern of N ternary values which is analogous to that of said one-dimensional window.
Claim 8
Dependent Claim
43 words
The method according to claim 3, Wherein said determining step includes the step of: searching, in the other of the right and left stereo images, an area having a pattern of N ternary values which is analogous to that of said one-dimensional window.
Claim 9
Dependent Claim
127 words
The method according to claim 4, wherein said determining step includes the step of: evaluating a degree of coincidence of said pattern of N ternary values between the right and left stereo images by using a coincidence evaluation factor E=Np+Nz+Nm for each one-dimensional window, where Np is a number of pixels each having a level not less than the first threshold value in both the right and left stereo images. Nz is a number of pixels each having a level less than the first threshold value and not less than the second threshold value in both the right and left stereo images, and Nm is a number of pixels each having a level less than the second threshold value in both the right and left stereo images.
Claim 10
Dependent Claim
127 words
The method according to claim 5, wherein said determining step includes the step of: evaluating a degree of coincidence of said pattern of N ternary values between the right and left stereo images by using a coincidence evaluation factor E=Np+Nz+Nm for each one-dimensional window, where Np is a number of pixels each having a level not less than the first threshold value in both the right and left stereo images. Nz is a number of pixels each having a level less than the first threshold value and not less than the second threshold value in both the right and left stereo images, and Nm is a number of pixels each having a level less than the second threshold value in both the right and left stereo images.
Claim 11
Dependent Claim
127 words
The method according to claim 6, wherein said determining step includes the step of: evaluating a degree of coincidence of said pattern of N ternary values between the right and left stereo images by using a coincidence evaluation factor E=Np+Nz+Nm for each one-dimensional window where Np is a number of pixels each having a level not less than the first threshold value in both the right and left stereo images. Nz is a number of pixels each having a level less than the first threshold value and riot less than the second threshold value in both the right and left stereo images, and Nm is a number of pixels each having a level less than the second threshold value in both the right and left stereo images.
Claim 12
Dependent Claim
43 words
The method according to claim 7, wherein said evaluating step includes the step of: determining that the coincidence of said pattern of N ternary values between the right and left stereo images is valid when Np+Nm is not less than a predetermined number.
Claim 13
Dependent Claim
43 words
The method according to claim 8, wherein said evaluating step includes the step of: determining that the coincidence of said pattern of N ternary values between the right and left stereo images is valid when Np+Nm is not less than a predetermined number.
Claim 14
Dependent Claim
43 words
The method according to claim 9, wherein said evaluating step includes the step of: determining that the coincidence of said pattern of N ternary values between the right and left stereo images is valid when Np+Nm is not less than a predetermined number.
Claim 15
Dependent Claim
119 words
The method according to claim 1, wherein said determining step includes the steps of: searching, in the other of the right and left stereo images, an area of the highest degree of coincidence with a pattern of N ternary values in said one-dimensional window and an area having the next highest degree of coincidence with the pattern of N ternary values in said one-dimensional window; designating disparity in the area having the highest degree of coincidence as the first candidate disparity and disparity in the area having the next highest degree of coincidence as the second candidate disparity; and determining disparity of the right and left stereo images by using said first candidate disparity and said second candidate disparity.
Claim 16
Dependent Claim
142 words
The method according to claim 2, wherein said determining step includes the steps of: setting a one-dimensional window having a size of N pixels along a horizontal direction in one of the right and left stereo images; searching, in the other of the right and left stereo images, an area of the highest degree of coincidence with a pattern of N ternary values in said one-dimensional window and an area having the next highest degree of coincidence with the pattern of N ternary values in said one-dimensional window; designating disparity in the area having the highest degree of coincidence as the first candidate disparity and disparity in the area having the next highest degree of coincidence as the second candidate disparity; and determining disparity of the right and left stereo images by using said first candidate disparity and said second candidate disparity.
Claim 17
Dependent Claim
119 words
The method according to claim 3, wherein said determining step includes the steps of: searching, in the other of the right and left stereo images, an area of the highest degree of coincidence with a pattern of N ternary values in said one-dimensional window and an area having the next highest degree of coincidence with the pattern of N ternary values in said one-dimensional window; designating disparity in the area having the highest degree of coincidence as the first candidate disparity and disparity in the area having the next highest degree of coincidence as the second candidate disparity; and determining disparity of the right and left stereo images by using said first candidate disparity and said second candidate disparity.
Claim 18
Dependent Claim
76 words
The method according to claim 4, wherein: said setting step includes the step of sequentially setting the one-dimensional window having a size of N pixels by overlapping N/2 pixels while scanning the whole screen on scanning lines; and said determining step includes the step of determining a position in one of the right and left stereo images corresponding to that in the other of the right and left stereo images for each one-dimensional window thus set.
Claim 19
Dependent Claim
83 words
The method according to claim 4, wherein: said setting step includes the step of sequentially setting the one-dimensional window having a size of N pixels by overlapping N/2 pixels while scanning a whole screen on one of odd-numbered scanning lines and even-numbered scanning lines; and said determining step includes the step of determining a position in one of the right and left stereo images corresponding to that in the other of the right and left stereo images for each one-dimensional window thus set.
Claim 20
Independent Claim
215 words
A method of measuring the stereo image disparity between right and left stereo images, said method comprising the steps of: deciding a level of each pixel in the right and left stereo images into a ternary value; dividing a whole screen of one of the right and left stereo images into two-dimensional blocks each having a size of N×M pixels; sequentially setting a one-dimensional window having a size of N pixels along a horizontal direction in one of the right and left stereo images; searching in the other of the right and left stereo images an area having the highest degree of coincidence with a pattern of N ternary values in said one-dimensional window and an area having the next highest degree of coincidence with the pattern of N ternary values in said one-dimensional window; designating disparity in an area having the highest degree of coincidence as the first candidate disparity and disparity in an area having the next highest degree of coincidence as the second candidate disparity in each one-dimensional window; generating a histogram of disparities by using at least one of said first candidate disparity and said second candidate disparity; and determining disparity at a peak of the histogram of the disparities as the stereo image disparity for each of said two-dimensional blocks.
Claim 21
Independent Claim
215 words
A method of measuring the stereo image disparity between right and left stereo images, said method comprising the steps of: deciding a level of each pixel in the right and left stereo images into a ternary value; dividing a whole screen of one of the right and left stereo images into two-dimensional blocks each having a size of N×M pixels; sequentially setting a one-dimensional window having a size of N pixels along a horizontal direction in one of the right and left stereo images; searching in the other of the right and left stereo images an area having the highest degree of coincidence with a pattern of N ternary values in said one-dimensional window and an area having the next highest degree of coincidence with the pattern of N ternary values in said one-dimensional window; designating disparity in an area having the highest degree of coincidence as the first candidate disparity and disparity in an area having the next highest degree of coincidence as the second candidate disparity in each one-dimensional window; generating a histogram of disparities by using at least one of said first candidate disparity and said second candidate disparity; and determining disparity at a peak of the histogram of the disparities as the stereo image disparity for each of said two-dimensional blocks.
Claim 22
Dependent Claim
176 words
The method according to claim 18 further comprising the step of: evaluating a degree of coincidence of said pattern of N ternary values between right and left stereo images by using a coincidence evaluation factor E=Np+Nz+Nm for each one-dimensional window, where Np is a number of pixels each having a level not less than the first threshold value in both the right and left stereo images, Nz is a number of pixels each having a level less than the first threshold value and not less than the second threshold value in both the right and left stereo images, and Nm is a number of pixels each having a level less than the second threshold value in both the right and left stereo images. wherein said generating step includes the step of generating a histogram of the disparities by using Np+Nm in N/2 pixels of an area where the degree of coincidence is evaluated as maximum in the other of the right and left stereo images and Np+Nm in N/2 pixels of a right-half of said area.
Claim 23
Dependent Claim
157 words
The method according to claim 18 further comprising: evaluating a degree of coincidence of said pattern of N ternary values between right and left stereo images by using a coincidence evaluation factor E=Np+Nz+Nm for each one-dimensional window, where Np is a number of pixels each having a level not less than the first threshold value in both the right and left; stereo images. Nz is a number of pixels each having a level less than the first threshold value and not less than the second threshold value in both the right and left stereo images, and Nm is a number of pixels each having a level less than the second threshold value in both the right and left stereo images. wherein said generating step includes the step of generating a histogram by using Np+Nm in N/2 pixels of a left half of the one-dimensional window and Np+Nm in N/2 pixels of a right-half of the one-dimensional window.
Claim 24
Independent Claim
141 words
A method for measuring stereo image disparity between right and left stereo images for each of a plurality of two-dimensional blocks having a rectangular shape, said method comprising the steps of: deciding a level of each pixel in the right and left stereo images into a ternary value; sequentially setting a one-dimensional window having a size of N pixels along a horizontal direction in one of the right and left stereo images by overlapping N/2 pixels; determining disparity for each one-dimensional window by determining a portion in the other of the right and left stereo images corresponding to each one-dimensional window on the basis of the ternary value obtained through said deciding step, thereby generating a histogram of the disparities; and determining the stereo image disparity for each of said two-dimensional blocks on the basis of the histogram of the disparities.
Claim 25
Independent Claim
141 words
A method for measuring stereo image disparity between right and left stereo images for each of a plurality of two-dimensional blocks having a rectangular shape, said method comprising the steps of: deciding a level of each pixel in the right and left stereo images into a ternary value; sequentially setting a one-dimensional window having a size of N pixels along a horizontal direction in one of the right and left stereo images by overlapping N/2 pixels; determining disparity for each one-dimensional window by determining a portion in the other of the right and left stereo images corresponding to each one-dimensional window on the basis of the ternary value obtained through said deciding step, thereby generating a histogram of the disparities; and determining the stereo image disparity for each of said two-dimensional blocks on the basis of the histogram of the disparities.
References Cited (Backward Citations)
JPS60217472A
Cited
US4825393A
Cited
US5220441A
Cited
US5479535A
Cited
US5179441A
Cited
JPH05189570A
Cited
JPH0621747A
Cited
US5606627A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-02-16 | 2001-08-18 | 2002-02-17 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-02-16 | 2005-08-18 | 2006-02-17 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-02-16 | 2009-08-18 | 2010-02-17 | $7700.00 | Window Closed / Lapsed |