US5754692A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Picture coincidence detecting apparatus and method
Assignee: Sony Corp
•
Filing: 1994-07-28
•
Granted: 1998-05-19
•
Expires: 2014-07-28
Abstract
Abstract Lower accuracy picture coincidence detecting means gives positional relationship between picture data of higher resolution picture and lower resolution picture as corresponding pixel position predicted with marker position as reference, i.e., initial position. Block matching processing means sets a search range corresponding to a block of an arbitrary range set within the lower resolution picture in accordance with the initial position to globally search, within the search range, block on the higher resolution picture corresponding to the block of the arbitrary range to find out a candidate of coincidence area to further interpolate between respective pixels of lower resolution picture and higher resolution picture to thereby evaluate, with high accuracy, similarity between the set block and block within the search range to detect a picture in which coincidence is obtained. For this reason, even if corresponding pictures are pictures such that both pixel positions differ from each other in dependency upon pictures of different formats, e.g., different picture angles, it is possible to detect coincidence between pictures or pixels.
Inventors
- 👤 Tetsujiro Kondo
- 👤 Takashi Horishi
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 21:06
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/20; G06T7/223; G06T7/238
Claims Analysis
Total Claims: 21
Claim 1
Independent Claim
272 words
A picture coincidence detecting apparatus adapted for detecting coincidence relationship between respective pixels of a first picture that a first image pick-up element comprised of a first number of pixels outputs and a second picture that a second image pick-up element comprised of a second number of pixels outputs, the apparatus comprising: lower accuracy picture coincidence detecting means for carrying out lower accuracy pixel matching on the basis of reference positions of the first and second pictures; and block matching processing means for selectively carrying out block matching processing in pixel or subpixel units to set, on the second picture, a search range corresponding to a block on the first picture in dependency upon a detection result of the lower accuracy picture coincidence detecting means to search a block on the second picture, which matches with the block on the first picture, wherein when the first picture is assumed to be a lower resolution picture and the second picture is assumed to be a higher resolution picture, the block matching processing means sets, on the higher resolution picture. a search range corresponding to the block on the lower resolution picture in dependency upon a detection result of the lower accuracy picture coincidence detecting means to globally search, within the search range, a block on the higher resolution picture, which matches with the block on the lower resolution picture to find a candidate to further interpolate between respective pixels of the lower resolution picture and the higher resolution picture to thereby evaluate similarity between the set block and the block within the search range to detect a picture in which coincidence is established.
Claim 2
Dependent Claim
272 words
A picture coincidence detecting apparatus adapted for detecting coincidence relationship between respective pixels of a first picture that a first image pick-up element comprised of a first number of pixels outputs and a second picture that a second image pick-up element comprised of a second number of pixels outputs, the apparatus comprising: lower accuracy picture coincidence detecting means for carrying out lower accuracy pixel matching on the basis of reference positions of the first and second pictures; and block matching processing means for selectively carrying out block matching processing in pixel or subpixel units to set, on the second picture, a search range corresponding to a block on the first picture in dependency upon a detection result of the lower accuracy picture coincidence detecting means to search a block on the second picture, which matches with the block on the first picture, wherein when the first picture is assumed to be a lower resolution picture and the second picture is assumed to be a higher resolution picture, the block matching processing means sets, on the higher resolution picture. a search range corresponding to the block on the lower resolution picture in dependency upon a detection result of the lower accuracy picture coincidence detecting means to globally search, within the search range, a block on the higher resolution picture, which matches with the block on the lower resolution picture to find a candidate to further interpolate between respective pixels of the lower resolution picture and the higher resolution picture to thereby evaluate similarity between the set block and the block within the search range to detect a picture in which coincidence is established.
Claim 3
Dependent Claim
222 words
A picture coincidence detecting apparatus adapted for detecting coincidence relationship between respective pixels of a first picture that a first image pick-up element comprised of a first number of pixels outputs and a second picture that a second image pick-up element comprised of a second number of pixels outputs, the apparatus comprising: lower accuracy picture coincidence detecting means for carrying out lower accuracy pixel matching on the basis of reference positions of the first and second pictures; and block matching processing means for globally searching, within a search range set on the second picture, the first and second pictures in dependency upon a detection result of the lower accuracy picture coincidence detecting means to select respective points of remark to set corresponding blocks including these points of remark in the first and second pictures to make a correction such that mean values or standard deviations of these luminance signals are in correspondence with each other thereafter to selectively implement block matching processing in pixel or subpixel units to the corresponding blocks, wherein the block matching processing means repeats, n number of times, while hierarchically reducing n number of times the corresponding block, detection and correction of a difference between mean levels of luminance signals or the detection and correction of a ratio between standard deviations of luminance signals, and block matching processing.
Claim 4
Dependent Claim
222 words
A picture coincidence detecting apparatus adapted for detecting coincidence relationship between respective pixels of a first picture that a first image pick-up element comprised of a first number of pixels outputs and a second picture that a second image pick-up element comprised of a second number of pixels outputs, the apparatus comprising: lower accuracy picture coincidence detecting means for carrying out lower accuracy pixel matching on the basis of reference positions of the first and second pictures; and block matching processing means for globally searching, within a search range set on the second picture, the first and second pictures in dependency upon a detection result of the lower accuracy picture coincidence detecting means to select respective points of remark to set corresponding blocks including these points of remark in the first and second pictures to make a correction such that mean values or standard deviations of these luminance signals are in correspondence with each other thereafter to selectively implement block matching processing in pixel or subpixel units to the corresponding blocks, wherein the block matching processing means repeats, n number of times, while hierarchically reducing n number of times the corresponding block, detection and correction of a difference between mean levels of luminance signals or the detection and correction of a ratio between standard deviations of luminance signals, and block matching processing.
Claim 5
Dependent Claim
190 words
A picture coincidence detecting method of detecting coincidence between respective still pictures imaged by cameras having different resolutions, said method comprising the steps of: setting a block of a predetermined size within a lower resolution picture, setting a search range corresponding to the block on a higher resolution picture, globally searching the search range to find a candidate, and block coincidence detecting by interpolating between respective pixels of the higher resolution picture and the lower resolution picture to selectively evaluate in pixel or subpixel units, with high accuracy, similarity between the set block and a block within the search range to detect a picture in which coincidence is established, said block coincidence detecting step including the step of allowing mean values or standard deviations of luminance signal levels of a higher resolution picture and a lower resolution picture to coincide with each other over the entire picture prior to carrying out the picture coincidence detecting processing to allow the mean values or standard deviations of luminance signal levels to coincide with each other in local corresponding block units for a second time in carrying out coincidence detection of block unit.
Claim 6
Dependent Claim
190 words
A picture coincidence detecting method of detecting coincidence between respective still pictures imaged by cameras having different resolutions, said method comprising the steps of: setting a block of a predetermined size within a lower resolution picture, setting a search range corresponding to the block on a higher resolution picture, globally searching the search range to find a candidate, and block coincidence detecting by interpolating between respective pixels of the higher resolution picture and the lower resolution picture to selectively evaluate in pixel or subpixel units, with high accuracy, similarity between the set block and a block within the search range to detect a picture in which coincidence is established, said block coincidence detecting step including the step of allowing mean values or standard deviations of luminance signal levels of a higher resolution picture and a lower resolution picture to coincide with each other over the entire picture prior to carrying out the picture coincidence detecting processing to allow the mean values or standard deviations of luminance signal levels to coincide with each other in local corresponding block units for a second time in carrying out coincidence detection of block unit.
Claim 7
Dependent Claim
167 words
A picture coincidence detecting method of detecting coincidence between respective still pictures imaged by cameras having different resolutions, the method comprising the steps of: setting a block of a predetermined size within a lower resolution picture; setting a search range corresponding to the block on the higher resolution picture; globally searching the search range to find a candidate: and block coincidence detecting by setting a corresponding block including a candidate in pictures of lower resolution and higher resolution to make a correction such that mean levels or standard deviations of luminance signals are in correspondence with each other thereafter to selectively evaluate in pixel or subpixel units, with high accuracy, similarity between the corresponding blocks to detect a picture in which coincidence is established wherein the block coincidence detecting step repeats, n number of times, detection and correction of a difference between mean values of luminance signals or detection and correction of a ratio between standard deviations of luminance signals, and block matching processing the corresponding block.
Claim 8
Dependent Claim
167 words
A picture coincidence detecting method of detecting coincidence between respective still pictures imaged by cameras having different resolutions, the method comprising the steps of: setting a block of a predetermined size within a lower resolution picture; setting a search range corresponding to the block on the higher resolution picture; globally searching the search range to find a candidate: and block coincidence detecting by setting a corresponding block including a candidate in pictures of lower resolution and higher resolution to make a correction such that mean levels or standard deviations of luminance signals are in correspondence with each other thereafter to selectively evaluate in pixel or subpixel units, with high accuracy, similarity between the corresponding blocks to detect a picture in which coincidence is established wherein the block coincidence detecting step repeats, n number of times, detection and correction of a difference between mean values of luminance signals or detection and correction of a ratio between standard deviations of luminance signals, and block matching processing the corresponding block.
Claim 9
Dependent Claim
184 words
A picture coincidence detecting method of detecting coincidence between respective still pictures imaged by cameras having different resolutions, the method comprising the steps of: setting a block of a predetermined size within a lower resolution picture; setting a search range corresponding to the block on a higher resolution picture; globally searching the search range to find a candidate; and block coincidence detecting by respectively setting corresponding blocks including the candidate to determine a difference between mean values or a ratio between standard deviations of luminance signals of a block within the lower resolution picture and a block within the higher resolution picture while allowing the corresponding blocks to be greater in a stepwise manner to successively selectively implement matching processing in pixel or subpixel units from larger blocks to smaller blocks of hierarchical plural blocks by using the difference or the ratio when the determined difference or ratio converges to detect a picture in which coincidences established wherein the block coincidence detecting step generates, by interpolation data between respective pixels of the first and second pictures to respectively set corresponding blocks including the candidate.
Claim 10
Dependent Claim
184 words
A picture coincidence detecting method of detecting coincidence between respective still pictures imaged by cameras having different resolutions, the method comprising the steps of: setting a block of a predetermined size within a lower resolution picture; setting a search range corresponding to the block on a higher resolution picture; globally searching the search range to find a candidate; and block coincidence detecting by respectively setting corresponding blocks including the candidate to determine a difference between mean values or a ratio between standard deviations of luminance signals of a block within the lower resolution picture and a block within the higher resolution picture while allowing the corresponding blocks to be greater in a stepwise manner to successively selectively implement matching processing in pixel or subpixel units from larger blocks to smaller blocks of hierarchical plural blocks by using the difference or the ratio when the determined difference or ratio converges to detect a picture in which coincidences established wherein the block coincidence detecting step generates, by interpolation data between respective pixels of the first and second pictures to respectively set corresponding blocks including the candidate.
Claim 11
Dependent Claim
38 words
A picture coincidence detecting apparatus as set forth in claim 1, wherein the block matching processing means generates, by interpolation, data between respective pixels of the first and second pictures thereafter to carry out the block matching processing.
Claim 12
Dependent Claim
23 words
A picture coincidence detecting apparatus as set forth in claim 1, wherein the first and second image pick-up elements image the same object.
Claim 13
Dependent Claim
25 words
A picture coincidence detecting apparatus as set forth in claim 7, wherein a marker indicating a pixel position of reference is attached to the object.
Claim 14
Dependent Claim
38 words
A picture coincidence detecting apparatus as set forth in claim 2, wherein the block matching processing means generates, by interpolation, data between respective pixels of the first and second pictures thereafter to carry out the block matching processing.
Claim 15
Dependent Claim
23 words
A picture coincidence detecting apparatus as set forth in claim 2, wherein the first and second image pick-up elements image the same object.
Claim 16
Dependent Claim
25 words
A picture coincidence detecting apparatus as set forth in claim 10, wherein a marker indicating a pixel position of reference is attached to the object.
Claim 17
Dependent Claim
44 words
A picture coincidence detecting method as set forth in claim 3, wherein, in the block coincidence detecting step, as a method of evaluating similarity between blocks of higher resolution picture and lower resolution picture, correlative coefficients between blocks are used to carry out evaluation.
Claim 18
Dependent Claim
47 words
A picture coincidence detecting method as set forth in claim 3, wherein, in the block coincidence detecting step, as a method of evaluating similarity between blocks of higher resolution picture and lower resolution picture, absolute value sum of differences between blocks is used to carry out evaluation.
Claim 19
Dependent Claim
46 words
A picture coincidence detecting method as set forth in claim 3, wherein, in the block coincidence detecting step, as a method of evaluating similarity between blocks of higher resolution picture and lower resolution picture, square sum of differences between blocks is used to carry out evaluation.
Claim 20
Dependent Claim
31 words
A picture coincidence detecting method as set forth in claim 4, wherein the block coincidence detecting step mathematically judges evaluation values in matching every rank to correct a matching candidate pixel.
Claim 21
Dependent Claim
58 words
A picture coincidence detecting method as set forth in claim 4, wherein the block coincidence detecting step adjusts block size and search area in matching so that an evaluation value of higher rank corresponding to an evaluation object pixel position of lower rank exists when evaluation value of higher rank is applied to evaluation value of lower rank.
References Cited (Backward Citations)
US4486775A
Cited
US5040223A
Cited
US4972499A
Cited
JPH02255990A
Cited
US5105467A
Cited
JPH04345394A
Cited
US5488674A
Cited
US5557684A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-05-18 | 2001-11-17 | 2002-05-19 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-05-18 | 2005-11-17 | 2006-05-19 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-05-18 | 2009-11-17 | 2010-05-19 | $7700.00 | Window Closed / Lapsed |