Patent US7164784B2 successfully refreshed from Google Patents.
US7164784B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Edge chaining using smoothly-varying stereo disparity
Assignee: Mitsubishi Electric Research Laboratories Inc
•
Filing: 2002-07-30
•
Granted: 2007-01-16
•
Expires: 2022-07-30
Abstract
Abstract A method links edges in stereo images into chains which correspond to physical contours in a scene. First, edges are detected in the stereo images. Edges between the stereo images are matched, such that each edge has associated stereo matches. The edges are linked into chains, such that each chained edge has a single associated stereo match, and neighboring edges in a chain have matches with a substantial similar stereo disparity.
Inventors
- 👤 Paul Beardsley
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-06 11:37
CPC Classifications
G; G06; G06T; G06T17/00; G06T5/00; G06T5/50; G06T7/00; G06T7/10; G06T7/12; G06T7/174; G06T7/181; G06T7/50; G06T7/55; G06T7/593; G06V; G06V10/00; G06V10/20; G06V10/24; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/10021; G06T2207/30; G06T2207/30236; H; H04; H04N; H04N13/00; H04N2013/0074; H04N2013/0085
Claims Analysis
Total Claims: 8
Claim 1
Independent Claim
279 words
A method for linking edges in stereo images into chains which correspond to physical contours in a scene, comprising: detecting edges in the stereo images; matching edges between the stereo images, such that each edge has associated stereo matches; linking the edges into chains, such that each chained edge has a single associated stereo match, and neighboring edges in a chain have matches with a substantial similar stereo disparity; and in which the stereo images are acquired with more than two cameras, and further comprising: identifying one stereo image as a primary image and the remaining stereo images as secondary images; determining, for each edge in the primary image, an epipolar line relative to each of the secondary images; determining, for each such epipolar line, a difference in angle between an edge alignment and the epipolar line, and finding a maximum difference in angle over all the secondary images, and identifying the secondary image which is associated with a maximum difference as a target image; identifying the remaining secondary images as support images; measuring, for each edge in the primary image and the edges along the epipolar line in the target image, a difference in gradient direction, and rejecting any edges as matching if the difference is greater than a first threshold; otherwise measuring, for each edge in the primary image and the edges along the epipolar line in the target image, a difference between intensities of pixels neighboring the edges, and rejecting the edges as matching if the difference is greater than a second threshold, otherwise rejecting any edges as matching if there is no corresponding edge in the support images; and otherwise accepting the edges as matching.
Claim 2
Independent Claim
279 words
A method for linking edges in stereo images into chains which correspond to physical contours in a scene, comprising: detecting edges in the stereo images; matching edges between the stereo images, such that each edge has associated stereo matches; linking the edges into chains, such that each chained edge has a single associated stereo match, and neighboring edges in a chain have matches with a substantial similar stereo disparity; and in which the stereo images are acquired with more than two cameras, and further comprising: identifying one stereo image as a primary image and the remaining stereo images as secondary images; determining, for each edge in the primary image, an epipolar line relative to each of the secondary images; determining, for each such epipolar line, a difference in angle between an edge alignment and the epipolar line, and finding a maximum difference in angle over all the secondary images, and identifying the secondary image which is associated with a maximum difference as a target image; identifying the remaining secondary images as support images; measuring, for each edge in the primary image and the edges along the epipolar line in the target image, a difference in gradient direction, and rejecting any edges as matching if the difference is greater than a first threshold; otherwise measuring, for each edge in the primary image and the edges along the epipolar line in the target image, a difference between intensities of pixels neighboring the edges, and rejecting the edges as matching if the difference is greater than a second threshold, otherwise rejecting any edges as matching if there is no corresponding edge in the support images; and otherwise accepting the edges as matching.
Claim 3
Dependent Claim
18 words
The method of claim 1 wherein the neighboring pixels are aligned with a gradient direction of the edges.
Claim 4
Dependent Claim
48 words
The method of claim 1 further comprising: using the edges in the primary and target images to generate a pair of epipolar lines in each support image, and searching for the corresponding edge in the support image in a window around an intersection point of the epipolar lines.
Claim 5
Dependent Claim
46 words
The method of claim 1 further comprising: identifying each edge which has multiple associated stereo matches; examining, for each of those stereo matches, the associated edge chain; and marking a stereo match with a longest associated edge chain as accepted and rejecting the other stereo matches.
Claim 6
Dependent Claim
22 words
The method of claim 1 further comprising: linking only edges which have a difference in stereo disparity less than a third threshold.
Claim 7
Dependent Claim
18 words
The method of claim 1 further comprising: using the edge chains and matches to determine a 3D reconstruction.
Claim 8
Dependent Claim
27 words
The method of claim 6 wherein the scene includes multiple objects, and further comprising: segmenting the 3D reconstruction into individual reconstructions for each object in the scene.
References Cited (Backward Citations)
US5818959A
Cited
US6173066B1
Cited
US6873723B1
Cited
US6339375B1
Cited
US6386325B1
Cited
US6718062B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2010-01-15 | 2010-07-17 | 2011-01-16 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2014-01-15 | 2014-07-17 | 2015-01-16 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2018-01-15 | 2018-07-17 | 2019-01-16 | $7700.00 | Window Closed / Lapsed |