Patent US7164784B2 successfully refreshed from Google Patents.
← Back to Patent Explorer
US7164784B2 Expired / Lapsed US ⏱️ 0.0 years remaining

Edge chaining using smoothly-varying stereo disparity

Assignee: Mitsubishi Electric Research Laboratories Inc
•
Filing: 2002-07-30
•
Granted: 2007-01-16
•
Expires: 2022-07-30
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method links edges in stereo images into chains which correspond to physical contours in a scene. First, edges are detected in the stereo images. Edges between the stereo images are matched, such that each edge has associated stereo matches. The edges are linked into chains, such that each chained edge has a single associated stereo match, and neighboring edges in a chain have matches with a substantial similar stereo disparity.

Inventors

  • 👤 Paul Beardsley

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-06 11:37
CPC Classifications
G; G06; G06T; G06T17/00; G06T5/00; G06T5/50; G06T7/00; G06T7/10; G06T7/12; G06T7/174; G06T7/181; G06T7/50; G06T7/55; G06T7/593; G06V; G06V10/00; G06V10/20; G06V10/24; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/10021; G06T2207/30; G06T2207/30236; H; H04; H04N; H04N13/00; H04N2013/0074; H04N2013/0085

Claims Analysis

Total Claims: 8
Claim 1
Independent Claim 279 words
A method for linking edges in stereo images into chains which correspond to physical contours in a scene, comprising: detecting edges in the stereo images; matching edges between the stereo images, such that each edge has associated stereo matches; linking the edges into chains, such that each chained edge has a single associated stereo match, and neighboring edges in a chain have matches with a substantial similar stereo disparity; and in which the stereo images are acquired with more than two cameras, and further comprising: identifying one stereo image as a primary image and the remaining stereo images as secondary images; determining, for each edge in the primary image, an epipolar line relative to each of the secondary images; determining, for each such epipolar line, a difference in angle between an edge alignment and the epipolar line, and finding a maximum difference in angle over all the secondary images, and identifying the secondary image which is associated with a maximum difference as a target image; identifying the remaining secondary images as support images; measuring, for each edge in the primary image and the edges along the epipolar line in the target image, a difference in gradient direction, and rejecting any edges as matching if the difference is greater than a first threshold; otherwise measuring, for each edge in the primary image and the edges along the epipolar line in the target image, a difference between intensities of pixels neighboring the edges, and rejecting the edges as matching if the difference is greater than a second threshold, otherwise rejecting any edges as matching if there is no corresponding edge in the support images; and otherwise accepting the edges as matching.
Claim 2
Independent Claim 279 words
A method for linking edges in stereo images into chains which correspond to physical contours in a scene, comprising: detecting edges in the stereo images; matching edges between the stereo images, such that each edge has associated stereo matches; linking the edges into chains, such that each chained edge has a single associated stereo match, and neighboring edges in a chain have matches with a substantial similar stereo disparity; and in which the stereo images are acquired with more than two cameras, and further comprising: identifying one stereo image as a primary image and the remaining stereo images as secondary images; determining, for each edge in the primary image, an epipolar line relative to each of the secondary images; determining, for each such epipolar line, a difference in angle between an edge alignment and the epipolar line, and finding a maximum difference in angle over all the secondary images, and identifying the secondary image which is associated with a maximum difference as a target image; identifying the remaining secondary images as support images; measuring, for each edge in the primary image and the edges along the epipolar line in the target image, a difference in gradient direction, and rejecting any edges as matching if the difference is greater than a first threshold; otherwise measuring, for each edge in the primary image and the edges along the epipolar line in the target image, a difference between intensities of pixels neighboring the edges, and rejecting the edges as matching if the difference is greater than a second threshold, otherwise rejecting any edges as matching if there is no corresponding edge in the support images; and otherwise accepting the edges as matching.
Claim 3
Dependent Claim 18 words
The method of claim 1 wherein the neighboring pixels are aligned with a gradient direction of the edges.
Claim 4
Dependent Claim 48 words
The method of claim 1 further comprising: using the edges in the primary and target images to generate a pair of epipolar lines in each support image, and searching for the corresponding edge in the support image in a window around an intersection point of the epipolar lines.
Claim 5
Dependent Claim 46 words
The method of claim 1 further comprising: identifying each edge which has multiple associated stereo matches; examining, for each of those stereo matches, the associated edge chain; and marking a stereo match with a longest associated edge chain as accepted and rejecting the other stereo matches.
Claim 6
Dependent Claim 22 words
The method of claim 1 further comprising: linking only edges which have a difference in stereo disparity less than a third threshold.
Claim 7
Dependent Claim 18 words
The method of claim 1 further comprising: using the edge chains and matches to determine a 3D reconstruction.
Claim 8
Dependent Claim 27 words
The method of claim 6 wherein the scene includes multiple objects, and further comprising: segmenting the 3D reconstruction into individual reconstructions for each object in the scene.

References Cited (Backward Citations)

US5818959A Cited
US6173066B1 Cited
US6873723B1 Cited
US6339375B1 Cited
US6386325B1 Cited
US6718062B1 Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2010-01-15 2010-07-17 2011-01-16 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2014-01-15 2014-07-17 2015-01-16 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2018-01-15 2018-07-17 2019-01-16 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag