US5768443A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method for coordinating multiple fields of view in multi-camera
Assignee: Cognex Corp
•
Filing: 1995-12-19
•
Granted: 1998-06-16
•
Expires: 2015-12-19
Abstract
Abstract A method is provided for use in a multi-camera machine vision system wherein each of a plurality of cameras simultaneously acquires an image of a different portion of an object of interest. The invention makes it possible to precisely coordinate the fields of view of the plurality of cameras so that accurate measurements can be precisely performed across multiple fields of view, even in the presence of image distortion within each field of view. The method includes the steps of, at calibration-time, fixing the plurality of cameras with respect to a substantially rigid dimensionally-stable substrate including a plurality of calibration targets each having a reference feature. For each camera, an image of a calibration target is acquired to provide a plurality of acquired calibration target images. Then a distortion-correction map is generated for each acquired calibration target image. At run-time, for each camera, an image is acquired, at least two of the images including a portion of the object to provide a plurality of partial object images. These partial object images are then transformed by a distortion-correction map to provide a plurality of corrected partial object images. Next, relative displacement information is used to determine the relative displacement of a first point in a first corrected partial object image with respect to a second point in a second corrected partial object image. A combined map can be generated that both corrects image distortion, and transforms local camera coordinates into global coordinates.
Inventors
- 👤 David Michael
- 👤 Aaron Wallack
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-06 00:03
CPC Classifications
G; G06; G06T; G06T5/00; G06T5/80; G06T7/00; G06T7/80; G06T7/85; G01; G01N; G01N21/00; G01N21/84; G01N21/88; G01N21/95
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
219 words
A method for precisely coordinating multiple fields of view of a plurality of fixed cameras so as to facilitate determining the distance between features each disposed within a different field of view, the method being especially useful when there is image distortion in each field of view, the method comprising the steps of: at calibration-time, fixing a substantially rigid dimensionally-stable substrate including a plurality of calibration targets each having a reference feature, such that a calibration target is within the field of view of each said camera; acquiring relative displacement information regarding at least the linear displacement of each said reference feature with respect to at least one other said reference feature; for each camera, acquiring an image of a calibration target to provide a plurality of acquired calibration target images; generating an image distortion-correction map for each acquired calibration target image, and at run-time, for each camera, acquiring an image of a portion of said object to provide a plurality of partial object images; applying said image distortion-correction map to each partial object image to provide a plurality of corrected partial object images; and using said relative displacement information to determine the relative displacement of a first point in a first corrected partial object image with respect to a second point in a second corrected partial object image.
Claim 2
Independent Claim
219 words
A method for precisely coordinating multiple fields of view of a plurality of fixed cameras so as to facilitate determining the distance between features each disposed within a different field of view, the method being especially useful when there is image distortion in each field of view, the method comprising the steps of: at calibration-time, fixing a substantially rigid dimensionally-stable substrate including a plurality of calibration targets each having a reference feature, such that a calibration target is within the field of view of each said camera; acquiring relative displacement information regarding at least the linear displacement of each said reference feature with respect to at least one other said reference feature; for each camera, acquiring an image of a calibration target to provide a plurality of acquired calibration target images; generating an image distortion-correction map for each acquired calibration target image, and at run-time, for each camera, acquiring an image of a portion of said object to provide a plurality of partial object images; applying said image distortion-correction map to each partial object image to provide a plurality of corrected partial object images; and using said relative displacement information to determine the relative displacement of a first point in a first corrected partial object image with respect to a second point in a second corrected partial object image.
Claim 3
Dependent Claim
25 words
The method of claim 1, wherein at run-time, the step of acquiring an image includes acquiring an image from each of at least three cameras.
Claim 4
Dependent Claim
40 words
The method of claim 1, further including the step of: at calibration time, acquiring absolute displacement information regarding at least the linear displacement of at least one said reference feature with respect to a reference feature of a mechanical device.
Claim 5
Dependent Claim
33 words
The method of claim 3, wherein said substrate is transparent, and the step of acquiring absolute displacement information includes the step of viewing said reference feature of said mechanical device through said substrate.
Claim 6
Dependent Claim
28 words
The method of claim 1, wherein the step of acquiring an image of a calibration target includes the step of acquiring an image of an array of dots.
Claim 7
Dependent Claim
28 words
The method of claim 1, wherein the step of acquiring an image of a calibration target includes the step of acquiring the image of a grid of lines.
Claim 8
Dependent Claim
35 words
The method of claim 1, wherein the step of acquiring an image of a calibration target includes the step of acquiring an image of two non-parallel lines for indicating an origin of said calibration target.
Claim 9
Dependent Claim
19 words
The method of claim 1, wherein said step of acquiring relative displacement information includes acquiring relative angular displacement information.
Claim 10
Dependent Claim
23 words
The method of claim 1, wherein said step of generating a distortion-correction map includes the step of determining the coefficients of a polynomial.
Claim 11
Dependent Claim
26 words
The method of claim 9, wherein said step of determining the coefficients of a polynomial includes the step of determining the coefficients of a fifth-order polynomial.
Claim 12
Dependent Claim
32 words
The method of claim 1, wherein said step of generating a distortion correction map includes the step of pre-computing said distortion correction map and storing the results so-computed in a look-up table.
Claim 13
Dependent Claim
25 words
The method of claim 1, wherein the step of applying said distortion-correction map includes the step of reading a correction parameter in a look-up table.
Claim 14
Independent Claim
175 words
A method for precisely coordinating multiple fields of view of a plurality of fixed cameras so as to facilitate determining the distance between features each disposed within a different field of view, the method being especially useful when there is image distortion in each field of view, the method comprising the steps of: at calibration-time, fixing a plurality of cameras with respect to a calibration plate including a plurality of calibration targets; for each camera, generating an image distortion-correction map; for each camera, generating a transformation of camera coordinates into global coordinates; and at run-time, for each camera, acquiring an image of a portion of said object to provide a plurality of partial object images; applying said image distortion-correction map to each partial object image to provide a plurality of corrected partial object images; and using said transformation of camera coordinates into global coordinates to determine the relative displacement of a first feature point in a first corrected partial object image with respect to a second feature point in a second corrected partial object image.
Claim 15
Independent Claim
175 words
A method for precisely coordinating multiple fields of view of a plurality of fixed cameras so as to facilitate determining the distance between features each disposed within a different field of view, the method being especially useful when there is image distortion in each field of view, the method comprising the steps of: at calibration-time, fixing a plurality of cameras with respect to a calibration plate including a plurality of calibration targets; for each camera, generating an image distortion-correction map; for each camera, generating a transformation of camera coordinates into global coordinates; and at run-time, for each camera, acquiring an image of a portion of said object to provide a plurality of partial object images; applying said image distortion-correction map to each partial object image to provide a plurality of corrected partial object images; and using said transformation of camera coordinates into global coordinates to determine the relative displacement of a first feature point in a first corrected partial object image with respect to a second feature point in a second corrected partial object image.
Claim 16
Dependent Claim
40 words
The method of claim 13, further including the step of: at calibration time, acquiring absolute displacement information regarding at least the linear displacement of at least one said reference feature with respect to a reference feature of a mechanical device.
Claim 17
Dependent Claim
23 words
The method of claim 13, wherein said step of generating a distortion-correction map includes the step of determining the coefficients of a polynomial.
Claim 18
Dependent Claim
32 words
The method of claim 13, wherein said step of generating a distortion correction map includes the step of pre-computing said distortion correction map and storing the results so-computed in a look-up table.
Claim 19
Independent Claim
208 words
A method for precisely coordinating multiple fields of view of a plurality of fixed cameras so as to facilitate determining the distance between features each disposed within a different field of view, the method being especially useful when there is image distortion in each field of view, the method comprising the steps of: at calibration-time, fixing a plurality of cameras with respect to a calibration plate including a plurality of calibration targets; for each camera, generating an image distortion-correction map using said plurality of calibration targets; for each camera, generating a transformation of local camera coordinates into global coordinates using said plurality of calibration targets; combining said image distortion-correction map and said transformation of local camera coordinates into global coordinates to provide a corrected local-to-global map for determining the distance between features each disposed within a different field of view, even when there is image distortion in each field of view; and at run-time, for each camera, acquiring an image of a portion of said object to provide a plurality of partial object images; applying said corrected local-to-global map to determine the relative displacement of a first feature point in a first partial object image with respect to a second feature point in a second partial object image.
Claim 20
Independent Claim
208 words
A method for precisely coordinating multiple fields of view of a plurality of fixed cameras so as to facilitate determining the distance between features each disposed within a different field of view, the method being especially useful when there is image distortion in each field of view, the method comprising the steps of: at calibration-time, fixing a plurality of cameras with respect to a calibration plate including a plurality of calibration targets; for each camera, generating an image distortion-correction map using said plurality of calibration targets; for each camera, generating a transformation of local camera coordinates into global coordinates using said plurality of calibration targets; combining said image distortion-correction map and said transformation of local camera coordinates into global coordinates to provide a corrected local-to-global map for determining the distance between features each disposed within a different field of view, even when there is image distortion in each field of view; and at run-time, for each camera, acquiring an image of a portion of said object to provide a plurality of partial object images; applying said corrected local-to-global map to determine the relative displacement of a first feature point in a first partial object image with respect to a second feature point in a second partial object image.
Claim 21
Dependent Claim
27 words
The method of claim 17, further including the step of: at calibration time, acquiring absolute displacement information with respect to a reference feature of a mechanical device.
Claim 22
Dependent Claim
24 words
The method of claim 17, wherein said step of generating an image distortion-correction map includes the step of determining the coefficients of a polynomial.
Claim 23
Dependent Claim
34 words
The method of claim 17, wherein said step of generating an image distortion correction map includes the step of pre-computing said image distortion correction map and storing the results so-computed in a look-up table.
References Cited (Backward Citations)
US4847911A
Cited
US5325443A
Cited
US5145432A
Cited
US5542002A
Cited
US5611000A
Cited
US5528290A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-06-15 | 2001-12-15 | 2002-06-16 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-06-15 | 2005-12-15 | 2006-06-16 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-06-15 | 2009-12-15 | 2010-06-16 | $7700.00 | Window Closed / Lapsed |