US6028672A
Expired / Lapsed
US
⏱️ 0.0 years remaining
High speed three dimensional imaging method
Assignee: Technest Holdings Inc
•
Filing: 1996-09-30
•
Granted: 2000-02-22
•
Expires: 2016-09-30
Abstract
Abstract The target of the present invention is to provide a high speed, low-cost, multi-mode three-dimensional (3D) surface profile measurement method. The proposed Rainbow Stereo 3D Camera exploits the projected color light with a spatially distributed wavelength spectrum on the surface of objects in the scene. Multiple color imaging sensors separated by a baseline distance are used to capture stereo pair images of the scene at camera's frame rate. The 3D depth values are calculated using triangulation principle by finding pixels corresponding to a common color feature in both images. Unlike conventional stereo correspondence matching algorithms, which requires the feature extraction from a group of pixels, the proposed method utilizes a projected rainbow color pattern as unique landmarks of each pixel for correspondence registration. Essentially, the colors of pixels in a pair of stereo images are used as a "token" to perform the stereo match. Searching corresponding point in a pair of stereo images becomes a straightforward pixel-to-pixel color matching. A simple and efficient 3D triangulation algorithm can be formulated to generate full frames of 3D images in high speed.
Inventors
- 👤 Zheng Jason Geng
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-25 05:43
CPC Classifications
G; G01; G01B; G01B11/00; G01B11/24; G01B11/25; G01B11/2509; G01B11/02; G01B11/022; G01S; G01S17/00; G01S17/02; G01S17/06; G01S17/42; G06; G06T; G06T7/00; G06T7/50; G06T7/521
Claims Analysis
Total Claims: 9
Claim 1
Independent Claim
257 words
An apparatus for obtaining 3D image of objects in a scene, comprising (a) a light projection means for generating a bundle of light rays with spatially varying wavelengths to illuminate surface of objects in the scene such that spatially varying color patterns are formed on the surface of objects through the light projection, and (b) a sensor means for acquiring images of objects in the scene from multiple viewing locations, based on which the wavelengths can be detected of light rays reflected from objects' surface that is illuminated by said light projection means, and (c) a calibration means for determining the geometric and optical parameters of the said sensor means at multiple viewing locations, and (d) a data comparison means for matching the correspondence pixels in multiple data sets obtained from the said sensor means based on their wavelength values and/or local color patterns, and (e) a data extraction means for computing distances in the 3D space between sensor means and surface points in the scene, and therefore determining 3D coordinates of surface points of objects in the scene, based on information of (i) locations of the matched correspondence points in multiple images obtained by the said sensor means based on color comparison, and (ii) geometric and optical parameters of the said sensor means obtained by the said calibration means, whereby 3D images, in which each pixel value represents a 3D distance between the said sensor means and a surface point on objects in the scene that corresponds to the pixel, can be obtained using triangulation principle.
Claim 2
Independent Claim
257 words
An apparatus for obtaining 3D image of objects in a scene, comprising (a) a light projection means for generating a bundle of light rays with spatially varying wavelengths to illuminate surface of objects in the scene such that spatially varying color patterns are formed on the surface of objects through the light projection, and (b) a sensor means for acquiring images of objects in the scene from multiple viewing locations, based on which the wavelengths can be detected of light rays reflected from objects' surface that is illuminated by said light projection means, and (c) a calibration means for determining the geometric and optical parameters of the said sensor means at multiple viewing locations, and (d) a data comparison means for matching the correspondence pixels in multiple data sets obtained from the said sensor means based on their wavelength values and/or local color patterns, and (e) a data extraction means for computing distances in the 3D space between sensor means and surface points in the scene, and therefore determining 3D coordinates of surface points of objects in the scene, based on information of (i) locations of the matched correspondence points in multiple images obtained by the said sensor means based on color comparison, and (ii) geometric and optical parameters of the said sensor means obtained by the said calibration means, whereby 3D images, in which each pixel value represents a 3D distance between the said sensor means and a surface point on objects in the scene that corresponds to the pixel, can be obtained using triangulation principle.
Claim 3
Dependent Claim
81 words
An apparatus as recited in claim 1, wherein the surface illumination is generated by a light projection means selected from the group consisting of: (a) a light source and a variable wavelength filter, (b) a light source and a prism, (c) a light source and a diffraction grating, (d) liquid crystal device (LCD) projectors, and (e) a slice film projector and color slices, for producing a bundle of light rays spreading simultaneously more than one dimensions and with spatially varying wavelengths.
Claim 4
Independent Claim
272 words
An apparatus for obtaining 3D image of objects in a scene, comprising (a) a light projection means for generating a bundle of light rays with spatially varying wavelengths to illuminate surface of objects in the scene such that spatially varying wavelength patterns are formed on the surface of objects through the light projection, and (b) a sensor means comprises a set of multiple color CCD cameras that provide a set of multiple stereo color images of objects in the scene from multiple viewing locations, based on which the wavelengths can be detected of light rays reflected from objects' surface that is illuminated by said light projection means, and (c) a calibration means for determining the geometric and optical parameters of the said sensor means at multiple viewing locations, and (d) a data comparison means for matching the correspondence pixels in multiple data sets obtained from the said sensor means based on their wavelength values and/or local color patterns, and (e) a data extraction means for computing distances in the 3D space between the sensor means and surface points in the scene, and therefore determining 3D coordinates of surface points of objects in the scene, based on information of (i) locations of the matched correspondence points in multiple images obtained by the said sensor means based on color comparison, and (ii) geometric and optical parameters of the said sensor means obtained by the said calibration means, whereby 3D images, in which each pixel value represents a 3D distance between the said sensor means and a surface point of objects in the scene that corresponds to the pixel, can be obtained using triangulation principle.
Claim 5
Independent Claim
272 words
An apparatus for obtaining 3D image of objects in a scene, comprising (a) a light projection means for generating a bundle of light rays with spatially varying wavelengths to illuminate surface of objects in the scene such that spatially varying wavelength patterns are formed on the surface of objects through the light projection, and (b) a sensor means comprises a set of multiple color CCD cameras that provide a set of multiple stereo color images of objects in the scene from multiple viewing locations, based on which the wavelengths can be detected of light rays reflected from objects' surface that is illuminated by said light projection means, and (c) a calibration means for determining the geometric and optical parameters of the said sensor means at multiple viewing locations, and (d) a data comparison means for matching the correspondence pixels in multiple data sets obtained from the said sensor means based on their wavelength values and/or local color patterns, and (e) a data extraction means for computing distances in the 3D space between the sensor means and surface points in the scene, and therefore determining 3D coordinates of surface points of objects in the scene, based on information of (i) locations of the matched correspondence points in multiple images obtained by the said sensor means based on color comparison, and (ii) geometric and optical parameters of the said sensor means obtained by the said calibration means, whereby 3D images, in which each pixel value represents a 3D distance between the said sensor means and a surface point of objects in the scene that corresponds to the pixel, can be obtained using triangulation principle.
Claim 6
Dependent Claim
81 words
An apparatus as recited in claim 3, wherein the surface illumination is generated by a light projection means selected from the group consisting of: (a) a light source and a variable wavelength filter, (b) a light source and a prism, (c) a light source and a diffraction grating, (d) liquid crystal device (LCD) projectors, and (e) a slice film projector and color slices, for producing a bundle of light rays spreading simultaneously more than one dimensions and with spatially varying wavelengths.
Claim 7
Independent Claim
280 words
An apparatus for obtaining 3D image of objects in a scene, comprising (a) a light projection means for generating a bundle of light rays with spatially varying wavelengths to illuminate surface of objects in the scene such that spatially varying wavelength patterns are formed on the surface of objects through the light projection, and (b) a sensor means comprises single color CCD camera with a multiple image collecting means, which enables the single camera to capture color images of objects in the scene from multiple viewing points to form stereo image pairs, based on which the wavelengths can be detected of light rays reflected from objects' surface that is illuminated by said light projection means, and (c) a calibration means for determining the geometric and optical parameters of the said sensor means at multiple viewing locations, and (d) a data comparison means for matching the correspondence pixels in multiple data sets obtained from the said sensor means based on their wavelength values and/or local color patterns, and (e) a data extraction means for computing distances in the 3D space between the sensor means and surface points in the scene, and therefore determining 3D coordinates of surface points of objects in the scene, based on information of (i) locations of the matched correspondence points in multiple images obtained by the said sensor means based on color comparison, and (ii) geometric and optical parameters of the said sensor means obtained by the said calibration means, whereby 3D images, in which each pixel value represents a 3D distance between the said sensor means and a surface point of objects in the scene that corresponds to the pixel, can be obtained using triangulation principle.
Claim 8
Independent Claim
280 words
An apparatus for obtaining 3D image of objects in a scene, comprising (a) a light projection means for generating a bundle of light rays with spatially varying wavelengths to illuminate surface of objects in the scene such that spatially varying wavelength patterns are formed on the surface of objects through the light projection, and (b) a sensor means comprises single color CCD camera with a multiple image collecting means, which enables the single camera to capture color images of objects in the scene from multiple viewing points to form stereo image pairs, based on which the wavelengths can be detected of light rays reflected from objects' surface that is illuminated by said light projection means, and (c) a calibration means for determining the geometric and optical parameters of the said sensor means at multiple viewing locations, and (d) a data comparison means for matching the correspondence pixels in multiple data sets obtained from the said sensor means based on their wavelength values and/or local color patterns, and (e) a data extraction means for computing distances in the 3D space between the sensor means and surface points in the scene, and therefore determining 3D coordinates of surface points of objects in the scene, based on information of (i) locations of the matched correspondence points in multiple images obtained by the said sensor means based on color comparison, and (ii) geometric and optical parameters of the said sensor means obtained by the said calibration means, whereby 3D images, in which each pixel value represents a 3D distance between the said sensor means and a surface point of objects in the scene that corresponds to the pixel, can be obtained using triangulation principle.
Claim 9
Independent Claim
81 words
An apparatus as recited in claims 5, wherein the surface illumination is generated by a light projection means selected from the group consisting of: (a) a light source and a variable wavelength filter, (b) a light source and a prism, (c) a light source and a diffraction grating, (d) liquid crystal device (LCD) projectors, and (e) a slice film projector and color slices, for producing a bundle of light rays spreading simultaneously more than one dimensions and with spatially varying wavelengths.
References Cited (Backward Citations)
JPS5256556A
Cited
JPH02110305A
Cited
US5018854A
Cited
US5135309A
Cited
US5237404A
Cited
US5381235A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-02-21 | 2003-08-23 | 2004-02-22 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-02-21 | 2007-08-23 | 2008-02-22 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-02-21 | 2011-08-23 | 2012-02-22 | $7700.00 | Window Closed / Lapsed |