US5930383A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Depth sensing camera systems and methods
Assignee: Individual
•
Filing: 1996-09-24
•
Granted: 1999-07-27
•
Expires: 2016-09-24
Abstract
Abstract This invention relates to a method and apparatus for sensing a three-dimensional (depth and illuminance) image of a scene. It is based on the inverse-square law relating the incident brightness on an area illuminated by a light point source, to its distance from the point source. In the preferred embodiment of the invention the scene is sequentially illuminated by more than one light point source each at a pre calibrated location in the reference coordinate system. The resulting reflections from the field of-view are sensed by a stationary digital camera that maps each scene element into a corresponding image pixel, to provide a 2-dimensional brightness map that contains the photometric values of each image pixel for each specific illumination. Each pixel photometric value depends on the illumination incident on the corresponding scene element which, in itself, is further determined by the element inherent Lambertian reflectance-coefficient at the illumination wavelength, the element orientation relative to the coordinate system, and the element illuminance as determined by the point source brightness and the distance separating the point source and the scene element. Each brightness map is different from its sequel due to the differing point-source locations. By manipulating the brightness maps the spatial location of each scene element relative to the fixed point sources is determined, thus yielding a depth-image as well as a brightness-image.
Inventors
- 👤 Yishay Netzer
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-08 21:44
CPC Classifications
G; G01; G01C; G01C11/00; G01C11/02; G01B; G01B11/00; G01B11/24
Claims Analysis
Total Claims: 15
Claim 1
Independent Claim
226 words
A method for deriving depth information associated with pixels of an image sensed by a digital camera, each pixel corresponding to a surface element of a subject scene, the method comprising the steps of: (a) generating a first intensity map of the subject scene while substantially the entirety of the subject scene is illuminated by a first light source positioned in a first known geometrical relation to the digital camera; (b) generating a second intensity map of the subject scene while substantially the entirety of the subject scene is illuminated by a second light source positioned in a second known geometrical relation to the digital camera; (c) generating a third intensity map of the subject scene while substantially the entirety of the subject scene is illuminated by a third light source positioned in a third known geometrical relation to the digital camera; (d) generating a fourth intensity map of the subject scene while substantially the entirety of the subject scene is illuminated by a fourth light source positioned in a fourth known geometrical relation to the digital camera; and (e) processing the measured intensity values of corresponding pixels of said first, second, third and fourth intensity maps to derive information relating to the depth of the corresponding surface element of the subject scene, said processing being based upon an inverse square relation between distance and intensity.
Claim 2
Independent Claim
226 words
A method for deriving depth information associated with pixels of an image sensed by a digital camera, each pixel corresponding to a surface element of a subject scene, the method comprising the steps of: (a) generating a first intensity map of the subject scene while substantially the entirety of the subject scene is illuminated by a first light source positioned in a first known geometrical relation to the digital camera; (b) generating a second intensity map of the subject scene while substantially the entirety of the subject scene is illuminated by a second light source positioned in a second known geometrical relation to the digital camera; (c) generating a third intensity map of the subject scene while substantially the entirety of the subject scene is illuminated by a third light source positioned in a third known geometrical relation to the digital camera; (d) generating a fourth intensity map of the subject scene while substantially the entirety of the subject scene is illuminated by a fourth light source positioned in a fourth known geometrical relation to the digital camera; and (e) processing the measured intensity values of corresponding pixels of said first, second, third and fourth intensity maps to derive information relating to the depth of the corresponding surface element of the subject scene, said processing being based upon an inverse square relation between distance and intensity.
Claim 3
Dependent Claim
20 words
The method of claim 1, further comprising employing a smoothing algorithm for rejecting local depth errors due to specular reflection.
Claim 4
Dependent Claim
50 words
The method of claim 1, further comprising generating additional intensity maps of the subject scene while the subject scene is illuminated by additional light sources each positioned in different known geometrical relation to the digital camera so as to minimize the chance of erroneous depth calculation due to specular reflection.
Claim 5
Dependent Claim
41 words
The method of claim 1, further comprising generating a calibration intensity map of the subject scene illuminated only by background illumination, and wherein said processing includes subtracting said calibration intensity map from each of said first, second, and third intensity maps.
Claim 6
Dependent Claim
30 words
The method of claim 1, wherein each of said first, second, third and fourth light sources approximates to a point source with respect to the area of the object scene.
Claim 7
Dependent Claim
23 words
The method of claim 1, wherein said processing derives information relating to the orientation of said corresponding surface element of the subject scene.
Claim 8
Dependent Claim
25 words
The method of claim 1, wherein said processing derives information relating to the Lambertian reflection coefficient of said corresponding surface element of the subject scene.
Claim 9
Dependent Claim
238 words
A depth sensing camera system for generating three-dimensional information about an object scene, the system comprising: (a) a digital camera having a field of view including the object scene; (b) a first light source positioned in a first known geometrical relation to said digital camera for illuminating substantially the entirety of the object scene; (c) a second light source positioned in a second known geometrical relation to said digital camera for illuminating substantially the entirety of the object scene; (d) a third light source positioned in a third known geometrical relation to said digital camera for illuminating substantially the entirety of the object scene; (e) a fourth light source positioned in a fourth known geometrical relation to said digital camera for illuminating substantially the entirety of the object scene; (f) a control system for sequentially activating each of said light sources such that said digital camera generates a first image of the object scene illuminated by said first light source, a second image of the object scene illuminated by said second light source, a third image of the object scene illuminated by said third light source, and a fourth image of the object scene illuminated by said fourth light source; and (g) a processor configured to process said first, second, third and fourth images based upon an inverse square relation between distance and intensity to derive depth information relating to at least some points of the object scene.
Claim 10
Dependent Claim
238 words
A depth sensing camera system for generating three-dimensional information about an object scene, the system comprising: (a) a digital camera having a field of view including the object scene; (b) a first light source positioned in a first known geometrical relation to said digital camera for illuminating substantially the entirety of the object scene; (c) a second light source positioned in a second known geometrical relation to said digital camera for illuminating substantially the entirety of the object scene; (d) a third light source positioned in a third known geometrical relation to said digital camera for illuminating substantially the entirety of the object scene; (e) a fourth light source positioned in a fourth known geometrical relation to said digital camera for illuminating substantially the entirety of the object scene; (f) a control system for sequentially activating each of said light sources such that said digital camera generates a first image of the object scene illuminated by said first light source, a second image of the object scene illuminated by said second light source, a third image of the object scene illuminated by said third light source, and a fourth image of the object scene illuminated by said fourth light source; and (g) a processor configured to process said first, second, third and fourth images based upon an inverse square relation between distance and intensity to derive depth information relating to at least some points of the object scene.
Claim 11
Dependent Claim
18 words
The system as in claim 8, wherein said first, second and third light sources are arranged substantially collinearly.
Claim 12
Dependent Claim
26 words
The system as in claim 8, wherein each of said light sources approximates to a point source with respect to the area of the object scene.
Claim 13
Dependent Claim
14 words
The system of claim 8, wherein each of said light sources is an LED.
Claim 14
Dependent Claim
16 words
The system of claim 8, wherein each of said light sources is an illuminated optical fiber.
Claim 15
Dependent Claim
46 words
The system of claim 8, wherein said digital camera is a line detector employing a linear array of detector elements, the system further comprising means for generating relative movement of the object scene relative to said digital camera in a direction perpendicular to said linear array.
References Cited (Backward Citations)
US3775735A
Cited
US4601053A
Cited
US4687325A
Cited
US4873651A
Cited
US4963017A
Cited
US5513276A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-07-26 | 2003-01-25 | 2003-07-27 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-07-26 | 2007-01-25 | 2007-07-27 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-07-26 | 2011-01-25 | 2011-07-27 | $7700.00 | Window Closed / Lapsed |