Patent US6171909B1 successfully refreshed from Google Patents.
Patent US6323942B1 successfully refreshed from Google Patents.
US6323942B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
CMOS-compatible three-dimensional image sensor IC
Assignee: Microsoft Technology Licensing LLC
•
Filing: 1999-09-22
•
Granted: 2001-11-27
•
Expires: 2019-09-22
Abstract
Abstract A three-dimensional imaging system includes a two-dimensional array of pixel light sensing detectors and dedicated electronics and associated processing circuitry fabricated on a common IC using CMOS fabrication techniques. In one embodiment, each detector has an associated high speed counter that accumulates clock pulses in number directly proportional to time of flight (TOF) for a system-emitted pulse to reflect from an object point and be detected by a pixel detector focused upon that point. The TOF data provides a direct digital measure of distance from the particular pixel to a point on the object reflecting the emitted light pulse. In a second embodiment, the counters and high speed clock circuits are eliminated, and instead each pixel detector is provided with a charge accumulator and an electronic shutter. The shutters are opened when a light pulse is emitted and closed thereafter such that each pixel detector accumulates charge as a function of return photon energy falling upon the associated pixel detector. The amount of accumulated charge provides a direct measure of round-trip TOF. In either embodiment, the collection of TOF data permits reconstruction of the three-dimensional topography of the light-reflecting surface of the object being imaged. The CMOS nature of the array permits random-order readout of TOF data if desired. Using a light source of a known wavelength and filtering out incoming light of other wavelengths permits use of the system with or without ambient light.
Inventors
- 👤 Cyrus Bamji
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-31 15:56
CPC Classifications
G; G01; G01C; G01C3/00; G01C3/02; G01C3/06; G01C3/08; G01S; G01S17/00; G01S17/02; G01S17/06; G01S17/08; G01S17/10; G01S17/14; G01S17/46; G01S17/88; G01S17/89; G01S17/894; G01S7/00; G01S7/48; G01S7/483; G01S7/486; G01S7/497; G06; G06V; G06V30/00; G06V30/10; G06V30/22; G06V30/228; H; H04; H04N; H04N25/00; H04N25/50; H04N25/53; G01S7/4802
Claims Analysis
Total Claims: 29
Claim 1
Independent Claim
209 words
A method to determine distance Z within resolution ΔZ between at least one pixel detector and a target less than about 100 m distant, the method comprising the following steps: (a) disposing said at least one pixel detector so as to detect optical energy reflected from said target, each said pixel detector having a pixel integration delay time exceeding 2·ΔZ/C, where C is speed of light, and for each said pixel detector disposing an associated pixel time interval counter; (b) illuminating said target at time t0 with at least a first pulse of optical energy from an energy source; (c) starting each said pixel time interval counter at said time t0 to count a clock signal operating at frequency at least about C/(2·ΔZ); (d) halting each said pixel time interval counter when an associated said pixel detector detects optical energy reflected from said target resulting from said first pulse; wherein detection time for said pixel detector includes actual time of flight (TOF) from said energy source to said target to said pixel detector, as well as pixel integration delay time for said pixel detector; and (e) removing said pixel integration delay time on a per pixel detector basis to obtain said actual TOF, whereby said distance Z is obtained.
Claim 2
Independent Claim
209 words
A method to determine distance Z within resolution ΔZ between at least one pixel detector and a target less than about 100 m distant, the method comprising the following steps: (a) disposing said at least one pixel detector so as to detect optical energy reflected from said target, each said pixel detector having a pixel integration delay time exceeding 2·ΔZ/C, where C is speed of light, and for each said pixel detector disposing an associated pixel time interval counter; (b) illuminating said target at time t0 with at least a first pulse of optical energy from an energy source; (c) starting each said pixel time interval counter at said time t0 to count a clock signal operating at frequency at least about C/(2·ΔZ); (d) halting each said pixel time interval counter when an associated said pixel detector detects optical energy reflected from said target resulting from said first pulse; wherein detection time for said pixel detector includes actual time of flight (TOF) from said energy source to said target to said pixel detector, as well as pixel integration delay time for said pixel detector; and (e) removing said pixel integration delay time on a per pixel detector basis to obtain said actual TOF, whereby said distance Z is obtained.
Claim 3
Dependent Claim
50 words
The method of claim 1 , wherein step (a) includes disposing an array of pixel detectors, each pf said pixel detectors having a pixel integration delay time exceeding 2·ΔZ/C, where C is speed of light; said array including for each of said pixel detectors an associated pixel time interval counter.
Claim 4
Dependent Claim
23 words
The method of claim 1 , wherein step (e) results in a direct digital measurement of time when said pixel detector detects energy.
Claim 5
Dependent Claim
13 words
The method of claim 1 , wherein said clock signal exceeds 100 MHz.
Claim 6
Dependent Claim
19 words
The method of claim 1 , wherein said pixel time interval counter is a pseudo random sequence digital counter.
Claim 7
Dependent Claim
23 words
The method of claim 1 , wherein said pixel time interval counter is a true single phase clocked pseudo random sequence digital counter.
Claim 8
Dependent Claim
17 words
The method of claim 1 , wherein said pixel time interval counter includes sub-clock period capacitor charging.
Claim 9
Dependent Claim
23 words
The method of claim 2 , wherein information detected by said pixel detectors in said array may be randomly readout from said array.
Claim 10
Dependent Claim
37 words
The method of claim 1 , wherein step (b) includes outputting optical energy pulses of varying amplitude, and wherein step (e) uses reflected energy from said pulses of varying amplitude to determine said pixel integration delay time.
Claim 11
Dependent Claim
31 words
The method of claim 1 , further including: outputting multiple optical energy pulses; and averaging detection time for each said pulse to enhance signal/noise ratio in said determining said distance Z.
Claim 12
Dependent Claim
29 words
The method of claim 1 , wherein at least one of step (a), step (c), step (d), and step (e) are carried out on a common integrated circuit substrate.
Claim 13
Dependent Claim
243 words
A CMOS-implementable integrated circuit (IC) time of flight (TOF) measurement system used with a generator that outputs light pulses commencing at time t0 to determine distance Z within resolution ΔZ between said IC and a target less than about 100 m distant, the IC including: an array comprising a plurality of pixel detectors to detect generated light pulse energy returned from said target, each of said pixel detectors having a pixel integration delay time exceeding 2·ΔZ/C, where C is speed of light, said array further comprising for each of said pixel detectors an associated pixel time interval counter; a system clock providing countable clock pulses to each said pixel time interval counter, said clock having a frequency at least about C/(2·ΔZ); logic to enable each said pixel time interval counter to count said clock pulses commencing with start of a generated light pulse at said time t0, and to disable each said pixel time interval counter from further counting clock pulses when an associated pixel detector detects energy from the generated said light pulse; wherein detection time for each said pixel detector includes actual time of flight (TOF) from said generator to said target to said pixel detector, as well as pixel integration delay time for said pixel detector; and wherein said pixel integration delay time may be removed on a per pixel detector basis to obtain said actual TOF such that a direct digital measurement proportional to said distance Z is obtained.
Claim 14
Dependent Claim
243 words
A CMOS-implementable integrated circuit (IC) time of flight (TOF) measurement system used with a generator that outputs light pulses commencing at time t0 to determine distance Z within resolution ΔZ between said IC and a target less than about 100 m distant, the IC including: an array comprising a plurality of pixel detectors to detect generated light pulse energy returned from said target, each of said pixel detectors having a pixel integration delay time exceeding 2·ΔZ/C, where C is speed of light, said array further comprising for each of said pixel detectors an associated pixel time interval counter; a system clock providing countable clock pulses to each said pixel time interval counter, said clock having a frequency at least about C/(2·ΔZ); logic to enable each said pixel time interval counter to count said clock pulses commencing with start of a generated light pulse at said time t0, and to disable each said pixel time interval counter from further counting clock pulses when an associated pixel detector detects energy from the generated said light pulse; wherein detection time for each said pixel detector includes actual time of flight (TOF) from said generator to said target to said pixel detector, as well as pixel integration delay time for said pixel detector; and wherein said pixel integration delay time may be removed on a per pixel detector basis to obtain said actual TOF such that a direct digital measurement proportional to said distance Z is obtained.
Claim 15
Dependent Claim
63 words
The IC of claim 12 , wherein: said system clock has at least one characteristic selected from a group consisting of (a) a clock rate exceeding about 100 MHz, (b) said clock pulses are single-phase clock pulses, (c) said clock compensates for clock pulse phase at each of said pixel detectors, and (d) said clock includes means for maintaining relative clock edge integrity.
Claim 16
Dependent Claim
19 words
The IC of claim 12 , wherein each said pixel time interval counter is a pseudo random sequence counter.
Claim 17
Dependent Claim
25 words
The IC of claim 12 , further including means for providing sub-clock period capacitor charging to measure output of each said pixel time interval counter.
Claim 18
Dependent Claim
26 words
The IC of claim 12 , further including means to average detection time of multiple said pulses to enhance signal/noise ratio in determining said distance Z.
Claim 19
Dependent Claim
61 words
The IC of claim 12 , further including means for collecting data over multiple light pulses, said means for collecting data including at least one of (a) a look-up calibration table for said IC to compensate for said pixel integration delay, and (b) means for examining characteristics associated with various of said pixel detectors to compensate for said pixel integration delay.
Claim 20
Dependent Claim
29 words
The IC of claim 12 , further including a processor to process outputs from each said pixel time interval counter to provide Z distance data relating to said target.
Claim 21
Dependent Claim
43 words
The IC of claim 18 , wherein said processor can determine at least one of (a) said Z distance from said IC to said target, (b) velocity of said target, (c) relative shape of said target, and (d) relative identification of said target.
Claim 22
Independent Claim
252 words
A method to determine distance Z between a detector array and a target less than about 100 m distant, the method comprising the following steps: (a) disposing said array so as to detect optical energy reflected from said target, the array comprising a plurality of pixel detectors, and for each pixel detector providing an associated charge collector, and for each pixel detector an associated shutter disposed intermediate an associated said pixel detector and associated said charge collector to control ability of said charge collector to collect charge output by an associated said pixel detector; (b) at time t0, illuminating said target with a first pulse of optical energy having pulse width PW and opening each said shutter to permit said collector to collect any output resulting from detected optical energy reflected from said target resulting from said pulse; (c) beginning at said time t0 to accumulate in each said collector any charge output by an associated said pixel detector; (d) at a time Tep, corresponding to approximately PW=Tep−t0, closing each said shutter to disable each said associated collector from accumulating further charge; (e) after said time Tep, evaluating charge associated in each said collector to obtain a measure of actual time of flight (TOF) for each said pixel detector to said target; and (f) at a subsequent time outputting a second pulse of known PW and opening and retaining open each said shutter until cessation of detected energy from said second pulse; wherein said distance Z to said target may be determined.
Claim 23
Independent Claim
252 words
A method to determine distance Z between a detector array and a target less than about 100 m distant, the method comprising the following steps: (a) disposing said array so as to detect optical energy reflected from said target, the array comprising a plurality of pixel detectors, and for each pixel detector providing an associated charge collector, and for each pixel detector an associated shutter disposed intermediate an associated said pixel detector and associated said charge collector to control ability of said charge collector to collect charge output by an associated said pixel detector; (b) at time t0, illuminating said target with a first pulse of optical energy having pulse width PW and opening each said shutter to permit said collector to collect any output resulting from detected optical energy reflected from said target resulting from said pulse; (c) beginning at said time t0 to accumulate in each said collector any charge output by an associated said pixel detector; (d) at a time Tep, corresponding to approximately PW=Tep−t0, closing each said shutter to disable each said associated collector from accumulating further charge; (e) after said time Tep, evaluating charge associated in each said collector to obtain a measure of actual time of flight (TOF) for each said pixel detector to said target; and (f) at a subsequent time outputting a second pulse of known PW and opening and retaining open each said shutter until cessation of detected energy from said second pulse; wherein said distance Z to said target may be determined.
Claim 24
Dependent Claim
59 words
The method of claim 20 , further including accumulating charge in each collector using at least two pulses of known PW with said shutter enabled, and accumulating charge in said collector using at least two pulses of said known PW with said shutter disabled to obtain calibration data representing light reflectivity of said target; wherein measurement accuracy is enhanced.
Claim 25
Dependent Claim
27 words
The method of claim 20 , further including accumulating charge in at least one of said pixel detectors to obtain calibration data representing reflectivity of said target.
Claim 26
Dependent Claim
272 words
A CMOS-implementable integrated circuit (IC) time of flight (TOF) measurement system used with a generator outputting at least a first light pulse of pulse width PW to determine distance Z between said IC and a target less than about 100 m distant, the IC comprising: an array of pixel detectors to detect generated light pulse energy returned from said target, each pixel detector having a pixel integration delay time exceeding 2·ΔZ/C where C is speed of light; for each of said pixel detectors, an associated charge collector, and for each pixel detector an associated shutter disposed intermediate an associated said pixel detector and associated said charge collector to control ability of said charge collector to collect charge output by an associated said pixel detector; logic that opens each said shutter at a time t0 representing start of a generated said first light pulse to permit said collector to collect any output resulting from detected optical energy reflected from said target resulting from said first pulse, said logic closing each said shutter at a time Tep corresponding to approximately PW=Tep−t0 width of each said first pulse to disable each said associated collector from accumulating further charge; means for evaluating accumulated charge after said time Tep accumulated in each said collector to obtain a measure of actual time of flight (TOF) for each said pixel detector to said target; said logic further opening and retaining open each said shutter, at a subsequent time corresponding to output duration of a second pulse of known pulse width, until cessation of detected energy from said second pulse; wherein said distance Z to said target may be determined.
Claim 27
Dependent Claim
272 words
A CMOS-implementable integrated circuit (IC) time of flight (TOF) measurement system used with a generator outputting at least a first light pulse of pulse width PW to determine distance Z between said IC and a target less than about 100 m distant, the IC comprising: an array of pixel detectors to detect generated light pulse energy returned from said target, each pixel detector having a pixel integration delay time exceeding 2·ΔZ/C where C is speed of light; for each of said pixel detectors, an associated charge collector, and for each pixel detector an associated shutter disposed intermediate an associated said pixel detector and associated said charge collector to control ability of said charge collector to collect charge output by an associated said pixel detector; logic that opens each said shutter at a time t0 representing start of a generated said first light pulse to permit said collector to collect any output resulting from detected optical energy reflected from said target resulting from said first pulse, said logic closing each said shutter at a time Tep corresponding to approximately PW=Tep−t0 width of each said first pulse to disable each said associated collector from accumulating further charge; means for evaluating accumulated charge after said time Tep accumulated in each said collector to obtain a measure of actual time of flight (TOF) for each said pixel detector to said target; said logic further opening and retaining open each said shutter, at a subsequent time corresponding to output duration of a second pulse of known pulse width, until cessation of detected energy from said second pulse; wherein said distance Z to said target may be determined.
Claim 28
Dependent Claim
24 words
The IC of claim 23 , wherein said logic permits opening each said shutter to obtain calibration data representing light reflectivity of said target.
Claim 29
Dependent Claim
48 words
The IC of claim 23 , further including a microprocessor to determine from evaluated said accumulated charge at least one of (a) distance Z from said IC to said target, (b) velocity of said target, (c) relative shape of said target, and (d) relative identification of said target.
References Cited (Backward Citations)
US4764982A
Cited
US4277167A
Cited
US4708473A
Cited
US5446529A
Cited
US5682229A
Cited
US5835204A
Cited
US5892575A
Cited
US5953110A
Cited
US6137566A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-11-26 | 2005-05-28 | 2005-11-27 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-11-26 | 2009-05-28 | 2009-11-27 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-11-26 | 2013-05-28 | 2013-11-27 | $7700.00 | Window Closed / Lapsed |