US7006236B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for approximating depth of an object's placement onto a monitored region with applications to virtual interface devices
Assignee: HEILONGJIANG GOLDEN JUMPING GROUP Co Ltd
•
Filing: 2002-09-17
•
Granted: 2006-02-28
•
Expires: 2022-09-17
Abstract
Abstract Structured light is directed across a monitored region. An image is captured of a light pattern that forms on the object as a result of the object intersecting the structured light when the object is placed at a first position in the monitored region. A geometric characteristic is identified of the image of the light pattern. The geometric characteristic is variable with a depth of the first position relative to where the image is captured. The depth of the first position is approximated based on the measured geometric characteristic.
Inventors
- 👤 Carlo Tomasi
- 👤 Salih Burak Gokturk
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:00
CPC Classifications
G; G06; G06F; G06F3/00; G06F3/01; G06F3/03; G06F3/033; G06F3/038; G06F1/00; G06F1/16; G06F1/1613; G06F1/1626; G06F1/1632; G06F1/1633; G06F1/1662; G06F1/1673; G06F3/041; G06F3/042; G06F3/0425; G06F3/0426; G06F3/0428; G06F3/048; G06F3/0487; G06F3/0488; G06F3/04886; G01; G01S; G01S17/00; G01S17/02; G01S17/06; G06F2200/00; G06F2200/16; G06F2200/163; G06F2200/1633
Claims Analysis
Total Claims: 43
Claim 1
Independent Claim
151 words
An electronic device for detecting a depth of an object's placement on a monitored region, the electronic device comprising: one or more light sources configured to direct structured light across the monitored region, wherein the structured light is capable of creating a geometric characteristic when forming a light pattern on the object in the monitored region; a light detecting device configured to capture an image of a light pattern that forms on the object as a result of the object intersecting the structured light when being placed at a first position in the monitored region; and a processor configured to: identify a geometric characteristic of the image of the light pattern, wherein the geometric characteristic of the image is variable with a depth of the first position relative to where the light detecting device captures the image; and approximate the depth of the first position based on the identified geometric characteristic.
Claim 2
Dependent Claim
151 words
An electronic device for detecting a depth of an object's placement on a monitored region, the electronic device comprising: one or more light sources configured to direct structured light across the monitored region, wherein the structured light is capable of creating a geometric characteristic when forming a light pattern on the object in the monitored region; a light detecting device configured to capture an image of a light pattern that forms on the object as a result of the object intersecting the structured light when being placed at a first position in the monitored region; and a processor configured to: identify a geometric characteristic of the image of the light pattern, wherein the geometric characteristic of the image is variable with a depth of the first position relative to where the light detecting device captures the image; and approximate the depth of the first position based on the identified geometric characteristic.
Claim 3
Dependent Claim
31 words
The electronic device of claim 1 , wherein the one or more light sources are actuatable to generate one or more beams that extend across and fan over the monitored region.
Claim 4
Dependent Claim
44 words
The electronic device of claim 1 , wherein the one or more light sources are actuatable to generate a first beam and a second beam to extend over the monitored region, wherein the first beam and the second beam are parallel to one another.
Claim 5
Dependent Claim
50 words
The electronic device of claim 1 , wherein the one or more light sources are actuatable to generate a first beam and a second beam to extend over the monitored region, wherein the first beam and the second beam are directed to converge towards one another beyond the monitored region.
Claim 6
Dependent Claim
45 words
The electronic device of claim 4 , wherein the processor is configured to match the gap distance to one of a plurality of predetermined values, wherein each of the plurality of predetermined values are based at least partially on the depth of the first position.
Claim 7
Dependent Claim
31 words
The electronic device of claim 4 , wherein in response to identifying the gap distance, the processor is configured to calculate the depth of the first position using the gap distance.
Claim 8
Dependent Claim
29 words
The electronic device of claim 6 , wherein processor is configured to identify a height of the image of the light pattern formed by the object intersecting first beam.
Claim 9
Dependent Claim
30 words
The electronic device of claim 6 , wherein the processor is configured to match the dimension of the image of the light pattern to the depth of the first position.
Claim 10
Dependent Claim
36 words
The electronic device of claim 6 , wherein in response to identifying the dimension, the processor is configured to calculate the depth of the first position using the dimension of the image of the light pattern.
Claim 11
Dependent Claim
40 words
The electronic device of claim 9 , wherein the processor is configured to determine that the object made contact with the surface at the first position using the geometric characteristic of the light pattern captured by the light detecting device.
Claim 12
Dependent Claim
22 words
The electronic device of claim 9 , wherein the processor is configured to interpret the depth of the first position as input.
Claim 13
Dependent Claim
22 words
The electronic device of claim 9 , wherein the processor is configured to interpret a coordinate of the first position as input.
Claim 14
Dependent Claim
30 words
The electronic device of claim 12 , wherein the projector provides an image of a set of keys, so that each key in the set of keys is visually identifiable.
Claim 15
Dependent Claim
94 words
The electronic device of claim 9 , wherein the light detecting device is configured to capture a plurality of images of the light pattern that forms on the object as the object is moved from the first position to a second position across the monitored region, and where the processor is configured to approximate the depth of the second position relative to where the image of the object is captured, and wherein the processor is configured to interpret the depth of at least one of the first position and the second position as input.
Claim 16
Dependent Claim
40 words
The electronic device of claim 14 , wherein the processor is configured to approximate the depth of one or more intermediate points where the object is placed as the object is moved from the first position to the second position.
Claim 17
Dependent Claim
39 words
The electronic device of claim 15 , wherein the processor is configured to cause a gesture to be displayed, the gesture corresponding to a formation interconnecting the first position, the second position, and the one or more intermediate points.
Claim 18
Dependent Claim
110 words
The electronic device of claim 1 , wherein: the one or more light sources are actuatable to generate at least a first beam and a second beam, the first beam and the second beam fanning across the monitored object; the light detecting device is positioned to capture the image containing a first portion of the light pattern corresponding to the object intersecting the first beam, and a second portion of the light pattern corresponding to the object intersecting the second beam; and the processor is configured to identify a gap distance on the image between the first portion of the light pattern and the second portion of the light pattern.
Claim 19
Dependent Claim
50 words
The electronic device of claim 1 , wherein: the one or more light sources are actuatable to generate a first beam to project across the monitored region; and the processor is configured to identify a dimension of the image of the light pattern formed by the object intersecting first beam.
Claim 20
Dependent Claim
48 words
The electronic device of claim 1 , wherein the processor is configured to use the light pattern captured by the light detecting device in order to determine when the object intersects the structured light to make contact with a surface of the monitored region at the first position.
Claim 21
Dependent Claim
65 words
The electronic device of claim 1 , further comprising: a projector to provide a visual indication of an input value associated with each region in a plurality of regions of the monitored region, and wherein the processor is configured to interpret the first position as the input value that is visual indicated on a region in the plurality of regions that contains the first position.
Claim 22
Dependent Claim
18 words
The electronic device of claim 20 , wherein the projector provides the image of a QWERTY style keyboard.
Claim 23
Dependent Claim
154 words
An electronic device for approximating a depth of an objects placement on a monitored region, the electronic device comprising: processor configured to: receive information from a light detecting device, including information from an image of a light pattern that is formed on the object as a result of the object intersecting a structured light when being placed at a first position in the monitored region; identify a geometric characteristic of the image of the light pattern, wherein the geometric characteristic of the image is variable with a depth of the first position relative to where the light detecting device captures the image, and wherein the geometric characteristic is based on at least one of (i) a dimension of at least a portion of the light pattern, or (ii) a separation distance between two or more portions of the light pattern; and approximate the depth of the first position based on the identified geometric characteristic.
Claim 24
Dependent Claim
154 words
An electronic device for approximating a depth of an objects placement on a monitored region, the electronic device comprising: processor configured to: receive information from a light detecting device, including information from an image of a light pattern that is formed on the object as a result of the object intersecting a structured light when being placed at a first position in the monitored region; identify a geometric characteristic of the image of the light pattern, wherein the geometric characteristic of the image is variable with a depth of the first position relative to where the light detecting device captures the image, and wherein the geometric characteristic is based on at least one of (i) a dimension of at least a portion of the light pattern, or (ii) a separation distance between two or more portions of the light pattern; and approximate the depth of the first position based on the identified geometric characteristic.
Claim 25
Dependent Claim
97 words
The electronic device of claim 22 , wherein the processor is configured to: receive information identifying a first portion of the light pattern and a second portion of the light pattern, the first portion of the light pattern is formed by the object intersecting a first beam that is directed over the monitored area, and the second portion of the light pattern is formed by the object intersecting a second beam that is directed over the monitored area; determine the depth of the first position from a gap distance between the first portion and the second portion.
Claim 26
Dependent Claim
40 words
The electronic device of claim 23 , wherein the processor is configured to: receive information in order to identify a dimension of the light pattern; and determine the depth of the first position using the dimension of the light pattern.
Claim 27
Dependent Claim
26 words
The electronic device of claim 22 , wherein the processor is configured to determine an input at least partially from the depth of the first position.
Claim 28
Dependent Claim
85 words
The electronic device of claim 22 , wherein the processor is configured to: receive information from the light detecting device that includes information from a plurality of images, each image of a light pattern formed on the object as a result of the object intersecting the structured light while being moved from the first position to a second position; and identify the geometric characteristic of the image of each light pattern; and approximate the depth of at least the first position and the second position.
Claim 29
Dependent Claim
46 words
The electronic device of claim 26 , wherein the processor is configured to approximate the depth of one or more intermediate points between the first position and the second position using an image captured of the object at each of the one or more intermediate points.
Claim 30
Dependent Claim
39 words
The electronic device of claim 26 , wherein the processor is configured to cause a gesture to be displayed, the gesture corresponding to a formation interconnecting the first position, the second position, and the one or more intermediate points.
Claim 31
Dependent Claim
23 words
The electronic device of claim 22 , further comprising a connector to couple the processor to another device containing the light detecting device.
Claim 32
Dependent Claim
155 words
An electronic device comprising: one or more light sources to project structured light over a monitored region, the one or more light sources including a first end that is distal to a surface upon which the monitored region is provided on, wherein the structured light is capable of creating a geometric characteristic when forming a light pattern on the object in the monitored region; and a light detecting device that is configured to capture an image of the object intersecting the structured light when being placed at a first position in the monitored region; and a processor that is configured to use the image to determine a depth of the first position relative to where the light detecting device captures the image; wherein the light detecting device is placed so that a center of the light detecting device is more proximate to the surface than the first end of the one or more light sources.
Claim 33
Dependent Claim
155 words
An electronic device comprising: one or more light sources to project structured light over a monitored region, the one or more light sources including a first end that is distal to a surface upon which the monitored region is provided on, wherein the structured light is capable of creating a geometric characteristic when forming a light pattern on the object in the monitored region; and a light detecting device that is configured to capture an image of the object intersecting the structured light when being placed at a first position in the monitored region; and a processor that is configured to use the image to determine a depth of the first position relative to where the light detecting device captures the image; wherein the light detecting device is placed so that a center of the light detecting device is more proximate to the surface than the first end of the one or more light sources.
Claim 34
Dependent Claim
37 words
The electronic device of claim 30 , wherein the light detecting device is configured to capture the image that includes a light pattern forming on the object as a result of the object intersecting the structured light.
Claim 35
Dependent Claim
27 words
The electronic device of claim 31 , wherein the processor is configured to determine the depth of the first position using the image of the light pattern.
Claim 36
Dependent Claim
22 words
The electronic device of claim 30 , wherein the one or more light sources are less than three centimeters from the surface.
Claim 37
Dependent Claim
23 words
The electronic device of claim 30 , wherein the one or more light sources are between one and two centimeters from the surface.
Claim 38
Dependent Claim
27 words
The electronic device of claim 30 , wherein the processor is configured to determine an input based at least partially on the depth of the first position.
Claim 39
Dependent Claim
71 words
The electronic device of claim 30 , wherein: the one or more light sources include a first light source for directing a first beam over the monitored region, and a second light source for directing a second beam over the monitored region; wherein the first light source and second light source are positioned vertically so that one of the first light source and second light source is distal from the surface.
Claim 40
Dependent Claim
43 words
The electronic device of claim 30 , further comprising: a housing containing a front panel; a lens for the light detecting device positioned on the front panel; and wherein the one or more light sources direct the structured light from the front panel.
Claim 41
Dependent Claim
24 words
The electronic device of claim 30 , wherein the processor is configured to use a geometric characteristic of the image to determine the depth.
Claim 42
Dependent Claim
79 words
The electronic device of claim 38 , wherein the geometric characteristic of the image corresponds to a gap distance between a first portion of the image of the light pattern and a second portion of the image of the light pattern, the first portion being formed by the object intersecting a first beam from the one or more light sources, the second portion being formed by the object intersecting a second beam from the one or more light sources.
Claim 43
Dependent Claim
27 words
The electronic device of claim 30 , further comprising: a projector that is configured to project an image of a virtual input device from the front panel.
References Cited (Backward Citations)
GB1073503A
Cited
US3610754A
Cited
US4686655A
Cited
US4312053A
Cited
US3857022A
Cited
US4187492A
Cited
US4333170A
Cited
US4294544A
Cited
US4376301A
Cited
WO1984000427A1
Cited
US4716542A
Cited
EP0233464A1
Cited
US4980870A
Cited
US5174759A
Cited
EP0370770A1
Cited
US4956824A
Cited
EP0420500A2
Cited
US5056791A
Cited
US5099456A
Cited
US5573077A
Cited
US5166905A
Cited
US5442573A
Cited
EP0629964A1
Cited
US5617371A
Cited
US5733031A
Cited
US6002435A
Cited
US5825033A
Cited
EP0982676A1
Cited
WO2000019705A1
Cited
EP1039365A2
Cited
EP1045586A2
Cited
WO2002021502A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2009-02-27 | 2009-08-29 | 2010-02-28 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2013-02-27 | 2013-08-29 | 2014-02-28 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2017-02-27 | 2017-08-29 | 2018-02-28 | $7700.00 | Window Closed / Lapsed |