US6710770B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Quasi-three-dimensional method and apparatus to detect and localize interaction of user-object and virtual transfer device
Assignee: HEILONGJIANG GOLDEN JUMPING GROUP Co Ltd
•
Filing: 2001-09-07
•
Granted: 2004-03-23
•
Expires: 2021-09-07
Abstract
Abstract A system used with a virtual device inputs or transfers information to a companion device, and includes two optical systems OS1, OS2. In a structured-light embodiment, OS1 emits a fan beam plane of optical energy parallel to and above the virtual device. When a user-object penetrates the beam plane of interest, OS2 registers the event. Triangulation methods can locate the virtual contact, and transfer user-intended information to the companion system. In a non-structured active light embodiment, OS2 is preferably a digital camera; whose field of view defines the plane of interest, which is illuminated by an active source of optical energy. Preferably the active source, OS1, and OS2 operate synchronously to reduce effects of ambient light. A non-structured passive light embodiment is similar except the source of optical energy is ambient light. A subtraction technique preferably enhances the signal/noise ratio. The companion device may in fact house the present invention.
Inventors
- 👤 Carlo Tomasi
- 👤 Abbas Rafii
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-26 17:41
CPC Classifications
G; G06; G06F; G06F3/00; G06F3/01; G06F3/011; G06F1/00; G06F1/16; G06F1/1613; G06F1/1626; G06F1/1632; G06F1/1633; G06F1/1662; G06F1/1673; G06F3/02; G06F3/0202; G06F3/0221; G06F3/03; G06F3/041; G06F3/042; G06F3/0421; G06F3/0423; G06F3/0425; G06F3/0426; G06F3/048; G06F3/0487; G06F3/0488; G06F3/04886; G06V; G06V30/00; G06V30/10; G06V30/22; G06V30/228
Claims Analysis
Total Claims: 21
Claim 1
Independent Claim
175 words
A method to obtain information from an interaction of at least one user-object with a virtual input device defined on a device plane, the method comprising the following steps: (a) generating with a fan beam a plane of light substantially parallel to and spaced-above said device plane a distance sufficiently small such that penetration of said plane of light by said at least one user-object is equivalent to interactingly touching a virtual input device position on said device plane; (b) using a single sensor that acquires data representing a single image at a given time to determine from light reflected from said plane of light if and when at least a portion of said at least one user-object penetrates said plane of light and thus interactingly touches a position on said device plane; and (c) for each contact with said device plane determined to occur at step (b) determining contact position relative to said single sensor; wherein a function of said virtual input device associated with each contact position determined at step (c) is ascertainable.
Claim 2
Independent Claim
175 words
A method to obtain information from an interaction of at least one user-object with a virtual input device defined on a device plane, the method comprising the following steps: (a) generating with a fan beam a plane of light substantially parallel to and spaced-above said device plane a distance sufficiently small such that penetration of said plane of light by said at least one user-object is equivalent to interactingly touching a virtual input device position on said device plane; (b) using a single sensor that acquires data representing a single image at a given time to determine from light reflected from said plane of light if and when at least a portion of said at least one user-object penetrates said plane of light and thus interactingly touches a position on said device plane; and (c) for each contact with said device plane determined to occur at step (b) determining contact position relative to said single sensor; wherein a function of said virtual input device associated with each contact position determined at step (c) is ascertainable.
Claim 3
Dependent Claim
48 words
The method of claim 1 , further including: (d) transferring to a companion device information commensurate with contact position determined at step (c) relative to said virtual input device; wherein Interaction of said at least one user-object with said virtual input device affects operation of said companion device.
Claim 4
Dependent Claim
72 words
The method of claim 2 , wherein said companion device includes at least one of (i) a PDA, (ii) a portable communication device, (iii) an electronic device, (iv) an electronic game device, and (v) a musical instrument, and said virtual input device is at least one of (I) a virtual keyboard, (II) a virtual mouse, (III) a virtual trackball, (IV) a virtual pen, (V) a virtual trackpad, and (VI) a user-interface selector.
Claim 5
Dependent Claim
46 words
The method of claim 2 , wherein: said user-object includes at least a portion of a user's hand; said virtual input device includes a virtual keyboard; and said companion device includes at least one of (i) a PDA, (ii) a mobile telephone, and (iii) a computer.
Claim 6
Dependent Claim
46 words
The method of claim 2 , wherein: said user-object includes at least a portion of a user's hand; said virtual input device includes a virtual mouse, and said companion device includes at least one of (i) a PDA, (ii) a mobile telephone, and (iii) a computer.
Claim 7
Dependent Claim
46 words
The method of claim 2 , wherein: said user-object includes at least a portion of a user's hand; said virtual input device includes a virtual trackball, and said companion device includes at least one of (i) a PDA, (ii) a mobile telephone, and (iii) a computer.
Claim 8
Dependent Claim
46 words
The method of claim 2 , wherein: said user-object includes at least a portion of a user's hand; said virtual input device includes a virtual pen, and said companion device includes at least one of (i) a PDA, (ii) a mobile telephone, and (iii) a computer.
Claim 9
Dependent Claim
44 words
The method of claim 1 , wherein step (a) includes generating said plane of light using optical energy, and wherein step (b) includes detecting a reflected portion of said optical energy when at least a portion of said user-object penetrates said plane of light.
Claim 10
Dependent Claim
22 words
The method of claim 1 , wherein at least one of step (b) and step (c) is carried out using triangulation analysis.
Claim 11
Dependent Claim
67 words
The method of claim claim 1 , wherein said virtual input device is mapped to a work surface selected from at least one of (i) a table top, (ii) a desk top, (iii) a wall, (iv) a point-of-sale appliance, (v) a point-of-service appliance, (vi) a kiosk, (vii) a surface in a vehicle, (viii) a projected display, (ix) a physical display, (x) a CRT, and (xi) an LCD.
Claim 12
Dependent Claim
53 words
The method of claim 1 , wherein step (b) includes providing a camera having a lens with a lens optical axis, and providing an image plane, and further including improving at least one of resolution and depth of field of said camera by tilting said image plane relative to said lens optical axis.
Claim 13
Dependent Claim
34 words
The method of claim 1 , wherein: step (a) includes defining said plane of light using an optical source; and step (b) includes providing a camera to sense penetration of said plane of light.
Claim 14
Dependent Claim
39 words
The method of claim 12 , further including: synchronizing operation of said optical source and said camera; wherein effects of ambient light upon accuracy of information obtained at at least one of step (b) and step (c) are reduced.
Claim 15
Dependent Claim
21 words
The method of claim 12 , wherein said optical source emits optical energy bearing a signature used to reject ambient light.
Claim 16
Dependent Claim
65 words
The method of claim 1 , wherein: step (b) includes acquiring ambient light information generated by ambient light by determining when said user-object is distant from said plane of light; and at least one of step (b) and step (c) includes subtracting said ambient light information from information acquired when said user-object interacts with said virtual input device; wherein effects of ambient light are reduced.
Claim 17
Dependent Claim
18 words
The method of claim 1 , wherein said user-object includes at least a portion of a user's hand.
Claim 18
Dependent Claim
15 words
The method of claim 1 , wherein said virtual input device includes a virtual keyboard.
Claim 19
Dependent Claim
15 words
The method of claim 1 , wherein said virtual input device includes a virtual mouse.
Claim 20
Dependent Claim
15 words
The method of claim 1 , wherein said virtual input device includes a virtual trackball.
Claim 21
Dependent Claim
14 words
The method of claim 1 , wherein said virtual input device a virtual pen.
References Cited (Backward Citations)
US4507557A
Cited
US4855590A
Cited
US5196835A
Cited
US5936614A
Cited
US5767842A
Cited
US6091405A
Cited
US5317140A
Cited
US5528263A
Cited
US6281878B1
Cited
US5909210A
Cited
US6252598B1
Cited
US6043805A
Cited
US6266048B1
Cited
US6323942B1
Cited
US6594023B1
Cited
US20010030642A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-03-23 | 2007-09-22 | 2008-03-23 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-03-23 | 2011-09-22 | 2012-03-23 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-03-23 | 2015-09-22 | 2016-03-23 | $7700.00 | Window Closed / Lapsed |