US6404416B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Unconstrained pointing interface for natural human interaction with a display-based computer system
Assignee: Corporation for National Research Initiatives
•
Filing: 1998-02-25
•
Granted: 2002-06-11
•
Expires: 2018-02-25
Abstract
Abstract An unconstrained pointing interface for natural human interaction with a display-based computer system includes a hand-manipulated pointer configured to permit it to be (1) aimed by line of sight to point at any arbitrary position within the user's field of view, including positions beyond the user's natural reach, and (2) swept along any arbitrary path and at any arbitrary speed within the user's natural capability. A detector detects emanations from at least some positions at which the pointer may be aimed; and circuitry identifies the locations of positions at which the user is aiming the pointer. The interface enables the user to point to a position within his field of view and beyond his reach, move his hand along any arbitrary path and at any arbitrary speed within the user's natural capability to point to another position, and so on, and to have the circuitry automatically identify the locations of the series of positions to which he has pointed.
Inventors
- 👤 Robert E. Kahn
- 👤 John H. Cafarella
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 22:03
CPC Classifications
G; G06; G06F; G06F3/00; G06F3/01; G06F3/03; G06F3/033; G06F3/038; G06F3/0386; G06F3/0354; G06F3/03542; G06F3/037
Claims Analysis
Total Claims: 40
Claim 1
Independent Claim
197 words
Apparatus which enables a user to communicate with an image appearing on a display surface associated with a computer system, the image appearing on the display surface including an object that represents a control that can be rotated in the image to actuate a software feature, the display surface being characterized by predetermined time-varying light emanations from the surface, the time variations of the emanations being sufficient to enable a determination of a localized area on the surface which is the source of portions of the light emanations, the interface comprising a hand-held pointer having an axis that can be aimed at the object that represents a control that can be rotated in the image while the pointer is held at a location remote from the surface, the pointer being rotatable about the axis while being aimed, and sensors configured to receive portions of the light emanations from the object that represents a control that can be rotated in the image, and circuitry configured to determine that the hand-held pointer is being rotated based on signals from the sensors and to cause rotation of the object to actuate the software feature based on determination of the rotation.
Claim 2
Dependent Claim
197 words
Apparatus which enables a user to communicate with an image appearing on a display surface associated with a computer system, the image appearing on the display surface including an object that represents a control that can be rotated in the image to actuate a software feature, the display surface being characterized by predetermined time-varying light emanations from the surface, the time variations of the emanations being sufficient to enable a determination of a localized area on the surface which is the source of portions of the light emanations, the interface comprising a hand-held pointer having an axis that can be aimed at the object that represents a control that can be rotated in the image while the pointer is held at a location remote from the surface, the pointer being rotatable about the axis while being aimed, and sensors configured to receive portions of the light emanations from the object that represents a control that can be rotated in the image, and circuitry configured to determine that the hand-held pointer is being rotated based on signals from the sensors and to cause rotation of the object to actuate the software feature based on determination of the rotation.
Claim 3
Dependent Claim
183 words
Apparatus which enables a user of a computer system to operate interactively with an object that has a surface characterized by visible variations, comprising a scanner controllable to impose a modulating pattern of radiation on the object to cause a modulated pattern of reflected emanations that is different from the visible variations, the pattern being sufficient to enable a determination, from the modulated pattern of reflected emanations, of a localized area of the visible variations on the object which is a source of reflected portions of the radiation, the modulated pattern of reflected emanations comprising a vertical scan of a horizontal line preceded or followed by a horizontal scan of a vertical line, and a hand-held pointer having an axis that can be aimed at a localized area of the visible variations of the object, and a sensor that receives portions of the modulated pattern of reflected emanations from the localized area of the visible variations, and circuitry configured to determine the localized area of the visible variations of the object to which the pointer is aimed based on signals from the sensor.
Claim 4
Dependent Claim
183 words
Apparatus which enables a user of a computer system to operate interactively with an object that has a surface characterized by visible variations, comprising a scanner controllable to impose a modulating pattern of radiation on the object to cause a modulated pattern of reflected emanations that is different from the visible variations, the pattern being sufficient to enable a determination, from the modulated pattern of reflected emanations, of a localized area of the visible variations on the object which is a source of reflected portions of the radiation, the modulated pattern of reflected emanations comprising a vertical scan of a horizontal line preceded or followed by a horizontal scan of a vertical line, and a hand-held pointer having an axis that can be aimed at a localized area of the visible variations of the object, and a sensor that receives portions of the modulated pattern of reflected emanations from the localized area of the visible variations, and circuitry configured to determine the localized area of the visible variations of the object to which the pointer is aimed based on signals from the sensor.
Claim 5
Dependent Claim
36 words
The apparatus of claim 1 or 2 wherein the emanations differ at different positions, and the circuitry identifies the location of each localized area in a series of localized areas based on differences in the emanations.
Claim 6
Dependent Claim
16 words
The apparatus of claim 1 or 2 wherein the differences comprise differences in time of occurrence.
Claim 7
Dependent Claim
22 words
The apparatus of claim 1 or 2 wherein the differences in time of occurrence are associated with raster scanning of the positions.
Claim 8
Dependent Claim
13 words
The apparatus of claim 1 or 2 wherein the emanations comprise electromagnetic radiation.
Claim 9
Dependent Claim
16 words
The apparatus of claim 1 or 2 wherein the emanations comprise visible light or non-visible radiation.
Claim 10
Dependent Claim
15 words
The apparatus of claim 1 or 2 wherein the emanations originate at the localized area.
Claim 11
Dependent Claim
16 words
The apparatus of claim 1 or 2 wherein the emanations are reflected from the localized area.
Claim 12
Dependent Claim
14 words
The apparatus of claim 1 or 2 wherein the reflections are of scanned emanations.
Claim 13
Dependent Claim
18 words
The apparatus of claim 1 wherein the scanned emanations are directed to at least one passive everyday object.
Claim 14
Dependent Claim
36 words
The apparatus of claim 1 or 2 wherein the circuitry generates a monopulse position signal as a result of a monopulse processing technique and the monopulse position signal carries information about the timing of the emanations.
Claim 15
Dependent Claim
19 words
The apparatus of claim 1 or 2 wherein the circuitry derives a timing signal from the monopulse position signal.
Claim 16
Dependent Claim
18 words
The apparatus of claim 1 or 2 wherein the circuitry is part of or attached to the pointer.
Claim 17
Independent Claim
50 words
The apparatus of claims 2 further comprising a communication channel from the circuitry which identifies the localized areas at which the user is aiming the pointer, to the pointer, and wherein the pointer includes an indicator for conveying information to a user based on data received via the communication link.
Claim 18
Independent Claim
16 words
The apparatus of claims 1 or 2 wherein there are two or more of said pointers.
Claim 19
Independent Claim
31 words
The apparatus of claims 1 or 2 further comprising an event mechanism which enables the user to generate events associated with a localized area at which he is aiming the pointer.
Claim 20
Dependent Claim
19 words
The apparatus of claim 1 or 2 wherein the event mechanism is part of or attached to the pointer.
Claim 21
Dependent Claim
24 words
The apparatus of claim 1 or 2 wherein the events generated by the event mechanism are represented as event signals delivered to the circuitry.
Claim 22
Dependent Claim
15 words
The apparatus of claim 1 or 2 wherein the event signals are carried by wire.
Claim 23
Dependent Claim
16 words
The apparatus of claim 1 or 2 wherein the event signals are carried by electromagnetic radiation.
Claim 24
Dependent Claim
18 words
The apparatus of claim 1 or 2 further comprising a wireless communication channel for carrying the monopulse signal.
Claim 25
Dependent Claim
17 words
The apparatus of claim 1 or 2 wherein the event signals are carried on a coded channel.
Claim 26
Dependent Claim
18 words
The apparatus of claim 1 or 2 wherein the event signals are carried on a spread spectrum channel.
Claim 27
Dependent Claim
23 words
The apparatus of claim 1 or 2 wherein the circuitry generates a monopulse position signal as a result of a monopulse processing technique.
Claim 28
Dependent Claim
19 words
The apparatus of claim 1 or 2 further comprising a wireless communication channel for carrying the monopulse position signal.
Claim 29
Dependent Claim
15 words
The apparatus of claim 1 or 2 wherein the communication channel comprises a coded channel.
Claim 30
Dependent Claim
14 words
The apparatus of claim 1 or 2 wherein the channel comprises a spread-spectrum channel.
Claim 31
Dependent Claim
16 words
The apparatus of claim 2 wherein the modulating pattern of radiation comprises a time varying pattern.
Claim 32
Dependent Claim
125 words
Apparatus which enables a user to interact with a display surface, the display surface displaying an object that represents a control that can be rotated in the image to actuate a software feature, comprising a hand-held pointer that includes a sensor arranged so that when the pointer is aimed at the object displayed on the display surface of the surface, from a location remote from the surface, light emanating from the object is received at the sensor, and circuitry connected to the hand-held pointer and configured to determine changes in the angular orientation of the pointer about an axis generally extending between the pointer and the surface and to cause rotation of the object to actuate the software feature based on determination of the rotation.
Claim 33
Dependent Claim
125 words
Apparatus which enables a user to interact with a display surface, the display surface displaying an object that represents a control that can be rotated in the image to actuate a software feature, comprising a hand-held pointer that includes a sensor arranged so that when the pointer is aimed at the object displayed on the display surface of the surface, from a location remote from the surface, light emanating from the object is received at the sensor, and circuitry connected to the hand-held pointer and configured to determine changes in the angular orientation of the pointer about an axis generally extending between the pointer and the surface and to cause rotation of the object to actuate the software feature based on determination of the rotation.
Claim 34
Dependent Claim
31 words
The apparatus of claim 30 , in which the sensor includes three sensing elements and the circuitry determines the changes based on analysis of output signals from the three sensing elements.
Claim 35
Dependent Claim
146 words
Apparatus which enables a user to interact with a passive object by pointing at selected visibly-distinct parts of a surface of the object comprising: a source that projects radiation onto the surface, the radiation being modulated in a pattern that permits different locations of the surface to be distinguished on the basis of radiation reflected from them, the modulated pattern comprising a vertical scan of a horizontal line preceded or followed by a horizontal scan of a vertical line, a hand-held pointer that includes a sensor arranged so that when the pointer is aimed at one of the visibly distinct parts of the surface, the sensor receives radiation reflected from the part, and circuitry connected to the sensor and configured to determine a visibly-distinct part of the surface to which the pointer is being aimed based on the modulated pattern of radiation received at the sensor.
Claim 36
Dependent Claim
146 words
Apparatus which enables a user to interact with a passive object by pointing at selected visibly-distinct parts of a surface of the object comprising: a source that projects radiation onto the surface, the radiation being modulated in a pattern that permits different locations of the surface to be distinguished on the basis of radiation reflected from them, the modulated pattern comprising a vertical scan of a horizontal line preceded or followed by a horizontal scan of a vertical line, a hand-held pointer that includes a sensor arranged so that when the pointer is aimed at one of the visibly distinct parts of the surface, the sensor receives radiation reflected from the part, and circuitry connected to the sensor and configured to determine a visibly-distinct part of the surface to which the pointer is being aimed based on the modulated pattern of radiation received at the sensor.
Claim 37
Dependent Claim
16 words
The apparatus of claim 32 in which the radiation is modulated as a pseudo raster scan.
Claim 38
Dependent Claim
30 words
The apparatus of claim 32 in which the circuitry also uses information about the state of modulation of the radiation in determining the part to which the pointer is aimed.
Claim 39
Dependent Claim
21 words
The apparatus of claim 32 in which the modulation includes projecting radiation on different parts of the surface at different times.
Claim 40
Dependent Claim
14 words
The apparatus of claim 32 in which the surface of the object is two-dimensional.
References Cited (Backward Citations)
JPS59212945A
Cited
US4591841A
Cited
US4884068A
Cited
EP0312095A2
Cited
US4814552A
Cited
US5045843A
Cited
US5045843B1
Cited
DE4000518A1
Cited
US5504501A
Cited
WO1991018383A1
Cited
US5349460A
Cited
US5341155A
Cited
WO1992009062A1
Cited
EP0515015A2
Cited
US5420607A
Cited
US5581269A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2005-06-10 | 2005-12-10 | 2006-06-11 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2009-06-10 | 2009-12-10 | 2010-06-11 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2013-06-10 | 2013-12-10 | 2014-06-11 | $7700.00 | Window Closed / Lapsed |