Patent US5377303A successfully refreshed from Google Patents.
US5377303A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Controlled computer interface
Assignee: MULTIMODAL TECHNOLOGIES LLC
•
Filing: 1993-12-09
•
Granted: 1994-12-27
•
Expires: 2013-12-09
Abstract
Abstract Voice utterances are substituted for manipulation of a pointing device, the pointing device being of the kind which is manipulated to control motion of a cursor on a computer display and to indicate desired actions associated with the position of the cursor on the display, the cursor being moved and the desired actions being aided by an operating system in, the computer in response to control signals received from the pointing device, the computer also having an alphanumeric keyboard, the operating system being separately responsive to control signals received from the keyboard in accordance with a predetermined format specific to the keyboard; in the system, a voice recognizer recognizes the voiced utterance, and an interpreter converts the voiced utterance into control signals which will directly create a desired action aided by the operating system without first being converted into control signals expressed in the predetermined format specific to the keyboard. In another aspect, voiced utterances are converted to commands, expressed in a predefined command language, to be used by an operating system of a computer, by converting some voiced utterances into commands corresponding to actions to be taken by the operating system, and converting other voiced utterances into commands which carry associated text strings to be used as part of text being processed in an application program running under the operating system.
Inventors
- 👤 Thomas R. Firman
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-31 05:29
CPC Classifications
G; G06; G06F; G06F3/00; G06F3/01; G06F3/03; G06F3/033; G06F3/038; G06F3/16; G06F3/167; G10; G10L; G10L15/00; G10L15/26
Claims Analysis
Total Claims: 29
Claim 1
Independent Claim
128 words
A system for enabling voiced utterances to control window elements in a graphical user interface, said graphical user interface being provided by an operating system responsive to events posted in an event queue, some events in the queue being posted in response to signals received from an alphanumeric keyboard in accordance with a predetermined format specific to the keyboard, said events including higher level events, comprising a voice recognizer for recognizing voiced utterances, and an interpreter functionally connected to said voice recognizer for converting at least some of the voiced utterances into said higher level events for controlling said window elements and posting said higher level events to the event queue, without first converting said voiced utterances into signals expressed in the predetermined format specific to the keyboard.
Claim 2
Independent Claim
128 words
A system for enabling voiced utterances to control window elements in a graphical user interface, said graphical user interface being provided by an operating system responsive to events posted in an event queue, some events in the queue being posted in response to signals received from an alphanumeric keyboard in accordance with a predetermined format specific to the keyboard, said events including higher level events, comprising a voice recognizer for recognizing voiced utterances, and an interpreter functionally connected to said voice recognizer for converting at least some of the voiced utterances into said higher level events for controlling said window elements and posting said higher level events to the event queue, without first converting said voiced utterances into signals expressed in the predetermined format specific to the keyboard.
Claim 3
Dependent Claim
24 words
The system of claim 1 wherein said higher level events posted by said interpreter mimic events fed to said event queue by a mouse.
Claim 4
Dependent Claim
23 words
The system of claim 1 wherein said one of said higher level events directs said program to wait for a predetermined time delay.
Claim 5
Dependent Claim
35 words
The system of claim 1 wherein said interpreter converts at least some of said voiced utterances to said higher level events based on each of said voiced utterances and on a state of said program.
Claim 6
Dependent Claim
38 words
The system of claim 4 wherein said interpreter further comprises stored data controlling said conversion of said voiced utterance to said higher level event, and means for generating a portion of said stored data by examining said program.
Claim 7
Dependent Claim
23 words
The system of claim 5 wherein said data are generated by examining menus and control buttons of an executable image of said program.
Claim 8
Dependent Claim
32 words
The system of claim 4 wherein said interpreter further comprises stored data controlling said conversion of said voiced utterances to said higher level events, means for viewing and editing said stored data.
Claim 9
Dependent Claim
43 words
The system of claim 1 further comprising stored data controlling said conversion of said voiced utterances to said higher level events, and an event recorder for generating a portion of said data by said event recorder examining an execution session of said program.
Claim 10
Dependent Claim
27 words
The system of claim 8 wherein said event recorder is implemented by code substituted for the code normally executed by a trap handler of said operating system.
Claim 11
Dependent Claim
20 words
The system of claim 9 wherein said event recorder examines the state of data structures maintained by said operating system.
Claim 12
Dependent Claim
20 words
The system of claim 8, wherein said event recorder can be rerun to incrementally re-generate a portion of said data.
Claim 13
Dependent Claim
58 words
The system of claim 8 further comprising a pointing device to control a location indicator on a display, means to control said event recorder with said pointing device, and means within said event recorder to distinguish pointer movements and pointer device button presses as either intended to produce commands to said program or to control said event recorder.
Claim 14
Dependent Claim
23 words
The system of claim 12 wherein said distinguishing means comprises a global variable tracking the state of the buttons of said pointer device.
Claim 15
Dependent Claim
83 words
The system of claim 1 further adapted to enable voiced utterances to be substituted for manipulation of a pointing device to control motion of a displayed location indicator on a computer display, the indicator being moved by an operating system in a computer in response to control signals received from the pointing device, and wherein said interpreter is further connected to said voice recognizer for converting voiced utterances into events which will cause desired movements of the indicator aided by the operating system.
Claim 16
Dependent Claim
45 words
The system of claim 14 further comprising a program for execution with said operating system, a state of said program comprising a configuration on said display, and wherein said higher level events posted by said interpreter direct motion of said indicator relative to said configuration.
Claim 17
Dependent Claim
13 words
The system of claim 15 wherein said configuration on said display comprises characters.
Claim 18
Dependent Claim
34 words
The system of claim 15 wherein said higher level events posted by said interpreter further direct said location indicator to the screen position said location indicator indicated immediately before said voiced utterance was recognized.
Claim 19
Dependent Claim
26 words
The system of claim 14 wherein one of said higher level events directs said location indicator to indicate a position specified by a local window-relative coordinate.
Claim 20
Dependent Claim
26 words
The system of claim 14 wherein one of said higher level events directs the location indicator to indicate a position specified by a global screen-absolute coordinate.
Claim 21
Dependent Claim
25 words
The system of claim 14 wherein one of said higher level events directs the location indicator to indicate a specified screen button or dialog box.
Claim 22
Dependent Claim
27 words
The system of claim 14 wherein one of said high level events directs the indicator to move from a current position (y,x) to a new position (y+δy,x+δx).
Claim 23
Dependent Claim
30 words
The system of claim 14 wherein one of said high level events directs the location indicator to move continuously by a (δy, δx) predetermined incremental distance per predetermined time interval.
Claim 24
Dependent Claim
36 words
The system of claim 22 wherein said one high level event is generated during a timer interrupt of said operating system, said timer interrupt occurring on the order of ten to one hundred times per second.
Claim 25
Dependent Claim
43 words
The system of claim 14 wherein said program provides user menu selections to be selected by pointer device movements and/or button presses, and wherein said interpreter produces a series of higher level events in response to said pointer device movements and/or button presses.
Claim 26
Dependent Claim
32 words
The system of claim 14 or 1 wherein said operating system is an operating system of a Macintosh computer, and said event queue is an event queue of said Macintosh operating system.
Claim 27
Dependent Claim
14 words
The system of claim 14 or 1 wherein said window elements comprise zooming windows.
Claim 28
Dependent Claim
26 words
The system of claim 14 or 1 wherein said window elements comprise moving windows nearer to or farther from the front of a set of windows.
Claim 29
Dependent Claim
46 words
The system of claim 14 or 1 wherein said voiced utterances are converted into events which will cause movement of the indicator in a desired direction aided by the operating system in the computer, said movement continuing unabated until stopped by an action of the user.
References Cited (Backward Citations)
US4144582A
Cited
US3928724A
Cited
US4462080A
Cited
US4677569A
Cited
US4627001A
Cited
US4688195A
Cited
US4704696A
Cited
US5095508A
Cited
US4811243A
Cited
US4799144A
Cited
US4783803A
Cited
US4776016A
Cited
US4829576A
Cited
US4827520A
Cited
US4922538A
Cited
US4962535A
Cited
US4907274A
Cited
US4984177A
Cited
US5054082A
Cited
US4931950A
Cited
US4949382A
Cited
US5086472A
Cited
US5036538A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1997-12-26 | 1998-06-27 | 1998-12-27 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2001-12-26 | 2002-06-27 | 2002-12-27 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2005-12-26 | 2006-06-27 | 2006-12-27 | $7700.00 | Window Closed / Lapsed |