US5664061A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Interactive computer system recognizing spoken commands
Assignee: Nuance Communications Inc
•
Filing: 1995-06-05
•
Granted: 1997-09-02
•
Expires: 2015-06-05
Abstract
Abstract An interactive computer system having a processor executing a target computer program, and having a speech recognizer for converting an utterance into a command signal for the target computer program. The target computer program has a series of active program states occurring over a series of time periods. At least a first active-state image is displayed for a first active state occurring during a first time period. At least one object displayed in the first active-state image is identified, and a list of one or more first active-state commands identifying functions which can be performed in the first active state of the target computer program is generated from the identified object. A first active-state vocabulary of acoustic command models for the first active state comprises the acoustic command models from a system vocabulary representing the first active-state commands. A speech recognizer measures the value of at least one feature of an utterance during each of a series of successive time intervals within the first time period to produce a series of feature signals. The measured feature signals are compared to each of the acoustic command models in the first active-state vocabulary to generate a match score for the utterance and each acoustic command model. The speech recognizer outputs a command signal corresponding to the command model from the first active-state vocabulary having the best match score.
Inventors
- 👤 Joseph Charles Andreshak
- 👤 Gregg H. Daggett
- 👤 John Karat
- 👤 John Lucassen
- 👤 Stephen Eric Levy
- 👤 Robert Lawrence Mack
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-02 18:36
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/22; G06; G06F; G06F3/00; G06F3/16; G10L2015/226; G10L2015/228
Claims Analysis
Total Claims: 27
Claim 1
Independent Claim
340 words
An interactive computer system comprising: a processor executing a target computer program having a series of active program states occurring over a succession of time periods, said target computer program generating active state image data signals representing an active state image for an active state of the target computer program occurring during each time period, each active state image containing one or more objects; means for displaying at least a first active-state image for a first active state occurring during a first time period; means for identifying an object displayed in the first active-state image, and for generating from an identified object displayed in the first active-state image a list of one or more first active-state commands identifying a first active-state function which can be performed in the first active state of the target computer program; means for storing a system vocabulary of acoustic command models, each acoustic command model representing one or more series of acoustic feature values representing an utterance of one or more words associated with the acoustic command model; means for identifying a first active-state vocabulary of acoustic command models for the first active state, the first active-state vocabulary comprising the acoustic command models from the system vocabulary representing the first active-state commands, wherein the first active-state vocabulary changes dynamically as a function of both the identity of the target computer program and the active state image data signals which identify an active state of the target computer program; and a speech recognizer for measuring a value of at least one feature of an utterance during each of a first sequence of time intervals within the first time period to produce a first series of feature signals, said speech recognizer comparing the first series of feature signals to each of the acoustic command models in the first active-state vocabulary to generate a match score for the utterance and each acoustic command model, and said speech recognizer outputting a command signal corresponding to the acoustic command model from the first active-state vocabulary having a best match score.
Claim 2
Dependent Claim
340 words
An interactive computer system comprising: a processor executing a target computer program having a series of active program states occurring over a succession of time periods, said target computer program generating active state image data signals representing an active state image for an active state of the target computer program occurring during each time period, each active state image containing one or more objects; means for displaying at least a first active-state image for a first active state occurring during a first time period; means for identifying an object displayed in the first active-state image, and for generating from an identified object displayed in the first active-state image a list of one or more first active-state commands identifying a first active-state function which can be performed in the first active state of the target computer program; means for storing a system vocabulary of acoustic command models, each acoustic command model representing one or more series of acoustic feature values representing an utterance of one or more words associated with the acoustic command model; means for identifying a first active-state vocabulary of acoustic command models for the first active state, the first active-state vocabulary comprising the acoustic command models from the system vocabulary representing the first active-state commands, wherein the first active-state vocabulary changes dynamically as a function of both the identity of the target computer program and the active state image data signals which identify an active state of the target computer program; and a speech recognizer for measuring a value of at least one feature of an utterance during each of a first sequence of time intervals within the first time period to produce a first series of feature signals, said speech recognizer comparing the first series of feature signals to each of the acoustic command models in the first active-state vocabulary to generate a match score for the utterance and each acoustic command model, and said speech recognizer outputting a command signal corresponding to the acoustic command model from the first active-state vocabulary having a best match score.
Claim 3
Dependent Claim
59 words
An interactive computer system as claimed in claim 1, characterized in that: the first active-state vocabulary comprises substantially less than all of the acoustic command models from the system vocabulary; and the speech recognizer does not compare the measured feature signals for the first time period to any acoustic command model which is not in the first active-state vocabulary.
Claim 4
Dependent Claim
257 words
An interactive computer system as claimed in claim 2, characterized in that: the means for displaying displays at least a second active-state image different from the first active-state image for a second active state occurring during a second time period different from the first time period; the means for identifying an object identifies an object displayed in the second active-state image, and generates from an identified object displayed in the second active-state image a catalog of one or more second active-state commands identifying a second active-state function function which can be performed in the second active state of the target computer program; the means for identifying a first active-state vocabulary identifies a second active-state vocabulary of acoustic command models for the second active state, the second active-state vocabulary comprising the acoustic command models from the system vocabulary representing the second active-state commands, the second active-state vocabulary being at least partly different from the first active-state vocabulary; and the speech recognizer measures the value of at least one feature of the utterance during each of a second sequence of time intervals within the second time period to produce a second series of feature signals, said speech recognizer comparing the second series of feature signals for the second time period to each of the acoustic command models in the second active-state vocabulary to generate the match score for the utterance and each acoustic command model, and said speech recognizer outputting the command signal corresponding to the acoustic command model from the second active-state vocabulary having the best match score.
Claim 5
Dependent Claim
26 words
An interactive computer system as claimed in claim 3, characterized in that the target computer program has only one active state occurring during each time period.
Claim 6
Dependent Claim
21 words
An interactive computer system as claimed in claim 4, characterized in that the target computer program comprises an operating system program.
Claim 7
Dependent Claim
25 words
An interactive computer system as claimed in claim 5, characterized in that the target computer program comprises an application program and an operating system program.
Claim 8
Dependent Claim
27 words
An interactive computer system as claimed in claim 6, characterized in that the target computer program comprises two or more application programs and an operating system program.
Claim 9
Dependent Claim
36 words
An interactive computer system as claimed in claim 6, characterized in that at least some commands for the active-state identify functions which can be performed on the identified object in the active-state image for the active-state.
Claim 10
Dependent Claim
50 words
An interactive computer system as claimed in claim 8, characterized in that the identified object in the active-state image comprises one or more of a character, a word, an icon, a button, a scroll bar, a slider, a list box, a menu, a check box, a container, or a notebook.
Claim 11
Dependent Claim
39 words
An interactive computer system as claimed in claim 9, characterized in that the speech recognizer outputs two or more command signals corresponding to the command models from the active-state vocabulary having best match scores for a given time period.
Claim 12
Dependent Claim
50 words
An interactive computer system as claimed in claim 10, characterized in that the active-state vocabulary of acoustic command models for each active state further comprises a set of global acoustic command models representing global commands identifying functions which can be performed in each active state of the target computer program.
Claim 13
Dependent Claim
19 words
An interactive computer system as claimed in claim 11, characterized in that the means for displaying comprises a display.
Claim 14
Dependent Claim
49 words
An interactive computer system as claimed in claim 11, characterized in that the means for displaying displays both the active-state image for the active state occurring during a time period, and at least a portion of one or more images for program states not occurring during the time period.
Claim 15
Independent Claim
322 words
A method of computer interaction comprising: executing, on a processor, a target computer program having a series of active program states occurring over a succession of time periods, said target computer program generating active state image data signals representing an active state image for an active state of the target computer program occurring during each time period, each active state image containing one or more objects; displaying at least a first active-state image for a first active state occurring during a first time period; identifying an object displayed in the first active-state image, and generating from an identified object displayed in the first active-state image a list of one or more first active-state commands identifying a first active-state function which can be performed in the first active state of the target computer program; storing a system vocabulary of acoustic command models, each acoustic command model representing one or more series of acoustic feature values representing an utterance of one or more words associated with the acoustic command model; identifying a first active-state vocabulary of acoustic command models for the first active state, the first active-state vocabulary comprising the acoustic command models from the system vocabulary representing the first active-state commands wherein the first active-state vocabulary changes dynamically as a function of both the identity of the target computer program and the active state image data signals which identify an active state of the target computer program; and measuring a value of at least one feature of an utterance during each of first sequence of time intervals within the first time period to produce a first series of feature signals; comparing the first series of feature signals to each of the acoustic command models in the first active-state vocabulary to generate a match score for the utterance and each acoustic command model; and outputting a command signal corresponding to the acoustic command model from the first active-state vocabulary having a best match score.
Claim 16
Independent Claim
322 words
A method of computer interaction comprising: executing, on a processor, a target computer program having a series of active program states occurring over a succession of time periods, said target computer program generating active state image data signals representing an active state image for an active state of the target computer program occurring during each time period, each active state image containing one or more objects; displaying at least a first active-state image for a first active state occurring during a first time period; identifying an object displayed in the first active-state image, and generating from an identified object displayed in the first active-state image a list of one or more first active-state commands identifying a first active-state function which can be performed in the first active state of the target computer program; storing a system vocabulary of acoustic command models, each acoustic command model representing one or more series of acoustic feature values representing an utterance of one or more words associated with the acoustic command model; identifying a first active-state vocabulary of acoustic command models for the first active state, the first active-state vocabulary comprising the acoustic command models from the system vocabulary representing the first active-state commands wherein the first active-state vocabulary changes dynamically as a function of both the identity of the target computer program and the active state image data signals which identify an active state of the target computer program; and measuring a value of at least one feature of an utterance during each of first sequence of time intervals within the first time period to produce a first series of feature signals; comparing the first series of feature signals to each of the acoustic command models in the first active-state vocabulary to generate a match score for the utterance and each acoustic command model; and outputting a command signal corresponding to the acoustic command model from the first active-state vocabulary having a best match score.
Claim 17
Dependent Claim
61 words
A method of computer interaction as claimed in claim 14, characterized in that: the first active-state vocabulary comprises substantially less than all of the acoustic command models from the system vocabulary; and the step of comparing does not compare the measured feature signals for the first time period to any acoustic command model which is not in the first active-state vocabulary.
Claim 18
Dependent Claim
230 words
A method of computer interaction as claimed in claim 15, further comprising the steps of: displaying at least a second active-state image different from the first active-state image for a second active state occurring during a second time period different from the first time period; identifying an object displayed in the second active-state image, and generating from an identified object displayed in the second active-state image a catalog of one or more second active-state commands identifying a second active-state function which can be performed in the second active state of the target computer program; identifying a second active-state vocabulary of acoustic command models for the second active state, the second active-state vocabulary comprising the acoustic command models from the system vocabulary representing the second active-state commands, the second active-state vocabulary being at least partly different from the first active-state vocabulary; measuring the value of at least one feature of the utterance during each of a second sequence of time intervals within the second time period to produce a series of feature signals; comparing the second series of feature signals for the second time period to each of the acoustic command models in the second active-state vocabulary to generate the match score for the utterance and each acoustic command model; and outputting the command signal corresponding to the acoustic command model from the second active-state vocabulary having the best match score.
Claim 19
Dependent Claim
27 words
A method of computer interaction as claimed in claim 16, characterized in that the target computer program has only one active state occurring during each time period.
Claim 20
Dependent Claim
22 words
A method of computer interaction as claimed in claim 17, characterized in that the target computer program comprises an operating system program.
Claim 21
Dependent Claim
26 words
A method of computer interaction as claimed in claim 18, characterized in that the target computer program comprises an application program and an operating system program.
Claim 22
Dependent Claim
28 words
A method of computer interaction as claimed in claim 19, characterized in that the target computer program comprises two or more application programs and an operating system program.
Claim 23
Dependent Claim
38 words
A method of computer interaction as claimed in claim 19, characterized in that at least some commands for the active-state identify functions which can be performed on the identified object in the active-state image for the active state.
Claim 24
Dependent Claim
51 words
A method of computer interaction as claimed in claim 21, characterized in that the identified object in the active-state image comprises one or more of a character, a word, an icon, a button, a scroll bar, a slider, a list box, a menu, a check box, a container, or a notebook.
Claim 25
Dependent Claim
45 words
A method of computer interaction as claimed in claim 22, characterized in that the step of outputting a command signal comprises outputting two or more command signals corresponding to the command models from the active-state vocabulary having best match scores for a given time period.
Claim 26
Dependent Claim
51 words
A method of computer interaction as claimed in claim 23, characterized in that the active-state vocabulary of acoustic command models for each active state further comprises a set of global acoustic command models representing global commands identifying functions which can be performed in each active state of the target computer program.
Claim 27
Dependent Claim
48 words
A method of computer interaction as claimed in claim 24, further comprising the step of displaying both the active-state image for the active state occurring during a time period, and at least a portion of one or more images for program states not occurring during the time period.
References Cited (Backward Citations)
US4509133A
Cited
US4677569A
Cited
US4704696A
Cited
US4980918A
Cited
US4759068A
Cited
US4776016A
Cited
US4931950A
Cited
US5157384A
Cited
EP0414238A2
Cited
US5195167A
Cited
US5182773A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-09-01 | 2001-03-03 | 2001-09-02 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-09-01 | 2005-03-03 | 2005-09-02 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-09-01 | 2009-03-03 | 2009-09-02 | $7700.00 | Window Closed / Lapsed |