US4481593A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Continuous speech recognition
Assignee: Silicon Valley Bank Inc
•
Filing: 1981-10-05
•
Granted: 1984-11-06
•
Expires: 2001-10-05
Abstract
Abstract An improved speech recognition method and apparatus for recognizing keywords in a continuous audio signal are disclosed. The keywords, generally either a word or a string of words, are each represented by an element template defined by a plurality of target patterns. Each target pattern is represented by a plurality of statistics describing the expected behavior of a group of spectra selected from plural short-term spectra generated by processing of the incoming audio. The incoming audio spectra are processed to enhance the separation between the spectral pattern classes during later analysis. The processed audio spectra are grouped into multi-frame spectral patterns and are compared, using likelihood statistics, with the target patterns of the element templates. Each multi-frame pattern is forced to contribute to each of a plurality of pattern scores as represented by the element templates. The method and apparatus use speaker independent word models during the training stage to generate, automatically, improved target patterns. The apparatus and method further employ grammatical syntax during the training stage for identifying the beginning and ending boundaries of unknown keywords. Recognition is further improved by use of a plurality of templates representing "silence" or non-speech signals, for example, hum. Also, memory and computation load is reduced by use of modified (collapsed or folded) syntax flow graph logic, implemented by additional (augment) control numbers. A concatenation technique is employed, using dynamic programming techniques, to determine the correct identity of the word string.
Inventors
- 👤 Lawrence G. Bahler
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 01:37
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/04; G10L15/05; G10L15/08; G10L15/12; G10L15/18; G10L15/183; G10L15/19; G10L15/193; G10L2015/088
Claims Analysis
Total Claims: 32
Claim 1
Independent Claim
101 words
In a speech analysis apparatus for recognizing at least one keyword in an audio signal, a method for recognizing silence in the incoming audio signal comprising the steps of: generating at least first and second target templates, each template representing, as a sequence of frequency spectrum representing parameters, an alternate description of silence in said incoming audio signal, comparing said incoming audio signal with each of said first and second target templates, generating a first and a second numerical measure representing the result of said comparisons respectively, and deciding, based at least upon said numerical measures, whether silence has been detected.
Claim 2
Dependent Claim
101 words
In a speech analysis apparatus for recognizing at least one keyword in an audio signal, a method for recognizing silence in the incoming audio signal comprising the steps of: generating at least first and second target templates, each template representing, as a sequence of frequency spectrum representing parameters, an alternate description of silence in said incoming audio signal, comparing said incoming audio signal with each of said first and second target templates, generating a first and a second numerical measure representing the result of said comparisons respectively, and deciding, based at least upon said numerical measures, whether silence has been detected.
Claim 3
Dependent Claim
113 words
In a speech analysis apparatus for recognizing a plurality of keywords in an audio signal, each keyword being characterized by a template having at least one target pattern and each sequence of said keywords in said audio signal being described by a grammatical syntax, said syntax being characterized by a plurality of connected decision nodes, the recognition apparatus comprising: means for providing a sequence of numerical scores for recognizing keywords in said audio signal employing dynamic programming, means for employing said grammatical syntax for determining which scores form acceptable progressions in the recognition process, and means for using augments to preserve acceptable progressions whereby otherwise acceptable progressions are discarded according to said syntax.
Claim 4
Dependent Claim
113 words
In a speech analysis apparatus for recognizing a plurality of keywords in an audio signal, each keyword being characterized by a template having at least one target pattern and each sequence of said keywords in said audio signal being described by a grammatical syntax, said syntax being characterized by a plurality of connected decision nodes, the recognition apparatus comprising: means for providing a sequence of numerical scores for recognizing keywords in said audio signal employing dynamic programming, means for employing said grammatical syntax for determining which scores form acceptable progressions in the recognition process, and means for using augments to preserve acceptable progressions whereby otherwise acceptable progressions are discarded according to said syntax.
Claim 5
Dependent Claim
95 words
In a speech analysis apparatus for recognizing at least one keyword in an audio signal, a method for recognizing silence in said audio signal comprising the steps of: generating a numerical measure of likelihood that the present incoming audio signal portion corresponds to a reference pattern representing silence, effectively altering the numerical measure according to a syntax dependent determination, said syntax dependent determination representing the recognition of an immediately preceeding portion of the audio signal according to a grammatical syntax, and determining from the effectively altered measure whether the present signal portion corresponds to silence.
Claim 6
Dependent Claim
95 words
In a speech analysis apparatus for recognizing at least one keyword in an audio signal, a method for recognizing silence in said audio signal comprising the steps of: generating a numerical measure of likelihood that the present incoming audio signal portion corresponds to a reference pattern representing silence, effectively altering the numerical measure according to a syntax dependent determination, said syntax dependent determination representing the recognition of an immediately preceeding portion of the audio signal according to a grammatical syntax, and determining from the effectively altered measure whether the present signal portion corresponds to silence.
Claim 7
Dependent Claim
104 words
In a speech analysis apparatus for recognizing at least one spoken keywork in an audio signal, each keyword being characterized by a template having at least one target pattern, a method for forming reference patterns representing said spoken keywords and tailored to a speaker, comprising the steps of: providing speaker independent reference patterns representing said spoken keywords, determining beginning and ending boundaries of said keywords in audio signals spoken by said speaker using said speaker independent reference patterns, and training the speech analysis apparatus to said speaker using the beginning and ending boundaries determined by said apparatus for said keywords spoken by said speaker.
Claim 8
Dependent Claim
104 words
In a speech analysis apparatus for recognizing at least one spoken keywork in an audio signal, each keyword being characterized by a template having at least one target pattern, a method for forming reference patterns representing said spoken keywords and tailored to a speaker, comprising the steps of: providing speaker independent reference patterns representing said spoken keywords, determining beginning and ending boundaries of said keywords in audio signals spoken by said speaker using said speaker independent reference patterns, and training the speech analysis apparatus to said speaker using the beginning and ending boundaries determined by said apparatus for said keywords spoken by said speaker.
Claim 9
Dependent Claim
94 words
The method of claim 4 wherein the training step comprises the steps of: dividing a keyword representing incoming audio signal from said speaker into a plurality of subintervals using said keyword boundaries, forcing each subinterval to correspond to a unique reference pattern, repeating said dividing and forcing steps upon a plurality of audio input signals representing the same keyword, generating statistics describing the reference pattern associated with each subinterval, and making a second pass through said audio input signals representing said keyword, using said assembled statistics, for providing machine generated subintervals for said keywords.
Claim 10
Dependent Claim
102 words
In a speech analysis apparatus for recognizing at least one spoken keyword in an audio signal, each keyword being characterized by a template having at least one target pattern, a method for forming reference patterns representing a previously unknown keyword comprising the steps of: providing speaker independent reference patterns representing spoken keywords previously known to the apparatus, determining beginning and ending boundaries of said unknown keyword using said speaker independent reference patterns, and training the speech analysis apparatus, using the beginning and ending boundaries previously determined by said apparatus for said previously unknown keyword, to generate statistics describing said previously unknown keyword.
Claim 11
Dependent Claim
102 words
In a speech analysis apparatus for recognizing at least one spoken keyword in an audio signal, each keyword being characterized by a template having at least one target pattern, a method for forming reference patterns representing a previously unknown keyword comprising the steps of: providing speaker independent reference patterns representing spoken keywords previously known to the apparatus, determining beginning and ending boundaries of said unknown keyword using said speaker independent reference patterns, and training the speech analysis apparatus, using the beginning and ending boundaries previously determined by said apparatus for said previously unknown keyword, to generate statistics describing said previously unknown keyword.
Claim 12
Dependent Claim
24 words
The method of claim 6 further comprising the step of providing an audio signal representing said unknown keyword spoken by said speaker in isolation.
Claim 13
Dependent Claim
96 words
The method of claim 6 wherein the training step comprises the steps of: dividing an incoming audio signal corresponding to said previously unknown keyword into a plurality of subintervals using said boundaries, forcing each subinterval to correspond to a unique reference pattern, repeating said dividing and forcing steps upon a plurality of audio input signals representing the same keyword, generating statistics describing the reference pattern associated with each subinterval, and making a second pass through said audio input signals representing said previously unknown keyword, using said assembled statistics, for providing machine generated subintervals for said keyword.
Claim 14
Dependent Claim
113 words
In a speech analysis apparatus for recognizing a plurality of keywords in an audio signal, each keyword being characterized by a template having at least one target pattern and each sequence of said keywords in said audio signal being described by a grammatical syntax, said syntax being characterized by a plurality of connected decision nodes, the recognition method comprising the steps of: providing a sequence of numerical scores for recognizing keywords in said audio signal employing dynamic programming, employing said grammatical syntax for determining which scores form acceptable progressions in the recognition process, and reducing the number of decision nodes by collapsing said syntax whereby the computational load for the apparatus is reduced.
Claim 15
Dependent Claim
113 words
In a speech analysis apparatus for recognizing a plurality of keywords in an audio signal, each keyword being characterized by a template having at least one target pattern and each sequence of said keywords in said audio signal being described by a grammatical syntax, said syntax being characterized by a plurality of connected decision nodes, the recognition method comprising the steps of: providing a sequence of numerical scores for recognizing keywords in said audio signal employing dynamic programming, employing said grammatical syntax for determining which scores form acceptable progressions in the recognition process, and reducing the number of decision nodes by collapsing said syntax whereby the computational load for the apparatus is reduced.
Claim 16
Dependent Claim
105 words
In a speech analysis apparatus for recognizing at least one keyword in an audio signal, apparatus for recognizing silence in the incoming audio signal comprising: means for generating at least first and second target templates, each template representing, as a sequence of frequency spectrum representing parameters, an alternate description of silence in said incoming audio signal, means for comparing said incoming audio signal with each of said first and second target templates, means for generating a first and a second numerical measure representing the result of said comparisons respectively, and means for deciding, based at least upon said numerical measures, whether silence has been detected.
Claim 17
Dependent Claim
105 words
In a speech analysis apparatus for recognizing at least one keyword in an audio signal, apparatus for recognizing silence in the incoming audio signal comprising: means for generating at least first and second target templates, each template representing, as a sequence of frequency spectrum representing parameters, an alternate description of silence in said incoming audio signal, means for comparing said incoming audio signal with each of said first and second target templates, means for generating a first and a second numerical measure representing the result of said comparisons respectively, and means for deciding, based at least upon said numerical measures, whether silence has been detected.
Claim 18
Dependent Claim
110 words
In a speech analysis apparatus for recognizing a plurality of keywords in an audio signal, each keyword being characterized by a template having at least one target pattern and each sequence of said keywords in said audio signal being described by a grammatical syntax, said syntax being characterized by a plurality of connected decision nodes, the recognition method comprising the steps of: providing a sequence of numerical scores for recognizing keywords in said audio signal employing dynamic programming, employing said grammatical syntax for determining which scores form acceptable progressions in the recognition process, and using augments to preserve acceptable progressions whereby otherwise acceptable progressions are discarded according to said syntax.
Claim 19
Dependent Claim
110 words
In a speech analysis apparatus for recognizing a plurality of keywords in an audio signal, each keyword being characterized by a template having at least one target pattern and each sequence of said keywords in said audio signal being described by a grammatical syntax, said syntax being characterized by a plurality of connected decision nodes, the recognition method comprising the steps of: providing a sequence of numerical scores for recognizing keywords in said audio signal employing dynamic programming, employing said grammatical syntax for determining which scores form acceptable progressions in the recognition process, and using augments to preserve acceptable progressions whereby otherwise acceptable progressions are discarded according to said syntax.
Claim 20
Dependent Claim
98 words
In a speech analysis apparatus for recognizing at least one keyword in an audio signal, apparatus for recognizing silence in said audio signal comprising: means for generating a numerical measure of likelihood that the present incoming audio signal portion corresponds to a reference pattern representing silence, means for adding to the numerical measure a syntax dependent numerical value to form a score, said syntax dependent value representing the recognition of an immediately preceeding portion of the audio signal according to a grammatical syntax, and means for determining from the score whether the present signal portion corresponds to silence.
Claim 21
Dependent Claim
98 words
In a speech analysis apparatus for recognizing at least one keyword in an audio signal, apparatus for recognizing silence in said audio signal comprising: means for generating a numerical measure of likelihood that the present incoming audio signal portion corresponds to a reference pattern representing silence, means for adding to the numerical measure a syntax dependent numerical value to form a score, said syntax dependent value representing the recognition of an immediately preceeding portion of the audio signal according to a grammatical syntax, and means for determining from the score whether the present signal portion corresponds to silence.
Claim 22
Dependent Claim
106 words
In a speech analysis apparatus for recognizing at least one spoken keyword in an audio signal, each keyword being characterized by a template having at least one target pattern, apparatus for forming reference patterns representing said spoken keywords and tailored to a speaker comprising: means for providing speaker independent reference patterns representing said spoken keywords, means for determining beginning and ending boundaries of said keywords in audio signals spoken by said speaker using said speaker independent reference patterns, and means for training the speech analysis apparatus to said speaker using the beginning and ending boundaries determined by said apparatus for said keywords spoken by said speaker.
Claim 23
Dependent Claim
106 words
In a speech analysis apparatus for recognizing at least one spoken keyword in an audio signal, each keyword being characterized by a template having at least one target pattern, apparatus for forming reference patterns representing said spoken keywords and tailored to a speaker comprising: means for providing speaker independent reference patterns representing said spoken keywords, means for determining beginning and ending boundaries of said keywords in audio signals spoken by said speaker using said speaker independent reference patterns, and means for training the speech analysis apparatus to said speaker using the beginning and ending boundaries determined by said apparatus for said keywords spoken by said speaker.
Claim 24
Dependent Claim
88 words
The apparatus of claim 13 wherein the training means comprises: means for repetitively dividing a keyword representing incoming audio signal, from said speaker, corresponding to a keyword into a plurality of subintervals using said keyword boundaries, means for repetitively forcing each subinterval to correspond to a unique reference pattern, means for generating statistics describing the reference pattern associated with each subinterval, and means for making a second pass through said audio input signals representing said keyword, using said assembled statistics, for providing machine generated subintervals for said keywords.
Claim 25
Dependent Claim
103 words
In a speech analysis apparatus for recognizing at least one spoken keyword in an audio signal, each keyword being characterized by a template having at least one target pattern, apparatus for forming reference patterns representing a previously unknown keyword comprising: means for providing speaker independent reference patterns representing spoken keywords previously known to the apparatus, means for determining beginning and ending boundaries of said unknown keyword using said speaker independent reference patterns, and means for training the speech analysis apparatus using the beginning and ending boundaries previously determined by said apparatus for said unknown keyword to generate statistics describing said previously unknown keyword.
Claim 26
Dependent Claim
103 words
In a speech analysis apparatus for recognizing at least one spoken keyword in an audio signal, each keyword being characterized by a template having at least one target pattern, apparatus for forming reference patterns representing a previously unknown keyword comprising: means for providing speaker independent reference patterns representing spoken keywords previously known to the apparatus, means for determining beginning and ending boundaries of said unknown keyword using said speaker independent reference patterns, and means for training the speech analysis apparatus using the beginning and ending boundaries previously determined by said apparatus for said unknown keyword to generate statistics describing said previously unknown keyword.
Claim 27
Dependent Claim
7 words
The apparatus of claim 15 further comprising
Claim 28
Dependent Claim
16 words
means for providing an audio signal representing said unknown keyword spoken by said speaker in isolation.
Claim 29
Dependent Claim
16 words
means for providing an audio signal representing said unknown keyword spoken by said speaker in isolation.
Claim 30
Dependent Claim
86 words
The apparatus of claim 15 wherein the training means comprises: means for repetitively dividing an incoming audio signal corresponding to said previously unknown keyword into a plurality of subintervals using said boundaries, means for repetitively forcing each subinterval to correspond to a unique reference pattern, means for generating statistics describing the reference pattern associated with each subinterval, and means for making a second pass through said audio input signals representing said previously unknown keyword, using said assembled statistics, for providing machine generated subintervals for said keyword.
Claim 31
Dependent Claim
112 words
In a speech analysis apparatus for recognizing a plurality of keywords in an audio signal, each keyword being characterized by a template having at least one target pattern and each sequence of said keywords in said audio signal being described by a grammatical syntax, said syntax being characterized by a plurality of connected decision nodes, the recognition apparatus comprising: means for providing a sequence of numerical scores for recognizing keywords in said audio signal employing dynamic programming, means for employing said grammatical syntax for determining which scores form acceptable progressions in the recognition process, and means for reducing the number of decision nodes whereby the computational load for the apparatus is reduced.
Claim 32
Dependent Claim
112 words
In a speech analysis apparatus for recognizing a plurality of keywords in an audio signal, each keyword being characterized by a template having at least one target pattern and each sequence of said keywords in said audio signal being described by a grammatical syntax, said syntax being characterized by a plurality of connected decision nodes, the recognition apparatus comprising: means for providing a sequence of numerical scores for recognizing keywords in said audio signal employing dynamic programming, means for employing said grammatical syntax for determining which scores form acceptable progressions in the recognition process, and means for reducing the number of decision nodes whereby the computational load for the apparatus is reduced.
References Cited (Backward Citations)
US3816722A
Cited
US4059725A
Cited
US4049913A
Cited
US4038503A
Cited
US4158750A
Cited
US4301329A
Cited
US4227176A
Cited
US4241329A
Cited
US4227177A
Cited
US4282403A
Cited
US4282405A
Cited
US4412098A
Cited
US4336421A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1987-11-06 | 1988-05-07 | 1988-11-06 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1991-11-06 | 1992-05-07 | 1992-11-06 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 1995-11-06 | 1996-05-07 | 1996-11-06 | $7700.00 | Window Closed / Lapsed |