Patent US4489435A successfully refreshed from Google Patents.
US4489435A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for continuous word string recognition
Assignee: Silicon Valley Bank Inc
•
Filing: 1981-10-05
•
Granted: 1984-12-18
•
Expires: 2001-10-05
Abstract
Abstract A speech recognition method and apparatus for recognizing word strings in a continuous audio signal are disclosed. The word strings are made up of a plurality of elements, and each element, generally a word, is represented by an element template defined by a plurality of target patterns. Each target pattern is represented by a plurality of statistics describing the expected behavior of a group of spectra selected from plural short-term spectra generated by processing of the incoming audio. Each target pattern has associated therewith at least one required dwell time position and at least one optional dwell time position. The number of required dwell time positions and the sum of the required and optional dwell time positions define, in effect, the limits of a time interval during which a given target pattern can be said to match an incoming sequence of frame patterns. The incoming audio spectra are processed to enhance the separation between the spectral pattern classes during later analysis. The processed audio spectra are grouped into multi-frame spectral patterns and are compared, using likelihood statistics, with the target patterns of the element templates. Each multi-frame pattern input, which inputs occur at a frame rate which requires each keyword target pattern to correspond to at least two of the multi-frame patterns, is forced to contribute to each of a plurality of pattern scores as represented by the element templates. The contributions of said multi-frame pattern inputs to said pattern scores is controlled, in part, by said required and optional dwell time constraints. A concatenation technique is employed, using dynamic programming techniques, to determine the correct identity of the word string.
Inventors
- 👤 Stephen L. Moshier
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 19:13
CPC Classifications
G; G10; G10L; G10L15/00
Claims Analysis
Total Claims: 19
Claim 1
Independent Claim
198 words
In a speech analysis apparatus for recognizing at least one keyword in an audio signal, each keyword being characterized by a template having at least one target pattern, each target pattern representing at least two short-term power spectra, and each target pattern having associated therewith at least two required dwell time positions and at least one optional dwell time position, the recognition method comprising the steps of: forming at a repetitive frame time, a sequence of input frame patterns from and representing said audio signal, each frame pattern being associated with a frame time, successive frame patterns corresponding to successive dwell time positions, generating a numerical measure of the similarity of each said frame pattern with each of said target patterns, accumulating for each said target pattern required dwell time position and each said target pattern optional dwell time position, and using said numerical measure of the similarity of the just formed frame pattern and said each target pattern, a numerical value representing the alignment of the just formed frame pattern with the respective target pattern dwell time position, and generating a recognition decision, based upon said numerical values, when a predetermined sequence occurs in said audio signal.
Claim 2
Dependent Claim
198 words
In a speech analysis apparatus for recognizing at least one keyword in an audio signal, each keyword being characterized by a template having at least one target pattern, each target pattern representing at least two short-term power spectra, and each target pattern having associated therewith at least two required dwell time positions and at least one optional dwell time position, the recognition method comprising the steps of: forming at a repetitive frame time, a sequence of input frame patterns from and representing said audio signal, each frame pattern being associated with a frame time, successive frame patterns corresponding to successive dwell time positions, generating a numerical measure of the similarity of each said frame pattern with each of said target patterns, accumulating for each said target pattern required dwell time position and each said target pattern optional dwell time position, and using said numerical measure of the similarity of the just formed frame pattern and said each target pattern, a numerical value representing the alignment of the just formed frame pattern with the respective target pattern dwell time position, and generating a recognition decision, based upon said numerical values, when a predetermined sequence occurs in said audio signal.
Claim 3
Dependent Claim
147 words
The method of claim 1 wherein said accumulating step comprises the steps of accumulating for each target pattern second and later required dwell time position, and for each target pattern optional dwell time position, the sum of the accumulated score for the previous target pattern dwell time position during the previous frame time and the present numerical measure associated with the target pattern, accumulating, for each keyword first target pattern, first required dwell time position, the sum of the best accumulated score, during the previous frame time, which is associated with the end of a keyword, and the present numerical measure associated with the keyword first target pattern, and accumulating, for each other target pattern first required dwell time position, the sum of the best ending accumulated score for the previous target pattern of the same keyword and the present numerical measure associated with the target pattern.
Claim 4
Dependent Claim
70 words
The method of claim 2 further comprising the steps of storing in association with each frame time position, the identity and duration, in frame time position, of the keyword having best score and a valid ending at each said frame time position, and wherein said decision generating step comprises the step of tracing back through said stored keyword indentity and duration information for determining each keyword in a word string.
Claim 5
Dependent Claim
43 words
The method of claim 3 further comprising the step of storing, in association with each dwell time position accumulated score, a word duration count corresponding to the time position length of the keyword associated with the accumulated score at the dwell time position.
Claim 6
Dependent Claim
39 words
The method of claim 4 further comprising the step of storing, in association with each dwell time position accumulated score, a target pattern duration count corresponding to the position sequence of the dwell time position in the target pattern.
Claim 7
Dependent Claim
26 words
The method of claim 1 wherein said decision generating and accumulating steps comprise directing the transfer of accumulated scores in response to a syntax generating element.
Claim 8
Independent Claim
206 words
An apparatus for recognizing at least one keyword in an audio speech signal, each keyword being characterized by a template having at least one target pattern, each pattern representing at least two short term power spectra, and each target pattern having associated therewith at least two required dwell time positions and at least one optional dwell time position, the recognition apparatus comprising, means for forming, at a repetitive frame time rate, a sequence of input frame patterns from, and representing, said audio signal, each frame pattern corresponding to a said frame time, and successive frame patterns corresponding to successive dwell time positions, means for generating a numerical measure of the similarity of each said frame pattern with each of said target patterns, means for accumulating, for each said target pattern required dwell time position and each said target pattern optional dwell time position, and using said numerical measure of the similarity of the just formed frame pattern and said each target pattern, a numerical value representing the alignment of the just formed audio representing frame pattern with the respective target pattern dwell time position, and means for generating a recognition decision, based upon the accumulated numerical values, when a predetermined sequence occurs in said audio signal.
Claim 9
Independent Claim
206 words
An apparatus for recognizing at least one keyword in an audio speech signal, each keyword being characterized by a template having at least one target pattern, each pattern representing at least two short term power spectra, and each target pattern having associated therewith at least two required dwell time positions and at least one optional dwell time position, the recognition apparatus comprising, means for forming, at a repetitive frame time rate, a sequence of input frame patterns from, and representing, said audio signal, each frame pattern corresponding to a said frame time, and successive frame patterns corresponding to successive dwell time positions, means for generating a numerical measure of the similarity of each said frame pattern with each of said target patterns, means for accumulating, for each said target pattern required dwell time position and each said target pattern optional dwell time position, and using said numerical measure of the similarity of the just formed frame pattern and said each target pattern, a numerical value representing the alignment of the just formed audio representing frame pattern with the respective target pattern dwell time position, and means for generating a recognition decision, based upon the accumulated numerical values, when a predetermined sequence occurs in said audio signal.
Claim 10
Dependent Claim
27 words
The apparatus of claim 7 further comprising means for recognizing said predetermined sequence in said audio signal and for employing said predetermined sequence as a control signal.
Claim 11
Dependent Claim
13 words
The apparatus of claim 8 wherein said predetermined sequence is a silence pattern.
Claim 12
Dependent Claim
154 words
The apparatus according to claim 7 wherein said accumulating means comprises first means for accumulating for each target pattern second and later required dwell time position and each target pattern optional dwell time position, the sum of the accumulated score for the previous target pattern dwell time position during the previous frame time and the present numerical measure associated with the target pattern, second means for accumulating, for each keyword first target pattern, first required dwell time position, the sum of the best accumulated score during the previous frame time which is associated with the end of a keyword, and the present numerical measure associated with the keyword first target pattern, and third means for accumulating, for each other first target pattern, first required dwell time position, the sum of the best ending accumulated score for the previous target pattern of the same keyword and the present numerical measure associated with the target pattern.
Claim 13
Dependent Claim
70 words
The apparatus according to claim 10 further comprising means for storing in association with each frame time position, the identity and duration, in frame time positions, of the keyword having the best score and a valid ending at each said frame time position, and wherein said decision generating means comprises means for tracing back through the stored keyword identity and duration information for identifying each keyword in a word string.
Claim 14
Dependent Claim
42 words
The apparatus of claim 11 further comprising means for storing in association with each dwell time position accumulated score, a word duration count corresponding to the time position length of the keyword associated with the accumulated score at the dwell time position.
Claim 15
Dependent Claim
38 words
The apparatus of claim 12 further comprising second means for storing, in association with each dwell time position accumulated score, a target pattern duration count corresponding to the time of the dwell time position in the target pattern.
Claim 16
Dependent Claim
28 words
The method of claim 7 wherein the decision generating and accumulating means comprise means for directing the transfer of accumulated scores in response to a syntax generating element.
Claim 17
Dependent Claim
171 words
In a speech analysis apparatus for recognizing at least one keyword in an audio signal, each keyword being characterized by a template having at least one target pattern, each target pattern representing at least two short-term power spectra, and each target pattern having associated therewith at least two required dwell time positions and at least one optional dwell time position, said dwell time positions defining the limits during which a said target pattern can match an incoming sequence of frame patterns, a method for forming said target patterns representing said keywords comprising the steps of: dividing an incoming audio signal corresponding to a keyword into a plurality of subintervals, forcing each subinterval to correspond to a unique target pattern, repeating said dividing and forcing steps upon a plurality of audio input signals representing the same keyword, generating statistics describing the target pattern associated with each subinterval, and making a second pass through said audio input signals representing said keyword, using said assembled statistics, for providing machine generated subintervals for said keywords.
Claim 18
Dependent Claim
171 words
In a speech analysis apparatus for recognizing at least one keyword in an audio signal, each keyword being characterized by a template having at least one target pattern, each target pattern representing at least two short-term power spectra, and each target pattern having associated therewith at least two required dwell time positions and at least one optional dwell time position, said dwell time positions defining the limits during which a said target pattern can match an incoming sequence of frame patterns, a method for forming said target patterns representing said keywords comprising the steps of: dividing an incoming audio signal corresponding to a keyword into a plurality of subintervals, forcing each subinterval to correspond to a unique target pattern, repeating said dividing and forcing steps upon a plurality of audio input signals representing the same keyword, generating statistics describing the target pattern associated with each subinterval, and making a second pass through said audio input signals representing said keyword, using said assembled statistics, for providing machine generated subintervals for said keywords.
Claim 19
Dependent Claim
23 words
The method of claim 15 wherein said subintervals are initially spaced uniformly from the beginning to the end of an audio input keyword.
References Cited (Backward Citations)
US3816722A
Cited
US4059725A
Cited
US4049913A
Cited
US4038503A
Cited
US4107460A
Cited
US4156868A
Cited
US4301329A
Cited
US4227177A
Cited
US4227176A
Cited
US4241329A
Cited
US4282403A
Cited
US4282405A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1987-12-18 | 1988-06-18 | 1988-12-18 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1991-12-18 | 1992-06-18 | 1992-12-18 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 1995-12-18 | 1996-06-18 | 1996-12-18 | $7700.00 | Window Closed / Lapsed |