US5625749A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Segment-based apparatus and method for speech recognition by analyzing multiple speech unit frames and modeling both temporal and spatial correlation
Assignee: Massachusetts Institute of Technology
•
Filing: 1994-08-22
•
Granted: 1997-04-29
•
Expires: 2014-08-22
Abstract
Abstract Phonetic recognition is provided by capturing dynamical behavior and statistical dependencies of the acoustic attributes used to represent a subject speech waveform. A segment based framework is employed. Temporal behavior is modelled explicitly by creating dynamic templates, called tracks, of the acoustic attributes used to represent the speech waveform, and by generating the estimation of the acoustic spatio-temporal correlation structure. An error model represents this estimation as the temporal and spatial correlations between the input speech waveform and track generated speech segment. Models incorporating these two components (track and error estimation) are created for both phonetic units and for phonetic transitions. Phonetic contextual influences are accounted for by merging context-dependent tracks and pooling error statistics over the different contexts. This allows for a large number of contextual models without compromising the robustness of the statistical parameter estimates. The transition models also supply contextual information.
Inventors
- 👤 William D. Goldenthal
- 👤 James R. Glass
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 18:01
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/02; G10L15/08; G10L15/14; G10L15/142; G10L15/148; G10L2015/025
Claims Analysis
Total Claims: 29
Claim 1
Independent Claim
189 words
In a digital processor, speech recognition apparatus for decoding an input speech signal to a corresponding speech unit, the apparatus comprising: a source providing an input speech signal formed of multiple observation frames; a plurality of unit templates, each unit template for representing acoustic attributes of a respective speech unit and each unit template generating a respective synthetic segment indicative of the respective speech unit; a plurality of error models associated with the unit templates, each unit template having an error model for explicitly measuring and quantitatively representing temporal and spatial correlations between the synthetic segments and a subject speech signal, the temporal and spatial correlations being between acoustic attributes in the observation frames of the subject speech signal; and processor means coupled to the unit templates and error models and coupled to the source to receive the input speech signal, the processor means comparing the synthetic segments to different plural observation frames of the input speech signal to define a set of error sequences and based on the error models, the processor means analyzing the error sequences and determining the corresponding speech unit of the input speech signal.
Claim 2
Dependent Claim
189 words
In a digital processor, speech recognition apparatus for decoding an input speech signal to a corresponding speech unit, the apparatus comprising: a source providing an input speech signal formed of multiple observation frames; a plurality of unit templates, each unit template for representing acoustic attributes of a respective speech unit and each unit template generating a respective synthetic segment indicative of the respective speech unit; a plurality of error models associated with the unit templates, each unit template having an error model for explicitly measuring and quantitatively representing temporal and spatial correlations between the synthetic segments and a subject speech signal, the temporal and spatial correlations being between acoustic attributes in the observation frames of the subject speech signal; and processor means coupled to the unit templates and error models and coupled to the source to receive the input speech signal, the processor means comparing the synthetic segments to different plural observation frames of the input speech signal to define a set of error sequences and based on the error models, the processor means analyzing the error sequences and determining the corresponding speech unit of the input speech signal.
Claim 3
Dependent Claim
19 words
Apparatus as claimed in claim 1 wherein the unit templates employ a generation function to generate the synthetic segments.
Claim 4
Dependent Claim
17 words
Apparatus as claimed in claim 2 wherein the generation function is used to form each unit template.
Claim 5
Dependent Claim
48 words
Apparatus as claimed in claim 1 wherein each error model is formed from a probability density function; and the processor means determines the corresponding speech unit of the input speech signal to be the respective speech unit of the unit template corresponding to the most likely error model.
Claim 6
Dependent Claim
46 words
Apparatus as claimed in claim 1 wherein each error model is formed from a distance metric; and the processor means determines the corresponding speech unit of the input speech signal to be the respective speech unit of the unit template corresponding to the best error model.
Claim 7
Dependent Claim
29 words
Apparatus as claimed in claim 1 wherein each error sequence is normalized to a single error feature vector of fixed dimension before the processor means generates the error models.
Claim 8
Dependent Claim
28 words
Apparatus as claimed in claim 1 wherein the plurality of unit templates includes transition unit templates for representing acoustic transition dynamics between speech units within a speech signal.
Claim 9
Dependent Claim
33 words
Apparatus as claimed in claim 7 wherein the transition unit templates provide an indication of one of location of a transition in the input speech signal and speech units involved in the transition.
Claim 10
Dependent Claim
23 words
Apparatus as claimed in claim 1 further comprising a multiplicity of merged templates formed by a combination of a plurality of unit templates.
Claim 11
Dependent Claim
25 words
Apparatus as claimed in claim 1 wherein certain ones of the unit templates are templates for representing context-dependent acoustic attributes of a respective speech unit.
Claim 12
Dependent Claim
25 words
Apparatus as claimed in claim 1 wherein the respective speech unit for each unit template is a phonetic unit or a string of phonetic units.
Claim 13
Dependent Claim
185 words
In a digital processor, a method for decoding an input speech signal to a corresponding speech unit comprising the steps of: providing an input speech signal formed of multiple observation frames; providing a plurality of unit templates in stored memory of the digital processor, each unit template for representing acoustic attributes of a respective speech unit and for generating a respective target speech unit; providing a plurality of error models associated with the unit templates in stored memory, each unit template having an error model for explicitly measuring and quantitatively representing temporal and spatial correlations between the synthetic segments and a subject speech signal, the temporal and spatial correlations being between acoustic attributes in the observation frames of the subject speech signal; receiving the input speech signal in working memory of the digital processor; comparing the target speech units with different plural observation frames of the input speech signal in working memory such that the comparison defines a set of error sequences in working memory; and using the error models, analyzing the error sequences and determining the corresponding speech unit of the input speech signal.
Claim 14
Dependent Claim
185 words
In a digital processor, a method for decoding an input speech signal to a corresponding speech unit comprising the steps of: providing an input speech signal formed of multiple observation frames; providing a plurality of unit templates in stored memory of the digital processor, each unit template for representing acoustic attributes of a respective speech unit and for generating a respective target speech unit; providing a plurality of error models associated with the unit templates in stored memory, each unit template having an error model for explicitly measuring and quantitatively representing temporal and spatial correlations between the synthetic segments and a subject speech signal, the temporal and spatial correlations being between acoustic attributes in the observation frames of the subject speech signal; receiving the input speech signal in working memory of the digital processor; comparing the target speech units with different plural observation frames of the input speech signal in working memory such that the comparison defines a set of error sequences in working memory; and using the error models, analyzing the error sequences and determining the corresponding speech unit of the input speech signal.
Claim 15
Dependent Claim
21 words
A method as claimed in claim 12 wherein the unit templates employ a generation function to generate the target speech units.
Claim 16
Dependent Claim
18 words
A method as claimed in claim 13 wherein the generation function is used to form each unit template.
Claim 17
Dependent Claim
68 words
A method as claimed in claim 12 wherein: the step of generating the error models includes forming each error model from a probability density function; and the step of determining the corresponding speech unit includes determining a most likely error model such that the respective speech unit of the unit template corresponding to the most likely error model is the corresponding speech unit of the input speech signal.
Claim 18
Dependent Claim
65 words
A method as claimed in claim 12 wherein: the step of generating the error models includes forming each error model from a distance metric; and the step of determining the corresponding speech unit includes determining a best error model, such that the respective speech unit of the unit template corresponding to the best error model is the corresponding speech unit of the input speech signal.
Claim 19
Dependent Claim
30 words
A method as claimed in claim 12 further comprising the step of normalizing each error sequence to a single error feature vector of fixed dimension before generating the error models.
Claim 20
Dependent Claim
18 words
A method as claimed in claim 17 wherein the step of normalizing includes averaging across each error sequence.
Claim 21
Dependent Claim
34 words
A method as claimed in claim 12 wherein the step of providing a plurality of unit templates includes providing transition unit templates for representing acoustic transition dynamics between speech units within a speech signal.
Claim 22
Dependent Claim
34 words
A method as claimed in claim 19 wherein the transition unit templates provide an indication of one of location of a transition in the input speech signal and speech units involved in the transition.
Claim 23
Dependent Claim
45 words
A method as claimed in claim 12 wherein the step of providing a plurality of unit templates includes combining a plurality of unit templates to form a multiplicity of merged templates that account for contextual effects on the respective speech units of the unit templates.
Claim 24
Dependent Claim
34 words
A method as claimed in claim 12 wherein the step of providing a plurality of unit templates includes providing a multiplicity of templates for representing context dependent acoustic attributes of a respective speech unit.
Claim 25
Dependent Claim
37 words
A method as claimed in claim 12 wherein the step of providing a plurality of unit templates includes providing phonetic unit templates for representing one of phonetic units of speech and strings of phonetic units of speech.
Claim 26
Dependent Claim
166 words
In a digital processor, speech recognition apparatus for decoding an input speech signal to a corresponding speech unit, the apparatus comprising: a source providing an input speech signal formed of multiple observation frames; a plurality of unit templates, each unit template for representing acoustic attributes of a respective speech unit and each unit template generating a respective synthetic segment indicative of the respective speech unit; a plurality of error models associated with the unit templates, each unit template having an error model; and processor means coupled to the unit templates and error models and coupled to the source to receive the input speech signal, the processor means comparing the synthetic segments to different plural observation frames of the input speech signal to define a set of error sequences, the processor means transforming each error sequence to a fixed dimension error feature vector independent of the number of observation frames, and based on the error models, the processor means computing a score for the error feature vector.
Claim 27
Dependent Claim
166 words
In a digital processor, speech recognition apparatus for decoding an input speech signal to a corresponding speech unit, the apparatus comprising: a source providing an input speech signal formed of multiple observation frames; a plurality of unit templates, each unit template for representing acoustic attributes of a respective speech unit and each unit template generating a respective synthetic segment indicative of the respective speech unit; a plurality of error models associated with the unit templates, each unit template having an error model; and processor means coupled to the unit templates and error models and coupled to the source to receive the input speech signal, the processor means comparing the synthetic segments to different plural observation frames of the input speech signal to define a set of error sequences, the processor means transforming each error sequence to a fixed dimension error feature vector independent of the number of observation frames, and based on the error models, the processor means computing a score for the error feature vector.
Claim 28
Dependent Claim
45 words
The apparatus of claim 24 wherein each error model explicitly measures and quantitatively represents temporal and spatial correlations between the synthetic segments and a subject speech signal, the temporal and spatial correlations being between acoustic attributes in the observation frames of the subject speech signal.
Claim 29
Dependent Claim
25 words
The apparatus of claim 25 wherein the temporal and spatial correlations are between different acoustic attributes in different observation frames of the subject speech signal.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-04-28 | 2000-10-28 | 2001-04-29 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-04-28 | 2004-10-28 | 2005-04-29 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-04-28 | 2008-10-28 | 2009-04-29 | $7700.00 | Window Closed / Lapsed |