US5946656A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Speech and speaker recognition using factor analysis to model covariance structure of mixture components
Assignee: Nuance Communications Inc
•
Filing: 1997-11-17
•
Granted: 1999-08-31
•
Expires: 2017-11-17
Abstract
Abstract Hidden Markov models (HMMs) rely on high-dimensional feature vectors to summarize the short-time properties of speech correlations between features that can arise when the speech signal is non-stationary or corrupted by noise. These correlations are modeled using factor analysis, a statistical method for dimensionality reduction. Factor analysis is used to model acoustic correlation in automatic speech recognition by introducing a small number of parameters to model the covariance structure of a speech signal. The parameters are estimated by an Expectation Maximization (EM) technique that can be embedded in the training procedures for the HMMs, and then further adjusted using Minimum Classification Error (MCE) training, which demonstrates better discrimination and produces more accurate recognition models.
Inventors
- 👤 Mazin G. Rahim
- 👤 Lawrence K. Saul
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-01 18:21
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/08; G10L15/14; G10L15/142; G10L15/144; G10L17/00; G10L17/16; G10L2015/085
Claims Analysis
Total Claims: 34
Claim 1
Independent Claim
82 words
A method for recognizing speech, comprising the steps of: deploying a speech recognizer and a memory coupled to the speech recognizer storing a set of HMMs, each HMM comprising one or more units, each unit represented with one or more states using one or more mixture components per state; storing each mixture component in said memory as a set of means, a set of variances and a matrix of factors having a number of factors; and recognizing speech using the speech recognizer.
Claim 2
Independent Claim
82 words
A method for recognizing speech, comprising the steps of: deploying a speech recognizer and a memory coupled to the speech recognizer storing a set of HMMs, each HMM comprising one or more units, each unit represented with one or more states using one or more mixture components per state; storing each mixture component in said memory as a set of means, a set of variances and a matrix of factors having a number of factors; and recognizing speech using the speech recognizer.
Claim 3
Dependent Claim
35 words
A method as defined in claim 1, wherein: the set of variances and the matrix of factors for each mixture component emulate a full covariance matrix that has been reduced in dimensionality by factor analysis.
Claim 4
Dependent Claim
26 words
A method as defined in claim 1, further comprising the step of: using factor analysis to make the set of variances and the matrix of factors.
Claim 5
Dependent Claim
28 words
A method as defined in claim 1, further comprising the step of: using the set of variances and the matrix of factors to emulate a full covariance matrix.
Claim 6
Dependent Claim
103 words
A speech recognition system, comprising: a feature extractor which produces a sequence of feature vectors representing speech; a speech recognizer coupled to the feature extractor, which receives the sequence of feature vectors and produces a transcription of the speech; a memory coupled to the speech recognizer which stores a set of HMMs, each HMM comprising one or more units, each unit represented with one or more states using one or more mixture components per state; and a set of variances and a matrix of factors stored in the memory for each mixture component, emulating a full covariance matrix corresponding to the mixture component.
Claim 7
Dependent Claim
103 words
A speech recognition system, comprising: a feature extractor which produces a sequence of feature vectors representing speech; a speech recognizer coupled to the feature extractor, which receives the sequence of feature vectors and produces a transcription of the speech; a memory coupled to the speech recognizer which stores a set of HMMs, each HMM comprising one or more units, each unit represented with one or more states using one or more mixture components per state; and a set of variances and a matrix of factors stored in the memory for each mixture component, emulating a full covariance matrix corresponding to the mixture component.
Claim 8
Dependent Claim
17 words
A system as defined in claim 5, wherein: each mixture component is a Gaussian probability density function.
Claim 9
Dependent Claim
29 words
A system as defined in claim 5, wherein: the full covariance matrix corresponding to each mixture component is stored in the memory in a condensed form using factor analysis.
Claim 10
Dependent Claim
21 words
A system as defined in claim 7, wherein: the condensed form includes the set of variances and the matrix of factors.
Claim 11
Independent Claim
79 words
A method of making an HMM stored in a memory for use in a speech recognition system, wherein the HMM comprising one or more units, each unit represented with one or more states using one or more mixture components per state, the method comprising the steps of: determining a set of parameters for each mixture component from training data; and storing the set of parameters for each mixture component in the memory in a condensed form using factor analysis.
Claim 12
Independent Claim
79 words
A method of making an HMM stored in a memory for use in a speech recognition system, wherein the HMM comprising one or more units, each unit represented with one or more states using one or more mixture components per state, the method comprising the steps of: determining a set of parameters for each mixture component from training data; and storing the set of parameters for each mixture component in the memory in a condensed form using factor analysis.
Claim 13
Dependent Claim
17 words
A method as defined in claim 9, wherein: each mixture component is a Gaussian probability density function.
Claim 14
Dependent Claim
34 words
A method as defined in claim 9, wherein: the condensed form comprises a set of variances and a matrix of factors which correspond to a full covariance matrix reduced in dimensionality by factor analysis.
Claim 15
Dependent Claim
31 words
A method as defined in claim 9, further comprising the step of: converting the set of parameters for each mixture component into a set of variances and a matrix of factors.
Claim 16
Dependent Claim
22 words
A method as defined in claim 9, further comprising the step of: adjusting one or more parameters based on additional training data.
Claim 17
Independent Claim
119 words
A method of making a set of HMMs stored in a memory for use in a speech recognition system, the set of HMMs comprising one or more units, each unit represented with one or more states using one or more mixture components per state, and each mixture component comprising a diagonal covariance matrix, the method comprising the steps of: determining parameters of the diagonal covariance matrix for each mixture component from training data; estimating a number of factors using factor analysis to form a matrix of factors for each mixture component which provides a covariance structure for each diagonal covariance matrix; and storing the diagonal covariance matrix and the matrix of factors for each mixture component in the memory.
Claim 18
Independent Claim
119 words
A method of making a set of HMMs stored in a memory for use in a speech recognition system, the set of HMMs comprising one or more units, each unit represented with one or more states using one or more mixture components per state, and each mixture component comprising a diagonal covariance matrix, the method comprising the steps of: determining parameters of the diagonal covariance matrix for each mixture component from training data; estimating a number of factors using factor analysis to form a matrix of factors for each mixture component which provides a covariance structure for each diagonal covariance matrix; and storing the diagonal covariance matrix and the matrix of factors for each mixture component in the memory.
Claim 19
Dependent Claim
20 words
A method as defined in claim 14, further comprising the step of: varying the number of mixture components per state.
Claim 20
Dependent Claim
26 words
A method as defined in claim 14, further comprising the step of: varying the number of factors forming the matrix of factors for each mixture component.
Claim 21
Dependent Claim
30 words
A method as defined in claim 14, further comprising the step of: adjusting the number of factors per mixture component based on the amount of training data for each state.
Claim 22
Dependent Claim
23 words
A method as defined in claim 14, further comprising the step of: training the set of HMMs using a maximum likelihood training process.
Claim 23
Dependent Claim
22 words
A method as defined in claim 14, further comprising the step of: training the set of HMMs using a discriminative training process.
Claim 24
Dependent Claim
17 words
A method as defined in claim 19, wherein: the discriminative training process includes minimum classification error training.
Claim 25
Dependent Claim
51 words
A speech recognizer, comprising: a set of recognition models, each recognition model having one or more states, each state represented by one or more mixture components, wherein each mixture component is stored in a memory as a set of variances and a matrix of factors to emulate a full covariance matrix.
Claim 26
Dependent Claim
51 words
A speech recognizer, comprising: a set of recognition models, each recognition model having one or more states, each state represented by one or more mixture components, wherein each mixture component is stored in a memory as a set of variances and a matrix of factors to emulate a full covariance matrix.
Claim 27
Dependent Claim
15 words
A speech recognizer as defined in claim 21, wherein: each recognition model is an HMM.
Claim 28
Dependent Claim
18 words
A speech recognizer as defined in claim 21, wherein: each mixture component is a Gaussian probability density function.
Claim 29
Dependent Claim
20 words
A speech recognizer as defined in claim 21, wherein: the recognition models are produced by a maximum likelihood training process.
Claim 30
Dependent Claim
19 words
A speech recognizer as defined in claim 21, wherein: the recognition models are produced by a discriminative training process.
Claim 31
Dependent Claim
18 words
A speech recognizer as defined in claim 25, wherein: the discriminative training process includes minimum classification error training.
Claim 32
Dependent Claim
22 words
A speech recognizer as defined in claim 21, wherein: each matrix of factors having a uniform number of factors per mixture component.
Claim 33
Independent Claim
87 words
A method for use in a speech recognition system, the speech recognition system comprising a speech recognizer and a memory coupled to the speech recognizer storing a set of HMMs, each HMM comprising one or more units, each unit represented with one or more states using one or more mixture components per state, the method comprising the step of: applying factor analysis at a level of the set of HMMs selected from the group consisting of the unit level, the state level or the mixture component level.
Claim 34
Independent Claim
87 words
A method for use in a speech recognition system, the speech recognition system comprising a speech recognizer and a memory coupled to the speech recognizer storing a set of HMMs, each HMM comprising one or more units, each unit represented with one or more states using one or more mixture components per state, the method comprising the step of: applying factor analysis at a level of the set of HMMs selected from the group consisting of the unit level, the state level or the mixture component level.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-08-30 | 2003-03-01 | 2003-08-31 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-08-30 | 2007-03-01 | 2007-08-31 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-08-30 | 2011-03-01 | 2011-08-31 | $7700.00 | Window Closed / Lapsed |