US5787394A — State-dependent speaker clustering for speaker ad…

Claim 1

Independent Claim 171 words

A method for adapting the parameters of a speech recognition system during a training process, to better recognize speech of a particular test speaker comprising the steps of: calculating the acoustic characterization of a plurality of training speakers for all acoustic subspaces of an acoustic space, the acoustic characterizations being individually identifiable for each training speaker for each acoustic subspace; calculating the acoustic characterization of a test speaker from adaptation data provided by said test speaker for acoustic subspaces of the acoustic space; computing a match score between the test speaker's characterization for each acoustic subspace, and each training speaker's characterization for the same acoustic subspace; ranking each of the training speakers in the acoustic subspace based upon the score; and for each acoustic space, generating a re-estimated acoustic model for the particular acoustic subspace using individually identifiable data respectively derived from the one or more training speakers closest to the test speaker for that acoustic subspace, the re-estimated acoustic model for each acoustic subspace being used during a decoding process.

Claim 2

Independent Claim 171 words

A method for adapting the parameters of a speech recognition system during a training process, to better recognize speech of a particular test speaker comprising the steps of: calculating the acoustic characterization of a plurality of training speakers for all acoustic subspaces of an acoustic space, the acoustic characterizations being individually identifiable for each training speaker for each acoustic subspace; calculating the acoustic characterization of a test speaker from adaptation data provided by said test speaker for acoustic subspaces of the acoustic space; computing a match score between the test speaker's characterization for each acoustic subspace, and each training speaker's characterization for the same acoustic subspace; ranking each of the training speakers in the acoustic subspace based upon the score; and for each acoustic space, generating a re-estimated acoustic model for the particular acoustic subspace using individually identifiable data respectively derived from the one or more training speakers closest to the test speaker for that acoustic subspace, the re-estimated acoustic model for each acoustic subspace being used during a decoding process.

Claim 3

Dependent Claim 37 words

The method of claim 1, wherein the speakers are characterized by the duration of a phone class, and wherein the training speakers closest to the test speaker are determined to be those with the closest duration distribution.

Claim 4

Dependent Claim 55 words

The method of claim 1, wherein the step of generating an acoustic model comprises: generating a shortlist of training speakers who are deemed to be close to the test speaker in that acoustic subspace; and using the training data of the shortlisted speakers to construct a model for the test speaker in that acoustic subspace.

Claim 5

Dependent Claim 77 words

The method of claim 1, wherein the step of calculating the acoustic characterization of a plurality of training speakers comprises: generating a hierarchical tree representing the contextual characterization of each phone for each training speaker, the tree terminating in a plurality of leaves, each leaf representing a phone in a given context, the tree further including one or more nodes each representing similar ones of the leaves, or of similar ones of the leaves and other nodes.

Claim 6

Dependent Claim 15 words

The method of claim 4, wherein each leaf represents a region in the acoustic subspace.

Claim 7

Dependent Claim 62 words

The method of claim 5, wherein the step of calculating the acoustic characterization of the test speaker comprises: producing an alignment of the test speaker's data and tagging each feature vector with a leaf; and wherein when insufficient data exists for the construction of a model at a leaf, constructing a model at a node of the tree that includes that leaf.

Claim 8

Dependent Claim 32 words

The method of claim 6, wherein the step of computing a match comprises: measuring the distance, in acoustic space, between corresponding nodes of the test speaker's model and each training speaker's model.

Claim 9

Dependent Claim 53 words

The method of claim 7, wherein the step of measuring the distance comprises: determining the likelihood of the test speaker's data at a particular node of the test speaker's tree given the training speaker's model at the corresponding node, made up by using the training speaker data at all leaves comprising that node.

Claim 10

Dependent Claim 20 words

The method of claim 8, wherein the likelihood is computed using the training speaker's mixture of Gaussians for that node.

Claim 11

Dependent Claim 29 words

The method of claim 1, further comprising: computing a transformation to map the acoustic subspace of the selected training speaker closer to the corresponding subspace of the test speaker.

Claim 12

Dependent Claim 51 words

The method of claim 1, further comprising: computing a transformation to map the acoustic subspace of the selected training speaker closer to the corresponding subspace of the test speaker; and using the transformed training data of the shortlisted speakers to construct a model for the test speaker in that acoustic subspace.

Claim 13

Independent Claim 179 words

A system comprising: means for adapting the parameters of a speech recognition system during a training process to better recognize speech of a particular test speaker: means for calculating the acoustic characterization of a plurality of training speakers for all acoustic subspaces of an acoustic space, the acoustic characterizations being individually identifiable for each training speaker for each acoustic subspace; means for calculating the acoustic characterization of a test speaker from adaptation data provided by said test speaker for acoustic subspaces of the acoustic space; means for computing a match score between the test speaker's characterization for each acoustic subspace, and each training speaker's characterization for the same acoustic subspace; means for ranking each of the training speakers in the acoustic subspace based upon the score; and means for each acoustic space, for generating a re-estimated acoustic model for the particular acoustic subspace using individually identifiable data respectively derived from the one or more training speakers closest to the test speaker for that acoustic subspace, the re-estimated acoustic model for each acoustic subspace being used during a decoding process.

Claim 14

Independent Claim 179 words

A system comprising: means for adapting the parameters of a speech recognition system during a training process to better recognize speech of a particular test speaker: means for calculating the acoustic characterization of a plurality of training speakers for all acoustic subspaces of an acoustic space, the acoustic characterizations being individually identifiable for each training speaker for each acoustic subspace; means for calculating the acoustic characterization of a test speaker from adaptation data provided by said test speaker for acoustic subspaces of the acoustic space; means for computing a match score between the test speaker's characterization for each acoustic subspace, and each training speaker's characterization for the same acoustic subspace; means for ranking each of the training speakers in the acoustic subspace based upon the score; and means for each acoustic space, for generating a re-estimated acoustic model for the particular acoustic subspace using individually identifiable data respectively derived from the one or more training speakers closest to the test speaker for that acoustic subspace, the re-estimated acoustic model for each acoustic subspace being used during a decoding process.

Claim 15

Dependent Claim 38 words

The system of claim 12, further comprising: means for speaker characterization by the duration of a phone class, and wherein the training speakers closest to the test speaker are determined to be those with the closest duration distribution.

Claim 16

Dependent Claim 59 words

The system of claim 12, wherein the means for generating an acoustic model comprises: means for generating a shortlist of training speakers who are deemed to be close to the test speaker in that acoustic subspace; and means for using the training data of the shortlisted speakers to construct a model for the test speaker in that acoustic subspace.

Claim 17

Dependent Claim 79 words

The system of claim 12, wherein the means for calculating the acoustic characterization of a plurality of training speakers comprises: means for generating a hierarchical tree representing the contextual characterization of each phone for each training speaker, the tree terminating in a plurality of leaves, each leaf representing a phone in a given context, the tree further including one or more nodes each representing similar ones of the leaves, or of similar ones of the leaves and other nodes.

Claim 18

Dependent Claim 15 words

The system of claim 15, wherein each leaf represents a region in the acoustic subspace.

Claim 19

Dependent Claim 65 words

The system of claim 16, wherein the means for calculating the acoustic characterization of the test speaker comprises: means for producing an alignment of the test speaker's data and tagging each featured vector with a leaf; and where insufficient data exists for the construction of a model at a leaf, means for constructing a model at a node of the tree that includes the leaf.

Claim 20

Dependent Claim 34 words

The system of claim 17, wherein the means for computing a match comprises: means for measuring the distance, in acoustic space, between corresponding nodes of the test speaker's model and each training speaker's model.

Claim 21

Dependent Claim 55 words

The system of claim 18, wherein the means for measuring the distance comprises: means for determining the likelihood of the test speaker's data at a particular node of the test speaker's tree given the training speaker's model at the corresponding node, made up by using the training speaker data at all leaves comprising that node.

Claim 22

Dependent Claim 20 words

The system of claim 19, wherein the likelihood is computed using the training speaker's mixture of Gaussians for that node.

Claim 23

Dependent Claim 66 words

The system of claim 12, further comprising: means for computing a transformation that maps the training speaker data in the acoustic subspace to bring the training speaker data closer with respect to a calculated distance to the test speakers subspace, the transformation mapping reducing the calculated distance to achieve acoustic similarity between the transformed data of the training speaker and the data of the test speaker.

Claim 24

Dependent Claim 31 words

The system of claim 12, further comprising: means for computing a transformation to map the acoustic subspace of the selected training speaker closer to the corresponding subspace of the test speaker.

Claim 25

Dependent Claim 199 words

A training system, comprising: a training speaker feature vector and training script store for storing a script and a plurality of test speakers utterances of the training script; a viterbi alignment processor for aligning each of the plurality of training speakers' feature vectors with the training script; a training speaker data model for modeling each of the training speakers' feature vectors in acoustic space, given the alignment with the training script; a test speaker feature vector and test script store for storing feature vectors representing a test speaker's utterances of the test script; a test speaker viterbi alignment processor for aligning the test speaker's feature vectors with the test script; a training speaker select processor for selecting for each of a plurality of acoustic subspaces in the acoustic space, one or more individually identifiable training speakers whose feature vectors most closely match the test speaker's feature vectors in that acoustic subspace; a training data transformer for mapping the selected training speaker's feature vectors to the test speakers' feature vectors; a Gaussian parameter re-estimation processor for estimating the first and second moment and posterior probability of the mapped feature vectors; and a decoder for decoding the estimated moments and probability.

Claim 26

Dependent Claim 199 words

A training system, comprising: a training speaker feature vector and training script store for storing a script and a plurality of test speakers utterances of the training script; a viterbi alignment processor for aligning each of the plurality of training speakers' feature vectors with the training script; a training speaker data model for modeling each of the training speakers' feature vectors in acoustic space, given the alignment with the training script; a test speaker feature vector and test script store for storing feature vectors representing a test speaker's utterances of the test script; a test speaker viterbi alignment processor for aligning the test speaker's feature vectors with the test script; a training speaker select processor for selecting for each of a plurality of acoustic subspaces in the acoustic space, one or more individually identifiable training speakers whose feature vectors most closely match the test speaker's feature vectors in that acoustic subspace; a training data transformer for mapping the selected training speaker's feature vectors to the test speakers' feature vectors; a Gaussian parameter re-estimation processor for estimating the first and second moment and posterior probability of the mapped feature vectors; and a decoder for decoding the estimated moments and probability.

Annuity Stage	Window Opens	Payment Deadline	Surcharge Period Until	Estimated Fee	Status
3.5 Years (Year 4)	2001-07-27	2002-01-26	2002-07-28	$2000.00	Window Closed / Lapsed
7.5 Years (Year 8)	2005-07-27	2006-01-26	2006-07-28	$3760.00	Window Closed / Lapsed
11.5 Years (Year 12)	2009-07-27	2010-01-26	2010-07-28	$7700.00	Window Closed / Lapsed

State-dependent speaker clustering for speaker adaptation

Abstract

Inventors

Bibliographic Details

Claims Analysis

References Cited (Backward Citations)

USPTO Annuity & Maintenance Windows

Assigned Categories & Tags

Assign Category Tag