Patent US3150701A successfully refreshed from Google Patents.
Patent US6029124A successfully refreshed from Google Patents.
← Back to Patent Explorer
US6029124A Expired / Lapsed US ⏱️ 0.0 years remaining

Sequential, nonparametric speech recognition and speaker identification

Assignee: Nuance Communications Inc
•
Filing: 1998-03-31
•
Granted: 2000-02-22
•
Expires: 2018-03-31
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A speech sample is evaluated using a computer. Training data that include samples of speech are received and stored along with identification of speech elements to which portions of the training data are related. A speech sample is received and speech recognition is performed on the speech sample to produce recognition results. Finally, the recognition results are evaluated in view of the training data and the identification of the speech elements to which the portions of the training data are related. The technique may be used to perform tasks such as speech recognition, speaker identification, and language identification.

Inventors

  • 👤 Laurence S. Gillick
  • 👤 Andres Corrada-Emmanuel
  • 👤 Michael J. Newman
  • 👤 Barbara R. Peskin

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 14:52
CPC Classifications
G; G10; G10L; G10L17/00; G10L17/04; G10L15/00; G10L15/08; G10L17/06; G10L17/14

Claims Analysis

Total Claims: 29
Claim 1
Independent Claim 141 words
A method of evaluating a speech sample using a computer, the method comprising: receiving training data comprising samples of speech; storing the training data along with identification of speech elements to which portions of the training data are related; receiving a speech sample; performing speech recognition on the speech sample to produce recognition results; and evaluating the recognition results in view of the training data and the identification of the speech elements to which the portions of the training data are related, wherein: performing speech recognition on the speech sample comprises identifying portions of the speech sample to which different speech elements correspond; and evaluating the recognition results comprises comparing a portion of the speech sample identified as corresponding to a particular speech element to one or more portions of the training data identified as corresponding to the particular speech element.
Claim 2
Independent Claim 141 words
A method of evaluating a speech sample using a computer, the method comprising: receiving training data comprising samples of speech; storing the training data along with identification of speech elements to which portions of the training data are related; receiving a speech sample; performing speech recognition on the speech sample to produce recognition results; and evaluating the recognition results in view of the training data and the identification of the speech elements to which the portions of the training data are related, wherein: performing speech recognition on the speech sample comprises identifying portions of the speech sample to which different speech elements correspond; and evaluating the recognition results comprises comparing a portion of the speech sample identified as corresponding to a particular speech element to one or more portions of the training data identified as corresponding to the particular speech element.
Claim 3
Dependent Claim 26 words
The method of claim 1, further comprising analyzing the training data to designate different portions of the training data as being related to different speech elements.
Claim 4
Dependent Claim 62 words
The method of claim 2, wherein analyzing the training data comprises performing large vocabulary continuous speech recognition on the training data to produce training data recognition results and a training data time alignment, the training data recognition results including a sequence of speech elements and the training data time alignment identifying portions of the training data to which each speech element corresponds.
Claim 5
Dependent Claim 25 words
The method of claim 1, wherein comparing comprises directly comparing the portion of the speech sample to a particular speech sample from the training data.
Claim 6
Dependent Claim 58 words
The method of claim 1, wherein performing speech recognition on the speech sample to produce recognition results comprises producing speech sample recognition results and a speech sample time alignment, the speech sample recognition results including a sequence of speech elements and the speech sample time alignment identifying portions of the speech sample to which each speech element corresponds.
Claim 7
Dependent Claim 17 words
The method of claim 1, wherein evaluating the recognition results comprises evaluating accuracy of the recognition results.
Claim 8
Dependent Claim 41 words
The method of claim 6, wherein the recognition results comprise an ordered list of hypotheses about contents of the speech sample, and wherein evaluating the recognition results comprises reordering the list as a result of the evaluated accuracy of each hypothesis.
Claim 9
Dependent Claim 32 words
The method of claim 1, wherein the training data are associated with a known speaker and evaluating the recognition results comprises determining a likelihood that the known speaker produced the speech sample.
Claim 10
Dependent Claim 36 words
The method of claim 1, wherein the training data are associated with different known speakers and evaluating the recognition results comprises determining which of the known speakers is more likely to have produced the speech sample.
Claim 11
Dependent Claim 34 words
The method of claim 1, wherein the training data are associated with a known language and evaluating the recognition results comprises determining a likelihood that the speech sample was spoken in the known language.
Claim 12
Dependent Claim 59 words
The method of claim 1, wherein the recognition results identify speech elements to which different portions of the speech sample correspond and evaluating the recognition results comprises comparing a portion of the speech sample identified as corresponding to a particular speech element to one or more portions of the training data identified as corresponding to the particular speech element.
Claim 13
Dependent Claim 96 words
The method of claim 11, wherein evaluating the recognition results comprises: selecting a speech element from the recognition results; comparing a portion of the speech sample corresponding to the selected speech element to a portion of the training data identified as corresponding to the selected speech element; generating a speech element score as a result of the comparison; repeating the selecting, comparing and generating steps for each speech element in the recognition results; and producing an evaluation score for the recognition results based on the speech element scores for the speech elements in the recognition results.
Claim 14
Dependent Claim 55 words
The method of claim 12, wherein the compared portion of the speech sample and the compared portion of the training data are each represented by frames of data and wherein comparing the portions comprises aligning the frames of the portions using a dynamic programming technique that seeks to minimize an average distance between aligned frames.
Claim 15
Dependent Claim 21 words
The method of claim 13, wherein generating the speech element score comprises generating the score based on distances between aligned frames.
Claim 16
Dependent Claim 28 words
The method of claim 12, wherein producing the evaluation score for the recognition results comprises producing the evaluation score based on a subset of the speech element scores.
Claim 17
Dependent Claim 29 words
The method of claim 15, wherein producing the evaluation score for the recognition results comprises producing the evaluation score based on a best-scoring subset of the speech element scores.
Claim 18
Dependent Claim 11 words
The method of claim 12, further comprising normalizing the evaluation score.
Claim 19
Dependent Claim 87 words
The method of claim 17, wherein normalizing the evaluation score comprises: receiving cohort data, the cohort data comprising samples of speech for a cohort of speakers; storing the cohort data along with identification of speech elements to which portions of the cohort data are related; evaluating the recognition results in view of the cohort data and the identification of the speech elements to which the portions of the cohort data are related to produce a cohort score; and modifying the evaluation score based on the cohort score.
Claim 20
Dependent Claim 16 words
The method of claim 1, wherein performing speech recognition comprises performing large vocabulary continuous speech recognition.
Claim 21
Dependent Claim 26 words
The method of claim 1, wherein the training data comprises individual speech samples, each of which represents a single speech element uttered by a single speaker.
Claim 22
Dependent Claim 32 words
The method of claim 20, wherein evaluating recognition results comprises directly comparing the speech sample to individual speech samples from the training data corresponding to speech elements identified by the recognition results.
Claim 23
Dependent Claim 183 words
A computer program, residing on a computer readable medium, for a system comprising a processor and an input device, the computer program comprising instructions for evaluating a speech sample by causing the processor to perform the following operations: receive training data comprising samples of speech; store the training data along with identification of speech elements to which portions of the training data are related; receive a speech sample; perform speech recognition on the speech sample to produce recognition results; and evaluate the recognition results in view of the training data and the identification of the speech elements to which the portions of the training data are related, wherein: analyzing the training data comprises identifying portions of the training data to which different speech elements correspond; performing speech recognition on the speech sample comprises identifying portions of the speech sample to which different speech elements correspond; and evaluating the recognition results comprises comparing a portion of the speech sample identified as corresponding to a particular speech element to one or more portions of the training data identified as corresponding to the particular speech element.
Claim 24
Dependent Claim 183 words
A computer program, residing on a computer readable medium, for a system comprising a processor and an input device, the computer program comprising instructions for evaluating a speech sample by causing the processor to perform the following operations: receive training data comprising samples of speech; store the training data along with identification of speech elements to which portions of the training data are related; receive a speech sample; perform speech recognition on the speech sample to produce recognition results; and evaluate the recognition results in view of the training data and the identification of the speech elements to which the portions of the training data are related, wherein: analyzing the training data comprises identifying portions of the training data to which different speech elements correspond; performing speech recognition on the speech sample comprises identifying portions of the speech sample to which different speech elements correspond; and evaluating the recognition results comprises comparing a portion of the speech sample identified as corresponding to a particular speech element to one or more portions of the training data identified as corresponding to the particular speech element.
Claim 25
Dependent Claim 33 words
The computer program of claim 20, further comprising instructions for causing the processor to analyze the training data to designate different portions of the training data as being related to different speech elements.
Claim 26
Dependent Claim 33 words
The computer program of claim 22, wherein the training data are associated with a known speaker and evaluating the recognition results comprises determining a likelihood that the known speaker produced the speech sample.
Claim 27
Dependent Claim 37 words
The computer program of claim 22, wherein the training data are associated with different known speakers and evaluating the recognition results comprises determining which of the known speakers is more likely to have produced the speech sample.
Claim 28
Dependent Claim 35 words
The computer program of claim 22, wherein the training data are associated with a known language and evaluating the recognition results comprises determining a likelihood that the speech sample was spoken in the known language.
Claim 29
Dependent Claim 18 words
The computer program of claim 22, wherein evaluating the recognition results comprises evaluating accuracy of the recognition results.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2003-02-21 2003-08-23 2004-02-22 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2007-02-21 2007-08-23 2008-02-22 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2011-02-21 2011-08-23 2012-02-22 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag