← Back to Patent Explorer
US5027408A Expired / Lapsed US ⏱️ 0.0 years remaining

Speech-recognition circuitry employing phoneme estimation

Assignee: Eliza Corp
•
Filing: 1987-04-09
•
Granted: 1991-06-25
•
Expires: 2007-04-09
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A phoneme estimator (12) in a speech-recognition system (10) includes trigger circuitry (18, 22) for identifying the segments of speech that should be analyzed for phoneme content. Speech-element processors (24, 26, and 28) calculate the likelihoods that currently received speech contains individual phonemes, but they operate only when the trigger circuitry identifies such segments. The computation-intensive processing for determining phoneme likelihoods is thus performed on only a small subset of the received speech segments. The accuracy of the speech-element processors (24, 26, and 28) is enhanced because these processors operate by recognition of patterns not only in elements of the data-reduced representations of the received speech but also in higher-ordered products of those elements; that is, these circuits employ non-linear modeling for phoneme identification.

Inventors

  • 👤 John P. Kroeker
  • 👤 Robert L. Powers

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-30 14:15
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/08; G10L15/10; G10L15/02; G10L2015/025

Claims Analysis

Total Claims: 34
Claim 1
Independent Claim 165 words
For determining a modeling matrix to be used in identifying a predetermined speech event, the speech event being a speech element or a class of speech elements in received speech, a method comprising the steps of: A. dividing speech in a development base of recorded speech into speech segments and labeling the speech segments in accordance with whether the speech event occurred in the speech segment, thereby associating original labels with speech segments; B. computing a preliminary modeling matrix by correlating the speech segments with the original labels associated therewith; C. employing the preliminary matrix to associate predicted labels with the speech signal; D. adjusting the association of at least some of the original labels from the speech elements to which they were previously associated to nearby speech elements so that the original labels whose associations have been adjusted coincide with predicted labels; and E. computing a new modeling matrix by correlating the speech segments with the labels with which they are associated after adjustment.
Claim 2
Dependent Claim 165 words
For determining a modeling matrix to be used in identifying a predetermined speech event, the speech event being a speech element or a class of speech elements in received speech, a method comprising the steps of: A. dividing speech in a development base of recorded speech into speech segments and labeling the speech segments in accordance with whether the speech event occurred in the speech segment, thereby associating original labels with speech segments; B. computing a preliminary modeling matrix by correlating the speech segments with the original labels associated therewith; C. employing the preliminary matrix to associate predicted labels with the speech signal; D. adjusting the association of at least some of the original labels from the speech elements to which they were previously associated to nearby speech elements so that the original labels whose associations have been adjusted coincide with predicted labels; and E. computing a new modeling matrix by correlating the speech segments with the labels with which they are associated after adjustment.
Claim 3
Independent Claim 171 words
A method of processing speech comprising the steps of: A. receiving a speech signal; B. converting the speech signal to a sequence of digital quantities; C. subjecting the digital quantities to a sequence of digital processing steps including a sequence of vector-processing steps whose outputs are multi-element vectors and whose inputs include vector outputs of previous processing steps, the sequence of vector-processing steps including a first nonlinear step, which comprises computing nonlinear combinations of different ones of its input elements to produce a first-nonlinear-step output vector that includes a separate first-nonlinear-step element representing the result of each such computed combination, and a second nonlinear step, which comprises computing nonlinear combinations of different elements of the first-nonlinear-step output vector to produce a second-nonlinear-step output vector that includes a separate second-nonlinear-step element representing the result of each such computed combination; and D. modeling the vector output of the sequence of vector-processing steps to generate speech-element-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective speech elements.
Claim 4
Independent Claim 171 words
A method of processing speech comprising the steps of: A. receiving a speech signal; B. converting the speech signal to a sequence of digital quantities; C. subjecting the digital quantities to a sequence of digital processing steps including a sequence of vector-processing steps whose outputs are multi-element vectors and whose inputs include vector outputs of previous processing steps, the sequence of vector-processing steps including a first nonlinear step, which comprises computing nonlinear combinations of different ones of its input elements to produce a first-nonlinear-step output vector that includes a separate first-nonlinear-step element representing the result of each such computed combination, and a second nonlinear step, which comprises computing nonlinear combinations of different elements of the first-nonlinear-step output vector to produce a second-nonlinear-step output vector that includes a separate second-nonlinear-step element representing the result of each such computed combination; and D. modeling the vector output of the sequence of vector-processing steps to generate speech-element-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective speech elements.
Claim 5
Dependent Claim 35 words
A method as defined in claim 2 wherein the modeling step comprises generating as the speech-element-estimate signals phoneme-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective phonemes.
Claim 6
Dependent Claim 29 words
A method as defined in claim 2 wherein the vector output of the sequence of vector-processing steps that is modeled in the modeling step includes the second-nonlinear-step output vector.
Claim 7
Dependent Claim 35 words
A method as defined in claim 4 wherein the modeling step comprises generating as the speech-element-estimate signals phoneme-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective phonemes.
Claim 8
Dependent Claim 104 words
A method as defined in claim 2 wherein the input of at least one of the nonlinear steps includes a plurality of time-interval vectors, each element of one of the time-interval vectors representing a speech time interval the same as that represented by the other elements of the same time-interval vector but different form the speech time interval represented by the elements of a different one of the time-interval vectors, at least one nonlinear step comprising computing nonlinear combinations of elements of different ones of the time-interval vectors to include in its output a separate element representing the result of each such computed combination.
Claim 9
Dependent Claim 35 words
A method as defined in claim 6 wherein the modeling step comprises generating as the speech-element-estimate signals phoneme-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective phonemes.
Claim 10
Dependent Claim 29 words
A method as defined in claim 6 wherein the vector output of the sequence of vector-processing steps that is modeled in the modeling step includes the second-nonlinear-step output vector.
Claim 11
Dependent Claim 35 words
A method as defined in claim 8 wherein the modeling step comprises generating as the speech-element-estimate signals phoneme-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective phonemes.
Claim 12
Dependent Claim 58 words
A method as defined in claim 6 wherein the second nonlinear step comprises computing the nonlinear combinations of different elements of the first-nonlinear-step output vector by: A. computing linear combinations of the first-nonlinear-step elements; and B. computing nonlinear combinations of different ones of the linear combinations, thereby computing nonlinear combinations of different elements of the first-nonlinear-step output vector.
Claim 13
Dependent Claim 118 words
A method as defined in claim 10 wherein: A. the step of computing linear combinations of the first-nonlinear-step elements comprises computing highest-variance components as the linear combinations, the highest-variance components being the components of the first-nonlinear-step input vector in the directions of the eigenvectors of the first-nonlinear-step input vector's covariance matrix that are associated with the greatest eigenvalues; and B. the step of computing nonlinear combinations of different ones of the linear combinations comprises computing nonlinear combinations of the highest-variance components but omitting computation of the nonlinear combinations of at least some of the components of the first-nonlinear-step input vector in the direction of the eigenvectors of the first-nonlinear-step input vector that are associated with the lowest eigenvalues.
Claim 14
Independent Claim 192 words
A method of processing speech comprising the steps of: A. receiving a speech signal; B. converting the speech signal to a sequence of digital quantities; C. subjecting the digital quantities to a sequence of processing steps including a sequence of vector-processing steps whose outputs are multi-element vectors and whose inputs include vector outputs of previous processing steps, the sequence of vector-processing steps including a nonlinear step whose input includes a plurality of time-interval vectors, each element of a time-interval vector representing a speech time interval the same as that represented by the other elements of the same time-interval vector but different from the speech time interval represented by the elements of a different one of the time-interval vectors, the nonlinear step comprising computing combinations of higher than second order of elements of different ones of time-interval vectors and generating as its output a nonlinear-step output vector that includes a separate element representing the result of each such computed combination; and D. modeling the vector output of the sequence of vector-processing steps to generate speech-element-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective speech elements.
Claim 15
Independent Claim 192 words
A method of processing speech comprising the steps of: A. receiving a speech signal; B. converting the speech signal to a sequence of digital quantities; C. subjecting the digital quantities to a sequence of processing steps including a sequence of vector-processing steps whose outputs are multi-element vectors and whose inputs include vector outputs of previous processing steps, the sequence of vector-processing steps including a nonlinear step whose input includes a plurality of time-interval vectors, each element of a time-interval vector representing a speech time interval the same as that represented by the other elements of the same time-interval vector but different from the speech time interval represented by the elements of a different one of the time-interval vectors, the nonlinear step comprising computing combinations of higher than second order of elements of different ones of time-interval vectors and generating as its output a nonlinear-step output vector that includes a separate element representing the result of each such computed combination; and D. modeling the vector output of the sequence of vector-processing steps to generate speech-element-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective speech elements.
Claim 16
Dependent Claim 35 words
A method as defined in claim 12 wherein the modeling step comprises generating as the speech-element-estimate signals phoneme-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective phonemes.
Claim 17
Dependent Claim 29 words
A method as defined in claim 12 wherein the vector output of the sequence of vector-processing steps that is modeled in the modeling step includes the nonlinear-step output vector.
Claim 18
Dependent Claim 35 words
A method as defined in claim 14 wherein the modeling step comprises generating as the speech-element-estimate signals phoneme-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective phonemes.
Claim 19
Dependent Claim 175 words
A speech processor adapted for reception of a speech signal and comprising: A. means for converting the speech signal to a sequence of digital quantities; B. means for subjecting the digital quantities to a sequence of digital processing steps including a sequence of vector-processing steps whose outputs are multi-element vectors and whose inputs include vector outputs of previous processing steps, the sequence of vector-processing steps including a first nonlinear step, which comprises computing nonlinear combinations of different ones of its input elements to produce a first-nonlinear-step output vector that includes a separate first-nonlinear-step element representing the result of each such computed combination, and a second nonlinear step, which comprises computing nonlinear combinations of different elements of the first-nonlinear-step output vector to produce a second-nonlinear-step output vector that includes a separate second-nonlinear-step element representing the result of each such computed combination; and C. means for modeling the vector output of the sequence of vector-processing steps to generate speech-element-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective speech elements.
Claim 20
Dependent Claim 175 words
A speech processor adapted for reception of a speech signal and comprising: A. means for converting the speech signal to a sequence of digital quantities; B. means for subjecting the digital quantities to a sequence of digital processing steps including a sequence of vector-processing steps whose outputs are multi-element vectors and whose inputs include vector outputs of previous processing steps, the sequence of vector-processing steps including a first nonlinear step, which comprises computing nonlinear combinations of different ones of its input elements to produce a first-nonlinear-step output vector that includes a separate first-nonlinear-step element representing the result of each such computed combination, and a second nonlinear step, which comprises computing nonlinear combinations of different elements of the first-nonlinear-step output vector to produce a second-nonlinear-step output vector that includes a separate second-nonlinear-step element representing the result of each such computed combination; and C. means for modeling the vector output of the sequence of vector-processing steps to generate speech-element-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective speech elements.
Claim 21
Dependent Claim 38 words
A speech processor as defined in claim 16 wherein the modeling means comprises means for generating as the speech-element-estimate signals phoneme-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective phonemes.
Claim 22
Dependent Claim 30 words
A speech processor as defined in claim 16 wherein the vector output of the sequence of vector-processing steps that is modeled in the modeling means includes the second-nonlinear-step output vector.
Claim 23
Dependent Claim 38 words
A speech processor as defined in claim 18 wherein the modeling means comprises means for generating as the speech-element-estimate signals phoneme-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective phonemes.
Claim 24
Dependent Claim 105 words
A speech processor as defined in claim 16 wherein the input of at least one of the nonlinear steps includes a plurality of time-interval vectors, each element of one of the time-interval vectors representing a speech time interval the same as that represented by the other elements of the same time-interval vector but different from the speech time interval represented by the elements of a different one of the time-interval vectors, at least one nonlinear step comprising computing nonlinear combinations of elements of different ones of the time-interval vectors to include in its output a separate element representing the result of each such computed combination.
Claim 25
Dependent Claim 38 words
A speech processor as defined in claim 20 wherein the modeling means comprises means for generating as the speech-element-estimate signals phoneme-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective phonemes.
Claim 26
Dependent Claim 30 words
A speech processor as defined in claim 20 wherein the vector output of the sequence of vector-processing steps that is modeled in the modeling means includes the second-nonlinear-step output vector.
Claim 27
Dependent Claim 38 words
A speech processor as defined in claim 26 wherein the modeling means comprises means for generating as the speech-element-estimate signals phoneme-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective phonemes.
Claim 28
Dependent Claim 59 words
A speech processor as defined in claim 16 wherein the second nonlinear step comprises computing the nonlinear combinations of different elements of the first-nonlinear-step output vector by: A. computing linear combinations of the first-nonlinear-step elements; and B. computing nonlinear combinations of different ones of the linear combinations, thereby computing nonlinear combinations of different elements of the first-nonlinear-step output vector.
Claim 29
Dependent Claim 119 words
A speech processor as defined in claim 24 wherein: A. the step of computing linear combinations of the first-nonlinear-step elements comprises computing highest-variance components as the linear combinations, the highest-variance components being the components of the first-nonlinear-step input vector in the directions of the eigenvectors of the first-nonlinear-step input vector's covariance matrix that are associated with the greatest eigenvalues; and B. the step of computing nonlinear combinations of different ones of the linear combinations comprises computing nonlinear combinations of the highest-variance components but omitting computation of the nonlinear combinations of at least some of the components of the first-nonlinear-step input vector in the directions of the eigenvectors of the first-nonlinear-step input vector that are associated with the lowest eigenvalues.
Claim 30
Dependent Claim 194 words
A speech processor adapted for reception of speech and comprising: A. means for converting the speech signal to a sequence of digital quantities; means for subjecting the digital quantities to a sequence of processing steps including a sequence of vector-processing steps whose outputs are multi-element vectors and whose inputs include vector outputs of previous processing steps, the sequence of vector-processing steps including a nonlinear step whose input includes a plurality of time-interval vectors, each element of a time-interval vector representing a speech time interval the same as that represented by the other elements of the same time-interval vector but different from the speech time interval represented by the elements of a different one of the time-interval vectors, the nonlinear step comprising computing combinations of higher than second order of elements of different ones of the time-interval vectors and generating as its output a nonlinear-step output vector that includes a separate element representing the result of each such computed combination; and C. means for modeling the vector output of the sequence of vector-processing steps to generate speech-element-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective speech elements.
Claim 31
Dependent Claim 194 words
A speech processor adapted for reception of speech and comprising: A. means for converting the speech signal to a sequence of digital quantities; means for subjecting the digital quantities to a sequence of processing steps including a sequence of vector-processing steps whose outputs are multi-element vectors and whose inputs include vector outputs of previous processing steps, the sequence of vector-processing steps including a nonlinear step whose input includes a plurality of time-interval vectors, each element of a time-interval vector representing a speech time interval the same as that represented by the other elements of the same time-interval vector but different from the speech time interval represented by the elements of a different one of the time-interval vectors, the nonlinear step comprising computing combinations of higher than second order of elements of different ones of the time-interval vectors and generating as its output a nonlinear-step output vector that includes a separate element representing the result of each such computed combination; and C. means for modeling the vector output of the sequence of vector-processing steps to generate speech-element-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective speech elements.
Claim 32
Dependent Claim 38 words
A speech processor as defined in claim 26 wherein the modeling means comprises means for generating as the speech-element-estimate signals phoneme-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective phonemes.
Claim 33
Dependent Claim 30 words
A speech processor as defined in claim 26 wherein the vector output of the sequence of vector-processing steps that is modeled in the modeling means includes the nonlinear-step output vector.
Claim 34
Dependent Claim 38 words
A speech processor as defined in claim 28 wherein the modeling means comprises means for generating as the speech-element-estimate signals phoneme-estimate signals that represent respective figures of merit related to the likelihoods that the speech contains respective phonemes.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1994-06-24 1994-12-24 1995-06-25 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 1998-06-24 1998-12-24 1999-06-25 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2002-06-24 2002-12-24 2003-06-25 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag