← Back to Patent Explorer
US5832430A Expired / Lapsed US ⏱️ 0.0 years remaining

Devices and methods for speech recognition of vocabulary words with simultaneous detection and verification

Assignee: Nokia of America Corp
•
Filing: 1995-12-08
•
Granted: 1998-11-03
•
Expires: 2015-12-08
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Devices and methods for speech recognition enable simultaneous word hypothesis detection and verification in a one-pass procedure that provides for different segmentations of the speech input. A confidence measure of a target hypothesis for a known word is determined according to a recursion formula that operates on parameters of a target models and alternate models of known words, a language model and a lexicon, and feature vectors of the speech input in a likelihood ratio decoder. The confidence measure is processed to determine an accept/reject signal for the target hypothesis that is output with a target hypothesis signal. The recursion formula is based on hidden Markov models with a single optimum state sequence and may take the form of a modified Viterbi algorithm.

Inventors

  • 👤 Eduardo Lleida
  • 👤 Richard Cameron Rose

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-04 10:21
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/08; G10L15/14; G10L15/142; G10L15/06; G10L15/065; G10L15/07

Claims Analysis

Total Claims: 26
Claim 1
Independent Claim 135 words
A method for determining a confidence measure of the presence of a known word in an utterance, comprising the steps of: inputting a signal including signal components representing the utterance into a likelihood ratio decoder; inputting target model signals representing a target model and alternate model signals representing an alternate model into the likelihood ratio decoder; inputting language model signals representing a language model and lexicon signals representing a lexicon into the likelihood ratio decoder; processing the signal including signal components, the target model signals, the alternate model signals, the language model signals, and the lexicon signals in one pass in the likelihood ratio decoder by applying a recursion formula in iterative steps to determine a confidence measure signal that represents a confidence measure of the identification of a particular known word in the utterance.
Claim 2
Independent Claim 135 words
A method for determining a confidence measure of the presence of a known word in an utterance, comprising the steps of: inputting a signal including signal components representing the utterance into a likelihood ratio decoder; inputting target model signals representing a target model and alternate model signals representing an alternate model into the likelihood ratio decoder; inputting language model signals representing a language model and lexicon signals representing a lexicon into the likelihood ratio decoder; processing the signal including signal components, the target model signals, the alternate model signals, the language model signals, and the lexicon signals in one pass in the likelihood ratio decoder by applying a recursion formula in iterative steps to determine a confidence measure signal that represents a confidence measure of the identification of a particular known word in the utterance.
Claim 3
Dependent Claim 24 words
The method of claim 1, wherein said processing step includes obtaining a maximum of a recursively iterated quantity at each of said iterative steps.
Claim 4
Dependent Claim 71 words
The method of claim 1, further comprising the steps of: inputting the confidence measure signal to a decision rule device; comparing the confidence measure signal to the decision threshold signal in the decision rule device; and outputting a signal representative of the presence or absence of the known word in the utterance based on the comparison of the confidence measure signal and the decision threshold signal from the decision rule device.
Claim 5
Dependent Claim 34 words
The method of claim 3, further comprising the step of outputting a signal representative of a target model hypothesis associated with a known word and the confidence measure signal from said likelihood ratio decoder.
Claim 6
Dependent Claim 192 words
The method claim 1, wherein said step of inputting target model signals and alternate model signals includes inputting signals representing hidden Markov models (HMMs) having a number of states N c and N a respectively, wherein said step of inputting a signal including signal components includes inputting signal components that are representative of feature vectors Y={y 1 , y 2 , . . . y T } corresponding to times 1, 2, . . . ,T respectively, and wherein said step of inputting target model signals and alternate model signals includes inputting signals representing the following parameters related to said HMMs, π.sub.n.sup.c, a.sub.in.sup.c,π.sub.m.sup.a, and a.sub.jm.sup.a for 1≦n≦N.sub.c, 1≦M<N.sub.a, 1≦i≦N.sub.c, 1≦j≦N.sub.a, and t=1,2, . . . ,T, where π n c =the initial state probability of the state n for the model λ c , a in c =the transition probability from the state i to the state n for the model λ c , π m a =the initial state probability of the state m for the model λ a , and a jm a =the transition probability from the state j to the state m for the model λ a .
Claim 7
Independent Claim 390 words
A method for determining a confidence measure of the presence of a known word in an utterance, comprising the steps of: inputting a signal including signal components representing the utterance and signal components that are representative of feature vectors Y={y 1 , y 2 , . . . y T } corresponding to times 1, 2, . . . ,T respectively into a likelihood ratio decoder; inputting target model signals representing a target model including signals representing hidden Markov models (HMMs) having a number of states N c and alternate model signals representing an alternate model into the likelihood ratio decoder, said step of inputting target model signals and alternate model signals including inputting signals representing the following parameters related to said HMMs, π.sub.n.sup.C, a.sub.in.sup.c, π.sub.m.sup.a, and a.sub.jm.sup.a for 1≦n≦N.sub.c, 1≦M<N.sub.a, 1≦i≦N.sub.c, 1≦j≦N.sub.a, and t=1,2, . . . ,T, where π n c =the initial state probability of the state n for the model λ c , a in c =the transition probability from the state i to the state n for the model λ c , π m a =the initial state probability of the state m for the model λ a , and a jm a =the transition probability from the state j to the state m for the model λ a ; inputting language model signals representing a language model including signals representing hidden Markov models (HMMs) having a number of states N a and lexicon signals representing a lexicon into the likelihood ratio decoder; processing the signal including signal components, the target model signals, the alternate model signals, the language model signals, and the lexicon signals in the likelihood ratio decoder by applying a recursion formula in iterative steps to determine a confidence measure signal that represents a confidence measure of the identification of a particular known word in the utterance, said processing step including the steps of: determining in the likelihood ratio decoder signals representing the following parameters, b n c (y→ t )=the observation density for the feature vector y t for the state n and the model λ c , b j a (y→ t )=the observation density for the feature vector y t for the state j and the model λ a , and determining the confidence measure signal based on δ t (n,m) determined according to the following recursion formula: ##EQU15##
Claim 8
Independent Claim 390 words
A method for determining a confidence measure of the presence of a known word in an utterance, comprising the steps of: inputting a signal including signal components representing the utterance and signal components that are representative of feature vectors Y={y 1 , y 2 , . . . y T } corresponding to times 1, 2, . . . ,T respectively into a likelihood ratio decoder; inputting target model signals representing a target model including signals representing hidden Markov models (HMMs) having a number of states N c and alternate model signals representing an alternate model into the likelihood ratio decoder, said step of inputting target model signals and alternate model signals including inputting signals representing the following parameters related to said HMMs, π.sub.n.sup.C, a.sub.in.sup.c, π.sub.m.sup.a, and a.sub.jm.sup.a for 1≦n≦N.sub.c, 1≦M<N.sub.a, 1≦i≦N.sub.c, 1≦j≦N.sub.a, and t=1,2, . . . ,T, where π n c =the initial state probability of the state n for the model λ c , a in c =the transition probability from the state i to the state n for the model λ c , π m a =the initial state probability of the state m for the model λ a , and a jm a =the transition probability from the state j to the state m for the model λ a ; inputting language model signals representing a language model including signals representing hidden Markov models (HMMs) having a number of states N a and lexicon signals representing a lexicon into the likelihood ratio decoder; processing the signal including signal components, the target model signals, the alternate model signals, the language model signals, and the lexicon signals in the likelihood ratio decoder by applying a recursion formula in iterative steps to determine a confidence measure signal that represents a confidence measure of the identification of a particular known word in the utterance, said processing step including the steps of: determining in the likelihood ratio decoder signals representing the following parameters, b n c (y→ t )=the observation density for the feature vector y t for the state n and the model λ c , b j a (y→ t )=the observation density for the feature vector y t for the state j and the model λ a , and determining the confidence measure signal based on δ t (n,m) determined according to the following recursion formula: ##EQU15##
Claim 9
Dependent Claim 176 words
The method of claim 1, wherein said target model and said alternate model are hidden Markov models (HMMs), each having a number of states N, wherein said step of inputting a signal including signal components includes inputting signal components that are representative of feature vector Y={y 1 , y 2 , . . . y T } corresponding to times 1,2, . . . ,T respectively, and wherein said step of inputting target model signals and alternate model signals includes inputting signals representing the following parameters related to said HMMs, π.sub.i.sup.c,a.sub.ij.sup.c,π.sub.i.sup.a, and a.sub.ij.sup.a for 1≦i≦N and t=1,2, . . . ,T, where π j c =the initial state probability of the state j for the model λ c , a ij c =the transition probability from the state i to the state j for the model λ c , π j a =the initial state probability of the state j for the model λ a , a ij a =the transition probability from the state i to the state j for the model λ a .
Claim 10
Independent Claim 364 words
A method for determining a confidence measure of the presence of a known word in an utterance, comprising the steps of: inputting a signal including signal components representing the utterance into a likelihood ratio decoder, including signal components that are representative of feature vector Y={y 1 , y 2 , . . . y T } corresponding to times 1,2, . . . ,T respectively; inputting target model signals representing a target model and alternate model signals representing an alternate model into the likelihood ratio decoder, said target model and said alternate model being hidden Markov models (HMMs), each having a number of states N, said inputting including inputting signals representing the following parameters related to said HMMs, π.sub.i.sup.C,a.sub.ij.sup.c,π.sub.i.sup.a, and a.sub.ij.sup.a for 1≦i≦N and t=1,2, . . . ,T, where π j c =the initial state probability of the state j for the model λ c , a ij c =the transition probability from the state i to the state j for the model λ c , π j a =the initial state probability of the state j for the model λ a ; a ij a =the transition probability from the state i to the state j for the model λ a ; inputting language model signals representing a language model and lexicon signals representing a lexicon into the likelihood ratio decoder; processing the signal including signal components, the target model signals, the alternate model signals, the language model signals, and the lexicon signals in the likelihood ratio decoder by applying a recursion formula in iterative steps to determine a confidence measure signal that represents a confidence measure of the identification of a particular known word in the utterance, said processing step including the steps of: determining in the likelihood ratio decoder signal representing the following parameters, b i c (y→ t )=observation density for the feature vector y t for the state i and the model λ a , b j a (y→ t )=the observation density for the feature vector y t for the state j and the model λ a , and determining the confidence measure signal based on δ t (n,m) determined according to the following recursion formula: ##EQU16##
Claim 11
Independent Claim 364 words
A method for determining a confidence measure of the presence of a known word in an utterance, comprising the steps of: inputting a signal including signal components representing the utterance into a likelihood ratio decoder, including signal components that are representative of feature vector Y={y 1 , y 2 , . . . y T } corresponding to times 1,2, . . . ,T respectively; inputting target model signals representing a target model and alternate model signals representing an alternate model into the likelihood ratio decoder, said target model and said alternate model being hidden Markov models (HMMs), each having a number of states N, said inputting including inputting signals representing the following parameters related to said HMMs, π.sub.i.sup.C,a.sub.ij.sup.c,π.sub.i.sup.a, and a.sub.ij.sup.a for 1≦i≦N and t=1,2, . . . ,T, where π j c =the initial state probability of the state j for the model λ c , a ij c =the transition probability from the state i to the state j for the model λ c , π j a =the initial state probability of the state j for the model λ a ; a ij a =the transition probability from the state i to the state j for the model λ a ; inputting language model signals representing a language model and lexicon signals representing a lexicon into the likelihood ratio decoder; processing the signal including signal components, the target model signals, the alternate model signals, the language model signals, and the lexicon signals in the likelihood ratio decoder by applying a recursion formula in iterative steps to determine a confidence measure signal that represents a confidence measure of the identification of a particular known word in the utterance, said processing step including the steps of: determining in the likelihood ratio decoder signal representing the following parameters, b i c (y→ t )=observation density for the feature vector y t for the state i and the model λ a , b j a (y→ t )=the observation density for the feature vector y t for the state j and the model λ a , and determining the confidence measure signal based on δ t (n,m) determined according to the following recursion formula: ##EQU16##
Claim 12
Dependent Claim 121 words
A speech recognizer for determining a confidence measure of the presence of a known word in an utterance, comprising: means for determining a signal including signal components representing the utterance; means for determining target model signals representing a target model and alternate model signals representing an alternate model; means for determining language model signals representing a language model and lexicon signals representing a lexicon; means for processing the signal including signal components, the target model signals, the alternate model signals, the language model signals, and the lexicon signals in one pass by applying a recursion formula in iterative steps to determine a confidence measure signal that represents a confidence measure of the identification of a particular known word in the utterance.
Claim 13
Dependent Claim 121 words
A speech recognizer for determining a confidence measure of the presence of a known word in an utterance, comprising: means for determining a signal including signal components representing the utterance; means for determining target model signals representing a target model and alternate model signals representing an alternate model; means for determining language model signals representing a language model and lexicon signals representing a lexicon; means for processing the signal including signal components, the target model signals, the alternate model signals, the language model signals, and the lexicon signals in one pass by applying a recursion formula in iterative steps to determine a confidence measure signal that represents a confidence measure of the identification of a particular known word in the utterance.
Claim 14
Dependent Claim 28 words
The speech recognizer of claim 9, wherein said means for processing includes means for obtaining a maximum of a recursively iterated quantity at each of the iterative steps.
Claim 15
Dependent Claim 60 words
The speech recognizer of claim 9, further comprising: means for determining a decision threshold signal; means for comparing the confidence measure signal to the decision threshold signal; and means for outputting a signal representative of the presence or absence of the known word in the utterance based on the comparison of the confidence measure signal and the decision threshold signal.
Claim 16
Dependent Claim 29 words
The speech recognizer of claim 11, further comprising means for outputting a signal representative of a target model hypothesis associated with a known word and the confidence measure signal.
Claim 17
Dependent Claim 191 words
The speech recognizer of claim 9, wherein said means for determining target model signals and alternate model signals determines signals representing hidden Markov models (HMMs) having a number of states N c and N a respectively, wherein said means for determining a signal including signal components determines signal components that are representative of feature vectors Y={y 1 , y 2 , . . . y T } corresponding to times 1, 2, . . . ,T respectively, and wherein said means for determining target model signals and alternate model signals determines signals representing the following parameters related to the HMMs, π.sub.n.sup.C, a.sub.in.sup.c,π.sub.m.sup.a, and a.sub.jm.sup.a for 1≦n≦N.sub.c, 1≦M<N.sub.a, 1≦i≦N.sub.c, 1≦j≦N.sub.a, and t=1,2, . . . ,T, where π n c =the initial state probability of the state n for the model λ c , a in c =the transition probability from the state i to the state n for the model λ c , π m a =the initial state probability of the state m for the model λ a , and a jm a =the transition probability from the state j to the state m for the model λ a .
Claim 18
Dependent Claim 356 words
A speech recognizer for determining a confidence measure of the presence of a known word in an utterance, comprising: means for determining a signal including signal components representing the utterance, said means determining signal components that are representative of feature vectors Y={y 1 , y 2 , . . . y T } corresponding to times 1, 2, . . . ,T respectively; means for determining target model signals representing a target model and alternate model signals representing an alternate model, said means determining signals representing hidden Markov models (HMMs) having a number of states N c and N a respectively, said means determining signals representing the following parameters related to the HMMs, π.sub.n.sup.C, a.sub.in.sup.c,π.sub.m.sup.a, and a.sub.jm.sup.a for 1≦n≦N.sub.c, 1≦M<N.sub.a, 1≦i≦N.sub.c, 1≦j≦N.sub.a, and t=1,2, . . . ,T, where π n c =the initial state probability of the state n for the model λ c , a in c =the transition probability from the state i to the state n for the model λ c , π m a =the initial state probability of the state m for the model λ a , and a jm a =the transition probability from the state j to the state m for the model λ a ; means for determining language model signals representing a language model and lexicon signals representing a lexicon; means for processing the signal including signal components, the target model signals, the alternate model signals, the language model signals, and the lexicon signals by applying a recursion formula in iterative steps to determine a confidence measure signal that represents a confidence measure of the identification of a particular known word in the utterance, said means for processing comprising: means for determining signals representing the following parameters, b n c (y→ t )=the observation density for the feature vector y t for the state n and the model λ c , b j a (y→ t )=the observation density for the feature vector y t for the state j and the model λ a , and means for determining said confidence measure signal based on δ t (n,m) determined according to the following recursion formula: ##EQU17##
Claim 19
Dependent Claim 356 words
A speech recognizer for determining a confidence measure of the presence of a known word in an utterance, comprising: means for determining a signal including signal components representing the utterance, said means determining signal components that are representative of feature vectors Y={y 1 , y 2 , . . . y T } corresponding to times 1, 2, . . . ,T respectively; means for determining target model signals representing a target model and alternate model signals representing an alternate model, said means determining signals representing hidden Markov models (HMMs) having a number of states N c and N a respectively, said means determining signals representing the following parameters related to the HMMs, π.sub.n.sup.C, a.sub.in.sup.c,π.sub.m.sup.a, and a.sub.jm.sup.a for 1≦n≦N.sub.c, 1≦M<N.sub.a, 1≦i≦N.sub.c, 1≦j≦N.sub.a, and t=1,2, . . . ,T, where π n c =the initial state probability of the state n for the model λ c , a in c =the transition probability from the state i to the state n for the model λ c , π m a =the initial state probability of the state m for the model λ a , and a jm a =the transition probability from the state j to the state m for the model λ a ; means for determining language model signals representing a language model and lexicon signals representing a lexicon; means for processing the signal including signal components, the target model signals, the alternate model signals, the language model signals, and the lexicon signals by applying a recursion formula in iterative steps to determine a confidence measure signal that represents a confidence measure of the identification of a particular known word in the utterance, said means for processing comprising: means for determining signals representing the following parameters, b n c (y→ t )=the observation density for the feature vector y t for the state n and the model λ c , b j a (y→ t )=the observation density for the feature vector y t for the state j and the model λ a , and means for determining said confidence measure signal based on δ t (n,m) determined according to the following recursion formula: ##EQU17##
Claim 20
Dependent Claim 175 words
The speech recognizer of claim 9, wherein the target model and the alternate model are hidden Markov models (HMMs), each having a number of states N, wherein said means for determining a signal including signal components determines signal components that are representative of feature vector Y={y 1 , y 2 , . . . y T } corresponding to times 1,2, . . . ,T respectively, and wherein said means for determining target model signals and alternate model signals determines signals representing the following parameters related to said HMMs, π.sub.i.sup.c,a.sub.ij.sup.c,π.sub.i.sup.a, and a.sub.ij.sup.a for 1≦i≦N and t=1,2, . . . ,T, where π j c =the initial state probability of the state j for the model λ c , a ij c =the transition probability from the state i to the state j for the model λ c , π j a =the initial state probability of the state j for the model λ a , a ij c =the transition probability from the state i to the state j for the model λ a .
Claim 21
Dependent Claim 350 words
A speech recognizer recognizer for determining a confidence measure of the presence of a known word in an utterance, comprising: means for determining a signal including signal components representing the utterance, said means determining signal components that are representative of feature vector Y={y 1 , y 2 , . . . y T } corresponding to times 1,2, . . . ,T respectively; means for determining target model signals representing a target model and alternate model signals representing an alternate model, the target model and the alternate model being hidden Markov models (HMMs), each having a number of states N, said means determining signals representing the following parameters related to said HMMs, π.sub.i.sup.C,a.sub.ij.sup.c,π.sub.i.sup.a, and a.sub.ij.sup.a for 1≦i≦N and t=1,2, . . . ,T, where π j c =the initial state probability of the state j for the model λ c , a ij c =the transition probability from the state i to the state j for the model λ c , π j a =the initial state probability of the state j for the model λ a , a ij c =the transition probability from the state i to the state j for the model λ a ; means for determining language model signals representing a language model and lexicon signals representing a lexicon; means for processing the signal including signal components, the target model signals, the alternate model signals, the language model signals, and the lexicon signals by applying a recursion formula in iterative steps to determine a confidence measure signal that represents a confidence measure of the identification of a particular known word in the utterance said means for processing comprising: means for determining signals representing the following parameters, b i c (y→ t )=the observation density for the feature vector y t for the state i and the model λ a , b j a (y→ t )=the observation density for the feature vector y t for the state j and the model λ a , and means for determining said confidence measure signal based on δ t (n,m) determined according to the following recursion formula: ##EQU18##
Claim 22
Dependent Claim 350 words
A speech recognizer recognizer for determining a confidence measure of the presence of a known word in an utterance, comprising: means for determining a signal including signal components representing the utterance, said means determining signal components that are representative of feature vector Y={y 1 , y 2 , . . . y T } corresponding to times 1,2, . . . ,T respectively; means for determining target model signals representing a target model and alternate model signals representing an alternate model, the target model and the alternate model being hidden Markov models (HMMs), each having a number of states N, said means determining signals representing the following parameters related to said HMMs, π.sub.i.sup.C,a.sub.ij.sup.c,π.sub.i.sup.a, and a.sub.ij.sup.a for 1≦i≦N and t=1,2, . . . ,T, where π j c =the initial state probability of the state j for the model λ c , a ij c =the transition probability from the state i to the state j for the model λ c , π j a =the initial state probability of the state j for the model λ a , a ij c =the transition probability from the state i to the state j for the model λ a ; means for determining language model signals representing a language model and lexicon signals representing a lexicon; means for processing the signal including signal components, the target model signals, the alternate model signals, the language model signals, and the lexicon signals by applying a recursion formula in iterative steps to determine a confidence measure signal that represents a confidence measure of the identification of a particular known word in the utterance said means for processing comprising: means for determining signals representing the following parameters, b i c (y→ t )=the observation density for the feature vector y t for the state i and the model λ a , b j a (y→ t )=the observation density for the feature vector y t for the state j and the model λ a , and means for determining said confidence measure signal based on δ t (n,m) determined according to the following recursion formula: ##EQU18##
Claim 23
Dependent Claim 25 words
The speech recognizer of claim 9, wherein said means for processing comprises a likelihood ratio decoder that determines the confidence measure as a likelihood ratio.
Claim 24
Dependent Claim 33 words
The speech recognizer of claim 9, wherein said means for determining a signal including signal components comprises a feature extractor that determines the signal components as representative of feature vectors of the utterance.
Claim 25
Dependent Claim 32 words
The speech recognizer of claim 9, wherein said means for determining target model signals and alternate model signals comprises a memory that stores parameters of the target model and the alternate model.
Claim 26
Dependent Claim 31 words
The speech recognizer of claim 9, wherein said means for determining language model signals and lexicon signals comprises a memory that stores parameters of the language model and the lexicon model.

References Cited (Backward Citations)

US4489434A Cited
US4783804A Cited
US4827521A Cited
US5033087A Cited
US5271088A Cited
US5349645A Cited
US5579436A Cited
US5638425A Cited
US5606644A Cited
US5621859A Cited
US5617488A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2001-11-02 2002-05-04 2002-11-03 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2005-11-02 2006-05-04 2006-11-03 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2009-11-02 2010-05-04 2010-11-03 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag