Hidden Markov model speech recognition arrangement

Claim 2

A speech analyzer for recognizing an utterance as one of a plurality of reference patterns each having a frame sequence of acoustic feature signals comprising: means for storing a set of K signals each representative of a prescribed acoustic feature of said plurality of reference patterns; means for storing a plurality of templates each representative of an identified spoken reference pattern, the template of each spoken reference pattern comprising signals representative of a first state, a last state and a preselected number N-2 intermediate states between said first and last states of a constrained hidden Markov model of said spoken reference pattern, N being independent of the number of acoustic feature frames in the acoustic feature frame sequence of the identified spoken reference pattern, a plurality of first type signals each representative of the likelihood of a prescribed acoustic feature signal of a reference pattern frame being in a predetermined one of said states, and a plurality of second type signals each representative of the likelihood of a transition from a prescribed acoustic feature signal in one of said states to another of said states of said template; means responsive to the utterance for forming a time frame sequence of acoustic feature signals representative of the speech pattern of the utterance; means responsive to said utterance feature signal sequence and said stored prescribed acoustic feature signals for selecting a sequence of said prescribed feature signals representative of the utterance speech pattern; means jointly responsive to said sequence of prescribed feature signals representative of the utterance and the reference pattern template N state constrained hidden Markov model signals for combining said utterance representative sequence of prescribed feature signal sequence with said reference pattern N state Markov model template signals to form a third type signal representative of the likelihood of the unknown utterance being the spoken reference pattern; and means responsive to the third type signals for the plurality of reference patterns for generating a signal to identify the utterance as one of the plurality of reference patterns.

Claim 3

A speech analyzer according to claim 1 wherein said third type signal generating means comprises: means for successively generating speech pattern frame processing interval signals for the sequence of prescribed acoustic feature signals; means operative in the current speech pattern frame processing interval responsive to the utterance representative prescribed feature signal of the current speech pattern frame and the reference pattern template N state constrained hidden Markov model signals for producing a set of signals representative of the likelihood of the utterance speech pattern being in a prescribed state of the Markov model template during said speech frame; and means operative in the speech pattern frame processing intervals responsive to the likelihood representative signal corresponding to the reference pattern Markov model template being in the last state during the last speech pattern frame for forming a signal representative of the probability of the speech pattern being obtained from the reference pattern N state Markov model template.

Claim 4

A speech analyzer according to claim 2 wherein: said means for producing said set of likelihood representative signals in each speech pattern frame processing interval comprises means responsive to the first and second type signals for generating a set of signals representative of the probability that the reference template Markov model for the utterance speech pattern portion up to the current frame is in each of the reference template Markov model states.

Claim 5

A speech analyzer according to claim 1 wherein N is smaller than the number of frames in the sequence of acoustic feature signal frames of the smallest of said reference patterns.

Claim 6

A speech analyzer according to claim 3 wherein: said means for storing the set of K prescribed feature signals comprises means for storing K linear predictive feature prototype signals covering the range of acoustic features of the frame sequence of acoustic feature of the reference patterns; and said means for forming a sequence of acoustic feature signals representative of the utterance speech pattern comprises means for forming a sequence of linear predictive feature signals representative of the utterance speech pattern.

Claim 7

A speech analyzer according to claim 3 wherein the second type signals corresponding to transitions from a first distinct state i<N to a second distinct state j<=N, j<i and j>i+2 are zero value signals.

Claim 8

A speech analyzer according to claims 1, 2, 3, 4, 5, or 6 wherein said speech pattern is an utterance of a word and each reference pattern is an identified spoken word speech pattern.

Claim 11

A method for recognizing an utterance as one of a plurality of reference patterns according to claim 8 wherein generation of said third type signals comprises the steps of: successively generating speech pattern frame processing interval signals; in the current speech pattern frame processing interval responsive to the prescribed feature signal of the current utterance speech pattern frame and the reference pattern template N state constrained hidden Markov model signals, producing a set of signals representative of the likelihood of the utterance speech pattern being in a prescribed state of the N state Markov model template during said speech pattern frame; and in the speech pattern frame processing intervals responsive to the likelihood representative signal corresponding to the reference pattern Markov model template being in the last state during the last speech pattern frame, forming a signal representative of the probability of the speech pattern being obtained from the reference pattern N state Markov model template.

Claim 12

A method for recognizing an utterance as one of a plurality of reference patterns according to claim 9 wherein: the step of producing said set of likelihood representative signals in each speech pattern frame processing interval comprises: generating a set of signals representative of the probability that the reference template Markov model for the utterance speech pattern portion up to the current frame is in each of the reference template Markov model states responsive to the first and second type signals.

Claim 13

A method for recognizing an utterance as one of a plurality of reference patterns according to claim 8 wherein: N is smaller than the number of frames in the sequence of acoustic feature signal frames of the smallest of said reference patterns.

Claim 14

A method for recognizing an utterance as one of a plurality of reference patterns according to claim 10 wherein: the step of storing the set of K prescribed feature signals comprises storing K linear predictive feature prototype signals covering the range of acoustic features of the frame sequence of acoustic feature signals of the reference patterns; and the step of forming a sequence of acoustic feature signals representative of the utterance speech pattern comprises forming a sequence of linear predictive feature signals representative of the utterance speech pattern.

Claim 15

A method for recognizing an utterance as one of a plurality of reference patterns according to claim 12 wherein the second type signals corresponding to transitions from a first distinct state i<N to a second distinct state j<=N, j<i and j>i+2 are zero value signals.

Claim 17

A speech analyzer for recognizing an utterance as one of a plurality of vocabulary words comprising: a first memory for storing a set of K vector quantized prototype signals each representative of a linear predictive acoustic feature in the frame sequence of acoustic features of utterances of said plurality of vocabulary words; a second memory for storing a plurality of vocabulary reference templates, each template corresponding to an N state constrained hidden Markov model of a vocabulary word and including; a signal corresponding to an initial state of said constrained hidden Markov model, signals corresponding to N-2 intermediate states of said constrained hidden Markov model, a signal corresponding to the Nth final state of said constrained hidden Markov model, the number of states N being preselected to be less than the number of acoustic features in the sequence of acoustic features of the shortest vocabulary word, a set of first type signals each representative of the probability of a prototype feature signal being in a predetermined state of said constrained hidden Markov model, and a set of second type signals each representative of the probability of transition between a predetermined pair of said vocabulary word constrained hidden Markov model states; first means responsive to the utterance for forming an M time frame sequence of linear predictive acoustic feature signals representative of the speech pattern of the utterance; second means operative responsive to said speech pattern feature signals and said stored prototype acoustic feature signals for generating a sequence of M prototype acoustic feature signals representative of said utterance speech pattern; said second means being jointly responsive to said sequence of M prototype feature signals representative of the utterance and the signals of the N state constrained hidden Markov model of the vocabulary word template for forming a third type signal representative of the likelihood of the unknown utterance being the vocabulary word including means for producing a sequence of speech pattern frame processing interval signals, said second means being operative in the first frame processing interval responsive to the first frame prototype feature signal, the vocabulary word Markov model first state and first type signals for forming a signal representative of the likelihood of the first frame prototype feature signal being in the vocabulary word Markov model first state, and operative in each of the second to the Mth speech pattern frame processing intervals responsive to the Markov model state signals, the current frame prototype feature signals, the first type and second type signals, and the likelihood signals of the immediately preceding frame processing interval for forming a set of signals each representative of the likelihood of the current frame prototype feature signal being in a prescribed state of the vocabulary word Markov model, and means responsive to the likelihood signal corresponding to the Nth final state in the Mth speech pattern frame processing interval for generating the third type signal for said vocabulary word representative of the likelihood of the utterance being the vocabulary word; and means responsive to the third type signals for the plurality of vocabulary words for generating a signal identifying the utterance as the vocabulary word having the largest third type signal.

Claim 18

A speech analyzer for recognizing an utterance as one of a plurality of vocabulary words comprising: a first memory for storing a set of K vector quantized prototype signals each representative of a linear predictive acoustic feature in the frame sequence of acoustic features of utterances of said plurality of vocabulary words; a second memory for storing a plurality of vocabulary reference templates, each template corresponding to an N state constrained hidden Markov model of a vocabulary word and including; a signal corresponding to an initial state of said constrained hidden Markov model, signals corresponding to N-2 intermediate states of said constrained hidden Markov model, a signal corresponding to the Nth final state of said constrained hidden Markov model, the number of states N being preselected to be less than the number of acoustic features in the sequence of acoustic features of the shortest vocabulary word, a set of first type signals each representative of the probability of a prototype feature signal being in a predetermined state of said constrained hidden Markov model, and a set of second type signals each representative of the probability of transition between a predetermined pair of said vocabulary word constrained hidden Markov model states; first means responsive to the utterance for forming an M time frame sequence of linear predictive acoustic feature signals representative of the speech pattern of the utterance; second means operative responsive to said speech pattern feature signals and said stored prototype acoustic feature signals for generating a sequence of M prototype acoustic feature signals representative of said utterance speech pattern; said second means being jointly responsive to said sequence of M prototype feature signals representative of the utterance and the signals of the N state constrained hidden Markov model of the vocabulary word template for forming a third type signal representative of the likelihood of the unknown utterance being the vocabulary word including means for producing a sequence of speech pattern frame processing interval signals, said second means being operative in the first frame processing interval responsive to the first frame prototype feature signal, the vocabulary word Markov model first state and first type signals for forming a signal representative of the likelihood of the first frame prototype feature signal being in the vocabulary word Markov model first state, and operative in each of the second to the Mth speech pattern frame processing intervals responsive to the Markov model state signals, the current frame prototype feature signals, the first type and second type signals, and the likelihood signals of the immediately preceding frame processing interval for forming a set of signals each representative of the likelihood of the current frame prototype feature signal being in a prescribed state of the vocabulary word Markov model, and means responsive to the likelihood signal corresponding to the Nth final state in the Mth speech pattern frame processing interval for generating the third type signal for said vocabulary word representative of the likelihood of the utterance being the vocabulary word; and means responsive to the third type signals for the plurality of vocabulary words for generating a signal identifying the utterance as the vocabulary word having the largest third type signal.