← Back to Patent Explorer
EP0238697A1 Expired / Lapsed EP ⏱️ 0.0 years remaining

Method of constructing baseform models of words from multiple utterances for speech recognition

Assignee: International Business Machines Corp
•
Filing: 1986-03-27
•
Granted: —
•
Expires: 2006-03-27
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract The present invention addresses the problem of constructing fenemic baseforms which take into account variations in pronunciation of words from one utterance thereof to another. Specifically disclosed is a method of constructing a fenemic baseform for a word in a vocabulary of word segments including the steps of: (a) transforming multiple utterances of the word into respective strings of fenemes; (b) defining a set of fenemic Markov model phone machines; (c) determining the best single-phone machine P₁ for producing the multiple feneme strings; (d) determining the best two-phone baseform of the form P₁P₂ or P₂P₁ for producing the multiple feneme strings; (e) aligning the best two-phone baseform against each feneme string; (f) splitting each feneme string into a left portion and a right portion with the left portion corresponding to the first phone machine of the two-phone baseform and the right portion corresponding to the second phone machine of the two-phone baseform; (g) identifying each left portion as a left substring and each right portion as a right substring; (h) processing the set of left substrings and the set of right substrings in the same manner as the set of feneme strings corresponding to the multiple utterances including the further step of inhibiting further splitting of a substring when the single-phone baseform thereof has a higher probability of pro­ducing the substring than does the best two-phone baseform; and (k) concatenating the unsplit single phones in an order corresponding the order of the feneme substrings to which they correspond.

Inventors

  • 👤 Lalit Rai Bahl
  • 👤 Peter Vincent Desouza
  • 👤 Robert Leroy Mercer
  • 👤 Michael Alan Picheny

Bibliographic Details

Application Number —
Jurisdiction EP
Data Source google_patents
Last Synchronized 2026-10-29 14:39
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/04

Claims Analysis

Total Claims: 12
Claim 1
Independent Claim 131 words
In a speech recognition system having an acoustic processor, a method of processing multip­le utterances of a word in the construction of a fenemic baseform for the word, the method compris­ing the steps of: a) providing as input a string of fenemes gene­rated by the acoustic processor in response to an utterance of the word; (b) repeating step (a) for each utterance of the multiple utterances; and (c) locating a consistent point in each input string of fenemes, wherein each string of fenemes is divided by the consistent point thereof into a left portion and a right portion; the left portions of all the input strings of fenemes representing a common sequence of sounds, and the right portions of all the input strings of fenemes representing a common sequence of sounds.
Claim 2
Dependent Claim 131 words
In a speech recognition system having an acoustic processor, a method of processing multip­le utterances of a word in the construction of a fenemic baseform for the word, the method compris­ing the steps of: a) providing as input a string of fenemes gene­rated by the acoustic processor in response to an utterance of the word; (b) repeating step (a) for each utterance of the multiple utterances; and (c) locating a consistent point in each input string of fenemes, wherein each string of fenemes is divided by the consistent point thereof into a left portion and a right portion; the left portions of all the input strings of fenemes representing a common sequence of sounds, and the right portions of all the input strings of fenemes representing a common sequence of sounds.
Claim 3
Dependent Claim 101 words
The method of claim 1 wherein said consistent point locating step comprises the steps of: (d) storing a set of fenemic phone machines, each phone machine having a plurality of states; transitions between states, each transition having a probability associated therewith; and, for at least some transitions, a respect­ive probability of producing each feneme at a given transition; and (e) determining the probabilities of a phone machine to produce each of the input feneme strings; (f) repeating step (e) for each phone machine; and (g) selecting the phone machine that has the highest joint probability of producing the input feneme strings.
Claim 4
Dependent Claim 153 words
The method of claim 2 wherein said consistent point locating step comprises the further steps of: (h) appending a phone machine in front of the selected phone machine to form an ordered pair of phone machines and determining the proba­bilities of the ordered pair of phone machines to produce each of the input strings of fe­nemes; (j) repeating step (h) for each phone machine as the appended phone machine; (k) appending a phone machine at the end of the selected phone machine to form an ordered pair of phone machines and determining the pro­babilities of the ordered pair of phone machines to produce each of the input strings of fenemes; (l) repeating step (k) for each phone machine as the appended phone machine; and (m) selecting that ordered pair consisting of the selected phone machine and an appended phone machine, which has the highest joint probabili­ty of producing the input strings of fenemes.
Claim 5
Dependent Claim 52 words
The method of claim 3 wherein said consistent point locating step comprises the further step of: (n) performing an alignment process between the selected ordered pair of phone machines and each input string of fenemes, the most pro­bable point in each string where the two phone machines meet being the consistent point.
Claim 6
Dependent Claim 161 words
The method of claim 4 comprising the further steps of: (p) splitting the left portion from the right portion of each input string of fenemes of the respective consistent point thereof; (q) finding the single phone P L having the highest joint probability for the left portions of the input strings; (r) finding the two-phone baseform, from among all two-phone baseforms that include the phone P L , which has the highest joint probability of producing the left portions; (s) if the highest probability two-phone baseform including phone P L is higher than the proba­bility associated with the single phone P L , aligning each utterance against the found two-­phone baseform, and splitting the found two-­phone baseform apart at the point of meeting into a resultant left portion and a resultant right portion; and (t) performing steps (p) through (s) with the resultant left portion and the resultant right portion being substituted for the left portion and the right portion respectively.
Claim 7
Dependent Claim 56 words
The method of claim 5 comprising the further steps of: (u) discontinuing the splitting when a highest probability single-phone machine has a higher probability than any two-phone baseform that includes the highest probability single phone and an appended phone; and (v) concatenating the unsplit single phones; the concatenated baseform forming a basic baseform of the word.
Claim 8
Dependent Claim 95 words
The method of claim 6 comprising the further steps of: (w) aligning each input string of fenemes against the baseform of concatenated single phones; and (x) for a phone in the concatenated baseform, determining the fenemes which are aligned thereagainst and either, if there are no aligned fenemes, deleting the phone from the concatenated baseform or finding the phone which maximizes the probability of producing the determined fenemes, and replacing the phone in the concatenated baseform by the found phone if they differ; and (y) repeating step (x) for each phone in the concatenated baseform.
Claim 9
Dependent Claim 48 words
The method of claim 7 comprising the further step of: (z) repeating steps (w), (x), and (y) until each phone in the concatenated sequence has the maximum probability of producing the fenemes aligned therewith; the baseform resulting from step (z) being a refined baseform for the word segment.
Claim 10
Dependent Claim 209 words
A speech recognition method using a speech input subsystem which converts utterances to feneme strings, the method being characterized by the steps of: (a) finding a best first baseform of phone length one which maximizes the joint probability of producing the feneme strings resulting from multiple utterances of a given word in a vocabulary of words; (b) finding a best second baseform of phone length two and of the form either P₁P₂ or P₂P₁ which has a higher joint probability than any other baseform of length two; (c) comparing the joint probability of the first baseform with the joint probability of the second baseform and, if the second baseform joint probability is higher than the joint probability of the first baseform, splitting each feneme string into a left portion and a right portion at the point which maximizes the probability that the left portion is produced by the left phone and the right portion is produced by the right phone; (d) repeating steps (a) through (c) until all baseforms are of single phone length and no second baseform has a higher probability than its respective first baseform; (e) concatenating the baseforms of phone length one remaining after step (d) to form a basic fenemic baseform of the entire word.
Claim 11
Dependent Claim 209 words
A speech recognition method using a speech input subsystem which converts utterances to feneme strings, the method being characterized by the steps of: (a) finding a best first baseform of phone length one which maximizes the joint probability of producing the feneme strings resulting from multiple utterances of a given word in a vocabulary of words; (b) finding a best second baseform of phone length two and of the form either P₁P₂ or P₂P₁ which has a higher joint probability than any other baseform of length two; (c) comparing the joint probability of the first baseform with the joint probability of the second baseform and, if the second baseform joint probability is higher than the joint probability of the first baseform, splitting each feneme string into a left portion and a right portion at the point which maximizes the probability that the left portion is produced by the left phone and the right portion is produced by the right phone; (d) repeating steps (a) through (c) until all baseforms are of single phone length and no second baseform has a higher probability than its respective first baseform; (e) concatenating the baseforms of phone length one remaining after step (d) to form a basic fenemic baseform of the entire word.
Claim 12
Dependent Claim 74 words
The method of claim 9 comprising the further step of: (f) aligning the concatenated baseform against the feneme strings using the Viterbi algorithm and identifying a feneme substring in each string corresponding to each phone in the concate­nated baseforms; and (g) determining after alignement, for each phone in the concatenated baseform, any other phone in the set having a higher joint probability of producing the feneme substrings corresponding thereto in the multiple feneme strings.

References Cited (Backward Citations)

No citation records indexed.

USPTO Annuity & Maintenance Windows

Maintenance schedule is calculated for granted US utility patents.

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag