US5835888A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Statistical language model for inflected languages
Assignee: International Business Machines Corp
•
Filing: 1996-06-10
•
Granted: 1998-11-10
•
Expires: 2016-06-10
Abstract
Abstract A statistical language model for inflected languages, having very large vocabularies, is generated by splitting words into stems, prefixes and endings, and deriving trigrams for the stems, ending and prefixes. The statistical dependence of endings and prefixes from each stem is also obtained, and the resulting language model is a weighted sum of these scores.
Inventors
- 👤 Dimitri Kanevsky
- 👤 Salim Estephan Roukos
- 👤 Jan Sedivy
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-07 19:14
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/08; G10L15/18; G10L15/14; G10L15/183; G10L15/19
Claims Analysis
Total Claims: 25
Claim 1
Independent Claim
92 words
A method for generating a language model, comprising: providing to a classifier a corpus of words having a given sequence; performing a plurality of transformations on the words in the corpus, while preserving the given sequence, to generate a plurality of classes, each of the plurality of classes having a different stream of word components associated therewith, said different stream of word components being generated in accordance with one of the transformations; estimating statistical data representing each of the classes; and weighting and combining the statistical data to form the language model.
Claim 2
Independent Claim
92 words
A method for generating a language model, comprising: providing to a classifier a corpus of words having a given sequence; performing a plurality of transformations on the words in the corpus, while preserving the given sequence, to generate a plurality of classes, each of the plurality of classes having a different stream of word components associated therewith, said different stream of word components being generated in accordance with one of the transformations; estimating statistical data representing each of the classes; and weighting and combining the statistical data to form the language model.
Claim 3
Dependent Claim
51 words
The method of claim 1, wherein one of the transformations identifies a stem and ending, if present, in each word, and links the stem and ending via a linking character if an ending is present, and appends the linking character at the end of the stem if no ending is present.
Claim 4
Dependent Claim
29 words
The method of claim 2, wherein the estimated statistical data includes a distribution of the occurrence of each of a plurality of endings, given each stem in the corpus.
Claim 5
Dependent Claim
27 words
The method of claim 2, wherein the spellings for words in the model are split in the same place that words are split into stems and endings.
Claim 6
Dependent Claim
19 words
The method of claim 1, wherein one of the transformations deletes the ending from each word in the corpus.
Claim 7
Dependent Claim
20 words
The method of claim 5, wherein the estimated statistical data includes an n-gram distribution of each stem in the corpus.
Claim 8
Dependent Claim
19 words
The method of claim 1, wherein one of the transformations removes the stem from all words in the corpus.
Claim 9
Dependent Claim
20 words
The method of claim 7, wherein the estimated statistical data includes an n-gram distribution of each ending in the corpus.
Claim 10
Dependent Claim
23 words
The method of claim 1, wherein one of the transformations separates the stem and ending, if present, of each word in the corpus.
Claim 11
Dependent Claim
30 words
The method of claim 9, wherein the estimated statistical data includes an n-gram distribution of stems and endings, in their natural order, for each stem and ending in the corpus.
Claim 12
Dependent Claim
102 words
The method of claim 1, wherein the plurality of the transformations comprises: a first transformation that identifies a stem and ending, if present, in each word, and links the stem and ending with a linking character if an ending is present, and appends the linking character at the end of the stem if no ending is present; a second transformation that deletes the ending, if present, from each word in the corpus; a third transformation that deletes the stem from each word in the corpus; a fourth transformation that separates the stem and ending, if present, of each word in the corpus.
Claim 13
Dependent Claim
66 words
The method of claim 11, wherein the estimated statistical data comprises: a distribution of the occurrence of each of a plurality of endings, given each stem in the corpus; an n-gram distribution of each stem in the corpus; an n-gram distribution of each ending in the corpus an n-gram distribution of stems and endings, in their natural order, for each stem and ending in the corpus.
Claim 14
Dependent Claim
20 words
The method of claim 12, wherein a zero n-gram probability is assigned to stem-ending pairs not occurring in the language.
Claim 15
Dependent Claim
36 words
The method of claim 1, further comprising identifying a stem and an ending, if present, in each word in the corpus by comparing a list of endings in the language with each word in the corpus.
Claim 16
Dependent Claim
26 words
The method of claim 1, further comprising identifying a stem and an ending in each word in the corpus by reference to a set of rules.
Claim 17
Independent Claim
96 words
A system for generating a language model, comprising: means for storing a corpus of words having a meaningful sequence; classification means for performing a plurality of transformations on each word in the corpus, while preserving the sequence, to generate a plurality of classes, each of the plurality of classes having a different stream of word components associated therewith, said different stream of word components being generated in accordance with one of the transformations; means for estimating statistical data representing each of the classes; means for weighting and combining the statistical data to form the language model.
Claim 18
Independent Claim
96 words
A system for generating a language model, comprising: means for storing a corpus of words having a meaningful sequence; classification means for performing a plurality of transformations on each word in the corpus, while preserving the sequence, to generate a plurality of classes, each of the plurality of classes having a different stream of word components associated therewith, said different stream of word components being generated in accordance with one of the transformations; means for estimating statistical data representing each of the classes; means for weighting and combining the statistical data to form the language model.
Claim 19
Dependent Claim
34 words
A speech recognition system including the system of claim 16, comprising: means for computing the likelihood of an input word of speech based on the weighted combination of statistical data forming the language model.
Claim 20
Independent Claim
132 words
A method for generating a language model for a language, comprising the steps of: a) identifying a plurality of stems and endings in the language; b) extracting the identified stems and endings from a plurality of words in the language; c) given a set of text data in the language, converting the text to a text composed of stems and endings, and considering stems and endings as separate dictionary entries; d) constructing a vocabulary from the text generated in step c); e) for each stem, generating a set of probabilities for endings, the set of probabilities for endings having a size given by the number of endings; f) using the results of step b), generating a language model for any combination of stems and endings which would give the lowest recognition score.
Claim 21
Independent Claim
132 words
A method for generating a language model for a language, comprising the steps of: a) identifying a plurality of stems and endings in the language; b) extracting the identified stems and endings from a plurality of words in the language; c) given a set of text data in the language, converting the text to a text composed of stems and endings, and considering stems and endings as separate dictionary entries; d) constructing a vocabulary from the text generated in step c); e) for each stem, generating a set of probabilities for endings, the set of probabilities for endings having a size given by the number of endings; f) using the results of step b), generating a language model for any combination of stems and endings which would give the lowest recognition score.
Claim 22
Dependent Claim
22 words
The method of claim 18, wherein the possible endings in a language are identified using a known vocabulary set for the language.
Claim 23
Dependent Claim
18 words
The method of claim 1, wherein the possible endings in a language are contained in a precompiled list.
Claim 24
Independent Claim
181 words
A method for generating a language model for a language, comprising the steps of: a) identifying a plurality of stems, endings and prefixes in the language; b) extracting the identified stems, endings and prefixes from a plurality of words in the language; c) given a set of text data in the language, converting the text to a text composed of prefixes, stems and endings, and considering prefixes, stems and endings as separate dictionary entries; d) constructing a vocabulary from the text generated in step c); e) for each stem, generating a set of probabilities for endings, a set of probabilities for prefixes and a set of probabilities for stems, the set of probabilities for prefixes having a size given by the number of prefixes, the set of probabilities for endings having a size given by the number of endings, and the set of probabilities for stems having a size given by the number of stems; f) using the results of step b), generating a language model for any combination of prefixes, stems and endings which would give the lowest recognition score.
Claim 25
Independent Claim
181 words
A method for generating a language model for a language, comprising the steps of: a) identifying a plurality of stems, endings and prefixes in the language; b) extracting the identified stems, endings and prefixes from a plurality of words in the language; c) given a set of text data in the language, converting the text to a text composed of prefixes, stems and endings, and considering prefixes, stems and endings as separate dictionary entries; d) constructing a vocabulary from the text generated in step c); e) for each stem, generating a set of probabilities for endings, a set of probabilities for prefixes and a set of probabilities for stems, the set of probabilities for prefixes having a size given by the number of prefixes, the set of probabilities for endings having a size given by the number of endings, and the set of probabilities for stems having a size given by the number of stems; f) using the results of step b), generating a language model for any combination of prefixes, stems and endings which would give the lowest recognition score.
References Cited (Backward Citations)
US4342085A
Cited
US4831550A
Cited
US4882759A
Cited
US5490061A
Cited
EP0282272A1
Cited
EP0376501A2
Cited
US5467425A
Cited
US5680511A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-11-09 | 2002-05-11 | 2002-11-10 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-11-09 | 2006-05-11 | 2006-11-10 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-11-09 | 2010-05-11 | 2010-11-10 | $7700.00 | Window Closed / Lapsed |