US5510981A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Language translation apparatus and method using context-based translation models
Assignee: International Business Machines Corp
•
Filing: 1993-10-28
•
Granted: 1996-04-23
•
Expires: 2013-10-28
Abstract
Abstract An apparatus for translating a series of source words in a first language to a series of target words in a second language. For an input series of source words, at least two target hypotheses, each including a series of target words, are generated. Each target word has a context comprising at least one other word in the target hypothesis. For each target hypothesis, a language model match score including an estimate of the probability of occurrence of the series of words in the target hypothesis. At least one alignment connecting each source word with at least one target word in the target hypothesis is identified. For each source word and each target hypothesis, a word match score including an estimate of the conditional probability of occurrence of the source word, given the target word in the target hypothesis which is connected to the source word and given the context in the target hypothesis of the target word which is connected to the source word. For each target hypothesis, a translation match score including a combination of the word match scores for the target hypothesis and the source words in the input series of source words. A target hypothesis match score including a combination of the language model match score for the target hypothesis and the translation match score for the target hypothesis. The target hypothesis having the best target hypothesis match score is output.
Inventors
- 👤 Adam L. Berger
- 👤 Peter F. Brown
- 👤 Stephen A. Della Pietra
- 👤 Vincent J. Della Pietra
- 👤 Andrew S. Kehler
- 👤 Robert L. Mercer
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 20:42
CPC Classifications
G; G06; G06F; G06F40/00; G06F40/40; G06F40/42; G06F40/44; G06F40/45
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
294 words
An apparatus for translating a series of source words in a first language to a series of target words in a second language different from the first language, said apparatus comprising: means for inputting said series of source words; means for generating at least two target hypotheses, each target hypothesis comprising said series of target words selected from a vocabulary of words in the second language, each target word having a context comprising at least one other word in the target hypothesis; means for generating, for each target hypothesis, a language model match score comprising an estimate of the probability of occurrence of the series of words in the target hypothesis; means for identifying at least one alignment between the input series of source words and each target hypothesis, the alignment connecting each source word with at least one target word in the target hypothesis; means for generating, for each source word and each target hypothesis, a word match score comprising an estimate of the conditional probability of occurrence of the source word, given the target word in the target hypothesis which is connected to the source word and given the context of the target word in the target hypothesis which is connected to the source word; means for generating, for each target hypothesis, a translation match score comprising a combination of the word match scores for the target hypothesis and the source words in the input series of source words; means for generating a target hypothesis match score for each target hypothesis, each target hypothesis match score comprising a combination of the language model match score for the target hypothesis and the translation match score for the target hypothesis; and means for outputting the target hypothesis having the best target hypothesis match score.
Claim 2
Independent Claim
294 words
An apparatus for translating a series of source words in a first language to a series of target words in a second language different from the first language, said apparatus comprising: means for inputting said series of source words; means for generating at least two target hypotheses, each target hypothesis comprising said series of target words selected from a vocabulary of words in the second language, each target word having a context comprising at least one other word in the target hypothesis; means for generating, for each target hypothesis, a language model match score comprising an estimate of the probability of occurrence of the series of words in the target hypothesis; means for identifying at least one alignment between the input series of source words and each target hypothesis, the alignment connecting each source word with at least one target word in the target hypothesis; means for generating, for each source word and each target hypothesis, a word match score comprising an estimate of the conditional probability of occurrence of the source word, given the target word in the target hypothesis which is connected to the source word and given the context of the target word in the target hypothesis which is connected to the source word; means for generating, for each target hypothesis, a translation match score comprising a combination of the word match scores for the target hypothesis and the source words in the input series of source words; means for generating a target hypothesis match score for each target hypothesis, each target hypothesis match score comprising a combination of the language model match score for the target hypothesis and the translation match score for the target hypothesis; and means for outputting the target hypothesis having the best target hypothesis match score.
Claim 3
Dependent Claim
39 words
An apparatus as claimed in claim 1, characterized in that each target hypothesis comprises a series of target words selected from a vocabulary comprising words in the second language and a null word representing the absence of a word.
Claim 4
Dependent Claim
167 words
An apparatus as claimed in claim 2, characterized in that: the means for identifying at least one alignment comprises means for identifying two or more alignments between the input series of source words and each target hypothesis, each alignment connecting each source word with at least one target word in the target hypothesis; the word match score generator comprises means for generating, for each source word and each alignment and each target hypothesis, a word match score comprising an estimate of the conditional probability of occurrence of the source word, given the target word in the target hypothesis which is connected to the source word and given the context of the target word in the target hypothesis which is connected to the source word; the translation match score generator comprises means for generating, for each target hypothesis, a translation match score comprising a combination of the word match scores for the target hypothesis and the alignments and the source words in the input series of source words.
Claim 5
Dependent Claim
207 words
An apparatus as claimed in claim 2, characterized in that: the input means comprises means for transforming the input series of source words into a series of transformed source words; the alignment means comprises means for identifying at least one alignment between the series of transformed source words and each target hypothesis, the alignment connecting each transformed source word with at least one target word in the target hypothesis; the word match score generator comprises means for generating, for each transformed source word and each target hypothesis, a word match score comprising an estimate of the conditional probability of occurrence of the transformed source word, given the target word in the target hypothesis which is connected to the transformed source word and given the context of the target word in the target hypothesis which is connected to the transformed source word; the translation match score generator comprises means for generating for each target hypothesis, a translation match score comprising a combination of the word match scores for the target hypothesis and the transformed source words; and the output means comprises means for synthesizing a series of output words from the target hypothesis having the best target hypothesis match score, and means for outputting the synthesized output words.
Claim 6
Dependent Claim
74 words
An apparatus as claimed in claim 2, characterized in that: the translation match score for a target hypothesis comprises the product of the word match scores for the target hypothesis and the source words in the input series of source words; and the target hypothesis match score for a target hypothesis comprises the product of the language model match score for the target hypothesis multiplied by the translation match score for the target hypothesis.
Claim 7
Dependent Claim
106 words
An apparatus as claimed in claim 2, characterized in that: the context of the target word in the target hypothesis which is connected to a source word is contained in at least one of two or more context classes; and the estimated conditional probability of occurrence of the source word, given the target word in the target hypothesis which is connected to the source word and given the context of the target word which is connected to the source word, comprises at least one function having a value dependent on the class containing the context of the target word which is connected to the source word.
Claim 8
Dependent Claim
119 words
An apparatus as claimed in claim 2, characterized in that: the context of the target word in the target hypothesis which is connected to a source word comprises at least one word having a part of speech in the target hypothesis; and the estimated conditional probability of occurrence of the source word, given the target word in the target hypothesis which is connected to the source word and given the context of the target word which is connected to the source word, comprises at least one function having a value dependent on the part of speech in the target hypothesis of at least one word in the context of the target word which is connected to the source word.
Claim 9
Dependent Claim
107 words
An apparatus as claimed in claim 2, characterized in that: the context of the target word in the target hypothesis which is connected to a source word comprises at least one word having an identity; and the estimated conditional probability of occurrence of the source word, given the target word in the target hypothesis which is connected to the source word and given the context of the target word which is connected to the source word, comprises at least one function having a value dependent on the identity of at least one word in the context of the target word which is connected to the source word.
Claim 10
Dependent Claim
25 words
An apparatus as claimed in claim 2, characterized in that the means for outputting the target hypothesis having the best match score comprises a display.
Claim 11
Dependent Claim
16 words
An apparatus as claimed in claim 2, characterized in that the input means comprises a keyboard.
Claim 12
Dependent Claim
18 words
An apparatus as claimed in claim 2, characterized in that the input means comprises a computer disk drive.
Claim 13
Dependent Claim
18 words
An apparatus as claimed in claim 2, characterized in that the input means comprises a computer tape drive.
Claim 14
Dependent Claim
279 words
A computer-implemented method of translating a series of source words in a first language to a series of target words in a second language different from the first language, said method comprising: inputting a series of source words; generating at least two target hypotheses, each target hypothesis comprising said series of target words selected from a vocabulary of words in the second language, each target word having a context comprising at least one other word in the target hypothesis; generating, for each target hypothesis, a language model match score comprising an estimate of the probability of occurrence of the series of words in the target hypothesis; identifying at least one alignment between the input series of source words and each target hypothesis, the alignment connecting each source word with at least one target word in the target hypothesis; generating, for each source word and each target hypothesis, a word match score comprising an estimate of the conditional probability of occurrence of the source word, given the target word in the target hypothesis which is connected to the source word and given the context of the target word in the target hypothesis which is connected to the source word; generating, for each target hypothesis, a translation match score comprising a combination of the word match scores for the target hypothesis and the source words in the input series of source words; generating a target hypothesis match score for each target hypothesis, each target hypothesis match score comprising a combination of the language model match score for the target hypothesis and the translation match score for the target hypothesis; and outputting the target hypothesis having the best target hypothesis match score.
Claim 15
Dependent Claim
279 words
A computer-implemented method of translating a series of source words in a first language to a series of target words in a second language different from the first language, said method comprising: inputting a series of source words; generating at least two target hypotheses, each target hypothesis comprising said series of target words selected from a vocabulary of words in the second language, each target word having a context comprising at least one other word in the target hypothesis; generating, for each target hypothesis, a language model match score comprising an estimate of the probability of occurrence of the series of words in the target hypothesis; identifying at least one alignment between the input series of source words and each target hypothesis, the alignment connecting each source word with at least one target word in the target hypothesis; generating, for each source word and each target hypothesis, a word match score comprising an estimate of the conditional probability of occurrence of the source word, given the target word in the target hypothesis which is connected to the source word and given the context of the target word in the target hypothesis which is connected to the source word; generating, for each target hypothesis, a translation match score comprising a combination of the word match scores for the target hypothesis and the source words in the input series of source words; generating a target hypothesis match score for each target hypothesis, each target hypothesis match score comprising a combination of the language model match score for the target hypothesis and the translation match score for the target hypothesis; and outputting the target hypothesis having the best target hypothesis match score.
Claim 16
Dependent Claim
39 words
A method as claimed in claim 13, characterized in that each target hypothesis comprises a series of target words selected from a vocabulary comprising words in the second language and a null word representing the absence of a word.
Claim 17
Dependent Claim
167 words
A method as claimed in claim 14, characterized in that: the step of identifying at least one alignment comprises identifying two or more alignments between the input series of source words and each target hypothesis, each alignment connecting each source word with at least one target word in the target hypothesis; the step of generating a word match score comprises generating, for each source word and each alignment and each target hypothesis, a word match score comprising an estimate of the conditional probability of occurrence of the source word, given the target word in the target hypothesis which is connected to the source word and given the context of the target word in the target hypothesis which is connected to the source word; the step of generating a translation match score comprises generating, for each target hypothesis, a translation match score comprising a combination of the word match scores for the target hypothesis and the alignments and the source words in the input series of source words.
Claim 18
Dependent Claim
204 words
A method as claimed in claim 14, characterized in that: the step of inputting comprises the step of transforming the input series of source words into a series of transformed source words; the step of aligning comprises identifying at least one alignment between the series of transformed source words and each target hypothesis, the alignment connecting each transformed source word with at least one target word in the target hypothesis; the step of generating a word match score comprises generating, for each transformed source word and each target hypothesis, a word match score comprising an estimate of the conditional probability of occurrence of the transformed source word, given the target word in the target hypothesis which is connected to the transformed source word and given the context of the target word in the target hypothesis which is connected to the transformed source word; the step of generating a translation match score comprises generating, for each target hypothesis, a translation match score comprising a combination of the word match scores for the target hypothesis and the transformed source words; and the step of outputting comprises the step of synthesizing a series of output words from the target hypothesis having the best target hypothesis match score.
Claim 19
Dependent Claim
74 words
A method as claimed in claim 14, characterized in that: the translation match score for a target hypothesis comprises the product of the word match scores for the target hypothesis and the source words in the input series of source words; and the target hypothesis match score for a target hypothesis comprises the product of the language model match score for the target hypothesis multiplied by the translation match score for the target hypothesis.
Claim 20
Dependent Claim
106 words
A method as claimed in claim 14, characterized in that: the context of the target word in the target hypothesis which is connected to a source word is contained in at least one of two or more context classes; and the estimated conditional probability of occurrence of the source word, given the target word in the target hypothesis which is connected to the source word and given the context of the target word which is connected to the source word, comprises at least one function having a value dependent on the class containing the context of the target word which is connected to the source word.
Claim 21
Dependent Claim
119 words
A method as claimed in claim 14, characterized in that: the context of the target word in the target hypothesis which is connected to a source word comprises at least one word having a part of speech in the target hypothesis; and the estimated conditional probability of occurrence of the source word, given the target word in the target hypothesis which is connected to the source word and given the context of the target word which is connected to the source word, comprises at least one function having a value dependent on the part of speech in the target hypothesis of at least one word in the context of the target word which is connected to the source word.
Claim 22
Dependent Claim
107 words
A method as claimed in claim 14, characterized in that: the context of the target word in the target hypothesis which is connected to a source word comprises at least one word having an identity; and the estimated conditional probability of occurrence of the source word, given the target word in the target hypothesis which is connected to the source word and given the context of the target word which is connected to the source word, comprises at least one function having a value dependent on the identity of at least one word in the context of the target word which is connected to the source word.
Claim 23
Dependent Claim
32 words
A method as claimed in claim 14, characterized in that the step of outputting the target hypothesis having the best match score comprises displaying the target hypothesis having the best match score.
References Cited (Backward Citations)
US5109509A
Cited
US4754489A
Cited
US4829580A
Cited
US4882759A
Cited
US5146405A
Cited
US5068789A
Cited
US5200893A
Cited
US5033087A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1999-04-23 | 1999-10-23 | 2000-04-23 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2003-04-23 | 2003-10-23 | 2004-04-23 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2007-04-23 | 2007-10-23 | 2008-04-23 | $7700.00 | Window Closed / Lapsed |