Patent US5878386A successfully refreshed from Google Patents.
US5878386A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Natural language parser with dictionary-based part-of-speech probabilities
Assignee: Microsoft Technology Licensing LLC
•
Filing: 1996-06-28
•
Granted: 1999-03-02
•
Expires: 2016-06-28
Abstract
Abstract A natural language parser determines part-of-speech probabilities by using a dictionary or other lexicon as a source for the part-of-speech probabilities. A machine-readable dictionary is scanned, word-by-word. For each word, the number of senses listed for the word and associated with a part of speech are counted. A part-of-speech probability is then computed for each part of speech based upon the number of senses counted. The part-of-speech probability is indicative of how likely the word is to assume a particular part of speech in a text. The most probable parts of speech are then used by a parser during the first parse of an input string of text to improve the parser's accuracy and efficiency.
Inventors
- 👤 Deborah A. Coughlin
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-05 13:54
CPC Classifications
G; G06; G06F; G06F40/00; G06F40/20; G06F40/205; G06F40/216; G06F40/211; G06F40/237; G06F40/242; G06F40/268; G06F40/279; G06F40/284
Claims Analysis
Total Claims: 55
Claim 1
Independent Claim
81 words
In a parser of a natural language processing system, a method comprising the following steps: examining individual dictionary entries for corresponding words in a dictionary; counting, for an individual dictionary entry, a number of senses listed in the dictionary entry which are associated with a part of speech; and deriving a part-of-speech probability indicative of how likely a dictionary entry is to be a particular part of speech based upon the number of senses associated with the particular part of speech.
Claim 2
Dependent Claim
81 words
In a parser of a natural language processing system, a method comprising the following steps: examining individual dictionary entries for corresponding words in a dictionary; counting, for an individual dictionary entry, a number of senses listed in the dictionary entry which are associated with a part of speech; and deriving a part-of-speech probability indicative of how likely a dictionary entry is to be a particular part of speech based upon the number of senses associated with the particular part of speech.
Claim 3
Dependent Claim
23 words
A method as recited in claim 1, wherein the examining step comprises the step of reading a computer-readable dictionary using a computational device.
Claim 4
Dependent Claim
47 words
A method as recited in claim 1, further comprising the following steps: counting a total number of senses for the dictionary entry; and computing the part-of-speech probability as a function of the number of senses counted for the part of speech and the total number of senses.
Claim 5
Dependent Claim
53 words
A method as recited in claim 1, further comprising the following steps: counting a number of senses listed in the dictionary entry which are associated with every part of speech; and determining which part of speech is most probable based upon the various numbers of senses associated with the different parts of speech.
Claim 6
Dependent Claim
22 words
A method as recited in claim 4, further comprising the step of entering the most probable part of speech into the parser.
Claim 7
Dependent Claim
103 words
A method as recited in claim 1, further comprising the following steps: determining whether the dictionary entry is an inflected form of a lexeme accounted for by another dictionary entry; in an event that the dictionary entry is an inflected form, counting a number of senses for each part of speech attributable to the lexeme dictionary entry and a number of senses for each part of speech attributable to the inflected form dictionary entry; and adding the number of senses attributable to the lexeme dictionary entry and the inflected form dictionary entry to derive the part-of-speech probability for the inflected form dictionary entry.
Claim 8
Dependent Claim
53 words
A method as recited in claim 1, further comprising the following steps: counting a number of senses listed in the dictionary entry which are associated with every part of speech; and deriving part-of-speech probabilities for all of the parts of speech based upon the number of senses associated with the parts of speech.
Claim 9
Dependent Claim
87 words
A method as recited in claim 1, wherein the dictionary entry has first and second parts of speech, further comprising the following steps: counting a first number of senses for the first part of speech and a second number of senses for the second part of speech; modifying at least one of the first and second numbers to increase a difference between the first and second numbers; and deriving part-of-speech probabilities for the first and second parts of speech based on the modified first and second numbers.
Claim 10
Dependent Claim
38 words
A method as recited in claim 1, further comprising the following steps: deriving part-of-speech probabilities for many dictionary entries in the dictionary; and saving, as part of the dictionary, the part-of-speech probabilities in correlation with the dictionary entries.
Claim 11
Dependent Claim
25 words
A computer-readable dictionary stored in a computer-readable memory which incorporates the part-of-speech probabilities created as a result of the method as recited in claim 9.
Claim 12
Dependent Claim
15 words
A computer programmed to perform the steps of the method as recited in claim 1.
Claim 13
Dependent Claim
27 words
A computer-implemented rule-based parser stored in a storage medium and executable on a process programmed to perform the steps of the method as recited in claim 1.
Claim 14
Dependent Claim
19 words
A computer-readable memory which directs a computer to perform the steps of the method as recited in claim 1.
Claim 15
Dependent Claim
110 words
In a natural language processing system for determining which part of speech a word is likely to be in a natural language text, the word being listed in a dictionary with multiple senses attributed thereto, the senses reflecting multiple different parts of speech that the word can assume in different contexts, a method comprising the following steps: counting a number of senses listed in the dictionary for each part of speech that the word can assume; and deriving a part-of-speech probability indicative of how likely the word is to be a particular part of speech based upon the number of senses counted in conjunction with the particular part of speech.
Claim 16
Dependent Claim
110 words
In a natural language processing system for determining which part of speech a word is likely to be in a natural language text, the word being listed in a dictionary with multiple senses attributed thereto, the senses reflecting multiple different parts of speech that the word can assume in different contexts, a method comprising the following steps: counting a number of senses listed in the dictionary for each part of speech that the word can assume; and deriving a part-of-speech probability indicative of how likely the word is to be a particular part of speech based upon the number of senses counted in conjunction with the particular part of speech.
Claim 17
Dependent Claim
48 words
A method as recited in claim 14, further comprising the following steps: counting a total number of senses listed in the dictionary; and computing the part-of-speech probability as a function of the number of senses counted for the particular part of speech and the total number of senses.
Claim 18
Dependent Claim
41 words
A method as recited in claim 14, further comprising the following steps: deriving a part-of-speech probability for each part of speech that the word can assume; and determining which of the parts of speech is most probable from the part-of-speech probabilities.
Claim 19
Dependent Claim
36 words
A method as recited in claim 14, further comprising the following steps: deriving part-of-speech probabilities for multiple words in the dictionary; and saving, as part of the dictionary, the part-of-speech probabilities in correlation with the words.
Claim 20
Dependent Claim
25 words
A computer-readable dictionary stored in a computer-readable memory which incorporates the part-of-speech probabilities created as a result of the method as recited in claim 17.
Claim 21
Dependent Claim
15 words
A computer programmed to perform the steps of the method as recited in claim 14.
Claim 22
Dependent Claim
27 words
A computer-implemented rule-based parser stored in a storage medium and executable on a process programmed to perform the steps of the method as recited in claim 14.
Claim 23
Dependent Claim
19 words
A computer-readable memory which directs a computer to perform the steps of the method as recited in claim 14.
Claim 24
Dependent Claim
104 words
In a natural language processing system for determining which part of speech a word is likely to be in a natural language text, the word being listed in a dictionary with multiple senses attributed thereto, the senses reflecting multiple different parts of speech that the word can assume in different contexts, a method comprising the following steps: counting a number of senses listed in the dictionary for each part of speech that the word can assume; and using the number of senses counted for each part of speech as an indication of how likely the word is to be a particular part of speech.
Claim 25
Dependent Claim
104 words
In a natural language processing system for determining which part of speech a word is likely to be in a natural language text, the word being listed in a dictionary with multiple senses attributed thereto, the senses reflecting multiple different parts of speech that the word can assume in different contexts, a method comprising the following steps: counting a number of senses listed in the dictionary for each part of speech that the word can assume; and using the number of senses counted for each part of speech as an indication of how likely the word is to be a particular part of speech.
Claim 26
Dependent Claim
29 words
A method as recite in claim 22, further comprising the step of initializing the parser to parse beginning with the part of speech having a highest number of senses.
Claim 27
Dependent Claim
15 words
A computer programmed to perform the steps of the method as recited in claim 22.
Claim 28
Dependent Claim
27 words
A computer-implemented rule-based parser stored in a storage medium and executable on a process programmed to perform the steps of the method as recited in claim 22.
Claim 29
Dependent Claim
19 words
A computer-readable memory which directs a computer to perform the steps of the method as recited in claim 22.
Claim 30
Dependent Claim
135 words
In a natural language processing system, a method comprising the following steps: generating, for lexemes listed as dictionary entries in a dictionary, inflected forms of the lexemes; for each lexeme, counting a number of senses for each part of speech attributable to the lexeme in the dictionary; for each inflected form, counting a number of senses for each part of speech attributable to the inflected form and adding, for each part of speech, the number of senses attributable to the inflected form and the number of senses attributable to the lexeme from which the inflected form is generated; and deriving, for each lexeme and inflected form, a part-of-speech probability indicative of how likely the lexeme or inflected form is to be a particular part of speech based upon the senses counted in said counting steps.
Claim 31
Dependent Claim
135 words
In a natural language processing system, a method comprising the following steps: generating, for lexemes listed as dictionary entries in a dictionary, inflected forms of the lexemes; for each lexeme, counting a number of senses for each part of speech attributable to the lexeme in the dictionary; for each inflected form, counting a number of senses for each part of speech attributable to the inflected form and adding, for each part of speech, the number of senses attributable to the inflected form and the number of senses attributable to the lexeme from which the inflected form is generated; and deriving, for each lexeme and inflected form, a part-of-speech probability indicative of how likely the lexeme or inflected form is to be a particular part of speech based upon the senses counted in said counting steps.
Claim 32
Dependent Claim
20 words
A method as recited in claim 27, further comprising the step of reading a computer-readable dictionary using a computational device.
Claim 33
Dependent Claim
61 words
A method as recited in claim 27, further comprising the following steps: reading a computer-readable dictionary using a computational device, the computer-readable dictionary having dictionary entries that are substantially lexemes; and expanding the computer-readable dictionary to include dictionary entries for inflected forms of the lexemes; and using the expanded dictionary as a source for counting the senses in said counting steps.
Claim 34
Dependent Claim
38 words
A method as recited in claim 27, further comprising the following steps: repeating the counting steps for every part of speech attributable to a lexeme or an inflected form; deriving multiple part-of-speech probabilities for every part of speech.
Claim 35
Dependent Claim
31 words
A method as recited in claim 30, further comprising the following steps: determining which part of speech is most probable; and entering the most probable part of speech into the parser.
Claim 36
Dependent Claim
25 words
A method as recited in claim 30, further comprising the step of saving the multiple part-of-speech probabilities in correlation with the lexeme or inflected form.
Claim 37
Dependent Claim
24 words
A computer-readable dictionary stored in a computer-readable memory having the part-of-speech probabilities created as a result of the method as recited in claim 32.
Claim 38
Dependent Claim
15 words
A computer programmed to perform the steps of the method as recited in claim 27.
Claim 39
Dependent Claim
28 words
A computer-implemented rule-based parser stored in a storage s medium and executable on a process programmed to perform the steps of the method as recited in claim 27.
Claim 40
Dependent Claim
19 words
A computer-readable memory which directs a computer to perform the steps of the method as recited in claim 27.
Claim 41
Independent Claim
64 words
A method for parsing a natural language text comprising the following steps: counting a number of senses listed in a dictionary that are associated with a part of speech; deriving a part-of-speech probability as a function of the number of senses associated with the part of speech; and choosing a part of speech for a word in the text based upon the part-of-speech probability.
Claim 42
Independent Claim
64 words
A method for parsing a natural language text comprising the following steps: counting a number of senses listed in a dictionary that are associated with a part of speech; deriving a part-of-speech probability as a function of the number of senses associated with the part of speech; and choosing a part of speech for a word in the text based upon the part-of-speech probability.
Claim 43
Dependent Claim
43 words
A method as recited in claim 37 further comprising the step of initially choosing, for the word, a part of speech with a highest part-of-speech probability as determined by the part of speech having a highest number of senses listed in the dictionary.
Claim 44
Dependent Claim
46 words
A method as recited in claim 37 further comprising the step of sequentially choosing, for the word, parts of speech in decreasing order of part-of-speech probabilities as determined by the number of senses given for each part of speech attributable to the word in the dictionary.
Claim 45
Dependent Claim
15 words
A computer programmed to perform the steps of the method as recited in claim 37.
Claim 46
Dependent Claim
27 words
A computer-implemented rule-based parser stored in a storage medium and executable on a process programmed to perform the steps of the method as recited in claim 37.
Claim 47
Dependent Claim
19 words
A computer-readable memory which directs a computer to perform the steps of the method as recited in claim 37.
Claim 48
Independent Claim
78 words
A method for parsing a natural language text to determine which part of speech a word assumes within the text comprising the following steps: counting a number of senses listed in a dictionary which are associated with a part of speech for the word; determining the part of speech with a highest number of senses listed in the dictionary; and choosing, for an initial parse, the part of speech for the word with the highest number of senses.
Claim 49
Independent Claim
78 words
A method for parsing a natural language text to determine which part of speech a word assumes within the text comprising the following steps: counting a number of senses listed in a dictionary which are associated with a part of speech for the word; determining the part of speech with a highest number of senses listed in the dictionary; and choosing, for an initial parse, the part of speech for the word with the highest number of senses.
Claim 50
Independent Claim
85 words
An apparatus for determining which part of speech a word is likely to be in a natural language text, comprising: a sense counter to scan words from a machine-readable dictionary and to count, for each word, a number of senses associated with each part of speech attributable to the word; and a computational unit to compute, for each word, part-of-speech probabilities indicative of how likely the word is to be particular parts of speech based upon the number of senses counted by the sense counter.
Claim 51
Independent Claim
85 words
An apparatus for determining which part of speech a word is likely to be in a natural language text, comprising: a sense counter to scan words from a machine-readable dictionary and to count, for each word, a number of senses associated with each part of speech attributable to the word; and a computational unit to compute, for each word, part-of-speech probabilities indicative of how likely the word is to be particular parts of speech based upon the number of senses counted by the sense counter.
Claim 52
Dependent Claim
55 words
An apparatus as recited in claim 44, wherein: the sense counter counts a total number of senses for all parts of speech attributable to the word; and the computational unit computes the part-of-speech probabilities as a function of the number of senses counted for each associated part of speech and the total number of senses.
Claim 53
Dependent Claim
106 words
An apparatus as recited in claim 44, wherein: the machine-readable dictionary contains words in lexeme form and inflected forms of the lexeme form; in an event that the word is an inflected form, the sense counter counts a number of senses associated with each part of speech attributable to the lexeme form of the word and a number of senses associated with each part of speech attributable to the inflected form of the word; and the computational unit adding the counts from the sense counter for both the lexeme and inflected forms for use in deriving the part-of-speech probabilities for the inflected form of the word.
Claim 54
Dependent Claim
81 words
An apparatus as recited in claim 44, wherein: the word has first and second parts of speech; the sense counter counts a first number of senses for the first part of speech and a second number of senses for the second part of speech; and the computational unit modifies at least one of the first and second numbers to increase a difference between the first and second numbers and computes the part-of-speech probabilities based on the modified first and second numbers.
Claim 55
Dependent Claim
13 words
A computerized rule-based parser processing system comprising the apparatus recited in claim 44.
References Cited (Backward Citations)
US4887212A
Cited
US4868750A
Cited
US5146405A
Cited
US5243520A
Cited
US5541836A
Cited
EP0598598A1
Cited
EP0598597A1
Cited
US5331556A
Cited
US5724594A
Cited
WO1996000436A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-03-01 | 2002-08-31 | 2003-03-02 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-03-01 | 2006-08-31 | 2007-03-02 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-03-01 | 2010-08-31 | 2011-03-02 | $7700.00 | Window Closed / Lapsed |