← Back to Patent Explorer
US5680628A Expired / Lapsed US ⏱️ 0.0 years remaining

Method and apparatus for automated search and retrieval process

Assignee: INSO DALLAS Corp
•
Filing: 1995-07-19
•
Granted: 1997-10-21
•
Expires: 2015-07-19
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract An apparatus and method for the identification of noun phrases in a stream of natural language text receives an input stream of text, identifies tokens within the stream of text, and processes the tokens to identify noun phrases. The system processes the tokens by annotating the tokens with tags identifying characteristics of the tokens and by contextually analyzing each token and its associated characteristics. During processing, the system can also disambiguate individual token characteristics and identify agreement between tokens.

Inventors

  • 👤 Alwin B. Carus
  • 👤 Michael Wiesner
  • 👤 Ateeque R. Haque

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-01 02:01
CPC Classifications
G; G06; G06F; G06F40/00; G06F40/20; G06F40/253

Claims Analysis

Total Claims: 43
Claim 1
Independent Claim 99 words
A data processing method for identifying noun phrases in a stream of words, the method comprising the steps of: extracting a sequence of tokens from the stream, storing the sequence of tokens in a first memory element, determining the most probable part-of-speech tag and grammatical features for each token, and identifying parts of a noun phrase by inspecting the part-of-speech tags and the grammatical features of a window of extracted tokens, the window of extracted tokens, including a selected candidate token and a first token preceding the selected candidate token and a second token following the selected candidate token.
Claim 2
Dependent Claim 99 words
A data processing method for identifying noun phrases in a stream of words, the method comprising the steps of: extracting a sequence of tokens from the stream, storing the sequence of tokens in a first memory element, determining the most probable part-of-speech tag and grammatical features for each token, and identifying parts of a noun phrase by inspecting the part-of-speech tags and the grammatical features of a window of extracted tokens, the window of extracted tokens, including a selected candidate token and a first token preceding the selected candidate token and a second token following the selected candidate token.
Claim 3
Dependent Claim 119 words
A method in accordance with claim 1 wherein the identifying step further comprises: identifying as a beginning of the noun phrase a candidate token having a part-of-speech tag functionally related to noun word forms, identifying as a middle of the noun phrase a candidate token when the candidate token has a part-of-speech tag functionally related to noun word forms and when the first token is an identified part of the noun phrase, and identifying as an end of the noun phrase a candidate token when the candidate token has a part-of-speech tag of noun and has a grammatical feature of lowercase and when the second token has a part-of-speech tag of noun and has a grammatical feature of uppercase.
Claim 4
Dependent Claim 39 words
A method in accordance with claim 2, wherein the identifying step further comprises identifying as an end of the noun phrase a candidate token having a part-of-speech tag selected from the group consisting of stop list nouns and adjectives.
Claim 5
Dependent Claim 36 words
A method in accordance with claim 2, wherein those tokens having a part-of-speech tag functionally related to noun word forms are selected from the group of part-of-speech tags consisting of: nouns, adjectives, ordinal numbers, cardinal numbers.
Claim 6
Dependent Claim 41 words
A method in accordance with claim 1, further comprising the step of initializing a language database prior to the extracting step, the language database being selected from the group consisting of: English, German, Spanish, Portuguese, French, Dutch, Italian, Swedish, and Japanese.
Claim 7
Dependent Claim 60 words
A method in accordance with claim 5 having a selected language database of English, further comprising the step of identifying as an end of a noun phrase a candidate token when the candidate token has a part-of-speech tag of singular adverbial noun and has a grammatical feature of uppercase and when the first token has a part-of-speech tag of noun.
Claim 8
Dependent Claim 52 words
A method in accordance with claim 5 having a selected language database of English, further comprising the step of identifying as an end of a noun phrase a candidate token when the candidate token has a part-of-speech tag of adjective and when the first token has a part-of-speech tag of non-possessive noun.
Claim 9
Dependent Claim 66 words
A method in accordance with claim 5 having a selected language database of German, further comprising the step of identifying as an end of a noun phrase a selected token when the selected token has a part-of-speech tag of adjective and when the first token has a part-of-speech tag of noun and when the second token has a part-of-speech tag functionally related to noun word forms.
Claim 10
Dependent Claim 26 words
A method in accordance with claim 8, wherein the token has a part-of-speech tag selected from the group consisting of: nouns, adjectives, ordinal numbers, cardinal numbers.
Claim 11
Dependent Claim 72 words
A method in accordance with claim 5 having a language database selected from the group consisting of French, Spanish, and Italian, the method further comprising the step of identifying the as an end of a noun phrase a candidate token when the candidate token has a part-of-speech tag of adjective and when the first token has a part-of-speech tag of noun and when the second token has a part-of-speech tag of noun.
Claim 12
Dependent Claim 96 words
A data processing method for identifying noun phrases in a stream of words, the method comprising the steps of: extracting a sequence of tokens from the stream, storing the sequence of tokens in a first memory element, determining the most probable part-of-speech tag and grammatical features for each token, identifying parts of a noun phrase by inspecting the part-of-speech tags of successive tokens, and iteratively checking agreement between a first identified part of the noun phrase and a second identified part of the noun phrase immediately following the first identified part in the stream of text.
Claim 13
Dependent Claim 96 words
A data processing method for identifying noun phrases in a stream of words, the method comprising the steps of: extracting a sequence of tokens from the stream, storing the sequence of tokens in a first memory element, determining the most probable part-of-speech tag and grammatical features for each token, identifying parts of a noun phrase by inspecting the part-of-speech tags of successive tokens, and iteratively checking agreement between a first identified part of the noun phrase and a second identified part of the noun phrase immediately following the first identified part in the stream of text.
Claim 14
Dependent Claim 57 words
A method in accordance with claim 11 wherein the iterative checking step further comprises: monitoring gender agreement between the first identified part of the noun phrase and the second identified part of the noun phrase, and monitoring number agreement between the first identified part of the noun phrase and the second identified part of the noun phrase.
Claim 15
Dependent Claim 35 words
A method in accordance with claim 12 wherein the successive checking step further comprises monitoring case agreement between the first identified part of the noun phrase and the second identified part of the noun phrase.
Claim 16
Dependent Claim 87 words
A data processing method for identifying noun phrases in a stream of words, the method comprising the steps of: extracting a sequence of tokens from the stream, storing the sequence of tokens in a first memory element, determining at least one part-of-speech tag for each token, disambiguating the at least one part-of-speech tag of an ambiguous token by inspecting the part-of-speech tags of a window of sequential tokens containing the ambiguous token, and identifying parts of a noun phrase by inspecting the part-of-speech tags of successive tokens.
Claim 17
Dependent Claim 87 words
A data processing method for identifying noun phrases in a stream of words, the method comprising the steps of: extracting a sequence of tokens from the stream, storing the sequence of tokens in a first memory element, determining at least one part-of-speech tag for each token, disambiguating the at least one part-of-speech tag of an ambiguous token by inspecting the part-of-speech tags of a window of sequential tokens containing the ambiguous token, and identifying parts of a noun phrase by inspecting the part-of-speech tags of successive tokens.
Claim 18
Dependent Claim 51 words
A method in accordance with claim 14, wherein the determining step further comprises locating at least one lexical expression representative of an extracted token in a first addressable table, the first addressable table containing a list of lexical expressions with each lexical expression being associated with at least one part-of-speech tag.
Claim 19
Dependent Claim 62 words
A method in accordance with claim 15, wherein the determining step further comprises: forming a target suffix from the last three characters of the extracted token, and locating a stored suffix matching the target suffix in a second addressable table, the second addressable table containing a list of stored suffixes with each stored suffix being associated with at least one part-of-speech tag.
Claim 20
Dependent Claim 38 words
A method in accordance with claim 16, wherein the determining step further comprises associating a part-of-speech tag of noun with an extracted token not located in the first addressable table and not located in the second addressable table.
Claim 21
Dependent Claim 50 words
A method in accordance with claim 14, further comprising the step of forming a window of sequential tokens, including the ambiguous token and a token immediately following the ambiguous token in the stream of words and at least two tokens immediately preceding the ambiguous tokens in the stream of words.
Claim 22
Dependent Claim 55 words
A method in accordance with claim 14, wherein the disambiguating step further comprises: identifying a primary part-of-speech tag of the ambiguous token, identifying a secondary part-of-speech tag of the ambiguous token, and promoting the secondary part-of-speech tag to the primary part-of-speech tag as a function of the part-of-speech tags of the window of sequential tokens.
Claim 23
Dependent Claim 50 words
A method in accordance with claim 19, wherein the promoting step further comprises promoting the secondary part-of-speech tag to the primary part-of-speech tag as a function of the identified primary part-of-speech tag of the ambiguous token and as a function of the identified secondary part-of-speech tag of the ambiguous token.
Claim 24
Dependent Claim 61 words
A method in accordance with claim 14, wherein the disambiguating step further comprises generating a primary part-of-speech tag by operating upon the part-of-speech tags of the window of sequential tokens with a predetermined rule, and replacing the at least one part-of-speech tag of the ambiguous tokens with the generated primary part-of-speech tag, such that the primary part-of-speech tag is contextually accurate.
Claim 25
Dependent Claim 17 words
A method in accordance with claim 14, further comprising the step of truncating the identified noun phrase.
Claim 26
Independent Claim 142 words
An apparatus for identifying noun phrases contained in a stream of words, the apparatus comprising: tokenizing means for extracting a sequence of digital signals representative of a sequence of tokens contained in the stream, first addressable memory means containing a list of lexical expressions with each lexical expression being associated with a part-of-speech tag and grammatical features, data processing means coupled with the tokenizing means and with the first addressable memory means, the data processing means, including: means for determining a part-of-speech tag and grammatical features for each token by identifying in the first addressable memory means at least one lexical expression representative of each token, and means for identifying parts of a noun phrase by inspecting the part-of-speech tags of a first window of tokens, and means for generating an output signal representative of the tokens forming the identified noun phrase.
Claim 27
Independent Claim 142 words
An apparatus for identifying noun phrases contained in a stream of words, the apparatus comprising: tokenizing means for extracting a sequence of digital signals representative of a sequence of tokens contained in the stream, first addressable memory means containing a list of lexical expressions with each lexical expression being associated with a part-of-speech tag and grammatical features, data processing means coupled with the tokenizing means and with the first addressable memory means, the data processing means, including: means for determining a part-of-speech tag and grammatical features for each token by identifying in the first addressable memory means at least one lexical expression representative of each token, and means for identifying parts of a noun phrase by inspecting the part-of-speech tags of a first window of tokens, and means for generating an output signal representative of the tokens forming the identified noun phrase.
Claim 28
Dependent Claim 121 words
An apparatus according to claim 23, wherein the means for identifying parts of a noun phrase further comprises: means for identifying as a beginning of the noun phrase a token having a part-of-speech tag functionally related to noun word forms, means for identifying as a middle of the noun phrase a token having a part-of-speech tag functionally related to noun word forms, and having immediately followed a token identified as part of the noun phrase, and means for identifying as an end of the noun phrase a token having a part-of-speech tag of noun and having a grammatical feature of lowercase, and having immediately preceded an extracted tokens having a part-of-speech tag of noun and having a grammatical feature of uppercase.
Claim 29
Dependent Claim 47 words
An apparatus according to claim 23, wherein the data processing means further comprises means for iteratively checking agreement between a first identified part of the noun phrase and a second identified part of the noun phrase immediately following the first identified part in the stream of text.
Claim 30
Dependent Claim 62 words
An apparatus according to claim 25, wherein the means for iteratively checking agreement further comprises: means for monitoring gender agreement between the first identified part of the noun phrase and the second identified part of the noun phrase, and means for monitoring number agreement between the first identified part of the noun phrase and the second identified part of the noun phrase.
Claim 31
Dependent Claim 38 words
An apparatus according to claim 26, wherein the means for iteratively checking agreement further comprises means for monitoring case agreement between the first identified part of the noun phrase and the second identified part of the noun phrase.
Claim 32
Dependent Claim 82 words
An apparatus according to claim 23 further comprising a second addressable memory means coupled with the data processing means, the second addressable memory means containing a list of stored suffixes with each stored suffix being associated with at least one part-of-speech tag, and wherein the data processing means further comprises a means for determining a part-of-speech tag for each token by identifying in the second addressable memory means at least one stored suffix representative of the last three characters of each token.
Claim 33
Dependent Claim 24 words
An apparatus according to claim 28 wherein the data processing means further comprises means for assigning a part-of-speech tag of noun to each token.
Claim 34
Dependent Claim 40 words
An apparatus according to claim 23, wherein the data processing means further comprises a means for disambiguating the part-of-speech tag of an ambiguous token by inspecting the part-of-speech tags of a second window of sequential token containing the ambiguous token.
Claim 35
Dependent Claim 56 words
An apparatus according to claim 30, further comprising a means for forming the second window of words such that the second window of words includes the ambiguous token and a token immediately following the ambiguous token in the stream of words and at least two tokens immediately preceding the ambiguous token in the stream of words.
Claim 36
Dependent Claim 66 words
An apparatus according to claim 30, wherein the disambiguating means further comprises: means for identifying a primary part-of-speech tag of the ambiguous token, means for identifying at least one secondary part-of-speech tag of the ambiguous token, and means for promoting the at least one secondary part-of-speech tag to the primary part-of-speech tag as a function of the part-of-speech tags of the second window of sequential token.
Claim 37
Dependent Claim 58 words
An apparatus according to claim 32, wherein the promoting means further comprises a means for promoting the at least one second part-of-speech tag to the primary part-of-speech tag as a function of the identified primary part-of-speech tag of the ambiguous token and as a function of the identified at least one secondary part-of-speech tag of the ambiguous token.
Claim 38
Dependent Claim 65 words
An apparatus according to claim 30, wherein the disambiguating means further comprises: means for generating a primary part-of-speech tag by operating upon the part-of-speech tags of the second window of sequential tokens with a predetermined rule, and means for replacing the at least one part-of-speech tag of the ambiguous token with the generated primary part-of-speech tag, such that the primary part-of-speech tag is contextually accurate.
Claim 39
Dependent Claim 21 words
An apparatus according to claim 23, wherein the data processing means further comprises a means for rameating the identified noun phrase.
Claim 40
Dependent Claim 29 words
A method in accordance with claim 14, further comprising the step of forming a window of sequential tokens, including the ambiguous token and excluding sequential tokens having ignore tags.
Claim 41
Dependent Claim 27 words
A method in accordance with claim 36, wherein the ignore tags are selected from the group of part-of-speech tags consisting of: adverbs, qualifying adverbs, and negative adverbs.
Claim 42
Dependent Claim 35 words
An apparatus according to claim 30, further comprising a means for forming the second window of words such that the second window of words includes the ambiguous token and excludes sequential tokens having ignore tags.
Claim 43
Dependent Claim 26 words
An apparatus according to claim 38, wherein the ignore tags are selected from the group of part-of-speech tags consisting of: adverbs, qualifying adverbs, and negative adverbs.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2000-10-20 2001-04-21 2001-10-21 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2004-10-20 2005-04-21 2005-10-21 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2008-10-20 2009-04-21 2009-10-21 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag