← Back to Patent Explorer
US5761631A Expired / Lapsed US ⏱️ 0.0 years remaining

Parsing method and system for natural language processing

Assignee: International Business Machines Corp
•
Filing: 1995-07-12
•
Granted: 1998-06-02
•
Expires: 2015-07-12
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract The present invention provides a method and system to improve the accuracy of natural language processing systems by enabling them to acquire a parsing output that is accurate to a degree for any type of sentence. The feature of the present invention is that a sentence (a non-grammatical, ill-formed sentence) that cannot be parsed when using a conventional parsing process, which relies on grammatical knowledge, is re-analyzed by using the parsing results for an identical word row in a sentence (a well-formed sentence) in the same context that could be parsed. More specifically, the processing below is performed: (1) a well-formed sentence in a context that includes a word row that is identical to a word row in an ill-formed sentence is searched for, and a dependency structure for that word row is extracted from the parsing results for the well-formed sentence; and (2) the dependency structures of the phrases obtained in (1) are linked by referring to linking information for the well-formed sentence and a grammar, and the dependency structure of the entire sentence is introduced.

Inventors

  • 👤 Tetsuya Nasukawa

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-05 03:58
CPC Classifications
G; G06; G06F; G06F40/00; G06F40/20; G06F40/268; G06F40/205; G06F40/211; G06F40/226

Claims Analysis

Total Claims: 30
Claim 1
Independent Claim 153 words
A computer implemented natural language analysis method, comprising the steps of: (a) inputting a plurality of sentences described in natural language; (b) analyzing said plurality of sentences into morphemes; (c) parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) when those results that are obtained by said parsing are well-formed sentences, storing said parsing analysis results as well-formed context information; (e) when those results that are obtained by said parsing are ill-formed sentences, storing said parsing analysis results as ill-formed sentence information; (f) upon completion of said parsing of said plurality of sentences, retrieving, from said well-formed context information, partial parsing information for sentences having parsing analysis results that were stored as said ill-formed sentence information; and (g) parsing once more said sentences having parsing analysis results that were stored as said ill-formed sentence information by using said information retrieved from said well-formed context information.
Claim 2
Dependent Claim 153 words
A computer implemented natural language analysis method, comprising the steps of: (a) inputting a plurality of sentences described in natural language; (b) analyzing said plurality of sentences into morphemes; (c) parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) when those results that are obtained by said parsing are well-formed sentences, storing said parsing analysis results as well-formed context information; (e) when those results that are obtained by said parsing are ill-formed sentences, storing said parsing analysis results as ill-formed sentence information; (f) upon completion of said parsing of said plurality of sentences, retrieving, from said well-formed context information, partial parsing information for sentences having parsing analysis results that were stored as said ill-formed sentence information; and (g) parsing once more said sentences having parsing analysis results that were stored as said ill-formed sentence information by using said information retrieved from said well-formed context information.
Claim 3
Dependent Claim 29 words
A natural language analysis method according to claim 1, wherein said well-formed context information that is stored includes context information for each sentence and context information for each word.
Claim 4
Dependent Claim 30 words
A natural language analysis method according to claim 2, wherein said context information for each sentence includes a sentence number, input character rows, and information about a sentence parsing result.
Claim 5
Dependent Claim 51 words
A natural language analysis method according to claim 2, wherein said context information that is stored for each word includes a character row of a surface structure, a word by which one word is modified and a connection relationship, and a word that said one word modifies and a connection relationship.
Claim 6
Dependent Claim 33 words
A natural language analysis method according to claim 1, wherein said ill-formed sentence information that is stored includes morphological analysis results and context information for each sentence, and context information for each word.
Claim 7
Dependent Claim 164 words
A computer implemented natural language analysis system, comprising: (a) means for inputting a plurality of sentences described in natural language; (b) means for analyzing said plurality of sentences into morphemes; (c) means for parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) means for, when those results that are obtained by said parsing are well-formed sentences, storing said parsing analysis results as well-formed context information; (e) means for, when those results that are obtained by said parsing are ill-formed sentences, storing said parsing analysis results as ill-formed sentence information; (f) means for, upon completion of said parsing of said plurality of sentences, retrieving, from said well-formed context information, partial parsing information for sentences having parsing analysis results that were stored as said ill-formed sentence information; and (g) means for parsing once more said sentences having parsing analysis results that were stored as said ill-formed sentence information by using said information retrieved from said well-formed context information.
Claim 8
Dependent Claim 164 words
A computer implemented natural language analysis system, comprising: (a) means for inputting a plurality of sentences described in natural language; (b) means for analyzing said plurality of sentences into morphemes; (c) means for parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) means for, when those results that are obtained by said parsing are well-formed sentences, storing said parsing analysis results as well-formed context information; (e) means for, when those results that are obtained by said parsing are ill-formed sentences, storing said parsing analysis results as ill-formed sentence information; (f) means for, upon completion of said parsing of said plurality of sentences, retrieving, from said well-formed context information, partial parsing information for sentences having parsing analysis results that were stored as said ill-formed sentence information; and (g) means for parsing once more said sentences having parsing analysis results that were stored as said ill-formed sentence information by using said information retrieved from said well-formed context information.
Claim 9
Dependent Claim 29 words
A natural language analysis system according to claim 6, wherein said well-formed context information that is stored includes context information for each sentence and context information for each word.
Claim 10
Dependent Claim 33 words
A natural language analysis system according to claim 6, wherein said ill-formed sentence information that is stored includes morphological analysis results and context information for each sentence, and context information for each word.
Claim 11
Dependent Claim 152 words
A computer implemented natural language analysis method, comprising the steps of: (a) inputting a plurality of sentences described in natural language; (b) analyzing said plurality of sentences into morphemes; (c) parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) when the results of said parsing are well-formed sentences, storing, as well-formed context information, parsing information that includes information about word connections; (e) when the results of said parsing are ill-formed sentences, storing, as ill-formed sentence information, parsing information that includes information about word rows; (f) upon the completion of said parsing of said plurality of sentences, retrieving, from said well-formed context information, information about a word row connection that is the same as each sentence having parsing information that was stored as said ill-formed sentence information; and (g) assembling phrase structure trees based on said information that is retrieved from said well-formed context information.
Claim 12
Dependent Claim 152 words
A computer implemented natural language analysis method, comprising the steps of: (a) inputting a plurality of sentences described in natural language; (b) analyzing said plurality of sentences into morphemes; (c) parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) when the results of said parsing are well-formed sentences, storing, as well-formed context information, parsing information that includes information about word connections; (e) when the results of said parsing are ill-formed sentences, storing, as ill-formed sentence information, parsing information that includes information about word rows; (f) upon the completion of said parsing of said plurality of sentences, retrieving, from said well-formed context information, information about a word row connection that is the same as each sentence having parsing information that was stored as said ill-formed sentence information; and (g) assembling phrase structure trees based on said information that is retrieved from said well-formed context information.
Claim 13
Dependent Claim 211 words
A computer implemented natural language analysis method, comprising the steps of: (a) inputting a plurality of sentences described in natural language; (b) analyzing said plurality of sentences into morphemes; (c) parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) when said results of said parsing are well-formed sentences, storing, as well-formed context information, parsing information that includes information about word connections; (e) when the results of said parsing are ill-formed sentences, storing, as ill-formed sentence information, parsing information that includes information about word rows; (f) upon completion of said parsing of said plurality of sentences, retrieving, from said well-formed context information, information about a word row connection that is the same as each sentence having parsing information that was stored as said ill-formed sentence information; (g) determining whether or not all words in a sentence having parsing information that was stored as said ill-formed sentence information are dominated by information that is retrieved from said well-formed context information, and if there are words that are not so dominated, extracting information for said words from said ill-formed sentence information; and (h) connecting phrase structure trees by applying said context information and grammar information to information that is obtained at said steps (f) and (g).
Claim 14
Dependent Claim 211 words
A computer implemented natural language analysis method, comprising the steps of: (a) inputting a plurality of sentences described in natural language; (b) analyzing said plurality of sentences into morphemes; (c) parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) when said results of said parsing are well-formed sentences, storing, as well-formed context information, parsing information that includes information about word connections; (e) when the results of said parsing are ill-formed sentences, storing, as ill-formed sentence information, parsing information that includes information about word rows; (f) upon completion of said parsing of said plurality of sentences, retrieving, from said well-formed context information, information about a word row connection that is the same as each sentence having parsing information that was stored as said ill-formed sentence information; (g) determining whether or not all words in a sentence having parsing information that was stored as said ill-formed sentence information are dominated by information that is retrieved from said well-formed context information, and if there are words that are not so dominated, extracting information for said words from said ill-formed sentence information; and (h) connecting phrase structure trees by applying said context information and grammar information to information that is obtained at said steps (f) and (g).
Claim 15
Dependent Claim 49 words
A natural language processing method according to claim 10, further comprising a step of determining whether or not said phrase structure trees are united for each sentence, and if not, selecting a less strict connection rule that is included in said grammar information to reconnect said phrase structure trees.
Claim 16
Dependent Claim 160 words
A computer implemented natural language analysis system, comprising: (a) means for inputting a plurality of sentences described in natural language; (b) means for analyzing said plurality of sentences into morphemes; (c) means for parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) means for, when the results of said parsing are well-formed sentences, storing, as well-formed context information, parsing information that includes information about word connections; (e) means for, when the results of parsing are ill-formed sentences, storing, as ill-formed sentence information, parsing information that includes information about word rows; (f) means for, upon completion of said parsing of said plurality of sentences, retrieving, from said well-formed context information, information about a word row connection that is the same as each sentence having parsing information that was stored as said ill-formed sentence information; (g) means for assembling phrase structure trees based on said information that is retrieved from said well-formed context information.
Claim 17
Dependent Claim 160 words
A computer implemented natural language analysis system, comprising: (a) means for inputting a plurality of sentences described in natural language; (b) means for analyzing said plurality of sentences into morphemes; (c) means for parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) means for, when the results of said parsing are well-formed sentences, storing, as well-formed context information, parsing information that includes information about word connections; (e) means for, when the results of parsing are ill-formed sentences, storing, as ill-formed sentence information, parsing information that includes information about word rows; (f) means for, upon completion of said parsing of said plurality of sentences, retrieving, from said well-formed context information, information about a word row connection that is the same as each sentence having parsing information that was stored as said ill-formed sentence information; (g) means for assembling phrase structure trees based on said information that is retrieved from said well-formed context information.
Claim 18
Dependent Claim 241 words
A computer implemented natural language analysis system, comprising: (a) means for inputting a plurality of sentences described in natural language; (b) means for analyzing said plurality of sentences into morphemes; (c) means for parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) means for, when said results of said parsing are well-formed sentences, storing, as well-formed context information, parsing information that includes information about word connections; (e) means for, when the results of said parsing are ill-formed sentences, storing, as ill-formed sentence information, parsing information that includes information about word rows; (f) means for, upon completion of said parsing of said plurality of sentences, retrieving, from said well-formed context information, information about a word row connection that is the same as each sentence having parsing information that was stored as said ill-formed sentence information; (g) means for determining whether or not all words in a sentence having parsing information that was stored as said ill-formed sentence information are dominated by information that is retrieved from said well-formed context information, and if there are words that are not so dominated, extracting information for said words from said ill-formed sentence information; (h) means for storing grammar information includes word connection rule; and (i) means for connecting phrase structure trees by applying said context information and grammar information stored in said storing means to information that is obtained from said retrieving means and said determining means.
Claim 19
Dependent Claim 241 words
A computer implemented natural language analysis system, comprising: (a) means for inputting a plurality of sentences described in natural language; (b) means for analyzing said plurality of sentences into morphemes; (c) means for parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) means for, when said results of said parsing are well-formed sentences, storing, as well-formed context information, parsing information that includes information about word connections; (e) means for, when the results of said parsing are ill-formed sentences, storing, as ill-formed sentence information, parsing information that includes information about word rows; (f) means for, upon completion of said parsing of said plurality of sentences, retrieving, from said well-formed context information, information about a word row connection that is the same as each sentence having parsing information that was stored as said ill-formed sentence information; (g) means for determining whether or not all words in a sentence having parsing information that was stored as said ill-formed sentence information are dominated by information that is retrieved from said well-formed context information, and if there are words that are not so dominated, extracting information for said words from said ill-formed sentence information; (h) means for storing grammar information includes word connection rule; and (i) means for connecting phrase structure trees by applying said context information and grammar information stored in said storing means to information that is obtained from said retrieving means and said determining means.
Claim 20
Dependent Claim 72 words
A natural language processing system according to claim 13, further comprising means for determining whether or not said phrase structure trees are united for each sentence, and if not, selecting a less strict connection rule that is included in said grammar information to reconnect said phrase structure trees, wherein said means (h) possesses a plurality of connection rules that consist of a more strict connection rule and a less strict connection rule.
Claim 21
Dependent Claim 148 words
A computer implemented natural language analysis method, comprising the steps of: (a) inputting a plurality of sentences described in natural language; (b) analyzing said plurality of sentences into morphemes; (c) parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) when the results of said parsing present a single analysis choice, storing said parsing result as context information; (e) when the results of said parsing present a plurality of analysis choices, storing said parsing result as sentence information for multiple analysis choices; (f) upon completion of said parsing of said plurality of sentences, comparing said sentence information for multiple analysis choices with information from among said well-formed context information, and determining an evaluation value for said analysis choice; and (g) selecting, as said sentence parsing information from among said multiple analysis choices, an analysis choice that has a maximum evaluation value.
Claim 22
Dependent Claim 148 words
A computer implemented natural language analysis method, comprising the steps of: (a) inputting a plurality of sentences described in natural language; (b) analyzing said plurality of sentences into morphemes; (c) parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) when the results of said parsing present a single analysis choice, storing said parsing result as context information; (e) when the results of said parsing present a plurality of analysis choices, storing said parsing result as sentence information for multiple analysis choices; (f) upon completion of said parsing of said plurality of sentences, comparing said sentence information for multiple analysis choices with information from among said well-formed context information, and determining an evaluation value for said analysis choice; and (g) selecting, as said sentence parsing information from among said multiple analysis choices, an analysis choice that has a maximum evaluation value.
Claim 23
Dependent Claim 53 words
A natural language processing method according to claim 15, wherein said step of determining said evaluation value includes a process for calculating the ratio of the presence in a context of a word that has the same linking relationship as an identical word to a total amount of said plurality of sentences inputted.
Claim 24
Dependent Claim 49 words
A natural language processing method according to claim 15, wherein said step of determining said evaluation value includes a process for calculating the ratio of the presence in a context of words having the same parts of speech to a total amount of instances of said context of words.
Claim 25
Dependent Claim 32 words
A natural language processing method according to claim 15, wherein said step of determining said evaluation value includes a process for calculating a correspondence of a sentence type with an adjacent sentence.
Claim 26
Dependent Claim 159 words
A computer implemented natural language analysis system, comprising: (a) means for inputting a plurality of sentences described in natural language; (b) means for analyzing said plurality of sentences into morphemes; (c) means for parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) means for, when the results of said parsing present a single analysis choice, storing said parsing result as context information; (e) means for, when the results of said parsing present a plurality of analysis choices, storing said parsing result as sentence information for multiple analysis choices; (f) means for, upon completion of said parsing of said plurality of sentences, comparing said sentence information for multiple analysis choices with information from among said well-formed context information, and determining an evaluation value for said analysis choice; and (g) means for selecting, as said sentence parsing information from among said multiple analysis choices, an analysis choice that has a maximum evaluation value.
Claim 27
Dependent Claim 159 words
A computer implemented natural language analysis system, comprising: (a) means for inputting a plurality of sentences described in natural language; (b) means for analyzing said plurality of sentences into morphemes; (c) means for parsing said plurality of sentences based on those results that are obtained by said morphological analysis; (d) means for, when the results of said parsing present a single analysis choice, storing said parsing result as context information; (e) means for, when the results of said parsing present a plurality of analysis choices, storing said parsing result as sentence information for multiple analysis choices; (f) means for, upon completion of said parsing of said plurality of sentences, comparing said sentence information for multiple analysis choices with information from among said well-formed context information, and determining an evaluation value for said analysis choice; and (g) means for selecting, as said sentence parsing information from among said multiple analysis choices, an analysis choice that has a maximum evaluation value.
Claim 28
Dependent Claim 53 words
A natural language processing system according to claim 19, wherein said means for determining said evaluation value includes a process for calculating the ratio of the presence in a context of a word that has the same linking relationship as an identical word to a total amount of said plurality of sentences inputted.
Claim 29
Dependent Claim 49 words
A natural language processing system according to claim 19, wherein said means for determining said evaluation value includes a process for calculating the ratio of the presence in a context of words having the same parts of speech to a total amount of instances of said context of words.
Claim 30
Dependent Claim 32 words
A natural language processing system according to claim 19, wherein said means for determining said evaluation value includes a process for calculating a correspondence of a sentence type with an adjacent sentence.

References Cited (Backward Citations)

US5225981A Cited
US5136503A Cited
US5128865A Cited
US5311429A Cited
US5424947A Cited
US5297039A Cited
US5396419A Cited
US5495413A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2001-06-01 2001-12-01 2002-06-02 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2005-06-01 2005-12-01 2006-06-02 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2009-06-01 2009-12-01 2010-06-02 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag