US5819260A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Phrase recognition method and apparatus
Assignee: GAYLORD-TOUSANA BRAIN BRAIN
•
Filing: 1996-01-22
•
Granted: 1998-10-06
•
Expires: 2016-01-22
Abstract
Abstract A phrase recognition method breaks streams of text into text "chunks" and selects certain chunks as "phrases" useful for automated full text searching. The phrase recognition method uses a carefully assembled list of partition elements to partition the text into the chunks, and selects phrases from the chunks according to a small number of frequency based definitions. The method can also incorporate additional processes such as categorization of proper names to enhance phrase recognition. The method selects phrases quickly and efficiently, referring simply to the phrases themselves and the frequency with which they are encountered, rather than relying on complex, time-consuming, resource-consuming grammatical analysis, or on collocation schemes of limited applicability, or on heuristical text analysis of limited reliability or utility.
Inventors
- 👤 Xin Allan Lu
- 👤 David James Miller
- 👤 John Richard Wassum
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-25 17:10
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/30; Y; Y10; Y10S; Y10S707/00; Y10S707/912; Y10S707/917; Y10S707/964; Y10S707/966; Y10S707/967; Y10S707/968; Y10S707/99931; Y10S707/99933; Y10S707/99934; Y10S707/99935
Claims Analysis
Total Claims: 38
Claim 1
Independent Claim
100 words
A computer-implemented method of processing a stream of document text to form a list of phrases that are indicative of conceptual content of the document, the phrases being used as index terms and search query terms in full text document searching performed after the phrase list is formed, the method comprising: partitioning the document text into plural chunks of document text, each chunk being separated by at least one partition entity from a partition list; and selecting certain chunks as the phrases of the phrase list, based on frequencies of occurrence of the chunks within the stream of document text.
Claim 2
Dependent Claim
100 words
A computer-implemented method of processing a stream of document text to form a list of phrases that are indicative of conceptual content of the document, the phrases being used as index terms and search query terms in full text document searching performed after the phrase list is formed, the method comprising: partitioning the document text into plural chunks of document text, each chunk being separated by at least one partition entity from a partition list; and selecting certain chunks as the phrases of the phrase list, based on frequencies of occurrence of the chunks within the stream of document text.
Claim 3
Dependent Claim
92 words
The method of claim 1, wherein the partitioning step includes: scanning a portion of the document text stream; comparing the scanned portion of the document text stream to partition entities in the partition list; substituting a partition tag for portions of the document text stream which match a partition entity; generating a text chunk list; scanning the text chunk list to determine a frequency of each text chunk in the text chunk list; and revising the text chunk list to include the respective frequencies of occurrence in association with the text chunks.
Claim 4
Dependent Claim
46 words
The method of claim 1, wherein the selecting step includes: selecting the certain chunks as the phrases of the phrase list based only on the frequencies of occurrence of the chunks within the stream of document text and on a quantity of words within the chunks.
Claim 5
Dependent Claim
141 words
The method of claim 1, wherein: a) the partitioning step includes: a1) scanning a portion of the document text stream; a2) comparing the scanned portion of the document text stream to partition entities in the partition list; a3) substituting a partition tag for portions of the document text stream which match a partition entity; a4) generating a text chunk list; a5) scanning the text chunk list to determine a frequency of each text chunk in the text chunk list; and a6) revising the text chunk list to include the respective frequencies of occurrence in association with the text chunks; and b) the selecting step includes selecting the certain chunks as the phrases of the phrase list based only on the frequencies of occurrence of the chunks within the stream of document text and on a quantity of words within the chunks.
Claim 6
Dependent Claim
32 words
The method of claim 1, wherein the selecting step includes: excluding a chunk from being determined as a phrase if the chunk is a single word beginning with a lower case letter.
Claim 7
Dependent Claim
43 words
The method of claim 1, wherein the selecting step includes: determining a chunk as being a phrase if the chunk includes a plurality of words each constituting lower case letters only if the chunk occurs at least twice in the document text stream.
Claim 8
Dependent Claim
37 words
The method of claim 1, wherein the selecting step includes: determining a chunk as being a proper name if the chunk includes a plurality of words each having at least a first letter which is upper case.
Claim 9
Dependent Claim
16 words
The method of claim 1, wherein the selecting step includes: mapping a sub-phrase to a phrase.
Claim 10
Dependent Claim
20 words
The method of claim 1, wherein the selecting step includes: mapping single upper case words to their respective proper names.
Claim 11
Dependent Claim
39 words
The method of claim 1, wherein the selecting step includes: detecting presence of acronyms; incrementing a count of a proper name corresponding to the respective detected acronyms; and copying the proper name and the acronym to an acronym list.
Claim 12
Dependent Claim
25 words
The method of claim 1, wherein the selecting step includes: combining a phrase list of lower case words with a phrase list of proper names.
Claim 13
Dependent Claim
23 words
The method of claim 1, further comprising: reducing the phrase list by consolidating phrases in the phrase list by using a synonym thesaurus.
Claim 14
Dependent Claim
27 words
The method of claim 1, further comprising: adding phrases to the phrase list by combining phrases which are separated in the document text stream only by prepositions.
Claim 15
Dependent Claim
26 words
The method of claim 1, further comprising: trimming the phrase list by eliminating phrases which occur in fewer than a threshold number of document text streams.
Claim 16
Dependent Claim
22 words
The method of claim 1, further comprising: categorizing proper names in the proper name list into groups based on corresponding group lists.
Claim 17
Independent Claim
103 words
An apparatus of processing a stream of document text to form a list of phrases that are indicative of conceptual content of the document, the phrases being used as index terms and search query terms in full text document searching performed after the phrase list is formed, the apparatus comprising: means for partitioning the document text into plural chunks of document text, each chunk being separated by at least one partition entity from a partition list; and means for selecting certain chunks as the phrases of the phrase list, based on frequencies of occurrence of the chunks within the stream of document text.
Claim 18
Independent Claim
103 words
An apparatus of processing a stream of document text to form a list of phrases that are indicative of conceptual content of the document, the phrases being used as index terms and search query terms in full text document searching performed after the phrase list is formed, the apparatus comprising: means for partitioning the document text into plural chunks of document text, each chunk being separated by at least one partition entity from a partition list; and means for selecting certain chunks as the phrases of the phrase list, based on frequencies of occurrence of the chunks within the stream of document text.
Claim 19
Dependent Claim
104 words
The apparatus of claim 16, wherein the partitioning means includes: means for scanning a portion of the document text stream; means for comparing the scanned portion of the document text stream to partition entities in the partition list; means for substituting a partition tag for portions of the document text stream which match a partition entity; means for generating a text chunk list; means for scanning the text chunk list to determine a frequency of each text chunk in the text chunk list; and means for revising the text chunk list to include the respective frequencies of occurrence in association with the text chunks.
Claim 20
Dependent Claim
48 words
The apparatus of claim 16, wherein the selecting means includes: means for selecting the certain chunks as the phrases of the phrase list based only on the frequencies of occurrence of the chunks within the stream of document text and on a quantity of words within the chunks.
Claim 21
Dependent Claim
155 words
The apparatus of claim 16, wherein: a) the partitioning means includes: a1) means for scanning a portion of the document text stream; a2) means for comparing the scanned portion of the document text stream to partition entities in the partition list; a3) means for substituting a partition tag for portions of the document text stream which match a partition entity; a4) means for generating a text chunk list; a5) means for scanning the text chunk list to determine a frequency of each text chunk in the text chunk list; and a6) means for revising the text chunk list to include the respective frequencies of occurrence in association with the text chunks; and b) the selecting means includes means for selecting the certain chunks as the phrases of the phrase list based only on the frequencies of occurrence of the chunks within the stream of document text and on a quantity of words within the chunks.
Claim 22
Dependent Claim
114 words
A computer-readable memory which, when used in conjunction with a computer, can carry out a phrase recognition method to form a phrase list containing phrases that are indicative of conceptual content of a document, the phrases being used as index terms and search query terms in full-text document searching performed after the phrase list is formed, the computer-readable memory comprising: computer-readable code for partitioning document text into plural chunks of document text, each chunk being separated by at least one partition entity from a partition list; and computer-readable code for selecting certain chunks as the phrases of the phrase list based on frequencies of occurrence of the chunks within the stream of document text.
Claim 23
Dependent Claim
114 words
A computer-readable memory which, when used in conjunction with a computer, can carry out a phrase recognition method to form a phrase list containing phrases that are indicative of conceptual content of a document, the phrases being used as index terms and search query terms in full-text document searching performed after the phrase list is formed, the computer-readable memory comprising: computer-readable code for partitioning document text into plural chunks of document text, each chunk being separated by at least one partition entity from a partition list; and computer-readable code for selecting certain chunks as the phrases of the phrase list based on frequencies of occurrence of the chunks within the stream of document text.
Claim 24
Dependent Claim
113 words
The computer-readable memory of claim 20, wherein the computer-readable code for partitioning includes: computer-readable code for scanning a portion of the document text stream; computer-readable code for comparing the scanned portion of the document text stream to partition entities in the partition list; computer-readable code for substituting a partition tag for portions of the document text stream which match a partition entity; computer-readable code for generating a text chunk list; computer-readable code for scanning the text chunk list to determine a frequency of each text chunk in the text chunk list; and computer-readable code for revising the text chunk list to include the respective frequencies of occurrence in association with the text chunks.
Claim 25
Dependent Claim
52 words
The computer-readable memory of claim 20, wherein the computer-readable code for selecting includes: computer-readable code for selecting the certain chunks as the phrases of the phrase list based only on the frequencies of occurrence of the chunks within the stream of document text and on a quantity of words within the chunks.
Claim 26
Dependent Claim
167 words
The computer-readable memory of claim 20, wherein: a) the computer-readable code for partitioning includes: a1) computer-readable code for scanning a portion of the document text stream; a2) computer-readable code for comparing the scanned portion of the document text stream to partition entities in the partition list; a3) computer-readable code for substituting a partition tag for portions of the document text stream which match a partition entity; a4) computer-readable code for generating a text chunk list; a5) computer-readable code for scanning the text chunk list to determine a frequency of each text chunk in the text chunk list; and a6) computer-readable code for revising the text chunk list to include the respective frequencies of occurrence in association with the text chunks; and b) the computer-readable code for selecting includes computer-readable code for selecting the certain chunks as the phrases of the phrase list based only on the frequencies of occurrence of the chunks within the stream of document text and on a quantity of words within the chunks.
Claim 27
Dependent Claim
154 words
A computer-implemented method of full-text, on-line searching, the method comprising: a) receiving and executing a search query to display at least one current document; b) receiving a command to search for documents having similar conceptual content to the current document; c) executing a phrase recognition process to extract phrases allowing full text searches for documents having similar conceptual content to the current document, the phrase recognition process including the steps of: c1) partitioning the document text into plural chunks of document text, each chunk being separated by at least one partition entity from a partition list; and c2) selecting certain chunks as the phrases, based on frequencies of occurrence of the chunks within the stream of document text; and d) automatically forming a second search query based at least on the phrases determined in the phrase recognition process so as to allow automated searching for documents having similar conceptual content to the current document.
Claim 28
Dependent Claim
154 words
A computer-implemented method of full-text, on-line searching, the method comprising: a) receiving and executing a search query to display at least one current document; b) receiving a command to search for documents having similar conceptual content to the current document; c) executing a phrase recognition process to extract phrases allowing full text searches for documents having similar conceptual content to the current document, the phrase recognition process including the steps of: c1) partitioning the document text into plural chunks of document text, each chunk being separated by at least one partition entity from a partition list; and c2) selecting certain chunks as the phrases, based on frequencies of occurrence of the chunks within the stream of document text; and d) automatically forming a second search query based at least on the phrases determined in the phrase recognition process so as to allow automated searching for documents having similar conceptual content to the current document.
Claim 29
Dependent Claim
28 words
The method of claim 24, further comprising: validating phrases recognized by the phrase recognition process against phrases in a phrase dictionary before automatically forming the second search query.
Claim 30
Dependent Claim
25 words
The method of claim 24, further comprising: displaying an error message if less than a threshold number of phrases are recognized for the current document.
Claim 31
Dependent Claim
140 words
A computer-implemented method of forming a phrase list containing phrases that are indicative of conceptual content of each of a plurality of documents, which phrases are used as index terms or in document search queries formed after the phrase list is formed, the method comprising: a) selecting document text from the plurality of documents; b) executing a phrase recognition process including the steps of: b1) partitioning the document text into plural chunks of document text, each chunk being separated by at least one partition entity from a partition list; and b2) selecting certain chunks as the phrases, based on frequencies of occurrence of the chunks within the stream of document text; and c) forming the phrase list, wherein the phrase list includes: 1) phrases extracted by the phrase recognition process; and 2) respective frequencies of occurrence of the extracted phrases.
Claim 32
Dependent Claim
140 words
A computer-implemented method of forming a phrase list containing phrases that are indicative of conceptual content of each of a plurality of documents, which phrases are used as index terms or in document search queries formed after the phrase list is formed, the method comprising: a) selecting document text from the plurality of documents; b) executing a phrase recognition process including the steps of: b1) partitioning the document text into plural chunks of document text, each chunk being separated by at least one partition entity from a partition list; and b2) selecting certain chunks as the phrases, based on frequencies of occurrence of the chunks within the stream of document text; and c) forming the phrase list, wherein the phrase list includes: 1) phrases extracted by the phrase recognition process; and 2) respective frequencies of occurrence of the extracted phrases.
Claim 33
Independent Claim
28 words
The method of 27, further comprising: forming a modified phrase list having only those phrases whose respective frequencies of occurrence are greater than a threshold number of occurrences.
Claim 34
Independent Claim
28 words
The method of 27, further comprising: forming a modified phrase list having only those phrases whose respective frequencies of occurrence are greater than a threshold number of occurrences.
Claim 35
Independent Claim
20 words
The method of 27, further comprising: forming a phrase dictionary based on the phrase list formed in the forming step.
Claim 36
Independent Claim
20 words
The method of 27, further comprising: forming a phrase dictionary based on the phrase list formed in the forming step.
Claim 37
Dependent Claim
130 words
A computer-implemented method of forming phrase lists containing phrases that are indicative of conceptual content of documents, which phrases are used as index terms or in document search queries formed after the phrase list is formed, the method comprising a) selecting document text from a sampling of documents from among a larger collection of documents; and b) executing a phrase recognition process to extract phrases to form a phrase list for each document processed, the phrase recognition process including: b1) partitioning the document text into plural chunks of document text, each chunk being separated by at least one partition entity from a partition list; and b2) selecting certain chunks as the phrases of the phrase list based on frequencies of occurrence of the chunks within the stream of document text.
Claim 38
Dependent Claim
130 words
A computer-implemented method of forming phrase lists containing phrases that are indicative of conceptual content of documents, which phrases are used as index terms or in document search queries formed after the phrase list is formed, the method comprising a) selecting document text from a sampling of documents from among a larger collection of documents; and b) executing a phrase recognition process to extract phrases to form a phrase list for each document processed, the phrase recognition process including: b1) partitioning the document text into plural chunks of document text, each chunk being separated by at least one partition entity from a partition list; and b2) selecting certain chunks as the phrases of the phrase list based on frequencies of occurrence of the chunks within the stream of document text.
References Cited (Backward Citations)
US5225981A
Cited
US5123103A
Cited
US4868750A
Cited
US4864502A
Cited
US4931936A
Cited
US5146405A
Cited
US4994966A
Cited
US4914590A
Cited
US5161105A
Cited
US5297042A
Cited
US5289375A
Cited
US5481742A
Cited
US5299124A
Cited
US5251316A
Cited
US5265065A
Cited
US5418948A
Cited
US5488725A
Cited
US5287278A
Cited
US5410475A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-10-05 | 2002-04-06 | 2002-10-06 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-10-05 | 2006-04-06 | 2006-10-06 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-10-05 | 2010-04-06 | 2010-10-06 | $7700.00 | Window Closed / Lapsed |