Method and apparatus for summarizing documents according to theme

Claim 2

An automated, computer implemented method of electronically processing a document stored in a memory of a computer, said document containing text represented by characters, said method comprising the steps of: a) using the computer, automatically determining a frequency of occurrence of expressions in the document not contained in a stop list and having at least a first predetermined level of complexity, said stop list stored in the memory of said computer; b) using the computer, automatically forming a seed list comprised of a second predetermined number of the most frequently occurring expressions determined in step (a), said seed list stored in said memory of said computer; c) using said computer, automatically forming a summary of the document comprised of regions in the document containing at least two members of said seed list, said summary stored in said memory of said computer; and d) using said computer, automatically repeating steps (a)-(c) on said summary until a length of said summary is no greater than a predetermined length, each time steps (a)-(c) are repeated, adding the members of said seed list to said stop list and reducing said first predetermined level of complexity.

Claim 3

The method of claim 1, wherein each expression is represented in the document as at least one character.

Claim 4

The method of claim 2, wherein at least some of said expressions are represented as character strings.

Claim 5

The method of claim 3, wherein the level of complexity of each character string is determined by said computer based on a length of said character string.

Claim 6

The method of claim 1, wherein the level of complexity of each expression is determined by said computer based on a length of said expression.

Claim 7

The method of claim 1, wherein the level of complexity of each expression is determined by said computer based on a number of strokes contained in said expression.

Claim 8

The method of claim 1, wherein each expression is a word, so that in step (a) said computer determines a frequency of occurrence of words in the document.

Claim 9

The method of claim 7, wherein the complexity of each word is determined by said computer based on a length of said word.

Claim 10

The method of claim 7, further comprising, using said computer, performing a word-stemming operation on words in said document prior to performing step (a).

Claim 11

The method of claim 1, wherein each of said regions comprises a portion of the document containing at least two of said members of said seed list.

Claim 12

The method of claim 10, wherein said portion is a sentence, so that each of said regions includes a sentence containing at least two of said members of said seed list.

Claim 13

The method of claim 1, wherein each of said regions comprises a sentence containing at least two of said members of said seed list and immediately preceding and following sentences located in a same paragraph as said sentence containing at least two of said members of said seed list.

Claim 14

The method of claim 1, further comprising including in a final summary of said document, any regions located in a first paragraph of said document, and contained in a summary of the document a first time step (c) is performed by said computer.

Claim 15

The method of claim 1, further comprising including in a final summary of said document, any regions located in a last paragraph of said document, and contained in a summary of the document a first time step (c) is performed by said computer.

Claim 16

The method of claim 1, further comprising including in a final summary of said document, any regions located in a first and a last paragraph of said document, and contained in a summary of the document a first time step (c) is performed by said computer.

Claim 17

The method of claim 1, wherein said stop list is empty before step (a) is performed a first time.

Claim 18

The method of claim 1, wherein said stop list includes a plurality of predefined stop expressions before step (a) is performed a first time.

Claim 19

The method of claim 17, wherein said predefined stop expressions include conjunctions, articles and modals.

Claim 20

The method of claim 1, wherein said summary is formed using said computer by extracting said regions from said document and constructing said summary from said extracted regions.

Claim 21

The method of claim 19, wherein said extracted regions are maintained in a same order in said summary as in the document.

Claim 22

The method of claim 1, wherein said second predetermined number is at least six.

Claim 23

The method of claim 1, wherein said predetermined length of said summary is no greater than one page.

Claim 24

The method of claim 1, further comprising using said computer, automatically outputting said summary when a length of said summary is no greater than said predetermined length.

Claim 25

The method of claim 23, wherein said summary is output on a display screen.

Claim 26

The method of claim 23, wherein said summary is output by a printer.

Claim 27

The method of claim 1, wherein said document includes roman characters, and step (a) comprises, using said computer, determining a frequency of occurrence of words defined by said roman characters in the document not contained in said stop list and having at least a predetermined number of said roman characters.

Claim 28

The method of claim 26, wherein said document is an English-language document.

Claim 29

The method of claim 1, wherein said document is a Japanese language document containing text represented by hiragana characters, katakana characters, roman characters, and kanji characters, and wherein step (a) includes: using said computer, determining a frequency of occurrence of character strings in the document not contained in said stop list, containing at least one of said hiragana, katakana, and roman characters, and having at least a predetermined number of characters.

Claim 30

The method of claim 1, wherein said document is a Japanese language document containing text represented by hiragana characters, katakana characters, roman characters, and kanji characters, and wherein step (a) includes: using said computer, determining a frequency of occurrence of kanji characters and repeated kanji character strings in the document not contained in said stop list, and containing at least a predetermined number of strokes.

Claim 31

The method of claim 1, wherein said document is a Chinese-language document containing text represented by chinese characters, and wherein: step (a) includes using said computer, determining: a frequency of occurrence of chinese characters in the document not contained in said stop list and having a predetermined number of strokes, and a frequency of chinese character strings in the document not contained in said stop list, having at least a third predetermined number of chinese characters, and having said predetermined number of strokes; and step (b) includes forming said seed list from said second predetermined number of the most frequently occurring characters and character strings determined in step (a).

Claim 32

An automated, computer implemented method of electronically processing a document stored in a memory of a computer, said document containing words represented by roman characters, said method comprising the steps of: a) using the computer, automatically determining a frequency of occurrence of words in the document having at least a first predetermined number of characters and not contained in a stop list that is stored in the memory of the computer; b) using the computer, automatically forming a seed list comprised of a second predetermined number of the most frequently occurring words in the document having at least said first predetermined number of characters, said seed list stored in the memory of the computer; c) using the computer, automatically forming a summary of the document comprised of regions in the document containing at least two words in said seed list, said summary stored in the memory of the computer; and d) using the computer, automatically repeating steps (a)-(c) on said summary until a length of said summary is no greater than a predetermined length, each time steps (a)-(c) are repeated, adding the words on said seed list to said stop list and reducing a value of said first predetermined number.

Claim 33

An automated, computer implemented method of electronically processing a document stored in a memory of a computer, said document containing words represented by roman characters, said method comprising the steps of: a) using the computer, automatically determining a frequency of occurrence of words in the document having at least a first predetermined number of characters and not contained in a stop list that is stored in the memory of the computer; b) using the computer, automatically forming a seed list comprised of a second predetermined number of the most frequently occurring words in the document having at least said first predetermined number of characters, said seed list stored in the memory of the computer; c) using the computer, automatically forming a summary of the document comprised of regions in the document containing at least two words in said seed list, said summary stored in the memory of the computer; and d) using the computer, automatically repeating steps (a)-(c) on said summary until a length of said summary is no greater than a predetermined length, each time steps (a)-(c) are repeated, adding the words on said seed list to said stop list and reducing a value of said first predetermined number.

Claim 34

The method of claim 31, wherein said document is an English-language document.

Claim 35

The method of claim 31, further comprising using said computer, performing a word-stemming operation on words in said document prior to performing step (a).

Claim 36

The method of claim 31, wherein said regions include at least a sentence containing said at least two words in said seed list.

Claim 37

The method of claim 31, wherein each of said regions comprises a sentence containing said at least two words in said seed list and immediately preceding and following sentences located in a same paragraph as said sentence containing said at least two words in said seed list.

Claim 38

The method of claim 31, further comprising including in a final summary of said document, any regions located in a first paragraph of said document, and contained in a summary of the document a first time step (c) is performed by the computer.

Claim 39

The method of claim 31, further comprising including in a final summary of said document, any regions located in a last paragraph of said document, and contained in a summary of the document a first time step (c) is performed by the computer.

Claim 40

The method of claim 31, wherein said stop list is empty before step (a) is performed a first time.

Claim 41

The method of claim 31, wherein said stop list includes a plurality of predefined stop words before step (a) is performed a first time.

Claim 42

The method of claim 31, further comprising using said computer, automatically outputting said summary when a length of said summary is no greater than said predetermined length.

Claim 43

An automated, computer implemented method of electronically processing a Japanese language document stored in a memory of a computer, said document containing text represented by hiragana characters, katakana characters, roman characters, and kanji characters, said method comprising the steps of: a) using the computer, automatically determining a frequency of occurrence of character strings in the document not contained in a stop list, containing at least one of said hiragana, katakana, and roman characters, and having at least a first predetermined number of characters, said stop list stored in the memory of the computer; b) using the computer, automatically determining a frequency of occurrence of kanji characters and repeated kanji character strings in the document not contained in said stop list, and containing at least a second predetermined number of strokes; c) using the computer, automatically forming a seed list stored in the memory of the computer, said seed list comprised of a third predetermined number of the most frequently occurring: character strings in the document having at least said first predetermined number of characters, and kanji characters and repeated kanji character strings in the document having at least said second predetermined number of strokes; d) using the computer, automatically forming a summary of the document comprised of all sentences in the document containing at least two members of said seed list and surrounding sentences, said summary stored in the memory of the computer; and e) using the computer, automatically repeating steps (a)-(d) on said summary until a length of said summary is no greater than a predetermined length, each time steps (a)-(d) are repeated, adding the members on said seed list to said stop list and reducing values of said first and second predetermined numbers.

Claim 44

An automated, computer implemented method of electronically processing a Japanese language document stored in a memory of a computer, said document containing text represented by hiragana characters, katakana characters, roman characters, and kanji characters, said method comprising the steps of: a) using the computer, automatically determining a frequency of occurrence of character strings in the document not contained in a stop list, containing at least one of said hiragana, katakana, and roman characters, and having at least a first predetermined number of characters, said stop list stored in the memory of the computer; b) using the computer, automatically determining a frequency of occurrence of kanji characters and repeated kanji character strings in the document not contained in said stop list, and containing at least a second predetermined number of strokes; c) using the computer, automatically forming a seed list stored in the memory of the computer, said seed list comprised of a third predetermined number of the most frequently occurring: character strings in the document having at least said first predetermined number of characters, and kanji characters and repeated kanji character strings in the document having at least said second predetermined number of strokes; d) using the computer, automatically forming a summary of the document comprised of all sentences in the document containing at least two members of said seed list and surrounding sentences, said summary stored in the memory of the computer; and e) using the computer, automatically repeating steps (a)-(d) on said summary until a length of said summary is no greater than a predetermined length, each time steps (a)-(d) are repeated, adding the members on said seed list to said stop list and reducing values of said first and second predetermined numbers.

Claim 45

An automated, computer implemented method of electronically processing a Chinese-Language document stored in a memory of a computer, said document containing text represented by Chinese characters, said method comprising the steps of: a) using the computer, automatically determining a frequency of occurrence of character strings in the document not contained in a stop list, having at least a first predetermined number of characters, and containing at least a second predetermined number of strokes, said stop list stored in the memory of the computer; b) using the computer, automatically determining a frequency of occurrence of characters in the document not contained in said stop list and containing at least said second predetermined number of strokes; c) using the computer, automatically forming a seed list comprised of a third predetermined number of the most frequently occurring characters and character strings determined in steps (a) and (b), said seed list stored in the memory of the computer; d) using the computer, automatically forming a summary of the document comprised of all sentences in the document containing at least two members of said seed list and surrounding sentences, said summary stored in the memory of the computer; and e) using the computer, automatically repeating steps (a)-(d) on said summary until a length of said summary is not greater than a predetermined length, each time steps (a)-(d) are repeated, adding the members on said seed list to said stop list and reducing values of said first and second predetermined numbers.

Claim 46

An automated, computer implemented method of electronically processing a Chinese-Language document stored in a memory of a computer, said document containing text represented by Chinese characters, said method comprising the steps of: a) using the computer, automatically determining a frequency of occurrence of character strings in the document not contained in a stop list, having at least a first predetermined number of characters, and containing at least a second predetermined number of strokes, said stop list stored in the memory of the computer; b) using the computer, automatically determining a frequency of occurrence of characters in the document not contained in said stop list and containing at least said second predetermined number of strokes; c) using the computer, automatically forming a seed list comprised of a third predetermined number of the most frequently occurring characters and character strings determined in steps (a) and (b), said seed list stored in the memory of the computer; d) using the computer, automatically forming a summary of the document comprised of all sentences in the document containing at least two members of said seed list and surrounding sentences, said summary stored in the memory of the computer; and e) using the computer, automatically repeating steps (a)-(d) on said summary until a length of said summary is not greater than a predetermined length, each time steps (a)-(d) are repeated, adding the members on said seed list to said stop list and reducing values of said first and second predetermined numbers.

Claim 47

A computer apparatus for automatically processing a document containing text represented by characters, comprising: input means for automatically inputting a document into a memory of the computer apparatus to produce document data; a processor coupled to said memory and including: frequency determining means, receiving said document data from said memory, for automatically determining a frequency of occurrence of expressions in the document not contained in a stop list and having at least a first predetermined level of complexity, said frequency determining means outputting expression frequency data, said stop list stored in said memory; seed list defining means, receiving said expression frequency data from said frequency determining means, for automatically defining a seed list comprised of a second predetermined number of the most frequently occurring expressions in the document, said seed list stored in said memory; identifying means for automatically identifying portions of the document data containing at least two members of said seed list; summarizing means for automatically forming a summary by combining said portions identified by said identifying means, said summary stored in said memory; length determining means for automatically determining whether a length of said summary is not greater than a predetermined length; and control means for automatically outputting said summary as a document summary when said length determining means determines said summary to be not greater than said predetermined length, otherwise automatically inputting said summary as a document to said input means, adding members of said seed list to said stop list, and reducing said first predetermined level of complexity so that said document data is iteratively processed until a document summary is produced having a length not greater than said predetermined length.

Claim 48

A computer apparatus for automatically processing a document containing text represented by characters, comprising: input means for automatically inputting a document into a memory of the computer apparatus to produce document data; a processor coupled to said memory and including: frequency determining means, receiving said document data from said memory, for automatically determining a frequency of occurrence of expressions in the document not contained in a stop list and having at least a first predetermined level of complexity, said frequency determining means outputting expression frequency data, said stop list stored in said memory; seed list defining means, receiving said expression frequency data from said frequency determining means, for automatically defining a seed list comprised of a second predetermined number of the most frequently occurring expressions in the document, said seed list stored in said memory; identifying means for automatically identifying portions of the document data containing at least two members of said seed list; summarizing means for automatically forming a summary by combining said portions identified by said identifying means, said summary stored in said memory; length determining means for automatically determining whether a length of said summary is not greater than a predetermined length; and control means for automatically outputting said summary as a document summary when said length determining means determines said summary to be not greater than said predetermined length, otherwise automatically inputting said summary as a document to said input means, adding members of said seed list to said stop list, and reducing said first predetermined level of complexity so that said document data is iteratively processed until a document summary is produced having a length not greater than said predetermined length.

Claim 49

The apparatus of claim 43, wherein said input means produces said document data as decoded text data.

Claim 50

The apparatus of claim 43, wherein said expressions are represented in the document as at least one character, and said frequency determining means automatically determines whether said expressions have said first predetermined level of complexity by determining a number of strokes in said expressions.

Claim 51

The apparatus of claim 43, wherein said expressions are represented in the document as character strings, and said frequency determining means automatically determines whether said expressions have said first predetermined level of complexity by determining a number of characters in said expressions.

Claim 52

The apparatus of claim 43, wherein said expressions are represented in the document as character strings, and said frequency determining means automatically determines whether said expressions have said first predetermined level of complexity by determining a number of strokes in said expressions.

Claim 53

The apparatus of claim 43, wherein said expressions are represented in the document as words, and said frequency determining means automatically determines whether said expressions have said first predetermined level of complexity by determining a length of said words.

Claim 54

The apparatus of claim 48, wherein said frequency determining means automatically determines the length of said words by determining a number of characters in said words.

Claim 55

The apparatus of claim 43, wherein said identifying means automatically identifies sentences containing at least two of said members of said seed list.

Claim 56

The apparatus of claim 50, wherein each of said portions includes a sentence containing at least two of said members of said seed list and immediately preceding and following sentences located in a same paragraph as said sentence containing at least two of said members of said seed list.

Claim 57

The apparatus of claim 43, wherein said processor further includes means for automatically predefining members of said stop list before a document is input to said input means.

Claim 58

The apparatus of claim 43, wherein said summarizing means forms said summary by extracting said portions from said document and constructing said summary from said extracted portions while maintaining said extracted portions in a same order in said summary as in the document.

Claim 59

The apparatus of claim 43, further comprising a display screen for displaying said output document summary.

Claim 60

The apparatus of claim 43, further comprising a printer for printing said output document summary.