Patent US5610812A successfully refreshed from Google Patents.
← Back to Patent Explorer
US5610812A Expired / Lapsed US ⏱️ 0.0 years remaining

Contextual tagger utilizing deterministic finite state transducer

Assignee: Benhov GmbH LLC
•
Filing: 1994-06-24
•
Granted: 1997-03-11
•
Expires: 2014-06-24
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A system for assigning part-of-speech tags to English text includes an improved contextual tagger which utilizes a deterministic finite state transducer to improve tagging speed such that large documents can have its sentences accurately tagged as to parts of speech to permit fast grammar checking, spell checking, information retrieval, text indexing and optical character recognition. The subject system performs by first acquiring a set of rules by examining a training corpus of tagged text. Then, these rules are transformed into a deterministic finite-state transducer through the utilization of non-deterministic transducers, a composer and a determiniser. In order to tag an input sentence, the sentence is initially tagged by first assigning each word in the sentence with its most likely part of speech tag regardless of the surrounding words in the sentences. The deterministic finite-state transducer is then applied on the resulting sequence of part of speech tags using the surrounding words and obtains the final part of speech tags. The Subject System requires an amount of time to compute the part-of-speech tags which is proportional to the number of words in the input sentence and which is independent of the number of rules it has applied.

Inventors

  • 👤 Yves Schabes
  • 👤 Emmanuel Roche

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-08 17:48
CPC Classifications
G; G06; G06F; G06F40/00; G06F40/20; G06F40/253; G06F40/205; G06F40/211; G06F40/268

Claims Analysis

Total Claims: 10
Claim 1
Independent Claim 66 words
A computer system for correcting part of speech tags of words of sentences in a text, comprising: means for receiving an initially tagged input sentence; and, a contextual part of speech tagger for correcting part-of-speech tags of the words of said initially tagged input sentence, said tagger including a deterministic finite state transducer for tagging said words in accordance with context and in a single pass.
Claim 2
Dependent Claim 66 words
A computer system for correcting part of speech tags of words of sentences in a text, comprising: means for receiving an initially tagged input sentence; and, a contextual part of speech tagger for correcting part-of-speech tags of the words of said initially tagged input sentence, said tagger including a deterministic finite state transducer for tagging said words in accordance with context and in a single pass.
Claim 3
Dependent Claim 23 words
The system of claim 1 wherein said deterministic finite state transducer includes for each input word means for making only one tagging choice.
Claim 4
Dependent Claim 38 words
The system of claim 2 wherein said means for making only one tagging choice includes means for postponing any choice until sufficient context is detected to ascertain that one tagging choice among the possible tagging choices is correct.
Claim 5
Dependent Claim 107 words
The system of claim 1 wherein said input sentence has words, each word having an identifiable sequential position, and wherein said deterministic finite state transducer includes means for selecting a word at one position for analysis to determine the part of speech thereof, means for choosing the part of speech of said selected word based on the parts of speech of prior words in said sentence and means for inhibiting the choice of the part of speech for said selected word if the parts of speech of said prior words do not lead to a singular conclusion as to the part of speech of said selected word.
Claim 6
Dependent Claim 45 words
The system of claim 4 wherein said deterministic finite state transducer includes means coupled to said inhibiting means for analyzing the parts of speech of additional words in said sentence until the choice of the part of speech of said selected word is unambiguously clear.
Claim 7
Dependent Claim 32 words
The system of claim 5 wherein means for analyzing the parts of speech of said additional words only selects additional words which are subsequent in position to that of said selected word.
Claim 8
Dependent Claim 56 words
The system of claim 1 and further including means for initially tagging said sentence by first assigning the most likely part of speech to a word in said sentence without regard to surrounding words, and, means utilizing said deterministic finite state transducer for obtaining a final part-of-speech tag for said word using surrounding words for context.
Claim 9
Dependent Claim 82 words
The system of claim 1 wherein said deterministic finite state transducer is derived from a set of tagging rules generated from a training corpus of tagged text and wherein said deterministic finite state transducers includes non-deterministic transducers having said tagging rules as an input thereto, a composer for combining the outputs of said non-deterministic transducers into an omnibus non-deterministic transducer, and a determiniser for postponing decisions as to tagging choice until enough context information is available to make the correct tagging choice.
Claim 10
Dependent Claim 32 words
The system of claim 1 wherein said deterministic finite state transducer utilizes only a finite number of predetermined parts of speech sequences corresponding to differing contexts for the words in said sentence.

References Cited (Backward Citations)

US4579533A Cited
US4674065A Cited
US4661942A Cited
US4830521A Cited
US4864502A Cited
US4864501A Cited
US4868750A Cited
US5146405A Cited
US5333313A Cited
US5297040A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2000-03-10 2000-09-09 2001-03-11 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2004-03-10 2004-09-09 2005-03-11 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2008-03-10 2008-09-09 2009-03-11 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag