Patent US5625748A successfully refreshed from Google Patents.
US5625748A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Topic discriminator using posterior probability or confidence scores
Assignee: Ramp Holdings Inc
•
Filing: 1994-04-18
•
Granted: 1997-04-29
•
Expires: 2014-04-18
Abstract
Abstract An improved topic discriminator includes an integrated speech recognizer or word and phrase spotter as part of a speech event detector, and a topic classifier trained on topic-dependent event frequencies. The event frequencies are determined from either or both transcribed data with a text event detector and untranscribed speech data with a speech event detector. In accordance with another aspect of the present invention, the phrase spotter is used to detect the presence of phrases without the need of parsing the output of a speech recognizer's hypothesized transcription. In accordance with another aspect of the invention, an improved technique is used to select a subset of the potential speech events on whose event frequencies the topic discrimination decision is made. Finally, in accordance with another aspect of the invention, an improved method of topic modeling is used to improve the performance of the topic discriminator.
Inventors
- 👤 John W. McDonough
- 👤 Herbert Gish
- 👤 Jan R. Rohlicek
- 👤 Kenney Ng
- 👤 Phillippe Jeanrenaud
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-06 14:31
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/08; G10L15/18; G10L15/1822; G10L15/02; G10L15/10; G10L15/1815
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
131 words
A method of selecting a vocabulary of important keywords or speech events, the presence or absence of which in a hypothesis string associated with a speech message serves to indicate the topic membership of the message, said method comprising the steps of: generating hypothesis strings in response to and as a function of a plurality of training messages produced from the output of an event detector, each of said training messages being known to be about one of a finite set of topics; deriving word or event frequency statistics from said hypothesis strings; assigning topic-conditional significance or association scores to all possible words or events as a function of the word or event frequency statistics; and selecting those words or events having topic-conditional significance or association scores above a predetermined threshold.
Claim 2
Independent Claim
131 words
A method of selecting a vocabulary of important keywords or speech events, the presence or absence of which in a hypothesis string associated with a speech message serves to indicate the topic membership of the message, said method comprising the steps of: generating hypothesis strings in response to and as a function of a plurality of training messages produced from the output of an event detector, each of said training messages being known to be about one of a finite set of topics; deriving word or event frequency statistics from said hypothesis strings; assigning topic-conditional significance or association scores to all possible words or events as a function of the word or event frequency statistics; and selecting those words or events having topic-conditional significance or association scores above a predetermined threshold.
Claim 3
Dependent Claim
58 words
The method according to claim 1, wherein said step of generating said hypothesis strings in response to and as a function of the plurality of training messages produced from the output of the event detector includes the step of generating said hypothesis strings so that each indicates only the binary-valued presence or absence of a word or event.
Claim 4
Dependent Claim
51 words
The method according to claim 2, wherein said step of generating said hypothesis strings in response to and as a function of the plurality of training messages includes the step of deriving said hypothesis strings from a text transcription of the speech message produced from the output of the event detector.
Claim 5
Dependent Claim
71 words
The method according to claim 2, wherein said step of generating said hypothesis strings in response to and as a function of the plurality of training messages includes the steps of (a) obtaining said hypothesis strings by applying the speech messages to the input of the event detector of the type providing a hypothesis string output in response to a speech message; and (b) detecting the output of the event detector.
Claim 6
Dependent Claim
36 words
The method according to claim 4, wherein the event detector is a speech recognizer and said step of detecting the output of the event detector includes the step of detecting the output of said speech recognizer.
Claim 7
Dependent Claim
73 words
The method according to claim 1, wherein said step of generating hypothesis strings in response to and as a function of the plurality of training messages includes the step of generating each hypothesis string so that said hypothesis string includes a probability or confidence score for every word or event in the string, said score indicating the overall likelihood the word or event occurred in the actual speech message associated with the string.
Claim 8
Dependent Claim
73 words
The method according to claim 6, wherein said step of generating hypothesis strings in response to and as a function of the plurality of training messages includes the steps of (a) generating said hypothesis strings by applying the speech messages to the input of an event detector of the type providing hypothesis strings and associated word or events scores in response to speech messages; and (b) detecting the output of the event detector.
Claim 9
Dependent Claim
40 words
The method according to claim 1, wherein the event detector is a word or event spotter and said step of detecting the output of the event detector includes the step of detecting the output of said word or event spotter.
Claim 10
Dependent Claim
36 words
The method according to claim 1, wherein said step of deriving word or event frequency statistics from said hypothesis strings includes the step of counting the number of keyword or event occurrences in the hypothesis strings.
Claim 11
Dependent Claim
42 words
The method according to claim 1, wherein said step of deriving word or event frequency statistics from said hypothesis strings includes the step of obtaining said word-frequency statistics by summing the confidence scores for all words or events in the hypothesis strings.
Claim 12
Dependent Claim
36 words
The method according to claim 1, wherein said step of assigning topic-conditional significance or association scores to all possible words or events includes the step of obtaining topic-conditional significance or association scores by a hypothesis test.
Claim 13
Dependent Claim
89 words
The method according to claim 11, wherein said hypothesis test is a chi-squared test, and the step of obtaining topic-conditional significance or association scores by said chi-squared test includes the step of calculating the chi-squared (X 2 ) values as follows: ##EQU16## and storing said chi-squared values in a table having cells defined by i rows and j columns; wherein ##EQU17## is the expected number of counts for each cell; ##EQU18## N ij equals the number of conversations assigned to cell (i,j) found for each cell in the table.
Claim 14
Dependent Claim
49 words
The method according to claim 12, wherein said step of obtaining topic-conditional significance or association scores by a chi-squared test includes the step of generating at least one contingency table from the word-frequency statistics derived from the message hypothesis strings and basing said chi-squared test on said contingency tables.
Claim 15
Dependent Claim
44 words
The method according to claim 13, wherein each topic is allotted its own row in the contingency table and said step of obtaining topic-conditional significance or association scores by a chi-squared test includes the step of conducting a hypothesis test across all topics simultaneously.
Claim 16
Dependent Claim
64 words
The method according to claim 13, wherein a single topic is allotted its own row in the contingency table while all other topics are grouped together in a second row of said table, and said step of obtaining topic-conditional significance or association scores by a chi-squared test includes the step conducting said chi-squared test for only a single word and topic at a time.
Claim 17
Dependent Claim
58 words
The method according to claim 1, wherein said step of deriving word or event frequency statistics from said hypothesis strings includes the steps of (a) using said word or event frequency statistics to construct topic-conditional mixture densities for each possible word or event, and (b) using said topic-conditional mixture densities to calculate an association score for each word.
Claim 18
Dependent Claim
67 words
The method according to claim 16, wherein the mixture have the form of: ##EQU19## wherein T i is one of i topics; q im is the prior probability of the selection of mixture m conditioned on topic T i ; f im (θ) is the conditional multi-variate probability density function of θ; and M i is the total number of mixtures associated with topic T i .
Claim 19
Dependent Claim
19 words
The method according to claim 17, wherein said mixture densities are comprised of the weighted sum of delta-dirac functions.
Claim 20
Dependent Claim
49 words
The method according to claim 17, wherein said mixture densities are comprised of the weighted sum of beta-density functions of the form: ##EQU20## wherein C(n im .sup.(0),n im .sup.(1), . . . ,n im .sup.(k))is a normalization constant chosen to ensure f im (θ) is a proper density function.
Claim 21
Dependent Claim
23 words
The method according to claim 19, wherein further including the steps of estimating the parameters of said mixture densities with an Estimation-Maximization algorithm.
Claim 22
Dependent Claim
75 words
The method according to claim 19, wherein said association score is a mutual information measure occurrences and that of topic membership, wherein the desired mutual information measure I(T,W) can be expressed as: ##EQU21## where p(w k .sup.(n) |T.sup.(n)) is the likelihood of the occurrence pattern for word or event v k observed in training sequence w.sup.(n) conditioned on its true topic T.sup.(n), and ##EQU22## is the likelihood for the same occurrence pattern independent of topic.
Claim 23
Dependent Claim
70 words
The method according to claim 19, wherein said association score is a Kullback-Liebler distance between the probability density of the word conditioned on a given topic, and the density of the word conditioned on all other topics, said distance measure having the form: ##EQU23## where N(T) is the total number of conversations or messages relating to the topic of interest, and N(T) is the number relating to all other topics.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-04-28 | 2000-10-28 | 2001-04-29 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-04-28 | 2004-10-28 | 2005-04-29 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-04-28 | 2008-10-28 | 2009-04-29 | $7700.00 | Window Closed / Lapsed |