Patent US5546499A successfully refreshed from Google Patents.
← Back to Patent Explorer
US5546499A Expired / Lapsed US ⏱️ 0.0 years remaining

Speech recognition system utilizing pre-calculated similarity measurements

Assignee: Nuance Communications Inc
•
Filing: 1994-05-27
•
Granted: 1996-08-13
•
Expires: 2014-05-27
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract An input utterance is converted to a sequence of standard or prototype data frames which are compared with word models which are represented by respective sequences of standard or prototype probability states, there being a pre-calculable distance metric representing the degree of match between each prototype data frame and each prototype model state. Only distance measurements better than a calculated threshold are considered meaningful and those meaningful metrics are stored in a packed list. Also stored is an address array of offsets for locating particular meaningful metrics in the list, the address array being accessed by the corresponding frame and state indices. Also stored is an array for distinguishing meaningful and non-meaningful metrics. Accordingly, an input utterance can be evaluated by locating meaningful metrics in the packed list using the address array and by utilizing a default value for any non-meaningful metric.

Inventors

  • 👤 Thomas E. Lynch
  • 👤 Vladimir Sejnoha
  • 👤 Thomas E. Dinger

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-28 13:47
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/08; G10L15/10; G10L2015/085

Claims Analysis

Total Claims: 27
Claim 1
Independent Claim 249 words
A method of preparing a compressed matrix of precalculated distance metrics for comparing an input utterance which is represented by a sequence of prototype data frames selected from a preselected set of prototype data frames with at least some of a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, said method comprising: generating an array of distance metrics for all combinations of prototype frames and prototype states; for each state, identifying the frames for which the corresponding metric is meaningful; for each state, determining a common default value for non-meaningful metrics; for at least one group of frames corresponding to each state, determining the locations within said array containing meaningful metrics; building a combined list of meaningful metrics by adding the meaningful metrics from successive groups of frames using an offset for each group which allows the meaningful metrics for each group to fit into currently unused positions in the list, the relative positions of meaningful metrics within each group being maintained in the list; building an array of said offset values accessed by the corresponding state; building an array distinguishing meaningful and non-meaningful entries in the original array of distance metrics; whereby a measure of match between an input utterance and a vocabulary word model is obtainable by combining corresponding metrics using a default value for non-meaningful metrics and locating respective meaningful metrics in said combined list using said array of offset values.
Claim 2
Independent Claim 249 words
A method of preparing a compressed matrix of precalculated distance metrics for comparing an input utterance which is represented by a sequence of prototype data frames selected from a preselected set of prototype data frames with at least some of a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, said method comprising: generating an array of distance metrics for all combinations of prototype frames and prototype states; for each state, identifying the frames for which the corresponding metric is meaningful; for each state, determining a common default value for non-meaningful metrics; for at least one group of frames corresponding to each state, determining the locations within said array containing meaningful metrics; building a combined list of meaningful metrics by adding the meaningful metrics from successive groups of frames using an offset for each group which allows the meaningful metrics for each group to fit into currently unused positions in the list, the relative positions of meaningful metrics within each group being maintained in the list; building an array of said offset values accessed by the corresponding state; building an array distinguishing meaningful and non-meaningful entries in the original array of distance metrics; whereby a measure of match between an input utterance and a vocabulary word model is obtainable by combining corresponding metrics using a default value for non-meaningful metrics and locating respective meaningful metrics in said combined list using said array of offset values.
Claim 3
Independent Claim 248 words
A method of preparing a compressed matrix of precalculated distance metrics for comparing an input utterance which is represented by a sequence of prototype data frames selected from a preselected set of prototype data frames with at least some of a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, said method comprising: generating an array of distance metrics for all combinations of prototype frames and prototype states; for each state, identifying the frames for which the corresponding metric is meaningful; for each state, determining a common default value for non-meaningful metrics; for subgroups of frames corresponding to each state, determining the locations within said array containing meaningful metrics; building a combined list of meaningful metrics by adding the meaningful metrics from successive subgroups of frames using an offset for each subgroup which allows the meaningful metrics for each group to fit into currently unused positions in the list, the relative positions of meaningful metrics within each subgroup being maintained in the list; building an array of said offset values accessed by the corresponding subgroup and state; building an array distinguishing meaningful and non-meaningful entries in the original array of distance metrics; whereby a measure of match between an input utterance and a vocabulary word model is obtainable by combining corresponding metrics using a default value for non-meaningful metrics and locating respective meaningful metrics in said combined list using said array of offset values.
Claim 4
Independent Claim 248 words
A method of preparing a compressed matrix of precalculated distance metrics for comparing an input utterance which is represented by a sequence of prototype data frames selected from a preselected set of prototype data frames with at least some of a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, said method comprising: generating an array of distance metrics for all combinations of prototype frames and prototype states; for each state, identifying the frames for which the corresponding metric is meaningful; for each state, determining a common default value for non-meaningful metrics; for subgroups of frames corresponding to each state, determining the locations within said array containing meaningful metrics; building a combined list of meaningful metrics by adding the meaningful metrics from successive subgroups of frames using an offset for each subgroup which allows the meaningful metrics for each group to fit into currently unused positions in the list, the relative positions of meaningful metrics within each subgroup being maintained in the list; building an array of said offset values accessed by the corresponding subgroup and state; building an array distinguishing meaningful and non-meaningful entries in the original array of distance metrics; whereby a measure of match between an input utterance and a vocabulary word model is obtainable by combining corresponding metrics using a default value for non-meaningful metrics and locating respective meaningful metrics in said combined list using said array of offset values.
Claim 5
Independent Claim 272 words
A method of preparing a compressed matrix of precalculated distance metrics for comparing an input utterance which is represented by a sequence of prototype data frames selected from a preselected set of prototype data frames with at least some of a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, said method comprising: generating a matrix of distance metrics for all combinations of prototype frames and prototype states; for each state, order the metrics, best matches first; cumulating the metrics, best matches first, for each frame until a preselected threshold is reached; for each state, assigning a common default value for all metrics which did not contribute to the cumulation; for the frames corresponding to each state, determining the locations within said array containing contributing metrics, said metrics being then considered meaningful; building a combined list of meaningful metrics by adding the meaningful metrics from successive groups of contributing frames using an offset for each group which allows the meaningful metrics for each group to fit into currently unused positions in the list, the relative positions of meaningful metrics within each group being maintained in the list; building an array of said offset values accessed by the corresponding frame and state; building an array distinguishing meaningful and non-meaningful entries in the original array of distance metrics; whereby a measure of match between an input utterance and a vocabulary word model is obtainable by combining corresponding metrics using a default value for non-meaningful metrics and locating respective meaningful metrics in said combined list using said array of offset values.
Claim 6
Independent Claim 272 words
A method of preparing a compressed matrix of precalculated distance metrics for comparing an input utterance which is represented by a sequence of prototype data frames selected from a preselected set of prototype data frames with at least some of a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, said method comprising: generating a matrix of distance metrics for all combinations of prototype frames and prototype states; for each state, order the metrics, best matches first; cumulating the metrics, best matches first, for each frame until a preselected threshold is reached; for each state, assigning a common default value for all metrics which did not contribute to the cumulation; for the frames corresponding to each state, determining the locations within said array containing contributing metrics, said metrics being then considered meaningful; building a combined list of meaningful metrics by adding the meaningful metrics from successive groups of contributing frames using an offset for each group which allows the meaningful metrics for each group to fit into currently unused positions in the list, the relative positions of meaningful metrics within each group being maintained in the list; building an array of said offset values accessed by the corresponding frame and state; building an array distinguishing meaningful and non-meaningful entries in the original array of distance metrics; whereby a measure of match between an input utterance and a vocabulary word model is obtainable by combining corresponding metrics using a default value for non-meaningful metrics and locating respective meaningful metrics in said combined list using said array of offset values.
Claim 7
Dependent Claim 23 words
A method as set forth in claim 3 wherein said threshold is selected to produce in the order of seven percent meaningful metrics.
Claim 8
Dependent Claim 43 words
A method as set forth in claim 3 wherein said metrics correspond to probabilities and wherein said common default value is selected to cause the sum of the probabilities corresponding to all meaningful and all non-meaningful metrics to be essentially equal to unity.
Claim 9
Dependent Claim 24 words
A method as set forth in claim 3 wherein the meaningful entries for each state are divided into subgroups prior to combining with offsets.
Claim 10
Dependent Claim 45 words
A method as set forth in claim 6 wherein said subgroups are ordered by number of meaningful entries prior to combining with offsets and wherein successive subgroups are added to build the combined list starting with the subgroups having the largest number of meaningful entries.
Claim 11
Dependent Claim 20 words
A method as set forth in claim 3 wherein said distinguishing array comprises a check list paralleling said combined list.
Claim 12
Dependent Claim 19 words
A method as set forth in claim 8 wherein said check list contains entries corresponding to respective frame identifiers.
Claim 13
Independent Claim 321 words
A method of preparing a compressed matrix of precalculated distance metrics for comparing an input utterance which is represented by a sequence of prototype data frames selected from a preselected set of prototype data frames with at least some of a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, said method comprising: generating a matrix of distance metrics for all combinations of prototype frames and prototype states, locations within said matrix being addressable by respective state and frame multibit indices; for each state, order the metrics, best matches first; cumulating the metrics, best matches first, for each frame until a preselected threshold is reached; for each state, assigning a common default value for all metrics which did not contribute to the cumulation; for the frames corresponding to each state, determining the locations within said array containing contributing metrics, said metrics being then considered meaningful; dividing the group of frames corresponding to each state into subgroups identifiable by the higher order bits of the frame multibit index; building a combined list of meaningful metrics by adding the meaningful metrics from successive sub-groups of contributing frames, using an offset for each sub-group which allows the meaningful entries to fit into currently unused positions in the list, the relative positions of meaningful metrics within each sub-group being maintained in the list; building an array of said offset values accessed by the corresponding state index and the higher order bits of the frame multibit index; building a check list paralleling said combined list and containing entries distinguishing meaningful and non-meaningful entries in the original array of distance metrics; whereby a measure of match between an input utterance and a vocabulary word model is obtainable by combining corresponding metrics using a default value for non-meaningful metrics and locating respective meaningful metrics in said combined list using said array of offset values.
Claim 14
Independent Claim 321 words
A method of preparing a compressed matrix of precalculated distance metrics for comparing an input utterance which is represented by a sequence of prototype data frames selected from a preselected set of prototype data frames with at least some of a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, said method comprising: generating a matrix of distance metrics for all combinations of prototype frames and prototype states, locations within said matrix being addressable by respective state and frame multibit indices; for each state, order the metrics, best matches first; cumulating the metrics, best matches first, for each frame until a preselected threshold is reached; for each state, assigning a common default value for all metrics which did not contribute to the cumulation; for the frames corresponding to each state, determining the locations within said array containing contributing metrics, said metrics being then considered meaningful; dividing the group of frames corresponding to each state into subgroups identifiable by the higher order bits of the frame multibit index; building a combined list of meaningful metrics by adding the meaningful metrics from successive sub-groups of contributing frames, using an offset for each sub-group which allows the meaningful entries to fit into currently unused positions in the list, the relative positions of meaningful metrics within each sub-group being maintained in the list; building an array of said offset values accessed by the corresponding state index and the higher order bits of the frame multibit index; building a check list paralleling said combined list and containing entries distinguishing meaningful and non-meaningful entries in the original array of distance metrics; whereby a measure of match between an input utterance and a vocabulary word model is obtainable by combining corresponding metrics using a default value for non-meaningful metrics and locating respective meaningful metrics in said combined list using said array of offset values.
Claim 15
Dependent Claim 39 words
A method as set forth in claim 10 wherein each offset value acts as the starting point for only one subgroup and wherein the entries in said check list correspond to the lower order bits in the frame index.
Claim 16
Independent Claim 174 words
A method of preparing a compressed matrix of precalculated distance metrics for comparing an input utterance which is represented by a sequence of prototype data frames selected from a preselected set of prototype data frames with at least some of a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, said method comprising: generating an array of distance metrics for all combinations of prototype frames and prototype states; designating as meaningful metrics which represent a probability better than a preselected criteria, said criteria being selected to produce meaningful metrics in less than about twenty percent of said entries thereby to generate a sparse matrix of meaningful entries; generating a data structure identifying which metrics in said matrix have been designated as meaningful; generating at least one default value for non-meaningful metrics, each default value being common to a substantial number of said non-meaningful metrics; and compressing said sparse matrix into a packed list comprised essentially entirely of said meaningful entries.
Claim 17
Independent Claim 174 words
A method of preparing a compressed matrix of precalculated distance metrics for comparing an input utterance which is represented by a sequence of prototype data frames selected from a preselected set of prototype data frames with at least some of a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, said method comprising: generating an array of distance metrics for all combinations of prototype frames and prototype states; designating as meaningful metrics which represent a probability better than a preselected criteria, said criteria being selected to produce meaningful metrics in less than about twenty percent of said entries thereby to generate a sparse matrix of meaningful entries; generating a data structure identifying which metrics in said matrix have been designated as meaningful; generating at least one default value for non-meaningful metrics, each default value being common to a substantial number of said non-meaningful metrics; and compressing said sparse matrix into a packed list comprised essentially entirely of said meaningful entries.
Claim 18
Dependent Claim 27 words
A method as set forth in claim 12 generating a data structure pointing to meaningful entries in said packed list based on corresponding locations in said array.
Claim 19
Dependent Claim 218 words
Speech recognition apparatus comprising: means for converting an input utterance to a sequence of utterance data frames; means for converting each of said utterance data frames to a closely matching prototype data frame selected from a preselected set of prototype data frames thereby to obtain a corresponding sequence of prototype data frames; means for storing a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, there being a precalcuable distance metric for each possible pairing of prototype data frame and prototype state, distance metrics better than a calculated value being designated as meaningful; means for storing a list of only the precalculated metrics which are designated as meaningful, an array distinguishing the meaningful and non-meaningful metrics, and an address array of offsets for locating particular meaningful metrics in said list, said address array being accessed by the corresponding frame and state; means for comparing an input utterance with at least some of said word models including a combining of the respective metrics, wherein said comparing means utilizes said distinguishing array to determine if a corresponding metric is meaningful or non-meaningful and utilizes, in the combining, a default value for any non-meaningful metric; and locates corresponding meaningful metrics in said list using said address array.
Claim 20
Dependent Claim 218 words
Speech recognition apparatus comprising: means for converting an input utterance to a sequence of utterance data frames; means for converting each of said utterance data frames to a closely matching prototype data frame selected from a preselected set of prototype data frames thereby to obtain a corresponding sequence of prototype data frames; means for storing a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, there being a precalcuable distance metric for each possible pairing of prototype data frame and prototype state, distance metrics better than a calculated value being designated as meaningful; means for storing a list of only the precalculated metrics which are designated as meaningful, an array distinguishing the meaningful and non-meaningful metrics, and an address array of offsets for locating particular meaningful metrics in said list, said address array being accessed by the corresponding frame and state; means for comparing an input utterance with at least some of said word models including a combining of the respective metrics, wherein said comparing means utilizes said distinguishing array to determine if a corresponding metric is meaningful or non-meaningful and utilizes, in the combining, a default value for any non-meaningful metric; and locates corresponding meaningful metrics in said list using said address array.
Claim 21
Dependent Claim 31 words
Apparatus as set forth in claim 14 wherein said metrics correspond to probabilities and wherein the probabilities associated with the meaningful metrics for each state essentially sum to a preselected threshold.
Claim 22
Dependent Claim 38 words
Apparatus as set forth in claim 15 wherein the default value for each prototype state corresponds to a probability such that the sum of probabilities for all of the non-meaningful metrics plus said preselected threshold essentially equals unity.
Claim 23
Dependent Claim 236 words
Speech recognition apparatus comprising: means for converting an input utterance to a sequence of utterance data frames; means for converting each of said utterance data frames to a closely matching prototype data frame selected from a preselected set of prototype data frames thereby to obtain a corresponding sequence of prototype data frames; means for storing a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, there being a precalcuable distance metric for each possible pairing of prototype data frame and prototype state, distance metrics better than a preselected criteria being designated as meaningful; means for storing a packed list of only the precalculated metrics which are designated as meaningful, a check list paralleling said packed list and containing entries distinguishing meaningful and non-meaningful metrics, a list of default values for the respective states, and an address array of offsets for locating particular meaningful metrics in said list, said address array being accessed by the corresponding frame and state; means for comparing an input utterance with at least some of said word models including a combining of the respective metrics, wherein said comparing means utilizes said distinguishing array to determine if a corresponding metric is meaningful or non-meaningful and utilizes, in the combining, a respective default value for any non-meaningful metric; and locates corresponding meaningful metrics in said list using said address array.
Claim 24
Dependent Claim 236 words
Speech recognition apparatus comprising: means for converting an input utterance to a sequence of utterance data frames; means for converting each of said utterance data frames to a closely matching prototype data frame selected from a preselected set of prototype data frames thereby to obtain a corresponding sequence of prototype data frames; means for storing a vocabulary of word models each of which is represented by a sequence of prototype states selected from a preselected set of prototype states, there being a precalcuable distance metric for each possible pairing of prototype data frame and prototype state, distance metrics better than a preselected criteria being designated as meaningful; means for storing a packed list of only the precalculated metrics which are designated as meaningful, a check list paralleling said packed list and containing entries distinguishing meaningful and non-meaningful metrics, a list of default values for the respective states, and an address array of offsets for locating particular meaningful metrics in said list, said address array being accessed by the corresponding frame and state; means for comparing an input utterance with at least some of said word models including a combining of the respective metrics, wherein said comparing means utilizes said distinguishing array to determine if a corresponding metric is meaningful or non-meaningful and utilizes, in the combining, a respective default value for any non-meaningful metric; and locates corresponding meaningful metrics in said list using said address array.
Claim 25
Dependent Claim 31 words
Apparatus as set forth in claim 17 wherein said metrics correspond to probabilities and wherein the probabilities associated with the meaningful metrics for each state essentially sum to a preselected threshold.
Claim 26
Dependent Claim 17 words
Apparatus as set forth in claim 18 wherein said preselected threshold encompasses about 98% of the probability.
Claim 27
Dependent Claim 38 words
Apparatus as set forth in claim 18 wherein the default value for each prototype state corresponds to a probability such that the sum of probabilities for all of the non-meaningful metrics plus said preselected threshold essentially equals unity.

References Cited (Backward Citations)

US4975959A Cited
US4903305A Cited
US5136654A Cited
US5345535A Cited
US5388183A Cited
US5280563A Cited
US5337394A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1999-08-13 2000-02-12 2000-08-13 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2003-08-13 2004-02-12 2004-08-13 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2007-08-13 2008-02-12 2008-08-13 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag