← Back to Patent Explorer
US6278973B1 Expired / Lapsed US ⏱️ 0.0 years remaining

On-demand language processing system and method

Assignee: Nokia of America Corp
•
Filing: 1995-12-12
•
Granted: 2001-08-21
•
Expires: 2015-12-12
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A language recognition methodology is provided whereby any finite-state model of context may be used in a very general class of decoding cascades, and without requiring specialized decoders or full network expansion. The methodology includes two fundamental improvements: (1) a simple generalization, weighted finite-state transducers, of existing network models, and (2) a novel on-demand execution technique for network combination. With the methodology of the invention one or more of the network cascades are formulated as a finite state transducer, and is composed, for a selected portion of the network, with a next successively higher level of the network cascade to prescribe a mapped portion of that next successively higher level corresponding to the portion of the network cascade selected to be expanded.

Inventors

  • 👤 Pi-Yu Chung
  • 👤 Mehryar Mohri
  • 👤 Fernando Carlos Pereira
  • 👤 Michael Dennis Riley

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 12:55
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/08; G10L15/18; G10L15/183

Claims Analysis

Total Claims: 26
Claim 1
Independent Claim 222 words
In a speech processing system wherein predetermined linguistic information is represented in a hierarchal cascade of network models and a linkage between successive levels of said network models is defined by a mapping function, and wherein at least one path within each said network model is defined by connections among a plurality of predetermined states, a method for input speech evaluation by on-demand expansion of a selected portion of at least one of said network models comprising the steps of: formulating said at least one of said network models as a finite state transducer, said transducer representing said mapping function between said at least one network model and an adjacent one of said cascaded network models; selecting a state in a one of said at least one transducers having a correspondence to said selected portion of said at least one network model; composing said one of said at least one transducers with a next successively higher level of said network models to prescribe a mapped portion of said next successively higher level corresponding to said selected portion of said at least one network model; iteratively repeating said selecting step and said composing step for each successively higher level network model representing said selected portion; and evaluating an input speech signal against a candidate speech segment provided by one of said network models.
Claim 2
Dependent Claim 222 words
In a speech processing system wherein predetermined linguistic information is represented in a hierarchal cascade of network models and a linkage between successive levels of said network models is defined by a mapping function, and wherein at least one path within each said network model is defined by connections among a plurality of predetermined states, a method for input speech evaluation by on-demand expansion of a selected portion of at least one of said network models comprising the steps of: formulating said at least one of said network models as a finite state transducer, said transducer representing said mapping function between said at least one network model and an adjacent one of said cascaded network models; selecting a state in a one of said at least one transducers having a correspondence to said selected portion of said at least one network model; composing said one of said at least one transducers with a next successively higher level of said network models to prescribe a mapped portion of said next successively higher level corresponding to said selected portion of said at least one network model; iteratively repeating said selecting step and said composing step for each successively higher level network model representing said selected portion; and evaluating an input speech signal against a candidate speech segment provided by one of said network models.
Claim 3
Dependent Claim 27 words
The method for on-demand expansion of claim 1 wherein at least one of said levels of said network cascade is represented in terms of context dependent units.
Claim 4
Dependent Claim 64 words
The method for on-demand expansion of claim 1 wherein said selecting step and said composing step are implemented as a generalized state machine C, said machine being created as a composition of a generalized state machine A, corresponding to said one of said at least one transducers, with a generalized state machine B, corresponding to said next successively higher level of said network cascade.
Claim 5
Dependent Claim 187 words
The method for on-demand expansion of claim 3 wherein said generalized state machine C supports the functions: C.start:=returns A.start paired with B.start C.final((s 1 ,s 2 )):=for state s 1 ,s 2 , returns A.final(s 1 ) Ù B.final(s 2 ) C.arcs((s 1 ,s 2 )):=for state s 1 ,s 2 , returns Merge(A.arcs(s 1 ), B.arcs(s 2 )) where merged arcs are defined as: (label 1 , label 3 , x+y, (next state 1 , next state 2 )) Î Merge(A.arcs(s 1 ), B.arcs(s 2 )) iff (label 1 , label 2 , x, next state 1 ) Î A.arcs(s 1 ) and (label 2 , label 3 , y, next state 2 ) Î B.arcs(s 2 ); where, using M to represent any of generalized state machines C, A or B: M.start returns, on request, the start state for machine M; M.final(state) represents probability of accepting at a given state; and M.arcs(state) returns, for a given state, transitions (a 1 , a 2 , . . . a N ) leaving the given state, where a i =(input label, output label, weight & next state).
Claim 6
Dependent Claim 34 words
The method for on-demand expansion of claim 1 further including a step of storing at least a part of said on-demand expansion of said selected portion of said network cascade in a storage cache.
Claim 7
Dependent Claim 102 words
The method for on-demand expansion of claim 5 wherein said storage cache is implemented as a generalized state machine of the form: N.start:=M.start N.final(state):=M.final(state) N.arcs(state):=M.arcs(state) where: M represents an input machine and N represents said cache machine; M.start returns, on request, the start state for machine M; M.final(state) represents probability of accepting at a given state; and M.arcs(state) returns, for a given state, transitions (a 1 , a 2 , . . . a N ) leaving the given state, where a i =(input label, output label, weight & next state); and corresponding functions of generalized state machine N are equivalently defined.
Claim 8
Dependent Claim 24 words
The method for on-demand expansion of claim 1 wherein said selected portion of said network cascade corresponds to an unknown speech fragment of interest.
Claim 9
Dependent Claim 51 words
The method for on-demand expansion of claim 1 further including the step of inserting a filter in said composition of said one of said at least one transducers with said next successively higher level, wherein said filter operates to remove redundant paths occurring between a pair of states in said composition.
Claim 10
Dependent Claim 18 words
The method for on-demand expansion of claim 8 wherein said filter is manifested as a finite state transducer.
Claim 11
Dependent Claim 196 words
A speech processing system operable to provide on-demand expansion of a selected portion of a linguistic model, wherein predetermined linguistic information established for training said system is represented in a hierarchal cascade of network models and a linkage between successive levels of said network models is defined by a mapping function, and wherein at least one path within each said network model is defined by connections among a plurality of predetermined states, said system comprising: decoding means for evaluating input speech signals against a candidate speech segment provided by one of said network models; a finite state transducer operable to represent said mapping function between at least one of said network models and an adjacent one of said cascaded network models; means for selecting a state in said transducer having a correspondence to said selected portion of said network model; means for composing said transducer with a next successively higher level of said network model to prescribe a mapped portion of said next successively higher level corresponding to said selected portion of said network model; and means for iteratively applying said transducer and said composing means to successively higher level network models representing said selected portion.
Claim 12
Dependent Claim 196 words
A speech processing system operable to provide on-demand expansion of a selected portion of a linguistic model, wherein predetermined linguistic information established for training said system is represented in a hierarchal cascade of network models and a linkage between successive levels of said network models is defined by a mapping function, and wherein at least one path within each said network model is defined by connections among a plurality of predetermined states, said system comprising: decoding means for evaluating input speech signals against a candidate speech segment provided by one of said network models; a finite state transducer operable to represent said mapping function between at least one of said network models and an adjacent one of said cascaded network models; means for selecting a state in said transducer having a correspondence to said selected portion of said network model; means for composing said transducer with a next successively higher level of said network model to prescribe a mapped portion of said next successively higher level corresponding to said selected portion of said network model; and means for iteratively applying said transducer and said composing means to successively higher level network models representing said selected portion.
Claim 13
Dependent Claim 29 words
The speech processing system of claim 10 further characterized in that at least one of said levels of said network cascade is represented in terms of context dependent units.
Claim 14
Dependent Claim 66 words
The speech processing system of claim 10 further characterized in that said selecting step and said composing step are implemented as a generalized state machine C, said machine being created as a composition of a generalized state machine A, corresponding to said one of said at least one transducers, with a generalized state machine B, corresponding to said next successively higher level of said network cascade.
Claim 15
Dependent Claim 186 words
The speech processing system of claim 12 wherein said generalized state machine C supports the functions: C.start:=returns A.start paired with B.start C.final((s 1 ,s 2 )):=for state s 1 ,s 2 , returns A.final(s 1 ) Ù B.final(s 2 ) C.arcs((s 1 ,s 2 )):=for state s 1 ,s 2 , returns Merge(A.arcs(s 1 ), B.arcs(s 2 )) where merged arcs are defined as: (label 1 , label 3 , x+y, (next state 1 , next state 2 )) Î Merge(A.arcs(s 1 ), B.arcs(s 2 )) iff (label 1 , label 2 , x, next state 1 ) Î A.arcs(s 1 ) and (label 2 , label 3 , y, next state 2 ) Î B.arcs(s 2 ); where, using M to represent any of generalized state machines C, A or B: M.start returns, on request, the start state for machine M; M.final(state) represents probability of accepting at a given state; and M.arcs(state) returns, for a given state, transitions (a 1 , a 2 , . . . a N ) leaving the given state, where a i =(input label, output label, weight & next state).
Claim 16
Dependent Claim 30 words
The speech processing system of claim 10 further including a storage cache for storing at least a part of said on-demand expansion of said selected portion of said network cascade.
Claim 17
Dependent Claim 101 words
The speech processing system of claim 14 wherein said storage cache is implemented as a generalized state machine of the form: N.start:=M.start N.final(state):=M.final(state) N.arcs(state):=M.arcs(state) where: M represents an input machine and N represents said cache machine; M.start returns, on request, the start state for machine M; M.final(state) represents probability of accepting at a given state; and M.arcs(state) returns, for a given state, transitions (a 1 , a 1 , . . . a N ) leaving the given state, where a i =(input) label, output label, weight & next state); and corresponding functions of generalized state machine N are equivalently defined.
Claim 18
Dependent Claim 26 words
The speech processing system of claim 10 further characterized in that said selected portion of said network cascade corresponds to an unknown speech fragment of interest.
Claim 19
Dependent Claim 32 words
The speech processing system of claim 10 further including a filter means operative to remove redundant paths occurring between a pair of states in a composition created by said means for composing.
Claim 20
Dependent Claim 241 words
In a system for recognition of an unknown pattern in an input signal, said pattern being indicative of underlying information content, wherein data applied to train said system are represented in a hierarchal cascade of network models and a linkage between successive levels of said network models is defined by a mapping function, and wherein at least one path within each said network model is defined by connections among a plurality of predetermined states, a method for input pattern evaluation by on-demand expansion of a selected portion of at least one of said network models comprising the steps of: formulating said at least one of said network models as a finite state transducer, said transducer representing said mapping function between said at least one network model and an adjacent one of said cascaded network models; selecting a state in a one of said at least one transducers having a correspondence to said selected portion of said at least one network model; composing said one of said at least one transducers with a next successively higher level of said network models to prescribe a mapped portion of said next successively higher level corresponding to said selected portion of said at least one network model; iteratively repeating said selecting step and said composing step for each successively higher level network model representing said selected portion; and evaluating an input signal pattern against a candidate pattern segment provided by one of said network models.
Claim 21
Dependent Claim 241 words
In a system for recognition of an unknown pattern in an input signal, said pattern being indicative of underlying information content, wherein data applied to train said system are represented in a hierarchal cascade of network models and a linkage between successive levels of said network models is defined by a mapping function, and wherein at least one path within each said network model is defined by connections among a plurality of predetermined states, a method for input pattern evaluation by on-demand expansion of a selected portion of at least one of said network models comprising the steps of: formulating said at least one of said network models as a finite state transducer, said transducer representing said mapping function between said at least one network model and an adjacent one of said cascaded network models; selecting a state in a one of said at least one transducers having a correspondence to said selected portion of said at least one network model; composing said one of said at least one transducers with a next successively higher level of said network models to prescribe a mapped portion of said next successively higher level corresponding to said selected portion of said at least one network model; iteratively repeating said selecting step and said composing step for each successively higher level network model representing said selected portion; and evaluating an input signal pattern against a candidate pattern segment provided by one of said network models.
Claim 22
Dependent Claim 27 words
The method for on-demand expansion of claim 18 wherein at least one of said levels of said network cascade is represented in terms of context dependent units.
Claim 23
Dependent Claim 235 words
In a system for processing linguistic information in an input signal, wherein predetermined linguistic information established for training said system is represented in a hierarchal cascade of network models and a linkage between successive levels of said network models is defined by a mapping function, and wherein at least one path within each said network model is defined by connections among a plurality of predetermined states, a method for evaluation of input linguistic information by on-demand expansion of a selected portion of at least one of said network models comprising the steps of: formulating said at least one of said network models as a finite state transducer, said transducer representing said mapping function between said at least one network model and an adjacent one of said cascaded network models; selecting a state in a one of said at least one transducers having a correspondence to said selected portion of said at least one network model; composing said one of said at least one transducers with a next successively higher level of said network models to prescribe a mapped portion of said next successively higher level corresponding to said selected portion of said at least one network model; iteratively repeating said selecting step and said composing step for each successively higher level network model representing said selected portion; and evaluating an input linguistic-information signal against a candidate linguistic-information segment provided by one of said network models.
Claim 24
Dependent Claim 235 words
In a system for processing linguistic information in an input signal, wherein predetermined linguistic information established for training said system is represented in a hierarchal cascade of network models and a linkage between successive levels of said network models is defined by a mapping function, and wherein at least one path within each said network model is defined by connections among a plurality of predetermined states, a method for evaluation of input linguistic information by on-demand expansion of a selected portion of at least one of said network models comprising the steps of: formulating said at least one of said network models as a finite state transducer, said transducer representing said mapping function between said at least one network model and an adjacent one of said cascaded network models; selecting a state in a one of said at least one transducers having a correspondence to said selected portion of said at least one network model; composing said one of said at least one transducers with a next successively higher level of said network models to prescribe a mapped portion of said next successively higher level corresponding to said selected portion of said at least one network model; iteratively repeating said selecting step and said composing step for each successively higher level network model representing said selected portion; and evaluating an input linguistic-information signal against a candidate linguistic-information segment provided by one of said network models.
Claim 25
Dependent Claim 235 words
In a system for processing linguistic information, wherein predetermined linguistic information established for training said system is represented in a hierarchal cascade of network models and a linkage between successive levels of said network models is defined by a mapping function, and wherein at least one path within each said network model is defined by connections among a plurality of predetermined states, a sub-system for providing on-demand expansion of a selected portion of at least one of said network models, comprising: decoding means for evaluating an input linguistic-information signal against a candidate linguistic-information segment provided by one of said network models means for formulating said at least one of said network models as a finite state transducer, said transducer representing said mapping function between said at least one network model and an adjacent one of said cascaded network models; means for selecting a state in a one of said at least one transducers having a correspondence to said selected portion of said at least one network model; means for composing said one of said at least one transducers with a next successively higher level of said network models to prescribe a mapped portion of said next successively higher level corresponding to said selected portion of said at least one network model; and means for iteratively applying said means for selecting and said means for composing for successively higher level network models representing said selected portion.
Claim 26
Dependent Claim 235 words
In a system for processing linguistic information, wherein predetermined linguistic information established for training said system is represented in a hierarchal cascade of network models and a linkage between successive levels of said network models is defined by a mapping function, and wherein at least one path within each said network model is defined by connections among a plurality of predetermined states, a sub-system for providing on-demand expansion of a selected portion of at least one of said network models, comprising: decoding means for evaluating an input linguistic-information signal against a candidate linguistic-information segment provided by one of said network models means for formulating said at least one of said network models as a finite state transducer, said transducer representing said mapping function between said at least one network model and an adjacent one of said cascaded network models; means for selecting a state in a one of said at least one transducers having a correspondence to said selected portion of said at least one network model; means for composing said one of said at least one transducers with a next successively higher level of said network models to prescribe a mapped portion of said next successively higher level corresponding to said selected portion of said at least one network model; and means for iteratively applying said means for selecting and said means for composing for successively higher level network models representing said selected portion.

References Cited (Backward Citations)

US5086472A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2004-08-20 2005-02-19 2005-08-21 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2008-08-20 2009-02-19 2009-08-21 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2012-08-20 2013-02-19 2013-08-21 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag