US5625747A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Speaker verification, speech recognition and channel normalization through dynamic time/frequency warping
Assignee: Nokia of America Corp
•
Filing: 1994-09-21
•
Granted: 1997-04-29
•
Expires: 2014-09-21
Abstract
Abstract A Dynamic Time/Frequency Warping (DTFW) technique is disclosed for speaker verification, speech recognition and channel normalization, among other uses. The DTFW technique utilities best path dynamic programming methods using a 3-dimensional time frequency array representing the spectral differences between a test utterance (the utterance being analyzed) and a reference utterance (template). The array is created by summing the squares of the differences of each feature in each frame of the template with each feature in each frame of the utterance in question. Dynamic programming techniques are then used to find the minimal distance path matching the test utterance and the template so as to optimize the time and frequency warping paths.
Inventors
- 👤 Randy G. Goldberg
- 👤 Gerard P. Lynch
- 👤 Richard R. Rosinski
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 19:26
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/08; G10L15/12
Claims Analysis
Total Claims: 17
Claim 1
Independent Claim
119 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; generating a model path signal; comparing said model path signal with said difference signal; and verifying a source of said test acoustic parameter signals from said comparison of said model path signal with said difference signal.
Claim 2
Independent Claim
119 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; generating a model path signal; comparing said model path signal with said difference signal; and verifying a source of said test acoustic parameter signals from said comparison of said model path signal with said difference signal.
Claim 3
Independent Claim
121 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; generating a model path signal; comparing said model path signal with said difference signal; and recognizing a particular sound from said test acoustic parameter signals based on said comparison of said model path signal with said difference signal.
Claim 4
Independent Claim
121 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; generating a model path signal; comparing said model path signal with said difference signal; and recognizing a particular sound from said test acoustic parameter signals based on said comparison of said model path signal with said difference signal.
Claim 5
Independent Claim
113 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; generating a model path signal; comparing said model path signal with said difference signal; and normalizing audio channels by said comparison of said model path signal with said difference signal.
Claim 6
Independent Claim
113 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; generating a model path signal; comparing said model path signal with said difference signal; and normalizing audio channels by said comparison of said model path signal with said difference signal.
Claim 7
Independent Claim
112 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; determining a warped path from said warped test acoustic parameter signals; and classifying said warped path to determine whether frequency warping is due to channel differences or speaker differences.
Claim 8
Independent Claim
112 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; determining a warped path from said warped test acoustic parameter signals; and classifying said warped path to determine whether frequency warping is due to channel differences or speaker differences.
Claim 9
Independent Claim
112 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; comparing said difference signal to a threshold signal; and verifying a source of said test acoustic parameter signals from said comparison of said difference signal to said threshold signal.
Claim 10
Independent Claim
112 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; comparing said difference signal to a threshold signal; and verifying a source of said test acoustic parameter signals from said comparison of said difference signal to said threshold signal.
Claim 11
Independent Claim
114 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; comparing said difference signal to a threshold signal; and recognizing a particular sound from said test acoustic parameter signals based on said comparison of said difference signal to said threshold signal.
Claim 12
Independent Claim
114 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; comparing said difference signal to a threshold signal; and recognizing a particular sound from said test acoustic parameter signals based on said comparison of said difference signal to said threshold signal.
Claim 13
Independent Claim
106 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; comparing said difference signal to a threshold signal; and normalizing audio channels by said comparison of said difference signal to said threshold signal.
Claim 14
Independent Claim
106 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; comparing said difference signal to a threshold signal; and normalizing audio channels by said comparison of said difference signal to said threshold signal.
Claim 15
Independent Claim
129 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; generating Euclidean distance measurement signals in the time domain from said reference acoustic parameter signals and said test acoustic parameter signals; generating a least distance path signal from said Euclidean distance measurement signals; and generating a least distance score signal from said Euclidean distance measurement signals.
Claim 16
Independent Claim
129 words
A method of analyzing acoustic signals, comprising the steps of: receiving acoustic signals; generating test acoustic parameter signals from said acoustic signals; comparing said test acoustic parameters signals with reference acoustic parameter signals; generating warped test acoustic parameter signals in the time and frequency domains; comparing said warped test acoustic parameter signals to said reference acoustic parameter signals; determining a difference between said warped test acoustic parameter signals and said reference acoustic parameter signals; generating a difference signal corresponding to said determined difference; generating Euclidean distance measurement signals in the time domain from said reference acoustic parameter signals and said test acoustic parameter signals; generating a least distance path signal from said Euclidean distance measurement signals; and generating a least distance score signal from said Euclidean distance measurement signals.
Claim 17
Dependent Claim
80 words
The method of claim 2 wherein said warping step further comprises the dynamic time/frequency warping steps of: generating transposed signals corresponding to said test acoustic parameter signals; generating from said transposed signals and said reference acoustic parameter signals a plurality of least distance path signals and least distance score signals by dynamic time warping; and generating a least distance score signal and a least distance path signal from said plurality of least distance path signals and least distance score signals.
References Cited (Backward Citations)
US3700815A
Cited
US4078154A
Cited
US4344031A
Cited
US4348553A
Cited
US4752958A
Cited
US5146539A
Cited
US4783804A
Cited
US4941178A
Cited
US4903306A
Cited
US4926488A
Cited
US5091948A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-04-28 | 2000-10-28 | 2001-04-29 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-04-28 | 2004-10-28 | 2005-04-29 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-04-28 | 2008-10-28 | 2009-04-29 | $7700.00 | Window Closed / Lapsed |