US5890108A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Low bit-rate speech coding system and method using voicing probability determination
Assignee: Voxware Inc
•
Filing: 1996-10-03
•
Granted: 1999-03-30
•
Expires: 2016-10-03
Abstract
Abstract A modular system and method is provided for low bit rate encoding and decoding of speech signals using voicing probability determination. The continuous input speech is divided into time segments of a predetermined length. For each segment the encoder of the system computes a model signal and subtracts the model signal from the original signal in the segment to obtain a residual excitation signal. Using the excitation signal the system computes the signal pitch and a parameter which is related to the relative content of voiced and unvoiced portions in the spectrum of the excitation signal, which is expressed as a ratio Pv, defined as a voicing probability. The voiced and the unvoiced portions of the excitation spectrum, as determined by the parameter Pv, are encoded using one or more parameters related to the energy of the excitation signal in a predetermined set of frequency bands. In the decoder, speech is synthesized from the transmitted parameters representing the model speech, the signal pitch, voicing probability and excitation levels in a reverse order. Boundary conditions between voiced and unvoiced segments are established to ensure amplitude and phase continuity for improved output speech quality. Perceptually smooth transition between frames is ensured by using an overlap and add method of synthesis. LPC interpolation and post-filtering is used to obtain output speech with improved perceptual quality.
Inventors
- 👤 Suat Yeldener
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-02 02:10
CPC Classifications
G; G10; G10L; G10L19/00; G10L19/04; G10L19/08; G10L19/12; G10L19/16; G10L19/18; G10L19/10; G10L25/00; G10L25/93
Claims Analysis
Total Claims: 36
Claim 1
Independent Claim
156 words
A method for processing an audio signal comprising: dividing the signal into segments, each segment representing one of a succession of time intervals; computing for each segment a model of the signal in such segment; subtracting the computed model from the original signal to obtain a residual excitation signal; detecting for each segment the presence of a fundamental frequency F 0 ; determining for the excitation signal in each segment a ratio between voiced and unvoiced components of the signal in such segment on the basis of the fundamental frequency F 0 , said ratio being defined as a voicing probability Pv; separating the excitation signal in each segment into a voiced portion and an unvoiced portion on the basis of the voicing probability Pv; and encoding parameters of the model of the signal in each segments and the voiced portion and the unvoiced portion of the excitation signal in each segment in separate data paths.
Claim 2
Independent Claim
156 words
A method for processing an audio signal comprising: dividing the signal into segments, each segment representing one of a succession of time intervals; computing for each segment a model of the signal in such segment; subtracting the computed model from the original signal to obtain a residual excitation signal; detecting for each segment the presence of a fundamental frequency F 0 ; determining for the excitation signal in each segment a ratio between voiced and unvoiced components of the signal in such segment on the basis of the fundamental frequency F 0 , said ratio being defined as a voicing probability Pv; separating the excitation signal in each segment into a voiced portion and an unvoiced portion on the basis of the voicing probability Pv; and encoding parameters of the model of the signal in each segments and the voiced portion and the unvoiced portion of the excitation signal in each segment in separate data paths.
Claim 3
Dependent Claim
33 words
The method of claim 1 wherein the audio signal is a speech signal and detecting the presence of a fundamental frequency F 0 comprises computing the spectrum of the signal in a segment.
Claim 4
Dependent Claim
36 words
The method of claim 2 wherein the voiced portion of the signal occupies the low end of the spectrum and the unvoiced portion of the signal occupies the high end of the spectrum for each segment.
Claim 5
Dependent Claim
27 words
The method of claim 1 wherein computing a model comprises modeling the spectrum of the signal in each segment as the output of a linear time-varying filter.
Claim 6
Dependent Claim
40 words
The method of claim 4 wherein modeling the spectrum of the signal in each segment comprises computing a set of linear predictive coding (LPC) coefficients and encoding parameters of the model of the signal comprises encoding the computed LPC coefficients.
Claim 7
Dependent Claim
34 words
The method of claim 5 wherein encoding the LPC coefficients comprises computing line spectral frequencies (LSF) coefficients corresponding to the LPC coefficients and encoding of the computed LSF coefficients for subsequent storage and transmission.
Claim 8
Dependent Claim
52 words
The method of claim 1 further comprising: forming one or more data packets corresponding to each segment for subsequent transmission or storage, the one or more data packets comprising: the fundamental frequency F 0 , data representative of the computed model of the signal, and the voicing probability Pv for the signal.
Claim 9
Dependent Claim
28 words
The method of claim 7 further comprising: receiving the one or more data packets; and synthesizing audio signals from the received one or more data packets data packets.
Claim 10
Dependent Claim
41 words
The method of claim 8 wherein synthesizing audio signal comprises: decoding the received one or more data packets to extract: the fundamental frequency, the data representative of the computed model of the signal and the voicing probability Pv for the signal.
Claim 11
Dependent Claim
91 words
The method of claim 9 further comprising: synthesizing an audio signal from the extracted data, wherein the low frequency band of the spectrum of said synthesized audio signal is synthesized using data representative of the voiced portion of the signal; the high frequency band of the spectrum of said synthesized audio signal is synthesized using data representative of the unvoiced portion of the signal and the boundary between the low frequency band and the high frequency band of the spectrum is determined on the basis of the decoded voicing probability Pv.
Claim 12
Dependent Claim
32 words
The method of claim 10 wherein the audio signal being synthesized is a speech signals and synthesizing further comprises: providing amplitude and phase continuity on the boundary between adjacent synthesized speech segments.
Claim 13
Independent Claim
170 words
A system for processing an audio signal comprising: means for dividing the signal into segments, each segment representing one of a succession of time intervals; means for computing for each segment a model of the signal in such segment; means for subtracting the computed model from the original signal to obtain a residual excitation signal; means for detecting for each segment the presence of a fundamental frequency F 0 ; means for determining for the excitation signal in each segment a ratio between voiced and unvoiced components of the signal in such segment on the basis of the fundamental frequency F 0 , said ratio being defined as a voicing probability Pv; means for separating the excitation signal in each segment into a voiced portion and an unvoiced portion on the basis of the voicing probability Pv; and means for encoding parameters of the model of the signal in each segments and the voiced portion and the unvoiced portion of the excitation signal in each segment in separate data paths.
Claim 14
Independent Claim
170 words
A system for processing an audio signal comprising: means for dividing the signal into segments, each segment representing one of a succession of time intervals; means for computing for each segment a model of the signal in such segment; means for subtracting the computed model from the original signal to obtain a residual excitation signal; means for detecting for each segment the presence of a fundamental frequency F 0 ; means for determining for the excitation signal in each segment a ratio between voiced and unvoiced components of the signal in such segment on the basis of the fundamental frequency F 0 , said ratio being defined as a voicing probability Pv; means for separating the excitation signal in each segment into a voiced portion and an unvoiced portion on the basis of the voicing probability Pv; and means for encoding parameters of the model of the signal in each segments and the voiced portion and the unvoiced portion of the excitation signal in each segment in separate data paths.
Claim 15
Dependent Claim
35 words
The system of claim 12 wherein the audio signal is a speech signal and the means for detecting the presence of a fundamental frequency F 0 comprises means for computing the spectrum of the signal.
Claim 16
Dependent Claim
33 words
The system of claim 13 further comprising: means for computing LPC coefficients for a signal segment; and means for transforming LPC coefficients into line spectral frequencies (LSF) coefficients corresponding to the LPC coefficients.
Claim 17
Dependent Claim
100 words
The system of claim 12 wherein said means for determining a ratio between voiced and unvoiced components further comprises: means for generating a fully voiced synthetic spectrum of a signal corresponding to the detected fundamental frequency F 0 ; means for evaluating an error measure for each frequency bin corresponding to harmonics of the fundamental frequency in the spectrum of the signal; and means for determining the voicing probability Pv of the segment as the ratio of harmonics for which the evaluated error measure is below certain threshold and the total number of harmonics in the spectrum of the signal.
Claim 18
Dependent Claim
54 words
The system of claim 12 further comprising: means for forming one or more data packets corresponding to each segment for subsequent transmission or storage, the one or more data packets comprising: the fundamental frequency F 0 , data representative of the computed model of the signal, and the voicing probability Pv for the signal.
Claim 19
Dependent Claim
35 words
The system of claim 16 further comprising: means for receiving the one or more data packets over communications medium; and means for synthesizing audio signals from the received one or more data packets data packets.
Claim 20
Dependent Claim
46 words
The system of claim 17 wherein said means for synthesizing audio signals comprises: means for decoding the received one or more data packets to extract: the fundamental frequency, the data representative of the computed model of the signal and the voicing probability Pv for the signal.
Claim 21
Dependent Claim
93 words
The system of claim 18 further comprising: means for synthesizing an audio signal from the extracted data, wherein the low frequency band of the spectrum of said synthesized audio signal is synthesized using data representative of the voiced portion of the signal; the high frequency band of the spectrum of said synthesized audio signal is synthesized using data representative of the unvoiced portion of the signal and the boundary between the low frequency band and the high frequency band of the spectrum is determined on the basis of the decoded voicing probability Pv.
Claim 22
Dependent Claim
34 words
The system of claim 19 wherein the audio signal being synthesized is a speech signals and synthesizing further comprises: means for providing amplitude and phase continuity on the boundary between adjacent synthesized speech segments.
Claim 23
Independent Claim
133 words
A method for synthesizing audio signals from one or more data packets representing at least one time segment of a signal, the method comprising: decoding said one or more data packets to extract data comprising: a fundamental frequency parameter, parameters representative of a spectrum model of the signal in said at least one time segment, and a voicing probability Pv defined as a ratio between voiced and unvoiced components of the signal in said at least one time segment; generating a set of harmonics H corresponding to said fundamental frequency, the amplitudes of said harmonics being determined on the basis of the model of the signal, and the number of harmonics being determined on the basis of the decoded voicing probability Pv; and synthesizing an audio signal using the generated set of harmonics.
Claim 24
Independent Claim
133 words
A method for synthesizing audio signals from one or more data packets representing at least one time segment of a signal, the method comprising: decoding said one or more data packets to extract data comprising: a fundamental frequency parameter, parameters representative of a spectrum model of the signal in said at least one time segment, and a voicing probability Pv defined as a ratio between voiced and unvoiced components of the signal in said at least one time segment; generating a set of harmonics H corresponding to said fundamental frequency, the amplitudes of said harmonics being determined on the basis of the model of the signal, and the number of harmonics being determined on the basis of the decoded voicing probability Pv; and synthesizing an audio signal using the generated set of harmonics.
Claim 25
Dependent Claim
47 words
The method of claim 21 wherein the model of the signal is an LPC model, the extracted data further comprises a gain parameter, and the amplitudes of said harmonics are determined using the gain parameter by sampling the LPC spectrum model at harmonics of the fundamental frequency.
Claim 26
Dependent Claim
38 words
The method of claim 22 wherein the audio signal is speech and generating a set of harmonics comprises applying a frequency domain filtering to shape the LPC spectrum as to improve the perceptual quality of the synthesized speech.
Claim 27
Dependent Claim
82 words
The method of claim 23 wherein the frequency domain filtering is applied in accordance with the expression ##EQU28## where R.sub.ω (ω)=H(ω)W(ω) in which W(ω) is the weighting function, represented as ##EQU29## the coefficient γ is between 0 and 1, and the frequency response H(ω) of the LPC filter is given by: ##EQU30## where a 78 is the coefficient of a ρth order all-pole LPC filter, γ is the weighting coefficient, and R max is the maximum value of the weighted spectral envelope.
Claim 28
Dependent Claim
22 words
The method of claim 22 wherein said parameters representative of a spectrum model are LSF coefficients corresponding to the LPC spectrum model.
Claim 29
Dependent Claim
35 words
The method of claim 25 wherein synthesizing an audio signal comprises linearly interpolating LSF coefficients across a current segment using LSF coefficients from the previous segment as to increase the accuracy of the signal synthesis.
Claim 30
Dependent Claim
19 words
The method of claim 26 wherein linear interpolating LSF is applied at two or more subsegments of the signal.
Claim 31
Independent Claim
162 words
A method for synthesizing audio signals from one or more data packets representing at least one time segment of a signal, the method comprising: decoding said one or more data packets to extract data comprising: a fundamental frequency parameter, parameters representative of a spectrum model of the signal in said at least one time segment, one or more parameters representative of a residual excitation signal associated with said spectrum model of the signal, and a voicing probability Pv defined as a ratio between voiced and unvoiced components of the signal in said at least one time segment; providing a filter, the frequency response of which corresponds to said spectrum model of the signal; and synthesizing an audio signal by passing a residual excitation signal through the provided filter, said residual excitation signal being generated from said fundamental frequency, said one or more parameters representative of a residual excitation signal associated with said spectrum model of the signal, and the voicing probability Pv.
Claim 32
Independent Claim
162 words
A method for synthesizing audio signals from one or more data packets representing at least one time segment of a signal, the method comprising: decoding said one or more data packets to extract data comprising: a fundamental frequency parameter, parameters representative of a spectrum model of the signal in said at least one time segment, one or more parameters representative of a residual excitation signal associated with said spectrum model of the signal, and a voicing probability Pv defined as a ratio between voiced and unvoiced components of the signal in said at least one time segment; providing a filter, the frequency response of which corresponds to said spectrum model of the signal; and synthesizing an audio signal by passing a residual excitation signal through the provided filter, said residual excitation signal being generated from said fundamental frequency, said one or more parameters representative of a residual excitation signal associated with said spectrum model of the signal, and the voicing probability Pv.
Claim 33
Dependent Claim
29 words
The method of claim 28 wherein the provided filter is a LPC filter, and said one or more parameters representative of a residual excitation signal comprises a gain parameter.
Claim 34
Dependent Claim
37 words
The method of claim 28 wherein the audio signal is speech and synthesizing an audio signal comprises applying frequency domain filtering to shape the residual excitation signal as to improve the perceptual quality of the synthesized speech.
Claim 35
Dependent Claim
22 words
The method of claim 28 wherein said parameters representative of a spectrum model are LSF coefficients corresponding to a LPC spectrum model.
Claim 36
Dependent Claim
35 words
The method of claim 31 wherein synthesizing an audio signal comprises linearly interpolating LSF coefficients across a current segment using LSF coefficients from the previous segment as to increase the accuracy of the signal synthesis.
References Cited (Backward Citations)
US4435832A
Cited
US4374302A
Cited
US4392018A
Cited
US4433434A
Cited
US4435831A
Cited
US4468804A
Cited
US4945565A
Cited
US4885790A
Cited
US4856068A
Cited
US4937873A
Cited
US4802221A
Cited
US4771465A
Cited
US4797926A
Cited
US5054072A
Cited
US4864620A
Cited
US5023910A
Cited
US4991213A
Cited
US5081681A
Cited
US5081681B1
Cited
US5226108A
Cited
US5216747A
Cited
US5195166A
Cited
US5226084A
Cited
US5247579A
Cited
US5491772A
Cited
US5353373A
Cited
US5303346A
Cited
US5327518A
Cited
US5267317A
Cited
US5189701A
Cited
US5339164A
Cited
US5369724A
Cited
US5327521A
Cited
WO1994012972A1
Cited
US5517511A
Cited
US5717821A
Cited
US5765126A
Cited
US5630012A
Cited
EP0676744A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-03-29 | 2002-09-28 | 2003-03-30 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-03-29 | 2006-09-28 | 2007-03-30 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-03-29 | 2010-09-28 | 2011-03-30 | $7700.00 | Window Closed / Lapsed |