US4937873A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Computationally efficient sine wave synthesis for acoustic waveform processing
Assignee: Massachusetts Institute of Technology
•
Filing: 1988-04-08
•
Granted: 1990-06-26
•
Expires: 2008-04-08
Abstract
Abstract Methods and apparatus for reducing discontinuities between frames of sinusoidally modeled acoustic waveforms, such as speech, which occur when sampling at low frame rates. A Fast Fourier Transform-based overlap-add technique is applied to amplitude, frequency and phase components of sinusoidal waves after frame-to-frame sine wave matching has been performed. Matched sine wave amplitudes and frequencies are linearly interpolated and mid-point phase is estimated such that the mid-frame sine wave is best fit to the most recent half-frame segments of the lagging and leading sine waves. Synthetic mid-frame sine waves are generated using the interpolated amplitude and frequency and estimated phase values. Synthesized acoustic waveforms of high quality from original source waveforms can be produced in sinusoidal analysis/synthesis operations at coding frame rates of 50 Hz and lower. The methods and devices disclosed herein are particularly useful for computationally efficient coding and synthesis of speech waveforms.
Inventors
- 👤 Robert J. McAulay
- 👤 Thomas F. Quatieri, Jr.
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 19:53
CPC Classifications
G; G10; G10L; G10L19/00; G10L19/04; G10L19/08; G10L19/093
Claims Analysis
Total Claims: 31
Claim 1
Independent Claim
119 words
A method of processing an acoustic waveform, the method comprising: sampling a waveform to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples; analyzing each frame of samples to extract a set of variable frequency components having individual amplitudes; tracking said components from one frame to a next frame, said tracking including matching a component from the one frame with a component in the next frame having a similar value regardless of shifts in frequency and spectral energy; and interpolating the values of the components from the one frame to the next frame by performing an overlap-and-add function utilizing Fourier analysis to generate a reconstruction of said waveforms.
Claim 2
Independent Claim
119 words
A method of processing an acoustic waveform, the method comprising: sampling a waveform to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples; analyzing each frame of samples to extract a set of variable frequency components having individual amplitudes; tracking said components from one frame to a next frame, said tracking including matching a component from the one frame with a component in the next frame having a similar value regardless of shifts in frequency and spectral energy; and interpolating the values of the components from the one frame to the next frame by performing an overlap-and-add function utilizing Fourier analysis to generate a reconstruction of said waveforms.
Claim 3
Dependent Claim
36 words
The method of claim 1 wherein said interpolating step further includes estimating mid-frame values and interpolating between said mid-frame values and values obtained during each frame in order to generate a refined representation of the waveform.
Claim 4
Dependent Claim
26 words
The method of claim 2 wherein said estimating step further includes deriving mid-frame amplitude and frequency values by linear interpolation of lagging and leading sine waves.
Claim 5
Dependent Claim
43 words
The method of claim 2 wherein said estimating step further includes providing a mid-frame phase value such that the sine wave corresponding to the interpolated mid-frame values of the parametric representation is best fit to predetermined segments of lagging and leading sine waves.
Claim 6
Dependent Claim
93 words
The method of claim 2 wherein said estimating step further includes deriving mid-frame phase values from the lagging and leading sine waves according to the following equation θ(M)=(θ.sub.o +θ.sub.1)/2+(ω.sub.o -ω.sub.1)/2.N/4+πM where M is an integer whose value is chosen, such that πM is closest to (θ.sub.o -θ.sub.1)/2+(ω.sub.o +ω.sub.1)/2.N/4 and where θ o is the phase of the lagging frame, θ 1 is the phase of the leading frame, ω o is the frequency of the lagging frame, ω 1 is the frequency of the leading frame, and N is the analysis frame length.
Claim 7
Dependent Claim
14 words
The method of claim 1 wherein the method further includes suppressing tonal noise values.
Claim 8
Dependent Claim
26 words
The method of claim 6 wherein the method further includes estimating a noise envelope and using said noise envelope estimate to drive a noise suppression filter.
Claim 9
Dependent Claim
19 words
The method of claim 6 wherein the method further includes generating broadband noise to replace said suppressed noise values.
Claim 10
Independent Claim
70 words
A method for suppressing tonal noise artifacts during the reconstruction of an acoustic waveform from a sinusoidal parametric representation of the waveform, the method comprising; estimating a noise envelope from a set of variable frequency components having individual amplitudes which comprise a parametric representation of the waveform; reconstructing an acoustic waveform from said parametric representation; and filtering said reconstructed waveform using said noise envelope estimates to suppress tonal noise estimates.
Claim 11
Independent Claim
70 words
A method for suppressing tonal noise artifacts during the reconstruction of an acoustic waveform from a sinusoidal parametric representation of the waveform, the method comprising; estimating a noise envelope from a set of variable frequency components having individual amplitudes which comprise a parametric representation of the waveform; reconstructing an acoustic waveform from said parametric representation; and filtering said reconstructed waveform using said noise envelope estimates to suppress tonal noise estimates.
Claim 12
Independent Claim
94 words
A method of deriving phase values for frequency components during reconstruction of an acoustic waveform from a sinusoidal representation of the waveform, the method comprising: determining a phase of the fundamental frequency by integration of a pitch frequency obtained by linear interpolation of matched fundamental frequencies between successive frames; determining a pitch onset time by locating the time at which the phase function crosses the nearest multiple of the phase synchrony point; and allocating phase values to the frequency components, such that all of the frequency components come into phase every pitch onset time.
Claim 13
Independent Claim
94 words
A method of deriving phase values for frequency components during reconstruction of an acoustic waveform from a sinusoidal representation of the waveform, the method comprising: determining a phase of the fundamental frequency by integration of a pitch frequency obtained by linear interpolation of matched fundamental frequencies between successive frames; determining a pitch onset time by locating the time at which the phase function crosses the nearest multiple of the phase synchrony point; and allocating phase values to the frequency components, such that all of the frequency components come into phase every pitch onset time.
Claim 14
Independent Claim
136 words
A system for processing an acoustic waveform, the system comprising sampling means for sampling a waveform to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples, analyzing means for analyzing each frame of samples to extract a set of variable frequency components having individual amplitudes, tracking means for tracking said components from one frame to a next frame, said tracking means including matching means for matching a component from the one frame with a component in the next frame having a similar value regardless of shifts in frequency and special energy, interpolating means for interpolating the values of the components from the one frame to the next frame, including means for performing an overlap-and-add function utilizing Fourier analysis to generate a reconstruction of said waveform.
Claim 15
Independent Claim
136 words
A system for processing an acoustic waveform, the system comprising sampling means for sampling a waveform to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples, analyzing means for analyzing each frame of samples to extract a set of variable frequency components having individual amplitudes, tracking means for tracking said components from one frame to a next frame, said tracking means including matching means for matching a component from the one frame with a component in the next frame having a similar value regardless of shifts in frequency and special energy, interpolating means for interpolating the values of the components from the one frame to the next frame, including means for performing an overlap-and-add function utilizing Fourier analysis to generate a reconstruction of said waveform.
Claim 16
Dependent Claim
42 words
The system of claim 11 wherein said interpolating means further includes mid-frame estimating means for estimating mid-frame values and means for interpolating between said mid-frames values and values obtained during each frame in order to generate a refined representation of the waveform.
Claim 17
Dependent Claim
32 words
The system of claim 12 wherein said mid-frame estimating means further includes means for linearly interpolating the amplitude and frequency values of the lagging and leading sin waves to obtain mid-frame values.
Claim 18
Dependent Claim
44 words
The system of claim 12 wherein said mid-frame estimating means further includes means for deriving mid-frame phase values such that sine waves corresponding to the interpolated mid-frame values of the parametric representation is best fit to predetermined segments of lagging and leading sine waves.
Claim 19
Dependent Claim
95 words
The system of claim 12 wherein said mid-frame estimating means further includes means for deriving mid-frame phase values from lagging and leading sine waves according to the following equation: θ(M)=(θ.sub.o +θ.sub.1)/2+(ω.sub.o -ω.sub.1)/2.N/4+πM where M is an integer whose value is chosen, such that πM is closest to (θ.sub.o -θ.sub.1)/2+(ω.sub.o +ω.sub.1)/2.N/4 and where θ o is the phase of the lagging frame, θ 1 is the phase of the leading frame, ωhd o is the frequency of the lagging frame, ω 1 is the frequency of the leading frame, and N is the analysis frame length.
Claim 20
Dependent Claim
15 words
The system of claim 11 wherein said system further includes means for suppressing tonal values.
Claim 21
Dependent Claim
34 words
The system of claim 16 wherein said system further includes noise estimating means for estimating a noise envelope and a filter means for suppressing tonal noise values in response to said noise envelope estimate.
Claim 22
Dependent Claim
23 words
The system of claim 16 wherein said system further includes a broadband noise generator to replace said suppressed noise values with broadband noise.
Claim 23
Dependent Claim
150 words
A receiver for receiving a coded parametric representation of an acoustic waveform in which the representation comprises as set of variable frequency components having individual amplitudes defining sine waves which can be summed to recreate the waveform at a particular frame of time, the receiver comprising: decoding means for extracting a set of frequency components having individual amplitudes from each frame of a coded representation of an acoustic waveform; tracking means for tracking said components from one frame to a next frame, said tracking means, including matching means for matching a component from the one frame with a component in the next frame having a similar value regardless of shifts in frequency and spectral energy; and interpolation means for interpolating the values of the components from the one frame to the next frame, including means for performing an overlap-and-add function utilizing Fourier analysis, to generate a reconstruction of said waveform.
Claim 24
Dependent Claim
150 words
A receiver for receiving a coded parametric representation of an acoustic waveform in which the representation comprises as set of variable frequency components having individual amplitudes defining sine waves which can be summed to recreate the waveform at a particular frame of time, the receiver comprising: decoding means for extracting a set of frequency components having individual amplitudes from each frame of a coded representation of an acoustic waveform; tracking means for tracking said components from one frame to a next frame, said tracking means, including matching means for matching a component from the one frame with a component in the next frame having a similar value regardless of shifts in frequency and spectral energy; and interpolation means for interpolating the values of the components from the one frame to the next frame, including means for performing an overlap-and-add function utilizing Fourier analysis, to generate a reconstruction of said waveform.
Claim 25
Dependent Claim
42 words
The receiver of claim 19 wherein said interpolating means further includes mid-frame estimating means for estimating mid-frame values and means for interpolating between said mid-frames values and values obtained during each frame in order to generate a refined representation of the waveform.
Claim 26
Dependent Claim
32 words
The receiver of claim 20 wherein said mid-frame estimating means further includes means for linearly interpolating the amplitude and frequency values of the lagging and leading sine waves to obtain mid-frame values.
Claim 27
Dependent Claim
44 words
The receiver of claim 20 wherein said mid-frame estimating means further includes means for deriving mid-frame phase values such that sine waves corresponding to the interpolated mid-frame values of the parametric representation is best fit to predetermined segments of lagging and leading sine waves.
Claim 28
Dependent Claim
95 words
The receiver of claim 20 wherein said mid-frame estimating means further includes means for deriving mid-frame phase values from lagging and leading sine waves according to the following equation: θ(M)=(θ.sub.o +θ.sub.1)/2+(ω.sub.o -ω.sub.1)/2.N/4+πM where M is an integer whose value is chosen, such that πM is closest to (θ.sub.o -θ.sub.1)/2+(ω.sub.o +ω.sub.1)/2.N/4 and where θ o is the phase of the lagging frame, θ 1 is the phase of the leading frame, ω o is the frequency of the lagging frame, ω 1 is the frequency of the leading frame, and N is the analysis frame length.
Claim 29
Dependent Claim
15 words
The receiver of claim 19 wherein said system further includes means for suppressing tonal values.
Claim 30
Dependent Claim
34 words
The receiver of claim 24 wherein said system further includes noise estimating means for estimating a noise envelope and a filter means for suppressing tonal noise values in response to said noise envelope estimate.
Claim 31
Dependent Claim
23 words
The receiver of claim 24 wherein said system further includes a broadband noise generator to replace said suppressed noise values with broadband noise.
References Cited (Backward Citations)
US3296374A
Cited
US3360610A
Cited
US3484556A
Cited
US3982070A
Cited
US3978287A
Cited
US4034160A
Cited
US4058676A
Cited
US4076958A
Cited
US4701955A
Cited
US4752956A
Cited
US4701953A
Cited
WO1986005617A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1993-06-25 | 1993-12-25 | 1994-06-26 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1997-06-25 | 1997-12-25 | 1998-06-26 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2001-06-25 | 2001-12-25 | 2002-06-26 | $7700.00 | Window Closed / Lapsed |