US4885790A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Processing of acoustic waveforms
Assignee: Massachusetts Institute of Technology
•
Filing: 1989-04-18
•
Granted: 1989-12-05
•
Expires: 2009-04-18
Abstract
Abstract A sinusoidal model for acoustic waveforms is applied to develop a new analysis/synthesis technique which characterizes a waveform by the amplitudes, frequencies, and phases of component sine waves. These parameters are estimated from a short-time Fourier transform. Rapid changes in the highly-resolved spectral components are tracked using the concept of "birth" and "death" of the underlying sine waves. The component values are interpolated from one frame to the next to yield a respresentation that is applied to a sine wave generator. The resulting synthetic waveform preserves the general waveform shape and is perceptually indistinguishable from the original. Furthermore, in the presence of noise the perceptual characteristics of the waveform as well as the noise are maintained. The method and devices are particularly useful in speech coding, time-scale modification, frequency scale modification and pitch modification.
Inventors
- 👤 Robert J. McAulay
- 👤 Thomas F. Quatieri, Jr.
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 19:49
CPC Classifications
G; G10; G10L; G10L19/00; G10L19/02
Claims Analysis
Total Claims: 68
Claim 1
Independent Claim
137 words
A method of processing an acoustic waveform, the method comprising: sampling the waveform to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples; analyzing each frame of samples to extract a set of variable frequency components having individual amplitudes; matching said variable components from one frame to a next frame such that a component in one frame is matched with a component in a successive frame that has a similar value regarless of shifts in frequency and spectral energy; and interpolating the matched values of the components from the one frame to the next frame to obtain a parametric representation of the waveform whereby a synthetic waveform can be constructed by generating a set of sine waves corresponding to the interpolated values of the parametric representation.
Claim 2
Independent Claim
137 words
A method of processing an acoustic waveform, the method comprising: sampling the waveform to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples; analyzing each frame of samples to extract a set of variable frequency components having individual amplitudes; matching said variable components from one frame to a next frame such that a component in one frame is matched with a component in a successive frame that has a similar value regarless of shifts in frequency and spectral energy; and interpolating the matched values of the components from the one frame to the next frame to obtain a parametric representation of the waveform whereby a synthetic waveform can be constructed by generating a set of sine waves corresponding to the interpolated values of the parametric representation.
Claim 3
Dependent Claim
44 words
The method of claim 1 wherein the step of sampling further includes determining a pitch period for said waveform and varying the length of the frame in accordance with the pitch period, the length being at least twice the pitch period of the waveform.
Claim 4
Dependent Claim
21 words
The method of claim 2 wherein the step of sampling further includes sampling the waveform according to a pitch-adaptive Hamming window.
Claim 5
Dependent Claim
18 words
The method of claim 1 wherein the step of analyzing further includes analyzing each frame by Fourier analysis.
Claim 6
Dependent Claim
21 words
The method of claim 1 wherein the step of analyzing further includes selecting a harmonic series to approximate the frequency components.
Claim 7
Dependent Claim
42 words
The method of claim 5 wherein the step of selecting a harmonic series further includes determining a pitch period for the waveform and varying the number of frequency components in the harmonic series in accordance with the pitch period of the waveform.
Claim 8
Dependent Claim
31 words
The method of claim 1 wherein the step of tracking further includes matching a frequency component from the one frame with a component in the next frame having a similar value.
Claim 9
Dependent Claim
24 words
The method of claim 7 wherein said matching further provides for the birth of new frequency components and the death of old frequency components.
Claim 10
Dependent Claim
50 words
The method of claim 1 wherein the step of interpolating values further includes defining a series of instantaneous frequency values by interpolating matched frequency components from the one frame to the next frame and then integrating the series of instantaneous frequency values to obtain a series of interpolated phase values.
Claim 11
Dependent Claim
30 words
The method of claim 1 wherein the step of interpolating further includes deriving phase values from frequency and phase measurements taken at each frame and then interpolating the phase measurements.
Claim 12
Dependent Claim
19 words
The method of claim 1 wherein the step of interpolating is achieved by performing an overlap and add function.
Claim 13
Dependent Claim
17 words
The method of claim 1 wherein the method further includes coding the frequency components for digital transmission.
Claim 14
Dependent Claim
23 words
The method of claim 12 wherein the frequency components are limited to a predetermined number defined by a plurality of harmonic frequency bins.
Claim 15
Dependent Claim
36 words
The method of claim 13 wherein the amplitude of only one of said components is coded for gain and the amplitudes of the others are coded relative to the neighboring component at the next lowest frequency.
Claim 16
Dependent Claim
21 words
The method of claim 12 wherein the phases are coded by applying pulse code modulation techniques to a predicted phase residual.
Claim 17
Dependent Claim
11 words
The method of claim 12 wherein high frequency regeneration is applied.
Claim 18
Dependent Claim
31 words
The method of claim 1 wherein the method further comprises constructing a synthetic waveform by generating a series of constituent sine waves corresponding in frequency and amplitude to the extracted components.
Claim 19
Dependent Claim
28 words
The method of claim 17 wherein the time-scale of said reconstructed waveform is varied by changing the rate at which said series of constituent sine waves are interpolated.
Claim 20
Dependent Claim
15 words
The method of claim 18 wherein the time-scale is continuously variable over a defined range.
Claim 21
Dependent Claim
28 words
The method of claim 17 wherein the pitch of the synthetic waveform is varied by adjusting the frequency of each frequency component while maintaining the overall spectral envelope.
Claim 22
Dependent Claim
32 words
The method of claim 1 wherein the method further comprises constructing a synthetic waveform by generating a series of constituent sine waves corresponding in frequency, amplitude, and phase to the extracted components.
Claim 23
Dependent Claim
28 words
The method of claim 21 wherein the time-scale of said reconstructed waveform is varied by changing the rate at which said series of constitutent sine waves are interpolated.
Claim 24
Dependent Claim
15 words
The method of claim 22 wherein the time-scale is continuously variable over a defined range.
Claim 25
Dependent Claim
33 words
The device of claim 22 wherein the device further comprises means for constructing a synthetic waveform by generating a series of constituent sine waves corresponding in frequency and amplitude to the extracted components.
Claim 26
Dependent Claim
33 words
The device of claim 24 wherein the device further includes means for varying the time-scale of said reconstructed waveform by changing the rate at which said series of constituent sine waves are interpolated.
Claim 27
Dependent Claim
19 words
The device of claim 25 wherein the means for varying the time-scale is continuously variable over a defined range.
Claim 28
Dependent Claim
51 words
The device of claim 24 wherein the constituent sine waves are further defined by system contributions and excitation contributions and wherein the means for varying the time-scale of said reconstructed waveform further includes means for changing the rate at which parameters defining the system contributions of the sine waves are interpolated.
Claim 29
Dependent Claim
18 words
The device of claim 27 wherein the device further includes a scaling means for scaling the frequency components.
Claim 30
Dependent Claim
19 words
The device of claim 27 wherein the device further includes a scaling means for scaling the excitation-contributed frequency components.
Claim 31
Dependent Claim
46 words
The method of claim 21 wherein the constituent sine waves are further defined by system contributions and excitation contributions and wherein the time-scale of said reconstructed waveform is varied by changing the rate at which parameters defining the system contributions of the sine waves are interpolated.
Claim 32
Dependent Claim
29 words
The method of claim 30 wherein the pitch of the synthetic waveform is altered by adjusting the frequencies of the excitation-contributed frequency components while maintaining the overall spectral envelope.
Claim 33
Independent Claim
149 words
A device for processing an acoustic waveform, the device comprising: sampling means for sampling the waveform to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples; analyzing means for analyzing each frame of samples to extract a set of variable frequency components having individual amplitudes; matching means for matching said variable components from one frame to a next frame such that a component in one frame is matched with a component in a successive frame that has a similar value regardless of shifts in frequency and spectral energy; and interpolating means for interpolating the matched values of the components from the one frame to the next frame to obtain a parametric representation of the waveform whereby a synthetic waveform can be constructed by generating a set of sine waves corresponding to the interpolated values of the parametric representation.
Claim 34
Independent Claim
149 words
A device for processing an acoustic waveform, the device comprising: sampling means for sampling the waveform to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples; analyzing means for analyzing each frame of samples to extract a set of variable frequency components having individual amplitudes; matching means for matching said variable components from one frame to a next frame such that a component in one frame is matched with a component in a successive frame that has a similar value regardless of shifts in frequency and spectral energy; and interpolating means for interpolating the matched values of the components from the one frame to the next frame to obtain a parametric representation of the waveform whereby a synthetic waveform can be constructed by generating a set of sine waves corresponding to the interpolated values of the parametric representation.
Claim 35
Dependent Claim
39 words
The device of claim 32 wherein the sampling means further includes means for constructing a frame having variable length, which varies in accordance with the pitch period, the length being at least twice the pitch period of the waveform.
Claim 36
Dependent Claim
19 words
The device of claim 32 wherein the sampling means further includes means for sampling according to a Hamming window.
Claim 37
Dependent Claim
19 words
The device of claim 32 wherein the analyzing means further includes means for analyzing each frame by Fourier analysis.
Claim 38
Dependent Claim
22 words
The device of claim 32 wherein the analyzing means further includes means for selecting a harmonic series to approximate the frequency components.
Claim 39
Dependent Claim
24 words
The device of claim 36 wherein the number of frequency components in the harmonic series varies according to the pitch period of the waveform.
Claim 40
Dependent Claim
32 words
The device of claim 32 wherein the tracking means further includes means for matching a frequency component from the one frame with a component in the next frame having a similar value.
Claim 41
Dependent Claim
25 words
The device of claim 38 wherein said matching means further provides for the birth of new frequency components and the death of old frequency components.
Claim 42
Dependent Claim
23 words
The device of claim 38 wherein the frequency components are limited to a predetermined number defined by a plurality of harmonic frequency bins.
Claim 43
Dependent Claim
36 words
The device of claim 40 wherein the amplitude of only one of said components is coded for gain and the amplitudes of the others are coded relative to the neighboring component of the next lowest frequency.
Claim 44
Dependent Claim
50 words
The device of claim 32 wherein the interpolating means further includes means defining a series of instantaneous frequency values by interpolating matched frequency components from the one frame to the next frame and means for integrating the series of instantaneous frequency values to obtain a series of interpolated phase values.
Claim 45
Dependent Claim
32 words
The device of claim 32 wherein the interpolating means further includes means for deriving phase values from the frequency and phase measurements taken at each frame and then interpolating the phase measurements.
Claim 46
Dependent Claim
19 words
The device of claim 32 wherein the interpolating means further includes means for performing an overlap and add function.
Claim 47
Dependent Claim
20 words
The device of claim 32 wherein the device further includes coding means for coding the frequency components for digital transmission.
Claim 48
Dependent Claim
23 words
The device of claim 45 wherein the coding means further comprises means for applying pulse code modulation techniques to a predicted phase residual.
Claim 49
Dependent Claim
17 words
The device of claim 45 wherein the coding means further comprises means for generating high frequency components.
Claim 50
Dependent Claim
34 words
The device of claim 32 wherein the device further comprises means for constructing a synthetic waveform by generating a series of constitutent sine waves corresponding in frequency, amplitude, and phase to the extracted components.
Claim 51
Dependent Claim
33 words
The device of claim 48 wherein the device further includes means for varying the time-scale of said reconstructed waveform by changing the rate at which said series of constituent sine waves are interpolated.
Claim 52
Dependent Claim
19 words
The device of claim 49 wherein the means for varying the time-scale is continuously variable over a defined range.
Claim 53
Dependent Claim
172 words
A coded speech transmission system comprising: sampling means for sampling a speech waveform to obtain a series of discrete samples and for constructing therefrom a series of frames, each frame spanning a plurality of samples; analyzing means for analyzing each frame of samples by Fourier analysis to extract a set of variable frequency components having individual amplitude values; coding means for coding the component values; decoding means for decoding the coded values after transmission and for reconstituting the variable components; matching means for matching the reconstituted, variable components from one frame to a next frame such that a component is one frame is matched with a component in a successive frame that has a similar value regardless of shifts in frequency and spectral energy; and interpolation means for interpolating the values of the frequency components from the one frame to the next frame to obtain a representation of the waveform whereby synthetic speech can be constructed by generating a set of sine waves corresponding to the interpolated values of the parametric representation.
Claim 54
Dependent Claim
172 words
A coded speech transmission system comprising: sampling means for sampling a speech waveform to obtain a series of discrete samples and for constructing therefrom a series of frames, each frame spanning a plurality of samples; analyzing means for analyzing each frame of samples by Fourier analysis to extract a set of variable frequency components having individual amplitude values; coding means for coding the component values; decoding means for decoding the coded values after transmission and for reconstituting the variable components; matching means for matching the reconstituted, variable components from one frame to a next frame such that a component is one frame is matched with a component in a successive frame that has a similar value regardless of shifts in frequency and spectral energy; and interpolation means for interpolating the values of the frequency components from the one frame to the next frame to obtain a representation of the waveform whereby synthetic speech can be constructed by generating a set of sine waves corresponding to the interpolated values of the parametric representation.
Claim 55
Dependent Claim
37 words
The device of claim 51 wherein the coding means further includes means for selecting a harmonic series of bins to approximate the frequency components and the number of bins varies according to the pitch of the waveform.
Claim 56
Dependent Claim
37 words
The device of claim 51 wherein the amplitude of only one of said components is coded for gain and the amplitudes of the other components are coded relative to the neighboring component at the next lowest frequency.
Claim 57
Dependent Claim
17 words
The device of claim 51 wherein the amplitudes of the components are coded by linear prediction techniques.
Claim 58
Dependent Claim
18 words
The device of claim 51 wherein the amplitudes of the components are coded by adaptive delta modulation techniques.
Claim 59
Dependent Claim
20 words
The device of claim 51 wherein the analyzing means further comprises means for measuring phase values for each frequency component.
Claim 60
Dependent Claim
27 words
The device of claim 56 wherein the coding means further includes means for coding the phase values by applying pulse code modulations to a predicted phase residual.
Claim 61
Independent Claim
194 words
A device for altering the time-scale of an audible waveform, the device comprising: sampling means for sampling the waveform to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples; analyzing means for analyzing each frame of samples to extract a set of variable frequency components having individual amplitudes; matching means for matching said variable components from one frame to a next frame such that a component in one frame is matched with a component in a successive frame that has a similar value regardless of shifts in frequency and spectral energy; interpolating means for interpolating the amplitude and frequency values of the components from the one frame to the next frame to obtain a representation of the waveform whereby a synthetic waveform can be constructed by generating a set of sine waves corresponding to the interpolated representation; interpolation rate adjusting means for altering the rate of interpolation; and synthesizing means for constructing a time-scaled synthetic waveform by generating a series of constituent sine waves corresponding in frequency and amplitude to the extracted components, the sine waves being generated at said alterable interpolation rate.
Claim 62
Independent Claim
194 words
A device for altering the time-scale of an audible waveform, the device comprising: sampling means for sampling the waveform to obtain a series of discrete samples and constructing therefrom a series of frames, each frame spanning a plurality of samples; analyzing means for analyzing each frame of samples to extract a set of variable frequency components having individual amplitudes; matching means for matching said variable components from one frame to a next frame such that a component in one frame is matched with a component in a successive frame that has a similar value regardless of shifts in frequency and spectral energy; interpolating means for interpolating the amplitude and frequency values of the components from the one frame to the next frame to obtain a representation of the waveform whereby a synthetic waveform can be constructed by generating a set of sine waves corresponding to the interpolated representation; interpolation rate adjusting means for altering the rate of interpolation; and synthesizing means for constructing a time-scaled synthetic waveform by generating a series of constituent sine waves corresponding in frequency and amplitude to the extracted components, the sine waves being generated at said alterable interpolation rate.
Claim 63
Dependent Claim
18 words
The device of claim 58 wherein the interpolation rate adjusting means is continuously variable over a defined range.
Claim 64
Dependent Claim
20 words
The device of claim 58 wherein the analyzing means further comprises means for measuring phase values for each frequency component.
Claim 65
Dependent Claim
15 words
The device of claim 60 wherein the component phase values are interpolated by cubic interpolation.
Claim 66
Dependent Claim
30 words
The device of claim 60 wherein the interpolation rate adjusting means is continuously variable over a defined range and further includes means for adjusting the rate of phase value interpolations.
Claim 67
Dependent Claim
50 words
The device of claim 60 wherein the device further comprises means for separating the measured frequency components into system contributions and excitation contributions and wherein the interpolation rate adjusting means varies the time-scale of the synthetic waveform by altering the rate at which values defining the system contributions are interpolated.
Claim 68
Dependent Claim
29 words
The device of claim 63 wherein the interpolation rate adjusting means alters the rate at which the system amplitudes and phases and the excitation amplitudes and frequencies are interpolated.
References Cited (Backward Citations)
US3296374A
Cited
US3360610A
Cited
US3484556A
Cited
US3982070A
Cited
US3978287A
Cited
US4034160A
Cited
US4058676A
Cited
US4076958A
Cited
US4701955A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1992-12-04 | 1993-06-05 | 1993-12-05 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1996-12-04 | 1997-06-05 | 1997-12-05 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2000-12-04 | 2001-06-05 | 2001-12-05 | $7700.00 | Window Closed / Lapsed |