← Back to Patent Explorer
US5987413A Expired / Lapsed US ⏱️ 0.0 years remaining

Envelope-invariant analytical speech resynthesis using periodic signals derived from reharmonized frame spectrum

Assignee: Individual
•
Filing: 1997-06-05
•
Granted: 1999-11-16
•
Expires: 2017-06-05
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Method envelope-invariant for audio signal synthesis from elementary audio waveforms stored in a dictionary wherein: the waveforms are perfectly periodic, and stored as one of their period, synthesis is obtained by overlap-adding of the waveforms obtained from time-domain repetition of the periodic waveforms with a weighting window whose size is approximately two times the period of the signals to weight, and whose relative position inside of the period is fixed to any value identical for all the periods, each extracted from a reharmonized and thus periodic waveform, obtained by modifying, without changing the spectral envelope, the frequencies and amplitudes of harmonics in the spectrum of a frame of the original continuous speech waveform, whereby the time shift between two successive waveforms obtained by weighting the original signals is set to the imposed fundamental frequency of the signal to synthesize.

Inventors

  • 👤 Thierry Dutoit
  • 👤 Vincent Pagel
  • 👤 Nicolas Pierret

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 22:56
CPC Classifications
G; G10; G10L; G10L13/00; G10L13/06; G10L13/07; G10L21/00; G10L21/04

Claims Analysis

Total Claims: 16
Claim 1
Independent Claim 115 words
A method for audio synthesis from waveforms stored in a dictionary, comprising the steps of: the waveforms are infinite and perfectly periodic, and are stored as one of their periods, itself represented as a sequence of sound samples of a priori any length; a synthesis is carried out by overlapping and adding the waveforms multiplied by a weighting window whose length is approximately two times the period of the original waveform, and whose position relatively to the waveform can be set to any fixed value; whereby the time shift between two successive weighted signals obtained by weighting the original waveforms is equal to the fundamental period requested for the synthetic signal, whose value is imposed.
Claim 2
Independent Claim 115 words
A method for audio synthesis from waveforms stored in a dictionary, comprising the steps of: the waveforms are infinite and perfectly periodic, and are stored as one of their periods, itself represented as a sequence of sound samples of a priori any length; a synthesis is carried out by overlapping and adding the waveforms multiplied by a weighting window whose length is approximately two times the period of the original waveform, and whose position relatively to the waveform can be set to any fixed value; whereby the time shift between two successive weighted signals obtained by weighting the original waveforms is equal to the fundamental period requested for the synthetic signal, whose value is imposed.
Claim 3
Dependent Claim 28 words
The method for audio synthesis according to claim 1, wherein the fundamental period of the synthetic signal is greater or lower than the original period in the dictionary.
Claim 4
Dependent Claim 22 words
The method for audio synthesis according to claim 2, wherein the lengths of the periods stored in the dictionary are all identical.
Claim 5
Dependent Claim 36 words
The method for audio synthesis according to claim 3, wherein the phases of the lower-frequency harmonics (typically from 0 to 3 kHz) of the stored periodic waveforms have a fixed value per harmonic throughout the dictionary.
Claim 6
Dependent Claim 60 words
The method for audio synthesis according to claim 4, wherein the stored waveforms are obtained from the spectral analysis of a dictionary of audio signal segments such as diphones in the case of speech synthesis whereby a spectral analysis provides at regular time intervals an estimate of the instantaneous spectral envelope in each segment from which the waveforms are computed.
Claim 7
Dependent Claim 60 words
The method for audio synthesis according to claim 3, wherein the stored waveforms are obtained from the spectral analysis of a dictionary of audio signal segments such as diphones in the case of speech synthesis whereby a spectral analysis provides at regular time intervals an estimate of the instantaneous spectral envelope in each segment from which the waveforms are computed.
Claim 8
Dependent Claim 60 words
The method for audio synthesis according to claim 2, wherein the stored waveforms are obtained from the spectral analysis of a dictionary of audio signal segments such as diphones in the case of speech synthesis whereby a spectral analysis provides at regular time intervals an estimate of the instantaneous spectral envelope in each segment from which the waveforms are computed.
Claim 9
Dependent Claim 22 words
The method for audio synthesis according to claim 1, wherein the lengths of the periods stored in the dictionary are all identical.
Claim 10
Dependent Claim 36 words
The method for audio synthesis according to claim 8, wherein the phases of the lower-frequency harmonics (typically from 0 to 3 kHz) of the stored periodic waveforms have a fixed value per harmonic throughout the dictionary.
Claim 11
Dependent Claim 60 words
The method for audio synthesis according to claim 9, wherein the stored waveforms are obtained from the spectral analysis of a dictionary of audio signal segments such as diphones in the case of speech synthesis whereby a spectral analysis provides at regular time intervals an estimate of the instantaneous spectral envelope in each segment from which the waveforms are computed.
Claim 12
Dependent Claim 60 words
The method for audio synthesis according to claim 8, wherein the stored waveforms are obtained from the spectral analysis of a dictionary of audio signal segments such as diphones in the case of speech synthesis whereby a spectral analysis provides at regular time intervals an estimate of the instantaneous spectral envelope in each segment from which the waveforms are computed.
Claim 13
Dependent Claim 60 words
The method for audio synthesis according to claim 1, wherein the stored waveforms are obtained from the spectral analysis of a dictionary of audio signal segments such as diphones in the case of speech synthesis whereby a spectral analysis provides at regular time intervals an estimate of the instantaneous spectral envelope in each segment from which the waveforms are computed.
Claim 14
Independent Claim 90 words
The method for audio synthesis according to any one of the preceding claims, wherein when concatenating two segments, the last periods of the first segment and the first period of the second segment are modified to smooth out the time-domain difference measured between the last period of the first segment and the first period of the second segment, this time-domain difference being added to each modified period with a weighting coefficient varying between -0.5 and 0.5 depending on the position of the modified period with respect to the concatenation point.
Claim 15
Independent Claim 343 words
A method for audio synthesis from waveforms stored in a dictionary, comprising; the waveforms are infinite and perfectly periodic and are obtained from the spectral analysis of a dictionary of audio signal segments, and are stored as one of their periods, itself represented as a sequence of sound samples of a priori any length; a synthesis is carried out by overlapping and adding the waveforms multiplied by awaiting window whose length is approximately two times the period of the original waveform, and whose position relative to the waveform can be set at any fixed value; whereby the time shift between two successive weighted signals obtained by weighting the original waveforms is equal to the fundamental period requested for the synthetic signal whose value is imposed; wherein when concatenating two segments, the last period of the first segment and the first period of the second segment are modified to smooth out the time-domain difference measured between the last period of the first segment and the first period of the second segment, this time-domain difference being added to each modified period with a weighting coefficient varying between -0.5 and 0.5 depending on the position of the modified period with respect to the concatenation point, and for each base segment, replacement segments are stored whereby at synthesis time when two segments are about to be concatenated, the periods of the first base segment are modified so as to propagate, on the last periods of this segment, the difference between the last period of the base segment and the last period of one of its replacement segments and whereby the periods of the second base segment are modified so as to propagate, on the first periods of this segment, the difference between the first period of the base segment and the first period of one of its replacement segments, the propagation of these differences being performed by multiplying the measured differences by a weighting coefficient continuously varying from one to zero (from period to period) and adding the weighted differences to the periods of the base segments.
Claim 16
Independent Claim 343 words
A method for audio synthesis from waveforms stored in a dictionary, comprising; the waveforms are infinite and perfectly periodic and are obtained from the spectral analysis of a dictionary of audio signal segments, and are stored as one of their periods, itself represented as a sequence of sound samples of a priori any length; a synthesis is carried out by overlapping and adding the waveforms multiplied by awaiting window whose length is approximately two times the period of the original waveform, and whose position relative to the waveform can be set at any fixed value; whereby the time shift between two successive weighted signals obtained by weighting the original waveforms is equal to the fundamental period requested for the synthetic signal whose value is imposed; wherein when concatenating two segments, the last period of the first segment and the first period of the second segment are modified to smooth out the time-domain difference measured between the last period of the first segment and the first period of the second segment, this time-domain difference being added to each modified period with a weighting coefficient varying between -0.5 and 0.5 depending on the position of the modified period with respect to the concatenation point, and for each base segment, replacement segments are stored whereby at synthesis time when two segments are about to be concatenated, the periods of the first base segment are modified so as to propagate, on the last periods of this segment, the difference between the last period of the base segment and the last period of one of its replacement segments and whereby the periods of the second base segment are modified so as to propagate, on the first periods of this segment, the difference between the first period of the base segment and the first period of one of its replacement segments, the propagation of these differences being performed by multiplying the measured differences by a weighting coefficient continuously varying from one to zero (from period to period) and adding the weighted differences to the periods of the base segments.

References Cited (Backward Citations)

WO1990003027A1 Cited
US5327498A Cited
US5524172A Cited
US5369730A Cited
EP0527527A2 Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2002-11-15 2003-05-17 2003-11-16 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2006-11-15 2007-05-17 2007-11-16 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2010-11-15 2011-05-17 2011-11-16 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag