Patent US6311154B1 successfully refreshed from Google Patents.
← Back to Patent Explorer
US6311154B1 Expired / Lapsed US ⏱️ 0.0 years remaining

Adaptive windows for analysis-by-synthesis CELP-type speech coding

Assignee: Nokia Oyj
•
Filing: 1998-12-30
•
Granted: 2001-10-30
•
Expires: 2018-12-30
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A speech coder and a method for speech coding wherein the speech signal is represented by an excitation signal applied to a synthesis filter. The speech is partitioned into frames and subframes. A classifier identifies which of several categories the speech frame belongs to, and a different coding method is applied to represent the excitation for each category. For some categories, one or more windows are identified for the frame where all or most of the excitation signal samples are assigned by a coding scheme. Performance is enhanced by coding the important segments of the excitation more accurately. The window locations are determined from a linear prediction residual by identifying peaks of the smoothed residual energy contour. The method adjusts the frame and subframe boundaries so that each window is located entirely within a modified subframe or frame. This eliminates the artificial restriction incurred when coding a frame or subframe in isolation, without regard for the local behavior of the speech signal across frame or subframe boundaries.

Inventors

  • 👤 Allen Gersho
  • 👤 Vladimir Cuperman
  • 👤 Ajit V Rao
  • 👤 Tung-Chiang Yang
  • 👤 Sassan Ahmadi
  • 👤 Fenghua Liu

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-01 18:39
CPC Classifications
G; G10; G10L; G10L19/00; G10L19/04; G10L19/08; G10L19/12; G10L19/16; G10L19/18

Claims Analysis

Total Claims: 45
Claim 1
Independent Claim 103 words
A method for coding a speech signal, comprising steps of: partitioning samples of the speech signal into frames; classifying the speech signal in each frame into one of a plurality of classes, wherein the step of classifying classifies a frame as being one of an unvoiced frame or a not unvoiced frame and classifies said not unvoiced frame as being one of a voiced frame or a transition frame; determining the location of at least one window in the frame; and encoding an excitation for the frame, whereby all or substantially all of non-zero excitation amplitudes lie within the at least one window.
Claim 2
Independent Claim 103 words
A method for coding a speech signal, comprising steps of: partitioning samples of the speech signal into frames; classifying the speech signal in each frame into one of a plurality of classes, wherein the step of classifying classifies a frame as being one of an unvoiced frame or a not unvoiced frame and classifies said not unvoiced frame as being one of a voiced frame or a transition frame; determining the location of at least one window in the frame; and encoding an excitation for the frame, whereby all or substantially all of non-zero excitation amplitudes lie within the at least one window.
Claim 3
Dependent Claim 37 words
A method as in claim 1 , further comprising a step of deriving a residual signal for each frame; and wherein the location of the at least one window is determined by examining the derived residual signal.
Claim 4
Dependent Claim 48 words
A method as in claim 1 , further comprising steps of: deriving a residual signal for each frame; and smoothing an energy contour of the residual signal; wherein the location of the at least one window is determined by examining the smoothed energy contour of the residual signal.
Claim 5
Dependent Claim 36 words
A method as in claim 1 , wherein the at least one window can be located so as to have an edge that coincides with at least one of a subframe boundary or a frame boundary.
Claim 6
Independent Claim 122 words
A method for coding a speech signal, comprising the steps of: partitioning samples of the speech signal into frames; classifying the speech signal in each frame into one of a plurality of classes, wherein the step of classifying classifies a frame as being one of an unvoiced frame or a not unvoiced frame and classifies said not unvoiced frame as being one of a voiced frame or a transition frame; deriving a residual signal for each frame; determining a location of at least one window, whose center lies within the frame, by considering the residual signal for the frame; and encoding an excitation for the frame whereby all or substantially all of non-zero excitation amplitudes lie within the at least one window.
Claim 7
Independent Claim 122 words
A method for coding a speech signal, comprising the steps of: partitioning samples of the speech signal into frames; classifying the speech signal in each frame into one of a plurality of classes, wherein the step of classifying classifies a frame as being one of an unvoiced frame or a not unvoiced frame and classifies said not unvoiced frame as being one of a voiced frame or a transition frame; deriving a residual signal for each frame; determining a location of at least one window, whose center lies within the frame, by considering the residual signal for the frame; and encoding an excitation for the frame whereby all or substantially all of non-zero excitation amplitudes lie within the at least one window.
Claim 8
Dependent Claim 52 words
A method as in claim 5 , wherein the step of deriving a residual signal for each frame includes a step of smoothing an energy contour of the residual signal; and wherein the location of the at least one window is determined by examining the smoothed energy contour of the residual signal.
Claim 9
Dependent Claim 49 words
A method as in claim 5 , wherein a subframe or frame boundary is modified so that the window lies entirely within the modified subframe or frame and the boundary is located so as to have an edge of the modified frame or subframe coincide with a window boundary.
Claim 10
Independent Claim 140 words
A method for coding a speech signal, comprising steps of: partitioning samples of the speech signal into frames; deriving a residual signal for each frame; classifying the speech signal in each frame into one of a plurality of classes, wherein the step of classifying classifies a frame as being one of an unvoiced frame or a not unvoiced frame and classifies said not unvoiced frame as being one of a voiced frame or a transition frame; identifying the location of at least one window in the frame by examining the residual signal for the frame; encoding an excitation for the frame using one of a plurality of excitation coding techniques selected according to the class of the frame; and for at least one of the classes, confining all or substantially all of non-zero excitation amplitudes to lie within the windows.
Claim 11
Independent Claim 140 words
A method for coding a speech signal, comprising steps of: partitioning samples of the speech signal into frames; deriving a residual signal for each frame; classifying the speech signal in each frame into one of a plurality of classes, wherein the step of classifying classifies a frame as being one of an unvoiced frame or a not unvoiced frame and classifies said not unvoiced frame as being one of a voiced frame or a transition frame; identifying the location of at least one window in the frame by examining the residual signal for the frame; encoding an excitation for the frame using one of a plurality of excitation coding techniques selected according to the class of the frame; and for at least one of the classes, confining all or substantially all of non-zero excitation amplitudes to lie within the windows.
Claim 12
Dependent Claim 20 words
A method as in claim 8 , wherein the classes are comprised of voiced frames, unvoiced frames, and transition frames.
Claim 13
Dependent Claim 24 words
A method as in claim 8 , wherein the classes are comprised of strongly periodic frames, weakly periodic frames, erratic frames, and unvoiced frames.
Claim 14
Dependent Claim 38 words
A method as in claim 8 , wherein the step of classifying the speech signal comprises steps of: forming a smoothed energy contour from the residual signal; and considering a location of peaks in the smoothed energy contour.
Claim 15
Dependent Claim 20 words
A method as in claim 8 , wherein one of the plurality of codebooks is comprised of an adaptive codebook.
Claim 16
Dependent Claim 23 words
A method as in claim 8 , wherein one of the plurality of codebooks is comprised of a fixed ternary pulse coding codebook.
Claim 17
Dependent Claim 23 words
A method as in claim 8 , wherein the step of classifying uses an open loop classifier followed by a closed loop classifier.
Claim 18
Dependent Claim 53 words
A method as in claim 8 , wherein the step of classifying uses a first classifier to classify said frame as being one of said unvoiced frame or said not unvoiced frame, and a second classifier for classifying said not unvoiced frame as being one of a voiced frame or a transition frame.
Claim 19
Dependent Claim 32 words
A method as in claim 8 , wherein the step of encoding comprises steps of: partitioning the frame into a plurality of subframes; and positioning at least one window within each subframe.
Claim 20
Dependent Claim 57 words
A method as in claim 16 , wherein the step of positioning at least one window positions a first window at a location that is a function of a pitch of the frame, and positions subsequent windows as a function of the pitch of the frame and as a function of the position of the first window.
Claim 21
Dependent Claim 47 words
A method as in claim 8 , wherein the step of identifying the location of at least one window includes a step of smoothing the residual signal, and wherein the step of identifying considers the presence of energy peaks in the smoothed contour of the residual signal.
Claim 22
Independent Claim 102 words
A method for coding a speech signal, comprising steps of: partitioning samples of the speech signal into frames; classifying the speech signal in each frame into one of a plurality of classes, wherein the step of classifying classifies a frame as being one of an unvoiced frame or a not unvoiced frame and classifies said not unvoiced frame as being one of a voiced frame or a transition frame; modifying the duration and boundaries of a frame or a subframe by considering the speech or residual signal for the frame; and encoding an excitation for the frame using an analysis-by-synthesis coding technique.
Claim 23
Independent Claim 102 words
A method for coding a speech signal, comprising steps of: partitioning samples of the speech signal into frames; classifying the speech signal in each frame into one of a plurality of classes, wherein the step of classifying classifies a frame as being one of an unvoiced frame or a not unvoiced frame and classifies said not unvoiced frame as being one of a voiced frame or a transition frame; modifying the duration and boundaries of a frame or a subframe by considering the speech or residual signal for the frame; and encoding an excitation for the frame using an analysis-by-synthesis coding technique.
Claim 24
Dependent Claim 48 words
A method as in claim 19 , wherein the speech signal in each frame is classified into one of a plurality of classes, and an excitation for the frame is encoded using one of a plurality of analysis-by-synthesis coding techniques selected according to the class of the frame.
Claim 25
Dependent Claim 100 words
Apparatus for coding speech, comprising: a framing unit for partitioning samples of an input speech signal into frames; a first classifier for classifying a frame as being one of an unvoiced frame or a not unvoiced frame and a second classifier for classifying said not unvoiced frame as being one of a voiced frame or a transition frame; a windowing unit for determining the location of at least one window in a frame; and an encoder for encoding an excitation for the frame such that all or substantially all of non-zero excitation amplitudes lie within the at least one window.
Claim 26
Dependent Claim 100 words
Apparatus for coding speech, comprising: a framing unit for partitioning samples of an input speech signal into frames; a first classifier for classifying a frame as being one of an unvoiced frame or a not unvoiced frame and a second classifier for classifying said not unvoiced frame as being one of a voiced frame or a transition frame; a windowing unit for determining the location of at least one window in a frame; and an encoder for encoding an excitation for the frame such that all or substantially all of non-zero excitation amplitudes lie within the at least one window.
Claim 27
Dependent Claim 38 words
Apparatus as in claim 21 , further comprising a unit for deriving a residual signal for each frame; and wherein said windowing unit determines the location of the at least one window by examining the derived residual signal.
Claim 28
Dependent Claim 53 words
Apparatus as in claim 21 , further comprising: a unit for deriving a residual signal for each frame; and a unit for smoothing an energy contour of the residual signal; wherein said windowing unit determines the location of the at least one window by examining the smoothed energy contour of the residual signal.
Claim 29
Dependent Claim 39 words
Apparatus as in claim 21 , wherein said windowing unit is operative for locating said at least one window so as to have an edge that coincides with at least one of a subframe boundary or a frame boundary.
Claim 30
Dependent Claim 254 words
A wireless voice communicator, comprising; a wireless transceiver comprising a transmitter and a receiver; an input speech transducer and an output speech transducer; and a speech processor comprising, a sampling and framing unit having an input coupled to an output of said input speech transducer for partitioning samples of an input speech signal into frames; a first classifier for classifying a frame as being one of an unvoiced frame or a not unvoiced frame and a second classifier for classifying said not unvoiced frame as being one or a voiced frame or a transition frame; a windowing unit for determining the location of at least one window in a frame; and an encoder for providing an encoded speech signal where, in an excitation for the frame, all or substantially all of non-zero excitation amplitudes lie within the at least one window; said wireless communicator further comprising a modulator for modulating a carrier with the encoded speech signal, said modulator having an output coupled to an input of said transmitter; a demodulator having an input coupled to an output of said receiver for demodulating a carrier that is encoded with a speech signal and that was transmitted from a remote transmitter; and said speech processor further comprising a decoder having an input coupled to an output of said demodulator for decoding an excitation from a frame wherein all or substantially all of non-zero excitation amolitudes lie within at least one window, said decoder having an output coupled to an input of said output speech transducer.
Claim 31
Dependent Claim 254 words
A wireless voice communicator, comprising; a wireless transceiver comprising a transmitter and a receiver; an input speech transducer and an output speech transducer; and a speech processor comprising, a sampling and framing unit having an input coupled to an output of said input speech transducer for partitioning samples of an input speech signal into frames; a first classifier for classifying a frame as being one of an unvoiced frame or a not unvoiced frame and a second classifier for classifying said not unvoiced frame as being one or a voiced frame or a transition frame; a windowing unit for determining the location of at least one window in a frame; and an encoder for providing an encoded speech signal where, in an excitation for the frame, all or substantially all of non-zero excitation amplitudes lie within the at least one window; said wireless communicator further comprising a modulator for modulating a carrier with the encoded speech signal, said modulator having an output coupled to an input of said transmitter; a demodulator having an input coupled to an output of said receiver for demodulating a carrier that is encoded with a speech signal and that was transmitted from a remote transmitter; and said speech processor further comprising a decoder having an input coupled to an output of said demodulator for decoding an excitation from a frame wherein all or substantially all of non-zero excitation amolitudes lie within at least one window, said decoder having an output coupled to an input of said output speech transducer.
Claim 32
Dependent Claim 44 words
A wireless communicator as in claim 25 , wherein said speech processor further comprises a unit for deriving a residual signal for each frame; and wherein said windowing unit determines the location of the at least one window by examining the derived residual signal.
Claim 33
Dependent Claim 59 words
A wireless communicator as in claim 25 , wherein said speech processor further comprises: a unit for deriving a residual signal for each frame; and a unit for smoothing an energy contour of the residual signal; wherein said windowing unit determines the location of the at least one window by examining the smoothed energy contour of the residual signal.
Claim 34
Dependent Claim 41 words
A wireless communicator as in claim 25 , wherein said windowing unit is operative for locating said at least one window so as to have an edge that coincides with at least one of a subframe boundary or a frame boundary.
Claim 35
Dependent Claim 53 words
A wireless communicator as in claim 25 , wherein said speech processor further comprises a unit for modifying the duration and boundaries of a frame or a subframe by considering the speech or residual signal for the frame; and wherein said encoder encodes an excitation for the frame using an analysis-by-synthesis coding technique.
Claim 36
Dependent Claim 69 words
A wireless communicator as in claim 25 , wherein a frame is comprised of at least two subframes, and wherein said windowing unit operates such that a subframe boundary or a frame boundary is modified so that the window lies entirely within the modified subframe or frame, and the boundary is located so as to have an edge of the modified frame or subframe coincide with a window boundary.
Claim 37
Dependent Claim 69 words
A wireless communicator as in claim 25 , wherein said windowing unit operates such that windows are centered at epochs, wherein epochs of voiced frames are separated by a predetermined distance plus or minus a jitter value, wherein said modulator further modulates said carrier with an indication of the jitter value, and wherein said demodulator further demodulates the received carrier to obtain the jitter value for the received frame.
Claim 38
Dependent Claim 30 words
A wireless communicator as in claim 31 , wherein the predetermined distance is one pitch period, and wherein the jitter value is an integer between about −8 and about +7.
Claim 39
Dependent Claim 25 words
A wireless communicator as in claim 25 , wherein said encoder and said decoder operate at a data rate of less than about 4 kb/sec.
Claim 40
Dependent Claim 352 words
A speech decoder, comprising: a class decoder having an input coupled to an input node of said speech decoder for extracting from an input bit stream predetermined ones of bits encoding class information for an encoded speech signal frame and for decoding the class information, wherein there are a plurality of predetermined classes; said plurality of predetermined classes comprises a voiced class, an unvoiced class and a transition class; and wherein said input bit stream is also coupled to an input of a LSP decoder; a first multi-position switch element controlled by an output of said class decoder for directing said input bit stream to an input of one of selected one of a plurality of excitation generators, an individual one of said excitation generators corresponding to one of said plurality of predetermined classes; a second multi-position switch element controlled by said output of said class decoder for coupling an output of the selected one of said excitation generators to an input of a synthesizer filter and, via a feedback path, also to said adaptive code book; an unvoiced class excitation generator and a transition class excitation generator coupled between said first and second multi-position switch elements; wherein for said transition class, at least one window position is decoded in a window decoder having an input coupled to said input bit stream; and wherein a codebook vector is retrieved from a transition excitation fixed codebook using information concerning the at least one window location output from said window decoder and by multiplying a retrieved codebook vector; and wherein for said voiced class, the input bit stream encodes pitch information for the encoded speech signal frame which is decoded in a pitch decoder block having an output coupled to a window generator block that generates at least one window based on the decoded pitch information, said at least one window being used to retrieve, from an adaptive code book, an adaptive code book vector used for generating an excitation vector which is multiplied by a gain element and added to an adaptive codebook excitation to give a total excitation for a voiced frame.
Claim 41
Dependent Claim 352 words
A speech decoder, comprising: a class decoder having an input coupled to an input node of said speech decoder for extracting from an input bit stream predetermined ones of bits encoding class information for an encoded speech signal frame and for decoding the class information, wherein there are a plurality of predetermined classes; said plurality of predetermined classes comprises a voiced class, an unvoiced class and a transition class; and wherein said input bit stream is also coupled to an input of a LSP decoder; a first multi-position switch element controlled by an output of said class decoder for directing said input bit stream to an input of one of selected one of a plurality of excitation generators, an individual one of said excitation generators corresponding to one of said plurality of predetermined classes; a second multi-position switch element controlled by said output of said class decoder for coupling an output of the selected one of said excitation generators to an input of a synthesizer filter and, via a feedback path, also to said adaptive code book; an unvoiced class excitation generator and a transition class excitation generator coupled between said first and second multi-position switch elements; wherein for said transition class, at least one window position is decoded in a window decoder having an input coupled to said input bit stream; and wherein a codebook vector is retrieved from a transition excitation fixed codebook using information concerning the at least one window location output from said window decoder and by multiplying a retrieved codebook vector; and wherein for said voiced class, the input bit stream encodes pitch information for the encoded speech signal frame which is decoded in a pitch decoder block having an output coupled to a window generator block that generates at least one window based on the decoded pitch information, said at least one window being used to retrieve, from an adaptive code book, an adaptive code book vector used for generating an excitation vector which is multiplied by a gain element and added to an adaptive codebook excitation to give a total excitation for a voiced frame.
Claim 42
Dependent Claim 30 words
A speech decoder as in claim 34 , wherein for said unvoiced class, the excitation is obtained by retrieving a random vector from a unvoiced codebook and multiplying the vector.
Claim 43
Dependent Claim 24 words
A speech decoder as in claim 34 , wherein all or substantially all of non-zero excitation amplitudes lie within the at least one window.
Claim 44
Dependent Claim 29 words
A speech decoder as in claim 34 , wherein all or substantially all of non-zero excitation amplitudes lie within the at least one window decoded by said window decoder.
Claim 45
Dependent Claim 102 words
A speech decoder as in claim 34 , and further comprising: a second multi-position switch element controlled by said output of said class decoder for coupling an output of the selected one of said excitation generators to an input of a synthesizer filter and, via a feedback path, also to said adaptive code book, an output of said synthesizer filter being coupled to an input of a postfilter having an output coupled to an output node of said decoder; wherein parameters of said synthesis filter and said postfilter are based on parameters decoded from said input bit stream by said LSP decoder.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2004-10-29 2005-04-30 2005-10-30 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2008-10-29 2009-04-30 2009-10-30 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2012-10-29 2013-04-30 2013-10-30 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag