← Back to Patent Explorer
EP0077558A1 Expired / Lapsed EP ⏱️ 0.0 years remaining

Method and apparatus for speech recognition and reproduction

Assignee: VOTAN
•
Filing: 1982-10-18
•
Granted: —
•
Expires: 2002-10-18
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A system capable of learning and subsequently recognizing a vocabulary of spoken words and synthetically reproducing such words as an audible voice when activated by an electronic command signal. Voice signals in the form of a time sequence of binary digits are processed by a digital spectrum analyzer in a "training" mode for the system to provide digital information to form a voice print which is stored in a memory. The digital spectrum analyzer comprises an arithmetic logic unit (ALU) that processes incoming data using only digital logic, without filter banks and in combination with a sequence or timing controller, an in/out controller and various internal memory components provided on a separate board or by an integrated circuit which may be combined with other external memory and external control circuitry to comprise the complete system. With voiceprints provided either from system training or from external storage and with the system in the recognition mode, pattern matching of spoken words is accomplished using the spectrum analyzer. The arithmetic logic unit, using basic logic functions, is programmed to provide a unique statistical analysis of the digital voice data so that accurate and rapid pattern matching, and hence word recognition, is accomplished even in the presence of relatively high background noise. Voice synthesis of words may be accomplished using the same methods and apparatus as used for recognition by essentially reversing the operation of the spectrum analyzer to synthesize voice signals from previously stored voiceprints.

Inventors

  • 👤 Stephen P. Gill
  • 👤 Lawrence F. Wagner
  • 👤 Gregory G. Frye
  • 👤 Klaus-Peter A. Bantowsky

Bibliographic Details

Application Number —
Jurisdiction EP
Data Source google_patents
Last Synchronized 2026-11-02 16:00
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/02

Claims Analysis

Total Claims: 31
Claim 1
Independent Claim 147 words
A method for providing a spectral analysis of an analog signal waveform comprising the steps of: dividing the total incoming analog signal into time frames of equal duration; converting the analog signal to a sequence of discrete signal amplitudes at equally spaced time intervals in each frame; transforming the sequence of discrete signal amplitudes to a sequence of complex spectral amplitudes, each such spectral amplitude representing the magnitude and phase of a function V(n,k) defined as: wherein k = time sequence index n = frequency sequence index r,t = integer summation indexes m = time function parameter defining the number of retained bits . Ø = phase adjustment function and the subscripts (p-r) and (r-t) for n and k refer to bit locations in their binary representation with bit locations ranging from o to the maximum value p and subscript values outside this range representing vanishing values.
Claim 2
Independent Claim 147 words
A method for providing a spectral analysis of an analog signal waveform comprising the steps of: dividing the total incoming analog signal into time frames of equal duration; converting the analog signal to a sequence of discrete signal amplitudes at equally spaced time intervals in each frame; transforming the sequence of discrete signal amplitudes to a sequence of complex spectral amplitudes, each such spectral amplitude representing the magnitude and phase of a function V(n,k) defined as: wherein k = time sequence index n = frequency sequence index r,t = integer summation indexes m = time function parameter defining the number of retained bits . Ø = phase adjustment function and the subscripts (p-r) and (r-t) for n and k refer to bit locations in their binary representation with bit locations ranging from o to the maximum value p and subscript values outside this range representing vanishing values.
Claim 3
Dependent Claim 14 words
The method of claim 1 wherein the phase adjustment function 0 is defined as:
Claim 4
Dependent Claim 13 words
The method of claim 1 wherein the phase adjustment function 0 is zero.
Claim 5
Dependent Claim 141 words
The method of claim 1 wherein the transformation from a sequence of discrete signal amplitudes to a sequence of complex spectral amplitudes is accomplished by establishing a processing array; transferring the signal amplitude data to the array in accordance with the expression wherein A represents the starting values of the array and Z represents the signal data in the form of binary digits; starting from the original sequence of signal data substituting one bit of the spectral sequence n for one bit of the time sequence k in accordance with the expression: wherein A r = results of the r th step of processing, beginning at r=o and ending at r=p+l determining the sequence of complex spectral amplitudes from the final step of the processing array in accordance with the formula: wherein S = the desired sequence of complex spectral amplitudes.
Claim 6
Independent Claim 98 words
A method for producing an analog signal waveform comprising the steps of: providing a predetermined series of digital signals representing a sequence of complex spectral amplitudes; transforming the sequence of complex spectral amplitudes to a sequence of discrete time waveform amplitudes, each such spectral amplitude representing the magnitude and phase of a function V(n,k) defined as: wherein k = time sequence index n = frequency sequence index r,t = integer summation indexes m = time function parameter defining the number of retained bits Ø = phase adjustment function converting the transformed digital data into an analog output signal.
Claim 7
Independent Claim 98 words
A method for producing an analog signal waveform comprising the steps of: providing a predetermined series of digital signals representing a sequence of complex spectral amplitudes; transforming the sequence of complex spectral amplitudes to a sequence of discrete time waveform amplitudes, each such spectral amplitude representing the magnitude and phase of a function V(n,k) defined as: wherein k = time sequence index n = frequency sequence index r,t = integer summation indexes m = time function parameter defining the number of retained bits Ø = phase adjustment function converting the transformed digital data into an analog output signal.
Claim 8
Dependent Claim 14 words
The method of claim 5 wherein the phase adjustment function 0 is defined as
Claim 9
Dependent Claim 13 words
The method of claim 5 wherein the phase adjustment function Ø is zero.
Claim 10
Dependent Claim 170 words
The method of claim 5 wherein the transformation from a sequence of complex spectral amplitudes to a sequence of discrete time waveform amplitudes is accomplished by establishing a processing array; transferring the complex conjugate of the spectral amplitude data to the array in accordance with the expression wherein A° represents the starting values of the array and S * represents the complex conjugate of the spectral amplitude data in the form of binary digits; starting from the original sequence of spectral amplitude data one bit of the time sequence k is substituted for one bit of the spectral sequence n in accordance with the formula: wherein A = results of the r th step of processing, beginning at r=o and ending at r=p+l. determining the sequence of time waveform amplitudes from the final step of the processing array in accordance with the formula: wherein Z = the desired. sequence of time waveform amplitudes R e A p+1 = the real part of complex values representing the final stage of processing.
Claim 11
Independent Claim 109 words
A method for producing audio analog output comprising the steps of: providing a predetermined series of encoded digital signals representing the analog output to be produced; decoding the encoded signals to provide a sequence of complex spectral amplitudes; transforming the sequence of complex spectral amplitudes to a sequence of discrete time waveform amplitudes, each such spectral amplitude representing the magnitude and phase of a function V(n,k) defined as: wherein . k = time sequence index n = frequency sequence index r,t = integer summation indexes m = time function parameter defining the number of retained bits Ø = phase adjustment function; converting-the-transformed digital data into an analog output signal.
Claim 12
Independent Claim 109 words
A method for producing audio analog output comprising the steps of: providing a predetermined series of encoded digital signals representing the analog output to be produced; decoding the encoded signals to provide a sequence of complex spectral amplitudes; transforming the sequence of complex spectral amplitudes to a sequence of discrete time waveform amplitudes, each such spectral amplitude representing the magnitude and phase of a function V(n,k) defined as: wherein . k = time sequence index n = frequency sequence index r,t = integer summation indexes m = time function parameter defining the number of retained bits Ø = phase adjustment function; converting-the-transformed digital data into an analog output signal.
Claim 13
Dependent Claim 21 words
The method of claim 9 wherein the encoded digital signals representing the analog output are provided from an external memory bank.
Claim 14
Dependent Claim 31 words
The method of claim 9 wherein the encoded digital signals representing the analog output are provided by performing a spectral analysis of an analog signal input to produce a digital voiceprint.
Claim 15
Dependent Claim 111 words
The method of claim 11 wherein the spectral analysis includes the steps of: dividing the total signal into time frames of equal duration; converting the analog signal to a sequence of discrete signal amplitudes at equally spaced time intervals in each frame; transforming the discrete signal amplitudes of each frame to a preselected number of spectral amplitudes representing values of various frequency components of the said series of signal amplitudes; reducing the.number of spectral coefficients of each frame by comparing the magnitude of each coefficient to a predetermined threshold value, and eliminating coefficients which are below the threshold; reducing the number of bits describing each remaining coefficient to a predetermined, maximum.
Claim 16
Independent Claim 183 words
A method for producing a voiceprint template for recognition of an analog waveform signal comprising the steps of: dividing the total signal into time frames of equal duration; converting the analog signal to a sequence of discrete signal amplitudes at equally spaced time intervals in each said frame; transforming the discrete signal amplitudes of each frame to a preselected number of spectral amplitudes representing values of various frequency components of the said series of signal amplitudes;, compacting and converting the spectral amplitudes of each frame to a lesser number of channels, each channel being comprised of an energy summation of amplitudes within a designated frequency range expressed in logarithmic amplitudes, and allocated on the basis of predetermined acoustic significance; deriving a mean amplitude value for all of said channels of each frame; measuring a deviation from said mean value for each separate channel amplitude in each frame; determining a feature ensemble for a plurality of successive frames of said total waveform signal; and storing a digital representation of said feature ensembles for said total waveform signal to form a digital coded template thereof.
Claim 17
Independent Claim 183 words
A method for producing a voiceprint template for recognition of an analog waveform signal comprising the steps of: dividing the total signal into time frames of equal duration; converting the analog signal to a sequence of discrete signal amplitudes at equally spaced time intervals in each said frame; transforming the discrete signal amplitudes of each frame to a preselected number of spectral amplitudes representing values of various frequency components of the said series of signal amplitudes;, compacting and converting the spectral amplitudes of each frame to a lesser number of channels, each channel being comprised of an energy summation of amplitudes within a designated frequency range expressed in logarithmic amplitudes, and allocated on the basis of predetermined acoustic significance; deriving a mean amplitude value for all of said channels of each frame; measuring a deviation from said mean value for each separate channel amplitude in each frame; determining a feature ensemble for a plurality of successive frames of said total waveform signal; and storing a digital representation of said feature ensembles for said total waveform signal to form a digital coded template thereof.
Claim 18
Dependent Claim 24 words
The method of claim 13 wherein each said feature ensemble is comprised of a pair of adjacent successive frames of the total waveform signal.
Claim 19
Dependent Claim 56 words
The method of claim 14 wherein each said feature ensemble is comprised of the average mean amplitude value of each frame pair, the slope of the difference in mean values of the same channel in the adjacent pair of frames, and the average amplitude deviation from the mean values for each channel of each frame pair.
Claim 20
Dependent Claim 187 words
A word recognition method comprising the steps of: providing a digital data template representing preselected acoustic features of a spoken word which include time-rates-of-change of spectral amplitudes; receiving a spoken word to be compared and performing a spectral analysis thereof to determine data representing its acoustic features including time-rates-of- changes of spectral amplitudes; comparing the template with the received spoken word spectral analysis data to determine a degree of similarity between features given by the metric function:, where: d = degree of similarity j = channel index a = a scaling factor to account for normal rates of speech b = a parameter for improving recognition performance x = mean amplitude value of spoken word template y = mean amplitude value of stored word template x = time-rate-of-change of spoken word template y = time-rate-of-change of stored word template Δx j = deviation of channel amplitude from mean value in spoken word template Δy j = deviation of channel amplitude from mean value in stored word template; and producing an output in response to a predetermined degree of similarity between said template and said spoken word data.
Claim 21
Dependent Claim 187 words
A word recognition method comprising the steps of: providing a digital data template representing preselected acoustic features of a spoken word which include time-rates-of-change of spectral amplitudes; receiving a spoken word to be compared and performing a spectral analysis thereof to determine data representing its acoustic features including time-rates-of- changes of spectral amplitudes; comparing the template with the received spoken word spectral analysis data to determine a degree of similarity between features given by the metric function:, where: d = degree of similarity j = channel index a = a scaling factor to account for normal rates of speech b = a parameter for improving recognition performance x = mean amplitude value of spoken word template y = mean amplitude value of stored word template x = time-rate-of-change of spoken word template y = time-rate-of-change of stored word template Δx j = deviation of channel amplitude from mean value in spoken word template Δy j = deviation of channel amplitude from mean value in stored word template; and producing an output in response to a predetermined degree of similarity between said template and said spoken word data.
Claim 22
Dependent Claim 17 words
The method of claim 16 wherein said digital data template is retrieved from an external memory storage.
Claim 23
Dependent Claim 47 words
The method of claim 16 wherein said digital data template is established by providing an initial training word; performing a spectral analysis of said training word to produce said template; and temporarily storing said training word template before comparing it with the subsequently said received spoken word.
Claim 24
Dependent Claim 35 words
The method of claim 16 wherein the step of producing an output includes the sub step of providing stored digital data representing predetermined analog signals; and synthesizing said stored data to produce the analog signals.
Claim 25
Dependent Claim 237 words
A voice recognition system for producing a voiceprint template of an analog waveform signal comprising: means for converting an incoming analog signal to a sequence of discrete digital signals; voice processor means including a timing generator for producing repetitive series of timing cycles, counter means for dividing the total incoming signal into time frames of equal length, sequence control means connected to said timing generator including ROM means for providing operating instructions for the processor during said timing cycles, an arithmetic logic unit for performing a spectral analysis of the received digital signals in response to instructions from said ROM means, said ROM means including instructions for: transforming the discrete signal amplitudes to a preselected number of spectral amplitudes representing values of various frequency components of the said series of signal amplitudes; compacting and converting the spectral amplitudes of each frame to a lesser number of channels, each channel being comprised of a summation of amplitudes within a designated frequency range allocated on the basis of predetermined acoustic significance; deriving a mean amplitude value for all of said channels of each frame; measuring a deviation from said mean value for each separate channel amplitude in each frame, and determining a feature ensemble for each pair of successive frames of said total waveform signal; and external memory means for storing a digital representation of said feature ensembles for said total waveform signal comprising a digital coded template thereof.
Claim 26
Dependent Claim 237 words
A voice recognition system for producing a voiceprint template of an analog waveform signal comprising: means for converting an incoming analog signal to a sequence of discrete digital signals; voice processor means including a timing generator for producing repetitive series of timing cycles, counter means for dividing the total incoming signal into time frames of equal length, sequence control means connected to said timing generator including ROM means for providing operating instructions for the processor during said timing cycles, an arithmetic logic unit for performing a spectral analysis of the received digital signals in response to instructions from said ROM means, said ROM means including instructions for: transforming the discrete signal amplitudes to a preselected number of spectral amplitudes representing values of various frequency components of the said series of signal amplitudes; compacting and converting the spectral amplitudes of each frame to a lesser number of channels, each channel being comprised of a summation of amplitudes within a designated frequency range allocated on the basis of predetermined acoustic significance; deriving a mean amplitude value for all of said channels of each frame; measuring a deviation from said mean value for each separate channel amplitude in each frame, and determining a feature ensemble for each pair of successive frames of said total waveform signal; and external memory means for storing a digital representation of said feature ensembles for said total waveform signal comprising a digital coded template thereof.
Claim 27
Dependent Claim 170 words
A voice recognition system for producing a voiceprint template of an analog waveform signal comprising: means for converting an incoming analog signal to a sequence of discrete digital signals; voice processor means including a timing generator for producing repetitive series of timing cycles, counter means for dividing the total incoming analog signal into time frames of equal length, sequence control means connected to said timing generator including ROM means for providing operating instructions for the processor during said timing cycles, means including an arithmetic logic unit for performing a spectral analysis of the received analog signal in response to instructions from said ROM means, said ROM means including instructions for transforming the discrete signal amplitudes of each frame to a sequence of complex spectral amplitudes each representing the magnitude and phase, of a function V (n, k) defined as: wherin: k = time sequence index n = frequency sequence index r,t = integer summation indexes m = time function parameter defining'the number of retained bits 0 = phase adjustment function
Claim 28
Dependent Claim 170 words
A voice recognition system for producing a voiceprint template of an analog waveform signal comprising: means for converting an incoming analog signal to a sequence of discrete digital signals; voice processor means including a timing generator for producing repetitive series of timing cycles, counter means for dividing the total incoming analog signal into time frames of equal length, sequence control means connected to said timing generator including ROM means for providing operating instructions for the processor during said timing cycles, means including an arithmetic logic unit for performing a spectral analysis of the received analog signal in response to instructions from said ROM means, said ROM means including instructions for transforming the discrete signal amplitudes of each frame to a sequence of complex spectral amplitudes each representing the magnitude and phase, of a function V (n, k) defined as: wherin: k = time sequence index n = frequency sequence index r,t = integer summation indexes m = time function parameter defining'the number of retained bits 0 = phase adjustment function
Claim 29
Dependent Claim 117 words
Said ROM means also including instructions for: compacting and converting the spectral amplitudes of each frame to a lesser number of channels, each channel being comprised of a summation of signal amplitudes within a designated frequency range allocated on the basis of predetermined acoustic significance; deriving a mean amplitude value for all of said channels of each frame; measuring a deviation from said mean value for (claim 21, continued) each separate channel amplitude in each frame, and determining a feature ensemble for each pair of successive frames of said total waveform signal; and external memory means for storing a digital repre- sentation of said feature ensembles for said total waveform signal comprising a digital coded template thereof.
Claim 30
Dependent Claim 400 words
. The voice recognition system as described in claim 20 wherein said ROM means includes means providing instructions for transforming a sequence of discrete signal amplitudes to a sequence of complex amplitudes by establishing a processing array and transforming signal amplitude data to the array in accordance with the expression: Wherein A° represents the starting values of the array and Z represents the signal data in the form of binary digits; said ROM means including further instructions for substituting one bit of the spectral sequence n for one bit of the time sequence k, starting from the original sequence of signal data, in accordance_with the expression: wherein: A r = results of the r t h step of processing, beginning at r=o and ending at r=p+l said R O M means including further instructions for determining the sequence of complex spectral amplitudes from the processing array in accordance with the expression: wherin: S = the desired sequence of complex spectral amplitudes 23. The voice recognition system as described in claim 22 wherein said voice processor includes means for comparing the voice template developed by spectral analysis of the analog signal with a second template stored in said external memory means. 24. The voice recognition system as described in claim 23 wherein said means for comparing includes ROM instruction means for determining a degree of similarity between features of the developed voice template and said second template in accordance.with the function: 25. The voice recognition system as described in claim 21 wherein said voice processor is in the form of an integrated circuit semiconductor device. 26. The voice recognition system as described in claim 21 wherein said voice processor is in the form of an integrated circuit semiconductor device that also includes said means for converting the incoming analog signal to digital signals. 27. A voice synthesis device comprising: means providing a predetermined series of digital signals representing a sequence of preselected complex spectral amplitudes; means for transforming said sequence of complex spectral amplitudes to a sequence of discrete time waveform amplitudes, each such spectral amplitude representing the magnitude and-phase of a function V(n,k) defined as: wherein: k = time sequence index n = frequency sequence index r,t = integer summation indexes m = time function parameter defining the number of retained bits Ø = phase adjustment function and means for converting the transformed digital data into an analog output signal.
Claim 31
Dependent Claim 165 words
The voice synthesis device of claim 27 wherein said means for transforming includes: means for establishing a processing array and thereafter transferring the complex conjugate of the spectral amplitude data to the array in accordance with the expression: Wherein A 0 represents the starting values of the array and S* represents the complex conjugate of the spectral amplitude data in the form of binary digits; and also including means for determining the sequence of time waveform amplitudes from the final processing array in accordance with the formula: wherein: Z = the desired sequence of time waveform amplitudes Re A p+1 = the real part of complex values representing the final stage of processing. means for substituting one bit of the time sequence k for one bit of the spectral sequence n, starting from the original sequence of spectral amplitude data in accordance with the formula: wherein: A r = results of the r t h step of processing, beginning at r=o and ending at r=p+l;

References Cited (Backward Citations)

US3582559A Cited
DE2150336A1 Cited

USPTO Annuity & Maintenance Windows

Maintenance schedule is calculated for granted US utility patents.

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag