← Back to Patent Explorer
US4441202A Expired / Lapsed US ⏱️ 0.0 years remaining

Speech processor

Assignee: University of Melbourne
•
Filing: 1980-05-28
•
Granted: 1984-04-03
•
Expires: 2000-05-28
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A system for converting a speech signal into a data signal for controlling an implantable stimulation electrode array hearing prosthesis. An input speech signal is passed through three circuit arms, comprising filter circuits, zero crossing counter circuits and RMS measuring circuits (3-13), for producing signals representing amplitude and frequency of the fundamental voicing component and the first three formants of the speech signal. Computer (14) is programmed with a patient's psychophysical data, and determines the manner of stimulation of the electrodes by ranking the sharpness of the electrodes and assigning sub-bands of the second formant frequency range to particular electrodes. Also, the voiced or unvoiced nature of the signal is determined by comparing the fundamental and second formant components. The output signal passed through a data formatter (15) and transmitter (16) has both formant and prosodic information whereby the production of confusing percepts is avoided.

Inventors

  • 👤 Yit C. Tong
  • 👤 Peter M. Seligman
  • 👤 Graeme M. Clark
  • 👤 James F. Patrick
  • 👤 John B. Millar

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-31 00:28
CPC Classifications
G; G10; G10L; G10L25/00; G10L25/93; A; A61; A61F; A61F11/00; A61F11/04; A61N; A61N1/00; A61N1/18; A61N1/32; A61N1/36; A61N1/36036; A61N1/36038; A61N1/36039; H; H04; H04R; H04R25/00; H04R25/50; H04R25/505; H04R2225/00; H04R2225/43

Claims Analysis

Total Claims: 24
Claim 1
Independent Claim 287 words
A signal processing system for converting a speech signal into a data signal for controlling a hearing prosthesis including an implanted electrode array adapted to stimulate the auditory nerve fibres of a patient by the application of electrical currents to selected electrodes in said array, said processing system comprising means (1,2;20,21) for generating an input signal corresponding to a received speech signal, means (3-6;30-36) for estimating the amplitude and frequency of the fundamental voicing component of said speech signal, means (8-10; 22-26, 27, 28) for estimating the amplitude and frequency of the second formant component of said speech signal, means (14;37) for determining whether said speech signal is voiced or unvoiced, programmable means (14;40) for producing instruction data which in use causes the application of said electrical currents to selected electrodes in said array, said programmable means being programmed with data (FIG. 2) defining a predetermined relationship between each electrode and a selected range of said second formant frequencies based on psychophysical testing of the patient and causing selection of said electrodes based on the estimated frequency of said second formant component such as to produce the desired percepts in the auditory-like sensations generated in the patient, means (14;38) for causing stimulation of said selected electrode at a frequency dependent on the estimated frequency of said fundamental voicing component for voiced speech signals and at a lower substantially constant frequency for unvoiced speech signals, said programmable means (14;40) further being programmed to produce data (FIG. 4) which determines the level of stimulation of each selected electrode dependent on said estimated amplitude of said second formant component of said speech signal as well as on predetermined data relating to the sensitivity of each electrode implanted in the patient.
Claim 2
Dependent Claim 287 words
A signal processing system for converting a speech signal into a data signal for controlling a hearing prosthesis including an implanted electrode array adapted to stimulate the auditory nerve fibres of a patient by the application of electrical currents to selected electrodes in said array, said processing system comprising means (1,2;20,21) for generating an input signal corresponding to a received speech signal, means (3-6;30-36) for estimating the amplitude and frequency of the fundamental voicing component of said speech signal, means (8-10; 22-26, 27, 28) for estimating the amplitude and frequency of the second formant component of said speech signal, means (14;37) for determining whether said speech signal is voiced or unvoiced, programmable means (14;40) for producing instruction data which in use causes the application of said electrical currents to selected electrodes in said array, said programmable means being programmed with data (FIG. 2) defining a predetermined relationship between each electrode and a selected range of said second formant frequencies based on psychophysical testing of the patient and causing selection of said electrodes based on the estimated frequency of said second formant component such as to produce the desired percepts in the auditory-like sensations generated in the patient, means (14;38) for causing stimulation of said selected electrode at a frequency dependent on the estimated frequency of said fundamental voicing component for voiced speech signals and at a lower substantially constant frequency for unvoiced speech signals, said programmable means (14;40) further being programmed to produce data (FIG. 4) which determines the level of stimulation of each selected electrode dependent on said estimated amplitude of said second formant component of said speech signal as well as on predetermined data relating to the sensitivity of each electrode implanted in the patient.
Claim 3
Dependent Claim 45 words
The system of claim 1, wherein said programmable means (14;40) is further programmed with data (FIG. 3) defining a pre-determined relationship between the estimated frequency of said fundamental voicing component of said speech signal and the rate at which each said selected electrode is stimulated.
Claim 4
Dependent Claim 48 words
The system of claim 2, wherein said stimulation rate has a lower limit and an upper limit, said lower limit being substantially higher than said substantially constant lower frequency and said upper limit being lower than the upper limit of said estimated frequency of said fundamental voicing component.
Claim 5
Dependent Claim 51 words
The system of claim 2 or 3, wherein said programmable means (14;40) is further programmed with alternative data defining a different relationship between said electrode stimulation rate and said estimated frequency of said fundamental voicing component which is more suitable for auditory-like sensations resembling music or certain types of speech signal.
Claim 6
Dependent Claim 93 words
The system of claim 1, 2 or 3, wherein said programmable means (14;40) is programmed to compare the instantaneous values of the estimated frequency F2 of the second formant component of said speech signal and the estimated amplitude A0 of the fundamental voicing component of said speech signal to determine a voiced speech signal when the instantaneous value of F2 is low and the instantaneous value of A0 is high and to determine an unvoiced speech signal when the instantaneous value of F2 is high and the instantaneous value of A0 is low.
Claim 7
Dependent Claim 63 words
The system of claim 1, 2 or 3, wherein means (14,37) are provided to compare the instantaneous high frequency energy of said speech signal with the instantaneous low frequency energy of said speech signal and for causing said selector electrode to be stimulated at said lower substantially constant when said instantaneous high frequency energy is high compared to said instantaneous low frequency energy.
Claim 8
Dependent Claim 61 words
The system of claim 1, 2 or 3, wherein the frequency of said second formant component of said speech signal is estimated by means of a single high pass filter (8;22) having characteristics which produce an output signal in which the second formant frequency component of said speech signal dominates the first and third formant frequency components of said speech signal.
Claim 9
Dependent Claim 54 words
The system of claim 7, wherein high pass filter (8;22) is a two pole filter having a cutoff point of about of 1500 Hz and a Q of 2, said filter being used in conjunction with a zero crossings counter (9;23) which estimates the said frequency of second formant component over a short period.
Claim 10
Dependent Claim 35 words
The system of claim 8, further including a circuit (25) for converting said estimated frequency to a proportional voltage signal and an analogue to digital converter for converting said voltage signal into digital data form.
Claim 11
Independent Claim 226 words
A method of converting a speech signal into a data signal for controlling a hearing prosthesis including an implanted electrode array adapted to stimulate the auditory nerve fibres of a patient by the application of electrical currents to selected electrodes in said array, said method comprising the steps of generating an input signal corresponding to a received speech signal, estimating the amplitude and frequency of the fundamental voicing component of said speech signal, estimating the amplitude and frequency of the second formant component of said speech signal, determining whether said speech signal is voiced or unvoiced, conducting psychophysical testing of a patient to determine a relationship between each electrode and a selected range of said second formant frequencies, selecting at least one of said electrodes on the basis of said estimated second formant frequency and said determined relationship to produce the desired percepts in the auditory-like sensations generated in the patient, causing stimulation of said selected electrode at a frequency dependent on the estimated frequency of said fundamental voicing component for voiced speech signals and at a lower substantially constant frequency for unvoiced speech signals, and causing stimulation of each selected electrode in a manner dependent on the estimated amplitude of said second formant component of said speech signal as well as on predetermined data relating to the sensitivity of each electrode implanted in the patient.
Claim 12
Independent Claim 226 words
A method of converting a speech signal into a data signal for controlling a hearing prosthesis including an implanted electrode array adapted to stimulate the auditory nerve fibres of a patient by the application of electrical currents to selected electrodes in said array, said method comprising the steps of generating an input signal corresponding to a received speech signal, estimating the amplitude and frequency of the fundamental voicing component of said speech signal, estimating the amplitude and frequency of the second formant component of said speech signal, determining whether said speech signal is voiced or unvoiced, conducting psychophysical testing of a patient to determine a relationship between each electrode and a selected range of said second formant frequencies, selecting at least one of said electrodes on the basis of said estimated second formant frequency and said determined relationship to produce the desired percepts in the auditory-like sensations generated in the patient, causing stimulation of said selected electrode at a frequency dependent on the estimated frequency of said fundamental voicing component for voiced speech signals and at a lower substantially constant frequency for unvoiced speech signals, and causing stimulation of each selected electrode in a manner dependent on the estimated amplitude of said second formant component of said speech signal as well as on predetermined data relating to the sensitivity of each electrode implanted in the patient.
Claim 13
Dependent Claim 296 words
A signal processing system for converting a speech signal into a data signal for controlling a hearing prosthesis including an implanted electrode array adapted to stimulate the auditory nerve fibres of a patient by the application of electrical currents to selected electrodes in said array, said processing system comprising: means (1,2;20,21) for generating an input signal corresponding to a received speech signal, means (3-6;30-36) for estimating the amplitude and frequency of the fundamental voicing component of said speech signal, means (8-10; 22-26, 27, 28) for estimating the amplitude and frequency of at least one formant component of said speech signal, means (14;37) for determining whether said speech signal is voiced or unvoiced, programmable means (14;40) for producing instruction data which in use causes the application of said electrical currents to selected electrodes in said array, said programmable means being programmed with data (FIG. 2) defining a predetermined relationship between each electrode and a selected range of said at least one formant frequencies based on psychophysical testing of hearing impaired persons and causing selection of said electrodes based on the estimated frequency of said at least one formant component such as to produce the desired percepts in the auditory-like sensations generated in the patient, and means (14;38) for causing stimulation of at least one selected electrode at a frequency dependent on the estimated frequency of said fundamental voicing component for voiced speech signals and at a lower substantially constant frequency for unvoiced speech signals, said programmable means (14;40) further being programmed to produce data (FIG. 4) which determines the level of stimulation of each selected electrode dependent on said estimated amplitude of said at least one formant component speech signal as well as on predetermined data relating to the sensitivity of each electrode implanted in the patient.
Claim 14
Dependent Claim 296 words
A signal processing system for converting a speech signal into a data signal for controlling a hearing prosthesis including an implanted electrode array adapted to stimulate the auditory nerve fibres of a patient by the application of electrical currents to selected electrodes in said array, said processing system comprising: means (1,2;20,21) for generating an input signal corresponding to a received speech signal, means (3-6;30-36) for estimating the amplitude and frequency of the fundamental voicing component of said speech signal, means (8-10; 22-26, 27, 28) for estimating the amplitude and frequency of at least one formant component of said speech signal, means (14;37) for determining whether said speech signal is voiced or unvoiced, programmable means (14;40) for producing instruction data which in use causes the application of said electrical currents to selected electrodes in said array, said programmable means being programmed with data (FIG. 2) defining a predetermined relationship between each electrode and a selected range of said at least one formant frequencies based on psychophysical testing of hearing impaired persons and causing selection of said electrodes based on the estimated frequency of said at least one formant component such as to produce the desired percepts in the auditory-like sensations generated in the patient, and means (14;38) for causing stimulation of at least one selected electrode at a frequency dependent on the estimated frequency of said fundamental voicing component for voiced speech signals and at a lower substantially constant frequency for unvoiced speech signals, said programmable means (14;40) further being programmed to produce data (FIG. 4) which determines the level of stimulation of each selected electrode dependent on said estimated amplitude of said at least one formant component speech signal as well as on predetermined data relating to the sensitivity of each electrode implanted in the patient.
Claim 15
Dependent Claim 45 words
The system of claim 11, wherein said programmable means (14;40) is further programmed with data (FIG. 3) defining a predetermined relationship between the estimated frequency of said fundamental voicing component of said speech signal and the rate at which each said selected electrode is stimulated.
Claim 16
Dependent Claim 48 words
The system of claim 12, wherein said stimulation rate has a lower limit and an upper limit, said lower limit being substantially higher than said substantially constant lower frequency and said upper limit being lower than the upper limit of said estimated frequency of said fundamental voicing component.
Claim 17
Dependent Claim 51 words
The system of claim 12 or 13, wherein said programmable means (14;40) is further programmed with alternative data defining a different relationship between said electrode stimulation rate and said estimated frequency of said fundamental voicing component which is more suitable for auditory-like sensations resembling music or certain types of speech signals.
Claim 18
Dependent Claim 93 words
The system of claim 11, 12 or 13, wherein said programmable means (14;40) is programmed to compare the instantaneous values of the estimated frequency F2 of the second formant component of said speech signal and the estimated amplitude A0 of the fundamental voicing component of said speech signal to determine a voiced speech signal when the instantaneous value of F2 is low and the instantaneous value of A0 is high and to determine the unvoiced speech signal when the instantaneous value of F2 is high and the instantaneous value of A0 is low.
Claim 19
Dependent Claim 63 words
The system of claim 11, 12 or 13, wherein means (14,37) are provided to compare the instantaneous high frequency energy of said speech signal with the instantaneous low frequency energy of said speech signal and for causing said selector electrode to be stimulated at said substantially lower constant when said instantaneous high frequency energy is high compared to said instantaneous low frequency energy.
Claim 20
Dependent Claim 58 words
The system of claim 15, wherein the frequency of said second formant component of said speech signal is estimated by means of a single high pass filter (8;22) having characteristics which produce an output signal in which the second formant frequency component of said speech signal dominates the first and third formant frequency components of said speech signal.
Claim 21
Independent Claim 238 words
A method of converting a speech signal into a data signal for controlling a hearing prosthesis including an implanted electrode array adapted to stimulate the auditory nerve fibres of a patient by the application of electrical currents to selected electrodes in said array, said method comprising the steps of generating an input signal corresponding to a received speech signal, estimating the amplitude and frequency of the fundamental voicing command of said speech signal, estimating the amplitude and frequency of the at least one formant component of said speech signal, determining whether said speech signal is voiced or unvoiced, conducting psychophysical testing of hearing impaired persons to determine a relationship between each electrode and a selected range of said at least one formant frequencies, selecting at least one of said electrodes on the basis of said estimated at least one formant frequency and said determined relationship to produce the desired percepts in the auditory-like sensations generated in the patient, causing stimulation of said at least one selected electrode at a frequency dependent on the estimated frequency of said fundamental voicing component for voiced speech signals and at a lower substantially constant frequency for unvoiced speech signals, and causing stimulation of each selected electrode in a manner dependent on the estimated amplitude of said at least one formant component of said speech signal as well as on predetermined data relating to the sensitivity of each electrode implanted in the patient.
Claim 22
Independent Claim 238 words
A method of converting a speech signal into a data signal for controlling a hearing prosthesis including an implanted electrode array adapted to stimulate the auditory nerve fibres of a patient by the application of electrical currents to selected electrodes in said array, said method comprising the steps of generating an input signal corresponding to a received speech signal, estimating the amplitude and frequency of the fundamental voicing command of said speech signal, estimating the amplitude and frequency of the at least one formant component of said speech signal, determining whether said speech signal is voiced or unvoiced, conducting psychophysical testing of hearing impaired persons to determine a relationship between each electrode and a selected range of said at least one formant frequencies, selecting at least one of said electrodes on the basis of said estimated at least one formant frequency and said determined relationship to produce the desired percepts in the auditory-like sensations generated in the patient, causing stimulation of said at least one selected electrode at a frequency dependent on the estimated frequency of said fundamental voicing component for voiced speech signals and at a lower substantially constant frequency for unvoiced speech signals, and causing stimulation of each selected electrode in a manner dependent on the estimated amplitude of said at least one formant component of said speech signal as well as on predetermined data relating to the sensitivity of each electrode implanted in the patient.
Claim 23
Dependent Claim 307 words
A signal processing system for converting a speech signal into a data signal for controlling a hearing prosthesis including an implanted electrode array adapted to stimulate the auditory nerve fibres of a patient by the application of electrical currents to selected electrodes in said array, said processing system comprising: means (1,2;20,21) for generating an input signal corresponding to a received speech signal, means (3-6;30-36) for estimating the amplitude and frequency of the fundamental voicing component of said speech signal, means (8-10; 22-26, 27, 28) for estimating the amplitude and frequency of at least one formant component of said speech signal, means (14;37) for determining whether said speech signal is voiced or unvoiced, programmable means (14;40) for producing instruction data which in use causes the application of said electrical currents to selected electrodes in said array, said programmable means being programmed with data (FIG. 2) defining a predetermined relationship between each electrode and a selected range of said at least one formant frequencies based on psychophysical testing of hearing impaired persons and causing selection of said electrodes based on the estimated frequency of said at least one formant component such as to produce the desired percepts in the auditory-like sensations generated in the patient, and means (14;38) for causing stimulation of at least one selected electrode at a frequency dependent on the estimated frequency of said fundamental voicing component for voiced speech signals and at a lower substantially constant frequency for unvoiced speech signals, said programmable means (14;40) further being programmed to produce data (FIG. 4) which determines the level of stimulation of each selected electrode dependent on said estimated amplitude of said at least one formant component and said estimated amplitude of said fundamental voicing component of said speech signal as well as on predetermined data relating to the sensitivity of each electrode implanted in the patient.
Claim 24
Dependent Claim 307 words
A signal processing system for converting a speech signal into a data signal for controlling a hearing prosthesis including an implanted electrode array adapted to stimulate the auditory nerve fibres of a patient by the application of electrical currents to selected electrodes in said array, said processing system comprising: means (1,2;20,21) for generating an input signal corresponding to a received speech signal, means (3-6;30-36) for estimating the amplitude and frequency of the fundamental voicing component of said speech signal, means (8-10; 22-26, 27, 28) for estimating the amplitude and frequency of at least one formant component of said speech signal, means (14;37) for determining whether said speech signal is voiced or unvoiced, programmable means (14;40) for producing instruction data which in use causes the application of said electrical currents to selected electrodes in said array, said programmable means being programmed with data (FIG. 2) defining a predetermined relationship between each electrode and a selected range of said at least one formant frequencies based on psychophysical testing of hearing impaired persons and causing selection of said electrodes based on the estimated frequency of said at least one formant component such as to produce the desired percepts in the auditory-like sensations generated in the patient, and means (14;38) for causing stimulation of at least one selected electrode at a frequency dependent on the estimated frequency of said fundamental voicing component for voiced speech signals and at a lower substantially constant frequency for unvoiced speech signals, said programmable means (14;40) further being programmed to produce data (FIG. 4) which determines the level of stimulation of each selected electrode dependent on said estimated amplitude of said at least one formant component and said estimated amplitude of said fundamental voicing component of said speech signal as well as on predetermined data relating to the sensitivity of each electrode implanted in the patient.

References Cited (Backward Citations)

AU41061A Cited
GB1155422A Cited
US3989904A Cited
US4051331A Cited
US4063048A Cited
DE2811120A1 Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1987-04-03 1987-10-03 1988-04-03 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 1991-04-03 1991-10-03 1992-04-03 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 1995-04-03 1995-10-03 1996-04-03 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag