US5473726A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Audio and amplitude modulated photo data collection for speech recognition
Assignee: UNITED STATES AMERICA AIR FORCE, Secretary of
•
Filing: 1993-07-06
•
Granted: 1995-12-05
•
Expires: 2013-07-06
Abstract
Abstract A speech recognition data collection arrangement in which audio sounds spoken by the user are supplemented with lip and mouth movement information obtained from a combination of a light emitting diode and photodiode disposed immediately before the user's face is disclosed. The lip and mouth movement photo information is obtained in the form of an AC coupled amplitude modulated carrier waveform which results from energization of the light emitting diode from a pulsating or alternating current component inclusive source of electrical energy. The lip and mouth movement amplitude modulated carrier waveform is processed with filtering and envelope detection and communicated to a programmed digital computer for the purpose of dual-channel audio and photo based accomplishment of human speech recognition.
Inventors
- 👤 Patrick T. Marshall
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-08 20:58
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/24; G10L15/25
Claims Analysis
Total Claims: 14
Claim 1
Independent Claim
184 words
Dual-channel, optical energy and sound energy, human speech recognition data collection apparatus comprising the combination of: a user's head-carried headset apparatus including a boom end received speech actuated microphone transducer member located close to lip and mouth cavity facial regions of said user; light emitting diode means disposed adjacent said microphone transducer member at said boom end for illuminating said lip and mouth cavity regions of said user with visible spectrum optical energy; pulse modulated electrical energy source means, of fixed predetermined operating frequency, connected with said light emitting diode means, for pulsed electrical energizing of said light emitting diode means and for pulsed optical energy generation therein; electrical photodiode transducer means disposed adjacent said microphone transducer member for generating a user's lip movement responsive amplitude modulated electrical signal having a carrier component of said predetermined frequency and having signal correlation with a voice generated electrical signal from said microphone transducer member; dual-channel electrical conduction means for communicating electrical signals from said microphone transducer member and said photodiode electrical transducer means to a spoken sound and lip movement correlation speech recognition electrical signal processor.
Claim 2
Dependent Claim
184 words
Dual-channel, optical energy and sound energy, human speech recognition data collection apparatus comprising the combination of: a user's head-carried headset apparatus including a boom end received speech actuated microphone transducer member located close to lip and mouth cavity facial regions of said user; light emitting diode means disposed adjacent said microphone transducer member at said boom end for illuminating said lip and mouth cavity regions of said user with visible spectrum optical energy; pulse modulated electrical energy source means, of fixed predetermined operating frequency, connected with said light emitting diode means, for pulsed electrical energizing of said light emitting diode means and for pulsed optical energy generation therein; electrical photodiode transducer means disposed adjacent said microphone transducer member for generating a user's lip movement responsive amplitude modulated electrical signal having a carrier component of said predetermined frequency and having signal correlation with a voice generated electrical signal from said microphone transducer member; dual-channel electrical conduction means for communicating electrical signals from said microphone transducer member and said photodiode electrical transducer means to a spoken sound and lip movement correlation speech recognition electrical signal processor.
Claim 3
Dependent Claim
35 words
The apparatus of claim 1 wherein said electrical photodiode transducer means includes an electrical photodiode member and further including electrical circuit means for operating said photodiode member in a photovoltaic, current source mode of operation.
Claim 4
Dependent Claim
39 words
The apparatus of claim 2 wherein said electrical circuit means includes an operational amplifier circuit and wherein an electrical current output signal of said photodiode member is connected with a summing node electrical input terminal of said operational amplifier.
Claim 5
Dependent Claim
31 words
The apparatus of claim 1 wherein said electrical energy source means predetermined operating frequency is displaced in spectral location from fundamental and harmonic frequencies of a sixty Hertz power line frequency.
Claim 6
Dependent Claim
22 words
The apparatus of claim 4 wherein said electrical energy source means predetermined operating frequency is between two hundred and four hundred Hertz.
Claim 7
Dependent Claim
20 words
The apparatus of claim 5 wherein said electrical energy source means predetermined operating frequency is two hundred seventy nine Hertz.
Claim 8
Independent Claim
212 words
The method of collecting coordinated vocal and lip movement signals for dual-channel human speech recognition correlated processing comprising the steps of: disposing an audio sound to electrical signal transducing microphone adjacent a lip and mouth cavity facial area of a user subject, said microphone generating electrical signals representative of user speech sounds; illuminating a predetermined mouth and lip facial portion of said user with visible spectrum light energy originating in a light emitting diode electrical energy to optical energy transducer disposed adjacent said microphone; energizing said light emitting diode with pulsating electrical energy of predetermined pulsation frequency, said illuminating visible spectrum light energy being also pulsated at said pulsation frequency; collecting user lip-reflected illumination energy in a photodiode optical signal to electrical signal transducer, said collected energy generating a lip movement modulated electrical signal of said predetermined pulsation frequency, carrier frequency and lip movement responsive carrier amplitude modulation at output terminals of said photodiode transducer; locating said photodiode optical signal to electrical signal transducer adjacent said microphone and said light emitting diode and proximate a predetermined portion of said user's lips and mouth cavity; and communicating said microphone electrical signals and said photodiode electrical signals via separate communication paths to a correlated dual-channel human speech recognition processor means for speech recognition processing.
Claim 9
Independent Claim
212 words
The method of collecting coordinated vocal and lip movement signals for dual-channel human speech recognition correlated processing comprising the steps of: disposing an audio sound to electrical signal transducing microphone adjacent a lip and mouth cavity facial area of a user subject, said microphone generating electrical signals representative of user speech sounds; illuminating a predetermined mouth and lip facial portion of said user with visible spectrum light energy originating in a light emitting diode electrical energy to optical energy transducer disposed adjacent said microphone; energizing said light emitting diode with pulsating electrical energy of predetermined pulsation frequency, said illuminating visible spectrum light energy being also pulsated at said pulsation frequency; collecting user lip-reflected illumination energy in a photodiode optical signal to electrical signal transducer, said collected energy generating a lip movement modulated electrical signal of said predetermined pulsation frequency, carrier frequency and lip movement responsive carrier amplitude modulation at output terminals of said photodiode transducer; locating said photodiode optical signal to electrical signal transducer adjacent said microphone and said light emitting diode and proximate a predetermined portion of said user's lips and mouth cavity; and communicating said microphone electrical signals and said photodiode electrical signals via separate communication paths to a correlated dual-channel human speech recognition processor means for speech recognition processing.
Claim 10
Dependent Claim
34 words
The method of claim 7 wherein said disposing, illuminating, and locating steps each comprise mounting said microphone, light emitting diode, and photodiode transducers on a distal end of a headset carried microphone boom arm.
Claim 11
Dependent Claim
18 words
The method of claim 7 wherein said pulsating electrical energy pulsation frequency is above one hundred twenty Hertz.
Claim 12
Dependent Claim
20 words
The method of claim 7 wherein said communicating step includes electrical signal transmission via a two-path flexible electrical tether cord.
Claim 13
Dependent Claim
24 words
The method of claim 7 wherein said correlated dual-channel human speech recognition processor means includes signal processing in a hardware implemented speech recognition algorithm.
Claim 14
Dependent Claim
25 words
The method of claim 7 wherein said correlated dual-channel human speech recognition correlated processor means includes signal processing in a software implemented speech recognition algorithm.
References Cited (Backward Citations)
US3191321A
Cited
US3622791A
Cited
US4151407A
Cited
US4437002A
Cited
US4757541A
Cited
US4769845A
Cited
US4961177A
Cited
US5051799A
Cited
US5153560A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1998-12-04 | 1999-06-05 | 1999-12-05 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2002-12-04 | 2003-06-05 | 2003-12-05 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2006-12-04 | 2007-06-05 | 2007-12-05 | $7700.00 | Window Closed / Lapsed |