US5313522A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Apparatus for generating from an audio signal a moving visual lip image from which a speech content of the signal can be comprehended by a lipreader
Assignee: Individual
•
Filing: 1993-04-15
•
Granted: 1994-05-17
•
Expires: 2013-04-15
Abstract
Abstract A device for facilitating comprehension by a hearing impaired person of a telephone conversation includes a cord coupling to a telephone line a circuit which can convert the received audio speech signal into a series of phonemes. The circuit also includes an arrangement which correlates the series of phonemes to respective human lip shapes and displays on a display device a succession of images of the respective lip shapes. This permits the hearing impaired person to carry out lip reading of the displayed lip shapes while listening to the telephone conversation, which improves the person's level of comprehension of the conversation.
Inventors
- 👤 Robert P. Slager
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-27 23:56
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/24; G09; G09B; G09B21/00; G09B21/06; G10L21/00; G10L21/06; G10L21/10; G10L2021/105; H; H04; H04N; H04N19/00; H04N19/20
Claims Analysis
Total Claims: 12
Claim 1
Independent Claim
128 words
An apparatus comprising: a circuit, means for coupling said circuit to a line carrying an audio speech signal, and display means coupled to said circuit, said circuit including means for breaking the audio speech signal into a series of successive phonemes representative of vowels and consonants, and means responsive to said series of phonemes for generating and for displaying on said display means an image of moving human lips substantially synchronized in real time to said audio speech signal and having an accuracy which permits a person with lipreading skills to comprehend a substantial portion of a speech content of the audio speech signal through lipreading of said image, said image including a succession of lip shapes respectively corresponding to respective said phonemes in said series of phonemes.
Claim 2
Independent Claim
128 words
An apparatus comprising: a circuit, means for coupling said circuit to a line carrying an audio speech signal, and display means coupled to said circuit, said circuit including means for breaking the audio speech signal into a series of successive phonemes representative of vowels and consonants, and means responsive to said series of phonemes for generating and for displaying on said display means an image of moving human lips substantially synchronized in real time to said audio speech signal and having an accuracy which permits a person with lipreading skills to comprehend a substantial portion of a speech content of the audio speech signal through lipreading of said image, said image including a succession of lip shapes respectively corresponding to respective said phonemes in said series of phonemes.
Claim 3
Dependent Claim
15 words
An apparatus of claim 1, wherein said display means includes a computer video display unit.
Claim 4
Dependent Claim
15 words
An apparatus of claim 1, wherein said display means includes a liquid crystal display component.
Claim 5
Dependent Claim
69 words
An apparatus of claim 3, including a wedge-shaped housing having said liquid crystal display component supported thereon, wherein said line is a telephone line, and wherein said means for coupling said circuit to said telephone line includes a telephone cord having a first end coupled to said circuit in said housing and having a second end which is disposed externally of said housing and which has a telephone jack.
Claim 6
Dependent Claim
41 words
An apparatus of claim 4, including a battery in said housing for powering said circuit, and a low battery indicator provided on said housing, said circuit including means responsive to a low energy state of said battery for actuating said indicator.
Claim 7
Dependent Claim
33 words
An apparatus of claim 1, wherein said circuit includes a computer system having a central processing unit, and includes memory means having stored therein a library of phonemes and corresponding human lip shapes.
Claim 8
Independent Claim
142 words
An apparatus comprising: a circuit, means for providing at an input to said circuit an audio speech signal, and display means coupled to said circuit, said circuit including means responsive to the audio speech signal for determining a phonetic content of said audio speech signal which is representative of vowels and consonants embodied in said audio speech signal, for synthesizing from said phonetic content an image of human lips forming a succession of lip shapes representative of said phonetic content, and for displaying on said display means said synthesized image of human lips forming said succession of lip shapes, said image being substantially synchronized in real time to said audio speech signal and having an accuracy which permits a person with lipreading skills to comprehend a substantial portion of a speech content of said audio speech signal through lipreading of said image.
Claim 9
Independent Claim
142 words
An apparatus comprising: a circuit, means for providing at an input to said circuit an audio speech signal, and display means coupled to said circuit, said circuit including means responsive to the audio speech signal for determining a phonetic content of said audio speech signal which is representative of vowels and consonants embodied in said audio speech signal, for synthesizing from said phonetic content an image of human lips forming a succession of lip shapes representative of said phonetic content, and for displaying on said display means said synthesized image of human lips forming said succession of lip shapes, said image being substantially synchronized in real time to said audio speech signal and having an accuracy which permits a person with lipreading skills to comprehend a substantial portion of a speech content of said audio speech signal through lipreading of said image.
Claim 10
Independent Claim
142 words
An apparatus comprising: a circuit, means for supplying to an input of said circuit an audio speech signal, and display means coupled to said circuit, said circuit including means for breaking the audio speech signal into a series of successive phonemes representative of vowels and consonants, and means for associating with each of said phonemes in said series a respective image of human lips forming a respective lip shape which corresponds to the phoneme, and for displaying on said display means each of said images in an order corresponding to the order in said series of the associated phonemes, said image being substantially synchronized in real time to said audio speech signal and having an accuracy which permits a person with lipreading skills to comprehend a substantial portion of a speech content of said audio speech signal through lipreading of said image.
Claim 11
Independent Claim
142 words
An apparatus comprising: a circuit, means for supplying to an input of said circuit an audio speech signal, and display means coupled to said circuit, said circuit including means for breaking the audio speech signal into a series of successive phonemes representative of vowels and consonants, and means for associating with each of said phonemes in said series a respective image of human lips forming a respective lip shape which corresponds to the phoneme, and for displaying on said display means each of said images in an order corresponding to the order in said series of the associated phonemes, said image being substantially synchronized in real time to said audio speech signal and having an accuracy which permits a person with lipreading skills to comprehend a substantial portion of a speech content of said audio speech signal through lipreading of said image.
Claim 12
Dependent Claim
25 words
An apparatus of claim 8, further comprising means responsive to said audio speech signal for generating audible sound waves representative of said audio speech signal.
References Cited (Backward Citations)
US4260229A
Cited
US4624010A
Cited
US4546383A
Cited
US4563758A
Cited
US4723290A
Cited
US4600281A
Cited
US4769845A
Cited
JPS62274962A
Cited
US4864622A
Cited
US4984185A
Cited
US4969194A
Cited
US4907274A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1997-05-16 | 1997-11-15 | 1998-05-17 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2001-05-16 | 2001-11-15 | 2002-05-17 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2005-05-16 | 2005-11-15 | 2006-05-17 | $7700.00 | Window Closed / Lapsed |