US4520501A — Speech presentation system and method

Claim 1

Independent Claim 81 words

A method of presenting speech information comprising separating speech into a sequence of phonemes representative of the speech; transforming each phoneme into first and second grid patterns of points, the first pattern being a code which identifies the phoneme sound and the second pattern being another code which identifies a mouth form that produces the phoneme sound; and presenting the first and second patterns by activating presenters arranged in a multiple point grid matrix in accordance with said patterns of points.

Claim 2

Independent Claim 81 words

A method of presenting speech information comprising separating speech into a sequence of phonemes representative of the speech; transforming each phoneme into first and second grid patterns of points, the first pattern being a code which identifies the phoneme sound and the second pattern being another code which identifies a mouth form that produces the phoneme sound; and presenting the first and second patterns by activating presenters arranged in a multiple point grid matrix in accordance with said patterns of points.

Claim 3

Dependent Claim 38 words

The method of claim 1, wherein said separating comprises identifying successive phonemes and their durations, and wherein said presenting comprises successively presenting the first and second patterns with the same durations as the phonemes to which they correspond.

Claim 4

Dependent Claim 17 words

The method of claim 2, wherein said presenting comprises presenting the patterns substantially contemporaneously with the speech.

Claim 5

Dependent Claim 38 words

The method of claim 1, wherein said presenting comprises presenting the first patterns on a first multiple point grid matrix array of presenters and presenting the second patterns on a second multiple point grid matrix array of presenters.

Claim 6

Dependent Claim 38 words

The method of claim 4, wherein the presenters of the first array comprise first and second groups of presenters, the first group being employed for representing consonant sounds and the second group being employed for representing vowel sounds.

Claim 7

Dependent Claim 76 words

A speech presentation apparatus comprising first keyboard means for selecting speech phonemes corresponding to consonant sounds, second keyboard means for selecting speech phonemes corresponding to vowel sounds, third keyboard means for selecting mouth forms that actually produce said consonant and said vowel sounds, each keyboard means having a plurality of keys for enabling the selections, and means responsive to the first, second and third keyboard means for providing signals representative of said phonemes and mouth forms.

Claim 8

Dependent Claim 76 words

A speech presentation apparatus comprising first keyboard means for selecting speech phonemes corresponding to consonant sounds, second keyboard means for selecting speech phonemes corresponding to vowel sounds, third keyboard means for selecting mouth forms that actually produce said consonant and said vowel sounds, each keyboard means having a plurality of keys for enabling the selections, and means responsive to the first, second and third keyboard means for providing signals representative of said phonemes and mouth forms.

Claim 9

Dependent Claim 22 words

The method of claim 1, wherein said transforming comprises associating each phoneme sound with one of a preselected group of mouth forms.

Claim 10

Dependent Claim 15 words

The method of claim 1, wherein said presenting comprises presenting the patterns as tactile stimuli.

Claim 11

Dependent Claim 15 words

The method of claim 1, wherein said presenting comprises presenting the patterns as visual stimuli.

Claim 12

Dependent Claim 18 words

The method of claim 1, wherein said presenting comprises presenting the patterns simultaneously as tactile and visual stimuli.

Claim 13

Dependent Claim 18 words

The method of claim 1, wherein said presenting comprises presenting the first and second patterns at different locations.

Claim 14

Independent Claim 82 words

A method of presenting speech information comprising producing a sequence of signals representative of speech phonemes; transforming the signals into a sequence of first and second grid patterns of points, the first pattern being a code which identifies the phoneme sound and the second pattern being another code which identifies a mouth form that produces the phoneme sound; and presenting the first and second patterns by activating presenters arranged in a multiple point grid matrix in accordance with said patterns of points.

Claim 15

Independent Claim 82 words

A method of presenting speech information comprising producing a sequence of signals representative of speech phonemes; transforming the signals into a sequence of first and second grid patterns of points, the first pattern being a code which identifies the phoneme sound and the second pattern being another code which identifies a mouth form that produces the phoneme sound; and presenting the first and second patterns by activating presenters arranged in a multiple point grid matrix in accordance with said patterns of points.

Claim 16

Dependent Claim 43 words

The method of claim 12, wherein said transforming comprises analyzing the speech in real time to identify successive phonemes, and forming a corresponding sequence of said first and second patterns, and wherein said presenting comprises presenting the patterns substantially contemporaneously with the speech.

Claim 17

Dependent Claim 17 words

The method of claim 12, wherein said producing comprises generating said sequence of signals using a keyboard.

Claim 18

Dependent Claim 46 words

The method of claim 14 wherein said producing comprises producing with a first plurality of keys first signals representing consonant sounds, producing with a second plurality of keys second signals representing vowel sounds, and producing with a third plurality of keys third signals representing mouth forms.

Claim 19

Dependent Claim 19 words

The method of claim 12, wherein said producing comprises producing a preselected sequence of signals from a storage medium.

Claim 20

Dependent Claim 22 words

The method of claim 12, wherein said presenting comprises presenting the first and second patterns on first and second arrays of presenters.

Claim 21

Dependent Claim 25 words

The method of claim 17, wherein said first and second arrays comprise first and second tactile stimulator matrices for presenting the patterns as tactile stimuli.

Claim 22

Dependent Claim 35 words

The method of claim 18, wherein said presenting comprises positioning the tactile stimulator matrices at first and second opposed areas of a human limb and presenting the tactile stimuli at said first and second areas.

Claim 23

Dependent Claim 20 words

The method of claim 19, wherein said presenting comprises presenting the patterns as visual stimuli simultaneously with said tactile stimuli.

Claim 24

Dependent Claim 27 words

The method of claim 12 further comprising producing signals representative of preselected environmental sounds, and wherein said presenting comprises presenting third patterns representative of the preselected sounds.

Claim 25

Dependent Claim 93 words

Apparatus for presenting speech information comprising means for separating speech into a sequence of phonemes representative of the speech; means for transforming each phoneme into first and second grid patterns of points, the first pattern being a code which identifies the phoneme sound and the second pattern being another code which identifies a mouth form that produces the phoneme sound; and means for presenting the first and second patterns, the presenting means including multiple point grid matrix arrays of presenters, and means for activating the presenters in accordance with said patterns of points.

Claim 26

Dependent Claim 93 words

Apparatus for presenting speech information comprising means for separating speech into a sequence of phonemes representative of the speech; means for transforming each phoneme into first and second grid patterns of points, the first pattern being a code which identifies the phoneme sound and the second pattern being another code which identifies a mouth form that produces the phoneme sound; and means for presenting the first and second patterns, the presenting means including multiple point grid matrix arrays of presenters, and means for activating the presenters in accordance with said patterns of points.

Claim 27

Dependent Claim 46 words

The apparatus of claim 22, wherein said separating means comprises means for analyzing the speech in real time to identify successive phonemes and their durations, and wherein the presenting means comprises means for presenting corresponding patterns with the same durations and substantially contemporaneously with the speech.

Claim 28

Dependent Claim 24 words

The apparatus of claim 23, wherein the analyzing means comprises means for classifying each phoneme as a consonant sound or as a vowel sound.

Claim 29

Dependent Claim 31 words

The apparatus of claim 24, wherein the presenting means comprises a first array of presenters for presenting said second patterns and a second array of presenters for presenting said second patterns.

Claim 30

Dependent Claim 53 words

The apparatus of claim 25, wherein the first array of presenters comprises a rectangular matrix having two columns of presenters, one column being used for presenting consonant sounds and the other column being used for presenting vowel sounds, and wherein the second array comprises a square matrix of presenters for the mouth forms.

Claim 31

Dependent Claim 24 words

The apparatus of claim 25, wherein the first and second arrays comprise tactile stimulators for presenting the patterns as patterns of cutaneous nerve stimulation.

Claim 32

Dependent Claim 58 words

The apparatus of claim 27, wherein the first and second arrays of tactile stimulators are built into the lining of an armband adapted to be worn on the forearm of a user, the tactile stimulator arrays being arranged so as to be positioned in opposing relationship on opposite sides of the forearm to provide coordinated tactile stimulation thereto.

Claim 33

Dependent Claim 38 words

The apparatus of claim 22, wherein the separating means and the transforming means comprise a microcomputer speech analyzer having input means for speech signals and having means for selecting said speech signals from a plurality of speech sources.

Claim 34

Dependent Claim 23 words

The apparatus of claim 29, wherein said plurality of speech sources comprises a plurality of microphones, each having a different area of coverage.

Claim 35

Dependent Claim 37 words

The apparatus of claim 22 further comprising memory means for storing said codes identifying phoneme sounds and mouth forms, and wherein the presenting means is responsive to the memory means for presenting said first and second patterns.

Claim 36

Dependent Claim 44 words

The apparatus of claim 31, wherein the memory means comprises film upon which spatial patterns representing the phonemes and mouth forms are recorded as punched patterns, and wherein the presenting means comprises means for projecting the punched patterns to produce a visual presentation thereof.

Claim 37

Dependent Claim 96 words

Apparatus for presenting speech information comprising first means for producing a sequence of signals representative of speech phonemes; second means for transforming the signals into a sequence of first and second grid patterns of points, the first pattern being a code which identifies the phoneme sound and the second pattern being another code which identifies a mouth form that produces the phoneme sound; and means for presenting the first and second patterns, the presenting means including multiple point grid matrix arrays of presenters, and means for activating the presenters in accordance with said patterns of points.

Claim 38

Dependent Claim 96 words

Apparatus for presenting speech information comprising first means for producing a sequence of signals representative of speech phonemes; second means for transforming the signals into a sequence of first and second grid patterns of points, the first pattern being a code which identifies the phoneme sound and the second pattern being another code which identifies a mouth form that produces the phoneme sound; and means for presenting the first and second patterns, the presenting means including multiple point grid matrix arrays of presenters, and means for activating the presenters in accordance with said patterns of points.

Claim 39

Dependent Claim 36 words

The apparatus of claim 33, wherein the producing means comprises means for separating speech into its constituent phonemes, and means for associating with each phoneme a characteristic mouth form from a preselected group of mouth forms.

Claim 40

Dependent Claim 41 words

The apparatus of claim 34, wherin said separating means comprises means for analyzing the speech in real time to identify successive phonemes and their durations, and wherein said presenting means comprises means for successively presenting corresponding patterns having the same durations.

Claim 41

Dependent Claim 50 words

The apparatus of claim 33, wherein producing means comprises a keyboard having a first plurality of keys for producing first signals representing consonant sounds, a second plurality of keys for producing second signals representing vowel sounds, and a third plurality of keys for producing third signals representing the mouth forms.

Claim 42

Dependent Claim 20 words

The apparatus of claim 33, wherein said producing means comprises a memory that reproduces a stored sequence of said signals.

Claim 43

Dependent Claim 19 words

The apparatus of claim 33 further comprising means for transmitting said signals to a plurality of such presenting means.

Claim 44

Dependent Claim 33 words

The apparatus of claim 33, wherein the presenting means comprises first and second arrays of presenters, the first array presenting the first patterns corresponding to and the second array presenting the second patterns.

Claim 45

Dependent Claim 16 words

The apparatus of claim 39, wherein said presenting means comprises first and second tactile stimulator matrices.

Claim 46

Dependent Claim 21 words

The apparatus of claim 39, wherein the presenting means comprises means for presenting the patterns as illuminated areas on a display.

Claim 47

Dependent Claim 18 words

The apparatus of claim 41, wherein the presenting means comprises means for projecting the patterns onto the display.

Claim 48

Dependent Claim 36 words

The apparatus of claim 42, wherein the display includes means for illuminating preselected portions thereof so as to display patterns that can be compared with a spatial pattern projected onto the display by the projecting means.

Claim 49

Dependent Claim 46 words

The apparatus of claim 43, wherein the display comprises a ground glass plate having a front surface for displaying the patterns projected thereon and having a rear surface at which a plurality of light sources arranged in accordance with the first and second arrays is positioned.

Claim 50

Dependent Claim 25 words

The apparatus of claim 41, wherein the display comprises means for producing electrical signals representative of the patterns displayed thereon for driving another presenting means.

Claim 51

Dependent Claim 113 words

Apparatus for presenting speech information comprising means for producing a sequence of signals representative of speech; first and second multiple point grid matrix arrays of tactile stimulators adapted to be positioned at spaced locations on a human limb for providing coordinated tactile stimulation thereto; and means responsive to the signals for simultaneously activating the tactile stimulators of each array in respective first and second sequences of patterns that correspond to signals of the sequence, the first pattern being a code which represents a speech sound and the second pattern being another code which represents a mouth shape that produces the speech sound, in order to provide a coded tactile presentation of the speech.

Claim 52

Dependent Claim 113 words

Apparatus for presenting speech information comprising means for producing a sequence of signals representative of speech; first and second multiple point grid matrix arrays of tactile stimulators adapted to be positioned at spaced locations on a human limb for providing coordinated tactile stimulation thereto; and means responsive to the signals for simultaneously activating the tactile stimulators of each array in respective first and second sequences of patterns that correspond to signals of the sequence, the first pattern being a code which represents a speech sound and the second pattern being another code which represents a mouth shape that produces the speech sound, in order to provide a coded tactile presentation of the speech.

Claim 53

Dependent Claim 25 words

The apparatus of claim 46, wherein the first and second arrays are adapted to be positioned in opposing relationship on opposite sides of the limb.

Claim 54

Dependent Claim 29 words

The apparatus of claim 47, wherein the limb comprises a forearm, and the first and second arrays are mounted in an armband adapted to be worn on the forearm.

Claim 55

Dependent Claim 33 words

The apparatus of claim 48, wherein the producing means comprises a speech analyzer mounted in the armband for producing signals representative of speech phonemes and characteristic mouth forms that actually produce such phonemes.

Claim 56

Dependent Claim 20 words

The apparatus of claim 49, wherein the tactile stimulators comprise piezoelectric strip benders having projections adapted to contact the forearm.

Claim 57

Dependent Claim 31 words

The apparatus of claim 48, wherein the tactile stimulators of each array are spaced from one another sufficiently to enable stimulation of adjacent areas of the limb to be readily distinguished.

Claim 58

Dependent Claim 68 words

The apparatus of claim 6, wherein the first and second keyboard means comprise first and second keyboards formed to be mounted on a leg of a user and to be operated with one hand of the user, and wherein the third keyboard means comprises a keyboard adapted to be mounted on the thumb of the opposite hand of the user and to be operated by the fingers thereof.

Claim 59

Dependent Claim 29 words

The apparatus of claim 52, wherein the first and second keyboards are movably related so as to enable their relative positions with respect to one another to be varied.

Claim 60

Dependent Claim 22 words

The apparatus of claim 27 further comprising means for vibrating said tactile stimulators at different frequencies to present differences in speech pitch.

Annuity Stage	Window Opens	Payment Deadline	Surcharge Period Until	Estimated Fee	Status
3.5 Years (Year 4)	1988-05-27	1988-11-26	1989-05-28	$2000.00	Window Closed / Lapsed
7.5 Years (Year 8)	1992-05-27	1992-11-26	1993-05-28	$3760.00	Window Closed / Lapsed
11.5 Years (Year 12)	1996-05-27	1996-11-26	1997-05-28	$7700.00	Window Closed / Lapsed

Speech presentation system and method

Abstract

Inventors

Bibliographic Details

Claims Analysis

References Cited (Backward Citations)

USPTO Annuity & Maintenance Windows

Assigned Categories & Tags

Assign Category Tag