US5734794A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and system for voice-activated cell animation
Assignee: Individual
•
Filing: 1995-06-22
•
Granted: 1998-03-31
•
Expires: 2015-06-22
Abstract
Abstract A computer based system utilizing cues extracted from audio speech to select from among a database of stored image cells to produce synthesized animated characters. A database of image cells is created by storing the face of an actor or other character articulating some 40 phoneme sounds, in 8 different emotions from 25 different camera angles. Audio speech is then analyzed and the faces are extracted based on phoneme sounds and emotion cues within the spectral information of the speech. The position of a user operated camera controller is polled to determine a desired camera angle and the three image parameters (articulation, emotion and camera angle) are used to select an image from the database associated with the phoneme. The selected images are interpolated to produce a smooth, life-like character or cartoon animation sequence, and then stored to a video recorder.
Inventors
- 👤 Tom H. White
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-07 20:32
CPC Classifications
G; G10; G10L; G10L13/00; G10L13/02; G10L13/033; G09; G09B; G09B5/00; G09B5/06; G09B5/065; G11; G11B; G11B27/00; G11B27/02; G11B27/031; G11B27/034; G11B27/10; G11B27/19; G11B27/28; G11B27/34; G10L21/00; G10L21/06; G10L21/10; G10L2021/105
Claims Analysis
Total Claims: 25
Claim 1
Independent Claim
48 words
A computer-based method for animating images, the method comprising the steps of: receiving audio speech; extracting emotion cues from the audio speech; identifying image cells from a database of image cells according to the extracted cues; and sequencing the identified image cells to correspond to the audio speech.
Claim 2
Dependent Claim
48 words
A computer-based method for animating images, the method comprising the steps of: receiving audio speech; extracting emotion cues from the audio speech; identifying image cells from a database of image cells according to the extracted cues; and sequencing the identified image cells to correspond to the audio speech.
Claim 3
Dependent Claim
18 words
The method according to claim 1, further comprising the step of extracting phonetic cues from the audio speech.
Claim 4
Dependent Claim
16 words
The method according to claim 1, wherein the received audio speech is from a recorded source.
Claim 5
Dependent Claim
36 words
The method according to claim 1, further comprising the steps of receiving a camera angle signal and combining said camera angle signal with the extracted emotion cues for use in identifying cells from the cell database.
Claim 6
Dependent Claim
24 words
The method according to claim 1, further comprising the step of receiving emotion control signals which override the extracted emotion cues from the audio.
Claim 7
Dependent Claim
27 words
The method according to claim 5, further comprising the step of storing the received emotion control signals for use in extracting emotion cues from the audio speech.
Claim 8
Dependent Claim
21 words
The method according to claim 1, wherein the database of image cells is organized according to an ordering of extracted cues.
Claim 9
Dependent Claim
20 words
The method according to claim 7, wherein the ordering of extracted cues is according to emotion, phonetics and camera angle.
Claim 10
Dependent Claim
26 words
The method according to claim 1, the method further comprising the step of interpolating the sequenced image cells to produce smooth transitions between said sequenced cells.
Claim 11
Dependent Claim
23 words
The method according to claim 1, further comprising the step of creating the database of image cells by scanning sequences of video frames.
Claim 12
Independent Claim
52 words
A system for animating images, the system comprising: means for receiving audio speech; means for extracting emotion cues from the audio speech; means for identifying image cells from a database of image cells according to the extracted cues; and means for sequencing the identified image cells to correspond to the audio speech.
Claim 13
Independent Claim
52 words
A system for animating images, the system comprising: means for receiving audio speech; means for extracting emotion cues from the audio speech; means for identifying image cells from a database of image cells according to the extracted cues; and means for sequencing the identified image cells to correspond to the audio speech.
Claim 14
Dependent Claim
40 words
The system according to claim 11, further comprising means for extracting phonetic cues from the audio speech coupled to the means for identifying, in order that phonetic cues may be combined with emotion cues and used for identifying image cells.
Claim 15
Dependent Claim
33 words
The system according to claim 11, further comprising means for receiving a camera angle signal said camera angle signal with the extracted emotion cues for use in identifying cells from the cell database.
Claim 16
Dependent Claim
24 words
The system according to claim 11, further comprising means for receiving emotion control signals which override the extracted emotion cues from the audio speech.
Claim 17
Dependent Claim
75 words
A computer-based system for animating images, the system comprising: a database of stored image cells; an audio source containing recorded audio speech; audio tools having criteria for extracting cues from the audio speech; a processor coupled to the audio tools and to the database for selecting stored image cells in response to cues extracted by the audio tools; and a video recorder coupled to the processor for sequentially storing image cells selected by the processor.
Claim 18
Dependent Claim
75 words
A computer-based system for animating images, the system comprising: a database of stored image cells; an audio source containing recorded audio speech; audio tools having criteria for extracting cues from the audio speech; a processor coupled to the audio tools and to the database for selecting stored image cells in response to cues extracted by the audio tools; and a video recorder coupled to the processor for sequentially storing image cells selected by the processor.
Claim 19
Dependent Claim
22 words
The system according to claim 15, wherein the database of image cells is arranged according to cues defined by the audio tools.
Claim 20
Dependent Claim
12 words
The system according to claim 15, wherein the cues comprise emotion information.
Claim 21
Dependent Claim
15 words
The system according to claim 17, wherein the emotion information further comprises relative amplitude data.
Claim 22
Dependent Claim
15 words
The system according to claim 17, wherein the emotion information further comprises frequency response data.
Claim 23
Dependent Claim
26 words
The system according to claim 17, further comprising an emotion control input coupled to the processor for defining the emotion cues extracted by the audio tools.
Claim 24
Dependent Claim
12 words
The system according to claim 15, wherein the cues comprise phoneme information.
Claim 25
Dependent Claim
37 words
The system according to claim 15, further comprising a control input coupled to the processor for providing perspective cues to the processor, which cues define a viewing angle corresponding to at least one of said image cells.
References Cited (Backward Citations)
CA920687A
Cited
US4600919A
Cited
US4600919B1
Cited
US4642710A
Cited
US4827532A
Cited
US4600281A
Cited
US4856066A
Cited
US4884972A
Cited
US5353404A
Cited
US5111409A
Cited
US5214758A
Cited
US5261041A
Cited
US5377319A
Cited
US5367454A
Cited
US5356156A
Cited
US5347306A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-03-30 | 2001-09-29 | 2002-03-31 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-03-30 | 2005-09-29 | 2006-03-31 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-03-30 | 2009-09-29 | 2010-03-31 | $7700.00 | Window Closed / Lapsed |