US5430835A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and means for computer sychronization of actions and sounds
Assignee: SIERRA ENTERTAINMENT Inc
•
Filing: 1994-05-26
•
Granted: 1995-07-04
•
Expires: 2014-05-26
Abstract
Abstract The invention includes a method of synchronizing actions and sounds for display on the visual display in a computer-system. The invention also includes a simulation including synchronized actions and sounds. Specifically, the method of synchronizing actions and sounds for display on a computer system having a visual display includes determining locations in a sound recording where predetermined actions are to be displayed, measuring the time that elapses when the sound recording is played from reference point to the locations in the sound recording where the predetermined actions are to be displayed, associating the predetermined actions with the locations in the sound recording where the predetermined actions are to be displayed, and saving the locations and their associated actions. The invented method of synchronizing actions and sounds on a visual display in a computer system includes playing the sound, determining when a predetermined amount of time of the sound has elapsed, and displaying the action on the visual display when the predetermined amount of time of the sound has elapsed. The simulation includes a sound recording, a mechanism for playing it, and a mechanism for measuring its elapsed time when it played; data defining predetermined actions; a mechanism to compare such elapsed time with time positions; and a mechanism to display the actions upon a predetermined relationship between the elapsed time and the time positions.
Inventors
- 👤 Kenneth A. Williams
- 👤 Robert E. Heitman
- 👤 Christopher F. Smith
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-30 19:14
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/40; H04N21/41; H04N21/414; H04N21/4143; H04N21/43; H04N21/4302; H04N21/4307; H04N21/43074; H04N21/47; H04N21/478; H04N21/4781
Claims Analysis
Total Claims: 13
Claim 1
Independent Claim
240 words
In a computer video game system having a sound generator and a visual display showing an image, a method of synchronizing actions of the image with a sound recording that has a given time duration, where each action is defined by data that is associated with a time position that signals when the action is to be displayed, the method comprising: reading a first time position associated with data describing a first action; playing the sound recording on the sound generator; determining the elapsed time of the sound recording; comparing the first time position with the elapsed time; and if the first time position is greater than the elapsed time, then waiting a predetermined period of time and repeating the method beginning with the step of determining; but if the first time position is less than or equal to the elapsed time, then performing the steps of recognizing a second time position associated with data, describing a second action; contrasting the second time position with the elapsed time; and if the second time position is greater than the elapsed time, then displaying the first action and repeating the method for subsequent time positions associated with data describing subsequent actions beginning with the step of determining; but if the second time position is less than or equal to the elapsed time, then repeating the method for subsequent time positions associated with data describing subsequent actions beginning with the step of recognizing.
Claim 2
Dependent Claim
240 words
In a computer video game system having a sound generator and a visual display showing an image, a method of synchronizing actions of the image with a sound recording that has a given time duration, where each action is defined by data that is associated with a time position that signals when the action is to be displayed, the method comprising: reading a first time position associated with data describing a first action; playing the sound recording on the sound generator; determining the elapsed time of the sound recording; comparing the first time position with the elapsed time; and if the first time position is greater than the elapsed time, then waiting a predetermined period of time and repeating the method beginning with the step of determining; but if the first time position is less than or equal to the elapsed time, then performing the steps of recognizing a second time position associated with data, describing a second action; contrasting the second time position with the elapsed time; and if the second time position is greater than the elapsed time, then displaying the first action and repeating the method for subsequent time positions associated with data describing subsequent actions beginning with the step of determining; but if the second time position is less than or equal to the elapsed time, then repeating the method for subsequent time positions associated with data describing subsequent actions beginning with the step of recognizing.
Claim 3
Dependent Claim
27 words
The method of claim 1 where each time position indicates the amount of time of the sound recording that must elapse before the respective action is displayed.
Claim 4
Dependent Claim
22 words
The method of claim 1 where the step of displaying is also accomplished when there is no further data describing subsequent actions.
Claim 5
Dependent Claim
42 words
The method of claim 1 where the steps of waiting and repeating beginning with the step of determining are accomplished when there is further data describing subsequent actions and when there is further time remaining for the playing of the sound recording.
Claim 6
Dependent Claim
24 words
The method of claim 1 where the image is a character, the sound recording is a speech sample and the actions include mouth positions.
Claim 7
Dependent Claim
17 words
The method of claim 1 where the image is a character and the actions include character gestures.
Claim 8
Dependent Claim
214 words
In a computer video game having a sound generator for playing sound samples from a sound recording composed of a plurality of sound samples and a visual display for displaying an image, a method of synchronizing incorporation of an action in the image with the sound recording, where the action is selected from a predefined set of available actions, the method comprising: selecting one or more of the sound samples to synchronize; identifying a set of predetermined time locations in each of the selected sound samples where an action is to be incorporated in the image; associating a specific action with each predetermined time location; playing one of the sound samples on the sound generator; determining a current time location in the playing of the sound sample; if the sound sample is one of the selected sound samples, then: comparing the current time location with the predetermined time locations for the sound sample; and if the current time location is one of the predetermined time locations, then incorporating the associated specific action in the image; and if the sound sample is not one of the selected sound samples, then for at least one of the current time locations randomly selecting an action from the set of available actions and incorporating it in the image.
Claim 9
Dependent Claim
214 words
In a computer video game having a sound generator for playing sound samples from a sound recording composed of a plurality of sound samples and a visual display for displaying an image, a method of synchronizing incorporation of an action in the image with the sound recording, where the action is selected from a predefined set of available actions, the method comprising: selecting one or more of the sound samples to synchronize; identifying a set of predetermined time locations in each of the selected sound samples where an action is to be incorporated in the image; associating a specific action with each predetermined time location; playing one of the sound samples on the sound generator; determining a current time location in the playing of the sound sample; if the sound sample is one of the selected sound samples, then: comparing the current time location with the predetermined time locations for the sound sample; and if the current time location is one of the predetermined time locations, then incorporating the associated specific action in the image; and if the sound sample is not one of the selected sound samples, then for at least one of the current time locations randomly selecting an action from the set of available actions and incorporating it in the image.
Claim 10
Dependent Claim
33 words
The method of claim 7 wherein, the actions are a character's mouth movements and the mouth movements are defined by mouth shapes stored in a memory device accessible to the computer video game.
Claim 11
Dependent Claim
27 words
The method of claim 7 wherein the image is an animated image having a characteristic animation cycle and the step of determining occurs once each animation cycle.
Claim 12
Dependent Claim
33 words
The method of claim 9 wherein the step of randomly selecting is carried out only if a specified number of animation cycles have passed since the last action was incorporated in the image.
Claim 13
Dependent Claim
57 words
The method of claim 9 wherein the step of randomly selecting is carried out only if a specified number of animation cycles have passed since the last action was incorporated in the image and the specified number of cycles is a randomly selected number between one and the number of animation cycles occurring during the sound recording.
References Cited (Backward Citations)
US660255A
Cited
US4305131A
Cited
CA1129640A
Cited
GB2121587A
Cited
US4460342A
Cited
US4692941A
Cited
US4641253A
Cited
US4617645A
Cited
US4642710A
Cited
US4827532A
Cited
US4805220A
Cited
US4852168A
Cited
US4884972A
Cited
US4905094A
Cited
WO1990005350A1
Cited
US5119474A
Cited
US5111409A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1998-07-03 | 1999-01-02 | 1999-07-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2002-07-03 | 2003-01-02 | 2003-07-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2006-07-03 | 2007-01-02 | 2007-07-04 | $7700.00 | Window Closed / Lapsed |