US5754660A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Sound generator synchronized with image display
Assignee: Nintendo Co Ltd
•
Filing: 1996-09-20
•
Granted: 1998-05-19
•
Expires: 2016-09-20
Abstract
Abstract Digital sound data are stored in a data memory. When a first display object (such as an enemy character, a waterfall, or the like) is displayed in a three-dimensional manner on a display screen, an audio processor reads out corresponding sound source data from the data memory to produce first and second sound source data. The first and second sound source data are converted into analog audio signals by digital-to-analog converters, and then used to drive left and right speakers. The audio processor calculates a delay between generation of the first and second sound source data based on a direction of the first display object as viewed from a "virtual" camera which might correspond for example to one of the graphical characters in the three-dimensional display. The audio processor also controls sound volume levels for the first and second sound source data depending on the distance between the first display object and the virtual camera. Using the present invention, realistic sound effects consistent with and synchronized to visual changes of a three-dimensional image are generated by selectively controlling the timing and volume of sound source data provided to the left and right speakers.
Inventors
- 👤 Hideaki Shimizu
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 13:58
CPC Classifications
A; A63; A63F; A63F13/00; A63F13/50; A63F13/52; A63F13/54; A63F13/40; A63F13/44; A63F13/525; A63F13/5255; H; H04; H04S; H04S1/00; A63F13/90; A63F13/95; A63F2300/00; A63F2300/20; A63F2300/206; A63F2300/60; A63F2300/6063; A63F2300/6081; A63F2300/63; A63F2300/64; A63F2300/66; A63F2300/6661; A63F2300/6676
Claims Analysis
Total Claims: 12
Claim 1
Independent Claim
268 words
In an image display device for displaying a three-dimensional image as viewed from a virtual camera, a sound generation system for generating sounds having a spatial extent corresponding to the three-dimensional image, comprising: a first sound generator generating a first sound; a second sound generator generating a second sound; a sound source data storage storing sound source data; a temporary storage temporarily storing the sound source data reads out from said sound source data storage; a delay time calculator calculating, when said image display device displays a first display object defined to generate sounds, a delay time on the basis of a direction to the first display object as viewed from the position of a predetermined viewpoint; an audio processor reading out the sound source data corresponding to said first display object from said sound source data storage, storing the sound source data in said temporary storage and reading out the sound source data as first sound source data, and reading out the sound source data stored in the temporary storage as second sound source data at a timing delayed by the delay time calculated by said delay time calculator from timing at which said first sound source data is read out; a first digital-to-analog converter converting the first sound source data read out from said temporary storage into an analog audio signal and feeding the analog audio signal to said first sound generator; and a second digital-to-analog converter converting the second sound source data read out from said temporary storage means into an analog audio signal and feeding the analog audio signal to said second sound generator.
Claim 2
Dependent Claim
268 words
In an image display device for displaying a three-dimensional image as viewed from a virtual camera, a sound generation system for generating sounds having a spatial extent corresponding to the three-dimensional image, comprising: a first sound generator generating a first sound; a second sound generator generating a second sound; a sound source data storage storing sound source data; a temporary storage temporarily storing the sound source data reads out from said sound source data storage; a delay time calculator calculating, when said image display device displays a first display object defined to generate sounds, a delay time on the basis of a direction to the first display object as viewed from the position of a predetermined viewpoint; an audio processor reading out the sound source data corresponding to said first display object from said sound source data storage, storing the sound source data in said temporary storage and reading out the sound source data as first sound source data, and reading out the sound source data stored in the temporary storage as second sound source data at a timing delayed by the delay time calculated by said delay time calculator from timing at which said first sound source data is read out; a first digital-to-analog converter converting the first sound source data read out from said temporary storage into an analog audio signal and feeding the analog audio signal to said first sound generator; and a second digital-to-analog converter converting the second sound source data read out from said temporary storage means into an analog audio signal and feeding the analog audio signal to said second sound generator.
Claim 3
Dependent Claim
34 words
The sound generation system according to claim 1, wherein said delay time calculator calculates the delay time on the basis of a direction to said first display object as viewed from said virtual camera.
Claim 4
Dependent Claim
38 words
The sound generation system according to claim 2, wherein said audio processor individually controls the sound volume of said first and second sounds on the basis of the distance between said first display object and said virtual camera.
Claim 5
Dependent Claim
45 words
The sound generation system according to claim 3, wherein said audio processor controls the respective sound volumes of said first and second sounds so as to be inversely proportional to a predetermined coefficient times the distance between said first display object and said virtual camera.
Claim 6
Dependent Claim
39 words
The sound generation system according to claim 3, wherein said audio processor suppresses the control ranges of the sound volumes in inverse proportion to a predetermined coefficient times the distance between said first display object and said virtual camera.
Claim 7
Dependent Claim
102 words
The sound generation system according to claim 1, further comprising: a controller connectable to said image display device to instruct a change of image, and said delay time calculator calculates the delay time on the basis of a direction to the first display object as viewed from the second display object when said image display device displays such a second display object that its display position is changed in response to an operation of said controller by a player, and the line of sight of said virtual camera is moved in synchronization with its movement in addition to said first display object.
Claim 8
Dependent Claim
39 words
The sound generation system according to claim 6, wherein said audio processor individually controls the sound volumes of said first and second sounds on the basis of the distance between said first display object and said second display object.
Claim 9
Dependent Claim
45 words
The sound generator according to claim 7, wherein said audio processor controls the respective sound volumes of said first and second sounds so as to be inversely proportional to a predetermined coefficient times the distance between said first display object and said second display object.
Claim 10
Dependent Claim
39 words
The sound generator according to claim 7, wherein said audio processor suppresses the control ranges of the sound volumes in inverse proportion to a predetermined coefficient times the distance between said first display object and said second display object.
Claim 11
Dependent Claim
231 words
The sound generator according to claim 1, wherein said temporary storage includes first temporary storage storing the sound source data read out for each unit time from said sound source data storage and having a capacity for storing the amount of the sound source data which corresponds to at least the unit time, and second temporary storage storing the sound source data read out for each unit time from said sound source data storage, and having a capacity for storing the amount of the sound source data which is larger by an amount corresponding to predetermined maximum delay time than that stored in the first temporary storage, and said audio processor performing the following tasks: writing the sound source data read out from said sound source data storage for each unit time into said first temporary storage, and then reading out the written sound source data as a first sound source data, and writing the sound source data read out from said sound source data storage for each unit time into the second temporary storage with a write address changed depending on the delay time calculated by said delay time calculator, and then reading out the written sound source data as a second sound source data, to delay the second sound source data from the first sound source data by a desired time in the range of said maximum delay time.
Claim 12
Dependent Claim
205 words
The sound generator according to claim 1, wherein said temporary storage includes first temporary storage storing the sound source data read out for each unit time from said sound source data storage, and having a capacity for storing the amount of the sound source data which corresponds to at least the unit time, and second temporary storage storing the sound source data read out from said first temporary storage, and having a capacity for storing the amount of the sound source data which corresponds to predetermined maximum delay time, and said audio processor: writing the sound source data read out from said sound source data storage for each unit time into said first temporary storage, and then reading out the written sound source data as a first sound source data, and writing the first sound source data read out from said first temporary storage into said second temporary storage, and then reading out the first sound source data as a second sound source data with a read address changed depending on the delay time calculated by said delay time calculator, to delay the second sound source data from the first sound source data by a desired time in the range of said maximum delay time.
References Cited (Backward Citations)
US4281883A
Cited
JPS609397A
Cited
JPS62155879A
Cited
US4817149A
Cited
US5046097A
Cited
US5095798A
Cited
US5105462A
Cited
US5052685A
Cited
US5138660A
Cited
US5317714A
Cited
US5212733A
Cited
US5095507A
Cited
US5666136A
Cited
US5524060A
Cited
US5495576A
Cited
US5636283A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-05-18 | 2001-11-17 | 2002-05-19 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-05-18 | 2005-11-17 | 2006-05-19 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-05-18 | 2009-11-17 | 2010-05-19 | $7700.00 | Window Closed / Lapsed |