Patent US5862229A successfully refreshed from Google Patents.
US5862229A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Sound generator synchronized with image display
Assignee: Nintendo Co Ltd
•
Filing: 1997-10-09
•
Granted: 1999-01-19
•
Expires: 2017-10-09
Abstract
Abstract Digital sound data are stored in a data memory. When a first display object (such as an enemy character, a waterfall, or the like) is displayed in a three-dimensional manner on a display screen, an audio processor reads out corresponding sound source data from the data memory to produce first and second sound source data. The first and second sound source data are converted into analog audio signals by digital-to-analog converters, and then used to drive left and right speakers. The audio processor calculates a delay between generation of the first and second sound source data based on a direction of the first display object as viewed from a "virtual" camera which might correspond for example to one of the graphical characters in the three-dimensional display. The audio processor also controls sound volume levels for the first and second sound source data depending on the distance between the first display object and the virtual camera. Using the present invention, realistic sound effects consistent with and synchronized to visual changes of a three-dimensional image are generated by selectively controlling the timing and volume of sound source data provided to the left and right speakers.
Inventors
- 👤 Hideaki Shimizu
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 15:55
CPC Classifications
A; A63; A63F; A63F13/00; A63F13/50; A63F13/54; A63F13/52; A63F13/40; A63F13/44; A63F13/525; A63F13/5255; H; H04; H04S; H04S1/00; A63F13/90; A63F13/95; A63F2300/00; A63F2300/20; A63F2300/206; A63F2300/60; A63F2300/6063; A63F2300/6081; A63F2300/63; A63F2300/64; A63F2300/66; A63F2300/6661; A63F2300/6676
Claims Analysis
Total Claims: 41
Claim 1
Independent Claim
117 words
A method for generating realistic three-dimensional sound signals in a three-dimensional (3D) image displayed by an image display device, comprising the steps of: determining a display position of a first object displayed on the displayed 3D image; determining a display position of a second object displayed in the displayed 3D image, the second object being associated with a sound signal; selectively delaying when the sound signal is applied to one of the left and right speakers relative to when the sound is applied to the other of the left and right speakers based on relative movement in the displayed 3D image between the display position of the first object and the display position of the second object.
Claim 2
Independent Claim
117 words
A method for generating realistic three-dimensional sound signals in a three-dimensional (3D) image displayed by an image display device, comprising the steps of: determining a display position of a first object displayed on the displayed 3D image; determining a display position of a second object displayed in the displayed 3D image, the second object being associated with a sound signal; selectively delaying when the sound signal is applied to one of the left and right speakers relative to when the sound is applied to the other of the left and right speakers based on relative movement in the displayed 3D image between the display position of the first object and the display position of the second object.
Claim 3
Dependent Claim
32 words
The method of claim 1, wherein there is no delay under a predetermined condition when the first and second objects are located within a range of display positions in the 3D image.
Claim 4
Dependent Claim
43 words
The method in claim 1, further comprising: determining a direction of the second display object relative to the first display object, wherein the amount of delay is based on the determined direction of the second display object relative to the first display object.
Claim 5
Dependent Claim
54 words
The method in claim 3, wherein as the second display object moves from left of the first display object to right of the first display object, the delay of the sound signal applied to the right speaker decreases to zero, and thereafter, the delay of the sound signal applied to the left speaker increases.
Claim 6
Dependent Claim
37 words
The method in claim 4, wherein the increase and decrease are linear, and wherein there is no delay for a range of positions of the second display object substantially directly in front of the first display object.
Claim 7
Dependent Claim
28 words
The method in claim 3, wherein a maximum delay is less than or equal to one-fifth of a unit time used to process one increment of sound signal.
Claim 8
Dependent Claim
34 words
The method in claim 3, wherein when the second display object is at 0° relative to the first display object, the delay of the sound signal provided to the right speaker is a maximum.
Claim 9
Dependent Claim
36 words
The method in claim 3, wherein when the second displayed object is at 90° relative to the first display object, there is no delay of the sound signal provided to either the left and right speakers.
Claim 10
Dependent Claim
34 words
The method in claim 3, wherein when the second display object is at 180° relative to the first display object, the delay of the sound signal provided to the left speaker is a maximum.
Claim 11
Dependent Claim
31 words
The method in claim 3, wherein the amount of delay is based on an angle defined by a line of sight between the first display object and the second display object.
Claim 12
Dependent Claim
77 words
The method in claim 10, wherein a lookup table is provided with a list of delays for various angles, the method further comprising: determining a current angle corresponding to the line of sight between the first display object and the second display object; accessing the lookup table with the determined angle; retrieving the delay corresponding to the determined angle; and applying the retrieved delay to the sound signal provided to one of the left and right speakers.
Claim 13
Dependent Claim
17 words
The method in claim 1, wherein the first display object is a character in the 3D image.
Claim 14
Independent Claim
91 words
A method for generating realistic three-dimensional sound signals in a three-dimensional (3D) image displayed by an image display device, comprising the steps of: determining a display position of a first object displayed on the displayed 3D image; determining a display position of a second object displayed in the displayed 3D image, the second object being associated with a sound signal; determining a distance between the first display object and the second display object, controlling a volume of a sound signal associated with the second display object based on the determined distance.
Claim 15
Independent Claim
91 words
A method for generating realistic three-dimensional sound signals in a three-dimensional (3D) image displayed by an image display device, comprising the steps of: determining a display position of a first object displayed on the displayed 3D image; determining a display position of a second object displayed in the displayed 3D image, the second object being associated with a sound signal; determining a distance between the first display object and the second display object, controlling a volume of a sound signal associated with the second display object based on the determined distance.
Claim 16
Dependent Claim
60 words
The method in claim 13, wherein the sound signal is generated on a first channel applied to a left speaker and a second channel applied to a right speaker, and wherein different volumes are applied to sound signals provided to the left and right speakers in accordance with relative movement between the second display object and the first display object.
Claim 17
Dependent Claim
52 words
The method in claim 14, wherein when as the second display object moves from left of the first display object to right of the first display object, the volume of the sound signal applied to the left speaker decreases and the volume of the sound signal applied to the right speaker increases.
Claim 18
Dependent Claim
36 words
The method in claim 13, wherein for distances up to a first distance, volume changes based on a linear function, and wherein for distances greater than the first distance, volume changes based on an exponential function.
Claim 19
Independent Claim
121 words
A method for generating realistic three-dimensional sound signals in a three-dimensional (3D) image displayed by an image display device, comprising the steps of: determining a display position of a first object displayed on the displayed 3D image; determining a display position of a second object displayed in the displayed 3D image the second object being associated with a sound signal; determining a current distance between the first display object and the second display object; determining a current relative direction between the first display object and the second display object; changing how a sound signal associated with the second display object is generated based on the relative direction and the current distance between the first display object and the second display object.
Claim 20
Independent Claim
121 words
A method for generating realistic three-dimensional sound signals in a three-dimensional (3D) image displayed by an image display device, comprising the steps of: determining a display position of a first object displayed on the displayed 3D image; determining a display position of a second object displayed in the displayed 3D image the second object being associated with a sound signal; determining a current distance between the first display object and the second display object; determining a current relative direction between the first display object and the second display object; changing how a sound signal associated with the second display object is generated based on the relative direction and the current distance between the first display object and the second display object.
Claim 21
Dependent Claim
57 words
The method in claim 17, wherein the sound signal is generated on a first channel applied to a left speaker and a second channel applied to a right speaker, and wherein different volumes are applied to sound signals provided to the left and right speakers in accordance with relative movement between the first and second display objects.
Claim 22
Dependent Claim
67 words
The method in claim 17, wherein the sound signal is generated on a first channel applied to a left speaker and on a second channel applied to a right speaker, the changing step further comprising: selectively delaying when sound signal is generated in one of the left and right speakers relative to when the sound signal is generated in the other of the left and right speakers.
Claim 23
Dependent Claim
67 words
The method in claim 17, wherein when the object is at 0° relative to the first display object, the delay of the sound signal generated in the left speaker is zero, the delay of the sound signal generated in the right speaker is a maximum, the volume applied to the left speaker is a maximum, and the volume applied to the right speaker is a minimum value.
Claim 24
Dependent Claim
60 words
The method in claim 17, wherein when the object is at 90° relative to the first display object, the delay of the sound signal generated in the left speaker is equal to the delay of the sound signal generated in the right speaker and the volume of the sound signals applied to the left and right speakers is the same.
Claim 25
Dependent Claim
66 words
The method in claim 17, wherein when the object is at 180° relative to the point of reference, the delay of the sound signal generated in the left speaker is a maximum, the delay of the sound signal generated in the right speaker is zero, the volume applied to the left speaker is a minimum and the volume applied to the right speaker is a maximum.
Claim 26
Dependent Claim
51 words
The method in claim 17, wherein when as the second display object moves from left of the first display object to right of the first display object, the delay of the sound signal applied to the left speaker increases and the delay the sound signal applied to the right speaker decreases.
Claim 27
Dependent Claim
51 words
The method in claim 23, wherein as the second display object moves from left of the first display object to right of the first display object, the volume of the sound signal applied to the left speaker decreases and the volume of the sound signal applied to the right speaker increases.
Claim 28
Dependent Claim
16 words
The method in claim 24, wherein the applied volume varies from zero to a maximum volume.
Claim 29
Dependent Claim
18 words
The method in claim 25, wherein the increase and decrease occur gradually between zero and the maximum volume.
Claim 30
Dependent Claim
21 words
The method in claim 24, wherein the applied volume varies from one half of a maximum volume to the maximum volume.
Claim 31
Dependent Claim
22 words
The method in claim 27, wherein the increase and decrease occur gradually between one half the maximum volume and the maximum volume.
Claim 32
Dependent Claim
35 words
The method in claim 24, wherein when the second display object is in front of the first display object, the volume of the sound signals applied to the left and right speakers is the same.
Claim 33
Dependent Claim
115 words
An imaging system generating a sound signal synchronized with movement of a first moving object displayed in a three-dimensional (3D) image, comprising: a display displaying the 3D image and the first object, the first object being viewed from a point of reference of a second object displayed in the displayed 3D image, and a data processor determining a position of the first display object in the displayed 3D image relative to the point of reference of the second display object and generating a sound signal associated with the first display object that changes based on relative movement between the point of reference of the second display object and the position of the first display object.
Claim 34
Dependent Claim
115 words
An imaging system generating a sound signal synchronized with movement of a first moving object displayed in a three-dimensional (3D) image, comprising: a display displaying the 3D image and the first object, the first object being viewed from a point of reference of a second object displayed in the displayed 3D image, and a data processor determining a position of the first display object in the displayed 3D image relative to the point of reference of the second display object and generating a sound signal associated with the first display object that changes based on relative movement between the point of reference of the second display object and the position of the first display object.
Claim 35
Dependent Claim
49 words
The system in claim 30, wherein the relative movement includes a distance between the second display object and the point of reference of the first display object, the data processor selectively modifying the volume of the sound signals applied to the left and right speakers based on the distance.
Claim 36
Dependent Claim
54 words
The system in claim 30, further comprising: a left speaker and a right speaker to which the data processor applies the sound signal, and a memory for storing the sound signal, the data processor retrieving the sound signal from the memory and selectively applying the retrieved sound signal to the right and left speakers.
Claim 37
Dependent Claim
73 words
The system in claim 32, wherein the memory includes: a first memory area storing the sound signal, and a second memory area storing the sound signal, wherein the data processor reads out the sound signal from the first memory for application to one of the left and right speakers and reads out the sound signal from the second memory for application to the other of the left and right speakers after a delay.
Claim 38
Dependent Claim
74 words
The system in claim 33, wherein the delay varies between zero to a maximum value depending on a current position of the second display object relative to the point of reference of the first display object, and wherein the data processor selectively delays when the sound signal is generated in one of the left and right speakers relative to when the sound signal is generated in the other of the left and right speakers.
Claim 39
Dependent Claim
31 words
The system in claim 33, wherein the first and second memory areas are first-in-first-out memories, and the second memory area has a fraction of the capacity of the first memory area.
Claim 40
Dependent Claim
28 words
The system in claim 33, wherein the first and second memory areas are first-in-first-out memories, and the second memory area has more capacity than the first memory area.
Claim 41
Dependent Claim
30 words
The system in claim 33, wherein the first and second memory areas are first-in-first-out memories, and an initial write location in the second memory area varies depending on the delay.
References Cited (Backward Citations)
US4281833A
Cited
JPS609397A
Cited
JPS62155879A
Cited
US4817149A
Cited
US4792974A
Cited
US5046097A
Cited
US5095798A
Cited
US5105462A
Cited
US5291556A
Cited
US5138660A
Cited
US5052685A
Cited
US5317714A
Cited
US5212733A
Cited
US5095507A
Cited
US5524060A
Cited
US5495576A
Cited
US5636283A
Cited
US5771294A
Cited
US5715318A
Cited
US5768393A
Cited
US5754660A
Cited
US5798922A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-01-18 | 2002-07-20 | 2003-01-19 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-01-18 | 2006-07-20 | 2007-01-19 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-01-18 | 2010-07-20 | 2011-01-19 | $7700.00 | Window Closed / Lapsed |