US6125115A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Teleconferencing method and apparatus with three-dimensional sound positioning
Assignee: Dolby International AB
•
Filing: 1998-02-12
•
Granted: 2000-09-26
•
Expires: 2018-02-12
Abstract
Abstract A computer network teleconferencing system is provided in which audio signals are coupled to or associated with source indicators, such as source addresses in TCP protocol packets. Three-dimensional spatialization transforms are applied to audio data according to the source of such data so that, upon reproduction, a listener perceives different participants as being located in different spaced-apart locations within a 3-D spatialization region. Preferably, the user may select or modify the apparent location of the teleconference participants.
Inventors
- 👤 Gerard Dirk Smits
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-06 20:05
CPC Classifications
H; H04; H04L; H04L12/00; H04L12/02; H04L12/16; H04L12/18; H04L12/1813; H04M; H04M3/00; H04M3/42; H04M3/56; H04M3/567; H04R; H04R27/00; H04M7/00; H04M7/006; H04M7/12
Claims Analysis
Total Claims: 20
Claim 1
Independent Claim
302 words
A process for teleconferencing over a computer network, the network having at least first and second audio sources and at least a first audio reproduction station with at least first and second speakers, each of said first and second audio sources outputting, over said computer network, audio information coupled to source identification information, the process comprising: receiving, at said first audio reproduction station, first audio information and first source identification information from said first audio source, wherein said first source identification information is coupled to said first audio information such that said first audio information, when received at said first audio reproduction station, can be identified as coming from said first source, and reproducing first audio output at said first audio reproduction station, using said speakers, controlled, using said first source information in said first audio reproduction station, to simulate a location for said first audio information in a first three-dimensional location, using three-dimensional spatialization control; and receiving, at said first audio reproduction station, second audio information and second source identification information from said second audio source, wherein said second source identification information is coupled to said second audio information such that said second audio information, when received at said first audio reproduction station, can be identified as coming from said second source, and reproducing second audio output at said first audio reproduction station, using said speakers, controlled, using said second source information, to simulate a location for said second audio information in a second three-dimensional location, different from said first location, using three-dimensional spatialization control, wherein a listener at said first audio reproduction station can identify the source of reproduced audio by its simulated location; wherein at least one of said first and second three-dimensional locations is a location which is not along a line between said first and second speakers.
Claim 2
Dependent Claim
302 words
A process for teleconferencing over a computer network, the network having at least first and second audio sources and at least a first audio reproduction station with at least first and second speakers, each of said first and second audio sources outputting, over said computer network, audio information coupled to source identification information, the process comprising: receiving, at said first audio reproduction station, first audio information and first source identification information from said first audio source, wherein said first source identification information is coupled to said first audio information such that said first audio information, when received at said first audio reproduction station, can be identified as coming from said first source, and reproducing first audio output at said first audio reproduction station, using said speakers, controlled, using said first source information in said first audio reproduction station, to simulate a location for said first audio information in a first three-dimensional location, using three-dimensional spatialization control; and receiving, at said first audio reproduction station, second audio information and second source identification information from said second audio source, wherein said second source identification information is coupled to said second audio information such that said second audio information, when received at said first audio reproduction station, can be identified as coming from said second source, and reproducing second audio output at said first audio reproduction station, using said speakers, controlled, using said second source information, to simulate a location for said second audio information in a second three-dimensional location, different from said first location, using three-dimensional spatialization control, wherein a listener at said first audio reproduction station can identify the source of reproduced audio by its simulated location; wherein at least one of said first and second three-dimensional locations is a location which is not along a line between said first and second speakers.
Claim 3
Dependent Claim
339 words
A process, as claimed in claim 1, said network also including a second audio reproduction station wherein said location for said first audio information and said location for said second audio information defines a first spatial relationship for said first audio information relative to said second audio information, at said first audio reproduction station, and further comprising: receiving, at said second audio reproduction station, said first audio information and first source identification information from said first audio source, wherein said first audio information, when received at said second audio reproduction station, can be identified as coming from said first source, and reproducing first audio output at said second audio reproduction station, using speakers at said second audio reproduction station, controlled, using said first source information, to simulate a location for said first audio information in a third three-dimensional location, using three-dimensional spatialization control; receiving, at said second audio reproduction station, second audio information and second source identification information from said second audio source, wherein said second source identification information, when received at said second audio reproduction station, can be identified as coming from said second source, and reproducing second audio output, using said speakers at said second audio reproduction station, controlled, using said second source information, to simulate a location for said second audio information in a fourth three-dimensional location, different from said first, second or third location, using three-dimensional spatialization control, wherein a listener at said second audio reproduction station can identify the source of reproduced audio by its simulated location; and wherein said third location and said fourth location defines a second spatial relationship for said first audio information relative to said second audio information, at said second audio reproduction station, said second spatial relationship being different from said first spatial relationship such that said spatial relationship of said first audio information relative to said second audio information at said first audio reproduction station is different from said spatial relationship of said first audio information relative to said second audio information at said second audio reproduction station.
Claim 4
Dependent Claim
53 words
A process as claimed in claim 1 wherein each of said first and second audio information is a monaural audio signal, and wherein said system is provided in the absence of a need to send a stereo audio signal from either of said first and second audio sources to said audio reproduction station.
Claim 5
Dependent Claim
69 words
A process as claimed in claim 1 wherein said reproducing of said first and second audio information comprises applying different transforms to said first and second audio information to provide said simulated first and second locations and wherein said transforms are applied at said audio reproduction station in the absence of a need for spatial encoding of said first and second audio information at said first and second sources.
Claim 6
Dependent Claim
252 words
A process for teleconferencing over a computer network, the network having at least first and second audio sources and at least one audio reproduction station with at least first and second speakers, the process comprising: outputting, from said first audio source, over said computer network, a first plurality of packets, each of said first plurality of packets containing first audio information and first source identification information, outputting, from said second audio source over said computer network, a second plurality of packets, each of said second plurality of packets containing second audio information and second source identification information; receiving, at said audio reproduction station, at least said first and second plurality of packets; using said first source information in each of said first plurality of packets, in said audio reproduction station to reproduce said first audio information to simulate a first location for said reproduced first audio information in a first three-dimensional location, using three-dimensional spatialization control; and using said second source information in each of said second plurality of packets, in said audio reproduction station, to reproduce said second audio information to simulate a second location for said reproduced second audio information in a second three-dimensional location, different from said first three-dimensional location, using three-dimensional spatialization control wherein a listener at said audio reproduction station can identify the source of reproduced audio by its simulated location; wherein at least one of said first and second three-dimensional locations is a location which is not along a line between said first and second speakers.
Claim 7
Dependent Claim
252 words
A process for teleconferencing over a computer network, the network having at least first and second audio sources and at least one audio reproduction station with at least first and second speakers, the process comprising: outputting, from said first audio source, over said computer network, a first plurality of packets, each of said first plurality of packets containing first audio information and first source identification information, outputting, from said second audio source over said computer network, a second plurality of packets, each of said second plurality of packets containing second audio information and second source identification information; receiving, at said audio reproduction station, at least said first and second plurality of packets; using said first source information in each of said first plurality of packets, in said audio reproduction station to reproduce said first audio information to simulate a first location for said reproduced first audio information in a first three-dimensional location, using three-dimensional spatialization control; and using said second source information in each of said second plurality of packets, in said audio reproduction station, to reproduce said second audio information to simulate a second location for said reproduced second audio information in a second three-dimensional location, different from said first three-dimensional location, using three-dimensional spatialization control wherein a listener at said audio reproduction station can identify the source of reproduced audio by its simulated location; wherein at least one of said first and second three-dimensional locations is a location which is not along a line between said first and second speakers.
Claim 8
Dependent Claim
26 words
A process, as claimed in claim 5, wherein said computer network is selected from among a local area network, an internet network and an intranet network.
Claim 9
Dependent Claim
24 words
A process, as claimed in claim 5, wherein said first and second locations are at least initially selected automatically at said audio reproduction station.
Claim 10
Dependent Claim
43 words
A process, as claimed in claim 5, further comprising selecting, via a user input device coupled to said audio reproduction station, at least one of said first and second locations within a three-dimensional space in the region of said first and second speakers.
Claim 11
Dependent Claim
28 words
A process, as claimed in claim 5, wherein said first and second locations may be selected independently of relative physical location of said first and second audio sources.
Claim 12
Dependent Claim
51 words
A process, as claimed in claim 5, further comprising sending audio information from said audio reproduction station for receipt and reproduction at at least one of said first and second audio sources substantially simultaneously with said steps of using to reproduce said first and second signals at said audio reproduction station.
Claim 13
Dependent Claim
75 words
A process, as claimed in claim 10, further comprising sending audio information from at least one location, different from said audio reproduction station, for receipt and reproduction at said one of said first and second audio sources to simulate a first location for reproduced audio from said at least one location in a first three-dimensional location and to simulate a second location for reproduced audio from said audio reproduction station in a second three-dimensional location.
Claim 14
Dependent Claim
68 words
A process as claimed in claim 5 wherein said first and second source identification information is used for both of first and second steps wherein said first step includes combining audio information from two or more packets with the same source identification information to reproduce audio information, and said second step includes simulating first and second three-dimensional locations for packets having first and second source identification information, respectively.
Claim 15
Dependent Claim
248 words
Apparatus for teleconferencing over a computer network, the network having at least first and second audio sources and at least one audio reproduction station with at least first and second speakers, said first audio source outputting, over said computer network, a first plurality of packets, each of said first plurality of packets containing first audio information and first source identification information, said second audio source outputting, over said computer network, a second plurality of packets, each of said second plurality of packets containing second audio information and second source identification information, the apparatus comprising: means for receiving, at said audio reproduction station, at least said first and second plurality of packets; means in said audio reproduction station, using said first source information in each of said first plurality of packets, for reproducing said first audio information to simulate a first location for said reproduced first audio information in a first three-dimensional location, using three-dimensional spatialization control; and means, using said second source information in each of said second plurality of packets for reproducing said second audio information to simulate a second location for said reproduced second audio information in a second three-dimensional location, different from said first three-dimensional location, using three-dimensional spatialization control wherein a listener at said audio reproduction station can identify the source of reproduced audio by its simulated location; wherein at least one of said first and second three-dimensional locations is a location which is not along a line between said first and second speakers.
Claim 16
Dependent Claim
248 words
Apparatus for teleconferencing over a computer network, the network having at least first and second audio sources and at least one audio reproduction station with at least first and second speakers, said first audio source outputting, over said computer network, a first plurality of packets, each of said first plurality of packets containing first audio information and first source identification information, said second audio source outputting, over said computer network, a second plurality of packets, each of said second plurality of packets containing second audio information and second source identification information, the apparatus comprising: means for receiving, at said audio reproduction station, at least said first and second plurality of packets; means in said audio reproduction station, using said first source information in each of said first plurality of packets, for reproducing said first audio information to simulate a first location for said reproduced first audio information in a first three-dimensional location, using three-dimensional spatialization control; and means, using said second source information in each of said second plurality of packets for reproducing said second audio information to simulate a second location for said reproduced second audio information in a second three-dimensional location, different from said first three-dimensional location, using three-dimensional spatialization control wherein a listener at said audio reproduction station can identify the source of reproduced audio by its simulated location; wherein at least one of said first and second three-dimensional locations is a location which is not along a line between said first and second speakers.
Claim 17
Dependent Claim
254 words
Apparatus for teleconferencing over a computer network, the network having at least first and second audio sources and at least one audio reproduction station with at least first and second speakers, said first audio source outputting, over said computer network, a first plurality of packets, each of said first plurality of packets containing first audio information and first source identification information, said second audio source outputting over said computer network, a second plurality of packets, each of said second plurality of packets containing second audio information and second source identification information, the apparatus comprising: a computer, at said audio reproduction station, coupled to said network to receive at least said first and second plurality of packets; said computer being programmed to: use said first source information in each of said first plurality of packets to control reproduction of said first audio information to simulate a first location for said reproduced first audio information in a first three-dimensional location, using three-dimensional spatialization control; and to use said second source information in each of said second plurality of packets to reproduce said second audio information to simulate a second location for said reproduced second audio information in a second three-dimensional location, different from said first three-dimensional location, using three-dimensional spatialization control; wherein a listener at said audio reproduction station can identify the source of reproduced audio by its simulated location; wherein at least one of said first and second three-dimensional locations is a location which is not along a line between said first and second speakers.
Claim 18
Dependent Claim
254 words
Apparatus for teleconferencing over a computer network, the network having at least first and second audio sources and at least one audio reproduction station with at least first and second speakers, said first audio source outputting, over said computer network, a first plurality of packets, each of said first plurality of packets containing first audio information and first source identification information, said second audio source outputting over said computer network, a second plurality of packets, each of said second plurality of packets containing second audio information and second source identification information, the apparatus comprising: a computer, at said audio reproduction station, coupled to said network to receive at least said first and second plurality of packets; said computer being programmed to: use said first source information in each of said first plurality of packets to control reproduction of said first audio information to simulate a first location for said reproduced first audio information in a first three-dimensional location, using three-dimensional spatialization control; and to use said second source information in each of said second plurality of packets to reproduce said second audio information to simulate a second location for said reproduced second audio information in a second three-dimensional location, different from said first three-dimensional location, using three-dimensional spatialization control; wherein a listener at said audio reproduction station can identify the source of reproduced audio by its simulated location; wherein at least one of said first and second three-dimensional locations is a location which is not along a line between said first and second speakers.
Claim 19
Dependent Claim
253 words
A software product, embodied in a computer-readable medium, for teleconferencing over a computer network, the network having at least first and second audio sources and at least one audio reproduction station with at least first and second speakers, said first audio source outputting, over said computer network, a first plurality of packets, each of said first plurality of packets containing first audio information and first source identification information, said second audio source outputting over said computer network, a second plurality of packets, each of said second plurality of packets containing second audio information and second source identification information, the software configured to control a computer at said audio reproduction station to: receive at least said first and second plurality of packets; use said first source information in each of said first plurality of packets to control reproduction at said first audio information to simulate a first location for said reproduced first audio information in a first three-dimensional location, using three-dimensional spatialization control; and use said second source information in each of said second plurality of packets to reproduce said second audio information to simulate a second location for said reproduced second audio information in a second three-dimensional location, different from said first three-dimensional location, using three-dimensional spatialization control; wherein a listener at said audio reproduction station can identify the source of reproduced audio by its simulated location; wherein at least one of said first and second three-dimensional locations is a location which is not along a line between said first and second speakers.
Claim 20
Dependent Claim
253 words
A software product, embodied in a computer-readable medium, for teleconferencing over a computer network, the network having at least first and second audio sources and at least one audio reproduction station with at least first and second speakers, said first audio source outputting, over said computer network, a first plurality of packets, each of said first plurality of packets containing first audio information and first source identification information, said second audio source outputting over said computer network, a second plurality of packets, each of said second plurality of packets containing second audio information and second source identification information, the software configured to control a computer at said audio reproduction station to: receive at least said first and second plurality of packets; use said first source information in each of said first plurality of packets to control reproduction at said first audio information to simulate a first location for said reproduced first audio information in a first three-dimensional location, using three-dimensional spatialization control; and use said second source information in each of said second plurality of packets to reproduce said second audio information to simulate a second location for said reproduced second audio information in a second three-dimensional location, different from said first three-dimensional location, using three-dimensional spatialization control; wherein a listener at said audio reproduction station can identify the source of reproduced audio by its simulated location; wherein at least one of said first and second three-dimensional locations is a location which is not along a line between said first and second speakers.
References Cited (Backward Citations)
US4100377A
Cited
US4771425A
Cited
US4815132A
Cited
US4696036A
Cited
US4817149A
Cited
US5027687A
Cited
US5023913A
Cited
US4969184A
Cited
US5105462A
Cited
US5020098A
Cited
US5283819A
Cited
US5245589A
Cited
US5430690A
Cited
US5331587A
Cited
US5617539A
Cited
US5438623A
Cited
US5457685A
Cited
US5487113A
Cited
US5524110A
Cited
WO1995031881A1
Cited
US5473363A
Cited
US5444676A
Cited
US5596644A
Cited
US5526353A
Cited
US5608786A
Cited
US5854898A
Cited
US5943427A
Cited
US5610920A
Cited
US5878145A
Cited
US6021206A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-09-26 | 2004-03-27 | 2004-09-26 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-09-26 | 2008-03-27 | 2008-09-26 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-09-26 | 2012-03-27 | 2012-09-26 | $7700.00 | Window Closed / Lapsed |