US5844600A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Methods, apparatus, and systems for transporting multimedia conference data streams through a transport network
Assignee: Haivision Systems Inc
•
Filing: 1995-09-15
•
Granted: 1998-12-01
•
Expires: 2015-09-15
Abstract
Abstract Multimedia conferencing systems are provided and include a plurality of audio/video terminals which are coupled together via a telecommunications network, with the network including switches and an audio bridge. The audio/video terminals are provided with interface modules which receive local audio and video signals, process the signals, and provide separate streams of properly formatted audio data and video data to the network. The video data is switched in the preferably ATM network (i.e., routed) to its desired destination, while the audio data is first routed to the audio bridge for mixing, and then to the desired destination. At the desired destination, the separate audio and video signals are processed and synchronized by the interface module of the destination and provided to the audio/video terminal. Various different synchronization methods for the audio and video data streams are disclosed. In a simple synchronization method, a fixed delay of, e.g., 65 milliseconds is added to the audio stream. In other synchronization methods, time stamps are utilized to determine the video, or video and audio coding delays, and the video or video/audio delta coding delay is used to delay the audio stream. A preferred aspect of the invention involves mapping the audio and video data streams into ATM cells, and utilizing the ATM network for switching or multicasting the video data stream.
Inventors
- 👤 Gordon Kerr
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-27 20:21
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/20; H04N21/23; H04N21/236; H04N21/2368; H04N21/242; H04N21/40; H04N21/43; H04N21/4302; H04N21/4305; H04N21/4307; H04N21/43072; H04N21/434; H04N21/4341; H04N21/60; H04N21/63; H04N21/643; H04N21/64307; H04N7/00; H04N7/14; H04N7/141; H04N7/147; H04N7/15; H04N7/152; H04N21/25; H04N21/266; H04N21/2665
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
128 words
A telecommunications multimedia conferencing system for use in conjunction with an ATM network which carries audio and video data streams, said conferencing system comprising: a plurality of multimedia terminals coupled to the ATM network, each of said plurality of said multimedia terminals including codec means for interfacing with said ATM network, for generating an outgoing audio data stream and an outgoing video data stream separate from said audio data stream, and for receiving and substantially synchronizing separate but related incoming audio data and incoming video data streams, wherein audio data and video data streams being sent from a first of said plurality of multimedia terminals to a second of said plurality of multimedia terminals are sent over different defined channels which are separately routed through the ATM network.
Claim 2
Dependent Claim
128 words
A telecommunications multimedia conferencing system for use in conjunction with an ATM network which carries audio and video data streams, said conferencing system comprising: a plurality of multimedia terminals coupled to the ATM network, each of said plurality of said multimedia terminals including codec means for interfacing with said ATM network, for generating an outgoing audio data stream and an outgoing video data stream separate from said audio data stream, and for receiving and substantially synchronizing separate but related incoming audio data and incoming video data streams, wherein audio data and video data streams being sent from a first of said plurality of multimedia terminals to a second of said plurality of multimedia terminals are sent over different defined channels which are separately routed through the ATM network.
Claim 3
Dependent Claim
21 words
A telecommunications multimedia conferencing system according to claim 1, wherein: said plurality of multimedia terminals comprises at least three multimedia terminals.
Claim 4
Dependent Claim
62 words
A telecommunications multimedia conferencing system according to claims 1, further comprising: an audio terminal coupled to the ATM network by a line of insufficient bandwidth to receive said outgoing video data stream, said audio terminal including an audio codec means for interfacing with the ATM network and for generating an outgoing audio data stream and for receiving an incoming audio data stream.
Claim 5
Dependent Claim
90 words
A telecommunications multimedia conferencing system according to claim 3, further comprising: audio bridge means for receiving said audio data streams from said plurality of multimedia terminals and from said audio terminal, for audio mixing said audio data streams, and for sending mixed audio data streams to said at plurality of multimedia terminals and to said audio terminal, each mixed audio data stream being received at a respective said codec means of a respective one of said plurality of multimedia terminals and said audio terminal as said incoming audio data stream.
Claim 6
Dependent Claim
26 words
A telecommunications multimedia conferencing system according to claim 4, further comprising: video switch means for routing video data streams received from said plurality of multimedia terminals.
Claim 7
Dependent Claim
78 words
A telecommunications multimedia conferencing system according to claim 2, further comprising: audio bridge means for receiving said audio data streams from said at least three multimedia terminals, for audio mixing said audio data streams, and for sending mixed audio data streams to said at least three multimedia terminals, each mixed audio data stream being received at a respective said codec means of a respective one of said at least three multimedia terminals as said incoming audio data stream.
Claim 8
Dependent Claim
27 words
A telecommunications multimedia conferencing system according to claim 2, further comprising: video switch means for routing video data streams received from said at least three multimedia terminals.
Claim 9
Dependent Claim
36 words
A telecommunications multimedia conferencing system according to claim 1, wherein: said codec means for receiving and substantially synchronizing separate but related incoming audio and incoming data streams includes means for delaying said incoming audio data stream.
Claim 10
Dependent Claim
33 words
A telecommunications multimedia conferencing system according to claim 8, wherein: said means for delaying said incoming audio data stream comprises means for delaying said incoming audio data stream by a predetermined time interval.
Claim 11
Dependent Claim
18 words
A telecommunications multimedia conferencing system according to claim 9, wherein: said predetermined time interval is approximately 65 milliseconds.
Claim 12
Dependent Claim
101 words
A telecommunications multimedia conferencing system according to claim 8, wherein: said means for delaying said incoming audio data stream comprises means for inserting a first video time stamp into said outgoing video data stream, means for inserting a local clock indicator into said outgoing video data stream, means for generating a receiving clock from said local clock indicator, means for recovering said first video time stamp, means for comparing said first video time stamp to an indication of said receiving clock to yield a delay indication, and means for using said delay indication to delay presentation of said audio data stream.
Claim 13
Dependent Claim
165 words
A telecommunications multimedia conferencing system according to claim 8, wherein: said means for delaying said incoming audio data stream comprises means for inserting a first video time stamp into said outgoing video data stream, means for inserting a first audio time stamp into said outgoing audio data stream, means for inserting a local clock indicator into one of said outgoing video and audio data streams, means for generating a receiving clock from said local clock indicator, means for recovering said first video time stamp, means for recovering said first audio time stamp, means for comparing said first video time stamp to an indication of said receiving clock to yield a first delay indication, means for comparing said first audio time stamp to an indication of said receiving clock to yield a second delay indication, means for comparing said first and second delay indications to provide a third delay indication, and means for using said third delay indication to delay presentation of said audio data stream.
Claim 14
Dependent Claim
181 words
A multimedia terminal coupled to and for use in conjunction with an ATM network, the ATM network being in turn coupled to at least one other multimedia terminal, said multimedia terminal comprising: a) audio means for generating a local audio signal; b) video means for generating a local video signal; and c) codec means for interfacing with the ATM network, said codec means coupled to said audio means and to said video means and including encoding means for receiving said local audio data and generating therefrom an outgoing audio data stream which is routed on a first defined channel, and for receiving said local video data and generating therefrom an outgoing video data stream separate from said audio data stream and which is separately routed on a second defined channel distinct from said first defined channel through the ATM network, and decoding means for receiving and substantially synchronizing separately routed but related incoming audio and incoming video data streams which are received over different defined channels of the ATM network and for presentation to said audio means and said video means.
Claim 15
Dependent Claim
181 words
A multimedia terminal coupled to and for use in conjunction with an ATM network, the ATM network being in turn coupled to at least one other multimedia terminal, said multimedia terminal comprising: a) audio means for generating a local audio signal; b) video means for generating a local video signal; and c) codec means for interfacing with the ATM network, said codec means coupled to said audio means and to said video means and including encoding means for receiving said local audio data and generating therefrom an outgoing audio data stream which is routed on a first defined channel, and for receiving said local video data and generating therefrom an outgoing video data stream separate from said audio data stream and which is separately routed on a second defined channel distinct from said first defined channel through the ATM network, and decoding means for receiving and substantially synchronizing separately routed but related incoming audio and incoming video data streams which are received over different defined channels of the ATM network and for presentation to said audio means and said video means.
Claim 16
Dependent Claim
34 words
A multimedia terminal according to claim 13, wherein: said codec means for receiving and substantially synchronizing separate but related incoming audio and incoming data streams includes means for delaying said incoming audio data stream.
Claim 17
Dependent Claim
31 words
A multimedia terminal according to claim 14, wherein: said means for delaying said incoming audio data stream comprises means for delaying said incoming audio data stream by a predetermined time interval.
Claim 18
Dependent Claim
16 words
A multimedia terminal according to claim 15, wherein: said predetermined time interval is approximately 65 milliseconds.
Claim 19
Dependent Claim
99 words
A multimedia terminal according to claim 14, wherein: said means for delaying said incoming audio data stream comprises means for inserting a first video time stamp into said outgoing video data stream, means for inserting a local clock indicator into said outgoing video data stream, means for generating a receiving clock from said local clock indicator, means for recovering said first video time stamp, means for comparing said first video time stamp to an indication of said receiving clock to yield a delay indication, and means for using said delay indication to delay presentation of said audio data stream.
Claim 20
Dependent Claim
163 words
A multimedia terminal according to claim 14, wherein: said means for delaying said incoming audio data stream comprises means for inserting a first video time stamp into said outgoing video data stream, means for inserting a first audio time stamp into said outgoing audio data stream, means for inserting a local clock indicator into one of said outgoing video and audio data streams, means for generating a receiving clock from said local clock indicator, means for recovering said first video time stamp, means for recovering said first audio time stamp, means for comparing said first video time stamp to an indication of said receiving clock to yield a first delay indication, means for comparing said first audio time stamp to an indication of said receiving clock to yield a second delay indication, means for comparing said first and second delay indications to provide a third delay indication, and means for using said third delay indication to delay presentation of said audio data stream.
Claim 21
Independent Claim
139 words
A method for conducting a multimedia multipoint conference utilizing at a plurality of multimedia terminals coupled to the ATM network, each said multimedia terminal including codec means for interfacing with the ATM network and for generating an outgoing audio data stream and an outgoing video data stream, and for receiving an incoming audio data stream and an incoming video data stream, said method comprising: a) for each multimedia terminal, routing the outgoing audio data stream for that multimedia terminal and the outgoing video data stream for that multimedia terminal onto separate defined channels in the ATM network; and b) for each multimedia terminal, receiving from the ATM network the separate but related incoming audio data stream and incoming video data stream, and substantially synchronizing the incoming audio data stream with the related incoming video data stream prior to presentation.
Claim 22
Independent Claim
139 words
A method for conducting a multimedia multipoint conference utilizing at a plurality of multimedia terminals coupled to the ATM network, each said multimedia terminal including codec means for interfacing with the ATM network and for generating an outgoing audio data stream and an outgoing video data stream, and for receiving an incoming audio data stream and an incoming video data stream, said method comprising: a) for each multimedia terminal, routing the outgoing audio data stream for that multimedia terminal and the outgoing video data stream for that multimedia terminal onto separate defined channels in the ATM network; and b) for each multimedia terminal, receiving from the ATM network the separate but related incoming audio data stream and incoming video data stream, and substantially synchronizing the incoming audio data stream with the related incoming video data stream prior to presentation.
Claim 23
Dependent Claim
78 words
A method according to claim 19, wherein: said conference includes at least three multimedia terminals, the ATM network includes an audio bridge means for receiving said audio data streams from said at least three multimedia terminals, and said method further comprises mixing said audio data streams from said at least three multimedia terminals at the audio bridge means, and for sending mixed audio data streams to said at least three multimedia terminals as the incoming audio data stream.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-11-30 | 2002-06-01 | 2002-12-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-11-30 | 2006-06-01 | 2006-12-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-11-30 | 2010-06-01 | 2010-12-01 | $7700.00 | Window Closed / Lapsed |