Patent US5689641A successfully refreshed from Google Patents.
US5689641A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Multimedia collaboration system arrangement for routing compressed AV signal through a participant site without decompressing the AV signal
Assignee: Pragmatus AV LLC
•
Filing: 1993-10-01
•
Granted: 1997-11-18
•
Expires: 2013-10-01
Abstract
Abstract A multimedia collaboration system that integrates separate real-time and asynchronous networks--the former for real-time audio and video, and the latter for control signals and textual, graphical and other data--in a manner that is interoperable across different computer and network operating system platforms and which closely approximates the experience of face-to-face collaboration, while liberating the participants from the limitations of time and distance. These capabilities are achieved by exploiting a variety of hardware, software and networking technologies in a manner that preserves the quality and integrity of audio/video/data and other multimedia information, even after wide area transmission, and at a significantly reduced networking cost as compared to what would be required by presently known approaches. The system architecture is readily scalable to the largest enterprise network environments. It accommodates differing levels of collaborative capabilities available to individual users and permits high-quality audio and video capabilities to be readily superimposed onto existing personal computers and workstations and their interconnecting LANs and WANs. In a particular preferred embodiment, a plurality of geographically dispersed multimedia LANs are interconnected by a WAN. The demands made on the WAN are significantly reduced by employing multi-hopping techniques, including dynamically avoiding the unnecessary decompression of data at intermediate hops, and exploiting video mosaicing, cut-and-paste and audio mixing technologies so that significantly fewer wide area transmission paths are required while maintaining the high quality of the transmitted audio/video.
Inventors
- 👤 Lester F. Ludwig
- 👤 J. Chris Lauwers
- 👤 Keith A. Lantz
- 👤 Gerald J. Burnett
- 👤 Emmett R. Burns
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 20:26
CPC Classifications
H; H04; H04L; H04L65/00; H04L65/80; G; G06; G06Q; G06Q10/00; G06Q10/10; H04L12/00; H04L12/02; H04L12/16; H04L12/18; H04L12/1813; H04L12/1818; H04L12/1822; H04L12/1827; H04L12/1831; H04L51/00; H04L51/04; H04L51/07; H04L51/10; H04L65/1066; H04L65/1101; H04L65/40; H04L65/403; H04L65/4038; H04L67/00; H04L67/14; H04L67/50; H04L67/75; H04L9/00; H04L9/40; H04M; H04M3/00; H04M3/42; H04M3/50; H04M3/53; H04M3/5307; H04M3/56; H04M3/562; H04M3/563; H04M3/567; H04N; H04N7/00; H04N7/14; H04N7/141; H04N7/147; H04N7/148; H04N7/15; H04N7/152; H04L12/1836; H04L12/185; H04M2201/00; H04M2201/38; H04M2203/00; H04M2203/50; H04M2203/5018; H04M2203/5027; H04M3/42221; H04M3/42314; H04M3/42323; H04M3/428; H04M3/4285; H04M3/564; H04M7/00; H04M7/006; H04M7/12; H04Q; H04Q2213/00; H04Q2213/1305; H04Q2213/13093; H04Q2213/13175; H04Q2213/1319; H04Q2213/1322; H04Q2213/1324; H04Q2213/1326; H04Q2213/1332; H04Q2213/13337; H04Q2213/13389
Claims Analysis
Total Claims: 45
Claim 1
Independent Claim
236 words
A teleconferencing system for conducting a teleconference among a plurality of participants comprising: (a) first, second and third locations; (b) at least one workstation at each of the first, second and third locations, each workstation including audio and video capture and reproduction capabilities arranged to capture and reproduce participant video images and spoken audio; (c) a codec associated with each of the first, second and third locations; (d) an AV path linking the three locations; (e) a network switch associated with at least one of the first and second locations and designed to route codec compressed AV signals representing captured participant video images and spoken audio along the AV path; (f) a switch in communication with the third location to route compressed AV signals, destined for the second location, from the first location to the second location without the compressed AV signals being decompressed or reproduced at said third location; and (g) a Local Area Network switch functionally positioned between the workstation at and the codec associated with one of the first and second locations to route signals to the workstation at that location, wherein the location at which the Local Area Network switch is positioned is a multi-participant location having a plurality of workstations, and wherein the Local Area Network switch is arranged to receive signals from the codec at that location and route the received signals to a destination workstation of the workstation plurality.
Claim 2
Dependent Claim
236 words
A teleconferencing system for conducting a teleconference among a plurality of participants comprising: (a) first, second and third locations; (b) at least one workstation at each of the first, second and third locations, each workstation including audio and video capture and reproduction capabilities arranged to capture and reproduce participant video images and spoken audio; (c) a codec associated with each of the first, second and third locations; (d) an AV path linking the three locations; (e) a network switch associated with at least one of the first and second locations and designed to route codec compressed AV signals representing captured participant video images and spoken audio along the AV path; (f) a switch in communication with the third location to route compressed AV signals, destined for the second location, from the first location to the second location without the compressed AV signals being decompressed or reproduced at said third location; and (g) a Local Area Network switch functionally positioned between the workstation at and the codec associated with one of the first and second locations to route signals to the workstation at that location, wherein the location at which the Local Area Network switch is positioned is a multi-participant location having a plurality of workstations, and wherein the Local Area Network switch is arranged to receive signals from the codec at that location and route the received signals to a destination workstation of the workstation plurality.
Claim 3
Dependent Claim
16 words
The teleconferencing system of claim 1, wherein said AV path includes dedicated links between said locations.
Claim 4
Dependent Claim
16 words
The teleconferencing system of claim 1, wherein said AV path includes dial-up connections between said locations.
Claim 5
Dependent Claim
19 words
The teleconferencing system of claim 1, wherein said AV path includes dial-up connections and dedicated links between said locations.
Claim 6
Dependent Claim
28 words
The teleconferencing system of claim 4, wherein said AV path includes a dial-up connection between at least two locations and a dedicated link between at least two locations.
Claim 7
Dependent Claim
21 words
The teleconferencing system of claim 1, wherein the system is configured to optimize the routing of AV signals between said locations.
Claim 8
Dependent Claim
25 words
The teleconferencing system of claim 6, wherein the signal routing is optimized based on either the actual or the anticipated state of said AV path.
Claim 9
Dependent Claim
21 words
The teleconferencing system of claim 1, wherein said AV path includes at least one trunk associated with at least one codec.
Claim 10
Dependent Claim
51 words
The teleconferencing system of claim 1, wherein (a) the number of workstations at each multi-participant location is greater than the number of any one resource in the group consisting of codecs and network switches associated with that location, and (b) each of the workstations has access to any of the resources.
Claim 11
Dependent Claim
28 words
The teleconferencing system of claim 1, further comprising a directory containing participant location information and wherein the compressed AV signals are routed using participant information in the directory.
Claim 12
Dependent Claim
52 words
The teleconferencing system of claim 1, further comprising: (a) a participant locator that responds to a participant logging into a workstation by associating that participant with each such workstation logged into, thereby enabling the routing of a videoconference call, for that participant, to the workstation at which that participant is logged in.
Claim 13
Dependent Claim
49 words
The teleconferencing system of claim 1, wherein the video image and spoken audio of a first participant at the first location, routed to said second location via said third location, can be reproduced at the workstations of both said first participant and a second participant at the second location.
Claim 14
Dependent Claim
49 words
The teleconferencing system of claim 12, further comprising: (a) a data network providing a data path for carrying data signals among the workstations; and (b) a data conference manager configured to manage a data conference during which shared data is displayed at the workstations of a plurality of participants.
Claim 15
Dependent Claim
16 words
The teleconferencing system of claim 13, wherein the AV and data paths define physically separate paths.
Claim 16
Dependent Claim
40 words
The teleconferencing system of claim 13, further comprising a video mosaic generator configured to combine at least a portion of captured video images of said first and second participants to generate a mosaic image for reproduction at least one workstation.
Claim 17
Dependent Claim
36 words
The teleconferencing system of claim 15, further comprising a close-up selector for selecting the image of one of the participants in said mosaic image and replacing said mosaic image with the image of said selected image.
Claim 18
Dependent Claim
66 words
The teleconferencing system of claim 15, wherein the mosaic image includes images' of the first and second and a third participant, the system further comprising an audio summer configured to receive the captured audio of said first, second and third participants and combining only the received audio of the second and third participants into an audio sum for reproduction at the workstation of said first participant.
Claim 19
Dependent Claim
86 words
The teleconferencing system of claim 17, wherein the AV reproduction capabilities of at least the workstation of the first participant includes a plurality of speakers, the system further comprising: (a) an audio control configured to control the reproduction of said audio sum at said first participant's workstation such that the composition of the audio originating from each or the second and third participants reproduced at each speaker is dependent on a position of the images of the second and third participant in said reproduced mosaic image.
Claim 20
Dependent Claim
21 words
The teleconferencing system of claim 17, further comprising an echo canceller to reduce echo during the reproduction of said audio sum.
Claim 21
Dependent Claim
38 words
The teleconferencing system of claim 12, further comprising a video mosaic generator configured to combine the captured video images of at least said first and second participants into a mosaic image for reproduction at at least one workstation.
Claim 22
Dependent Claim
57 words
The teleconferencing system of claim 20, further comprising a distributed video mosaic generator configured to combine a portion of said mosaic image with a captured image of a third participant to generate a distributed mosaic image of the captured images of said three participants for reproduction at the workstation of at least one of the three participants.
Claim 23
Dependent Claim
66 words
The teleconferencing system of claim 20, wherein the mosaic image includes images of the first and second and a third participant the system further comprising an audio summer configured to receive the captured audio of said first, second and third participants and combining only the received audio of the second and third participants into an audio sum for reproduction at the workstation of said first participant.
Claim 24
Dependent Claim
43 words
The teleconferencing system of claim 22, wherein the audio summer is configured to combine a part of the audio sum with the captured audio of another participant to generate a composite audio sum for reproduction at the workstation of at least one participant.
Claim 25
Dependent Claim
86 words
The teleconferencing system of claim 22, wherein the AV reproduction capabilities of at least the workstation of the first participant includes a plurality of speakers the system further comprising: (a) an audio control configured to control the reproduction of said audio sum at said first participant's workstation such that the composition of the audio originating from each of the second and third participants reproduced at each speaker is dependent on a position of the images of the second and third participants in said reproduced mosaic image.
Claim 26
Dependent Claim
17 words
The teleconferencing system of claim 1, wherein video images are reproduced at a workstation as full-motion video.
Claim 27
Dependent Claim
27 words
The teleconferencing system of claim 25, wherein the full-motion video images are reproduced at a workstation at a rate of at least about 30 frames per second.
Claim 28
Dependent Claim
36 words
The teleconferencing system of claim 20, further comprising a close-up selector for selecting the image of one of the participants in said mosaic image and replacing said mosaic image with the image of said selected image.
Claim 29
Independent Claim
217 words
A method of conducting a teleconference among at least one participant at each of first and second locations, each location having at least one associated workstation with audio and video capture and reproduction capabilities and a codec and one of of the locations having a Local Area Network switch, the method comprising the steps (a) linking the first and second locations with a third location including at least one workstation with audio and video reproduction capabilities and at least one codec; (b) capturing video images and spoken audio of a participant at the first location; (c) compressing signals representing the captured video and audio at the first location; (d) routing compressed signals, destined for the second location, to the third location; (e) receiving the routed signals at the third location and routing the received signals from the third to the second location without decompressing the received signals or reproducing the audio or video represented by the received signals at the workstation at the third location; (f) receiving the signals from the third location and reproducing the audio and video, captured at the fast location, at the second location; and (g) using the Local Area Network switch to route signals representing captured participant audio and video between the workstation and the codec at the location having the switch.
Claim 30
Independent Claim
217 words
A method of conducting a teleconference among at least one participant at each of first and second locations, each location having at least one associated workstation with audio and video capture and reproduction capabilities and a codec and one of of the locations having a Local Area Network switch, the method comprising the steps (a) linking the first and second locations with a third location including at least one workstation with audio and video reproduction capabilities and at least one codec; (b) capturing video images and spoken audio of a participant at the first location; (c) compressing signals representing the captured video and audio at the first location; (d) routing compressed signals, destined for the second location, to the third location; (e) receiving the routed signals at the third location and routing the received signals from the third to the second location without decompressing the received signals or reproducing the audio or video represented by the received signals at the workstation at the third location; (f) receiving the signals from the third location and reproducing the audio and video, captured at the fast location, at the second location; and (g) using the Local Area Network switch to route signals representing captured participant audio and video between the workstation and the codec at the location having the switch.
Claim 31
Dependent Claim
22 words
The method of claim 28, further comprising the steps of: (a) routing the compressed signals to optimize their transfer between the locations.
Claim 32
Dependent Claim
24 words
The method of claim 29, wherein the optimization is based on either the actual or the anticipated state of the links between the locations.
Claim 33
Dependent Claim
59 words
The method of conducting a teleconference of claim 28, further comprising the steps of: (a) managing a data conference during which data is shared among a plurality of participants and displayed at associated workstations; and (b) managing a videoconference, during which the video image and spoken audio of one participant are reproduced at the workstation associated with another participant.
Claim 34
Dependent Claim
44 words
The method of conducting a teleconference of claim 31, further comprising the steps of: (a) combining at least a portion of the captured images of a first and a second participant into a mosaic image; and (b) reproducing the mosaic image at a workstation.
Claim 35
Dependent Claim
40 words
The method of conducting a teleconference of claim 32 further comprising the steps of: (a) selecting the image of one of the participants in the mosaic image; and (b) replacing the mosaic image with the image of the selected image.
Claim 36
Dependent Claim
38 words
The method of conducting a teleconference of claim 28, further comprising the steps of: (a) combining the captured images of a first and second participant into a mosaic image; and (b) reproducing the mosaic image at a workstation.
Claim 37
Dependent Claim
54 words
The method of conducting a teleconference of claim 34, further comprising the steps of: (a) combining a portion of the mosaic image with a captured image of another of the participants to generate a composite mosaic image; and (b) reproducing the composite mosaic image at me workstation of at least one of the participants.
Claim 38
Dependent Claim
58 words
The method of conducting a teleconference of claim 34, further comprising the steps of: (a) receiving captured audio of the first and second participants and a third participant; (b) combining the received audio of only the second and third participants into an audio sum; and (c) reproducing the audio sum at the workstation associated with the first participant.
Claim 39
Dependent Claim
63 words
The method of conducting a teleconference of claim 36, wherein the reproduced mosaic image includes images of the first, second and third participants, the method further comprising the step of: (a) reproducing the audio sum at the first participant's workstation such that the composition of the reproduced audio is dependent on a position of the images of participants in the reproduced mosaic image.
Claim 40
Dependent Claim
40 words
The method of conducting a teleconference of claim 34, further comprising the steps of: (a) selecting the image of one of the participants in the mosaic image; and (b) replacing the mosaic image with the image of the selected image.
Claim 41
Dependent Claim
54 words
The method of conducting a teleconference of claim 28, further comprising the steps of: (a) receiving the captured audio of a first, second and third participant; (b) combining the received audio of only the second and third participants into an audio sum; and (c) reproducing the audio sum at the workstation of first participant.
Claim 42
Dependent Claim
63 words
The method of conducting a teleconference of claim 39, wherein the reproduced mosaic image includes images of the first, second and third participants, the method further comprising the step of: (a) reproducing the audio sum at the first participant's workstation such that the composition of the reproduced audio is dependent on a position of the images of participants in the reproduced mosaic image.
Claim 43
Dependent Claim
48 words
The method of conducting a teleconference of claim 28, further comprising the steps of: (a) associating a participant with each workstation logged into by the participant; and (b) muting a call to initiate a videoconference with such participant to the workstation at which that participant is logged in.
Claim 44
Dependent Claim
16 words
The method of claim 28, wherein video images are reproduced at a workstation as full-motion video.
Claim 45
Dependent Claim
26 words
The method of claim 42, wherein the full-motion video images are reproduced at a workstation at a rate of at least about 30 frames per second.
References Cited (Backward Citations)
US3974337A
Cited
US3723653A
Cited
US4005265A
Cited
US3873771A
Cited
US4210927A
Cited
US4441180A
Cited
US4516156A
Cited
US4645872A
Cited
US4529839A
Cited
US4531024A
Cited
US4574374A
Cited
US4529840A
Cited
DE3507152A1
Cited
US4650929A
Cited
EP0190060A1
Cited
US4710917A
Cited
US4837798A
Cited
US4961211A
Cited
US4987492A
Cited
US5200989A
Cited
US4995071A
Cited
US5130793A
Cited
EP0354370A1
Cited
US5027400A
Cited
US5170427A
Cited
US5003532A
Cited
US5010399A
Cited
EP0414222A2
Cited
US5130801A
Cited
US5042062A
Cited
US5099510A
Cited
US5202957A
Cited
US5283637A
Cited
US5218627A
Cited
EP0497022A1
Cited
EP0516371A2
Cited
EP0523626A1
Cited
EP0523618A2
Cited
US5315633A
Cited
EP0561381A2
Cited
US5374952A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-11-17 | 2001-05-19 | 2001-11-18 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-11-17 | 2005-05-19 | 2005-11-18 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-11-17 | 2009-05-19 | 2009-11-18 | $7700.00 | Window Closed / Lapsed |