US5802294A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Teleconferencing system in which location video mosaic generator sends combined local participants images to second location video mosaic generator for displaying combined images
Assignee: Pragmatus AV LLC
•
Filing: 1996-06-07
•
Granted: 1998-09-01
•
Expires: 2016-06-07
Abstract
Abstract A multimedia collaboration system that integrates separate real-time and asynchronous networks--the former for real-time audio and video, and the latter for control signals and textual, graphical and other data--in a manner that is interoperable across different computer and network operating system platforms and which closely approximates the experience of face-to-face collaboration, while liberating the participants from the limitations of time and distance. These capabilities are achieved by exploiting a variety of hardware, software and networking technologies in a manner that preserves the quality and integrity of audio/video/data and other multimedia information, even after wide area transmission, and at a significantly reduced networking cost as compared to what would be required by presently known approaches. The system architecture is readily scalable to the largest enterprise network environments. It accommodates differing levels of collaborative capabilities available to individual users and permits high-quality audio and video capabilities to be readily superimposed onto existing personal computers and workstations and their interconnecting LANs and WANs. In a particular preferred embodiment, a plurality of geographically dispersed multimedia LANs are interconnected by a WAN. The demands made on the WAN are significantly reduced by employing multi-hopping techniques, including dynamically avoiding the unnecessary decompression of data at intermediate hops, and exploiting video mosaicing, cut-and-paste and audio mixing technologies so that significantly fewer wide area transmission paths are required while maintaining the high quality of the transmitted audio/video.
Inventors
- 👤 Lester F. Ludwig
- 👤 J. Chris Lauwers
- 👤 Keith A. Lantz
- 👤 Gerald J. Burnett
- 👤 Emmett R. Burns
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-02 22:43
CPC Classifications
H; H04; H04L; H04L65/00; H04L65/80; G; G06; G06Q; G06Q10/00; G06Q10/10; H04L12/00; H04L12/02; H04L12/16; H04L12/18; H04L12/1813; H04L12/1818; H04L12/1822; H04L12/1827; H04L12/1831; H04L51/00; H04L51/04; H04L51/07; H04L51/10; H04L65/1066; H04L65/1101; H04L65/40; H04L65/403; H04L65/4038; H04L67/00; H04L67/14; H04L67/50; H04L67/75; H04L9/00; H04L9/40; H04M; H04M3/00; H04M3/42; H04M3/50; H04M3/53; H04M3/5307; H04M3/56; H04M3/562; H04M3/563; H04M3/567; H04N; H04N7/00; H04N7/14; H04N7/141; H04N7/147; H04N7/148; H04N7/15; H04N7/152; H04L12/1836; H04L12/185; H04M2201/00; H04M2201/38; H04M2203/00; H04M2203/50; H04M2203/5018; H04M2203/5027; H04M3/42221; H04M3/42314; H04M3/42323; H04M3/428; H04M3/4285; H04M3/564; H04M7/00; H04M7/006; H04M7/12; H04Q; H04Q2213/00; H04Q2213/1305; H04Q2213/13093; H04Q2213/13175; H04Q2213/1319; H04Q2213/1322; H04Q2213/1324; H04Q2213/1326; H04Q2213/1332; H04Q2213/13337; H04Q2213/13389
Claims Analysis
Total Claims: 26
Claim 1
Independent Claim
203 words
A teleconferencing system for conducting a teleconference between first and second locations, the system comprising; (a) a plurality of workstations at the first location and at least one workstation at the second location, each workstation being associated with at least a participant and having a monitor and participant audio and video capture and reproduction capabilities; (b) an AV path for carrying AV signals representing participant video images and spoken audio among the workstations; (c) a first video mosaic generator associated with the first location and configured to (1) combine captured video images, of at least two first-location-participants, into a first mosaic image, (2) receive a second-location-participant video image from the second location, and (3) combine at least a portion of the first mosaic image with the received second-location-participant video image to form a first combined mosaic image for reproduction at a first location workstation, and (d) a second video mosaic generator associated with the second location and configured to (1) receive the first mosaic image from the first mosaic generator, and (2) combine at least a portion of the first mosaic image with the second-location-participant video image to form a second combined mosaic image for reproduction at a workstation at the second location.
Claim 2
Dependent Claim
203 words
A teleconferencing system for conducting a teleconference between first and second locations, the system comprising; (a) a plurality of workstations at the first location and at least one workstation at the second location, each workstation being associated with at least a participant and having a monitor and participant audio and video capture and reproduction capabilities; (b) an AV path for carrying AV signals representing participant video images and spoken audio among the workstations; (c) a first video mosaic generator associated with the first location and configured to (1) combine captured video images, of at least two first-location-participants, into a first mosaic image, (2) receive a second-location-participant video image from the second location, and (3) combine at least a portion of the first mosaic image with the received second-location-participant video image to form a first combined mosaic image for reproduction at a first location workstation, and (d) a second video mosaic generator associated with the second location and configured to (1) receive the first mosaic image from the first mosaic generator, and (2) combine at least a portion of the first mosaic image with the second-location-participant video image to form a second combined mosaic image for reproduction at a workstation at the second location.
Claim 3
Dependent Claim
40 words
The teleconferencing system of claim 1, further comprising: (a) a close-up selector responsive to a participant input to select one paricipant's image in a reproduced combined mosaic image and to replace the reproduced combined mosaic image with the selected image.
Claim 4
Dependent Claim
48 words
The teleconferencing system of claim 1, further comprising: (a) a plurality of video mosaic generators at one location each configured to combine the captured images of a plurality of participants into respective first and second mosaic images both for reproduction at the workstations of at least one participant.
Claim 5
Dependent Claim
35 words
The teleconferencing system of claim 1, further comprising: (a) a participant display selector responsive to an input to select which participants are to have their corresponding captured video images displayed in a combined mosaic image.
Claim 6
Dependent Claim
47 words
The teleconferencing system of claim 1, further comprising: (a) at least one codec configured to compress the first mosaic image and the second-location-participant image and wherein at least one mosaic generator can combine the compressed mosaic image and the compressed participant image into a combined mosaic image.
Claim 7
Dependent Claim
55 words
The teleconferencing system of claim 1, further comprising: (a) an audio summer in communication with the AV path to receive captured audio of first, second and third participant and configured to combine the received audio of only the second and third participants into an audio sum for reproduction at the workstation of the first participant.
Claim 8
Dependent Claim
39 words
The teleconferencing system of claim 3, further comprising: (a) an image synchronizer responsive to information relating to the first and second mosaic images to synchronize the mosaic images for joint reproduction at the workstation of at least one participant.
Claim 9
Dependent Claim
33 words
The teleconferencing system of claim 7, further comprising: (a) a participant display selector configured to select which of the participants are to have their corresponding captured video image displayed in a mosaic image.
Claim 10
Dependent Claim
15 words
The teleconferencing system of claim 8, wherein the participant display selector selects the participants automatically.
Claim 11
Dependent Claim
16 words
The teleconferencing system of claim 4, wherein the participant display selector can select the participants automatically.
Claim 12
Dependent Claim
46 words
The teleconferencing system claim 4, wherein the system is operable to generate a combined video mosaic of fewer participants than the number of actual participants and the participant display selector is operable to select which of the actual participants will have a corresponding video image displayed.
Claim 13
Dependent Claim
22 words
The teleconferencing system of claim 6, further comprising: (a) an echo canceler to reduce echo during the reproduction of the audio sum.
Claim 14
Dependent Claim
81 words
The teleconferencing system of claim 6, wherein the audio reproduction capabilities associated with at least the workstation of the first participant includes a plurality of speakers and further comprising: (a) an audio control configured to control the audio sum at the first participant's workstation such that the composition of the audio originating from the second and third participants, is reproduced at each speaker based on a position of the images of the second and third participants in a combined mosaic image.
Claim 15
Dependent Claim
188 words
A teleconferencing system for conducting a teleconference between first and second locations the system comprising: (a) a plurality of workstations at the first location and at least one workstation at the second location, each workstation being associated with at least a participant and having a monitor and participant audio and video capture and reproduction capabilities; (b) an AV path for carrying AV signals representing participant video images and spoken audio among the workstations; (c) a first video mosaicing generator associated with the first location and configured to combine captured video images, of at least two first-location-participants, into a first mosaic image; (d) a second video mosaic generator configured to receive the first mosaic image and combine at least a portion thereof with a participant video image captured at the second location to form a second mosaic image for reproduction at least one workstation; (e) a data path providing a data path along which data can be shared among the workstations; and (f) a data conference manager for managing a data conference, during which the shared data is displayed interactively on the workstation monitors of at least two participants.
Claim 16
Dependent Claim
188 words
A teleconferencing system for conducting a teleconference between first and second locations the system comprising: (a) a plurality of workstations at the first location and at least one workstation at the second location, each workstation being associated with at least a participant and having a monitor and participant audio and video capture and reproduction capabilities; (b) an AV path for carrying AV signals representing participant video images and spoken audio among the workstations; (c) a first video mosaicing generator associated with the first location and configured to combine captured video images, of at least two first-location-participants, into a first mosaic image; (d) a second video mosaic generator configured to receive the first mosaic image and combine at least a portion thereof with a participant video image captured at the second location to form a second mosaic image for reproduction at least one workstation; (e) a data path providing a data path along which data can be shared among the workstations; and (f) a data conference manager for managing a data conference, during which the shared data is displayed interactively on the workstation monitors of at least two participants.
Claim 17
Dependent Claim
178 words
A teleconferencing system for conducting a teleconference between first and second locations, the system comprising: (a) a plurality of workstations at thc first location and at least one workstation at the second location, each workstation being associated with at least a participant and having a monitor and participant audio and video capture and reproduction capabilities; (b) a first video mosaic generator associated with the first location and configured to combine captured video images, of at least two first-location-participants, into a first mosaic image; (c) a second video mosaic generator configured to receive the first mosaic image and combine at least a portion thereof with a participant video image captured at the second location to form a second mosaic image for reproduction at a workstation; (d) an AV path for carrying AV signals representing participant video images and spoken audio among the workstations; and (e) an audio/video switch in association with the AV path and configured to control the carrying of AV signals representing individual participant and mosaic video images between the mosaic generator, the locations and the workstations.
Claim 18
Dependent Claim
178 words
A teleconferencing system for conducting a teleconference between first and second locations, the system comprising: (a) a plurality of workstations at thc first location and at least one workstation at the second location, each workstation being associated with at least a participant and having a monitor and participant audio and video capture and reproduction capabilities; (b) a first video mosaic generator associated with the first location and configured to combine captured video images, of at least two first-location-participants, into a first mosaic image; (c) a second video mosaic generator configured to receive the first mosaic image and combine at least a portion thereof with a participant video image captured at the second location to form a second mosaic image for reproduction at a workstation; (d) an AV path for carrying AV signals representing participant video images and spoken audio among the workstations; and (e) an audio/video switch in association with the AV path and configured to control the carrying of AV signals representing individual participant and mosaic video images between the mosaic generator, the locations and the workstations.
Claim 19
Independent Claim
209 words
A method for conducting a teleconference between first and second locations in which the first location includes a plurality of workstations and the second location includes at least one workstation, and in which each workstation is associated with at least one participant and has a monitor and participant audio and video capture an reproduction capabilities, the method comprising the steps of: (a) moving AV signals representing participant video images and spoken audio among the workstations; (b) creating a first combined mosaic image at the first location by (1) combining captured video images, of at least two first-location-participants, into a first mosaic image, (2) receiving a second-location-participant video image from the second location, and (3) combining at least a portion of the first mosaic image with the received second-location-participant video image to form the first combined mosaic image; (d) reproducing the first combined mosaic image at a first location workstation; (e) creating a second combined mosaic image at the second location by (1) receiving the first mosaic image from the first mosaicing circuitry, and (2) combining at least a portion of the first mosaic image with the second-location-participant video image to form the second combined mosaic image; and (f) reproducing the second combined mosaic image at a second location workstation.
Claim 20
Independent Claim
209 words
A method for conducting a teleconference between first and second locations in which the first location includes a plurality of workstations and the second location includes at least one workstation, and in which each workstation is associated with at least one participant and has a monitor and participant audio and video capture an reproduction capabilities, the method comprising the steps of: (a) moving AV signals representing participant video images and spoken audio among the workstations; (b) creating a first combined mosaic image at the first location by (1) combining captured video images, of at least two first-location-participants, into a first mosaic image, (2) receiving a second-location-participant video image from the second location, and (3) combining at least a portion of the first mosaic image with the received second-location-participant video image to form the first combined mosaic image; (d) reproducing the first combined mosaic image at a first location workstation; (e) creating a second combined mosaic image at the second location by (1) receiving the first mosaic image from the first mosaicing circuitry, and (2) combining at least a portion of the first mosaic image with the second-location-participant video image to form the second combined mosaic image; and (f) reproducing the second combined mosaic image at a second location workstation.
Claim 21
Dependent Claim
32 words
The method of claim 16, further comprising the steps of: (a) selecting one participant's image reproduced in a combined mosaic image; and (b) replacing the combined mosaic image with the selected image.
Claim 22
Dependent Claim
37 words
The method of claim 16, further comprising the steps of: (a) combining the captured images of a plurality of participants into first and second mosaic images both for reproduction at the workstations of at least one participant.
Claim 23
Dependent Claim
51 words
The method of claim 16, further comprising the steps of: (a) receiving the captured audio of a first, second and third participant; (b) combining the received audio of only the second and third participants into an audio sum; and (c) reproducing the audio sum at the workstation of the first participant.
Claim 24
Dependent Claim
29 words
The method of claim 17, further comprising the step of: (a) selecting which of the participants are to have their corresponding captured video image displayed in the mosaic image.
Claim 25
Dependent Claim
52 words
The method of claim 18, further comprising the step of: (a) combining the capture images of a plurality of participants into first and second mosaic images; and (b) synchronizing the mosaic images such that a plurality of mosaic images can be reproduced at the workstations of at least one of the participants.
Claim 26
Dependent Claim
82 words
The method of claim 19, wherein the audio reproduction capabilities associated with at least the workstation of the first participant includes a plurality of speakers, the method further comprising the steps of: (a) controlling the reproduction of the audio sum at the first participant's workstation such that the composition of the audio, originating from the second and third participants, is reproduced at each speaker based on a position of the images of the second and third participants in the combined mosaic image.
References Cited (Backward Citations)
US4054908A
Cited
US4716585A
Cited
US4686698A
Cited
US4965819A
Cited
US5382972A
Cited
US5014267A
Cited
US5315633A
Cited
US5526024A
Cited
US5353398A
Cited
US5408526A
Cited
US5444476A
Cited
US5515491A
Cited
US5561736A
Cited
US5602580A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-08-31 | 2002-03-02 | 2002-09-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-08-31 | 2006-03-02 | 2006-09-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-08-31 | 2010-03-02 | 2010-09-01 | $7700.00 | Window Closed / Lapsed |