US5915091A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Synchronization in video conferencing
Assignee: Pragmatus AV LLC
•
Filing: 1996-06-11
•
Granted: 1999-06-22
•
Expires: 2016-06-11
Abstract
Abstract A multimedia collaboration system that integrates separate real-time and asynchronous networks--the former for real-time audio and video, and the latter for control signals and textual, graphical and other data--in a manner that is interoperable across different computer and network operating system platforms and which closely approximates the experience of face-to-face collaboration, while liberating the participants from the limitations of time and distance. These capabilities are achieved by exploiting a variety of hardware, software and networking technologies in a manner that preserves the quality and integrity of audio/video/data and other multimedia information, even after wide area transmission, and at a significantly reduced networking cost as compared to what would be required by presently known approaches. The system architecture is readily scalable to the largest enterprise network environments. It accommodates differing levels of collaborative capabilities available to individual users and permits high-quality audio and video capabilities to be readily superimposed onto existing personal computers and workstations and their interconnecting LANs and WANs. In a particular preferred embodiment, a plurality of geographically dispersed multimedia LANs are interconnected by a WAN. The demands made on the WAN are significantly reduced by employing multi-hopping techniques, including dynamically avoiding the unnecessary decompression of data at intermediate hops, and exploiting video mosaicing, cut-and-paste and audio mixing technologies so that significantly fewer wide area transmission paths are required while maintaining the high quality of the transmitted audio/video.
Inventors
- 👤 Lester F. Ludwig
- 👤 J. Chris Lauwers
- 👤 Keith A. Lantz
- 👤 Gerald J. Burnett
- 👤 Emmett R. Burns
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-28 18:46
CPC Classifications
H; H04; H04L; H04L65/00; H04L65/80; G; G06; G06Q; G06Q10/00; G06Q10/10; H04L12/00; H04L12/02; H04L12/16; H04L12/18; H04L12/1813; H04L12/1818; H04L12/1822; H04L12/1827; H04L12/1831; H04L51/00; H04L51/04; H04L51/07; H04L51/10; H04L65/1066; H04L65/1101; H04L65/40; H04L65/403; H04L65/4038; H04L67/00; H04L67/14; H04L67/50; H04L67/75; H04L9/00; H04L9/40; H04M; H04M3/00; H04M3/42; H04M3/50; H04M3/53; H04M3/5307; H04M3/56; H04M3/562; H04M3/563; H04M3/567; H04N; H04N7/00; H04N7/14; H04N7/141; H04N7/147; H04N7/148; H04N7/15; H04N7/152; H04L12/1836; H04L12/185; H04M2201/00; H04M2201/38; H04M2203/00; H04M2203/50; H04M2203/5018; H04M2203/5027; H04M3/42221; H04M3/42314; H04M3/42323; H04M3/428; H04M3/4285; H04M3/564; H04M7/00; H04M7/006; H04M7/12; H04Q; H04Q2213/00; H04Q2213/1305; H04Q2213/13093; H04Q2213/13175; H04Q2213/1319; H04Q2213/1322; H04Q2213/1324; H04Q2213/1326; H04Q2213/1332; H04Q2213/13337; H04Q2213/13389
Claims Analysis
Total Claims: 39
Claim 1
Independent Claim
205 words
A videoconferencing and data conferencing system comprising: (a) at least one video signal source; (b) at least one audio source; (c) at least one video display device; (d) at least one audio reproduction facility; (e) at least one video communication path (i) arranged for transport of audio and video signals, (1) originating at one of the signal sources, (2) to at least one of the display devices; (f) at least one processor (i) capable of providing data conferencing signals; and (g) at least one data communication path (i) arranged for transmission of (1) data conferencing visual information signals, (2) to one of the display devices, wherein the system is configured to (i) reproduce video images and audio, (1) based on the transported video and audio signals, (2) at one of the display devices, (3) to define a video conference, (ii) display visual information, (1) based on the carried data conferencing signals, (2) at one of the display devices (3) to define a data conference, and (iii) store at least some of the data signals plus related audio and/or video signals (1) from the data and video conferences (2) for subsequent retrieval, and (3) synchronized play back (4) representing the relationship in which they were created.
Claim 2
Dependent Claim
205 words
A videoconferencing and data conferencing system comprising: (a) at least one video signal source; (b) at least one audio source; (c) at least one video display device; (d) at least one audio reproduction facility; (e) at least one video communication path (i) arranged for transport of audio and video signals, (1) originating at one of the signal sources, (2) to at least one of the display devices; (f) at least one processor (i) capable of providing data conferencing signals; and (g) at least one data communication path (i) arranged for transmission of (1) data conferencing visual information signals, (2) to one of the display devices, wherein the system is configured to (i) reproduce video images and audio, (1) based on the transported video and audio signals, (2) at one of the display devices, (3) to define a video conference, (ii) display visual information, (1) based on the carried data conferencing signals, (2) at one of the display devices (3) to define a data conference, and (iii) store at least some of the data signals plus related audio and/or video signals (1) from the data and video conferences (2) for subsequent retrieval, and (3) synchronized play back (4) representing the relationship in which they were created.
Claim 3
Dependent Claim
33 words
The system of claim 1, wherein (a) the visual information is at least one of: (i) a snapshot; (ii) information associated with an applications program; and (iii) a real-time display of video images.
Claim 4
Dependent Claim
43 words
The system of claim 1, wherein (a) either the data, audio or video signals (b) can be used (i) as a timing reference (ii) to synchronize (1) the play back or (2) the storage (iii) as related components of a collaborative, multimedia conference.
Claim 5
Dependent Claim
31 words
The system of claim 3, wherein (a) time codes (i) can be assigned (1) to the data, audio and/or video signals (2) during storage (3) to facilitate synchronizing the play back.
Claim 6
Dependent Claim
36 words
The system of claim 3, wherein (a) a user (i) can use the time codes (ii) certain portions of the stored visual information and captured audio and/or image signals (iii) to selectively access and play back.
Claim 7
Dependent Claim
25 words
The system of claim 1, further comprising (a) annotation tools (i) for use (ii) in annotating (1) the visual information and captured audio and/or images.
Claim 8
Dependent Claim
24 words
The system of claim 1, wherein (a) the visual information (i) can be shared interactively (ii) among the users (iii) over the data network.
Claim 9
Dependent Claim
24 words
The system of claim 1, wherein (a) the user can annotate (i) certain portions (ii) of the visual information and captured audio and/or images.
Claim 10
Dependent Claim
34 words
The system of claim 1, wherein (a) a user can cause (i) accessed visual information and captured audio and/or images (ii) to be played back (1) at a workstation (2) during an ongoing conference.
Claim 11
Independent Claim
106 words
A method of making and storing a multimedia message, comprising the steps of: (a) capturing (i) images and/or audio (ii) of a user (iii) at an associated workstation; (b) creating (i) data signals, (1) representing visual information (2) other than the captured image (ii) during the step of capturing; (c) reproducing (i) one or more of (1) the visual information and (2) captured image (3) at the workstation; and (d) storing (i) the audio and/or video signals and (ii) the associated visual information (iii) for subsequent retrieval and playback (1) of the associated visual information and the captured image and/or audio (2) in a synchronized manner.
Claim 12
Independent Claim
106 words
A method of making and storing a multimedia message, comprising the steps of: (a) capturing (i) images and/or audio (ii) of a user (iii) at an associated workstation; (b) creating (i) data signals, (1) representing visual information (2) other than the captured image (ii) during the step of capturing; (c) reproducing (i) one or more of (1) the visual information and (2) captured image (3) at the workstation; and (d) storing (i) the audio and/or video signals and (ii) the associated visual information (iii) for subsequent retrieval and playback (1) of the associated visual information and the captured image and/or audio (2) in a synchronized manner.
Claim 13
Dependent Claim
37 words
The method of claim 10, wherein (a) the visual information is one of the group of: (i) a bitmap; (ii) information associated with an applications program; (iii) a real-time display of video images; and (iv) textual information.
Claim 14
Dependent Claim
36 words
The method of claim 10, further comprising the step of (a) providing annotation tools (i) at the workstations (ii) so that a user can annotate (1) the visual information (2) prior to the step of storing.
Claim 15
Dependent Claim
34 words
The method of claim 10, further comprising the step of (a) using (i) at least one of the data, audio or video signals (1) as a timing reference (ii) to synchronize the play back.
Claim 16
Dependent Claim
30 words
The method of claim 10, further comprising the step of (a) assigning time codes (i) to the data, audio or video signals (ii) to facilitate (1) synchronizing the play back.
Claim 17
Dependent Claim
60 words
The method of claim 10, further including the step of (a) causing (i) the multimedia event (ii) to be transferred (iii) to a selected user (iv) as a multimedia mail message (b) such that a selected user (i) can initiate the play back (1) of the visual information and captured audio and/or image (2) at the selected user's associated workstation.
Claim 18
Dependent Claim
25 words
The method of claim 15, wherein (a) the retrieval and play back (i) is initiated (1) by the selected user (2) during an ongoing conference.
Claim 19
Dependent Claim
50 words
The method of claim 16, wherein (a) the stored visual information, captured audio and/or images (i) contains time codes and (b) wherein (i) a user (1) can use the time codes (2) to selectively access and play back (3) certain portions of the stored visual information captured audio and/or images.
Claim 20
Dependent Claim
28 words
The method of claim 16, wherein (a) the selected user (i) can edit and/or annotate (1) the certain portions of the visual information and captured audio and/or images.
Claim 21
Independent Claim
124 words
A method of storing a collaborative multimedia event, comprising the steps of: (a) capturing (i) the images and/or audio (ii) of a plurality of workstation users (iii) at an associated plurality of workstations; (b) generating (i) data signals, (1) representing associated visual information other than the captured image, (ii) during the step of capturing; (c) interactively sharing, (i) the visual information (ii) among the plurality of participants; (d) reproducing, (i) one or more of the associated visual information, captured images and/or audio (ii) at the workstations (iii) as a collaborative multimedia event; and (e) storing (i) the data, audio and/or video signals (ii) for subsequent retrieval and playback (1) of the associated visual information and captured images and/or audio; (iii) in a synchronized manner.
Claim 22
Independent Claim
124 words
A method of storing a collaborative multimedia event, comprising the steps of: (a) capturing (i) the images and/or audio (ii) of a plurality of workstation users (iii) at an associated plurality of workstations; (b) generating (i) data signals, (1) representing associated visual information other than the captured image, (ii) during the step of capturing; (c) interactively sharing, (i) the visual information (ii) among the plurality of participants; (d) reproducing, (i) one or more of the associated visual information, captured images and/or audio (ii) at the workstations (iii) as a collaborative multimedia event; and (e) storing (i) the data, audio and/or video signals (ii) for subsequent retrieval and playback (1) of the associated visual information and captured images and/or audio; (iii) in a synchronized manner.
Claim 23
Dependent Claim
34 words
The method of claim 19, wherein (a) the associated visual information is at least one of: (i) a snapshot; (ii) information associated with an applications program; and (iii) a real-time display of video images.
Claim 24
Dependent Claim
31 words
The method of claim 19, further comprising the step of (a) using (i) either the data, audio or video signals (ii) as a timing reference (iii) to synchronize the play back.
Claim 25
Dependent Claim
34 words
The method of claim 21, further comprising the step of (a) assigning (i) time codes (ii) to the data, audio and/or video signals (iii) during storage (iv) to facilitate (1) synchronizing the play back.
Claim 26
Dependent Claim
36 words
The method of claim 22, further comprising the step of (a) using (i) the time codes (ii) to selectively access and play back (1) certain portions of the stored visual information and captured audio and/or images.
Claim 27
Dependent Claim
30 words
The method of claim 19, further comprising the step of (a) providing (i) annotation tools (1) at each workstation (ii) that can be used (iii) to annotate the visual information.
Claim 28
Dependent Claim
27 words
The method of claim 24, further comprising the step of (a) editing and/or annotating (i) the certain portions of the visual information and captured audio and/or images.
Claim 29
Dependent Claim
36 words
The method of claim 19, further comprising (a) playing back (i) the visual information and captured audio and/or images (ii) at the workstations (iii) during an ongoing videoconference, data conference or combined videoconference and data conference.
Claim 30
Dependent Claim
113 words
A multimedia system, comprising: (a) AV capture tools (i) configured to capture (1) images and/or audio (2) of a workstation user; (b) means for creating data signals, (i) representing associated visual information (1) other than the captured image, during the step of capturing; (c) reproduction facilities (i) configured to reproduce (1) one or more of the associated visual information and captured image and/or audio at a workstation; and (d) a storage system configured to (i) store the data, audio and/or image signals so that (1) one or more of them can subsequently be retrieved and (2) the respective associated visual information and captured image and/or audio played back (3) in a synchronized manner.
Claim 31
Dependent Claim
113 words
A multimedia system, comprising: (a) AV capture tools (i) configured to capture (1) images and/or audio (2) of a workstation user; (b) means for creating data signals, (i) representing associated visual information (1) other than the captured image, during the step of capturing; (c) reproduction facilities (i) configured to reproduce (1) one or more of the associated visual information and captured image and/or audio at a workstation; and (d) a storage system configured to (i) store the data, audio and/or image signals so that (1) one or more of them can subsequently be retrieved and (2) the respective associated visual information and captured image and/or audio played back (3) in a synchronized manner.
Claim 32
Dependent Claim
37 words
The system of claim 27, wherein (a) the associated visual information is at least one of: (i) a bitmap; (ii) information associated with an applications program; (iii) a real-time display of video images; and (iv) textual information.
Claim 33
Dependent Claim
28 words
The system of claim 27, wherein (a) the data, audio or image signals (i) can be used (ii) as a timing reference (iii) to synchronize the play back.
Claim 34
Dependent Claim
28 words
The system of claim 27, wherein (a) time codes (i) can be assigned (ii) to the data, audio or image signals (iii) to facilitate synchronizing the play back.
Claim 35
Dependent Claim
26 words
The system of claim 27, further comprising (a) annotation tools, (i) operable by a user (ii) to annotate (iii) the visual information, captured audio and/or image.
Claim 36
Dependent Claim
53 words
The system of claim 27, wherein (a) a user (i) can cause the multimedia event (ii) to be transferred (1) to a selected user (2) as a multimedia mail message (3) such that the selected user (4) can initiate (5) the play back (6) of the visual information and captured audio and/or image.
Claim 37
Dependent Claim
25 words
The system of claim 27, wherein (a) the retrieval and play back (i) can be initiated (1) by a participant (2) in an ongoing conference.
Claim 38
Dependent Claim
30 words
The system of claim 27, wherein (a) the time codes (i) can be used (ii) to selectively access and play back (1) certain portions of the stored visual information captured.
Claim 39
Dependent Claim
26 words
The system of claim 27, wherein (a) a user (i) can edit and/or annotate (ii) certain portions of the visual information and captured audio and/or images.
References Cited (Backward Citations)
US5253362A
Cited
US5363507A
Cited
US5239466A
Cited
US5351276A
Cited
US5315633A
Cited
US5333299A
Cited
US5550966A
Cited
US5408526A
Cited
US5471318A
Cited
US5553222A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-06-21 | 2002-12-21 | 2003-06-22 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-06-21 | 2006-12-21 | 2007-06-22 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-06-21 | 2010-12-21 | 2011-06-22 | $7700.00 | Window Closed / Lapsed |