US6006241A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Production of a video stream with synchronized annotations over a computer network
Assignee: Microsoft Technology Licensing LLC
•
Filing: 1997-03-14
•
Granted: 1999-12-21
•
Expires: 2017-03-14
Abstract
Abstract The production of synchronization scripts and associated annotated multimedia streams for servers and client computers coupled to each other by a diverse computer network which includes local area networks (LANs) and/or wide area networks (WANs) such as the internet. Annotated multimedia streams can include a compressed video stream for display in a video window, an accompanying compressed audio stream and annotations. Synchronization scripts include annotation streams for synchronizing the display of video streams with annotations, e.g., displayable events, such textual/graphical data in the form of HTML pages with Java applets to be displayed in one or more event windows. The producer includes a capture module and an author module for capturing video streams and generating annotation streams, respectively. The capture module compresses the video stream using a suitable compression format. Annotation streams include annotation frames which provide either pointer(s) to the event(s) of interest or include displayable data embedded within the annotation stream. Accordingly, each annotation frame includes either an event locator or an event data. In addition, each annotation frame includes an event time marker which corresponds to the time stamp(s) of associated video frame(s) within the video stream. Embedded displayable data include ticker tape data embedded within the annotation stream. Examples of event locators to displayable events include URL addresses pointing to HTML web pages. The video/audio streams and annotation streams are stored in stream server(s) for subsequent retrieval by client computer(s) in a coordinated manner, so that the client computer(s) is able to synchronously display the video frames and displayable event(s) in a video window and event window(s), respectively. In one implementation, annotation streams include a flipper stream for locating HTML pages and a ticker stream which include ticker (tape) data.
Inventors
- 👤 Audi Purnaveja
- 👤 Navin Chaddha
- 👤 Srinivas Prasad Vellanki
- 👤 David del Val
- 👤 Anoop Gupta
- 👤 Edward Yan-bing Wang
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-28 15:37
CPC Classifications
H; H04; H04N; H04N5/00; H04N5/04; H04N21/00; H04N21/40; H04N21/41; H04N21/426; H04N21/43; H04N21/431; H04N21/4312; H04N21/4316; H04N21/47; H04N21/488; H04N21/4886; H04N21/80; H04N21/81; H04N21/8126; H04N21/8133; H04N21/85; H04N21/854; H04N21/858; H04N21/8586; H04N5/44; H04N5/445; H04N5/44504; H04N21/45; H04N21/462; H04N21/4622
Claims Analysis
Total Claims: 32
Claim 1
Independent Claim
159 words
In a computer system, a method for generating a synchronization script configured to orchestrate a synchronized display of a video stream and displayable elements on a display device of a client computer, said video stream including a plurality of video frames, each said video frame associated with a time stamp, the method comprising: generating a first annotation stream for inclusion in said synchronization script, said first annotation stream including a first plurality of annotation frames, said first plurality of annotation frames associated with a first selected subset of said video frames, each said first plurality of annotation frames including an event locator and an event time marker, each said event locator pointing to the location of one of a first plurality of displayable elements stored in a web server coupled to said client computer, said event time markers of said first plurality of annotation frames corresponding to the respective time stamps of said first selected subset of video frames.
Claim 2
Dependent Claim
159 words
In a computer system, a method for generating a synchronization script configured to orchestrate a synchronized display of a video stream and displayable elements on a display device of a client computer, said video stream including a plurality of video frames, each said video frame associated with a time stamp, the method comprising: generating a first annotation stream for inclusion in said synchronization script, said first annotation stream including a first plurality of annotation frames, said first plurality of annotation frames associated with a first selected subset of said video frames, each said first plurality of annotation frames including an event locator and an event time marker, each said event locator pointing to the location of one of a first plurality of displayable elements stored in a web server coupled to said client computer, said event time markers of said first plurality of annotation frames corresponding to the respective time stamps of said first selected subset of video frames.
Claim 3
Dependent Claim
26 words
The method of claim 1 wherein each said event locator of said first plurality of annotation frames includes an URL address pointing to a HTML page.
Claim 4
Dependent Claim
92 words
The method of claim 2 further comprising: generating a second annotation stream for inclusion in said synchronization script, said second annotation stream including a second plurality of annotation frames, said second plurality of annotation frames associated with a second selected subset of said video frames, each said second plurality of annotation frames including a corresponding one of a second plurality of displayable events and an event time marker, said time markers of said second plurality of annotation frames corresponding to the respective time stamps of said second selected subset of video frames.
Claim 5
Dependent Claim
12 words
The method of claim 3 wherein said displayable events include ticker data.
Claim 6
Dependent Claim
126 words
In a computer system, a method for generating a synchronization script configured to orchestrate a synchronized display of a video stream and displayable elements on a display device of a client computer, said video stream including a plurality of video frames, each said video frame associated with a time stamp, the method comprising: generating at least one annotation stream for inclusion in said synchronization script, said at least one annotation stream including a plurality of annotation frames, said annotation frames associated with a selected subset of said video frames, each said annotation frame including a corresponding one of said displayable events and an event time marker, said time markers of said annotation frames corresponding to the respective time stamps of said selected subset of video frames.
Claim 7
Dependent Claim
126 words
In a computer system, a method for generating a synchronization script configured to orchestrate a synchronized display of a video stream and displayable elements on a display device of a client computer, said video stream including a plurality of video frames, each said video frame associated with a time stamp, the method comprising: generating at least one annotation stream for inclusion in said synchronization script, said at least one annotation stream including a plurality of annotation frames, said annotation frames associated with a selected subset of said video frames, each said annotation frame including a corresponding one of said displayable events and an event time marker, said time markers of said annotation frames corresponding to the respective time stamps of said selected subset of video frames.
Claim 8
Dependent Claim
12 words
The method of claim 5 wherein said displayable events include ticker data.
Claim 9
Dependent Claim
168 words
In a client computer having a display device, a method of skipping forward or backward to a predetermined one of a plurality of video frames of a video stream being displayed on said display device, each said video frame including a time stamp, and wherein a table of contents is also displayed on said display device, the method comprising: receiving said video stream from a stream server coupled to the client computer via a computer network; sequentially displaying said video frames on said display device, starting from an initial video frame of said video stream; selecting a content label from said table of contents, said content label providing an index into an intermediate video frame of said video stream, said index based on the time stamp of said intermediate video frame; communicating said index to said stream server; receiving said video stream from said stream server, starting from said intermediate video frame; and sequentially displaying said video frames on said display device, starting with said intermediate video frame.
Claim 10
Dependent Claim
168 words
In a client computer having a display device, a method of skipping forward or backward to a predetermined one of a plurality of video frames of a video stream being displayed on said display device, each said video frame including a time stamp, and wherein a table of contents is also displayed on said display device, the method comprising: receiving said video stream from a stream server coupled to the client computer via a computer network; sequentially displaying said video frames on said display device, starting from an initial video frame of said video stream; selecting a content label from said table of contents, said content label providing an index into an intermediate video frame of said video stream, said index based on the time stamp of said intermediate video frame; communicating said index to said stream server; receiving said video stream from said stream server, starting from said intermediate video frame; and sequentially displaying said video frames on said display device, starting with said intermediate video frame.
Claim 11
Dependent Claim
164 words
In a stream server, a method of causing a client computer to skip forward or backward to a predetermined one of a plurality of video frames of a video stream being displayed on a display device of said client computer, said stream server coupled to the client computer via a computer network, each said video frame including a time stamp, and wherein a table of content is also displayed on said display device, the method comprising: streaming said video stream to said client computer for sequential display on said display device, starting from an initial video frame of said video stream; receiving an index from said client computer, said index associated with a selectable content label from a table of contents displayed on said display device, said index based on the time stamp of an intermediate video frame of said video stream; and streaming said video stream to said client computer for sequential display on said display device, starting from said intermediate video frame.
Claim 12
Dependent Claim
164 words
In a stream server, a method of causing a client computer to skip forward or backward to a predetermined one of a plurality of video frames of a video stream being displayed on a display device of said client computer, said stream server coupled to the client computer via a computer network, each said video frame including a time stamp, and wherein a table of content is also displayed on said display device, the method comprising: streaming said video stream to said client computer for sequential display on said display device, starting from an initial video frame of said video stream; receiving an index from said client computer, said index associated with a selectable content label from a table of contents displayed on said display device, said index based on the time stamp of an intermediate video frame of said video stream; and streaming said video stream to said client computer for sequential display on said display device, starting from said intermediate video frame.
Claim 13
Dependent Claim
169 words
A producer useful for generating a synchronization script configured to orchestrate a synchronized display of a video stream and displayable elements on a display device of a client computer, the producer comprising: a capture module configured to capture said video stream which includes a plurality of video frames, each said video frame associated with a time stamp; and an author module configured to generate a first annotation stream for inclusion in said synchronization script, said first annotation stream including a first plurality of annotation frames, said first plurality of annotation frames associated with a first selected subset of said video frames, each said first plurality of annotation frames including an event locator and an event time marker, each said event locator pointing to the location of one of a first plurality of displayable elements stored in a web server coupled to said client computer, said event time markers of said first plurality of annotation frames corresponding to the respective time stamps of said first selected subset of video frames.
Claim 14
Dependent Claim
169 words
A producer useful for generating a synchronization script configured to orchestrate a synchronized display of a video stream and displayable elements on a display device of a client computer, the producer comprising: a capture module configured to capture said video stream which includes a plurality of video frames, each said video frame associated with a time stamp; and an author module configured to generate a first annotation stream for inclusion in said synchronization script, said first annotation stream including a first plurality of annotation frames, said first plurality of annotation frames associated with a first selected subset of said video frames, each said first plurality of annotation frames including an event locator and an event time marker, each said event locator pointing to the location of one of a first plurality of displayable elements stored in a web server coupled to said client computer, said event time markers of said first plurality of annotation frames corresponding to the respective time stamps of said first selected subset of video frames.
Claim 15
Dependent Claim
26 words
The producer of claim 9 wherein each said event locator of said first plurality of annotation frames includes an URL address pointing to a HTML page.
Claim 16
Dependent Claim
98 words
The producer of claim 9 wherein said author module is further configured to generate a second annotation stream for inclusion in said synchronization script, said second annotation stream including a second plurality of annotation frames, said second plurality of annotation frames associated with a second selected subset of said video frames, each said second plurality of annotation frames including a corresponding one of a second plurality of displayable events and an event time marker, said time markers of said second plurality of annotation frames corresponding to the respective time stamps of said second selected subset of video frames.
Claim 17
Dependent Claim
12 words
The producer of claim 11 wherein said displayable events include ticker data.
Claim 18
Dependent Claim
136 words
A producer useful for generating a synchronization script configured to orchestrate a synchronized display of a video stream and displayable elements on a display device of a client computer, the producer comprising: a capture module configured to capture said video stream which includes a plurality of video frames, each said video frame associated with a time stamp; and an author module configured to generate at least one annotation stream for inclusion in said synchronization script, said at least one annotation stream including a plurality of annotation frames, said annotation frames associated with a selected subset of said video frames, each said annotation frame including a corresponding one of said displayable events and an event time marker, said time markers of said annotation frames corresponding to the respective time stamps of said selected subset of video frames.
Claim 19
Dependent Claim
136 words
A producer useful for generating a synchronization script configured to orchestrate a synchronized display of a video stream and displayable elements on a display device of a client computer, the producer comprising: a capture module configured to capture said video stream which includes a plurality of video frames, each said video frame associated with a time stamp; and an author module configured to generate at least one annotation stream for inclusion in said synchronization script, said at least one annotation stream including a plurality of annotation frames, said annotation frames associated with a selected subset of said video frames, each said annotation frame including a corresponding one of said displayable events and an event time marker, said time markers of said annotation frames corresponding to the respective time stamps of said selected subset of video frames.
Claim 20
Dependent Claim
12 words
The producer of claim 13 wherein said displayable events include ticker data.
Claim 21
Dependent Claim
171 words
A client computer useful in association with a stream server coupled to the client computer via a computer network, the client computer comprising: a playout buffer configured to receive a video stream from said stream server, said video stream including a plurality of video frames, each said video frame including a time stamp; a display device configured to sequentially display said video frames on said display device, starting from an initial video frame of said video stream, said display device also configured to display a selectable content label from said table of contents, said selectable content label providing an index into an intermediate video frame of said video stream, said index based on the time stamp of said intermediate video frame; and a transmitter configured to communicate said index to said stream server, thereby causing said stream server to begin transmitting said video stream to said client computer, starting from said intermediate video frame, and causing said display device to sequentially display said video frames, starting with said intermediate video frame.
Claim 22
Dependent Claim
171 words
A client computer useful in association with a stream server coupled to the client computer via a computer network, the client computer comprising: a playout buffer configured to receive a video stream from said stream server, said video stream including a plurality of video frames, each said video frame including a time stamp; a display device configured to sequentially display said video frames on said display device, starting from an initial video frame of said video stream, said display device also configured to display a selectable content label from said table of contents, said selectable content label providing an index into an intermediate video frame of said video stream, said index based on the time stamp of said intermediate video frame; and a transmitter configured to communicate said index to said stream server, thereby causing said stream server to begin transmitting said video stream to said client computer, starting from said intermediate video frame, and causing said display device to sequentially display said video frames, starting with said intermediate video frame.
Claim 23
Dependent Claim
162 words
A stream server useful in association with a client computer coupled to said stream server via a computer network, the stream server comprising: a streamer configured to store and stream a video stream to said client computer, said video stream including a plurality of video frames, said video stream enabling said client computer to sequentially display said video frames on a display device of said client computer, starting from an initial video frame of said video stream; and a receiver configured to receive an index from said client computer, said index associated with a selectable content label from a table of contents displayed on said display device, said index based on the time stamp of an intermediate video frame of said video stream, and wherein said received index causes said streamer to begin streaming said video stream to said client computer, and enabling said client computer to sequentially display said video frames on said display device starting from said intermediate video frame.
Claim 24
Dependent Claim
162 words
A stream server useful in association with a client computer coupled to said stream server via a computer network, the stream server comprising: a streamer configured to store and stream a video stream to said client computer, said video stream including a plurality of video frames, said video stream enabling said client computer to sequentially display said video frames on a display device of said client computer, starting from an initial video frame of said video stream; and a receiver configured to receive an index from said client computer, said index associated with a selectable content label from a table of contents displayed on said display device, said index based on the time stamp of an intermediate video frame of said video stream, and wherein said received index causes said streamer to begin streaming said video stream to said client computer, and enabling said client computer to sequentially display said video frames on said display device starting from said intermediate video frame.
Claim 25
Dependent Claim
138 words
A computer-readable medium useful in association with a computer system, the computer-readable medium having computer-executable instructions which cause the computer system to perform a method comprising generating a first annotation stream which includes a first plurality of annotation frames, said first plurality of annotation frames associated with a first selected subset of a plurality of video frames of a video stream, each said video frame associated with a time stamp, each said first plurality of annotation frames including an event locator and an event time marker, each said event locator pointing to the location of one of a first plurality of displayable elements stored in a web server coupled to said client computer, said event time markers of said first plurality of annotation frames corresponding to the respective time stamps of said first selected subset of video frames.
Claim 26
Dependent Claim
138 words
A computer-readable medium useful in association with a computer system, the computer-readable medium having computer-executable instructions which cause the computer system to perform a method comprising generating a first annotation stream which includes a first plurality of annotation frames, said first plurality of annotation frames associated with a first selected subset of a plurality of video frames of a video stream, each said video frame associated with a time stamp, each said first plurality of annotation frames including an event locator and an event time marker, each said event locator pointing to the location of one of a first plurality of displayable elements stored in a web server coupled to said client computer, said event time markers of said first plurality of annotation frames corresponding to the respective time stamps of said first selected subset of video frames.
Claim 27
Dependent Claim
27 words
The computer-readable medium of claim 17 wherein each said event locator of said first plurality of annotation frames includes an URL address pointing to a HTML page.
Claim 28
Dependent Claim
88 words
The computer-readable medium of claim 18 having further computer-readable code instructions comprising: generating a second annotation stream which includes a second plurality of annotation frames, said second plurality of annotation frames associated with a second selected subset of said video frames, each said second plurality of annotation frames including a corresponding one of a second plurality of displayable events and an event time marker, said time markers of said second plurality of annotation frames corresponding to the respective time stamps of said second selected subset of video frames.
Claim 29
Dependent Claim
13 words
The computer-readable medium of claim 19 wherein said displayable events include ticker data.
Claim 30
Dependent Claim
103 words
A computer-readable medium useful in association with a computer system, the computer-readable medium having computer-executable instructions which cause the computer system to perform a method comprising generating at least one annotation stream which includes a plurality of annotation frames, said annotation frames associated with a selected subset of a plurality of video frames of a video stream, each said video frame associated with a time stamp, each said annotation frame including a corresponding one of said displayable events and an event time marker, said time markers of said annotation frames corresponding to the respective time stamps of said selected subset of video frames.
Claim 31
Dependent Claim
103 words
A computer-readable medium useful in association with a computer system, the computer-readable medium having computer-executable instructions which cause the computer system to perform a method comprising generating at least one annotation stream which includes a plurality of annotation frames, said annotation frames associated with a selected subset of a plurality of video frames of a video stream, each said video frame associated with a time stamp, each said annotation frame including a corresponding one of said displayable events and an event time marker, said time markers of said annotation frames corresponding to the respective time stamps of said selected subset of video frames.
Claim 32
Dependent Claim
13 words
The computer-readable medium of claim 21 wherein said displayable events include ticker data.
References Cited (Backward Citations)
US4931950A
Cited
US5119474A
Cited
US5274758A
Cited
US5524193A
Cited
US5487167A
Cited
US5546324A
Cited
US5831666A
Cited
US5623690A
Cited
US5455910A
Cited
US5506954A
Cited
US5583980A
Cited
US5583561A
Cited
US5577258A
Cited
US5594911A
Cited
US5600775A
Cited
US5543850A
Cited
US5537408A
Cited
US5533021A
Cited
US5844600A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-12-20 | 2003-06-21 | 2003-12-21 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-12-20 | 2007-06-21 | 2007-12-21 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-12-20 | 2011-06-21 | 2011-12-21 | $7700.00 | Window Closed / Lapsed |