US5664226A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System for merging plurality of atomic data elements into single synchronized file by assigning ouput rate to each channel in response to presentation time duration
Assignee: International Business Machines Corp
•
Filing: 1994-09-08
•
Granted: 1997-09-02
•
Expires: 2014-09-08
Abstract
Abstract Disclosed are apparatus and methods for synchronized interleaving of multimedia data arriving from distinct sources. The invention independently buffers the incoming data streams and determines the amount of presentation time associated with each data element or byte of each data stream. The invention then draws data from the buffers at varying rates that reflect these differences, continuously presenting the withdrawn data to an interleaving module at data-streaming rates that reflect equivalent presentation-time rates. The invention also includes means for disabling synchronization when one type of data is streamed at a particularly high or low rate, resulting in buffer overload (with either the high-rate data or all data other than that transferred at the low rate).
Inventors
- 👤 Brian Matthew Czako
- 👤 William Wallis Lawton
- 👤 Susan Ann O'Loughlin
- 👤 Werner Leland Sharp
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-30 19:33
CPC Classifications
G; G06; G06F; G06F13/00; G06F13/38; G06F13/42; G06F13/4204; G06F13/4234; G06F13/4239
Claims Analysis
Total Claims: 18
Claim 1
Independent Claim
283 words
Apparatus for dynamically interleaving multiple streams of multimedia data into a single, integrated data file, said apparatus comprising: a plurality of sources of visual or audio data collectively representative of a presentation having a temporal flow pattern, the data from each of said plurality of sources originating as an ordered series of atomic data elements, each representative of a visual or audio presentation time segment, wherein atomic data elements from each diverse source of visual or audio data comprise different amounts of data; at least one memory buffer associated with each data source for accumulating presentation data in a manner that preserves the temporal flow pattern; handler means for obtaining data from each data source and storing the data in said at least one memory buffer associated with each data source and for extracting data from said at least one buffer as a separate data stream when a specified number of buffers for that data source have been filled, said specified number relating to an amount of data within each atomic data element from that data source; synchronization means for temporally aligning the data streams, said synchronization means comprising: multi-channel input means for accepting a data stream for each data source from said handler means; means for determining, for each data stream, a presentation time duration associated with each atomic data element; variable-rate, multi-channel output means for transmitting each accepted data stream at a streaming rate; and control means for assigning an output rate to each output channel in response to a determined presentation time duration such that the streaming rates correspond to equivalent output rates of presentation time segments; and means for merging the synchronized data into a single integrated data file.
Claim 2
Dependent Claim
283 words
Apparatus for dynamically interleaving multiple streams of multimedia data into a single, integrated data file, said apparatus comprising: a plurality of sources of visual or audio data collectively representative of a presentation having a temporal flow pattern, the data from each of said plurality of sources originating as an ordered series of atomic data elements, each representative of a visual or audio presentation time segment, wherein atomic data elements from each diverse source of visual or audio data comprise different amounts of data; at least one memory buffer associated with each data source for accumulating presentation data in a manner that preserves the temporal flow pattern; handler means for obtaining data from each data source and storing the data in said at least one memory buffer associated with each data source and for extracting data from said at least one buffer as a separate data stream when a specified number of buffers for that data source have been filled, said specified number relating to an amount of data within each atomic data element from that data source; synchronization means for temporally aligning the data streams, said synchronization means comprising: multi-channel input means for accepting a data stream for each data source from said handler means; means for determining, for each data stream, a presentation time duration associated with each atomic data element; variable-rate, multi-channel output means for transmitting each accepted data stream at a streaming rate; and control means for assigning an output rate to each output channel in response to a determined presentation time duration such that the streaming rates correspond to equivalent output rates of presentation time segments; and means for merging the synchronized data into a single integrated data file.
Claim 3
Dependent Claim
76 words
The apparatus according to claim 1 wherein: said at least one buffer associated with each data source comprises a plurality of buffers; each data element corresponds to a quantity of data bytes; and said handler means cyclicly transfers data in buffer-length units, the number of buffers that each handler means transfers to said synchronization means at each cycle being determined by said control means based upon differences in per-byte presentation times associated with each data source.
Claim 4
Dependent Claim
64 words
The apparatus of claim 2 wherein the data transferred during each cycle represents an aggregate presentation time, and mismatches in aggregate presentation times, which arise from outputting in buffer-length units, are accumulated by the control means until the succeeding cycle, and are thereupon used by the control means in determining the number of buffers to be transferred by each transfer means during that cycle.
Claim 5
Dependent Claim
16 words
The apparatus of claim 1 further comprising a storage device for storing the integrated data file.
Claim 6
Dependent Claim
16 words
The apparatus of claim 1 further comprising audiovisual presentation means for playing the integrated data file.
Claim 7
Dependent Claim
15 words
The apparatus of claim 1 wherein each source of data is a real-time input device.
Claim 8
Dependent Claim
21 words
The apparatus of claim 1 wherein the sources of data are data files contained on at least one mass storage device.
Claim 9
Dependent Claim
25 words
The apparatus of claim 1 further comprising means for disabling synchronization upon detection of imminent overload conditions in one of the at least one buffers.
Claim 10
Independent Claim
202 words
A method of dynamically interleaving multiple streams of multimedia data into a single, integrated data file, said method comprising the steps of: providing a plurality of sources of visual or audio data collectively representative of a presentation having a temporal flow pattern, said data originating as an ordered series of atomic data elements, each representative of a visual or audio presentation time segment wherein atomic data elements from each diverse source of visual or audio data comprise different amounts of data; buffering said data associated with each data source in at least one buffer associated with said data source; extracting data from said at least one buffer as a separate data stream when a specified number of buffers for each source have been filled, said specified number relating to an amount of data within each atomic data element from each data source; synchronizing said extracted data according to steps comprising: determining, for each data stream, a presentation time associated with each atomic data element; coordinating said data streams such that the streaming rates corresponding equivalent output rates of presentation time segments, including specifying said specified number of buffers for each source; and merging said synchronized data into a single integrated data file.
Claim 11
Independent Claim
202 words
A method of dynamically interleaving multiple streams of multimedia data into a single, integrated data file, said method comprising the steps of: providing a plurality of sources of visual or audio data collectively representative of a presentation having a temporal flow pattern, said data originating as an ordered series of atomic data elements, each representative of a visual or audio presentation time segment wherein atomic data elements from each diverse source of visual or audio data comprise different amounts of data; buffering said data associated with each data source in at least one buffer associated with said data source; extracting data from said at least one buffer as a separate data stream when a specified number of buffers for each source have been filled, said specified number relating to an amount of data within each atomic data element from each data source; synchronizing said extracted data according to steps comprising: determining, for each data stream, a presentation time associated with each atomic data element; coordinating said data streams such that the streaming rates corresponding equivalent output rates of presentation time segments, including specifying said specified number of buffers for each source; and merging said synchronized data into a single integrated data file.
Claim 12
Dependent Claim
65 words
The method according to claim 9 wherein: said at least one buffer associated with each data source comprises a plurality of buffers; each data element corresponds to a quantity of data bytes; and data is cyclicly extracted in buffer-length units, the number of buffers extracted from each data source in each cycle being determined by differences in per-byte presentation times associated with each data source.
Claim 13
Dependent Claim
64 words
The method of claim 10 wherein the data extracted during each cycle represents an aggregate presentation time, and mismatches in aggregate presentation times, which arise from outputting in buffer-length units, are accumulated by the control means until the succeeding cycle, and are thereupon used by the control means in determining the number of buffers to be transferred by each transfer means during that cycle.
Claim 14
Dependent Claim
19 words
The method of claim 9 further comprising the step of storing the integrated data file in a storage device.
Claim 15
Dependent Claim
19 words
The method of claim 9 further comprising the step of playing the integrated data on an audiovisual presentation means.
Claim 16
Dependent Claim
15 words
The method of claim 9 wherein each source of data is a real-time input device.
Claim 17
Dependent Claim
21 words
The method of claim 9 wherein the sources of data are data files contained on at least one mass storage device.
Claim 18
Dependent Claim
27 words
The method of claim 9 further comprising the steps of analyzing the buffers for an imminent overload condition and, upon detection of such a condition, disabling synchronization.
References Cited (Backward Citations)
US4688168A
Cited
US4864562A
Cited
US5195092A
Cited
US5020023A
Cited
US5121392A
Cited
US5265248A
Cited
US5349479A
Cited
US5268846A
Cited
US5333299A
Cited
US5440677A
Cited
US5339413A
Cited
US5455910A
Cited
US5410698A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-09-01 | 2001-03-03 | 2001-09-02 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-09-01 | 2005-03-03 | 2005-09-02 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-09-01 | 2009-03-03 | 2009-09-02 | $7700.00 | Window Closed / Lapsed |