US6665872B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Latency-based statistical multiplexing
Assignee: Amtran Technology Co Ltd
•
Filing: 2000-01-05
•
Granted: 2003-12-16
•
Expires: 2020-01-05
Abstract
Abstract When two or more different video streams a e compressed for concurrent transmission of multiple compressed video bitstreams over a single shared communication channel, control over both (1) the transmission of data over the shared channel and (2) the compression processing that generates the bitstreams is exercised taking into account the differing levels of latency required for the corresponding video applications. For example, interactive video games typically require lower latency than other video applications such as video streaming, web browsing, and electronic mail. A multiplexer and traffic controller takes these differing latency requirements, along with bandwidth and image fidelity requirements, into account when controlling both traffic flow and compression processing. In addition, an off-line profiling tool analyzes typical video applications off-line in order to generate profiles of different types of video applications that are then accessed in real-time by a call admission manager responsible to controlling the admission of new video application sessions as well as the assignment of admitted applications to specific available video encoders, which themselves may differ in video compression processing power as well as in the degree to which they allow external processors (like the multiplexer and traffic controller) to control their internal compression processing.
Inventors
- 👤 Ravi Krishnamurthy
- 👤 Sriram Sethuraman
- 👤 Xiaobing Lee
- 👤 Tihao Chiang
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-01 13:49
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/20; H04N21/23; H04N21/236; H04N21/2365; H04N19/00; H04N19/10; H04N19/102; H04N19/115; H04N19/124; H04N19/134; H04N19/136; H04N19/14; H04N19/146; H04N19/15; H04N19/152; H04N19/157; H04N19/159; H04N19/169; H04N19/17; H04N19/172; H04N19/177; H04N19/179; H04N19/42; H04N19/60; H04N19/61; H04N21/23655; H04N21/238; H04N21/40; H04N21/43; H04N21/434; H04N21/4347; H04N19/149
Claims Analysis
Total Claims: 43
Claim 1
Independent Claim
122 words
A method for controlling transmission over a shared communication channel of multiple compressed video bitstreams generated by a plurality of video encoders and corresponding to multiple video applications, comprising the steps of: (a) receiving information for each compressed video bitstream wherein at least two of the video applications have different latency requirements; (b) controlling the transmission of data from the multiple compressed video bitstreams over the shared communication channel taking into account the information for each compressed video bitstream and the latency requirement of each corresponding video application; and (c) adaptively controlling compression processing of at least one of the video encoders taking into account the information for the corresponding compressed video bitstream and the latency requirement of the corresponding video application.
Claim 2
Independent Claim
122 words
A method for controlling transmission over a shared communication channel of multiple compressed video bitstreams generated by a plurality of video encoders and corresponding to multiple video applications, comprising the steps of: (a) receiving information for each compressed video bitstream wherein at least two of the video applications have different latency requirements; (b) controlling the transmission of data from the multiple compressed video bitstreams over the shared communication channel taking into account the information for each compressed video bitstream and the latency requirement of each corresponding video application; and (c) adaptively controlling compression processing of at least one of the video encoders taking into account the information for the corresponding compressed video bitstream and the latency requirement of the corresponding video application.
Claim 3
Dependent Claim
40 words
The invention of claim 1 , wherein at least two of the video applications have different bandwidth requirements and steps (b) and (c) are both implemented taking into account the bandwidth requirement of one or more of the video applications.
Claim 4
Dependent Claim
32 words
The invention of claim 1 , further comprising the step of (d) controlling admission of a new video application for transmission of a corresponding compressed video bitstream over the shared communication channel.
Claim 5
Dependent Claim
57 words
The invention of claim 3 , wherein step (d) comprises the steps of: (1) receiving a classification for the new video application; (2) accessing results from off-line profiling of typical video streams corresponding to the classification for the new video application; and (3) determining whether to admit the new video application based on the off-line profiling results.
Claim 6
Dependent Claim
45 words
The invention of claim 4 , wherein step (d) further comprises the step of (4) assigning the new video application to an appropriate one of a set of available video encoders, wherein at least two of the available video encoders have different video compression capabilities.
Claim 7
Dependent Claim
25 words
The invention of claim 5 , wherein the different video compression capabilities include different levels of external control over video compression processing in step (c).
Claim 8
Dependent Claim
20 words
The invention of claim 5 , wherein the different video compression capabilities include different levels of video compression processing power.
Claim 9
Dependent Claim
138 words
The invention of claim 4 , wherein: each video applications is categorized as being either: a C1 application having relatively high bandwidth and relatively low latency requirements; a C2 application having relatively intermediate bandwidth and relatively intermediate latency requirements; or a C3 application having relatively high latency requirements; and step (d)(3) comprises the step of admitting the new application if and only if both of the following two rules would be satisfied after admitting the new video application: (i) a sum of peak bandwidths for all C1 applications+a sum of the average bandwidths for all C2 applications is less than a total bandwidth of the shared communication channel; (ii) a sum of average bit rates of all applications is less than the total bandwidth of the shared communication channel; and (iii)encoding resources are available for the new application.
Claim 10
Dependent Claim
152 words
The invention of claim 4 , wherein: each video applications is categorized as being either: a C1 application having relatively high bandwidth and relatively low latency requirements; a C2 application having relatively intermediate bandwidth and relatively intermediate latency requirements; or a C3 application having relatively high latency requirements; and step (d)(3) comprises the step of admitting the new application if and only if both of the following two rules would be satisfied after admitting the new video application: (i) maximum of a sum of peak bandwidths of concurrent I frames possible at a time based on GOP structures for C1 applications+a sum of average bandwidths of all C2 and C3 applications is less than a total bandwidth of the shared communication channel; (ii) a sum of average bit rates of all applications is less than the total bandwidth of the shared communication channel; and (iii)encoding resources are available for the new application.
Claim 11
Dependent Claim
19 words
The invention of claim 1 , wherein at least two of the video encoders have different video compression capabilities.
Claim 12
Dependent Claim
25 words
The invention of claim 10 , wherein the different video compression capabilities include different levels of external control over video compression processing in step (c).
Claim 13
Dependent Claim
20 words
The invention of claim 10 , wherein the different video compression capabilities include different levels of video compression processing power.
Claim 14
Dependent Claim
60 words
The invention of claim 1 , wherein the processing of at least two of the video encoders is staggered within a frame time and step (c) comprise the step of controlling the process of encoding at least one compressed video bitstream taking into account the information for at least one other compressed video bitstream earlier in the same frame time.
Claim 15
Dependent Claim
41 words
The invention of claim 1 , further comprising the step of (d) performing off-line profiling of typical video streams corresponding to different classifications of video applications to generate profiling results for use during at least one of steps (b) and (c).
Claim 16
Dependent Claim
23 words
The invention of claim 14 , wherein step (d) comprises the step of characterizing a level of interactivity for each typical video stream.
Claim 17
Dependent Claim
27 words
The invention of claim 14 , wherein step (d) comprises the step of characterizing a desired level of video compression processing power for each typical video stream.
Claim 18
Dependent Claim
52 words
The invention of claim 16 , wherein step (d) further comprises the steps of (1) identifying a class of video encoders for each typical video stream based on the desired level of video compression processing power and (2) characterizing a level of external control provided by the identified class of video encoders.
Claim 19
Dependent Claim
28 words
The invention of claim 14 , wherein the profiling results are used during step (b) to determine an acceptable level of buffering for at least one video application.
Claim 20
Dependent Claim
24 words
The invention of claim 14 , wherein the profiling results are used during step (b) to order packets of data from different video applications.
Claim 21
Dependent Claim
20 words
The invention of claim 1 , wherein step (b) comprises the step of dropping data from a compressed video bitstream.
Claim 22
Dependent Claim
29 words
The invention of claim 20 , wherein step (c) comprises the step of instructing a corresponding video encoder to take into account the data dropping for subsequent compression processing.
Claim 23
Dependent Claim
28 words
The invention of claim 21 , wherein the corresponding video encoder retains a previous reference frame to take into account the data dropping during the subsequent compression processing.
Claim 24
Dependent Claim
28 words
The invention of claim 20 , wherein step (b) further comprises the step of inserting skip codes into the compressed video bitstream in place of the dropped data.
Claim 25
Dependent Claim
52 words
The invention of claim 1 , wherein step (b) comprises the steps of: (1) delaying transmission of one or more frames from a compressed video bitstream during periods of high channel bandwidth usage; and (2) dropping one or more P frames before the next I frame to re-acquire a desirable latency level.
Claim 26
Dependent Claim
30 words
The invention of claim 1 , wherein step (c) comprises the step of encoding one or more frames on demand for a video application with a relatively high latency requirement.
Claim 27
Dependent Claim
48 words
The invention of claim 1 , wherein step (b) comprises the step of scheduling transmission of compressed data corresponding to a video application having a relatively high latency requirement to coincide with relatively low-bit-rate periods of one or more other video applications having a relatively low latency requirement.
Claim 28
Dependent Claim
34 words
The invention of claim 26 , wherein step (c) comprises the step of encoding frames on demand for a video application having a relatively high latency requirement to achieve the scheduling of step (b).
Claim 29
Dependent Claim
23 words
The invention of claim 27 , wherein step (c) further comprises the step of requesting frame types for one or more video applications.
Claim 30
Dependent Claim
24 words
The invention of claim 1 , wherein step (c) comprises the step of staggering I frames between different video applications over different frame times.
Claim 31
Dependent Claim
44 words
The invention of claim 1 , wherein step (c) comprises the step of instructing compression of a video application to include an adaptive refresh strategy in which intra slices are spread over multiple frames to reduce frequency of bit-rate peaks associated with I frames.
Claim 32
Dependent Claim
28 words
The invention of claim 1 , wherein the latency requirement for a video application can vary over time and step (c) takes the varying latency requirement into account.
Claim 33
Dependent Claim
25 words
The invention of claim 1 , wherein step (c) comprises the step of performing advance bit allocation for one or more of the video applications.
Claim 34
Dependent Claim
31 words
The invention of claim 1 , wherein step (c) comprises the step of changing spatial resolution of a subsequent frame for compression processing of at least one of the video applications.
Claim 35
Dependent Claim
27 words
The invention of claim 1 , wherein step (c) comprises the step of changing frame rate for compression processing of at least one of the video applications.
Claim 36
Dependent Claim
33 words
The invention of claim 1 , wherein step (c) comprises the step of controlling compression processing of at least one of the video applications based on advance information acquired from the video application.
Claim 37
Dependent Claim
33 words
The invention of claim 1 , further comprising the step of instructing at least one of the video applications to delay processing when the latency requirement for the video application is not met.
Claim 38
Dependent Claim
46 words
The invention of claim 1 , wherein step (b) comprises the step of transmitting data from at least one of the compressed video bitstreams based on region-of-interest information for the corresponding video application in order to prioritize data within a frame of the compressed video bitstream.
Claim 39
Dependent Claim
35 words
The invention of claim 37 , wherein step (b) comprises the step of transmitting pre-encoded data instead of the compressed video data for at least one region of the frame in the compressed video bitstream.
Claim 40
Dependent Claim
141 words
A video processing system for controlling transmission of multiple compressed video bitstreams corresponding to multiple video applications over a shared communication channel, comprising: (a) a plurality of video encoders, each configured to generate a different compressed video bitstream for a different video application, wherein at least two of the video applications have different latency requirements; and (b) a controller, configured to: (1) receive the compressed video bitstreams from the video encoders; (2) control the transmission of data from the multiple compressed video bitstreams over the shared communication channel taking into account information for each compressed video bitstream and the latency requirement of each corresponding video application; and (3) adaptively control the compression processing of at least one of the video encoders taking into account the information for the corresponding compressed video bitstream and the latency requirement of the corresponding video application.
Claim 41
Dependent Claim
141 words
A video processing system for controlling transmission of multiple compressed video bitstreams corresponding to multiple video applications over a shared communication channel, comprising: (a) a plurality of video encoders, each configured to generate a different compressed video bitstream for a different video application, wherein at least two of the video applications have different latency requirements; and (b) a controller, configured to: (1) receive the compressed video bitstreams from the video encoders; (2) control the transmission of data from the multiple compressed video bitstreams over the shared communication channel taking into account information for each compressed video bitstream and the latency requirement of each corresponding video application; and (3) adaptively control the compression processing of at least one of the video encoders taking into account the information for the corresponding compressed video bitstream and the latency requirement of the corresponding video application.
Claim 42
Dependent Claim
144 words
A controller for controlling transmission of multiple compressed video bitstreams corresponding to multiple video applications over a shared communication channel, in a video processing system further comprising a plurality of video encoders, each configured to generate a different compressed video bitstream for a different video application, wherein at least two of the video applications have different latency requirements, wherein the controller is configured to: (1) receive the compressed video bitstreams from the video encoders; (2) control the transmission of data from the multiple compressed video bitstreams over the shared communication channel taking into account information for each compressed video bitstream and the latency requirement of each corresponding video application; and (3) adaptively control the compression processing of at least one of the video encoders taking into account the information for the corresponding compressed video bitstream and the latency requirement of the corresponding video application.
Claim 43
Dependent Claim
144 words
A controller for controlling transmission of multiple compressed video bitstreams corresponding to multiple video applications over a shared communication channel, in a video processing system further comprising a plurality of video encoders, each configured to generate a different compressed video bitstream for a different video application, wherein at least two of the video applications have different latency requirements, wherein the controller is configured to: (1) receive the compressed video bitstreams from the video encoders; (2) control the transmission of data from the multiple compressed video bitstreams over the shared communication channel taking into account information for each compressed video bitstream and the latency requirement of each corresponding video application; and (3) adaptively control the compression processing of at least one of the video encoders taking into account the information for the corresponding compressed video bitstream and the latency requirement of the corresponding video application.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-12-15 | 2007-06-16 | 2007-12-16 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-12-15 | 2011-06-16 | 2011-12-16 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-12-15 | 2015-06-16 | 2015-12-16 | $7700.00 | Window Closed / Lapsed |