US6580754B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Video compression for multicast environments using spatial scalability and simulcast coding
Assignee: Google Technology Holdings LLC
•
Filing: 2000-04-10
•
Granted: 2003-06-17
•
Expires: 2020-04-10
Abstract
Abstract An optimal system for determining whether simulcast coding (400) or spatial scalability coding (100) should be used to encode video for clients with a specific communication link. Operating points (A', B', C') for both simulcast coding and spatial scalability are also determined. Adaptive switching (3130, 3140) is provided, with the operating points and decision boundaries being used to guide the switching to optimize the quality of the higher-resolution data based on a bit allocation to the associated lower-resolution data. A system for determining the point (A', C') of equal quality in both layers of simulcast and spatial scalability coding is also provided. The proportion of bits allocated to the base layer to achieve equal quality is essentially independent of the total bit rate for both simulcast and spatial scalability.
Inventors
- 👤 Wade K. Wan
- 👤 Xuemin Chen
- 👤 Ajay Luthra
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 11:19
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/10; H04N19/134; H04N19/154; H04N21/00; H04N21/60; H04N21/63; H04N21/64; H04N21/6405; H04N19/102; H04N19/12; H04N19/20; H04N19/29; H04N19/30; H04N19/33; H04N21/20; H04N21/23; H04N21/234; H04N21/2343; H04N21/234327; H04N21/23439; H04N21/25; H04N21/266; H04N21/2662; H04N21/40; H04N21/45; H04N21/4508; H04N21/4516; H04N21/454
Claims Analysis
Total Claims: 54
Claim 1
Independent Claim
101 words
A method for coding video data, comprising the steps of: modeling a quality of lower resolution video data and of corresponding higher resolution video data at varying bit allocations between the lower and higher resolution video data; determining a crossover point of the modeled qualities at which the lower and higher resolution video data have an approximately equal quality, said crossover point indicating a corresponding bit allocation between said lower and higher resolution video data; and coding the video data in accordance with the corresponding bit allocation to provide said lower and higher resolution video data at approximately equal quality levels.
Claim 2
Independent Claim
101 words
A method for coding video data, comprising the steps of: modeling a quality of lower resolution video data and of corresponding higher resolution video data at varying bit allocations between the lower and higher resolution video data; determining a crossover point of the modeled qualities at which the lower and higher resolution video data have an approximately equal quality, said crossover point indicating a corresponding bit allocation between said lower and higher resolution video data; and coding the video data in accordance with the corresponding bit allocation to provide said lower and higher resolution video data at approximately equal quality levels.
Claim 3
Dependent Claim
20 words
The method of claim 1 , wherein: the video data coded in said coding step comprises a sequence of pictures.
Claim 4
Dependent Claim
28 words
The method of claim 1 , wherein: the corresponding bit allocation is an average over a sequence of pictures that comprise the lower and higher resolution video data.
Claim 5
Dependent Claim
26 words
The method of claim 1 , wherein: the video data coded in said coding step is different than the video data used in said modeling step.
Claim 6
Dependent Claim
27 words
The method of claim 1 , wherein: the video data coded in said coding step is the same as the video data used in said modeling step.
Claim 7
Dependent Claim
15 words
The method of claim 1 , wherein: the quality comprises a peak signal-to-noise ratio (PSNR).
Claim 8
Dependent Claim
14 words
The method of claim 1 , wherein: said modeling step uses a logarithmic model.
Claim 9
Dependent Claim
16 words
The method of claim 1 , wherein: the coded-video data is coded in independent simulcast streams.
Claim 10
Dependent Claim
27 words
The method of claim 1 , wherein: the coded video data is coded using spatial scalability coding in a base layer and at least one enhancement layer.
Claim 11
Dependent Claim
18 words
The method of claim 1 , wherein: the crossover point is determined in accordance with a bisection algorithm.
Claim 12
Dependent Claim
12 words
The method of claim 1 , wherein: the crossover point is extrapolated.
Claim 13
Independent Claim
92 words
A method for coding video data, comprising the steps of: modeling a quality of lower resolution video data, and of corresponding higher resolution video data, for varying bit allocations between the lower and higher resolution video data, by using each of: (a) simulcast coding, and (b) spatial scalability coding; and coding the video data at a desired bit allocation for the lower and higher resolution video data using one of the simulcast coding and the spatial scalability coding according to whichever results in a larger modeled quality at the desired bit allocation.
Claim 14
Independent Claim
92 words
A method for coding video data, comprising the steps of: modeling a quality of lower resolution video data, and of corresponding higher resolution video data, for varying bit allocations between the lower and higher resolution video data, by using each of: (a) simulcast coding, and (b) spatial scalability coding; and coding the video data at a desired bit allocation for the lower and higher resolution video data using one of the simulcast coding and the spatial scalability coding according to whichever results in a larger modeled quality at the desired bit allocation.
Claim 15
Dependent Claim
15 words
The method of claim 12 , wherein: the video data comprises a sequence of pictures.
Claim 16
Dependent Claim
28 words
The method of claim 12 , wherein: the desired bit allocation is an average over a sequence of pictures that comprise the lower and higher resolution video data.
Claim 17
Dependent Claim
26 words
The method of claim 12 , wherein: the video data coded in said coding step is different than the video data used in said modeling step.
Claim 18
Dependent Claim
27 words
The method of claim 12 , wherein: the video data coded in said coding step is the same as the video data used in said modeling step.
Claim 19
Dependent Claim
16 words
The method of claim 12 , wherein: the modeled qualities comprise a peak signal-to-noise ratio (PSNR).
Claim 20
Dependent Claim
14 words
The method of claim 12 , wherein: said modeling step uses a logarithmic model.
Claim 21
Independent Claim
154 words
A method for coding video data, comprising the steps of: (a) determining a bit allocation decision boundary for varying bit allocations for lower resolution video data; wherein, for the varying bit allocations for the lower resolution video data, the decision boundary designates a bit allocation for corresponding higher resolution video data; (b) determining an operating point for the video data based on desired bit allocations for lower resolution video data thereof and corresponding higher resolution video data thereof; (c) coding the video data using simulcast coding if the operating point indicates the desired bit allocation of the higher resolution video data of said step (b) exceeds a bit allocation designated by the decision boundary; and (d) coding the video data using spatial scalability coding if the operating point indicates the desired bit allocation of the higher resolution video data of said step (b) is less than a bit allocation designated by the decision boundary.
Claim 22
Independent Claim
154 words
A method for coding video data, comprising the steps of: (a) determining a bit allocation decision boundary for varying bit allocations for lower resolution video data; wherein, for the varying bit allocations for the lower resolution video data, the decision boundary designates a bit allocation for corresponding higher resolution video data; (b) determining an operating point for the video data based on desired bit allocations for lower resolution video data thereof and corresponding higher resolution video data thereof; (c) coding the video data using simulcast coding if the operating point indicates the desired bit allocation of the higher resolution video data of said step (b) exceeds a bit allocation designated by the decision boundary; and (d) coding the video data using spatial scalability coding if the operating point indicates the desired bit allocation of the higher resolution video data of said step (b) is less than a bit allocation designated by the decision boundary.
Claim 23
Dependent Claim
49 words
The method of claim 19 , wherein: the decision boundary corresponds to a bit allocation of approximately 20% of an available bandwidth to the lower resolution video data in said step (a) and approximately 80% of the available bandwidth to the higher resolution video data in said step (a).
Claim 24
Dependent Claim
15 words
The method of claim 19 , wherein: the video data comprises a sequence of pictures.
Claim 25
Dependent Claim
22 words
The method of claim 21 , wherein: the desired bit allocations in said step (b) are averages over the sequence of pictures.
Claim 26
Dependent Claim
26 words
The method of claim 19 , wherein: the video data coded in said coding steps is different from the video data used in said step (a).
Claim 27
Dependent Claim
27 words
The method of claim 19 , wherein: the video data coded in said coding steps is the same as the video data used in said step (a).
Claim 28
Independent Claim
85 words
A method for coding video data comprising lower resolution data and corresponding higher resolution data, comprising the steps of: (a) allocating a first portion of an available bandwidth to the lower resolution data, and a remainder of the available bandwidth to the higher resolution data; and (b) coding the video data using simulcast coding if the first portion is less than approximately 20% of the available bandwidth, and using spatial scalability coding if the first portion is greater than approximately 20% of the available bandwidth.
Claim 29
Independent Claim
85 words
A method for coding video data comprising lower resolution data and corresponding higher resolution data, comprising the steps of: (a) allocating a first portion of an available bandwidth to the lower resolution data, and a remainder of the available bandwidth to the higher resolution data; and (b) coding the video data using simulcast coding if the first portion is less than approximately 20% of the available bandwidth, and using spatial scalability coding if the first portion is greater than approximately 20% of the available bandwidth.
Claim 30
Independent Claim
66 words
A method for coding video data comprising lower resolution data and corresponding higher resolution data, comprising the step of: allocating approximately 36-44% of an available bandwidth to the lower resolution data, and a remainder of the available bandwidth to the higher resolution data to achieve an approximately equal quality for the lower and higher resolution data when said lower and higher resolution data are simulcast coded.
Claim 31
Independent Claim
66 words
A method for coding video data comprising lower resolution data and corresponding higher resolution data, comprising the step of: allocating approximately 36-44% of an available bandwidth to the lower resolution data, and a remainder of the available bandwidth to the higher resolution data to achieve an approximately equal quality for the lower and higher resolution data when said lower and higher resolution data are simulcast coded.
Claim 32
Dependent Claim
15 words
The method of claim 26 , wherein: the quality comprises a peak signal-to-noise ratio (PSNR).
Claim 33
Independent Claim
67 words
A method for coding video data comprising lower resolution data and corresponding higher resolution data, comprising the step of: allocating approximately 40-50% of an available bandwidth to the lower resolution data, and a remainder of the available bandwidth to the higher resolution data to achieve an approximately equal quality for the lower and higher resolution data when said lower and higher resolution data are spatial scalability coded.
Claim 34
Independent Claim
67 words
A method for coding video data comprising lower resolution data and corresponding higher resolution data, comprising the step of: allocating approximately 40-50% of an available bandwidth to the lower resolution data, and a remainder of the available bandwidth to the higher resolution data to achieve an approximately equal quality for the lower and higher resolution data when said lower and higher resolution data are spatial scalability coded.
Claim 35
Dependent Claim
15 words
The method of claim 28 , wherein: the quality comprises a peak signal-to-noise ratio (PSNR).
Claim 36
Independent Claim
87 words
A method for communicating video data comprising lower resolution data and corresponding higher resolution data to at least a first user via a network that adaptively uses spatial scalability coding and simulcast coding, comprising the step of: configuring a switching device in the network to selectively forward at least one of the lower and higher resolution data to the first user according to which of the spatial scalability coding and the simulcast coding is being used, and according to a data service capacity of the first user.
Claim 37
Independent Claim
87 words
A method for communicating video data comprising lower resolution data and corresponding higher resolution data to at least a first user via a network that adaptively uses spatial scalability coding and simulcast coding, comprising the step of: configuring a switching device in the network to selectively forward at least one of the lower and higher resolution data to the first user according to which of the spatial scalability coding and the simulcast coding is being used, and according to a data service capacity of the first user.
Claim 38
Dependent Claim
87 words
The method of claim 30 , wherein: when the simulcast coding is used, the switching device is configured to: (a) forward the higher resolution data to the first user if a data rate of the higher resolution data is within the data service capacity, and (b) to forward the lower resolution data to the first user if the data rate of the higher resolution data is not within the data service capacity, but a data rate of the lower resolution data is within the data service capacity.
Claim 39
Dependent Claim
83 words
The method of claim 30 , wherein: when spatial scalability coding is used, the switching device is configured to: (a) forward both the higher and lower resolution data to the first user if a combined data rate thereof is within the data service capacity, and (b) to forward the lower resolution data to the first user if the combined data rate is not within the data service capacity, but a data rate of the lower resolution data is within the data service capacity.
Claim 40
Dependent Claim
13 words
The method of claim 30 , wherein: the switching device comprises a router.
Claim 41
Independent Claim
104 words
An apparatus for coding video data, comprising: means for modeling a quality of lower resolution video data and of corresponding higher resolution video data at varying bit allocations between the lower and higher resolution video data; means for determining a crossover point of the modeled qualities at which the lower and higher resolution video data have an approximately equal quality, said crossover point indicating a corresponding bit allocation between said lower and higher resolution video data; and means for coding the video data in accordance with the corresponding bit allocation to provide said lower and higher resolution video data at approximately equal quality levels.
Claim 42
Independent Claim
104 words
An apparatus for coding video data, comprising: means for modeling a quality of lower resolution video data and of corresponding higher resolution video data at varying bit allocations between the lower and higher resolution video data; means for determining a crossover point of the modeled qualities at which the lower and higher resolution video data have an approximately equal quality, said crossover point indicating a corresponding bit allocation between said lower and higher resolution video data; and means for coding the video data in accordance with the corresponding bit allocation to provide said lower and higher resolution video data at approximately equal quality levels.
Claim 43
Independent Claim
93 words
An apparatus for coding video data, comprising: means for modeling a quality of lower resolution video data, and of corresponding higher resolution video data, for varying bit allocations between the lower and higher resolution video data, by using each of: (a) simulcast coding, and (b) spatial scalability coding; and means for coding the video data at a desired bit allocation for the lower and higher resolution video data using one of the simulcast coding and the spatial scalability coding according to whichever results in a larger modeled quality at the desired bit allocation.
Claim 44
Independent Claim
93 words
An apparatus for coding video data, comprising: means for modeling a quality of lower resolution video data, and of corresponding higher resolution video data, for varying bit allocations between the lower and higher resolution video data, by using each of: (a) simulcast coding, and (b) spatial scalability coding; and means for coding the video data at a desired bit allocation for the lower and higher resolution video data using one of the simulcast coding and the spatial scalability coding according to whichever results in a larger modeled quality at the desired bit allocation.
Claim 45
Independent Claim
158 words
An apparatus for coding video data, comprising: (a) means for determining a bit allocation decision boundary for varying bit allocations for lower resolution video data; wherein, for the varying bit allocations for the lower resolution video data, the decision boundary designates a bit allocation for corresponding higher resolution video data; (b) means for determining an operating point for the video data based on desired bit allocations for lower resolution video data thereof and corresponding higher resolution video data thereof; (c) means for coding the video data using simulcast coding if the operating point indicates the desired bit allocation of the higher resolution video data of said means (b) exceeds a bit allocation designated by the decision boundary; and (d) means coding the video data using spatial scalability coding if the operating point indicates the desired bit allocation of the higher resolution video data of said means (b) is less than a bit allocation designated by the decision boundary.
Claim 46
Independent Claim
158 words
An apparatus for coding video data, comprising: (a) means for determining a bit allocation decision boundary for varying bit allocations for lower resolution video data; wherein, for the varying bit allocations for the lower resolution video data, the decision boundary designates a bit allocation for corresponding higher resolution video data; (b) means for determining an operating point for the video data based on desired bit allocations for lower resolution video data thereof and corresponding higher resolution video data thereof; (c) means for coding the video data using simulcast coding if the operating point indicates the desired bit allocation of the higher resolution video data of said means (b) exceeds a bit allocation designated by the decision boundary; and (d) means coding the video data using spatial scalability coding if the operating point indicates the desired bit allocation of the higher resolution video data of said means (b) is less than a bit allocation designated by the decision boundary.
Claim 47
Independent Claim
86 words
An apparatus for coding video data comprising lower resolution data and corresponding higher resolution data, comprising: (a) means for allocating a first portion of an available bandwidth to the lower resolution data, and a remainder of the available bandwidth to the higher resolution data; and (b) means for coding the video data using simulcast coding if the first portion is less than approximately 20% of the available bandwidth, and using spatial scalability coding if the first portion is greater than approximately 20% of the available bandwidth.
Claim 48
Independent Claim
86 words
An apparatus for coding video data comprising lower resolution data and corresponding higher resolution data, comprising: (a) means for allocating a first portion of an available bandwidth to the lower resolution data, and a remainder of the available bandwidth to the higher resolution data; and (b) means for coding the video data using simulcast coding if the first portion is less than approximately 20% of the available bandwidth, and using spatial scalability coding if the first portion is greater than approximately 20% of the available bandwidth.
Claim 49
Independent Claim
65 words
An apparatus for coding video data comprising lower resolution data and corresponding higher resolution data, comprising: means for allocating approximately 36-44% of an available bandwidth to the lower resolution data, and a remainder of the available bandwidth to the higher resolution data to achieve an approximately equal quality for the lower and higher resolution data when said lower and higher resolution data are simulcast coded.
Claim 50
Independent Claim
65 words
An apparatus for coding video data comprising lower resolution data and corresponding higher resolution data, comprising: means for allocating approximately 36-44% of an available bandwidth to the lower resolution data, and a remainder of the available bandwidth to the higher resolution data to achieve an approximately equal quality for the lower and higher resolution data when said lower and higher resolution data are simulcast coded.
Claim 51
Independent Claim
66 words
An apparatus for coding video data comprising lower resolution data and corresponding higher resolution data, comprising: means for allocating approximately 40-50% of an available bandwidth to the lower resolution data, and a remainder of the available bandwidth to the higher resolution data to achieve an approximately equal quality for the lower and higher resolution data when said lower and higher resolution data are spatial scalability coded.
Claim 52
Independent Claim
66 words
An apparatus for coding video data comprising lower resolution data and corresponding higher resolution data, comprising: means for allocating approximately 40-50% of an available bandwidth to the lower resolution data, and a remainder of the available bandwidth to the higher resolution data to achieve an approximately equal quality for the lower and higher resolution data when said lower and higher resolution data are spatial scalability coded.
Claim 53
Independent Claim
86 words
An apparatus for communicating video data comprising lower resolution data and corresponding higher resolution data to at least a first user via a network that adaptively uses spatial scalability coding and simulcast coding, comprising: means for configuring a switching device in the network to selectively forward at least one of the lower and higher resolution data to the first user according to which of the spatial scalability coding and the simulcast coding is being used, and according to a data service capacity of the first user.
Claim 54
Independent Claim
86 words
An apparatus for communicating video data comprising lower resolution data and corresponding higher resolution data to at least a first user via a network that adaptively uses spatial scalability coding and simulcast coding, comprising: means for configuring a switching device in the network to selectively forward at least one of the lower and higher resolution data to the first user according to which of the spatial scalability coding and the simulcast coding is being used, and according to a data service capacity of the first user.
References Cited (Backward Citations)
US6266817B1
Cited
US6111596A
Cited
US6137462A
Cited
US6233017B1
Cited
US6392705B1
Cited
US6292512B1
Cited
US6151362A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-06-16 | 2006-12-16 | 2007-06-17 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-06-16 | 2010-12-16 | 2011-06-17 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-06-16 | 2014-12-16 | 2015-06-17 | $7700.00 | Window Closed / Lapsed |