Patent US6700933B1 successfully refreshed from Google Patents.
← Back to Patent Explorer
US6700933B1 Expired / Lapsed US ⏱️ 0.0 years remaining

System and method with advance predicted bit-plane coding for progressive fine-granularity scalable (PFGS) video coding

Assignee: Microsoft Technology Licensing LLC
•
Filing: 2000-02-15
•
Granted: 2004-03-02
•
Expires: 2020-02-15
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A video encoding scheme employs progressive fine-granularity layered coding to encode video data frames into multiple layers, including a base layer of comparatively low quality video and multiple enhancement layers of increasingly higher quality video. Some of the enhancement layers in a current frame are predicted from at least one same or lower quality layer in a reference frame, whereby the lower quality layer is not necessarily the base layer. Use of multiple reference layers of different quality results in occasional fluctuations in the encoded image data. The video encoding scheme efficiently eliminates such fluctuations by predicting higher quality data from the lower quality data encoded in the base layer and a low quality enhancement layer.

Inventors

  • 👤 Feng Wu
  • 👤 Shipeng Li
  • 👤 Ya-Qin Zhang

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 11:09
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/60; H04N19/625; H04N19/10; H04N19/102; H04N19/103; H04N19/105; H04N19/134; H04N19/157; H04N19/159; H04N19/169; H04N19/18; H04N19/187; H04N19/30; H04N19/34; H04N19/50; H04N19/503; H04N19/61; H04N19/90; H04N19/91

Claims Analysis

Total Claims: 38
Claim 1
Independent Claim 186 words
A method for coding video data according to layered coding techniques in which the video data is represented as multi-layered frames, each frame having multiple layers ranging from a base layer of low quality to enhancement layers of increasingly higher quality, the method comprising: encoding a first bitstream representing a base layer; encoding a second bitstream representing one or more low quality enhancement layers, the encoding comprising: motion compensating an original image using the base layer as a reference to form a low quality predicted image, transforming the low quality predicted image to form low quality predicted coefficients, quantizing the low quality predicted coefficients to form quantized coefficients, dequantizing the quantized coefficients to form dequantized coefficients, deriving low quality residues as a difference between the low quality predicted coefficients and the dequantized coefficients, bit plane coding the low quality residues to form coded low quality residues, and compressing the coded low quality residues using variable length coding; and encoding a third bitstream representing one or more high quality enhancement layers based in part on values predicted from the base layer and the low quality enhancement layer.
Claim 2
Independent Claim 186 words
A method for coding video data according to layered coding techniques in which the video data is represented as multi-layered frames, each frame having multiple layers ranging from a base layer of low quality to enhancement layers of increasingly higher quality, the method comprising: encoding a first bitstream representing a base layer; encoding a second bitstream representing one or more low quality enhancement layers, the encoding comprising: motion compensating an original image using the base layer as a reference to form a low quality predicted image, transforming the low quality predicted image to form low quality predicted coefficients, quantizing the low quality predicted coefficients to form quantized coefficients, dequantizing the quantized coefficients to form dequantized coefficients, deriving low quality residues as a difference between the low quality predicted coefficients and the dequantized coefficients, bit plane coding the low quality residues to form coded low quality residues, and compressing the coded low quality residues using variable length coding; and encoding a third bitstream representing one or more high quality enhancement layers based in part on values predicted from the base layer and the low quality enhancement layer.
Claim 3
Dependent Claim 69 words
A method as recited in claim 1 , wherein the encoding a first bitstream representing a base layer comprises: motion compensating an original image using the base layer as a reference to form a low quality predicted image; transforming the low quality predicted image to form low quality predicted coefficients; quantizing the low quality predicted coefficients to form quantized coefficients; and compressing the quantized coefficients using variable length coding.
Claim 4
Dependent Claim 106 words
A method as recited in claim 1 , wherein the encoding a third bitstream representing one or more high quality enhancement layers comprises: motion compensating an original image using an enhancement layer as a reference to form a high quality predicted image; transforming the high quality predicted image to form a first set of high quality coefficients; predicting a second set of high quality coefficients from the coded low quality residues; deriving high quality residues as a difference between the first and second sets of high quality coefficients; bit plane coding the high quality residues; and compressing the coded high quality residues using variable length coding.
Claim 5
Dependent Claim 60 words
A method as recited in claim 1 , further comprising: decoding the first bitstream representing the base layer; decoding the second bitstream representing one or more low quality enhancement layers; and decoding the third bitstream representing one or more the high quality enhancement layers based in part on values predicted from the base layer and the low quality enhancement layer.
Claim 6
Dependent Claim 23 words
A computer-readable medium having computer-executable instructions, which when executed on a processor, direct a computer to perform the steps of claim 1 .
Claim 7
Independent Claim 278 words
A method for coding video data according to layered coding techniques in which the video data is represented as multi-layered frames, each frame having multiple layers ranging from a base layer of low quality to enhancement layers of increasingly higher quality, the method comprising: encoding a first bitstream representing a base layer; encoding a second bitstream representing one or more low quality enhancement layers; and encoding a third bitstream representing one or more high quality enhancement layers based in part on values predicted from the base layer and the low quality enhancement layer; wherein the encoding a second bitstream representing one or more low quality enhancement layers and the encoding a third bitstream representing one or more high quality enhancement layers comprises: motion compensating an original image using the base layer as a reference to form a low quality predicted image and using an enhancement layer as a reference to form a high quality predicted image, transforming the low quality predicted image to form low quality predicted coefficients and transforming the high quality predicted image to form high quality predicted coefficients, quantizing the low quality predicted coefficients to form quantized coefficients, dequantizing the quantized coefficients to form dequantized coefficients, deriving low quality residues as a difference between the high quality predicted coefficients and the dequantized coefficients, bit plane coding the low quality residues to form coded low quality residues, deriving high quality residues as a difference between the high quality predicted coefficients and the coded low quality residues, bit plane coding the high quality residues to form coded high quality residues, and compressing the coded low quality residues and the coded high quality residues using variable length coding.
Claim 8
Independent Claim 278 words
A method for coding video data according to layered coding techniques in which the video data is represented as multi-layered frames, each frame having multiple layers ranging from a base layer of low quality to enhancement layers of increasingly higher quality, the method comprising: encoding a first bitstream representing a base layer; encoding a second bitstream representing one or more low quality enhancement layers; and encoding a third bitstream representing one or more high quality enhancement layers based in part on values predicted from the base layer and the low quality enhancement layer; wherein the encoding a second bitstream representing one or more low quality enhancement layers and the encoding a third bitstream representing one or more high quality enhancement layers comprises: motion compensating an original image using the base layer as a reference to form a low quality predicted image and using an enhancement layer as a reference to form a high quality predicted image, transforming the low quality predicted image to form low quality predicted coefficients and transforming the high quality predicted image to form high quality predicted coefficients, quantizing the low quality predicted coefficients to form quantized coefficients, dequantizing the quantized coefficients to form dequantized coefficients, deriving low quality residues as a difference between the high quality predicted coefficients and the dequantized coefficients, bit plane coding the low quality residues to form coded low quality residues, deriving high quality residues as a difference between the high quality predicted coefficients and the coded low quality residues, bit plane coding the high quality residues to form coded high quality residues, and compressing the coded low quality residues and the coded high quality residues using variable length coding.
Claim 9
Dependent Claim 81 words
A method as recited in claim 6 , wherein the encoding high quality residues comprises: predicting one or more high quality enhancement layers of the current frame from a high quality enhancement layer of the previous frame; transforming the high quality enhancement layer to form a first set of high quality coefficients; predicting a second set of high quality coefficients from the low quality residues; and forming the high quality residues from the first and second sets of high quality coefficients.
Claim 10
Dependent Claim 62 words
A method as recited in claim 6 , wherein the encoding high quality residues comprises: predicting a high quality enhancement layer of the current frame from a high quality enhancement layer of the previous frame; transforming the high quality enhancement layer to form high quality coefficients; and forming the high quality residues from the high quality coefficients and the low quality residues.
Claim 11
Dependent Claim 23 words
A computer-readable medium having computer-executable instructions, which when executed on a processor, direct a computer to perform the steps of claim 6 .
Claim 12
Independent Claim 115 words
A method for coding video data according to layered coding techniques in which the video data is represented as multi-layered frames, each frame having multiple layers ranging from low quality to increasingly higher quality, the method comprising: predicting layers in a current frame using multiple layers of varying quality in a previous frame; deriving low quality predicted residues from a low quality layer in the current frame and a low quality layer in the previous frame; encoding the low quality predicted residues; and predicting, from the encoded low quality residues, high quality predicted residues representative of differences between a high quality layer in the current frame and a high quality layer in the previous frame.
Claim 13
Independent Claim 115 words
A method for coding video data according to layered coding techniques in which the video data is represented as multi-layered frames, each frame having multiple layers ranging from low quality to increasingly higher quality, the method comprising: predicting layers in a current frame using multiple layers of varying quality in a previous frame; deriving low quality predicted residues from a low quality layer in the current frame and a low quality layer in the previous frame; encoding the low quality predicted residues; and predicting, from the encoded low quality residues, high quality predicted residues representative of differences between a high quality layer in the current frame and a high quality layer in the previous frame.
Claim 14
Dependent Claim 31 words
A method as recited in claim 10 , wherein the predicting layers comprises predicting a higher quality layer in the current frame from a lower quality layer in the previous frame.
Claim 15
Dependent Claim 31 words
A method as recited in claim 10 , wherein the encoding comprises quantizing the low quality predicted residues to produce quantized residues and compressing the quantized residues using variable length coding.
Claim 16
Dependent Claim 20 words
A method as recited in claim 10 , wherein the encoding comprises bit plane coding the low quality predicted residues.
Claim 17
Dependent Claim 31 words
A method as recited in claim 10 , wherein the predicting high quality predicted residues comprises computing a predicted value based on the encoded low quality residues and two predicted images.
Claim 18
Dependent Claim 35 words
A method as recited in claim 10 , wherein the predicting high quality predicted residues comprises computing a predicted value based on two predicted images and an estimation of one of the two predicted images.
Claim 19
Dependent Claim 23 words
A computer-readable medium having computer-executable instructions, which when executed on a processor, direct a computer to perform the steps of claim 10 .
Claim 20
Independent Claim 189 words
A method for coding video data according to layered coding techniques in which the video data is represented as multi-layered frames, each frame having multiple layers ranging from a base layer of low quality to enhancement layers of increasingly higher quality, the method comprising: forming a base layer and multiple enhancement layers in a first frame representing an original image; and predicting, from the base layer and at least one enhancement layer in the first frame, a base layer and multiple enhancement layers in a second frame representing a predicted image; and deriving low quality residues resulting from the predicting of the base layer and low quality enhancement layers from the original image; encoding the low quality residues; and predicting, from the encoded low quality residues, high quality residues indicative of results from predicting high quality enhancement layers from the original image, wherein the multiple enhancement layers include at least first, second, and third layers, and the forming of the multiple enhancement layers comprises predicting even frames from the base and second layers of preceding frames and predicting odd frames from the base and third layers of preceding frames.
Claim 21
Independent Claim 189 words
A method for coding video data according to layered coding techniques in which the video data is represented as multi-layered frames, each frame having multiple layers ranging from a base layer of low quality to enhancement layers of increasingly higher quality, the method comprising: forming a base layer and multiple enhancement layers in a first frame representing an original image; and predicting, from the base layer and at least one enhancement layer in the first frame, a base layer and multiple enhancement layers in a second frame representing a predicted image; and deriving low quality residues resulting from the predicting of the base layer and low quality enhancement layers from the original image; encoding the low quality residues; and predicting, from the encoded low quality residues, high quality residues indicative of results from predicting high quality enhancement layers from the original image, wherein the multiple enhancement layers include at least first, second, and third layers, and the forming of the multiple enhancement layers comprises predicting even frames from the base and second layers of preceding frames and predicting odd frames from the base and third layers of preceding frames.
Claim 22
Dependent Claim 15 words
A method as recited in claim 17 , further comprising encoding the high quality residues.
Claim 23
Dependent Claim 21 words
A method as recited in claim 18 , further comprising transmitting the encoded low quality residues and the high quality residues.
Claim 24
Dependent Claim 23 words
A computer-readable medium having computer-executable instructions, which when executed on a processor, direct a computer to perform the steps of claim 17 .
Claim 25
Independent Claim 242 words
A method for coding video data according to layered coding techniques in which the video data is represented as multi-layered frames, each frame having multiple layers ranging from a base layer of low quality to enhancement layers of increasingly higher quality, the method comprising: forming a base layer and multiple enhancement layers in a first frame representing an original image; and predicting, from the base layer and at least one enhancement layer in the first frame, a base layer and multiple enhancement layers in a second frame representing a predicted image; and deriving low quality residues resulting from the predicting of the base layer and low quality enhancement layers from the original image; encoding the low quality residues; and predicting, from the encoded low quality residues, high quality residues indicative of results from predicting high quality enhancement layers from the original image, wherein the forming of the multiple enhancement layers comprises predicting each of the enhancement layers in a current frame from a lower quality reference layer of a reference frame if a relationship holds true, the relationship being: L mod N=i mod M where L is a variable designating a particular enhancement layer, i is a variable designating a particular frame, N is a variable representing a layer group depth of how many layers are predicted from a common reference layer, and M is a variable representing a frame group depth of how many frames are grouped together for prediction purposes.
Claim 26
Independent Claim 242 words
A method for coding video data according to layered coding techniques in which the video data is represented as multi-layered frames, each frame having multiple layers ranging from a base layer of low quality to enhancement layers of increasingly higher quality, the method comprising: forming a base layer and multiple enhancement layers in a first frame representing an original image; and predicting, from the base layer and at least one enhancement layer in the first frame, a base layer and multiple enhancement layers in a second frame representing a predicted image; and deriving low quality residues resulting from the predicting of the base layer and low quality enhancement layers from the original image; encoding the low quality residues; and predicting, from the encoded low quality residues, high quality residues indicative of results from predicting high quality enhancement layers from the original image, wherein the forming of the multiple enhancement layers comprises predicting each of the enhancement layers in a current frame from a lower quality reference layer of a reference frame if a relationship holds true, the relationship being: L mod N=i mod M where L is a variable designating a particular enhancement layer, i is a variable designating a particular frame, N is a variable representing a layer group depth of how many layers are predicted from a common reference layer, and M is a variable representing a frame group depth of how many frames are grouped together for prediction purposes.
Claim 27
Dependent Claim 204 words
A computer-readable medium having computer-executable instructions, which when executed on a processor, direct a computer to: (A) encode a first bitstream representing a base layer by: motion compensating an original image using a base layer as a reference to form a low quality predicted image; transforming the low quality predicted image to form low quality predicted coefficients; and quantizing the low quality predicted coefficients to form quantized coefficients; (B) encode a second bitstream representing a low quality enhancement layer by: dequantizing the quantized coefficients to form dequantized coefficients; deriving low quality residues as a difference between the low quality predicted coefficients and the dequantized coefficients; and bit plane coding the low quality residues to form coded low quality residues; (C) encode a third bitstream representing a high quality enhancement layer by: motion compensating an original image using an enhancement layer as a reference to form a high quality predicted image; transforming the high quality predicted image to form a first set of high quality coefficients; predicting a second set of high quality coefficients from the coded low quality residues; deriving high quality residues as a difference between the first and second sets of high quality coefficients; and bit plane coding the high quality residues.
Claim 28
Dependent Claim 204 words
A computer-readable medium having computer-executable instructions, which when executed on a processor, direct a computer to: (A) encode a first bitstream representing a base layer by: motion compensating an original image using a base layer as a reference to form a low quality predicted image; transforming the low quality predicted image to form low quality predicted coefficients; and quantizing the low quality predicted coefficients to form quantized coefficients; (B) encode a second bitstream representing a low quality enhancement layer by: dequantizing the quantized coefficients to form dequantized coefficients; deriving low quality residues as a difference between the low quality predicted coefficients and the dequantized coefficients; and bit plane coding the low quality residues to form coded low quality residues; (C) encode a third bitstream representing a high quality enhancement layer by: motion compensating an original image using an enhancement layer as a reference to form a high quality predicted image; transforming the high quality predicted image to form a first set of high quality coefficients; predicting a second set of high quality coefficients from the coded low quality residues; deriving high quality residues as a difference between the first and second sets of high quality coefficients; and bit plane coding the high quality residues.
Claim 29
Dependent Claim 42 words
A computer-readable medium as recited in claim 22 , further comprising computer-executable instructions, which when executed on a processor, direct a computer to compress the quantized coefficients, the coded low quality residues, and the coded high quality residues using variable length coding.
Claim 30
Dependent Claim 183 words
A computer-readable medium having computer-executable instructions, which when executed on a processor, direct a computer to: (A) encode a first bitstream representing a base layer by: motion compensating an original image using a base layer as a reference to form a low quality predicted image; transforming the low quality predicted image to form low quality predicted coefficients; and quantizing the low quality predicted coefficients to form quantized coefficients; (B) encode second and third bitstreams representing a low quality enhancement layer and a high quality enhancement layer by: dequantizing the quantized coefficients to form dequantized coefficients; motion compensating the original image using an enhancement layer as a reference to form a high quality predicted image; transforming the high quality predicted image to form high quality predicted coefficients; deriving low quality residues from the high quality predicted coefficients and the dequantized coefficients; bit plane coding the low quality residues to form coded low quality residues; deriving high quality residues from the high quality predicted coefficients and the coded low quality residues; and bit plane coding the high quality residues to form coded high quality residues.
Claim 31
Dependent Claim 183 words
A computer-readable medium having computer-executable instructions, which when executed on a processor, direct a computer to: (A) encode a first bitstream representing a base layer by: motion compensating an original image using a base layer as a reference to form a low quality predicted image; transforming the low quality predicted image to form low quality predicted coefficients; and quantizing the low quality predicted coefficients to form quantized coefficients; (B) encode second and third bitstreams representing a low quality enhancement layer and a high quality enhancement layer by: dequantizing the quantized coefficients to form dequantized coefficients; motion compensating the original image using an enhancement layer as a reference to form a high quality predicted image; transforming the high quality predicted image to form high quality predicted coefficients; deriving low quality residues from the high quality predicted coefficients and the dequantized coefficients; bit plane coding the low quality residues to form coded low quality residues; deriving high quality residues from the high quality predicted coefficients and the coded low quality residues; and bit plane coding the high quality residues to form coded high quality residues.
Claim 32
Dependent Claim 42 words
A computer-readable medium as recited in claim 24 , further comprising computer-executable instructions, which when executed on a processor, direct a computer to compress the quantized coefficients, the coded low quality residues, and the coded high quality residues using variable length coding.
Claim 33
Dependent Claim 91 words
A video coding system, comprising: means for predicting layers in a current frame using multiple layers of varying quality in a previous frame; means for deriving low quality predicted residues from a low quality layer in the current frame and a low quality layer in the previous frame; means for encoding the low quality predicted residues; and means for predicting, from the encoded low quality residues, high quality predicted residues representative of differences between a high quality layer in the current frame and a high quality layer in the previous frame.
Claim 34
Dependent Claim 91 words
A video coding system, comprising: means for predicting layers in a current frame using multiple layers of varying quality in a previous frame; means for deriving low quality predicted residues from a low quality layer in the current frame and a low quality layer in the previous frame; means for encoding the low quality predicted residues; and means for predicting, from the encoded low quality residues, high quality predicted residues representative of differences between a high quality layer in the current frame and a high quality layer in the previous frame.
Claim 35
Dependent Claim 12 words
An operating system comprising the video coding system of claim 26 .
Claim 36
Dependent Claim 113 words
A video coding system, comprising: means for forming a base layer and multiple enhancement layers in a first frame representing an original image; and means for predicting, from the base layer and at least one enhancement layer in the first frame, a base layer and multiple enhancement layers in a second frame representing a predicted image; and means for deriving low quality residues resulting from the predicting of the base layer and low quality enhancement layers from the original image; means for encoding the low quality residues; and means for predicting, from the encoded low quality residues, high quality residues indicative of results from predicting high quality enhancement layers from the original image.
Claim 37
Dependent Claim 113 words
A video coding system, comprising: means for forming a base layer and multiple enhancement layers in a first frame representing an original image; and means for predicting, from the base layer and at least one enhancement layer in the first frame, a base layer and multiple enhancement layers in a second frame representing a predicted image; and means for deriving low quality residues resulting from the predicting of the base layer and low quality enhancement layers from the original image; means for encoding the low quality residues; and means for predicting, from the encoded low quality residues, high quality residues indicative of results from predicting high quality enhancement layers from the original image.
Claim 38
Dependent Claim 11 words
Operating system comprising the video coding system of claim 28 .

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2007-03-02 2007-09-01 2008-03-02 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2011-03-02 2011-09-01 2012-03-02 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2015-03-02 2015-09-01 2016-03-02 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag