US6480547B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
System and method for encoding and decoding the residual signal for fine granular scalable video
Assignee: LG Electronics Inc
•
Filing: 1999-10-15
•
Granted: 2002-11-12
•
Expires: 2019-10-15
Abstract
Abstract There is disclosed a video encoder and a video decoder. The video encoder comprises base layer circuitry for receiving an input stream of video frames and generating compressed base layer video data for transmission to a streaming video receiver. The base layer video data comprises original transform coefficients (O) associated with the input stream of video frames and reconstructed base layer transform coefficients (B) associated with the original transform coefficients. The video encoder also comprises enhancement layer circuitry for receiving the original transform coefficients (O) and the reconstructed base layer transform coefficients (B) and generating a residual signal (R) proportional to a difference between the original transform coefficients (O) and the reconstructed base layer transform coefficients (B). The enhancement layer circuitry encodes and sends to the streaming video receiver a sign of the residual signal (R) and the bit planes of the residual signal (R). The video decoder comprises base layer circuitry for receiving compressed base layer video data and determining reconstructed base layer transform coefficients (B) associated with a quantization of the base layer video data. The video decoder further comprises enhancement layer circuitry for receiving enhancement layer video data associated with the compressed base layer video data and determining a residual signal (R) and a sign associated with the residual signal (R). The enhancement layer circuitry reconstructs enhancement layer transform coefficients (E) from the residual signal (R) and the plurality of reconstructed base layer transform coefficients (B).
Inventors
- 👤 Yingwei Chen
- 👤 Mihaela van der Schaar
- 👤 Hayder Radha
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 21:18
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/30; H04N19/34; H04N19/20; H04N19/29; H04N19/10; H04N19/102; H04N19/13; H04N19/60; H04N19/61; H04N19/63
Claims Analysis
Total Claims: 54
Claim 1
Independent Claim
148 words
A video encoder comprising: base layer circuitry capable of receiving an input stream of video frames and generating therefrom compressed base layer video data suitable for transmission to a streaming video receiver, said base layer video data comprising a plurality of original transform coefficients (O) associated with said input stream of video frames and a plurality of reconstructed base layer transform coefficients (B) generated by quantizing and de-quantizing said plurality of original transform coefficients (O); and enhancement layer circuitry capable of receiving said plurality of original transform coefficients (O) and said plurality of reconstructed base layer transform coefficients (B) and generating therefrom a residual signal (R) proportional to a difference between said plurality of original transform coefficients (O) and said plurality of reconstructed base layer transform coefficients (B), wherein said enhancement layer circuitry encodes and sends a sign of said residual signal (R) to said streaming video receiver.
Claim 2
Dependent Claim
148 words
A video encoder comprising: base layer circuitry capable of receiving an input stream of video frames and generating therefrom compressed base layer video data suitable for transmission to a streaming video receiver, said base layer video data comprising a plurality of original transform coefficients (O) associated with said input stream of video frames and a plurality of reconstructed base layer transform coefficients (B) generated by quantizing and de-quantizing said plurality of original transform coefficients (O); and enhancement layer circuitry capable of receiving said plurality of original transform coefficients (O) and said plurality of reconstructed base layer transform coefficients (B) and generating therefrom a residual signal (R) proportional to a difference between said plurality of original transform coefficients (O) and said plurality of reconstructed base layer transform coefficients (B), wherein said enhancement layer circuitry encodes and sends a sign of said residual signal (R) to said streaming video receiver.
Claim 3
Dependent Claim
27 words
The video encoder set forth in claim 1 wherein said base layer circuitry comprises a transform circuit capable of generating said plurality of original transform coefficients (O).
Claim 4
Dependent Claim
19 words
The video encoder set forth in claim 2 wherein said transform circuit is a discrete cosine transform (DCT) circuit.
Claim 5
Dependent Claim
42 words
The video encoder set forth in claim 1 wherein said base layer circuitry comprises a quantization circuit and an inverse quantization circuit capable of generating from said plurality of original transform coefficients (O) said plurality of reconstructed base layer transform coefficients (B).
Claim 6
Dependent Claim
38 words
The video encoder set forth in claim 1 wherein said enhancement layer circuitry comprises a residual computation circuit capable of comparing said plurality of original transform coefficients (O) and said plurality of reconstructed base layer transform coefficients (B).
Claim 7
Dependent Claim
106 words
A video decoder comprising: base layer circuitry capable of receiving compressed base layer video data and determining therefrom a plurality of reconstructed base layer transform coefficients (B) associated with a quantization of said compressed base layer video data; and enhancement layer circuitry capable of receiving enhancement layer video data associated with said compressed base layer video data and determining therefrom a residual signal (R) and a sign associated with said residual signal (R), wherein said enhancement layer circuitry is further capable of reconstructing a plurality of enhancement layer transform coefficients (E) from said residual signal (R) and said plurality of reconstructed base layer transform coefficients (B).
Claim 8
Dependent Claim
106 words
A video decoder comprising: base layer circuitry capable of receiving compressed base layer video data and determining therefrom a plurality of reconstructed base layer transform coefficients (B) associated with a quantization of said compressed base layer video data; and enhancement layer circuitry capable of receiving enhancement layer video data associated with said compressed base layer video data and determining therefrom a residual signal (R) and a sign associated with said residual signal (R), wherein said enhancement layer circuitry is further capable of reconstructing a plurality of enhancement layer transform coefficients (E) from said residual signal (R) and said plurality of reconstructed base layer transform coefficients (B).
Claim 9
Dependent Claim
39 words
The video decoder set forth in claim 6 wherein said enhancement layer circuitry comprises an inverse transform circuit capable of generating from said plurality of reconstructed enhancement layer transform coefficients (E) a plurality of decompressed enhancement layer video frames.
Claim 10
Dependent Claim
21 words
The video decoder set forth in claim 7 wherein said inverse transform circuit is an inverse discrete cosine transform (IDCT) circuit.
Claim 11
Dependent Claim
34 words
The video decoder set forth in claim 6 wherein said enhancement layer circuitry comprises a computation circuit capable of adding said residual signal (R) and said plurality of reconstructed base layer transform coefficients (B).
Claim 12
Dependent Claim
43 words
The video decoder set forth in claim 6 wherein said enhancement layer circuitry comprises an enhancement layer decoding circuit capable of receiving said enhancement layer video data and determining therefrom said residual signal (R) and said sign associated with said residual signal (R).
Claim 13
Dependent Claim
173 words
For use in a video encoder comprising 1) base layer circuitry capable of receiving an input stream of video frames and generating therefrom compressed base layer video data suitable for transmission to a streaming video receiver and 2) enhancement layer circuitry capable of generating therefrom enhancement layer video data associated with the compressed base layer video data and suitable for transmission to the streaming video receiver, a method of operating the video encoder comprising the steps of: generating a plurality of original transform coefficients (O) associated with the input stream of video frames; generating a plurality of reconstructed base layer transform coefficients (B) by quantizing and de-quantizing the plurality of original transform coefficients; generating from the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B) a residual signal (R) proportional to a difference between the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B); and encoding and sending a sign of the residual signal to the streaming video receiver.
Claim 14
Dependent Claim
173 words
For use in a video encoder comprising 1) base layer circuitry capable of receiving an input stream of video frames and generating therefrom compressed base layer video data suitable for transmission to a streaming video receiver and 2) enhancement layer circuitry capable of generating therefrom enhancement layer video data associated with the compressed base layer video data and suitable for transmission to the streaming video receiver, a method of operating the video encoder comprising the steps of: generating a plurality of original transform coefficients (O) associated with the input stream of video frames; generating a plurality of reconstructed base layer transform coefficients (B) by quantizing and de-quantizing the plurality of original transform coefficients; generating from the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B) a residual signal (R) proportional to a difference between the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B); and encoding and sending a sign of the residual signal to the streaming video receiver.
Claim 15
Dependent Claim
26 words
The method set forth in claim 11 wherein the base layer circuitry comprises a transform circuit capable of generating the plurality of original transform coefficients (O).
Claim 16
Dependent Claim
21 words
The method set forth in claim 12 wherein the plurality of original transform coefficients (O) are discrete cosine transform (DCT) coefficients.
Claim 17
Dependent Claim
42 words
The method set forth in claim 11 wherein the step of generating a plurality of original transform coefficients (O) comprises the sub-steps of quantizing and de-quantizing the input stream of video frames to thereby generate the plurality of original transform coefficients (O).
Claim 18
Dependent Claim
38 words
The method set forth in claim 11 wherein the step of generating the residual signal (R) comprises the step of comparing the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B).
Claim 19
Dependent Claim
124 words
For use in a video decoder comprising 1) base layer circuitry capable of receiving compressed base layer video data, and 2) enhancement layer circuitry capable of receiving enhancement layer video data associated with the compressed base layer video data, a method of operating the video decoder comprising the steps of: determining from the compressed base layer video data a plurality of reconstructed base layers transform coefficients (B) associated with a quantization of the compressed base layer video data; and determining from the enhancement layer video data a residual signal (R) and a sign associated with the residual signal (R); and reconstructing a plurality of enhancement layer transform coefficients (E) from the residual signal (R) and the plurality of reconstructed base layer transform coefficients (B).
Claim 20
Dependent Claim
124 words
For use in a video decoder comprising 1) base layer circuitry capable of receiving compressed base layer video data, and 2) enhancement layer circuitry capable of receiving enhancement layer video data associated with the compressed base layer video data, a method of operating the video decoder comprising the steps of: determining from the compressed base layer video data a plurality of reconstructed base layers transform coefficients (B) associated with a quantization of the compressed base layer video data; and determining from the enhancement layer video data a residual signal (R) and a sign associated with the residual signal (R); and reconstructing a plurality of enhancement layer transform coefficients (E) from the residual signal (R) and the plurality of reconstructed base layer transform coefficients (B).
Claim 21
Dependent Claim
38 words
The method set forth in claim 16 wherein the enhancement layer circuitry comprises an inverse transform circuit capable of generating from the plurality of reconstructed enhancement layer transform coefficients (E) a plurality of decompressed enhancement layer video frames.
Claim 22
Dependent Claim
20 words
The method set forth in claim 17 wherein the inverse transform circuit is an inverse discrete cosine transform (IDCT) circuit.
Claim 23
Dependent Claim
31 words
The method set forth in claim 16 wherein the step of reconstructing comprises the step of adding the residual signal (R) and the plurality of reconstructed base layer transform coefficients (B).
Claim 24
Dependent Claim
42 words
The method set forth in claim 16 wherein the step of determining the residual signal comprises the step of decoding the received enhancement layer video data and determining therefrom the residual signal (R) and the sign associated with the residual signal (R).
Claim 25
Dependent Claim
138 words
A television receiver comprising: a decoder buffer capable of receiving and storing compressed base layer video data and compressed enhancement layer video data; and a video decoder coupled to said decoder buffer comprising: base layer circuitry capable of receiving said compressed base layer video data and determining therefrom a plurality of reconstructed base layer transform coefficients (B) associated with a quantization of said compressed base layer video data; and enhancement layer circuitry capable of receiving said compressed enhancement layer video data associated with said compressed base layer video data and determining therefrom a residual signal (R) and a sign associated with said residual signal (R), wherein said enhancement layer circuitry is further capable of reconstructing a plurality of enhancement layer transform coefficients (E) from said residual signal (R) and said plurality of reconstructed base layer transform coefficients (B).
Claim 26
Dependent Claim
138 words
A television receiver comprising: a decoder buffer capable of receiving and storing compressed base layer video data and compressed enhancement layer video data; and a video decoder coupled to said decoder buffer comprising: base layer circuitry capable of receiving said compressed base layer video data and determining therefrom a plurality of reconstructed base layer transform coefficients (B) associated with a quantization of said compressed base layer video data; and enhancement layer circuitry capable of receiving said compressed enhancement layer video data associated with said compressed base layer video data and determining therefrom a residual signal (R) and a sign associated with said residual signal (R), wherein said enhancement layer circuitry is further capable of reconstructing a plurality of enhancement layer transform coefficients (E) from said residual signal (R) and said plurality of reconstructed base layer transform coefficients (B).
Claim 27
Dependent Claim
39 words
The television receiver set forth in claim 21 wherein said enhancement layer circuitry comprises an inverse transform circuit capable of generating from said plurality of reconstructed enhancement layer transform coefficients (E) a plurality of decompressed enhancement layer video frames.
Claim 28
Dependent Claim
21 words
The television receiver set forth in claim 22 wherein said inverse transform circuit is an inverse discrete cosine transform (IDCT) circuit.
Claim 29
Dependent Claim
34 words
The television receiver set forth in claim 21 wherein said enhancement layer circuitry comprises a computation circuit capable of adding said residual signal (R) and said plurality of reconstructed base layer transform coefficients (B).
Claim 30
Dependent Claim
43 words
The television receiver set forth in claim 21 wherein said enhancement layer circuitry comprises an enhancement layer decoding circuit capable of receiving said enhancement layer video data and determining therefrom said residual signal (R) and said sign associated with said residual signal (R).
Claim 31
Dependent Claim
127 words
For use in a video processing system capable of receiving compressed base layer video data and enhancement layer video data associated with the compressed base layer video data, computer-executable process steps stored on a computer-readable storage medium for decoding the enhancement layer video data, the computer executable process steps comprising the steps of: determining from the compressed base layer video data a plurality of reconstructed base layer transform coefficients (B) associated with a quantization of the compressed base layer video data; and determining from the enhancement layer video data a residual signal (R) and a sign associated with the residual signal (R); and reconstructing a plurality of enhancement layer transform coefficients (E) from the residual signal (R) and the plurality of reconstructed base layer transform coefficients (B).
Claim 32
Dependent Claim
127 words
For use in a video processing system capable of receiving compressed base layer video data and enhancement layer video data associated with the compressed base layer video data, computer-executable process steps stored on a computer-readable storage medium for decoding the enhancement layer video data, the computer executable process steps comprising the steps of: determining from the compressed base layer video data a plurality of reconstructed base layer transform coefficients (B) associated with a quantization of the compressed base layer video data; and determining from the enhancement layer video data a residual signal (R) and a sign associated with the residual signal (R); and reconstructing a plurality of enhancement layer transform coefficients (E) from the residual signal (R) and the plurality of reconstructed base layer transform coefficients (B).
Claim 33
Dependent Claim
39 words
The computer-executable process steps stored on a computer-readable storage medium set forth in claim 26 including the further step of generating from the plurality of reconstructed enhancement layer transform coefficients (E) a plurality of decompressed enhancement layer video frames.
Claim 34
Dependent Claim
39 words
The computer-executable process steps stored on a computer-readable storage medium set forth in claim 27 wherein the step of generating the plurality of decompressed enhancement layer video frames comprises inverse transforming the plurality of reconstructed enhancement layer transform coefficients.
Claim 35
Dependent Claim
31 words
The computer-executable process steps stored on a computer-readable storage medium set forth in claim 28 wherein step of inverse transforming comprises the step of performing an inverse discrete cosine transform (IDCT).
Claim 36
Dependent Claim
39 words
The computer-executable process steps stored on a computer-readable storage medium set forth in claim 26 wherein the step of reconstructing comprises the step of adding the residual signal (R) and the plurality of reconstructed base layer transform coefficients (B).
Claim 37
Dependent Claim
173 words
A video system comprising: a television receiver comprising: a decoder buffer capable of receiving and storing compressed base layer video data and compressed enhancement layer video data; and a video decoder coupled to said decoder buffer comprising: base layer circuitry capable of receiving said compressed base layer video data and determining therefrom a plurality of reconstructed base layer transform coefficients (B) associated with a quantization of said compressed base layer video data; and enhancement layer circuitry capable of receiving compressed enhancement layer video data associated with said compressed base layer video data and determining therefrom a residual signal (R) and a sign associated with said residual signal (R), wherein said enhancement layer circuitry is further capable of reconstructing a plurality of enhancement layer transform coefficients (E) from said residual signal (R) and said plurality of reconstructed base layer transform coefficients (B); and a video display coupled to said television receiver for displaying video images derived from said base layer video data and said enhancement layer video data containing said inserted all-zero bit plane.
Claim 38
Dependent Claim
173 words
A video system comprising: a television receiver comprising: a decoder buffer capable of receiving and storing compressed base layer video data and compressed enhancement layer video data; and a video decoder coupled to said decoder buffer comprising: base layer circuitry capable of receiving said compressed base layer video data and determining therefrom a plurality of reconstructed base layer transform coefficients (B) associated with a quantization of said compressed base layer video data; and enhancement layer circuitry capable of receiving compressed enhancement layer video data associated with said compressed base layer video data and determining therefrom a residual signal (R) and a sign associated with said residual signal (R), wherein said enhancement layer circuitry is further capable of reconstructing a plurality of enhancement layer transform coefficients (E) from said residual signal (R) and said plurality of reconstructed base layer transform coefficients (B); and a video display coupled to said television receiver for displaying video images derived from said base layer video data and said enhancement layer video data containing said inserted all-zero bit plane.
Claim 39
Dependent Claim
39 words
The video system set forth in claim 31 wherein said enhancement layer circuitry comprises an inverse transform circuit capable of generating from said plurality of reconstructed enhancement layer transform coefficients (E) a plurality of decompressed enhancement layer video frames.
Claim 40
Dependent Claim
21 words
The video system set forth in claim 32 wherein said inverse transform circuit is an inverse discrete cosine transform (IDCT) circuit.
Claim 41
Dependent Claim
34 words
The video system set forth in claim 31 wherein said enhancement layer circuitry comprises a computation circuit capable of adding said residual signal (R) and said plurality of reconstructed base layer transform coefficients (B).
Claim 42
Dependent Claim
43 words
The video system set forth in claim 31 wherein said enhancement layer circuitry comprises an enhancement layer decoding circuit capable of receiving said enhancement layer video data and determining therefrom said residual signal (R) and said sign associated with said residual signal (R).
Claim 43
Dependent Claim
144 words
A transmittable enhancement layer video signal produced by the steps of: receiving in base layer circuitry of a video encoder an input stream of video frames and generating therefrom compressed base layer video data suitable for transmission to a streaming video receiver; generating a plurality of original transform coefficients (O) associated with the input stream of video frames; generating a plurality of reconstructed base layer transform coefficients (B) associated with the plurality of original transform coefficients (O); generating from the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B) a residual signal (R) proportional to a difference between the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B); and encoding a sign of the residual signal and encoding the residual signal to thereby create the transmittable enhancement layer video signal.
Claim 44
Dependent Claim
144 words
A transmittable enhancement layer video signal produced by the steps of: receiving in base layer circuitry of a video encoder an input stream of video frames and generating therefrom compressed base layer video data suitable for transmission to a streaming video receiver; generating a plurality of original transform coefficients (O) associated with the input stream of video frames; generating a plurality of reconstructed base layer transform coefficients (B) associated with the plurality of original transform coefficients (O); generating from the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B) a residual signal (R) proportional to a difference between the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B); and encoding a sign of the residual signal and encoding the residual signal to thereby create the transmittable enhancement layer video signal.
Claim 45
Dependent Claim
30 words
The transmittable enhancement layer video signal set forth in claim 36 wherein the base layer circuitry comprises a transform circuit capable of generating the plurality of original transform coefficients (O).
Claim 46
Dependent Claim
25 words
The transmittable enhancement layer video signal set forth in claim 37 wherein the plurality of original transform coefficients (O) are discrete cosine transform (DCT) coefficients.
Claim 47
Dependent Claim
45 words
The transmittable enhancement layer video signal set forth in claim 36 the step of generating a plurality of original transform coefficients (O) comprises the sub-steps of quantizing and de-quantizing the input stream of video frames to thereby generate the plurality of original transform coefficients (O).
Claim 48
Dependent Claim
42 words
The transmittable enhancement layer video signal set forth in claim 36 wherein the step of generating the residual signal (R) comprises the step of comparing the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B).
Claim 49
Dependent Claim
196 words
A network system comprising: at least one streaming video receiver; a streaming video transmitter comprising: video encoder comprising: base layer circuitry capable of receiving an input stream of video frames and generating therefrom compressed base layer video data suitable for transmission to said at least one streaming video receiver, said base layer video data comprising a plurality of original transform coefficients (O) associated with said input stream of video frames and a plurality of reconstructed base layer transform coefficients (B) associated with said plurality of original transform coefficients; and enhancement layer circuitry capable of receiving said plurality of original transform coefficients (O) and said plurality of reconstructed base layer transform coefficients (B) and generating therefrom a residual signal (R) proportional to a difference between said plurality of original transform coefficients (O) and said plurality of reconstructed base layer transform coefficients (B), wherein said enhancement layer circuitry encodes and sends a sign of said residual signal (R) to said at least one streaming video receiver; and a variable bandwidth network capable of transporting said base layer video data and said enhancement layer video data from said streaming video transmitter to said at least one streaming video receiver.
Claim 50
Dependent Claim
196 words
A network system comprising: at least one streaming video receiver; a streaming video transmitter comprising: video encoder comprising: base layer circuitry capable of receiving an input stream of video frames and generating therefrom compressed base layer video data suitable for transmission to said at least one streaming video receiver, said base layer video data comprising a plurality of original transform coefficients (O) associated with said input stream of video frames and a plurality of reconstructed base layer transform coefficients (B) associated with said plurality of original transform coefficients; and enhancement layer circuitry capable of receiving said plurality of original transform coefficients (O) and said plurality of reconstructed base layer transform coefficients (B) and generating therefrom a residual signal (R) proportional to a difference between said plurality of original transform coefficients (O) and said plurality of reconstructed base layer transform coefficients (B), wherein said enhancement layer circuitry encodes and sends a sign of said residual signal (R) to said at least one streaming video receiver; and a variable bandwidth network capable of transporting said base layer video data and said enhancement layer video data from said streaming video transmitter to said at least one streaming video receiver.
Claim 51
Dependent Claim
27 words
The network system set forth in claim 41 wherein said base layer circuitry comprises a transform circuit capable of generating said plurality of original transform coefficients (O).
Claim 52
Dependent Claim
19 words
The network system set forth in claim 42 wherein said transform circuit is a discrete cosine transform (DCT) circuit.
Claim 53
Dependent Claim
42 words
The network system set forth in claim 41 wherein said base layer circuitry comprises a quantization circuit and an inverse quantization circuit capable of generating from said plurality of original transform coefficients (O) said plurality of reconstructed base layer transform coefficients (B).
Claim 54
Dependent Claim
38 words
The network system set forth in claim 41 wherein said enhancement layer circuitry comprises a residual computation circuit capable of comparing said plurality of original transform coefficients (O) and said plurality of reconstructed base layer transform coefficients (B).
References Cited (Backward Citations)
US5349383A
Cited
US5301018A
Cited
US5353061A
Cited
EP0739140A2
Cited
US6256346B1
Cited
WO1999033274A1
Cited
WO2000005898A2
Cited
US6275531B1
Cited
EP1030524A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2005-11-11 | 2006-05-13 | 2006-11-12 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2009-11-11 | 2010-05-13 | 2010-11-12 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2013-11-11 | 2014-05-13 | 2014-11-12 | $7700.00 | Window Closed / Lapsed |