US6940905B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Double-loop motion-compensation fine granular scalability
Assignee: Koninklijke Philips NV
•
Filing: 2001-06-21
•
Granted: 2005-09-06
•
Expires: 2021-06-21
Abstract
Abstract A video coding technique having motion compensation within a fine granular scalable coded enhancement layer. In one embodiment, the video coding technique involves a two-loop prediction-based enhancement layer including non-motion-predicted enhancement layer I- and P-frames and motion-predicted enhancement layer B-frames. The motion-predicted enhancement layer B-frames are computed using: 1) motion-prediction from two temporally adjacent differential I- and P- or P- and P-frame residuals, and 2) the differential B-frame residuals obtained by subtracting the decoded base layer B-frame residuals from the original base layer B-frame residuals. In a second embodiment, the enhancement layer further includes motion-predicted enhancement layer P-frames. The motion-predicted enhancement layer P-frames are computed using: 1) motion-prediction from a temporally adjacent differential I- or P-frame residual, and 2) the differential P-frame residual obtained by subtracting the decoded base layer P-frame residual from the original base layer P-frame residual.
Inventors
- 👤 Mihaela van der Schaar
- 👤 Hayder Radha
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-10 00:34
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/30; H04N19/34; H04N19/31; H04N19/60; H04N19/61
Claims Analysis
Total Claims: 37
Claim 1
Independent Claim
96 words
A method of coding video, comprising the steps of: coding an uncoded video with a non-scalable codec to generate base layer frames; computing differential frame residuals from the uncoded video and the base layer frames, at least portions of certain ones of the differential frame residuals being operative as references; applying motion-compensation to the at least portions of the differential frame residuals that are operative as references to generate reference motion-compensated differential frame residuals; and subtracting the reference motion-compensated differential frame residuals from respective ones of the differential frame residuals to generate motion-predicted enhancement layer frames.
Claim 2
Independent Claim
96 words
A method of coding video, comprising the steps of: coding an uncoded video with a non-scalable codec to generate base layer frames; computing differential frame residuals from the uncoded video and the base layer frames, at least portions of certain ones of the differential frame residuals being operative as references; applying motion-compensation to the at least portions of the differential frame residuals that are operative as references to generate reference motion-compensated differential frame residuals; and subtracting the reference motion-compensated differential frame residuals from respective ones of the differential frame residuals to generate motion-predicted enhancement layer frames.
Claim 3
Dependent Claim
25 words
A method of coding video according to claim 1 , further comprising the step of coding the motion-predicted enhancement layer frames with a scalable codec.
Claim 4
Dependent Claim
27 words
A method of coding video according to claim 1 , further comprising the step of coding the motion-predicted enhancement layer frames with a fine granular scalable codec.
Claim 5
Dependent Claim
67 words
A method of coding video according to claim 1 , wherein the motion-predicted enhancement layer frames in the subtracting step include motion-predicted enhancement layer B-frames, the reference motion-compensated differential frame residuals in the subtracting step include reference motion-compensated differential I- and P-frame residuals or reference motion-compensated differential P- and P-frame residuals, and the respective ones of the differential frame residuals in the subtracting step include differential B-frames.
Claim 6
Dependent Claim
65 words
A method of coding video according to claim 4 , wherein the motion-predicted enhancement layer frames in the subtracting step further include motion-predicted enhancement layer P-frames, the reference motion-compensated differential frame residuals in the subtracting step further include reference motion-compensated differential I-frame residuals or reference motion-compensated P-frame residuals, and the respective ones of the differential frame residuals in the subtracting step further include differential P-frames.
Claim 7
Dependent Claim
62 words
A method of coding video according to claim 1 , wherein the motion-predicted enhancement layer frames in the subtracting step include motion-predicted enhancement layer P-frames, the reference motion-compensated differential frame residuals in the subtracting step include reference motion-compensated differential I-frame residuals or reference motion-compensated P-frame residuals, and the respective ones of the differential frame residuals in the subtracting step include differential P-frames.
Claim 8
Independent Claim
122 words
A method of decoding a compressed video having a base layer stream and an enhancement layer stream, the method comprising the steps of: decoding the base layer stream to generate base layer video frames; decoding the enhancement layer stream to generate differential frame residuals, at least portions of certain ones of the differential frame residuals being operative as references; applying motion-compensation to the at least portions of the differential frame residuals operative as references to generate reference motion-compensated differential frame residuals; adding the reference motion-compensated differential frame residuals with respective ones of the differential frame residuals to generate motion-predicted enhancement layer frames; and combining the motion-predicted enhancement layer frames with respective ones of the base layer frames to generate an enhanced video.
Claim 9
Independent Claim
122 words
A method of decoding a compressed video having a base layer stream and an enhancement layer stream, the method comprising the steps of: decoding the base layer stream to generate base layer video frames; decoding the enhancement layer stream to generate differential frame residuals, at least portions of certain ones of the differential frame residuals being operative as references; applying motion-compensation to the at least portions of the differential frame residuals operative as references to generate reference motion-compensated differential frame residuals; adding the reference motion-compensated differential frame residuals with respective ones of the differential frame residuals to generate motion-predicted enhancement layer frames; and combining the motion-predicted enhancement layer frames with respective ones of the base layer frames to generate an enhanced video.
Claim 10
Dependent Claim
70 words
A method of decoding video according to claim 7 , wherein the motion-predicted enhancement layer frames in the adding step consist of motion-predicted enhancement layer B-frames, the reference motion-compensated differential frame residuals in the adding step consist of reference motion-compensated differential I- and P-frame residuals or reference motion-compensated differential P- and P-frame residuals, and the respective ones of the differential frame residuals in the adding step consist of differential B-frames.
Claim 11
Dependent Claim
67 words
A method of decoding video according to claim 7 , wherein the motion-predicted enhancement layer frames in the adding step include motion-predicted enhancement layer B-frames, the reference motion-compensated differential frame residuals in the adding step include reference motion-compensated differential I- and P-frame residuals or reference motion-compensated differential P- and P-frame residuals, and the respective ones of the differential frame residuals in the adding step include differential B-frames.
Claim 12
Dependent Claim
65 words
A method of decoding video according to claim 9 , wherein the motion-predicted enhancement layer frames in the adding step further include motion-predicted enhancement layer P-frames, the reference motion-compensated differential frame residuals in the adding step further include reference motion-compensated differential I-frame residuals or reference motion-compensated P-frame residuals, and the respective ones of the differential frame residuals in the adding step further include differential P-frames.
Claim 13
Dependent Claim
62 words
A method of decoding video according to claim 7 , wherein the motion-predicted enhancement layer frames in the adding step include motion-predicted enhancement layer P-frames, the reference motion-compensated differential frame residuals in the adding step include reference motion-compensated differential I-frame residuals or reference motion-compensated P-frame residuals, and the respective ones of the differential frame residuals in the adding step include differential P-frames.
Claim 14
Dependent Claim
101 words
A memory medium for encoding video, the memory medium comprising: code for non-scalable encoding an uncoded video into base layer frames; code for computing differential frame residuals from the uncoded video and the base layer frames, at least portions of certain ones of the differential frame residuals being operative as references; code for applying motion-compensation to the at least portions of the differential frame residuals that are operative as references to generate reference motion-compensated differential frame residuals; and code for subtracting the reference motion-compensated differential frame residuals from respective ones of the differential frame residuals to generate motion-predicted enhancement layer frames.
Claim 15
Dependent Claim
101 words
A memory medium for encoding video, the memory medium comprising: code for non-scalable encoding an uncoded video into base layer frames; code for computing differential frame residuals from the uncoded video and the base layer frames, at least portions of certain ones of the differential frame residuals being operative as references; code for applying motion-compensation to the at least portions of the differential frame residuals that are operative as references to generate reference motion-compensated differential frame residuals; and code for subtracting the reference motion-compensated differential frame residuals from respective ones of the differential frame residuals to generate motion-predicted enhancement layer frames.
Claim 16
Dependent Claim
22 words
A memory medium for encoding video according to claim 12 , further comprising code for scalable encoding the motion-predicted enhancement layer frames.
Claim 17
Dependent Claim
24 words
A memory medium for encoding video according to claim 12 , further comprising code for fine granular scalable encoding the motion-predicted enhancement layer frames.
Claim 18
Dependent Claim
56 words
A memory medium for encoding video according to claim 12 , wherein the motion-predicted enhancement layer frames include motion-predicted enhancement layer B-frames, the reference motion-compensated differential frame residuals include reference motion-compensated differential I- and P-frame residuals or reference motion-compensated differential P- and P-frame residuals, and the respective ones of the differential frame residuals include differential B-frames.
Claim 19
Dependent Claim
54 words
A memory medium for encoding video according to claim 15 , wherein the motion-predicted enhancement layer frames further include motion-predicted enhancement layer P-frames, the reference motion-compensated differential frame residuals further include reference motion-compensated differential I-frame residuals or reference motion-compensated P-frame residuals, and the respective ones of the differential frame residuals further include differential P-frames.
Claim 20
Dependent Claim
51 words
A memory medium for encoding video according to claim 12 , wherein the motion-predicted enhancement layer frames include motion-predicted enhancement layer P-frames, the reference motion-compensated differential frame residuals include reference motion-compensated differential I-frame residuals or reference motion-compensated P-frame residuals, and the respective ones of the differential frame residuals include differential P-frames.
Claim 21
Dependent Claim
131 words
A memory medium for decoding a compressed video having a base layer stream and an enhancement layer stream, the memory medium comprising: code for decoding the base layer stream to generate base layer video frames; code for decoding the enhancement layer stream to generate differential frame residuals, at least portions of certain ones of the differential frame residuals being operative as references; code for applying motion-compensation to the at least portions of the differential frame residuals operative as references to generate reference motion-compensated differential frame residuals; code for adding the reference motion-compensated differential frame residuals with respective ones of the differential frame residuals to generate motion-predicted enhancement layer frames; and code for combining the motion-predicted enhancement layer frames with respective ones of the base layer frames to generate an enhanced video.
Claim 22
Dependent Claim
131 words
A memory medium for decoding a compressed video having a base layer stream and an enhancement layer stream, the memory medium comprising: code for decoding the base layer stream to generate base layer video frames; code for decoding the enhancement layer stream to generate differential frame residuals, at least portions of certain ones of the differential frame residuals being operative as references; code for applying motion-compensation to the at least portions of the differential frame residuals operative as references to generate reference motion-compensated differential frame residuals; code for adding the reference motion-compensated differential frame residuals with respective ones of the differential frame residuals to generate motion-predicted enhancement layer frames; and code for combining the motion-predicted enhancement layer frames with respective ones of the base layer frames to generate an enhanced video.
Claim 23
Dependent Claim
58 words
A memory medium for decoding a compressed video according to claim 18 , wherein the motion-predicted enhancement layer frames include motion-predicted enhancement layer B-frames, the reference motion-compensated differential frame residuals include reference motion-compensated differential I- and P-frame residuals or reference motion-compensated differential P- and P-frame residuals, and the respective ones of the differential frame residuals include differential B-frames.
Claim 24
Dependent Claim
56 words
A memory medium for decoding a compressed video according to claim 19 , wherein the motion-predicted enhancement layer frames further include motion-predicted enhancement layer P-frames, the reference motion-compensated differential frame residuals further include reference motion-compensated differential I-frame residuals or reference motion-compensated P-frame residuals, and the respective ones of the differential frame residuals further include differential P-frames.
Claim 25
Dependent Claim
53 words
A memory medium for decoding a compressed video according to claim 18 , wherein the motion-predicted enhancement layer frames include motion-predicted enhancement layer P-frames, the reference motion-compensated differential frame residuals include reference motion-compensated differential I-frame residuals or reference motion-compensated P-frame residuals, and the respective ones of the differential frame residuals include differential P-frames.
Claim 26
Independent Claim
100 words
An apparatus for coding video, the apparatus comprising: means for non-scalable coding an uncoded video to generate base layer frames; means for computing differential frame residuals from the uncoded video and the base layer frames, at least portions of certain ones of the differential frame residuals being operative as references; means for applying motion-compensation to the at least portions of the differential frame residuals that are operative as references to generate reference motion-compensated differential frame residuals; and means for subtracting the reference motion-compensated differential frame residuals from respective ones of the differential frame residuals to generate motion-predicted enhancement layer frames.
Claim 27
Independent Claim
100 words
An apparatus for coding video, the apparatus comprising: means for non-scalable coding an uncoded video to generate base layer frames; means for computing differential frame residuals from the uncoded video and the base layer frames, at least portions of certain ones of the differential frame residuals being operative as references; means for applying motion-compensation to the at least portions of the differential frame residuals that are operative as references to generate reference motion-compensated differential frame residuals; and means for subtracting the reference motion-compensated differential frame residuals from respective ones of the differential frame residuals to generate motion-predicted enhancement layer frames.
Claim 28
Dependent Claim
21 words
An apparatus for coding video according to claim 22 , further comprising means for scalable coding the motion-predicted enhancement layer frames.
Claim 29
Dependent Claim
23 words
An apparatus for coding video according to claim 22 , further comprising means for fine granular scalable coding the motion-predicted enhancement layer frames.
Claim 30
Dependent Claim
55 words
An apparatus for coding video according to claim 22 , wherein the motion-predicted enhancement layer frames include motion-predicted enhancement layer B-frames, the reference motion-compensated differential frame residuals include reference motion-compensated differential I- and P-frame residuals or reference motion-compensated differential P- and P-frame residuals, and the respective ones of the differential frame residuals include differential B-frames.
Claim 31
Dependent Claim
53 words
An apparatus for coding video according to claim 25 , wherein the motion-predicted enhancement layer frames further include motion-predicted enhancement layer P-frames, the reference motion-compensated differential frame residuals further include reference motion-compensated differential I-frame residuals or reference motion-compensated P-frame residuals, and the respective ones of the differential frame residuals further include differential P-frames.
Claim 32
Dependent Claim
50 words
An apparatus for coding video according to claim 22 , wherein the motion-predicted enhancement layer frames include motion-predicted enhancement layer P-frames, the reference motion-compensated differential frame residuals include reference motion-compensated differential I-frame residuals or reference motion-compensated P-frame residuals, and the respective ones of the differential frame residuals include differential P-frames.
Claim 33
Independent Claim
129 words
An apparatus for decoding a compressed video having a base layer stream and an enhancement layer stream, the apparatus comprising: means for decoding the base layer stream to generate base layer video frames; means for decoding the enhancement layer stream to generate differential frame residuals, at least portions of certain ones of the differential frame residuals being operative as references; means for applying motion-compensation to the at least portions of the differential frame residuals operative as references to generate reference motion-compensated differential frame residuals; means for adding the reference motion-compensated differential frame residuals with respective ones of the differential frame residuals to generate motion-predicted enhancement layer frames; and means for combining the motion-predicted enhancement layer frames with respective ones of the base layer frames to generate an enhanced video.
Claim 34
Independent Claim
129 words
An apparatus for decoding a compressed video having a base layer stream and an enhancement layer stream, the apparatus comprising: means for decoding the base layer stream to generate base layer video frames; means for decoding the enhancement layer stream to generate differential frame residuals, at least portions of certain ones of the differential frame residuals being operative as references; means for applying motion-compensation to the at least portions of the differential frame residuals operative as references to generate reference motion-compensated differential frame residuals; means for adding the reference motion-compensated differential frame residuals with respective ones of the differential frame residuals to generate motion-predicted enhancement layer frames; and means for combining the motion-predicted enhancement layer frames with respective ones of the base layer frames to generate an enhanced video.
Claim 35
Dependent Claim
57 words
An apparatus for decoding a compressed video according to claim 28 , wherein the motion-predicted enhancement layer frames include motion-predicted enhancement layer B-frames, the reference motion-compensated differential frame residuals include reference motion-compensated differential I- and P-frame residuals or reference motion-compensated differential P- and P-frame residuals, and the respective ones of the differential frame residuals include differential B-frames.
Claim 36
Dependent Claim
55 words
An apparatus for decoding a compressed video according to claim 29 , wherein the motion-predicted enhancement layer frames further include motion-predicted enhancement layer P-frames, the reference motion-compensated differential frame residuals further include reference motion-compensated differential I-frame residuals or reference motion-compensated P-frame residuals, and the respective ones of the differential frame residuals further include differential P-frames.
Claim 37
Dependent Claim
52 words
An apparatus for decoding a compressed video according to claim 28 , wherein the motion-predicted enhancement layer frames include motion-predicted enhancement layer P-frames, the reference motion-compensated differential frame residuals include reference motion-compensated differential I-frame residuals or reference motion-compensated P-frame residuals, and the respective ones of the differential frame residuals include differential P-frames.
References Cited (Backward Citations)
US5349383A
Cited
EP0485230A2
Cited
US5973739A
Cited
US5742343A
Cited
US6256346B1
Cited
US5988863A
Cited
US6339618B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2008-09-05 | 2009-03-07 | 2009-09-06 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2012-09-05 | 2013-03-07 | 2013-09-06 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2016-09-05 | 2017-03-07 | 2017-09-06 | $7700.00 | Window Closed / Lapsed |