EP0739140A2
Expired / Lapsed
EP
⏱️ 0.0 years remaining
Encoder for an end-to-end scalable video delivery system
Assignee: Sun Microsystems Inc
•
Filing: 1996-04-17
•
Granted: —
•
Expires: 2016-04-17
Abstract
Abstract A software-based encoder is provided for an end-to-end scalable video delivery system that operates over heterogeneous networks. The encoder utilizes a scalable video compression algorithm based on a Laplacian pyramid decomposition to generate an embedded information stream. The decoder decimates a highest resolution original image, e.g., 640x480 pixels, to produce an intermediate 320x240 pixel image that is decimated to produce an intermediate 160x120 pixel image that is compressed to form an encodable base layer 160x120 pixel image. This base layer image is decompressed to form an image that is up-sampled by interpolation to produce an up-sampled 320x240 pixel image. This up-sampled image is subtracted from the intermediate 320x240 pixel image to form an error image that is compressed and encoded as a first enhancement 640x480 pixel layer. The decompressed base layer image is also up-sampled at step to produce an up-sampled 640x480 pixel image that is subtracted from the original 640x480 pixel image 200 to yield an error image that is compressed to yield a second enhancement 320x240 pixel layer. Collectively, the base and enhancement layers comprise the transmitted embedded bit stream. At the receiving end, the decoder extracts from the embedded stream different streams at different spatial and temporal resolutions. Because decoding requires only additions and look-ups from a small stored table, decoding occurs in real-time.
Inventors
- 👤 Navin Chaddha
- 👤 J. Duane Northcutt
- 👤 Gerald A. Wall
- 👤 James G. Hanko
Bibliographic Details
Application Number
—
Jurisdiction
EP
Data Source
google_patents
Last Synchronized
2026-10-30 21:50
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/20; H04N21/25; H04N21/266; H04N21/2662; H04N19/00; H04N19/10; H04N19/134; H04N19/156; H04N19/169; H04N19/186; H04N19/60; H04N19/63; H04N19/90; H04N19/94; H04N21/23; H04N21/234; H04N21/2343; H04N21/234327; H04N21/24; H04N21/2402; H04N21/258; H04N21/25808; H04N21/40; H04N21/43; H04N21/44; H04N21/4402; H04N21/440227; H04N21/45; H04N21/462; H04N21/4621; H04N21/60; H04N21/63; H04N21/631; H04N21/64; H04N21/6405; H04N21/647; H04N21/64784; H04N21/64792; H04N7/00; H04N7/16; H04N7/173; H04N7/17309; H04N7/17336; H04N7/24; H04N19/30; H04N19/39
Claims Analysis
Total Claims: 21
Claim 1
Independent Claim
224 words
For use in a video delivery system server having a source of video images, an encoder providing an embedded bit stream containing information including image data at at least two spatial resolutions, said embedded bit stream being sent over at least one network to at least one decoder, the encoder including: a central processor unit coupled to a memory unit; encoding means, digitally stored in said memory unit and coupled to said source of video images and receiving a first image at first spatial resolution, for decimating said first image to form an first intermediate image at half said highest resolution, for decimating said first intermediate image to form a second intermediate image, for compressing said second intermediate image to form a base layer image whose resolution is less than said first image; said encoding means further decompressing said base layer image to form a third intermediate image, and interpolating said third intermediate image to form a fourth intermediate image, and for subtracting said fourth intermediate image from said first intermediate image to form a fifth intermediate image, and for compressing said fifth intermediate image to form a first enhancement layer image whose resolution is less than said first image but greater than said base layer image; said embedded bit stream containing at least said base layer image and said first enhancement layer image.
Claim 2
Dependent Claim
92 words
The encoder of claim 1, wherein said embedded bit stream contains at least three spatial resolutions including an additional image, whose resolution equals that of said first image, and said base layer image, and wherein said encoding means further interpolates said fourth intermediate image to form a sixth intermediate image that is subtracted from said first image to form a seventh intermediate image that is compressed to form a second enhancement layer image whose resolution equals that of said first image; said embedded bit stream further containing said second enhancement layer image.
Claim 3
Dependent Claim
44 words
The encoder of claim 1, wherein said embedded bit stream includes spatial resolution data encoded in pixel blocks, and wherein said encoding means encodes said spatial resolution data using a discrete cosine transformation followed by a tree-structured vector quantization upon results of said transformation.
Claim 4
Dependent Claim
35 words
The encoder of claim 2, wherein said first image has a resolution of 640x480 pixels, said additional image has a resolution of 320x240 pixels, and said base layer image has a resolution of 160x120 pixels.
Claim 5
Dependent Claim
70 words
The encoder of claim 4, wherein said embedded bit stream includes spatial resolution data encoded in pixel blocks of size 2x2 bits for said base layer image, of size 4x4 bits for said additional image, and of size 8x8 bits for said first image, and wherein said encoding means encodes said spatial resolution data using a discrete cosine transformation followed by a tree-structured vector quantization upon results of said transformation.
Claim 6
Dependent Claim
53 words
The encoder of claim 3, wherein transform coefficients include input-weighted squared error defined as follows: where y j and ŷ j are components of a transformed vector y and of a corresponding reproduction vector ŷ , and where w j is a component of a weight vector generally dependent only upon y .
Claim 7
Dependent Claim
14 words
The encoder of claim 6, wherein said tree-structured vector quantization includes a perception model.
Claim 8
Dependent Claim
21 words
The encoder of claim 7, wherein said weight vector components reflect human visual sensitivity to quantization errors in different transform coefficients.
Claim 9
Dependent Claim
35 words
The encoder of claim 7, wherein said tree-structured vector quantization has a tree depth R and has a vector dimension is k , and wherein bitstream bit rates O/ k ,......., R/ k are provided.
Claim 10
Dependent Claim
52 words
The encoder of claim 7, wherein indices are transmitted in said embedded stream with different index planes; a first index plane containing a first index for a rate 1/ k tree-structured vector quantization reference, and a second index plane containing a second index for a rate 2/ k tree-structured vector quantization reference.
Claim 11
Dependent Claim
33 words
The encoder of claim 10, wherein said embedded bit stream includes data packets, and wherein said indices are associated with a relative priority of importance of at least some of said data packets.
Claim 12
Dependent Claim
42 words
The encoder of claim 11, wherein said embedded bit stream is sent over a network having throughput insufficient for decoder receipt of a highest spatial image, wherein said relative priority associated with said data packets permits selective non-transmission of relatively unimportant packets.
Claim 13
Dependent Claim
29 words
The encoder of claim 11, wherein data for each video frame is stored together, and wherein each frame has an associated set of index planes with associated packet headers.
Claim 14
Dependent Claim
38 words
The encoder of claim 1, wherein said encoding means further includes at least one option selected from the group consisting of (a) estimation of motion associated with a transmitted image, and (b) conditional replenishment of a said image.
Claim 15
Independent Claim
233 words
A method, for use in a video delivery system server having a source of video images, of encoding an embedded bit stream containing information including image data at at least two spatial resolutions, said embedded bit stream being sent over at least one network to at least one decoder, the method including the following steps: (a) providing a central processor unit coupled to a memory unit; and (b) providing encoding means, digitally stored in said memory unit and coupled to said source of video images and receiving a first image at first spatial resolution, for decimating said first image to form an first intermediate image at half said highest resolution, for decimating said first intermediate image to form a second intermediate image, for compressing said second intermediate image to form a base layer image whose resolution is less than said first image; said encoding means further decompressing said base layer image to form a third intermediate image, and interpolating said third intermediate image to form a fourth intermediate image, and for subtracting said fourth intermediate image from said first intermediate image to form a fifth intermediate image, and for compressing said fifth intermediate image to form a first enhancement layer image whose resolution is less than said first image but greater than said base layer image; said embedded bit stream containing at least said base layer image and said first enhancement layer image.
Claim 16
Dependent Claim
95 words
The method of claim 15, wherein said embedded bit stream contains at least three spatial resolutions including an additional image, whose resolution equals that of said first image, and said base layer image, and wherein at step (b), said encoding means further interpolates said fourth intermediate image to form a sixth intermediate image that is subtracted from said first image to form a seventh intermediate image that is compressed to form a second enhancement layer image whose resolution equals that of said first image; said embedded bit stream further containing said second enhancement layer image.
Claim 17
Dependent Claim
47 words
The method of claim 15, wherein said embedded bit stream includes spatial resolution data encoded in pixel blocks, and wherein at step (b), said encoding means encodes said spatial resolution data using a discrete cosine transformation followed by a tree-structured vector quantization upon results of said transformation.
Claim 18
Dependent Claim
56 words
The method of claim 17, wherein at step (b), transform coefficients include input-weighted squared error defined as follows: where y j and ŷ j are components of a transformed vector y and of a corresponding reproduction vector ŷ , and where w j is a component of a weight vector generally dependent only upon y .
Claim 19
Dependent Claim
26 words
The method of claim 18, wherein step (b) includes providing said weight vector components that reflect human visual sensitivity to quantization errors in different transform coefficients.
Claim 20
Dependent Claim
37 words
The method of claim 18, wherein at step (b), said tree-structured vector quantization has a tree depth R and has a vector dimension is k, and wherein bitstream bit rates O/ k ,......., R/ k are provided.
Claim 21
Dependent Claim
82 words
The method of claim 18, wherein said embedded bit stream includes data packets, and wherein at step (b), indices are transmitted in said embedded stream with different index planes; a first index plane containing a first index for a rate 1/ k tree-structured vector quantization reference, and a second index plane containing a second index for a rate 2/ k tree-structured vector quantization reference; said indices being associated with a relative priority of importance of at least some of said data packets.
References Cited (Backward Citations)
No citation records indexed.
USPTO Annuity & Maintenance Windows
Maintenance schedule is calculated for granted US utility patents.