US5768535A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Software-based encoder for a software-implemented end-to-end scalable video delivery system
Assignee: Sun Microsystems Inc
•
Filing: 1997-04-08
•
Granted: 1998-06-16
•
Expires: 2017-04-08
Abstract
Abstract A software-based encoder is provided for an end-to-end scalable video delivery system that operates over heterogeneous networks. The encoder utilizes a scalable video compression algorithm based on a Laplacian pyramid decomposition to generate an embedded information stream. The decoder decimates a highest resolution original image, e.g., 640×480 pixels, to produce an intermediate 320×240 pixel image that is decimated to produce an intermediate 160×120 pixel image that is compressed to form an encodable base layer 160×120 pixel image. This base layer image is decompressed to form an image that is up-sampled by interpolation to produce an up-sampled 320×240 pixel image. This up-sampled image is subtracted from the intermediate 320×240 pixel image to form an error image that is compressed and encoded as a first enhancement 640×480 pixel layer. The decompressed base layer image is also up-sampled at step to produce an up-sampled 640×480 pixel image that is subtracted from the original 640×480 pixel image 200 to yield an error image that is compressed to yield a second enhancement 320×240 pixel layer. Collectively, the base and enhancement layers comprise the transmitted embedded bit stream. At the receiving end, the decoder extracts from the embedded stream different streams at different spatial and temporal resolutions. Because decoding requires only additions and look-ups from a small stored table, decoding occurs in real-time.
Inventors
- 👤 Navin Chaddha
- 👤 J. Duane Northcutt
- 👤 Gerard A. Wall
- 👤 James G. Hanko
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-29 10:57
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/20; H04N21/25; H04N21/266; H04N21/2662; H04N19/00; H04N19/10; H04N19/134; H04N19/156; H04N19/169; H04N19/186; H04N19/60; H04N19/63; H04N19/90; H04N19/94; H04N21/23; H04N21/234; H04N21/2343; H04N21/234327; H04N21/24; H04N21/2402; H04N21/258; H04N21/25808; H04N21/40; H04N21/43; H04N21/44; H04N21/4402; H04N21/440227; H04N21/45; H04N21/462; H04N21/4621; H04N21/60; H04N21/63; H04N21/631; H04N21/64; H04N21/6405; H04N21/647; H04N21/64784; H04N21/64792; H04N7/00; H04N7/16; H04N7/173; H04N7/17309; H04N7/17336; H04N7/24; H04N19/30; H04N19/39
Claims Analysis
Total Claims: 24
Claim 1
Independent Claim
134 words
A scalable video encoder for use in a video delivery system server having a video source whose video images have a first spatial resolution, the scalable video encoder providing a decodable embedded bit stream that is network transmittable and includes image data at at least two spatial resolutions, the encoder including: a computer memory storing an executable software routine programmed to receive and process a first image from said video source to form at least a base image having resolution less than said first image, and to form a first enhancement layer image having resolution less than said first image but greater than said base layer image; said decodable embedded bit stream comprising data packets of fixed length code words and containing at least said base layer image and said first enhancement layer image.
Claim 2
Dependent Claim
134 words
A scalable video encoder for use in a video delivery system server having a video source whose video images have a first spatial resolution, the scalable video encoder providing a decodable embedded bit stream that is network transmittable and includes image data at at least two spatial resolutions, the encoder including: a computer memory storing an executable software routine programmed to receive and process a first image from said video source to form at least a base image having resolution less than said first image, and to form a first enhancement layer image having resolution less than said first image but greater than said base layer image; said decodable embedded bit stream comprising data packets of fixed length code words and containing at least said base layer image and said first enhancement layer image.
Claim 3
Dependent Claim
18 words
The encoder of claim 1, wherein before being encoded, said data packets are converted into a frequency domain.
Claim 4
Dependent Claim
22 words
The encoder of claim 1, wherein said data packets are encoded using quantized indexable representations of discrete cosine transformed video image data.
Claim 5
Dependent Claim
57 words
The encoder of claim 3, wherein encoding uses discrete cosine transform coefficients that include input-weighted squared error defined as follows: ##EQU2## where y j and y j are components of a transformed vector y and of a corresponding reproduction vector y, and where w j is a component of a weight vector generally dependent only upon y.
Claim 6
Dependent Claim
34 words
The encoder of claim 1, wherein said embedded bit stream includes information for at least two spatial resolutions and for at least one of said two spatial resolutions frequency domain information is vector quantized.
Claim 7
Dependent Claim
43 words
The encoder of claim 5, wherein said vector quantization is tree-structured such that vector quantization has a tree depth R and a vector dimension k; and wherein bitstream bit rates O/k . . . , R/k are provided for said embedded bit stream.
Claim 8
Dependent Claim
16 words
The encoder of claim 5, wherein said vector quantization is tree-structured and includes a perception model.
Claim 9
Dependent Claim
28 words
The encoder of claim 1, wherein said encoder encodes spatial resolution data using a discrete cosine transformation followed by a tree-structured vector quantization upon results of said transformation.
Claim 10
Dependent Claim
49 words
The encoder of claim 1, wherein said encoder forms said base layer image by: decimating said first image to form a first intermediate image having half said highest resolution; decimating said first intermediate image to form a second intermediate image that is compressed to form said base layer image.
Claim 11
Dependent Claim
59 words
The encoder of claim 9, wherein said encoder forms said first enhancement layer image by: decompressing said base layer image to form a third intermediate image that is interpolated to form a fourth intermediate image that is subtracted from said first intermediate image to form a fifth intermediate image that is compressed to form said first enhancement layer image.
Claim 12
Dependent Claim
32 words
The encoder of claim 1, wherein said decodable embedded bit stream includes image data for an additional image having a third spatial resolution that is equal to resolution of said first image.
Claim 13
Dependent Claim
160 words
For use in a video delivery system server having a video source whose video images have a first spatial resolution, a method of scalably encoding video to provide a decodable embedded bit stream that is network transmittable and includes image data at at least two spatial resolutions, the method including the following steps: (a) providing a central processor unit coupled to a computer memory; and (b) storing an encoding software routine on said computer memory, said routine executable by said central processor unit so as to receive and process a first image from said video source to form at least a base image having resolution less than said first image, and to form a first enhancement layer image having resolution less than said first image but greater than said base layer image; wherein said decodable embedded bit stream comprises data packets of fixed length code words and contains at least said base layer image and said first enhancement layer image.
Claim 14
Dependent Claim
160 words
For use in a video delivery system server having a video source whose video images have a first spatial resolution, a method of scalably encoding video to provide a decodable embedded bit stream that is network transmittable and includes image data at at least two spatial resolutions, the method including the following steps: (a) providing a central processor unit coupled to a computer memory; and (b) storing an encoding software routine on said computer memory, said routine executable by said central processor unit so as to receive and process a first image from said video source to form at least a base image having resolution less than said first image, and to form a first enhancement layer image having resolution less than said first image but greater than said base layer image; wherein said decodable embedded bit stream comprises data packets of fixed length code words and contains at least said base layer image and said first enhancement layer image.
Claim 15
Dependent Claim
20 words
The method of claim 12, wherein before being encoded, step (b) includes converting said data packets into a frequency domain.
Claim 16
Dependent Claim
24 words
The method of claim 12, wherein step (b) includes encoding said data packets using quantized indexable representations of discrete cosine transformed video image data.
Claim 17
Dependent Claim
61 words
The method of claim 14, wherein step (b) is carried out using discrete cosine transform coefficients that include input-weighted squared error defined as follows: ##EQU3## where y j and y j are components of a transformed vector y and of a corresponding reproduction vector y, and where w j is a component of a weight vector generally dependent only upon y.
Claim 18
Dependent Claim
29 words
The method of claim 14, wherein step (b) includes encoding spatial resolution data using a discrete cosine transformation followed by a tree-structured vector quantization upon results of said transformation.
Claim 19
Dependent Claim
54 words
The method of claim 14, wherein at step (b), said base layer image is formed by: (b-1) decimating said first image to form a first intermediate image having half said highest resolution; and (b-2) decimating said first intermediate image to form a second intermediate image that is compressed to form said base layer image.
Claim 20
Dependent Claim
61 words
The method of claim 17, wherein at step (b), said first enhancement layer image is formed by: decompressing said base layer image to form a third intermediate image that is interpolated to form a fourth intermediate image that is subtracted from said first intermediate image to form a fifth intermediate image that is compressed to form said first enhancement layer image.
Claim 21
Dependent Claim
32 words
The method of claim 14, wherein said decodable embedded bit stream includes image data for an additional image having a third spatial resolution that is equal to resolution of said first image.
Claim 22
Dependent Claim
37 words
The method of claim 12, wherein at step (b) said embedded bit stream includes information for at least two spatial resolutions and for at least one of said two spatial resolutions frequency domain information is vector quantized.
Claim 23
Dependent Claim
46 words
The method of claim 20, wherein at step (b), said vector quantization is tree-structured such that vector quantization has a tree depth R and a vector dimension k; and wherein bitstream bit rates O/k, . . . , R/k are provided for said embedded bit stream.
Claim 24
Dependent Claim
19 words
The method of claim 20, wherein at step (b), said vector quantization is tree-structured and includes a perception model.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-06-15 | 2001-12-15 | 2002-06-16 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-06-15 | 2005-12-15 | 2006-06-16 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-06-15 | 2009-12-15 | 2010-06-16 | $7700.00 | Window Closed / Lapsed |