US5742892A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Decoder for a software-implemented end-to-end scalable video delivery system
Assignee: Sun Microsystems Inc
•
Filing: 1995-04-18
•
Granted: 1998-04-21
•
Expires: 2015-04-18
Abstract
Abstract A decoder is used in an end-to-end scalable video delivery system operable over heterogeneous networks. The decoder may software-based and computationally low complexity, or may be implemented inexpensively in ROM hardware. The system utilizes a scalable video compression algorithm based on a Laplacian pyramid decomposition to generate an embedded information stream. At the receiving end, the decoder extracts from the embedded stream different streams at different spatial and temporal resolutions. Decoding a 160×120 pixel image involves only decompressing a base layer 160×120 pixel image. Decoding a 320×240 pixel image involves decompressing and up-sampling (e.g., interpolating) the base layer to yield a 320×240 pixel image to which is added error data in a first enhancement layer following its decompression. To obtain a 640×480 pixel image, the decoder up-samples the up-sampled 320×240 pixel image, to which is added error data in a second enhancement layer, following its decompression. Because decoding requires only additions and look-ups from a table stored in a small (12 Kb) memory, decoding occurs in real-time. Subjective quality of the compressed images preferably is enhanced using perceptual distortion measures. The system also provides joint-source channel coding capability on heterogenous networks. The look-up table or codebook includes the inverse perceptual weighting (preprocessed) and the inverse transform (preprocessed). Decoding permits the codewords within the look-up table codebook to include preprocessed color conversion, dithering, color palletization, edge-enhancement, decimation, and interpolation.
Inventors
- 👤 Navin Chaddha
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 15:58
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/20; H04N21/23; H04N21/236; G; G06; G06T; G06T9/00; G06T9/008; H04N19/00; H04N19/10; H04N19/169; H04N19/186; H04N19/60; H04N19/63; H04N19/90; H04N19/94; H04N21/40; H04N21/43; H04N21/434
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
223 words
A decoder for use with a video delivery system whose server provides an embedded bit stream in pixel blocks including information for at least two spatial resolutions and transmittable over at least one network, the decoder including: a central processor unit coupled to a memory unit; a look-up table, stored in said memory unit, including preprocessed decoded versions of quantized indexable representations of inverse discrete cosine transforms of image data used by said server in creating codewords present in said embedded bit stream; and means, operating under control of said central processor unit, for processing said information contained in said embedded bit stream; said means for processing decoding a first spatial resolution image by decompressing base layer data contained within said embedded bit stream; said means for processing further decoding a second, higher, spatial resolution image by decompressing said base layer data to obtain a first intermediate image that is up-sampled to yield a first up-sampled image to which is added decompressed error data in a first enhancement layer contained in said embedded bit stream; wherein said server encodes said embedded bit stream by performing a discrete cosine transform followed by tree-structured quantization, and wherein said decoder can decode a viewable image from data in said embedded bit stream from received codewords containing less than a number of bits representing a full-length codeword.
Claim 2
Dependent Claim
223 words
A decoder for use with a video delivery system whose server provides an embedded bit stream in pixel blocks including information for at least two spatial resolutions and transmittable over at least one network, the decoder including: a central processor unit coupled to a memory unit; a look-up table, stored in said memory unit, including preprocessed decoded versions of quantized indexable representations of inverse discrete cosine transforms of image data used by said server in creating codewords present in said embedded bit stream; and means, operating under control of said central processor unit, for processing said information contained in said embedded bit stream; said means for processing decoding a first spatial resolution image by decompressing base layer data contained within said embedded bit stream; said means for processing further decoding a second, higher, spatial resolution image by decompressing said base layer data to obtain a first intermediate image that is up-sampled to yield a first up-sampled image to which is added decompressed error data in a first enhancement layer contained in said embedded bit stream; wherein said server encodes said embedded bit stream by performing a discrete cosine transform followed by tree-structured quantization, and wherein said decoder can decode a viewable image from data in said embedded bit stream from received codewords containing less than a number of bits representing a full-length codeword.
Claim 3
Dependent Claim
65 words
The decoder of claim 1, wherein said embedded bit stream contains at least three spatial resolutions, and wherein said means for processing decodes a third image whose spatial resolution is higher than said second image by up-sampling said first up-sampled image to yield a second intermediate image to which is added decompressed error data in a second enhancement layer contained in said embedded bit stream.
Claim 4
Dependent Claim
71 words
The decoder of claim 1, wherein said memory unit stores at least one of the following (i) an algorithm comprising said means for processing, (ii) look-up data used in decompressing said base layer data, (iii) look-up data associated with said error data in said first enhancement layer, (iv) preprocessed data representing up-sampling of said first up-sampled image, and (v) preprocessed data associated with said error data in said second enhancement layer.
Claim 5
Dependent Claim
242 words
A decoder for use with a video delivery system whose server provides an embedded bit stream, transmittable over at least one network, including information for at least two spatial resolutions wherein for at least one of said two spatial resolutions domain information provided has been vector quantized, the decoder including: a central processor unit coupled to a memory unit; a look-up table, stored in said memory unit, including preprocessed decoded versions of quantized indexable representations of frequency domain transforms of image data used by said server in creating codewords present in said embedded bit stream; means, operating under control of said central processor unit, for processing said information contained in said embedded bit stream; said means for processing decoding a first spatial resolution image by decompressing base layer data contained within said embedded bit stream; said means for processing further decoding a second, higher, spatial resolution image by decompressing said base layer data to obtain a first intermediate image that is up-sampled to yield a first up-sampled image to which is added decompressed error data in a first enhancement layer contained in said embedded bit stream; wherein said server encodes said embedded bit stream by performing a discrete cosine transform followed by tree-structured vector quantization, and wherein vector quantization is such that said means for processing can decode a viewable image from data in said embedded bit stream from received codewords containing less than a number of bits representing a full-length codeword.
Claim 6
Dependent Claim
242 words
A decoder for use with a video delivery system whose server provides an embedded bit stream, transmittable over at least one network, including information for at least two spatial resolutions wherein for at least one of said two spatial resolutions domain information provided has been vector quantized, the decoder including: a central processor unit coupled to a memory unit; a look-up table, stored in said memory unit, including preprocessed decoded versions of quantized indexable representations of frequency domain transforms of image data used by said server in creating codewords present in said embedded bit stream; means, operating under control of said central processor unit, for processing said information contained in said embedded bit stream; said means for processing decoding a first spatial resolution image by decompressing base layer data contained within said embedded bit stream; said means for processing further decoding a second, higher, spatial resolution image by decompressing said base layer data to obtain a first intermediate image that is up-sampled to yield a first up-sampled image to which is added decompressed error data in a first enhancement layer contained in said embedded bit stream; wherein said server encodes said embedded bit stream by performing a discrete cosine transform followed by tree-structured vector quantization, and wherein vector quantization is such that said means for processing can decode a viewable image from data in said embedded bit stream from received codewords containing less than a number of bits representing a full-length codeword.
Claim 7
Dependent Claim
49 words
The decoder of claim 4, wherein said tree-structured vector quantization has a tree depth R and a vector dimension k; wherein bitstream bit rates O/k, . . . , R/k are provided for said embedded bit stream; and wherein said memory unit stores codewords arranged in a tree structure.
Claim 8
Dependent Claim
68 words
The decoder of claim 1, wherein said server encodes spatial resolution data in said embedded bit stream in pixel blocks, wherein: said decoder provides error correction for said embedded bit stream using inverse vector quantization followed by inverse discrete cosine transformation of at least some of said blocks of data, said inverse vector quantization and said inverse discrete cosine transformation being preprocessed and stored in said memory unit.
Claim 9
Dependent Claim
13 words
The decoder of claim 1, wherein said vector quantization includes human perception modelling.
Claim 10
Dependent Claim
16 words
The decoder of claim 1, wherein said memory unit stores codewords arranged in a tree structure.
Claim 11
Dependent Claim
40 words
The decoder of claim 1, wherein said tree-structured vector quantization has a tree depth R and has a vector dimension is k, and wherein bitstream bit rates O/k, . . . , R/k are provided for said embedded bit stream.
Claim 12
Dependent Claim
140 words
The decoder of claim 2, wherein: said first image has 160×120 pixel resolution, said second image has 320×240 pixel resolution, and wherein said third image has 640×480 pixel resolution; said means for processing decodes a 160×120 pixel image by decompressing base layer data contained within said embedded bit stream; said means for processing decodes a 320×240 pixel image by decompressing said base layer data to obtain a first intermediate image and up-sampling said first intermediate image to yield a first up-sampled image to which is added decompressed error data in a first enhancement layer contained in said embedded bit stream; and said means for processing decodes a 640×480 pixel image by up-sampling said first up-sampled image to yield a second intermediate image to which is added decompressed error data in a second enhancement layer contained in said embedded bit stream.
Claim 13
Dependent Claim
13 words
The decoder of claim 4, wherein said vector quantization includes human perception modelling.
Claim 14
Dependent Claim
208 words
A hardware-based decoder for use with a video delivery system whose server provides an embedded bit stream in pixel blocks including information for at least two spatial resolutions and transmittable over at least one network, the decoder including: a central processor unit coupled to a memory unit including a read-only memory; said read-only memory including preprocessed decoded versions of quantized indexable representations of inverse discrete cosine transforms of image data used by said server in creating codewords present in said embedded bit stream; said preprocessed decoded versions including at least information used to decode a first spatial resolution image by decompressing base layer data contained within said embedded bit stream; and information used to decode a second, higher, spatial resolution image by decompressing said base layer data to obtain a first intermediate image that is up-sampled to yield a first up-sampled image to which is added decompressed error data in a first enhancement layer contained in said embedded bit stream; wherein said server encodes said embedded bit stream by performing a discrete cosine transform followed by tree-structured quantization, and wherein said decoder can decode a viewable image from data in said embedded bit stream from received codewords containing less than a number of bits representing a full-length codeword.
Claim 15
Dependent Claim
208 words
A hardware-based decoder for use with a video delivery system whose server provides an embedded bit stream in pixel blocks including information for at least two spatial resolutions and transmittable over at least one network, the decoder including: a central processor unit coupled to a memory unit including a read-only memory; said read-only memory including preprocessed decoded versions of quantized indexable representations of inverse discrete cosine transforms of image data used by said server in creating codewords present in said embedded bit stream; said preprocessed decoded versions including at least information used to decode a first spatial resolution image by decompressing base layer data contained within said embedded bit stream; and information used to decode a second, higher, spatial resolution image by decompressing said base layer data to obtain a first intermediate image that is up-sampled to yield a first up-sampled image to which is added decompressed error data in a first enhancement layer contained in said embedded bit stream; wherein said server encodes said embedded bit stream by performing a discrete cosine transform followed by tree-structured quantization, and wherein said decoder can decode a viewable image from data in said embedded bit stream from received codewords containing less than a number of bits representing a full-length codeword.
Claim 16
Dependent Claim
72 words
The decoder of claim 12, wherein said embedded bit stream contains at least three spatial resolutions, and wherein said preprocessed decoded versions further include informed used to decode a third spatial resolution image, whose spatial resolution is higher than said second image, by up-sampling said first up-sampled image to yield a second intermediate image to which is added decompressed error data in a second enhancement layer contained in said embedded bit stream.
Claim 17
Dependent Claim
16 words
The decoder of claim 12, wherein said read-only memory stores codewords arranged in a tree structure.
Claim 18
Dependent Claim
13 words
The decoder of claim 12, wherein said vector quantization includes human perception modelling.
Claim 19
Independent Claim
224 words
A method of decoding information received by a decoder used with a video delivery system whose server provides an embedded bit stream in pixel blocks including information for at least two spatial resolutions and transmittable over at least one network, the method including the following steps: (a) providing a stored set of preprocessed decoded versions of quantized indexable representations of inverse discrete cosine transforms of image data used by said server in creating codewords present in said embedded bit stream; (b) processing said information in said embedded bit stream, including using information contained in said bit stream to index into said stored set of preprocessed decoded versions to decode a first spatial resolution image by decompressing base layer data contained within said embedded bit stream and to decode a second, higher, spatial resolution image by decompressing said base layer data to obtain a first intermediate image and up-sampling said first intermediate image to yield a first up-sampled image to which is added decompressed error data in a first enhancement layer contained in said embedded bit stream; wherein said server encodes said embedded bit stream by performing a discrete cosine transform followed by tree-structured quantization, and wherein said decoder can decode a viewable image from data in said embedded bit stream from received codewords containing less than a number of bits representing a full-length codeword.
Claim 20
Independent Claim
224 words
A method of decoding information received by a decoder used with a video delivery system whose server provides an embedded bit stream in pixel blocks including information for at least two spatial resolutions and transmittable over at least one network, the method including the following steps: (a) providing a stored set of preprocessed decoded versions of quantized indexable representations of inverse discrete cosine transforms of image data used by said server in creating codewords present in said embedded bit stream; (b) processing said information in said embedded bit stream, including using information contained in said bit stream to index into said stored set of preprocessed decoded versions to decode a first spatial resolution image by decompressing base layer data contained within said embedded bit stream and to decode a second, higher, spatial resolution image by decompressing said base layer data to obtain a first intermediate image and up-sampling said first intermediate image to yield a first up-sampled image to which is added decompressed error data in a first enhancement layer contained in said embedded bit stream; wherein said server encodes said embedded bit stream by performing a discrete cosine transform followed by tree-structured quantization, and wherein said decoder can decode a viewable image from data in said embedded bit stream from received codewords containing less than a number of bits representing a full-length codeword.
Claim 21
Dependent Claim
64 words
The method of claim 16, wherein said embedded bit stream contains at least three spatial resolutions, and wherein: step (b) includes decoding a third image whose spatial resolution is higher than said second image by up-sampling said first up-sampled image to yield a second intermediate image to which is added decompressed error data in a second enhancement layer contained in said embedded bit stream.
Claim 22
Dependent Claim
37 words
The method of claim 16, wherein said tree-structured vector quantization has a tree depth R, a vector dimension k, and wherein bitstream bit rates O/k, . . . , R/k are provided for said embedded bit stream.
References Cited (Backward Citations)
US4710812A
Cited
US5225904A
Cited
US5309526A
Cited
US5388181A
Cited
US5168356A
Cited
US5533138A
Cited
US5450599A
Cited
US5508746A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-04-20 | 2001-10-20 | 2002-04-21 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-04-20 | 2005-10-20 | 2006-04-21 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-04-20 | 2009-10-20 | 2010-04-21 | $7700.00 | Window Closed / Lapsed |