Patent US5621660A successfully refreshed from Google Patents.
← Back to Patent Explorer
US5621660A Expired / Lapsed US ⏱️ 0.0 years remaining

Software-based encoder for a software-implemented end-to-end scalable video delivery system

Assignee: Oracle America Inc
•
Filing: 1995-04-18
•
Granted: 1997-04-15
•
Expires: 2015-04-18
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A software-based encoder is provided for an end-to-end scalable video delivery system that operates over heterogeneous networks. The encoder utilizes a scalable video compression algorithm based on a Laplacian pyramid decomposition to generate an embedded information stream. The decoder decimates a highest resolution original image, e.g., 640×480 pixels, to produce an intermediate 320×240 pixel image that is decimated to produce an intermediate 160×120 pixel image that is compressed to form an encodable base layer 160×120 pixel image. A decompressed base layer image is also up-sampled at step to produce an up-sampled 640×480 pixel image that is subtracted from the original 640×480 pixel image 200 to yield an error image. At the receiving end, the decoder extracts from the embedded stream different streams at different spatial and temporal resolutions. Because decoding requires only additions and look-ups from a small stored table, decoding occurs in real-time.

Inventors

  • 👤 Navin Chaddha
  • 👤 J. Duane Northcutt
  • 👤 Gerard A. Wall
  • 👤 James G. Hanko

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-23 22:49
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/20; H04N21/25; H04N21/266; H04N21/2662; H04N19/00; H04N19/10; H04N19/134; H04N19/156; H04N19/169; H04N19/186; H04N19/60; H04N19/63; H04N19/90; H04N19/94; H04N21/23; H04N21/234; H04N21/2343; H04N21/234327; H04N21/24; H04N21/2402; H04N21/258; H04N21/25808; H04N21/40; H04N21/43; H04N21/44; H04N21/4402; H04N21/440227; H04N21/45; H04N21/462; H04N21/4621; H04N21/60; H04N21/63; H04N21/631; H04N21/64; H04N21/6405; H04N21/647; H04N21/64784; H04N21/64792; H04N7/00; H04N7/16; H04N7/173; H04N7/17309; H04N7/17336; H04N7/24; H04N19/30; H04N19/39

Claims Analysis

Total Claims: 23
Claim 1
Independent Claim 233 words
For use in a video delivery system server having a source of video images, an encoder providing an embedded bit stream containing information including image data at at least two spatial resolutions, said embedded bit stream being sent over at least one network to at least one decoder, the encoder including: a central processor unit coupled to a memory unit; encoding means, digitally stored in said memory unit and coupled to said source of video images and receiving a first image at first spatial resolution, for decimating said first image to form an first intermediate image at half said highest resolution, for decimating said first intermediate image to form a second intermediate image, for compressing said second intermediate image to form a base layer image whose resolution is less than said first image; said encoding means further decompressing said base layer image to form a third intermediate image, and interpolating said third intermediate image to form a fourth intermediate image, and for subtracting said fourth intermediate image from said first intermediate image to form a fifth intermediate image, and for compressing said fifth intermediate image to form a first enhancement layer image whose resolution is less than said first image but greater than said base layer image; said embedded bit stream having data packets of fixed length code words and containing at least said base layer image and said first enhancement layer image.
Claim 2
Dependent Claim 233 words
For use in a video delivery system server having a source of video images, an encoder providing an embedded bit stream containing information including image data at at least two spatial resolutions, said embedded bit stream being sent over at least one network to at least one decoder, the encoder including: a central processor unit coupled to a memory unit; encoding means, digitally stored in said memory unit and coupled to said source of video images and receiving a first image at first spatial resolution, for decimating said first image to form an first intermediate image at half said highest resolution, for decimating said first intermediate image to form a second intermediate image, for compressing said second intermediate image to form a base layer image whose resolution is less than said first image; said encoding means further decompressing said base layer image to form a third intermediate image, and interpolating said third intermediate image to form a fourth intermediate image, and for subtracting said fourth intermediate image from said first intermediate image to form a fifth intermediate image, and for compressing said fifth intermediate image to form a first enhancement layer image whose resolution is less than said first image but greater than said base layer image; said embedded bit stream having data packets of fixed length code words and containing at least said base layer image and said first enhancement layer image.
Claim 3
Dependent Claim 92 words
The encoder of claim 1, wherein said embedded bit stream contains at least three spatial resolutions including an additional image, whose resolution equals that of said first image, and said base layer image, and wherein said encoding means further interpolates said fourth intermediate image to form a sixth intermediate image that is subtracted from said first image to form a seventh intermediate image that is compressed to form a second enhancement layer image whose resolution equals that of said first image; said embedded bit stream further containing said second enhancement layer image.
Claim 4
Dependent Claim 35 words
The encoder of claim 2, wherein said first image has a resolution of 640×480 pixels, said additional image has a resolution of 320×240 pixels, and said base layer image has a resolution of 160×120 pixels.
Claim 5
Dependent Claim 70 words
The encoder of claim 3, wherein said embedded bit stream includes spatial resolution data encoded in pixel blocks of size 2×2 bits for said base layer image, of size 4×4 bits for said additional image, and of size 8×8 bits for said first image, and wherein said encoding means encodes said spatial resolution data using a discrete cosine transformation followed by a tree-structured vector quantization upon results of said transformation.
Claim 6
Dependent Claim 44 words
The encoder of claim 1, wherein said embedded bit stream includes spatial resolution data encoded in pixel blocks, and wherein said encoding means encodes said spatial resolution data using a discrete cosine transformation followed by a tree-structured vector quantization upon results of said transformation.
Claim 7
Dependent Claim 52 words
The encoder of claim 5, wherein transform coefficients include input-weighted squared error defined as follows: ##EQU2## where y j and y j are components of a transformed vector y and of a corresponding reproduction vector y, and where w j is a component of a weight vector generally dependent only upon y.
Claim 8
Dependent Claim 14 words
The encoder of claim 6, wherein said tree-structured vector quantization includes a perception model.
Claim 9
Dependent Claim 21 words
The encoder of claim 7, wherein said weight vector components reflect human visual sensitivity to quantization errors in different transform coefficients.
Claim 10
Dependent Claim 35 words
The encoder of claim 7, wherein said tree-structured vector quantization has a tree depth R and has a vector dimension is k, and wherein bitstream bit rates O/k, . . . , R/k are provided.
Claim 11
Dependent Claim 50 words
The encoder of claim 7, wherein indices are transmitted in said embedded stream with different index planes; a first index plane containing a first index for a rate 1/k tree-structured vector quantization reference, and a second index plane containing a second index for a rate 2/k tree-structured vector quantization reference.
Claim 12
Dependent Claim 24 words
The encoder of claim 10, wherein said indices are associated with a relative priority of importance of at least some of said data packets.
Claim 13
Dependent Claim 42 words
The encoder of claim 11, wherein said embedded bit stream is sent over a network having throughput insufficient for decoder receipt of a highest spatial image, wherein said relative priority associated with said data packets permits selective non-transmission of relatively unimportant packets.
Claim 14
Dependent Claim 29 words
The encoder of claim 11, wherein data for each video frame is stored together, and wherein each frame has an associated set of index planes with associated packet headers.
Claim 15
Dependent Claim 38 words
The encoder of claim 1, wherein said encoding means further includes at least one option selected from the group consisting of (a) estimation of motion associated with a transmitted image, and (b) conditional replenishment of a said image.
Claim 16
Independent Claim 242 words
A method, for use in a video delivery system server having a source of video images, of encoding an embedded bit stream containing information including image data at at least two spatial resolutions, said embedded bit stream being sent over at least one network to at least one decoder, the method including the following steps: (a) providing a central processor unit coupled to a memory unit; and (b) providing encoding means, digitally stored in said memory unit and coupled to said source of video images and receiving a first image at first spatial resolution, for decimating said first image to form an first intermediate image at half said highest resolution, for decimating said first intermediate image to form a second intermediate image, for compressing said second intermediate image to form a base layer image whose resolution is less than said first image; said encoding means further decompressing said base layer image to form a third intermediate image, and interpolating said third intermediate image to form a fourth intermediate image, and for subtracting said fourth intermediate image from said first intermediate image to form a fifth intermediate image, and for compressing said fifth intermediate image to form a first enhancement layer image whose resolution is less than said first image but greater than said base layer image; said embedded bit stream having data packets of fixed length code words and containing at least said base layer image and said first enhancement layer image.
Claim 17
Independent Claim 242 words
A method, for use in a video delivery system server having a source of video images, of encoding an embedded bit stream containing information including image data at at least two spatial resolutions, said embedded bit stream being sent over at least one network to at least one decoder, the method including the following steps: (a) providing a central processor unit coupled to a memory unit; and (b) providing encoding means, digitally stored in said memory unit and coupled to said source of video images and receiving a first image at first spatial resolution, for decimating said first image to form an first intermediate image at half said highest resolution, for decimating said first intermediate image to form a second intermediate image, for compressing said second intermediate image to form a base layer image whose resolution is less than said first image; said encoding means further decompressing said base layer image to form a third intermediate image, and interpolating said third intermediate image to form a fourth intermediate image, and for subtracting said fourth intermediate image from said first intermediate image to form a fifth intermediate image, and for compressing said fifth intermediate image to form a first enhancement layer image whose resolution is less than said first image but greater than said base layer image; said embedded bit stream having data packets of fixed length code words and containing at least said base layer image and said first enhancement layer image.
Claim 18
Dependent Claim 95 words
The method of claim 15, wherein said embedded bit stream contains at least three spatial resolutions including an additional image, whose resolution equals that of said first image, and said base layer image, and wherein at step (b), said encoding means further interpolates said fourth intermediate image to form a sixth intermediate image that is subtracted from said first image to form a seventh intermediate image that is compressed to form a second enhancement layer image whose resolution equals that of said first image; said embedded bit stream further containing said second enhancement layer image.
Claim 19
Dependent Claim 47 words
The method of claim 15, wherein said embedded bit stream includes spatial resolution data encoded in pixel blocks, and wherein at step (b), said encoding means encodes said spatial resolution data using a discrete cosine transformation followed by a tree-structured vector quantization upon results of said transformation.
Claim 20
Dependent Claim 55 words
The method of claim 17, wherein at step (b), transform coefficients include input-weighted squared error defined as follows: ##EQU3## where y j and y j are components of a transformed vector y and of a corresponding reproduction vector y, and where w j is a component of a weight vector generally dependent only upon y.
Claim 21
Dependent Claim 26 words
The method of claim 18, wherein step (b) includes providing said weight vector components that reflect human visual sensitivity to quantization errors in different transform coefficients.
Claim 22
Dependent Claim 38 words
The method of claim 18, wherein at step (b), said tree-structured vector quantization has a tree depth R and has a vector dimension is k, and wherein bitstream bit rates O/k, . . . , R/k are provided.
Claim 23
Dependent Claim 71 words
The method of claim 18, wherein at step (b), indices are transmitted in said embedded stream with different index planes; a first index plane containing a first index for a rate 1/k tree-structured vector quantization reference, and a second index plane containing a second index for a rate 2/k tree-structured vector quantization reference; said indices being associated with a relative priority of importance of at least some of said data packets.

References Cited (Backward Citations)

US5349383A Cited
US5132992A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2000-04-14 2000-10-14 2001-04-15 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2004-04-14 2004-10-14 2005-04-15 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2008-04-14 2008-10-14 2009-04-15 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag