← Back to Patent Explorer
US4245248A Expired / Lapsed US ⏱️ 0.0 years remaining

Motion estimation and encoding of video signals in the transform domain

Assignee: AT&T Inc
•
Filing: 1979-04-04
•
Granted: 1981-01-13
•
Expires: 1999-04-04
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Video signals are encoded (FIG. 5) using motion compensated prediction which operates on a transform domain representation of the signal. The displacement estimate used for compensation is recursively updated, so that a feedback path exists between the output (205) of the displacement calculator and one of its output (209). The update term is also computed in the transform domain. A decoder (FIG. 6) uses the same prediction technique to recover the original picture.

Inventors

  • 👤 Arun N. Netravali
  • 👤 John A. Stuller

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-24 02:48
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/60; H04N19/61; H04N19/619

Claims Analysis

Total Claims: 29
Claim 1
Independent Claim 125 words
A method of encoding a video signal including a series of samples representing the intensities of elements of a picture, including the steps of: (a) linearly transforming the intensity values for a first block of picture elements (pels) to a corresponding set of coefficient values, (b) predicting the values of said coefficients, and (c) encoding an error signal indicative of the difference between ones of said coefficient values and the predicted values thereof, wherein said predicting step is CHARACTERIZED BY (d) estimating the displacement of objects in said picture between a previous frame and the present frame, and (e) predicting said values using the coefficients of a second block of pels in said previous frame which is displaced from said first block by said estimate.
Claim 2
Independent Claim 125 words
A method of encoding a video signal including a series of samples representing the intensities of elements of a picture, including the steps of: (a) linearly transforming the intensity values for a first block of picture elements (pels) to a corresponding set of coefficient values, (b) predicting the values of said coefficients, and (c) encoding an error signal indicative of the difference between ones of said coefficient values and the predicted values thereof, wherein said predicting step is CHARACTERIZED BY (d) estimating the displacement of objects in said picture between a previous frame and the present frame, and (e) predicting said values using the coefficients of a second block of pels in said previous frame which is displaced from said first block by said estimate.
Claim 3
Dependent Claim 22 words
The invention defined in claim 1 wherein said estimating step includes recursively updating each estimate as a function of the previous estimate.
Claim 4
Dependent Claim 44 words
The method defined in claim 2 wherein said updating step includes forming an update term proportional to the product of (a) said difference between a coefficient value and the corresponding predicted value thereof, and (b) a coefficient gradient of said second block of pels.
Claim 5
Dependent Claim 31 words
The method defined in claim 3 wherein said encoding step includes: (1) comparing said difference to a threshold value, and (2) encoding said difference only if said threshold value is exceeded.
Claim 6
Independent Claim 122 words
A method of encoding a series of intensity values each representing an element of a picture, comprising the steps of: (a) transforming the intensity values for a block of pels to a series of coefficients representative thereof, (b) predicting the value of said coefficients based upon the value of coefficients for a block of pels in a previous frame of said picture, and (c) encoding a prediction error signal representing the difference between the actual and predicted values of ones of said coefficients, wherein said predicting step is CHARACTERIZED BY (d) selecting said block of pels in said previous frame in accordance with an estimate of the displacement of objects in said picture occurring between said previous frame and the present frame.
Claim 7
Independent Claim 122 words
A method of encoding a series of intensity values each representing an element of a picture, comprising the steps of: (a) transforming the intensity values for a block of pels to a series of coefficients representative thereof, (b) predicting the value of said coefficients based upon the value of coefficients for a block of pels in a previous frame of said picture, and (c) encoding a prediction error signal representing the difference between the actual and predicted values of ones of said coefficients, wherein said predicting step is CHARACTERIZED BY (d) selecting said block of pels in said previous frame in accordance with an estimate of the displacement of objects in said picture occurring between said previous frame and the present frame.
Claim 8
Dependent Claim 23 words
The method defined in claim 5 wherein said selecting step includes updating each displacement estimate as a function of the previous displacement estimate.
Claim 9
Dependent Claim 50 words
The method defined in claim 6 wherein said updating step includes: (1) storing each displacement estimate, and (2) combining each stored estimate with a term proportional to the product of said difference between actual and predicted values and a coefficient gradient of said block of pels in said previous frame.
Claim 10
Dependent Claim 49 words
The method defined in claim 7 wherein said coefficient gradient is obtained by the steps of: (1) forming line and element differences of the pels in said previous frame block, and (2) transforming said differences to a series of coefficients representative thereof according to the transformation of step (a).
Claim 11
Dependent Claim 14 words
The method defined in claim 8 wherein said transforming step comprises a Hadamard transformation.
Claim 12
Independent Claim 130 words
A method of encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including the steps of: (1) converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation, (2) predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, and (5) selecting stored values for a second block of pels for said prediction based upon said displacement estimate.
Claim 13
Independent Claim 130 words
A method of encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including the steps of: (1) converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation, (2) predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, and (5) selecting stored values for a second block of pels for said prediction based upon said displacement estimate.
Claim 14
Dependent Claim 27 words
The method defined in claim 10 wherein said estimating step includes updating each estimate each time said signal is encoded, as a function of the prior estimate.
Claim 15
Independent Claim 176 words
A method of encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including the steps of: (1) converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation. (2) predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, said estimating step including updating each estimate each time said signal is encoded, as a function of the prior estimate, and (5) selecting stored values for said prediction based upon said displacement estimate, said selecting step including interpolating coefficient values derived from said previous frame to yield the coefficient values for a second block of pels displaced from said first block by said displacement estimate.
Claim 16
Independent Claim 176 words
A method of encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including the steps of: (1) converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation. (2) predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, said estimating step including updating each estimate each time said signal is encoded, as a function of the prior estimate, and (5) selecting stored values for said prediction based upon said displacement estimate, said selecting step including interpolating coefficient values derived from said previous frame to yield the coefficient values for a second block of pels displaced from said first block by said displacement estimate.
Claim 17
Dependent Claim 40 words
The method of claim 12 wherein said update is proportional to the product of (a) said difference between predicted and actual coefficient values and (b) a coefficient value calculated using element and line differences for pels in said second block.
Claim 18
Dependent Claim 19 words
The method defined in claim 13 wherein said encoding step includes comparing said difference to a predetermined threshold value.
Claim 19
Dependent Claim 130 words
Apparatus for encoding a series of intensity values each representing an element of a picture, comprising: (a) means (101) transforming the intensity values for a block of pels to a series of coefficients representative thereof, (b) means (200) for predicting the value of said coefficients based upon the value of coefficients for a block of pels in a previous frame of said picture, and (c) means (103) for encoding a prediction error signal representing the difference between the actual and predicted values of ones of said coefficients, wherein said predicting means is CHARACTERIZED BY (d) means (203, 210) for selecting said block of pels in said previous frame in accordance with an estimate of the displacement of objects in said picture occurring between said previous frame and the present frame.
Claim 20
Dependent Claim 130 words
Apparatus for encoding a series of intensity values each representing an element of a picture, comprising: (a) means (101) transforming the intensity values for a block of pels to a series of coefficients representative thereof, (b) means (200) for predicting the value of said coefficients based upon the value of coefficients for a block of pels in a previous frame of said picture, and (c) means (103) for encoding a prediction error signal representing the difference between the actual and predicted values of ones of said coefficients, wherein said predicting means is CHARACTERIZED BY (d) means (203, 210) for selecting said block of pels in said previous frame in accordance with an estimate of the displacement of objects in said picture occurring between said previous frame and the present frame.
Claim 21
Dependent Claim 26 words
The invention defined in claim 15 wherein said selecting means includes means (208) for updating each displacement estimate as a function of the previous displacement estimate.
Claim 22
Dependent Claim 56 words
The invention defined in claim 16 wherein said selecting means includes: (1) means (206) for storing each displacement estimate, and (2) means (207) for combining each stored estimate with a term proportional to the product of said difference between actual and predicted values and a coefficient gradient in said block of pels in said previous frame.
Claim 23
Dependent Claim 141 words
Apparatus for encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including: (1) means (101) for converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation, (2) means (200) for predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) means (103) for encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) means (210) for estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, and (5) means (203) for selecting stored values for a second block of pels for said prediction based upon said displacement estimate.
Claim 24
Dependent Claim 141 words
Apparatus for encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including: (1) means (101) for converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation, (2) means (200) for predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) means (103) for encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) means (210) for estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, and (5) means (203) for selecting stored values for a second block of pels for said prediction based upon said displacement estimate.
Claim 25
Dependent Claim 30 words
The invention defined in claim 18 wherein said estimating means includes means (208) for updating each estimate each time said signal is encoded, as a function of the prior estimate.
Claim 26
Dependent Claim 194 words
Apparatus for encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including: (1) means (101) for converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation, (2) means (200) for predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) means (103) for encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) means (210) for estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, wherein said estimating means includes means (208) for updating each estimate, each time said signal is encoded, as a function of the prior estimate, and (5) means (203) for selecting stored values for said prediction based upon said displacement estimate, wherein said selecting means includes means (536) for interpolating coefficient values derived from said previous frame to yield coefficient values for a second block of pels displaced from said first block by said displacement estimate.
Claim 27
Dependent Claim 194 words
Apparatus for encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including: (1) means (101) for converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation, (2) means (200) for predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) means (103) for encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) means (210) for estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, wherein said estimating means includes means (208) for updating each estimate, each time said signal is encoded, as a function of the prior estimate, and (5) means (203) for selecting stored values for said prediction based upon said displacement estimate, wherein said selecting means includes means (536) for interpolating coefficient values derived from said previous frame to yield coefficient values for a second block of pels displaced from said first block by said displacement estimate.
Claim 28
Dependent Claim 47 words
The invention of claim 20 wherein said updating means (208) is arranged to form an output proportional to the product of (a) said difference between predicted and actual coefficient values and (b) a coefficient value calculated using element and line differences for pels in said second block.
Claim 29
Dependent Claim 22 words
The invention defined in claim 21 wherein said encoding means includes means (510) for comparing said difference to a predetermined threshold value.

References Cited (Backward Citations)

US3632865A Cited
US3679821A Cited
US3984626A Cited
US4193096A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1984-01-13 1984-07-14 1985-01-13 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 1988-01-13 1988-07-14 1989-01-13 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 1992-01-13 1992-07-14 1993-01-13 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag