US4245248A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Motion estimation and encoding of video signals in the transform domain
Assignee: AT&T Inc
•
Filing: 1979-04-04
•
Granted: 1981-01-13
•
Expires: 1999-04-04
Abstract
Abstract Video signals are encoded (FIG. 5) using motion compensated prediction which operates on a transform domain representation of the signal. The displacement estimate used for compensation is recursively updated, so that a feedback path exists between the output (205) of the displacement calculator and one of its output (209). The update term is also computed in the transform domain. A decoder (FIG. 6) uses the same prediction technique to recover the original picture.
Inventors
- 👤 Arun N. Netravali
- 👤 John A. Stuller
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 02:48
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/60; H04N19/61; H04N19/619
Claims Analysis
Total Claims: 29
Claim 1
Independent Claim
125 words
A method of encoding a video signal including a series of samples representing the intensities of elements of a picture, including the steps of: (a) linearly transforming the intensity values for a first block of picture elements (pels) to a corresponding set of coefficient values, (b) predicting the values of said coefficients, and (c) encoding an error signal indicative of the difference between ones of said coefficient values and the predicted values thereof, wherein said predicting step is CHARACTERIZED BY (d) estimating the displacement of objects in said picture between a previous frame and the present frame, and (e) predicting said values using the coefficients of a second block of pels in said previous frame which is displaced from said first block by said estimate.
Claim 2
Independent Claim
125 words
A method of encoding a video signal including a series of samples representing the intensities of elements of a picture, including the steps of: (a) linearly transforming the intensity values for a first block of picture elements (pels) to a corresponding set of coefficient values, (b) predicting the values of said coefficients, and (c) encoding an error signal indicative of the difference between ones of said coefficient values and the predicted values thereof, wherein said predicting step is CHARACTERIZED BY (d) estimating the displacement of objects in said picture between a previous frame and the present frame, and (e) predicting said values using the coefficients of a second block of pels in said previous frame which is displaced from said first block by said estimate.
Claim 3
Dependent Claim
22 words
The invention defined in claim 1 wherein said estimating step includes recursively updating each estimate as a function of the previous estimate.
Claim 4
Dependent Claim
44 words
The method defined in claim 2 wherein said updating step includes forming an update term proportional to the product of (a) said difference between a coefficient value and the corresponding predicted value thereof, and (b) a coefficient gradient of said second block of pels.
Claim 5
Dependent Claim
31 words
The method defined in claim 3 wherein said encoding step includes: (1) comparing said difference to a threshold value, and (2) encoding said difference only if said threshold value is exceeded.
Claim 6
Independent Claim
122 words
A method of encoding a series of intensity values each representing an element of a picture, comprising the steps of: (a) transforming the intensity values for a block of pels to a series of coefficients representative thereof, (b) predicting the value of said coefficients based upon the value of coefficients for a block of pels in a previous frame of said picture, and (c) encoding a prediction error signal representing the difference between the actual and predicted values of ones of said coefficients, wherein said predicting step is CHARACTERIZED BY (d) selecting said block of pels in said previous frame in accordance with an estimate of the displacement of objects in said picture occurring between said previous frame and the present frame.
Claim 7
Independent Claim
122 words
A method of encoding a series of intensity values each representing an element of a picture, comprising the steps of: (a) transforming the intensity values for a block of pels to a series of coefficients representative thereof, (b) predicting the value of said coefficients based upon the value of coefficients for a block of pels in a previous frame of said picture, and (c) encoding a prediction error signal representing the difference between the actual and predicted values of ones of said coefficients, wherein said predicting step is CHARACTERIZED BY (d) selecting said block of pels in said previous frame in accordance with an estimate of the displacement of objects in said picture occurring between said previous frame and the present frame.
Claim 8
Dependent Claim
23 words
The method defined in claim 5 wherein said selecting step includes updating each displacement estimate as a function of the previous displacement estimate.
Claim 9
Dependent Claim
50 words
The method defined in claim 6 wherein said updating step includes: (1) storing each displacement estimate, and (2) combining each stored estimate with a term proportional to the product of said difference between actual and predicted values and a coefficient gradient of said block of pels in said previous frame.
Claim 10
Dependent Claim
49 words
The method defined in claim 7 wherein said coefficient gradient is obtained by the steps of: (1) forming line and element differences of the pels in said previous frame block, and (2) transforming said differences to a series of coefficients representative thereof according to the transformation of step (a).
Claim 11
Dependent Claim
14 words
The method defined in claim 8 wherein said transforming step comprises a Hadamard transformation.
Claim 12
Independent Claim
130 words
A method of encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including the steps of: (1) converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation, (2) predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, and (5) selecting stored values for a second block of pels for said prediction based upon said displacement estimate.
Claim 13
Independent Claim
130 words
A method of encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including the steps of: (1) converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation, (2) predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, and (5) selecting stored values for a second block of pels for said prediction based upon said displacement estimate.
Claim 14
Dependent Claim
27 words
The method defined in claim 10 wherein said estimating step includes updating each estimate each time said signal is encoded, as a function of the prior estimate.
Claim 15
Independent Claim
176 words
A method of encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including the steps of: (1) converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation. (2) predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, said estimating step including updating each estimate each time said signal is encoded, as a function of the prior estimate, and (5) selecting stored values for said prediction based upon said displacement estimate, said selecting step including interpolating coefficient values derived from said previous frame to yield the coefficient values for a second block of pels displaced from said first block by said displacement estimate.
Claim 16
Independent Claim
176 words
A method of encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including the steps of: (1) converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation. (2) predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, said estimating step including updating each estimate each time said signal is encoded, as a function of the prior estimate, and (5) selecting stored values for said prediction based upon said displacement estimate, said selecting step including interpolating coefficient values derived from said previous frame to yield the coefficient values for a second block of pels displaced from said first block by said displacement estimate.
Claim 17
Dependent Claim
40 words
The method of claim 12 wherein said update is proportional to the product of (a) said difference between predicted and actual coefficient values and (b) a coefficient value calculated using element and line differences for pels in said second block.
Claim 18
Dependent Claim
19 words
The method defined in claim 13 wherein said encoding step includes comparing said difference to a predetermined threshold value.
Claim 19
Dependent Claim
130 words
Apparatus for encoding a series of intensity values each representing an element of a picture, comprising: (a) means (101) transforming the intensity values for a block of pels to a series of coefficients representative thereof, (b) means (200) for predicting the value of said coefficients based upon the value of coefficients for a block of pels in a previous frame of said picture, and (c) means (103) for encoding a prediction error signal representing the difference between the actual and predicted values of ones of said coefficients, wherein said predicting means is CHARACTERIZED BY (d) means (203, 210) for selecting said block of pels in said previous frame in accordance with an estimate of the displacement of objects in said picture occurring between said previous frame and the present frame.
Claim 20
Dependent Claim
130 words
Apparatus for encoding a series of intensity values each representing an element of a picture, comprising: (a) means (101) transforming the intensity values for a block of pels to a series of coefficients representative thereof, (b) means (200) for predicting the value of said coefficients based upon the value of coefficients for a block of pels in a previous frame of said picture, and (c) means (103) for encoding a prediction error signal representing the difference between the actual and predicted values of ones of said coefficients, wherein said predicting means is CHARACTERIZED BY (d) means (203, 210) for selecting said block of pels in said previous frame in accordance with an estimate of the displacement of objects in said picture occurring between said previous frame and the present frame.
Claim 21
Dependent Claim
26 words
The invention defined in claim 15 wherein said selecting means includes means (208) for updating each displacement estimate as a function of the previous displacement estimate.
Claim 22
Dependent Claim
56 words
The invention defined in claim 16 wherein said selecting means includes: (1) means (206) for storing each displacement estimate, and (2) means (207) for combining each stored estimate with a term proportional to the product of said difference between actual and predicted values and a coefficient gradient in said block of pels in said previous frame.
Claim 23
Dependent Claim
141 words
Apparatus for encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including: (1) means (101) for converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation, (2) means (200) for predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) means (103) for encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) means (210) for estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, and (5) means (203) for selecting stored values for a second block of pels for said prediction based upon said displacement estimate.
Claim 24
Dependent Claim
141 words
Apparatus for encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including: (1) means (101) for converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation, (2) means (200) for predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) means (103) for encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) means (210) for estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, and (5) means (203) for selecting stored values for a second block of pels for said prediction based upon said displacement estimate.
Claim 25
Dependent Claim
30 words
The invention defined in claim 18 wherein said estimating means includes means (208) for updating each estimate each time said signal is encoded, as a function of the prior estimate.
Claim 26
Dependent Claim
194 words
Apparatus for encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including: (1) means (101) for converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation, (2) means (200) for predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) means (103) for encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) means (210) for estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, wherein said estimating means includes means (208) for updating each estimate, each time said signal is encoded, as a function of the prior estimate, and (5) means (203) for selecting stored values for said prediction based upon said displacement estimate, wherein said selecting means includes means (536) for interpolating coefficient values derived from said previous frame to yield coefficient values for a second block of pels displaced from said first block by said displacement estimate.
Claim 27
Dependent Claim
194 words
Apparatus for encoding a video signal which includes a series of samples each indicating the intensity of an element of a picture, including: (1) means (101) for converting the intensity values for a first block of pels to a series of coefficient values through a linear transformation, (2) means (200) for predicting the values of each of said coefficients based upon stored intensity values for elements in a previous frame of said picture, and (3) means (103) for encoding said signal as a function of the difference between predicted and actual coefficient values, CHARACTERIZED BY (4) means (210) for estimating the displacement of objects in said picture occurring in the period between said prior frame and the present frame, wherein said estimating means includes means (208) for updating each estimate, each time said signal is encoded, as a function of the prior estimate, and (5) means (203) for selecting stored values for said prediction based upon said displacement estimate, wherein said selecting means includes means (536) for interpolating coefficient values derived from said previous frame to yield coefficient values for a second block of pels displaced from said first block by said displacement estimate.
Claim 28
Dependent Claim
47 words
The invention of claim 20 wherein said updating means (208) is arranged to form an output proportional to the product of (a) said difference between predicted and actual coefficient values and (b) a coefficient value calculated using element and line differences for pels in said second block.
Claim 29
Dependent Claim
22 words
The invention defined in claim 21 wherein said encoding means includes means (510) for comparing said difference to a predetermined threshold value.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1984-01-13 | 1984-07-14 | 1985-01-13 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1988-01-13 | 1988-07-14 | 1989-01-13 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 1992-01-13 | 1992-07-14 | 1993-01-13 | $7700.00 | Window Closed / Lapsed |