US5793429A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Methods of estimating motion in image data and apparatus for performing same
Assignee: Samsung Electronics Co Ltd
•
Filing: 1996-05-10
•
Granted: 1998-08-11
•
Expires: 2016-05-10
Abstract
Abstract Methods of estimating motion in image data include the steps of producing a first frame of image data from a received video signal containing information of an image data frame of higher predetermined resolution (e.g., 352x244 pixels) and producing a second image data frame of coarser resolution (e.g., 88x61 pixels) relative to the first image data frame. An estimate of motion in the second image data frame is then produced and used to determine a estimate of motion in the first image data frame of higher resolution. The estimate of motion in the first image data frame is then used to obtain an estimate of motion in the received image data frame of predetermined full resolution. The estimate of motion in the second image data frame can be determined by reading a plurality of motion vectors from an image block in a previous version of the second image data frame and reading image data in a reference block in a current version of the second image data frame. To obtain this estimate, an optimum motion vector is determined by predicting a plurality of motion vectors based on a corresponding plurality of motion models and selecting the best model and vector which yields the smallest difference signal. Once an optimum motion vector has been predicted, the plurality of motion vectors previously read are adjusted relative to the optimum motion vector. Then a determination is made as to which one of the plurality of vectors yields the smallest relative motion error so that this vector can be used as an estimation of motion from the previous version of the second image data frame to the current version of the second image data frame. These steps are then performed again for the first image data frame of higher resolution.
Inventors
- 👤 Jae-Min Kim
- 👤 Young-Bum Jang
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-03 18:11
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/50; H04N19/503; H04N19/51; H04N19/53; G; G06; G06T; G06T7/00; G06T7/20; G06T7/223; G06T7/238; G06T2207/00; G06T2207/10; G06T2207/10016
Claims Analysis
Total Claims: 26
Claim 1
Independent Claim
185 words
A method of estimating motion in image data, comprising the steps of: producing a first image data frame from an image data frame of first resolution, so that the first image data frame is of reduced resolution relative to the image data frame of first resolution; producing a second image data frame from the image data frame of first resolution or the first image data frame, so that the second image data frame is of reduced resolution relative to the first image data frame; estimating motion in the second image data frame to obtain a first estimation, by: predicting a motion vector based on a motion model; reading image data in a first search region within the second image data frame, based on the predicted motion vector; determining a first motion vector based on the predicted motion vector; and determining a sum of absolute difference based on the first motion vector, estimating motion in the first image data frame based on the first estimation, to obtain a second estimation: and estimating motion in the image data frame of first resolution based on the second estimation.
Claim 2
Independent Claim
185 words
A method of estimating motion in image data, comprising the steps of: producing a first image data frame from an image data frame of first resolution, so that the first image data frame is of reduced resolution relative to the image data frame of first resolution; producing a second image data frame from the image data frame of first resolution or the first image data frame, so that the second image data frame is of reduced resolution relative to the first image data frame; estimating motion in the second image data frame to obtain a first estimation, by: predicting a motion vector based on a motion model; reading image data in a first search region within the second image data frame, based on the predicted motion vector; determining a first motion vector based on the predicted motion vector; and determining a sum of absolute difference based on the first motion vector, estimating motion in the first image data frame based on the first estimation, to obtain a second estimation: and estimating motion in the image data frame of first resolution based on the second estimation.
Claim 3
Independent Claim
219 words
A method of estimating motion in image data, comprising the steps of: producing a first image data frame from an image data frame of first resolution, so that the first image data frame is of reduced resolution relative to the image data frame of first resolution: producing a second image data frame from the image data frame of first resolution or the first image data frame, so that the second image data frame is of reduced resolution relative to the first image data frame: estimating motion in the second image data frame to obtain a first estimation, by: reading a plurality of motion vectors; reading image data in a reference block in the second image data frame; predicting an optimum motion vector based on a motion model; reading image data in a first search region adjacent the predicted optimum motion vector; adjusting one of said plurality of motion vectors relative to the predicted optimum motion vector, to obtain a first motion vector; and determining a first sum of absolute difference between the reference block and a block of image data at the first motion vector, estimating motion in the first image data frame based on the first estimation, to obtain a second estimation; and estimating motion in the image data frame of first resolution based on the second estimation.
Claim 4
Independent Claim
219 words
A method of estimating motion in image data, comprising the steps of: producing a first image data frame from an image data frame of first resolution, so that the first image data frame is of reduced resolution relative to the image data frame of first resolution: producing a second image data frame from the image data frame of first resolution or the first image data frame, so that the second image data frame is of reduced resolution relative to the first image data frame: estimating motion in the second image data frame to obtain a first estimation, by: reading a plurality of motion vectors; reading image data in a reference block in the second image data frame; predicting an optimum motion vector based on a motion model; reading image data in a first search region adjacent the predicted optimum motion vector; adjusting one of said plurality of motion vectors relative to the predicted optimum motion vector, to obtain a first motion vector; and determining a first sum of absolute difference between the reference block and a block of image data at the first motion vector, estimating motion in the first image data frame based on the first estimation, to obtain a second estimation; and estimating motion in the image data frame of first resolution based on the second estimation.
Claim 5
Dependent Claim
38 words
The method of claim 2, wherein said step of reading image data in a first search region adjacent the predicted optimum motion vector comprises reading image data in a first search region surrounding the predicted optimum motion vector.
Claim 6
Dependent Claim
92 words
The method of claim 2, further comprising the steps of: adjusting another of said plurality of motion vectors relative to the predicted optimum motion vector, to obtain a second motion vector; determining a second sum of absolute difference between the reference block and a block of image data at the second motion vector; and determining the first motion vector as an estimate of motion in the second image data frame instead of the second motion vector, if the first sum of absolute difference is less than the second sum of absolute difference.
Claim 7
Dependent Claim
68 words
The method of claim 2, wherein said step of predicting an optimum motion vector based on a motion model comprises the steps of: predicting a motion vector using a model; and determining a sum of absolute difference between a reference block and a prediction block in the second image data frame when the reference block is predicted from a previous image data frame using the predicted motion vector.
Claim 8
Dependent Claim
29 words
The method of claim 5, wherein said step of predicting a motion vector using a model comprises predicting a plurality of motion vectors using a corresponding plurality of models.
Claim 9
Dependent Claim
50 words
The method of claim 6, further comprising the steps of determining a plurality of sums of absolute difference between the reference block and a plurality of prediction blocks in the second image data frame which are determined from the reference block and corresponding ones of the plurality of motion vectors.
Claim 10
Dependent Claim
21 words
The method of claim 7, further comprising the step of determining the lowest value of the plurality sums of absolute difference.
Claim 11
Dependent Claim
175 words
The method of claim 2, wherein said step of predicting an optimum motion vector based on a motion model comprises the steps of: predicting a motion vector using a first model; determining a sum of absolute difference between a reference block and a prediction block in the second image data frame when the reference block is predicted from a previous image data frame using the predicted motion vector based on the first model; predicting a motion vector using a second model; determining a sum of absolute difference between a reference block and a prediction block in the second image data frame when the reference block is predicted from a previous image data frame using the predicted motion vector based on the second model; and determining the predicted motion vector based on the first model as an optimum motion vector, if the sum of absolute difference determined using the predicted motion vector based on the first model is less than the sum of absolute difference determined using the predicted motion vector based on the second model.
Claim 12
Independent Claim
246 words
A method of estimating motion in image data, comprising the steps of: producing a first image data frame from an image data frame of first resolution, so that the first image data frame is of reduced resolution relative to the image data frame of first resolution: producing a second image data frame from the image data frame of first resolution or the first image data frame, so that the second image data frame is of reduced resolution relative to the first image data frame: producing a third image data frame from the image data frame of first resolution, the first image data frame or the second image data frame, so that the third image data frame is of reduced resolution relative to the second image data frame: estimating motion in the third image data frame to obtain a first estimation, by: predicting a motion vector based on a motion model; reading image data in a first search region within the third image data frame, based on the predicted motion vector; determining a first motion vector based on the predicted motion vector; and determining a sum of absolute difference based on the first motion vector; estimating motion in the second image data frame based on the first estimation, to obtain a second estimation: estimating motion in the first image data frame based on the second estimation, to obtain a third estimation: and estimating motion in the image data frame of first resolution based on the third estimation.
Claim 13
Independent Claim
246 words
A method of estimating motion in image data, comprising the steps of: producing a first image data frame from an image data frame of first resolution, so that the first image data frame is of reduced resolution relative to the image data frame of first resolution: producing a second image data frame from the image data frame of first resolution or the first image data frame, so that the second image data frame is of reduced resolution relative to the first image data frame: producing a third image data frame from the image data frame of first resolution, the first image data frame or the second image data frame, so that the third image data frame is of reduced resolution relative to the second image data frame: estimating motion in the third image data frame to obtain a first estimation, by: predicting a motion vector based on a motion model; reading image data in a first search region within the third image data frame, based on the predicted motion vector; determining a first motion vector based on the predicted motion vector; and determining a sum of absolute difference based on the first motion vector; estimating motion in the second image data frame based on the first estimation, to obtain a second estimation: estimating motion in the first image data frame based on the second estimation, to obtain a third estimation: and estimating motion in the image data frame of first resolution based on the third estimation.
Claim 14
Independent Claim
280 words
A method of estimating motion in image data, comprising the steps of: producing a first image data frame from an image data frame of first resolution, so that the first image data frame is of reduced resolution relative to the image data frame of first resolution: producing a second image data frame from the image data frame of first resolution or the first image data frame, so that the second image data frame is of reduced resolution relative to the first image data frame: producing a third image data frame from the image data frame of first resolution, the first image data frame or the second image data frame, so that the third image data frame is of reduced resolution relative to the second image data frame: estimating motion in the third image data frame to obtain a first estimation, by: reading a plurality of motion vectors; reading image data in a reference block in the third image data frame; predicting an optimum motion vector based on a motion model; reading image data in a first search region adjacent the predicted optimum motion vector; adjusting one of said plurality of motion vectors relative to the predicted optimum motion vector, to obtain a first motion vector; and determining a first sum of absolute difference between the reference block and a block of image data at the first motion vector; estimating motion in the second image data frame based on the first estimation, to obtain a second estimation: estimating motion in the first image data frame based on the second estimation, to obtain a third estimation: and estimating motion in the image data frame of first resolution based on the third estimation.
Claim 15
Independent Claim
280 words
A method of estimating motion in image data, comprising the steps of: producing a first image data frame from an image data frame of first resolution, so that the first image data frame is of reduced resolution relative to the image data frame of first resolution: producing a second image data frame from the image data frame of first resolution or the first image data frame, so that the second image data frame is of reduced resolution relative to the first image data frame: producing a third image data frame from the image data frame of first resolution, the first image data frame or the second image data frame, so that the third image data frame is of reduced resolution relative to the second image data frame: estimating motion in the third image data frame to obtain a first estimation, by: reading a plurality of motion vectors; reading image data in a reference block in the third image data frame; predicting an optimum motion vector based on a motion model; reading image data in a first search region adjacent the predicted optimum motion vector; adjusting one of said plurality of motion vectors relative to the predicted optimum motion vector, to obtain a first motion vector; and determining a first sum of absolute difference between the reference block and a block of image data at the first motion vector; estimating motion in the second image data frame based on the first estimation, to obtain a second estimation: estimating motion in the first image data frame based on the second estimation, to obtain a third estimation: and estimating motion in the image data frame of first resolution based on the third estimation.
Claim 16
Dependent Claim
38 words
The method of claim 11, wherein said step of reading image data in a first search region adjacent the predicted optimum motion vector comprises reading image data in a first search region surrounding the predicted optimum motion vector.
Claim 17
Dependent Claim
92 words
The method of claim 11, further comprising the steps of: adjusting another of said plurality of motion vectors relative to the predicted optimum motion vector, to obtain a second motion vector; determining a second sum of absolute difference between the reference block and a block of image data at the second motion vector; and determining the first motion vector as an estimate of motion in the third image data frame instead of the second motion vector, if the first sum of absolute difference is less than the second sum of absolute difference.
Claim 18
Dependent Claim
68 words
The method of claim 11, wherein said step of predicting an optimum motion vector based on a motion model comprises the steps of: predicting a motion vector using a model; and determining a sum of absolute difference between a reference block and a prediction block in the third image data frame when the reference block is predicted from a previous image data frame using the predicted motion vector.
Claim 19
Dependent Claim
29 words
The method of claim 14, wherein said step of predicting a motion vector using a model comprises predicting a plurality of motion vectors using a corresponding plurality of models.
Claim 20
Dependent Claim
50 words
The method of claim 15, further comprising the steps of determining a plurality of sums of absolute difference between the reference block and a plurality of prediction blocks in the third image data frame which are determined from the reference block and corresponding ones of the plurality of motion vectors.
Claim 21
Dependent Claim
21 words
The method of claim 16, further comprising the step of determining the lowest value of the plurality sums of absolute difference.
Claim 22
Dependent Claim
175 words
The method of claim 11, wherein said step of predicting an optimum motion vector based on a motion model comprises the steps of: predicting a motion vector using a first model; determining a sum of absolute difference between a reference block and a prediction block in the third image data frame when the reference block is predicted from a previous image data frame using the predicted motion vector based on the first model; predicting a motion vector using a second model; determining a sum of absolute difference between a reference block and a prediction block in the third image data frame when the reference block is predicted from a previous image data frame using the predicted motion vector based on the second model; and determining the predicted motion vector based on the first model as an optimum motion vector, if the sum of absolute difference determined using the predicted motion vector based on the first model is less than the sum of absolute difference determined using the predicted motion vector based on the second model.
Claim 23
Independent Claim
269 words
An apparatus for compressing motion video data by performing motion estimation, comprising: means for receiving a video signal containing information to construct an image data frame of first resolution; means, coupled to said receiving means, for producing information to construct a first image data frame of reduced resolution relative to the image data frame of first resolution and information to construct a second image data frame of reduced resolution relative to the first image data frame; means, coupled to said information producing means, for estimating motion in the second image data frame to obtain a first estimation and for estimating motion in the first image data frame, based on the first estimation, to obtain a second estimation, said estimating means comprising: means for reading a plurality of motion vectors and reading image data in a reference block in the second image data frame; means for predicting an optimum motion vector based on a motion model; means, responsive to said reading means and predicting means, for reading image data in a first search region in the second image data frame, adjacent the predicted optimum motion vector; means for adjusting one of said plurality of motion vectors relative to the predicted optimum motion vector, to obtain a first motion vector; and means, responsive to said adjusting means, for determining a first sum of absolute difference between the reference block and a block of image data at the first motion vector; and means responsive to said estimating means, for transmitting a video signal containing an estimate of motion occurring in the image data frame of first resolution, based on the second estimation.
Claim 24
Independent Claim
269 words
An apparatus for compressing motion video data by performing motion estimation, comprising: means for receiving a video signal containing information to construct an image data frame of first resolution; means, coupled to said receiving means, for producing information to construct a first image data frame of reduced resolution relative to the image data frame of first resolution and information to construct a second image data frame of reduced resolution relative to the first image data frame; means, coupled to said information producing means, for estimating motion in the second image data frame to obtain a first estimation and for estimating motion in the first image data frame, based on the first estimation, to obtain a second estimation, said estimating means comprising: means for reading a plurality of motion vectors and reading image data in a reference block in the second image data frame; means for predicting an optimum motion vector based on a motion model; means, responsive to said reading means and predicting means, for reading image data in a first search region in the second image data frame, adjacent the predicted optimum motion vector; means for adjusting one of said plurality of motion vectors relative to the predicted optimum motion vector, to obtain a first motion vector; and means, responsive to said adjusting means, for determining a first sum of absolute difference between the reference block and a block of image data at the first motion vector; and means responsive to said estimating means, for transmitting a video signal containing an estimate of motion occurring in the image data frame of first resolution, based on the second estimation.
Claim 25
Dependent Claim
64 words
The apparatus of claim 19, wherein said means for predicting an optimum motion vector comprises: means for predicting a motion vector using a model; and means for determining a sum of absolute difference between a reference block and a prediction block in the second image data frame when the reference block is predicted from a previous image data frame using the predicted motion vector.
Claim 26
Dependent Claim
184 words
The apparatus of claim 19, wherein said means for predicting an optimum motion vector comprises: means for predicting a motion vector using a first model; means for determining a sum of absolute difference between a reference block and a prediction block in the second image data frame when the reference block is predicted from a previous image data frame using the predicted motion vector based on the first model; means for predicting a motion vector using a second model; means for determining a sum of absolute difference between a reference block and a prediction block in the second image data frame when the reference block is predicted from a previous image data frame using the predicted motion vector based on the second model; and means, responsive to said predicting and determining means, for determining the predicted motion vector based on the first model as an optimum motion vector, if the sum of absolute difference determined using the predicted motion vector based on the first model is less than the sum of absolute difference determined using the predicted motion vector based on the second model.
References Cited (Backward Citations)
US5278915A
Cited
US5410358A
Cited
US5489949A
Cited
US5436665A
Cited
US5392073A
Cited
US5276513A
Cited
US5467086A
Cited
US5365281A
Cited
US5497153A
Cited
US5508745A
Cited
US5510857A
Cited
US5493344A
Cited
US5576772A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-08-10 | 2002-02-09 | 2002-08-11 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-08-10 | 2006-02-09 | 2006-08-11 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-08-10 | 2010-02-09 | 2010-08-11 | $7700.00 | Window Closed / Lapsed |