US5982438A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Overlapped motion compensation for object coding
Assignee: Microsoft Technology Licensing LLC
•
Filing: 1997-10-29
•
Granted: 1999-11-09
•
Expires: 2017-10-29
Abstract
Abstract To represent the motion of a pixel between successive image frames, this method utilizes the motion information for the transformation block containing the pixel, as well as the motion information for adjacent transformation blocks whenever the adjacent transformation blocks are associated with the same object with which the selected pixel is associated. As a result, transformation errors arising from transformation block discontinuities are decreased and the accuracy and integrity of motion representations of pixels within an object are maintained. Preferably, the motion representations for the transformation blocks are multi-dimensional or affine transformations that are capable of representing complex motions that include any or all of translation, rotation, magnification, and shear.
Inventors
- 👤 Chih-lung Bruce Lin
- 👤 Ming-Chieh Lee
- 👤 Wei-ge Chen
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 20:33
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/50; H04N19/503; H04N19/51; H04N19/537; H04N19/54; H04N19/10; H04N19/169; H04N19/186; H04N19/60; H04N19/61; H04N19/63; H04N19/20
Claims Analysis
Total Claims: 25
Claim 1
Independent Claim
167 words
A motion compensation method for representing motion of pixels between plural video image frames for encoding as compressed video, the method comprising: identifying in a reference video image frame an object feature comprising plural pixels, wherein the object feature has pixel-level boundaries; obtaining motion transform information for each of plural blocks of pixels in a current video image frame; and for each of plural pixels of one of the plural blocks of pixels in the current video image frame, computing a corresponding pixel in the reference video image frame based upon the motion transform information for the block comprising the pixel; computing one or more corresponding pixels in the reference video image frame based upon the motion transform information for at least one block adjacent to the one comprising the pixel; computing a weighted combination based upon the values of the corresponding pixels, plural weighting blocks, and whether the corresponding pixels are located within the pixel-level boundaries of the object feature in the reference video image frame.
Claim 2
Dependent Claim
167 words
A motion compensation method for representing motion of pixels between plural video image frames for encoding as compressed video, the method comprising: identifying in a reference video image frame an object feature comprising plural pixels, wherein the object feature has pixel-level boundaries; obtaining motion transform information for each of plural blocks of pixels in a current video image frame; and for each of plural pixels of one of the plural blocks of pixels in the current video image frame, computing a corresponding pixel in the reference video image frame based upon the motion transform information for the block comprising the pixel; computing one or more corresponding pixels in the reference video image frame based upon the motion transform information for at least one block adjacent to the one comprising the pixel; computing a weighted combination based upon the values of the corresponding pixels, plural weighting blocks, and whether the corresponding pixels are located within the pixel-level boundaries of the object feature in the reference video image frame.
Claim 3
Dependent Claim
26 words
The method of claim 1 further comprising the steps of determining a mask of the object feature and applying the mask when computing the weighted combination.
Claim 4
Dependent Claim
25 words
The method of claim 1 in which computing the weighted combination includes applying no weight to corresponding pixels that are not of the object feature.
Claim 5
Dependent Claim
15 words
The method of claim 1 in which the motion transform information includes affine transformation information.
Claim 6
Dependent Claim
102 words
The method of claim 1 wherein the weighted combination for a pixel is based upon a product: p(t.sub.x (i,j))×h.sub.x (i,j)×m(t.sub.x (i,j)), for each corresponding pixel x in the reference video image frame, in which t x (i,j) represents the corresponding pixel x that is based upon motion transform information, p(t x (i,j)) represents a pixel value of the corresponding pixel x, h x (i,j) represents a weight value from a weighting matrix for the block whose motion transform information is used to compute t x (i,j), and m(t x (i,j)) represents whether the corresponding pixel x is part of the object feature.
Claim 7
Dependent Claim
15 words
A computer-readable medium having stored thereon computer-executable instructions for performing the steps of claim 1.
Claim 8
Dependent Claim
41 words
The method of claim 1 further comprising: before computing a weighted combination, determining whether each of the corresponding pixels in the reference video image frame is located within the pixel-level boundaries of the object feature in the reference video image frame.
Claim 9
Dependent Claim
14 words
The method of claim 1 wherein an extrapolation block boundary encloses the object feature.
Claim 10
Dependent Claim
20 words
The method of claim 8 wherein pixel locations between the extrapolation block boundary and the object feature have null values.
Claim 11
Dependent Claim
150 words
A motion compensation method for representing motion of pixels of a video object between plural video image frames, wherein the video object has pixel-level boundaries, the method comprising: obtaining motion transform information for plural blocks of pixels in a current video image frame; for each of plural pixels of one of the plural blocks of pixels in the current video image frame, computing a corresponding pixel in a reference video image frame based upon the motion transform information for the block comprising the pixel; computing one or more corresponding pixels in the reference video image frame based upon the motion transform information for at least one block adjacent to the one comprising the pixel; computing a weighted combination based upon the values of the corresponding pixels, plural weighting blocks, and whether the corresponding pixels are located within the pixel-level boundaries of the video object in the reference video image frame.
Claim 12
Dependent Claim
150 words
A motion compensation method for representing motion of pixels of a video object between plural video image frames, wherein the video object has pixel-level boundaries, the method comprising: obtaining motion transform information for plural blocks of pixels in a current video image frame; for each of plural pixels of one of the plural blocks of pixels in the current video image frame, computing a corresponding pixel in a reference video image frame based upon the motion transform information for the block comprising the pixel; computing one or more corresponding pixels in the reference video image frame based upon the motion transform information for at least one block adjacent to the one comprising the pixel; computing a weighted combination based upon the values of the corresponding pixels, plural weighting blocks, and whether the corresponding pixels are located within the pixel-level boundaries of the video object in the reference video image frame.
Claim 13
Dependent Claim
15 words
A computer-readable medium having stored thereon computer-executable instructions for performing the steps of claim 10.
Claim 14
Dependent Claim
15 words
The method of claim 10 in which the motion transform information includes affine transformation information.
Claim 15
Dependent Claim
25 words
The method of claim 10 wherein computing the weighted combination includes applying no weight to corresponding pixels that are not part of the video object.
Claim 16
Dependent Claim
26 words
The method of claim 10 further comprising the steps of determining a mask of the video object and applying the mask when computing the weighted combination.
Claim 17
Dependent Claim
21 words
The method of claim 14 wherein each of plural pixels in the mask of the video object comprises a multi-bit value.
Claim 18
Dependent Claim
35 words
The method of claim 10 wherein the motion transform information includes affine transformation information, and wherein computing the weighted combination includes applying no weight to corresponding pixels that are not part of the video object.
Claim 19
Dependent Claim
15 words
A computer-readable medium having stored thereon computer-executable instructions for performing the steps of claim 16.
Claim 20
Dependent Claim
23 words
The method of claim 10 wherein the values of the corresponding pixels indicate whether the corresponding pixels are part of the video object.
Claim 21
Dependent Claim
41 words
The method of claim 10 further comprising: before computing a weighted combination, determining whether each of the corresponding pixels in the reference video image frame is located within the pixel-level boundaries of the video object in the reference video image frame.
Claim 22
Dependent Claim
14 words
The method of claim 10 wherein an extrapolation block boundary encloses the video object.
Claim 23
Dependent Claim
20 words
The method of claim 20 wherein pixel locations between the extrapolation block boundary and the video object have null values.
Claim 24
Dependent Claim
82 words
A computer-readable medium having stored thereon a data structure representing plural pixel values, wherein each of the plural pixel values is a weighted combination is based upon: motion transform information for plural blocks of pixels in a current video image frame; plural corresponding pixel values in a reference video image frame; plural weighting blocks; and whether the plural corresponding pixel values are within the boundaries of a video object in the reference video image frame, wherein the video object has pixel-level boundaries.
Claim 25
Dependent Claim
82 words
A computer-readable medium having stored thereon a data structure representing plural pixel values, wherein each of the plural pixel values is a weighted combination is based upon: motion transform information for plural blocks of pixels in a current video image frame; plural corresponding pixel values in a reference video image frame; plural weighting blocks; and whether the plural corresponding pixel values are within the boundaries of a video object in the reference video image frame, wherein the video object has pixel-level boundaries.
References Cited (Backward Citations)
US4754492A
Cited
US5034986A
Cited
EP0395293A1
Cited
US5214504A
Cited
US5274453A
Cited
US5258836A
Cited
US5706417A
Cited
US5557684A
Cited
US5517327A
Cited
US5594504A
Cited
US5619281A
Cited
US5689306A
Cited
US5581308A
Cited
US5617144A
Cited
US5673339A
Cited
US5598216A
Cited
US5734737A
Cited
US5612743A
Cited
US5546129A
Cited
US5654771A
Cited
US5668608A
Cited
US5627591A
Cited
US5692063A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-11-08 | 2003-05-10 | 2003-11-09 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-11-08 | 2007-05-10 | 2007-11-09 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-11-08 | 2011-05-10 | 2011-11-09 | $7700.00 | Window Closed / Lapsed |