Patent US5802501A successfully refreshed from Google Patents.
Patent US5959673A successfully refreshed from Google Patents.
US5959673A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Transform coding of dense motion vector fields for frame and object based video coding applications
Assignee: Microsoft Technology Licensing LLC
•
Filing: 1996-06-04
•
Granted: 1999-09-28
•
Expires: 2016-06-04
Abstract
Abstract A video compression encoding process compresses or encodes dense motion vector fields to provide and improved compression ratio. In accordance with this method, a dense motion vector field is obtained for an object or a portion of an object between a pair of video image frames. The dense motion vector field may correspond, for example, to an object or other image portion of arbitrary configuration or size. The configuration of the dense motion vector field is extrapolated to a regular, preferably rectangular, configuration to facilitate encoding or compression. The dense motion vector field with its extrapolated regular configuration is encoded or compressed according to conventional encoding transformations such as, for example, discrete cosine transformation (DCT) or lattice wavelet compression.
Inventors
- 👤 Ming-Chieh Lee
- 👤 Wei-ge Chen
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 12:28
CPC Classifications
H; H04; H04N; H04N19/00; G; G06; G06F; G06F17/00; G06F17/10; G06F17/15; G06F17/153; G06T; G06T7/00; G06T7/20; G06T7/223; G06T9/00; G06T9/20; G06V; G06V10/00; G06V10/70; G06V10/74; G06V10/75; G06V10/751; G06V10/7515; H04N19/10; H04N19/169; H04N19/186; H04N19/20; H04N19/23; H04N19/50; H04N19/503; H04N19/51; H04N19/513; H04N19/517; H04N19/537; H04N19/54; H04N19/543; H04N19/563; H04N19/60; H04N19/61; H04N19/63; H04N19/649; G06T2207/00; G06T2207/10; G06T2207/10016
Claims Analysis
Total Claims: 13
Claim 1
Independent Claim
224 words
A compression method of representing changes between corresponding pixels in first and second video image frames, comprising: determining motion vectors for all pixel locations in each region in a set of regions of the first video image frame by estimating the motion of all of the pixels in each region relative to pixels in the second video image frame; wherein the regions correspond to regions of a first image feature having a non-rectangular boundary in the first image frame and the motion vectors for at least one of the regions represent a motion vector field having a non-rectangular shape corresponding to the boundary of the first image feature; transforming the motion vector field having a non-rectangular shape to a motion vector field of rectangular configuration for encoding in the first compressed format, where the rectangular configuration comprises a two dimensional array of motion vectors, and transforming the motion vector field includes assigning motion vectors to pixel locations within the rectangular configuration but not overlapping the non-rectangular shape of the motion vector field; and encoding the motion vectors for each of the regions in a first compressed format to produce compressed motion vectors for each region, including transforming the motion vectors for each region into spatial frequency components and transforming the motion vectors for each pixel location in the rectangular configuration into spatial frequency components.
Claim 2
Dependent Claim
224 words
A compression method of representing changes between corresponding pixels in first and second video image frames, comprising: determining motion vectors for all pixel locations in each region in a set of regions of the first video image frame by estimating the motion of all of the pixels in each region relative to pixels in the second video image frame; wherein the regions correspond to regions of a first image feature having a non-rectangular boundary in the first image frame and the motion vectors for at least one of the regions represent a motion vector field having a non-rectangular shape corresponding to the boundary of the first image feature; transforming the motion vector field having a non-rectangular shape to a motion vector field of rectangular configuration for encoding in the first compressed format, where the rectangular configuration comprises a two dimensional array of motion vectors, and transforming the motion vector field includes assigning motion vectors to pixel locations within the rectangular configuration but not overlapping the non-rectangular shape of the motion vector field; and encoding the motion vectors for each of the regions in a first compressed format to produce compressed motion vectors for each region, including transforming the motion vectors for each region into spatial frequency components and transforming the motion vectors for each pixel location in the rectangular configuration into spatial frequency components.
Claim 3
Dependent Claim
76 words
The method of claim 1 in which the regions correspond to regions of a first image feature in the first image frame and determining the motion vectors includes determining a dense motion vector field between pixels of each of the regions in the first image feature and pixels of a corresponding image feature in the second video image frame, where the first image feature is coded separately from other image features in the first image frame.
Claim 4
Dependent Claim
65 words
The method of claim 1 in which determining the motion vectors includes: identifying a first arrangement of multiple first pixels and a corresponding second arrangement of multiple second pixels in the first and second video image frames, respectively; and identifying plural corresponding pairs of pixels in the first and second arrangements of multiple pixels and determining a motion vector for each corresponding pair of pixels.
Claim 5
Dependent Claim
48 words
The method of claim 3 in which the first and second arrangements of pixels represent first and second image features in the first and second video image frames, respectively, and the first and second image features comprise a non-rectangular video object segmented from the first and second frames.
Claim 6
Dependent Claim
14 words
The method of claim 1 in which the first compressed format includes lossy compression.
Claim 7
Dependent Claim
20 words
The method of claim 1 in which the first compressed format includes a discrete cosine transformation or lattice wavelet compression.
Claim 8
Dependent Claim
38 words
The method of claim 1 in which the first compressed format includes lossy compression and the method further comprises encoding in a second compressed format that includes lossless compression the motion vectors encoded in the first compressed format.
Claim 9
Dependent Claim
254 words
A computer-readable medium storing computer-executable programming for compressing changes between corresponding pixels in first and second video image frames, the medium comprising: programming for determining motion vectors for all pixel locations in each region in a set of regions of the first video image frame by estimating the motion of all of the pixels in each region relative to pixels in the second video image frame; and programming for encoding all of the motion vectors for each of the regions in a first compressed format to produce compressed motion vectors for each region, including transforming the motion vectors for each region into spatial frequency components and quantizing the spatial frequency components; wherein the regions correspond to regions of a first image feature having a non-rectangular boundary in the first image frame and the motion vectors for at least one of the regions represent a motion vector field having a non-rectangular shape corresponding to the boundary of the first image feature, the medium further comprising programming for transforming the motion vector field having a non-rectangular shape to a motion vector field of rectangular configuration for encoding in the first compressed format, where the rectangular configuration comprises a two dimensional array of motion vectors, and the programming for transforming the motion vector field includes programming for assigning motion vectors to pixel locations within the rectangular configuration but not overlapping the non-rectangular shape of the motion vector field; and programming for transforming the motion vectors for each pixel location in the rectangular configuration into spatial frequency components.
Claim 10
Dependent Claim
254 words
A computer-readable medium storing computer-executable programming for compressing changes between corresponding pixels in first and second video image frames, the medium comprising: programming for determining motion vectors for all pixel locations in each region in a set of regions of the first video image frame by estimating the motion of all of the pixels in each region relative to pixels in the second video image frame; and programming for encoding all of the motion vectors for each of the regions in a first compressed format to produce compressed motion vectors for each region, including transforming the motion vectors for each region into spatial frequency components and quantizing the spatial frequency components; wherein the regions correspond to regions of a first image feature having a non-rectangular boundary in the first image frame and the motion vectors for at least one of the regions represent a motion vector field having a non-rectangular shape corresponding to the boundary of the first image feature, the medium further comprising programming for transforming the motion vector field having a non-rectangular shape to a motion vector field of rectangular configuration for encoding in the first compressed format, where the rectangular configuration comprises a two dimensional array of motion vectors, and the programming for transforming the motion vector field includes programming for assigning motion vectors to pixel locations within the rectangular configuration but not overlapping the non-rectangular shape of the motion vector field; and programming for transforming the motion vectors for each pixel location in the rectangular configuration into spatial frequency components.
Claim 11
Dependent Claim
62 words
The medium of claim 8 in which the regions correspond to regions of a first image feature in the first image frame and the medium further comprises programming for determining the motion vectors as a dense motion vector field between each of the regions in the first image feature and pixels of a corresponding image feature in the second video image frame.
Claim 12
Dependent Claim
14 words
The medium of claim 8 in which the first compressed format includes lossy compression.
Claim 13
Dependent Claim
40 words
The medium of claim 8 in which the first compressed format includes lossy compression and the medium further comprises programming for encoding in a second compressed format that includes lossless compression the motion vectors encoded in the first compressed format.
References Cited (Backward Citations)
US3873971A
Cited
US4307377A
Cited
US4630306A
Cited
US4833721A
Cited
US4751742A
Cited
US4727422A
Cited
US4754492A
Cited
US4783833A
Cited
US4802005A
Cited
US4745633A
Cited
US4905295A
Cited
US4961231A
Cited
US5070465A
Cited
US4729020A
Cited
US5031225A
Cited
US4912549A
Cited
US5034986A
Cited
EP0395293A1
Cited
US5073955A
Cited
US5103305A
Cited
US5067014A
Cited
WO1991011782A1
Cited
US5214504A
Cited
US5148497A
Cited
US5117287A
Cited
US5103306A
Cited
US4999705A
Cited
US5155594A
Cited
US5086477A
Cited
US5020121A
Cited
US5274453A
Cited
EP0474307A2
Cited
EP0497586A2
Cited
US5258836A
Cited
US5251030A
Cited
US5294979A
Cited
US5684886A
Cited
US5471535A
Cited
US5259040A
Cited
US5570436A
Cited
US5684509A
Cited
US5295201A
Cited
US5731849A
Cited
US5469226A
Cited
US5376971A
Cited
US5467442A
Cited
US5424783A
Cited
EP0614318A2
Cited
US5557684A
Cited
US5500933A
Cited
US5329311A
Cited
US5598215A
Cited
EP0625853A2
Cited
US5459519A
Cited
US5517327A
Cited
US5477272A
Cited
US5572258A
Cited
US5594504A
Cited
US5642166A
Cited
US5574572A
Cited
US5761341A
Cited
WO1996015892A1
Cited
US5619281A
Cited
US5689306A
Cited
US5581308A
Cited
US5617144A
Cited
US5673339A
Cited
US5694487A
Cited
US5598216A
Cited
US5734737A
Cited
US5621660A
Cited
US5612743A
Cited
US5546129A
Cited
US5654771A
Cited
US5668608A
Cited
WO1997004662A1
Cited
US5627591A
Cited
US5692063A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-09-27 | 2003-03-29 | 2003-09-28 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-09-27 | 2007-03-29 | 2007-09-28 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-09-27 | 2011-03-29 | 2011-09-28 | $7700.00 | Window Closed / Lapsed |