US6058212A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Motion compensated interframe prediction method based on adaptive motion vector interpolation
Assignee: NEC Corp
•
Filing: 1997-01-14
•
Granted: 2000-05-02
•
Expires: 2017-01-14
Abstract
Abstract In a method of interpolating the motion vectors at all pixel positions in a frame on the basis of the motion vectors at plural predetermined representative points to perform motion compensated prediction of moving pictures, there is adaptively selected one of a method for dividing the frame into plural areas and interpolating the motion vector every area is selected from a conventional method of linearly interpolating a motion vector by using all the surrounding representative points, a method of separately detecting motion vectors for an area, a method of further dividing an area into plural subareas, a method of temporarily converting the values of the motion vectors at the representative points into values to be used for the motion vector interpolation, and a method of setting a fixed value as a prediction value.
Inventors
- 👤 Yutaka Yokoyama
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 21:59
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/50; H04N19/503; H04N19/51; H04N19/537; H04N19/54; H04N5/00; H04N5/14; H04N5/144; H04N5/145
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
251 words
A motion compensated interframe prediction method comprising the steps of: setting plural representative points at positions in a frame or at positions which are outside and in the neighborhood of the frame; detecting first motion vectors at the representative points; dividing the frame into plural areas for which a motion vector interpolating method is adaptively selected; generating first interpolated motion vectors by interpolating, for each area of the plural areas, the first motion vectors on the basis of the representative points on a boundary of an area or on the basis of the representative points contained in the area and areas adjacent thereto; detecting second motion vectors for each area of the plural areas separately from the representative points on the boundary of the area or contained in the area and areas adjacent thereto; generating second interpolated motion vectors for each of the plural areas by interpolating the detected second motion vectors; adaptively selecting either the first interpolated motion vector or the second interpolated motion vector for each area of the plural areas based on which of the first or second interpolated motion vectors requires the least amount of additional coding, wherein said adaptively selecting step selects the first interpolated motion vector interpolating method only when it is expected that the prediction performance can be enhanced to the extent that it offsets an increase of an additive coding amount; and performing motion compensated interframe prediction for each area of the plural areas on the basis of the selected interpolated motion vectors.
Claim 2
Dependent Claim
251 words
A motion compensated interframe prediction method comprising the steps of: setting plural representative points at positions in a frame or at positions which are outside and in the neighborhood of the frame; detecting first motion vectors at the representative points; dividing the frame into plural areas for which a motion vector interpolating method is adaptively selected; generating first interpolated motion vectors by interpolating, for each area of the plural areas, the first motion vectors on the basis of the representative points on a boundary of an area or on the basis of the representative points contained in the area and areas adjacent thereto; detecting second motion vectors for each area of the plural areas separately from the representative points on the boundary of the area or contained in the area and areas adjacent thereto; generating second interpolated motion vectors for each of the plural areas by interpolating the detected second motion vectors; adaptively selecting either the first interpolated motion vector or the second interpolated motion vector for each area of the plural areas based on which of the first or second interpolated motion vectors requires the least amount of additional coding, wherein said adaptively selecting step selects the first interpolated motion vector interpolating method only when it is expected that the prediction performance can be enhanced to the extent that it offsets an increase of an additive coding amount; and performing motion compensated interframe prediction for each area of the plural areas on the basis of the selected interpolated motion vectors.
Claim 3
Dependent Claim
66 words
The method as set forth in claim 1, wherein the method for setting plural representative points is a method of determining the arrangement in which the representative points are located at apexes of rectangular blocks, and the method of detecting the motion vectors uses a block matching method in which a position is more greatly weighted as the position is nearer to the representative point positions.
Claim 4
Dependent Claim
35 words
The method as set forth in claim 1, wherein the method for setting plural representative points includes a method of determining the arrangement in which the representative points are located at apexes of triangular blocks.
Claim 5
Dependent Claim
47 words
The method as set forth in claim 1, wherein the method to interpolate the motion vectors is a method where a motion vector at each pixel in a patch is linearly interpolated from the motion vectors at three apexes of the patch when triangular patches are used.
Claim 6
Dependent Claim
40 words
The method as set forth in claim 1, wherein the method for dividing the frame includes a method for which the frame is divided so that a rectangular patch obtained by linking representative points is directly set as an area.
Claim 7
Dependent Claim
186 words
A motion compensated interframe prediction method comprising the steps of: setting plural representative points contained in a noted area at positions in a frame or at positions which are outside a frame and in the neighborhood of the frame; detecting motion vectors at the representative points; dividing the frame into plural areas for which a motion vector interpolating method is adaptively selected; generating first interpolated motion vectors by interpolating the motion vectors at all the pixel positions in the frame for each area of the plural areas on the basis of the motion vectors at the representative points; further dividing the noted area into subareas in a predetermined divisional pattern; generating second interpolated motion vectors by interpolating the motion vectors which contact a subarea; and adaptively selecting either the first interpolated motion vectors or the second interpolated motion vectors for each area of the plural areas based on which of the first or second interpolated motion vectors requires the least amount of additional coding; and performing motion compensated interframe prediction for each area of the plural areas on the basis of the selected interpolated motion vectors.
Claim 8
Dependent Claim
186 words
A motion compensated interframe prediction method comprising the steps of: setting plural representative points contained in a noted area at positions in a frame or at positions which are outside a frame and in the neighborhood of the frame; detecting motion vectors at the representative points; dividing the frame into plural areas for which a motion vector interpolating method is adaptively selected; generating first interpolated motion vectors by interpolating the motion vectors at all the pixel positions in the frame for each area of the plural areas on the basis of the motion vectors at the representative points; further dividing the noted area into subareas in a predetermined divisional pattern; generating second interpolated motion vectors by interpolating the motion vectors which contact a subarea; and adaptively selecting either the first interpolated motion vectors or the second interpolated motion vectors for each area of the plural areas based on which of the first or second interpolated motion vectors requires the least amount of additional coding; and performing motion compensated interframe prediction for each area of the plural areas on the basis of the selected interpolated motion vectors.
Claim 9
Dependent Claim
66 words
The method as set forth in claim 6, wherein the method for setting plural representative points is a method of determining the arrangement in which the representative points are located at apexes of rectangular blocks, and the method of detecting the motion vectors uses a block matching method in which a position is more greatly weighted as the position is nearer to the representative point positions.
Claim 10
Dependent Claim
35 words
The method as set forth in claim 6, wherein the method for setting plural representative points includes a method of determining the arrangement in which the representative points are located at apexes of triangular blocks.
Claim 11
Dependent Claim
47 words
The method as set forth in claim 6, wherein the method for interpolating the motion vectors is a method where a motion vector at each pixel in a patch is linearly interpolated from the motion vectors at three apexes of the patch when triangular patches are used.
Claim 12
Dependent Claim
40 words
The method as set forth in claim 6, wherein the method for dividing the frame includes a method for which the frame is divided so that a rectangular patch obtained by linking representative points is directly set as an area.
Claim 13
Dependent Claim
133 words
A motion compensated interframe prediction method comprising the steps of: setting plural representative points at positions in a frame or at positions which are outside and in the neighborhood of the frame; detecting motion vectors at the representative points; dividing the frame into plural areas for which a motion vector interpolating method is adaptively selected; adaptively selecting one of a plurality of conversion methods for converting the motion vectors for each area of the plural areas based on which of the plurality of conversion methods requires the least amount of additional coding; converting the motion vectors into converted motion vectors according to the selected conversion method; interpolating the converted motion vectors; and performing motion compensated interframe prediction for each area of the plural areas on the basis of the interpolated converted motion vectors.
Claim 14
Dependent Claim
133 words
A motion compensated interframe prediction method comprising the steps of: setting plural representative points at positions in a frame or at positions which are outside and in the neighborhood of the frame; detecting motion vectors at the representative points; dividing the frame into plural areas for which a motion vector interpolating method is adaptively selected; adaptively selecting one of a plurality of conversion methods for converting the motion vectors for each area of the plural areas based on which of the plurality of conversion methods requires the least amount of additional coding; converting the motion vectors into converted motion vectors according to the selected conversion method; interpolating the converted motion vectors; and performing motion compensated interframe prediction for each area of the plural areas on the basis of the interpolated converted motion vectors.
Claim 15
Dependent Claim
66 words
The method as set forth in claim 11, wherein the method for setting plural representative points is a method of determining the arrangement in which the representative points are located at apexes of rectangular blocks, and the method of detecting the motion vectors uses a block matching method in which a position is more greatly weighted as the position is nearer to the representative point positions.
Claim 16
Dependent Claim
35 words
The method as set forth in claim 11, wherein the method for setting plural representative points includes a method of determining the arrangement in which the representative points are located at apexes of triangular blocks.
Claim 17
Dependent Claim
47 words
The method as set forth in claim 11, wherein the method for interpolating the motion vectors is a method where a motion vector at each pixel in a patch is linearly interpolated from the motion vectors at three apexes of the patch when triangular patches are used.
Claim 18
Dependent Claim
40 words
The method as set forth in claim 11, wherein the method for dividing the frame includes a method for which the frame is divided so that a rectangular patch obtained by linking representative points is directly set as an area.
Claim 19
Dependent Claim
169 words
A motion compensated interframe prediction method comprising the steps of: setting plural representative points at positions in a frame or at positions which are outside and in the neighborhood of the frame; detecting motion vectors at the representative points; dividing the frame into plural areas for which a motion vector interpolating method is adaptively selected; interpolating the motion vectors for each area of the plural areas on the basis of the motion vectors at the representative points; generating a first prediction value for each area of the plural areas by performing a motion compensated interframe prediction using the interpolated motion vectors; setting a fixed value as a second prediction value for each area of the plural areas, the fixed value being predetermined for each area of the plural areas; and adaptively selecting either the first prediction value or the second prediction value based on whether there is any additional coding required for the motion compensated interframe prediction used to generate the first prediction value which exceeds a predetermined value.
Claim 20
Dependent Claim
169 words
A motion compensated interframe prediction method comprising the steps of: setting plural representative points at positions in a frame or at positions which are outside and in the neighborhood of the frame; detecting motion vectors at the representative points; dividing the frame into plural areas for which a motion vector interpolating method is adaptively selected; interpolating the motion vectors for each area of the plural areas on the basis of the motion vectors at the representative points; generating a first prediction value for each area of the plural areas by performing a motion compensated interframe prediction using the interpolated motion vectors; setting a fixed value as a second prediction value for each area of the plural areas, the fixed value being predetermined for each area of the plural areas; and adaptively selecting either the first prediction value or the second prediction value based on whether there is any additional coding required for the motion compensated interframe prediction used to generate the first prediction value which exceeds a predetermined value.
Claim 21
Dependent Claim
66 words
The method as set forth in claim 16, wherein the method for setting plural representative points is a method of determining the arrangement in which the representative points are located at apexes of rectangular blocks, and the method of detecting the motion vectors uses a block matching method in which a position is more greatly weighted as the position is nearer to the representative point positions.
Claim 22
Dependent Claim
35 words
The method as set forth in claim 16, wherein the method for setting plural representative points includes a method of determining the arrangement in which the representative points are located at apexes of triangular blocks.
Claim 23
Dependent Claim
47 words
The method as set forth in claim 16, wherein the method for interpolating the motion vectors is a method where a motion vector at each pixel in a patch is linearly interpolated from the motion vectors at three apexes of the patch when triangular patches are used.
References Cited (Backward Citations)
US5748231A
Cited
US5592228A
Cited
US5689306A
Cited
US5598216A
Cited
US5654771A
Cited
US5623313A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-05-02 | 2003-11-01 | 2004-05-02 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-05-02 | 2007-11-01 | 2008-05-02 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-05-02 | 2011-11-01 | 2012-05-02 | $7700.00 | Window Closed / Lapsed |