Patent US5822007A successfully refreshed from Google Patents.
← Back to Patent Explorer
US5822007A Expired / Lapsed US ⏱️ 0.0 years remaining

Method and apparatus for motion estimation using block matching

Assignee: Vantiva SA
•
Filing: 1994-08-30
•
Granted: 1998-10-13
•
Expires: 2014-08-30
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Block matching is well known as a robust and intuitively simple method of motion estimation for television pictures. However, when the purpose of the motion estimation is to provide accurate interpolation between images, conventional block matching suffers from the problem that the blocks are situated in the original fields rather than in the fields to be interpolated, leading to possible errors in the calculated motion field. The invention uses two-sided block matching. The search window is shared between the two input fields so that the candidate motion vectors related to be candidate pixel blocks all pass through the same points in the field to be interpolated. Thus, the "current block" becomes a notional area in the field to be interpolated, and each of the two search windows extends to half the maximum motion vector in each direction. Each motion vector points forward to the forward field by half its value and backward to the backward field by half its value. Two-sided block matching solves the positional error problem because the current blocks cover the interpolated field and are correctly placed in the interpolated field, and it solves the problem of gaps and conflicts because every point in the interpolated field has one motion vector assigned to it.

Inventors

  • 👤 Michael Knee
  • 👤 Andrew Hackett
  • 👤 Michael Kerdranvat
  • 👤 Nadine Bolender

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 13:58
CPC Classifications
H; H04; H04N; H04N5/00; H04N5/14; H04N5/144; H04N5/145; H04N19/00; H04N19/50; H04N19/503; H04N19/51; H04N19/577

Claims Analysis

Total Claims: 9
Claim 1
Independent Claim 408 words
Apparatus for motion estimation using two-sided block matching wherein a current field or frame to be interpolated and which is non-existing in an original picture signal is regarded as having notional pixel blocks which cover the field or frame to be interpolated and are correctly placed in that field or frame to be interpolated, comprising: field or frame delay means, line delay means and sample delay means for providing for each current of said notional pixel blocks pixels of the required pixel positions of a forward search window, having a preselected width, of a forward field or frame, further field or frame delay means, line delay means and sample delay means for providing for the current of said notional pixel blocks, the pixels of the required pixel positions of a backward search window, having said preselected width of a backward field or frame; processing elements each having two inputs and being connected to said field or frame delay means, line delay means and sample delay means and/or to said further field or frame delay means, line delay means and sample delay means for matching respective forward candidate pixel blocks within the forward search window in the forward field or frame with respective backward candidate pixel blocks within the backward search window in the backward field or frame by accumulating the errors between such pixels which arrive at its two inputs, and means for storing the partial results in order to arrive at a total error for each block; detection means connected to said processing elements for selecting a motion vector related to the location of the best matching pair of blocks from the forward field or frame and the backward field or frame, in order to select one motion vector for the current of said notional pixel blocks (I FB), whereby a first half of said motion vector points to the location of the best matching block in the backward field or frame search window and the second half of said motion vector points to the location of the best matching block in the forward field or frame search window, both vector parts depending on a same candidate motion vector, wherein the candidate motion vector all pass through the same points in said current field or frame to be interpolated, and wherein every point in the interpolated field has precisely one motion vector assigned thereto to eliminate motion vector gaps and conflicts within areas in the interpolate field.
Claim 2
Dependent Claim 408 words
Apparatus for motion estimation using two-sided block matching wherein a current field or frame to be interpolated and which is non-existing in an original picture signal is regarded as having notional pixel blocks which cover the field or frame to be interpolated and are correctly placed in that field or frame to be interpolated, comprising: field or frame delay means, line delay means and sample delay means for providing for each current of said notional pixel blocks pixels of the required pixel positions of a forward search window, having a preselected width, of a forward field or frame, further field or frame delay means, line delay means and sample delay means for providing for the current of said notional pixel blocks, the pixels of the required pixel positions of a backward search window, having said preselected width of a backward field or frame; processing elements each having two inputs and being connected to said field or frame delay means, line delay means and sample delay means and/or to said further field or frame delay means, line delay means and sample delay means for matching respective forward candidate pixel blocks within the forward search window in the forward field or frame with respective backward candidate pixel blocks within the backward search window in the backward field or frame by accumulating the errors between such pixels which arrive at its two inputs, and means for storing the partial results in order to arrive at a total error for each block; detection means connected to said processing elements for selecting a motion vector related to the location of the best matching pair of blocks from the forward field or frame and the backward field or frame, in order to select one motion vector for the current of said notional pixel blocks (I FB), whereby a first half of said motion vector points to the location of the best matching block in the backward field or frame search window and the second half of said motion vector points to the location of the best matching block in the forward field or frame search window, both vector parts depending on a same candidate motion vector, wherein the candidate motion vector all pass through the same points in said current field or frame to be interpolated, and wherein every point in the interpolated field has precisely one motion vector assigned thereto to eliminate motion vector gaps and conflicts within areas in the interpolate field.
Claim 3
Dependent Claim 31 words
Apparatus according to claim 1, wherein said selection means round the first half and the second half of said motion vector in such a way that a related sum remains correct.
Claim 4
Dependent Claim 236 words
Method for motion estimation using two-sided block matching wherein a current field or frame to be interpolated and which is non-existing in an original picture signal is regarded as having notional pixel blocks which cover the field or frame to be interpolated and are correctly placed in that field or frame to be interpolated and wherein respective forward candidate pixel blocks within a forward search window in a forward field or frame are matched with respective backward candidate pixel blocks within a backward search window in a backward field or frame in order to select one motion vector for a current of said notional pixel blocks comprising the step of: the two sided block matching is performed so that a first part of said motion vector for a current of said notional pixel blocks points to the location of the best matching block out of the backward field or frame search window and the other part of said motion vector points to the location of the best matching block out of the forward field or frame search window, both vector parts depending on a same candidate motion vector, wherein the candidate motion vectors all pass through the same points in said current field or frame to be interpolated, and wherein every point in the interpolated field has precisely one motion vector assigned thereto to eliminate motion vector gaps and conflicts within areas in the interpolated field.
Claim 5
Dependent Claim 236 words
Method for motion estimation using two-sided block matching wherein a current field or frame to be interpolated and which is non-existing in an original picture signal is regarded as having notional pixel blocks which cover the field or frame to be interpolated and are correctly placed in that field or frame to be interpolated and wherein respective forward candidate pixel blocks within a forward search window in a forward field or frame are matched with respective backward candidate pixel blocks within a backward search window in a backward field or frame in order to select one motion vector for a current of said notional pixel blocks comprising the step of: the two sided block matching is performed so that a first part of said motion vector for a current of said notional pixel blocks points to the location of the best matching block out of the backward field or frame search window and the other part of said motion vector points to the location of the best matching block out of the forward field or frame search window, both vector parts depending on a same candidate motion vector, wherein the candidate motion vectors all pass through the same points in said current field or frame to be interpolated, and wherein every point in the interpolated field has precisely one motion vector assigned thereto to eliminate motion vector gaps and conflicts within areas in the interpolated field.
Claim 6
Dependent Claim 25 words
Method according to claim 3, wherein the first part and the other part of said motion vector are each one half of the motion vector.
Claim 7
Dependent Claim 29 words
Method according to claim 4, wherein the first half and the second half of said motion vector are rounded in such a way that a related sum remains correct.
Claim 8
Dependent Claim 24 words
Method according to claim 3, wherein said block matching in said backward and said forward field or frame is performed using interpolated half-pixel values.
Claim 9
Dependent Claim 25 words
Method according to claim 3, wherein this method is used for field or frame rate upconversion, slow motion generation, noise reduction or for controlling displays.

References Cited (Backward Citations)

US5089887A Cited
US5012337A Cited
US5162907A Cited
US5410358A Cited
US5469226A Cited
US5398079A Cited
US5526053A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2001-10-12 2002-04-13 2002-10-13 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2005-10-12 2006-04-13 2006-10-13 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2009-10-12 2010-04-13 2010-10-13 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag