US4890160A
Expired / Lapsed
US
⏱️ 0.0 years remaining
TV picture motion vector measurement by correlation of pictures
Assignee: British Broadcasting Corp
•
Filing: 1986-12-23
•
Granted: 1989-12-26
•
Expires: 2006-12-23
Abstract
Abstract A correlation surface is derived by phase correlating two pictures selectively displaced in the X and Y directions. The illustrative surface shows a large peak at zero displacement, corresponding to a stationary background, and a fairly large peak corresponding to a moving object, the X, Y position of the peak indicating the magnitude (pixels per field period) and direction of the motion vector. A set of motion vectors is thus determined and testing is then carried out, on a pixel by pixel basis or pixel block by pixel block basis, to determine which of the motion vectors gives the best match in deriving the second picture from the first. The motion vector thus assigned may be used in temporal interpolation of the pictures.
Inventors
- 👤 Graham A. Thomas
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-26 12:12
CPC Classifications
H; H04; H04N; H04N11/00; H04N11/06; H04N11/12; H04N11/14; H04N11/16; H04N11/167; G; G06; G06T; G06T7/00; G06T7/20; G06T7/262; H04N11/02; H04N11/24; H04N11/28; H04N19/00; H04N19/42; H04N19/43; H04N19/50; H04N19/503; H04N19/51; H04N19/523; H04N19/527; H04N19/547; H04N19/59; H04N19/80; H04N5/00; H04N5/14; H04N5/144; H04N5/145; H04N7/00; H04N7/015; H04N7/0152; H04N7/0155; H04N7/0157; H04N7/12; H04N7/122; H04N7/125; H04N9/00; H04N9/64; H04N9/646
Claims Analysis
Total Claims: 28
Claim 1
Independent Claim
209 words
A machine method of TV picture motion measurement, comprising a first step of correlating first and second pictures to determine correlation as a function of selective displacement, thereby to determine a plurality of peak correlation values corresponding to respective motion vectors, and a second step of testing for each of a plurality of elementary areas of the pictures which of these motion vectors gives the best fit in deriving one of the pictures from the other, and wherein said second step comprises the following operations: (a) an elementary area of a picture is derived from said first picture using each of said motion vectors determined in said first step, thereby to form a set of derived elementary areas corresponding to said motion vectors respectively; (b) each derived elementary area is compared with the corresponding elementary error as a sum over the elementary areas of the magnitudes of the differences between corresponding points of said elementary areas; (c) that one of said motion vectors which results in the smallest comparison error is selected as giving the best fit in deriving said elementary area of said second picture from said elementary area of said first picture; (d) repeating operations (a), (b) and (c) for each of said plurality of elementary areas.
Claim 2
Dependent Claim
209 words
A machine method of TV picture motion measurement, comprising a first step of correlating first and second pictures to determine correlation as a function of selective displacement, thereby to determine a plurality of peak correlation values corresponding to respective motion vectors, and a second step of testing for each of a plurality of elementary areas of the pictures which of these motion vectors gives the best fit in deriving one of the pictures from the other, and wherein said second step comprises the following operations: (a) an elementary area of a picture is derived from said first picture using each of said motion vectors determined in said first step, thereby to form a set of derived elementary areas corresponding to said motion vectors respectively; (b) each derived elementary area is compared with the corresponding elementary error as a sum over the elementary areas of the magnitudes of the differences between corresponding points of said elementary areas; (c) that one of said motion vectors which results in the smallest comparison error is selected as giving the best fit in deriving said elementary area of said second picture from said elementary area of said first picture; (d) repeating operations (a), (b) and (c) for each of said plurality of elementary areas.
Claim 3
Dependent Claim
19 words
A method according to claim 1, wherein the selective displacement is in two dimensions and two-dimensional correlation is performed.
Claim 4
Dependent Claim
20 words
A method according to claim 1, wherein a plurality of one-dimensional correlations are employed using one-dimensional displacements in different directions.
Claim 5
Dependent Claim
45 words
A method according to claim 3, wherein the number of one-dimensional correlations is greater than 2 and a plurality of motion vectors are determined as those vectors which have components in the said different directions matching the peak correlation values provided by the one-dimensional correlations.
Claim 6
Dependent Claim
20 words
A method according to claim 1, wherein the motion vectors are measured to sub-pixel accuracy by interpolating the correlation function.
Claim 7
Dependent Claim
38 words
A method according to claim 1, wherein the step of correlating is performed separately in respect of a plurality of blocks of pixels and the whole assembly of motion vectors thereby determined is used in the second step.
Claim 8
Dependent Claim
49 words
A method according to claim 1, wherein the step of correlating is performed separately in respect of a plurality of blocks of pixels and, in the second step, only the motion vectors determined in relation to a given block are used in the testing in relation to that block.
Claim 9
Dependent Claim
56 words
A method according to claim 1, wherein the step of correlating is performed separately in respect of a plurality of blocks of pixels and, in that the second step, in the testing in relation to a given block, the motion vectors used are those determined in relation to that block and a plurality of adjacent blocks.
Claim 10
Dependent Claim
21 words
A method according to claim 6, 7 or 8 wherein each block is windowed using a raised-cosine or other windowing aperture.
Claim 11
Independent Claim
22 words
A method according to claims 6, 7 or 8, wherein each block is windowed and each windowed block is surrounded with zeroes.
Claim 12
Dependent Claim
15 words
A method according to claim 6, 7 or 8, wherein the blocks are overlapping blocks.
Claim 13
Dependent Claim
14 words
A method according to claim 1, wherein each elementary area consists of one pixel.
Claim 14
Dependent Claim
15 words
A method according to claim 1, wherein each elementary area is a block of pixels.
Claim 15
Dependent Claim
12 words
A method according to claim 1, wherein the correlation is phase correlation.
Claim 16
Dependent Claim
28 words
A method according to claim 14, wherein a phase correlation function is derived from an inverse Fourier transformer of the product of Fourier transforms of the two pictures.
Claim 17
Dependent Claim
28 words
A method according to claim 1, wherein the correlation function is subjected to temporal filtering before the peak correlation values are determined, so as to reduce noise peaks.
Claim 18
Dependent Claim
19 words
A method according to claim 16, wherein the temporal filtering is temporarily inhibited whenever there is a shot change.
Claim 19
Dependent Claim
39 words
A method according to claim 1, wherein an error surface is derived in the second step for each motion vector and, for each pixel, the motion vector whose error surface exhibits the smallest value is assigned to that pixel.
Claim 20
Dependent Claim
21 words
A method according to claim 18, wherein no motion vector is assigned when the smallest value exceeds a predetermined threshold value.
Claim 21
Dependent Claim
21 words
A method according to claim 18, wherein each error surface is subjected to spatial filtering to reduce the effect of noise.
Claim 22
Dependent Claim
24 words
A method according to claim 18, wherein the error surfaces are multiplied by factors which increase with the vector lengths pertaining to the surfaces.
Claim 23
Dependent Claim
49 words
A method according to claim 1, comprising the further steps of effecting temporal interpolation of the pictures utilizing the motion vectors to interpolate the positions of moving objects in accordance with the time point of the interpolated picture between the preceding and succeeding pictures from which it is received.
Claim 24
Dependent Claim
51 words
A method according to claim 22, wherein the picture information for uncovered background, with motion vectors pointing away therefrom, is taken into the interpolated picture from the succeeding picture and the picture information for obscured backgruond, with motion vectors pointing there-into, is taken into the interpolated picture from the preceding picture.
Claim 25
Dependent Claim
35 words
A method according to claim 22 or 23, wherein a plurality of pictures are interpolated between consecutive input pictures so as to generate a slow motion sequence or increase the field rate for display purposes.
Claim 26
Dependent Claim
39 words
A method according to claim 1, wherein the pictures are subjected to temporal filtering to reduce noise and the filtering is extended to include the moving objects shifted from field to field in accordance with their assigned motion vectors.
Claim 27
Dependent Claim
31 words
A method according to claim 1, wherein the pictures are transmitted or recorded with bandwidth reduction, with the inclusion of motion vector information for reconstruction of missing samples of moving objects.
Claim 28
Dependent Claim
28 words
A method according to claim 1, wherein black and white pictures are coloured by automatically repeating assigned colours from frame to frame at locations determined by motion vectors.
References Cited (Backward Citations)
GB2050752A
Cited
US4460923A
Cited
US4733298A
Cited
GB2172171A
Cited
US4727422A
Cited
US4689673A
Cited
US4689672A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1992-12-25 | 1993-06-26 | 1993-12-26 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1996-12-25 | 1997-06-26 | 1997-12-26 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2000-12-25 | 2001-06-26 | 2001-12-26 | $7700.00 | Window Closed / Lapsed |