US5363146A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Motion compensated image processing
Assignee: Sony United Kingdom Ltd
•
Filing: 1993-02-17
•
Granted: 1994-11-08
•
Expires: 2013-02-17
Abstract
Abstract A motion compensation image processing apparatus and method for generating motion vectors that represent image motion between a pair of input images from which an output image is derived by motion compensated interpolation. A plurality of motion vectors are generated for each pixel of the output image and it is determined whether respective test blocks of each of the pair of input images, pointed to by each of the plurality of motion vectors, lie partially outside their respective input images. If one or both of the test blocks lies partially outside its respective input image, the degree of correlation between the test blocks is detected by performing a first correlation test on parts of the test blocks lying inside their respective input images. However, if both of the test blocks lie wholly inside their respective input image, the degree of correlation between the test blocks is detected by performing a second correlation test. The motion vector having the highest degree of correlation between the test blocks is selected for motion compensation interpolation.
Inventors
- 👤 Nicholas I. Saunders
- 👤 Stephen M. Keating
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:08
CPC Classifications
H; H04; H04N; H04N7/00; H04N7/01; H04N7/0135; H04N7/014; H04N19/00; H04N19/50; H04N19/503; H04N19/51; H04N19/577; H04N5/00; H04N5/14; H04N5/144; H04N5/145; H04N7/0112
Claims Analysis
Total Claims: 13
Claim 1
Independent Claim
208 words
A method of motion compensated image processing in which motion vectors are generated to represent image motion between a pair of input images from which an output image is to be derived by motion compensated interpolation, said method comprising the steps of: generating a plurality of motion vectors for each pixel of said output image; testing each of said plurality of motion vectors associated with a target output pixel in said output image by: (i) determining whether respective test blocks of each of said pair of input images, pointed to by a motion vector under test, lie partially outside their respective input images; (ii) detecting a degree of correlation between said test blocks by performing a first correlation test on parts of said test blocks lying inside their respective input images if one or both of said test blocks lies partially outside its respective input image; and (iii) detecting a degree of correlation between said test blocks by performing a second correlation test on said test blocks if both of said test blocks lie wholly inside their respective input images; and selecting, from said plurality of motion vectors, a motion vector having a highest degree of correlation between said test blocks pointed to by the selected motion vector.
Claim 2
Independent Claim
208 words
A method of motion compensated image processing in which motion vectors are generated to represent image motion between a pair of input images from which an output image is to be derived by motion compensated interpolation, said method comprising the steps of: generating a plurality of motion vectors for each pixel of said output image; testing each of said plurality of motion vectors associated with a target output pixel in said output image by: (i) determining whether respective test blocks of each of said pair of input images, pointed to by a motion vector under test, lie partially outside their respective input images; (ii) detecting a degree of correlation between said test blocks by performing a first correlation test on parts of said test blocks lying inside their respective input images if one or both of said test blocks lies partially outside its respective input image; and (iii) detecting a degree of correlation between said test blocks by performing a second correlation test on said test blocks if both of said test blocks lie wholly inside their respective input images; and selecting, from said plurality of motion vectors, a motion vector having a highest degree of correlation between said test blocks pointed to by the selected motion vector.
Claim 3
Dependent Claim
50 words
A method according to claim 1, in which said step of performing said second correlation test comprises the steps of: detecting absolute luminance differences between pairs of pixels at corresponding positions in said test blocks; and summing said absolute luminance differences, thereby generating a sum of absolute differences (SAD) value.
Claim 4
Dependent Claim
102 words
A method according to claim 1, in which said step of performing said first correlation test comprises the steps of: detecting absolute luminance differences between pairs of pixels at corresponding positions in said test blocks, for which both pixels in each pair lie inside their respective input images; summing said absolute luminance differences, thereby generating a sum of absolute differences (SAD) value; and multiplying each said SAD value thus obtained by a scale factor dependent on a ratio of a number of pixels in each of said test blocks to a number of pairs of pixels used to calculate said SAD value,
Claim 5
Dependent Claim
77 words
A method according to claim 1, in which said step of performing said first correlation test comprises the steps of: detecting the absolute luminance differences between pairs of pixels at corresponding positions in said test blocks; setting said detected absolute luminance differences to zero for pairs of pixels in which one or both of that pair lies outside its respective input image; and summing said absolute luminance differences, thereby generating a sum of absolute differences (SAD) value.
Claim 6
Dependent Claim
79 words
A method according to claim 1, in which said step of performing said first correlation test comprises the steps of: substituting pixels from said parts of each of said test blocks inside the input image into pixel positions in each of corresponding test blocks lying outside the input image; detecting absolute luminance differences between pairs of pixels at corresponding positions in said test blocks; and summing said absolute luminance differences, thereby generating a sum of absolute differences (SAD) value.
Claim 7
Dependent Claim
38 words
A method according to claim 1, in which said selecting step comprises discarding a motion vector if one or more pixels at predetermined positions in either or both of said test blocks lies outside its respective input image.
Claim 8
Dependent Claim
28 words
A method according to claim 1, in which one of said plurality of motion vectors associated with each output pixel is a motion vector representing zero inter-image motion.
Claim 9
Dependent Claim
24 words
A method according to claim 1, comprising the step of interpolating each output pixel using said motion vector selected for said target output pixel.
Claim 10
Dependent Claim
216 words
Motion compensated image processing apparatus for generating motion vectors representing image motion between a pair of input images from which an output image is to be derived by motion compensated interpolation, said apparatus comprising: means for generating a plurality of motion vectors for each pixel of said output image; means for testing each of said plurality of motion vectors associated with a target output pixel in said output image, said means for testing includes: (i) means for determining whether respective test blocks of each of said pair of input images, pointed to by a motion vector under test, lie partially outside their respective input images; (ii) means for detecting a degree of correlation between said test blocks by performing a first correlation test on parts of said test blocks lying inside their respective input images if one or both of said test blocks lies partially outside its respective input image; and (iii) means for detecting a degree of correlation between the test blocks by performing a second correlation test on said test blocks if both of said test blocks lie wholly inside their respective input images; and means for selecting, from said plurality of motion vectors, a motion vector having a highest degree of correlation between said test blocks pointed to by the selected motion vector.
Claim 11
Dependent Claim
216 words
Motion compensated image processing apparatus for generating motion vectors representing image motion between a pair of input images from which an output image is to be derived by motion compensated interpolation, said apparatus comprising: means for generating a plurality of motion vectors for each pixel of said output image; means for testing each of said plurality of motion vectors associated with a target output pixel in said output image, said means for testing includes: (i) means for determining whether respective test blocks of each of said pair of input images, pointed to by a motion vector under test, lie partially outside their respective input images; (ii) means for detecting a degree of correlation between said test blocks by performing a first correlation test on parts of said test blocks lying inside their respective input images if one or both of said test blocks lies partially outside its respective input image; and (iii) means for detecting a degree of correlation between the test blocks by performing a second correlation test on said test blocks if both of said test blocks lie wholly inside their respective input images; and means for selecting, from said plurality of motion vectors, a motion vector having a highest degree of correlation between said test blocks pointed to by the selected motion vector.
Claim 12
Dependent Claim
220 words
A television standards converter comprising motion compensated image processing apparatus for generating motion vectors representing image motion between a pair of input images from which an output image is to be derived by motion compensated interpolation, said apparatus comprising: means for generating a plurality of motion vectors for each pixel of said output image; means for testing each of said plurality of motion vectors associated with a target output pixel in said output image, said means for testing includes: (i) means for determining whether respective test blocks of each of said pair of input images, pointed to by a motion vector under test, lie partially outside their respective input images; (ii) means for detecting a degree of correlation between said test blocks by performing a first correlation test on parts of said test blocks lying inside their respective input images if one or both of said test blocks lies partially outside its respective input image; (iii) means for detecting a degree of correlation between the test blocks by performing a second correlation test on said test blocks if both of said test blocks lie wholly inside their respective input images; and means for selecting, from said plurality of motion vectors, a motion vector having a highest degree of correlation between said test blocks pointed to by the selected motion vector.
Claim 13
Dependent Claim
220 words
A television standards converter comprising motion compensated image processing apparatus for generating motion vectors representing image motion between a pair of input images from which an output image is to be derived by motion compensated interpolation, said apparatus comprising: means for generating a plurality of motion vectors for each pixel of said output image; means for testing each of said plurality of motion vectors associated with a target output pixel in said output image, said means for testing includes: (i) means for determining whether respective test blocks of each of said pair of input images, pointed to by a motion vector under test, lie partially outside their respective input images; (ii) means for detecting a degree of correlation between said test blocks by performing a first correlation test on parts of said test blocks lying inside their respective input images if one or both of said test blocks lies partially outside its respective input image; (iii) means for detecting a degree of correlation between the test blocks by performing a second correlation test on said test blocks if both of said test blocks lie wholly inside their respective input images; and means for selecting, from said plurality of motion vectors, a motion vector having a highest degree of correlation between said test blocks pointed to by the selected motion vector.
References Cited (Backward Citations)
US4862267A
Cited
US4864398A
Cited
GB2231750A
Cited
GB2231749A
Cited
US4992870A
Cited
US4992869A
Cited
US5005077A
Cited
US5025495A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1997-11-07 | 1998-05-09 | 1998-11-08 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2001-11-07 | 2002-05-09 | 2002-11-08 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2005-11-07 | 2006-05-09 | 2006-11-08 | $7700.00 | Window Closed / Lapsed |