US7728909B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and system for estimating motion and compensating for perceived motion blur in digital video
Assignee: 138 East LCD Advancements Ltd
•
Filing: 2006-03-16
•
Granted: 2010-06-01
•
Expires: 2026-03-16
Abstract
Abstract A method for compensating for perceived blur due to motion between a current frame and a previous frame of a digital video sequence comprises estimating a motion vector between the frames for each of a plurality of pixel blocks in the current and previous frames. A cluster motion vector is then estimated for each of a plurality of clusters of the motion vectors based on one of vectors in each cluster and motion vectors in proximate clusters. The cluster motion vector of its corresponding cluster is allocated to each pixel in the current frame. An initial guess frame is generated based on the current frame and pixels in the guess frame are blurred as a function of their respective allocated cluster motion vectors. Each blurred pixel is compared with a respective pixel in the current frame to generate an error pixel for each respective pixel. Each error pixel is blurred and weighted and then each error pixel and its respective pixel is combined in the initial guess frame thereby to update the guess frame and compensate for blur. A system and computer program for perceived blur compensation is also provided.
Inventors
- 👤 Eunice Poon
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 21:58
CPC Classifications
G; G06; G06T; G06T5/00; G06T5/73; H; H04; H04N; H04N5/00; H04N5/14; H04N5/20; H04N5/205; H04N5/208; G06T5/50; G06T7/00; G06T7/20; G06T7/223; G09; G09G; G09G3/00; G09G3/20; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/20; G06T2207/20172; G06T2207/20201; G09G2320/00; G09G2320/02; G09G2320/0257; G09G2320/0261; G09G2340/00; G09G2340/16
Claims Analysis
Total Claims: 21
Claim 1
Independent Claim
118 words
A method of compensating for perceived blur due to motion between a current frame and a previous frame of a digital video sequence using estimates of motion direction and motion extent of pixels between the frames, the method comprising: generating an initial guess frame based on the current frame; blurring pixels in the guess frame as a function of their respective estimated blur directions and blur extents; comparing each blurred pixel with a respective pixel in the current frame to generate an error pixel for each respective pixel; blurring and weighting each error pixel; and combining each error pixel and its respective pixel in the initial guess frame thereby to update the guess frame and compensate for blur.
Claim 2
Independent Claim
118 words
A method of compensating for perceived blur due to motion between a current frame and a previous frame of a digital video sequence using estimates of motion direction and motion extent of pixels between the frames, the method comprising: generating an initial guess frame based on the current frame; blurring pixels in the guess frame as a function of their respective estimated blur directions and blur extents; comparing each blurred pixel with a respective pixel in the current frame to generate an error pixel for each respective pixel; blurring and weighting each error pixel; and combining each error pixel and its respective pixel in the initial guess frame thereby to update the guess frame and compensate for blur.
Claim 3
Dependent Claim
17 words
The method of claim 1 , wherein the weighting is a function of the respective pixel motion.
Claim 4
Dependent Claim
30 words
The method of claim 2 , wherein the weighting is an estimate of the edge magnitude of the respective pixel in the guess image in the direction of pixel motion.
Claim 5
Dependent Claim
20 words
The method of claim 2 wherein the pixel blurring, comparing, error pixel blurring and weighting, and combining are performed iteratively.
Claim 6
Dependent Claim
30 words
The method of claim 4 wherein the pixel blurring, comparing, error pixel blurring and weighting, and combining are performed iteratively until a sum of error falls below a threshold level.
Claim 7
Dependent Claim
25 words
The method of claim 4 wherein the pixel blurring, comparing, error pixel blurring and weighting, and combining are performed iteratively a predetermined number of times.
Claim 8
Dependent Claim
37 words
The method of claim 4 wherein the pixel blurring, comparing, error pixel blurring and weighting, and combining are performed iteratively until a sum of error fails to change by more than a threshold amount between successive iterations.
Claim 9
Dependent Claim
21 words
A computer readable medium embodying a program of instructions executable by the computer to perform the method of claim 1 .
Claim 10
Independent Claim
165 words
A method of compensating for perceived blur due to motion between a current frame and a previous frame of a digital video sequence comprising: estimating a motion vector between the frames for each of a plurality of pixel blocks in the frames; estimating a cluster motion vector for each of a plurality of clusters of motion vectors based on one of motion vectors in each cluster and motion vectors in proximate clusters; allocating to each pixel in the current frame, the cluster motion vector of its corresponding cluster; generating an initial guess frame based on the current frame; blurring pixels in the guess frame as a function of their respective allocated cluster motion vector; comparing each blurred pixel with a respective pixel in the current frame to generate an error pixel for each respective pixel; blurring and weighting each error pixel; and combining each error pixel and its respective pixel in the initial guess frame thereby to update the guess frame and compensate for blur.
Claim 11
Independent Claim
165 words
A method of compensating for perceived blur due to motion between a current frame and a previous frame of a digital video sequence comprising: estimating a motion vector between the frames for each of a plurality of pixel blocks in the frames; estimating a cluster motion vector for each of a plurality of clusters of motion vectors based on one of motion vectors in each cluster and motion vectors in proximate clusters; allocating to each pixel in the current frame, the cluster motion vector of its corresponding cluster; generating an initial guess frame based on the current frame; blurring pixels in the guess frame as a function of their respective allocated cluster motion vector; comparing each blurred pixel with a respective pixel in the current frame to generate an error pixel for each respective pixel; blurring and weighting each error pixel; and combining each error pixel and its respective pixel in the initial guess frame thereby to update the guess frame and compensate for blur.
Claim 12
Independent Claim
123 words
A system for compensating for perceived blur due to motion between a current frame and a previous frame of a digital video sequence using estimates of motion direction and motion extent of pixels between the frames, the system comprising: a motion processing filter that: blurs pixels in an initial guess image, that is based on the current frame, as a function of their respective estimated blur directions and blur extents; compares each blurred pixel with a respective pixel in the current frame to generate an error pixel for each respective pixel, and further blurs and weights each error pixel; and combines each error pixel and its respective pixel in the initial guess frame thereby to update the guess frame and compensate for blur.
Claim 13
Independent Claim
123 words
A system for compensating for perceived blur due to motion between a current frame and a previous frame of a digital video sequence using estimates of motion direction and motion extent of pixels between the frames, the system comprising: a motion processing filter that: blurs pixels in an initial guess image, that is based on the current frame, as a function of their respective estimated blur directions and blur extents; compares each blurred pixel with a respective pixel in the current frame to generate an error pixel for each respective pixel, and further blurs and weights each error pixel; and combines each error pixel and its respective pixel in the initial guess frame thereby to update the guess frame and compensate for blur.
Claim 14
Dependent Claim
17 words
The system of claim 10 , wherein the weighting is a function of the respective pixel motion.
Claim 15
Dependent Claim
30 words
The system of claim 11 , wherein the weighting is an estimate of the edge magnitude of the respective pixel in the guess image in the direction of pixel motion.
Claim 16
Dependent Claim
20 words
The system of claim 11 wherein the motion processing filter iteratively performs the blurring, comparing, blurring and weighting, and combining.
Claim 17
Dependent Claim
30 words
The system of claim 13 wherein the motion processing filter iteratively performs the blurring, comparing, blurring and weighting, and combining until the sum of error falls below a threshold level.
Claim 18
Dependent Claim
25 words
The system of claim 13 wherein the motion processing filter iteratively performs the blurring, comparing, blurring and weighting, and combining a predetermined number of times.
Claim 19
Dependent Claim
36 words
The system of claim 13 wherein motion processing filter iteratively performs the blurring, comparing, blurring and weighting, and combining until the sum of error fails to change by more than a threshold amount between successive iterations.
Claim 20
Dependent Claim
14 words
The system of claim 10 wherein the initial guess frame is the current frame.
Claim 21
Dependent Claim
35 words
The system of claim 17 , wherein the motion processing filter provides weighting based on an estimate of the edge magnitude of the respective pixel in the guess frame in the direction of pixel motion.
References Cited (Backward Citations)
US4862267A
Cited
US5051844A
Cited
US6347153B1
Cited
JP2000175191A
Cited
JP2001298745A
Cited
US20020154088A1
Cited
US20030006991A1
Cited
US20030091112A1
Cited
US20030122772A1
Cited
US20040086047A1
Cited
US20040233157A1
Cited
US20040046891A1
Cited
US20050100095A1
Cited
JP2004328635A
Cited
US7365801B2
Cited
US20050053291A1
Cited
US20050140626A1
Cited
US20050030302A1
Cited
JP2005049784A
Cited
US20050053135A1
Cited
US20050157792A1
Cited
US20050243921A1
Cited
US20060062304A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2013-05-31 | 2013-11-30 | 2014-06-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2017-05-31 | 2017-11-30 | 2018-06-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2021-05-31 | 2021-11-30 | 2022-06-01 | $7700.00 | Window Closed / Lapsed |