Patent US7649549B2 successfully refreshed from Google Patents.
US7649549B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Motion stabilization in video frames using motion vectors and reliability blocks
Assignee: Texas Instruments Inc
•
Filing: 2005-09-22
•
Granted: 2010-01-19
•
Expires: 2025-09-22
Abstract
Abstract Stabilization for devices such as hand-held camcorders segments a low-resolution frame into a region of reliable estimation, finds a global motion vector for the region at high resolution, and uses the global motion vector to compensate for jitter.
Inventors
- 👤 Aziz Umit Batur
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 22:16
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/20; H; H04; H04N; H04N23/00; H04N23/60; H04N23/68; H04N23/681; H04N23/6811; H04N23/6812; H04N23/6815; H04N23/682; H04N5/00; H04N5/14; H04N5/144
Claims Analysis
Total Claims: 10
Claim 1
Independent Claim
145 words
A method of a digital signal processor for stabilizing a video sequence, comprising: (a) providing a low resolution version of an input picture; (b) segmenting said low resolution version into reliable motion estimation blocks and unreliable motion estimation blocks; (c) finding a single motion vector for the aggregation of said reliable motion estimation blocks; (d) finding a global motion vector for said input picture from said single motion vector by scaling and refining said single motion vector, wherein said scaling and refining includes a first scaling by a factor of 2 in both horizontal and vertical directions, a first single motion vector refinement by a local search, a second scaling by a factor of 2 in both horizontal and vertical directions, and second motion vector refinement by a second local search; (e) compensating for jitter motion in said input picture using said global motion vector.
Claim 2
Independent Claim
145 words
A method of a digital signal processor for stabilizing a video sequence, comprising: (a) providing a low resolution version of an input picture; (b) segmenting said low resolution version into reliable motion estimation blocks and unreliable motion estimation blocks; (c) finding a single motion vector for the aggregation of said reliable motion estimation blocks; (d) finding a global motion vector for said input picture from said single motion vector by scaling and refining said single motion vector, wherein said scaling and refining includes a first scaling by a factor of 2 in both horizontal and vertical directions, a first single motion vector refinement by a local search, a second scaling by a factor of 2 in both horizontal and vertical directions, and second motion vector refinement by a second local search; (e) compensating for jitter motion in said input picture using said global motion vector.
Claim 3
Dependent Claim
17 words
The method of claim 1 further comprising combining said reliable motion estimation blocks into a large block.
Claim 4
Independent Claim
216 words
A method of jitter estimation for video frames, comprising: (a) providing a low resolution version of an input frame; (b) decomposing said low resolution frame into blocks; (c) for each of said blocks, computing motion vector prediction errors and when an average motion vector prediction error exceeds a minimum motion vector prediction error by a first threshold, designating said each of said blocks as a reliable block; (d) for each of said blocks, computing a relative motion vector using a corresponding relative motion vector from a prior low resolution frame; (e) taking integer N equal to the number of said reliable blocks with a relative motion vector which differs from the average of said relative motion vectors of all of said reliable blocks by more than a second threshold; (f) when said N is larger than a third threshold, for each of said reliable blocks which has a relative motion vector greater than a fourth threshold, changing the designation from reliable to unreliable; (g) finding a motion vector of an aggregate of said reliable blocks; (h) extending said motion vector of step (g) to a global motion vector of a region in said input frame corresponding to said aggregate in said low resolution frame; and (i) applying said global motion vector to stabilize said input frame.
Claim 5
Independent Claim
216 words
A method of jitter estimation for video frames, comprising: (a) providing a low resolution version of an input frame; (b) decomposing said low resolution frame into blocks; (c) for each of said blocks, computing motion vector prediction errors and when an average motion vector prediction error exceeds a minimum motion vector prediction error by a first threshold, designating said each of said blocks as a reliable block; (d) for each of said blocks, computing a relative motion vector using a corresponding relative motion vector from a prior low resolution frame; (e) taking integer N equal to the number of said reliable blocks with a relative motion vector which differs from the average of said relative motion vectors of all of said reliable blocks by more than a second threshold; (f) when said N is larger than a third threshold, for each of said reliable blocks which has a relative motion vector greater than a fourth threshold, changing the designation from reliable to unreliable; (g) finding a motion vector of an aggregate of said reliable blocks; (h) extending said motion vector of step (g) to a global motion vector of a region in said input frame corresponding to said aggregate in said low resolution frame; and (i) applying said global motion vector to stabilize said input frame.
Claim 6
Dependent Claim
37 words
The method of claim 3 , further comprising prior to said step (g), for each of said reliable blocks which has a motion vector magnitude larger than the fourth threshold, changing the designation from reliable to unreliable.
Claim 7
Dependent Claim
29 words
The method of claim 3 , further comprising, terminating the method when the average of said relative motion vectors has magnitude larger than at least one of the thresholds.
Claim 8
Dependent Claim
23 words
The method of claim 3 , wherein said applying step includes an adaptive accumulation of said global motion vector to define a displacement.
Claim 9
Dependent Claim
231 words
A video camera, comprising: (a) means for providing a low resolution version of an input frame; (b) means for decomposing said low resolution frame into blocks; (c) for each of said blocks, means for computing motion vector prediction errors and when an average motion vector prediction error exceeds a minimum motion vector prediction error by a first threshold, means for designating said each of said blocks as a reliable block; (d) for each of said blocks, means for computing a relative motion vector using a corresponding relative motion vector from a prior low resolution frame; (e) means for taking integer N equal to the number of said reliable blocks with a relative motion vector which differs from the average of said relative motion vectors of all of said reliable blocks by more than a second threshold; (f) when said N is larger than a third threshold, for each of said reliable blocks which has a relative motion vector greater than a fourth threshold, means for changing the designation from reliable to unreliable; (g) means for finding a motion vector of an aggregate of said reliable blocks; (h) means for extending said motion vector of step (g) to a global motion vector of a region in said input frame corresponding to said aggregate in said low resolution frame; and (i) means for applying said global motion vector to stabilize said input frame.
Claim 10
Dependent Claim
231 words
A video camera, comprising: (a) means for providing a low resolution version of an input frame; (b) means for decomposing said low resolution frame into blocks; (c) for each of said blocks, means for computing motion vector prediction errors and when an average motion vector prediction error exceeds a minimum motion vector prediction error by a first threshold, means for designating said each of said blocks as a reliable block; (d) for each of said blocks, means for computing a relative motion vector using a corresponding relative motion vector from a prior low resolution frame; (e) means for taking integer N equal to the number of said reliable blocks with a relative motion vector which differs from the average of said relative motion vectors of all of said reliable blocks by more than a second threshold; (f) when said N is larger than a third threshold, for each of said reliable blocks which has a relative motion vector greater than a fourth threshold, means for changing the designation from reliable to unreliable; (g) means for finding a motion vector of an aggregate of said reliable blocks; (h) means for extending said motion vector of step (g) to a global motion vector of a region in said input frame corresponding to said aggregate in said low resolution frame; and (i) means for applying said global motion vector to stabilize said input frame.
References Cited (Backward Citations)
US5371539A
Cited
US5748231A
Cited
US5563652A
Cited
US7221390B1
Cited
US6628711B1
Cited
US20040201706A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2013-01-18 | 2013-07-20 | 2014-01-19 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2017-01-18 | 2017-07-20 | 2018-01-19 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2021-01-18 | 2021-07-20 | 2022-01-19 | $7700.00 | Window Closed / Lapsed |