Patent US6809758B1 successfully refreshed from Google Patents.
US6809758B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Automated stabilization method for digital image sequences
Assignee: Monument Peak Ventures LLC
•
Filing: 1999-12-29
•
Granted: 2004-10-26
•
Expires: 2019-12-29
Abstract
Abstract A method and structure for stabilizing a motion image formed using a sequence of successive frames which includes calculating a motion vector field between adjacent frames; forming a motion vector histogram from horizontal and vertical components of the motion vector field; applying a threshold to the motion vector histogram to produce a thresholded motion vector histogram; generating average horizontal and vertical motion components from the thresholded motion vector histogram; filtering the average horizontal and vertical motion components over a number of frames to identify unwanted horizontal and vertical motion components for each of the frames; and stabilizing the image sequence by shifting each frame according to the corresponding unwanted horizontal and vertical motion components.
Inventors
- 👤 Paul W. Jones
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 22:59
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/50; H04N19/503; H04N19/51; H04N19/527; H04N23/00; H04N23/60; H04N23/68; H04N23/681; H04N23/6811; H04N23/682; H04N5/00; H04N5/14; H04N5/144; H04N5/145
Claims Analysis
Total Claims: 50
Claim 1
Independent Claim
126 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating motion vectors for each of said frames, wherein said motion vectors follow corresponding points between adjacent frames; forming a motion vector histogram for each of said frames from horizontal and vertical components of said motion vectors; removing unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; generating average horizontal and vertical components from said processed motion vector histogram for each of said frames; filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components for each of said frames; and translating each frame by said unwanted horizontal and vertical components.
Claim 2
Independent Claim
126 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating motion vectors for each of said frames, wherein said motion vectors follow corresponding points between adjacent frames; forming a motion vector histogram for each of said frames from horizontal and vertical components of said motion vectors; removing unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; generating average horizontal and vertical components from said processed motion vector histogram for each of said frames; filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components for each of said frames; and translating each frame by said unwanted horizontal and vertical components.
Claim 3
Dependent Claim
12 words
The method in claim 1 , wherein said filtering comprises highpass filtering.
Claim 4
Dependent Claim
24 words
The method in claim 1 , wherein said removing includes discarding motion vectors from said motion vector histogram, which have values below a threshold.
Claim 5
Dependent Claim
17 words
The method in claim 3 , wherein said threshold is determined adaptively for each of said frames.
Claim 6
Independent Claim
131 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating motion vectors for each of said frames, wherein said motion vectors follow corresponding points between adjacent frames; forming a motion vector histogram for each of said frames from horizontal and vertical components of said motion vectors; removing unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; generating average horizontal and vertical components from said processed motion vector histogram for each of said frames; filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components for each of said frames; and translating each frame by said unwanted horizontal and vertical components; wherein said filtering is user-adjustable.
Claim 7
Independent Claim
131 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating motion vectors for each of said frames, wherein said motion vectors follow corresponding points between adjacent frames; forming a motion vector histogram for each of said frames from horizontal and vertical components of said motion vectors; removing unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; generating average horizontal and vertical components from said processed motion vector histogram for each of said frames; filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components for each of said frames; and translating each frame by said unwanted horizontal and vertical components; wherein said filtering is user-adjustable.
Claim 8
Dependent Claim
20 words
The method in claim 5 , wherein said removing includes discarding values from said motion vector histogram below a threshold.
Claim 9
Dependent Claim
11 words
The method in claim 6 , wherein said threshold is user-adjustable.
Claim 10
Independent Claim
151 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating motion vectors for each of said frames, wherein said motion vectors follow corresponding points between adjacent frames; forming a motion vector histogram for each of said frames from horizontal and vertical components of said motion vectors; removing unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; generating average horizontal and vertical components from said processed motion vector histogram for each of said frames; filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components for each of said frames; and translating each frame by said unwanted horizontal and vertical components; wherein said removing includes discarding values from said motion vector histogram below a threshold and said threshold is determined adaptively for each of said frames.
Claim 11
Independent Claim
151 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating motion vectors for each of said frames, wherein said motion vectors follow corresponding points between adjacent frames; forming a motion vector histogram for each of said frames from horizontal and vertical components of said motion vectors; removing unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; generating average horizontal and vertical components from said processed motion vector histogram for each of said frames; filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components for each of said frames; and translating each frame by said unwanted horizontal and vertical components; wherein said removing includes discarding values from said motion vector histogram below a threshold and said threshold is determined adaptively for each of said frames.
Claim 12
Dependent Claim
143 words
A computerized digital image system for stabilizing an image sequence formed from a number of successive frames comprising: a motion estimator calculating motion vectors for each of said frames, wherein said motion vectors follow corresponding points between adjacent frames; a histogram generator forming a motion vector histogram for each of said frames from horizontal and vertical components of said motion vectors; a processor removing unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; an averaging unit generating average horizontal and vertical components from said processed histogram for each of said frames; a filter filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components of each of said frames; and a stabilizing unit translating each frame by said unwanted horizontal and vertical components.
Claim 13
Dependent Claim
143 words
A computerized digital image system for stabilizing an image sequence formed from a number of successive frames comprising: a motion estimator calculating motion vectors for each of said frames, wherein said motion vectors follow corresponding points between adjacent frames; a histogram generator forming a motion vector histogram for each of said frames from horizontal and vertical components of said motion vectors; a processor removing unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; an averaging unit generating average horizontal and vertical components from said processed histogram for each of said frames; a filter filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components of each of said frames; and a stabilizing unit translating each frame by said unwanted horizontal and vertical components.
Claim 14
Dependent Claim
16 words
The computerized digital imaging system in claim 9 , wherein said filter comprises a highpass filter.
Claim 15
Dependent Claim
21 words
The computerized digital imaging system in claim 9 , wherein said processor discards values from said motion vector below a threshold.
Claim 16
Dependent Claim
20 words
The computerized digital imaging system in claim 11 , wherein said processor includes a user interface for adjusting said threshold.
Claim 17
Dependent Claim
154 words
A computerized digital image system for stabilizing an image sequence formed from a number of successive frames comprising: a motion estimator calculating motion vectors for each of said frames, wherein said motion vectors follow corresponding points between adjacent frames; a histogram generator forming a motion vector histogram for each of said frames from horizontal and vertical components of said motion vectors; a processor removing unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; an averaging unit generating average horizontal and vertical components from said processed histogram for each of said frames; a filter filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components of each of said frames; and a stabilizing unit translating each frame by said unwanted horizontal and vertical components; wherein said filter includes a user interface for adjusting said filter.
Claim 18
Dependent Claim
154 words
A computerized digital image system for stabilizing an image sequence formed from a number of successive frames comprising: a motion estimator calculating motion vectors for each of said frames, wherein said motion vectors follow corresponding points between adjacent frames; a histogram generator forming a motion vector histogram for each of said frames from horizontal and vertical components of said motion vectors; a processor removing unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; an averaging unit generating average horizontal and vertical components from said processed histogram for each of said frames; a filter filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components of each of said frames; and a stabilizing unit translating each frame by said unwanted horizontal and vertical components; wherein said filter includes a user interface for adjusting said filter.
Claim 19
Independent Claim
96 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating motion vectors for each of said frames; forming a motion vector histogram for each of said frames; generating average horizontal and vertical components from said motion vector histogram for each of said frames; identifying unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and translating each frame by said unwanted horizontal and vertical components; and further comprising removing unreliable motion vectors from said motion vector histogram for each of said frames.
Claim 20
Independent Claim
96 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating motion vectors for each of said frames; forming a motion vector histogram for each of said frames; generating average horizontal and vertical components from said motion vector histogram for each of said frames; identifying unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and translating each frame by said unwanted horizontal and vertical components; and further comprising removing unreliable motion vectors from said motion vector histogram for each of said frames.
Claim 21
Dependent Claim
16 words
The method in claim 14 , wherein said motion vectors follow corresponding points between adjacent frames.
Claim 22
Dependent Claim
20 words
The method in claim 14 , wherein said motion vector histogram comprises horizontal and vertical components of said motion vectors.
Claim 23
Dependent Claim
35 words
The method in claim 14 , wherein said identifying includes filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components for each of said frames.
Claim 24
Dependent Claim
20 words
The method in claim 14 , wherein said removing includes discarding values from said motion vector histogram below a threshold.
Claim 25
Dependent Claim
11 words
The method in claim 18 , wherein said threshold is user-adjustable.
Claim 26
Dependent Claim
17 words
The method in claim 18 , wherein said threshold is determined adaptively for each of said frames.
Claim 27
Independent Claim
115 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating motion vectors for each of said frames; forming a motion vector histogram for each of said frames; generating average horizontal and vertical components from said motion vector histogram for each of said frames; identifying unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and translating each frame by said unwanted horizontal and vertical components; wherein said identifying includes filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components for each of said frames; and wherein said filtering comprises highpass filtering.
Claim 28
Independent Claim
115 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating motion vectors for each of said frames; forming a motion vector histogram for each of said frames; generating average horizontal and vertical components from said motion vector histogram for each of said frames; identifying unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and translating each frame by said unwanted horizontal and vertical components; wherein said identifying includes filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components for each of said frames; and wherein said filtering comprises highpass filtering.
Claim 29
Dependent Claim
16 words
The method in claim 21 , wherein said motion vectors follow corresponding points between adjacent frames.
Claim 30
Dependent Claim
20 words
The method in claim 21 , wherein said motion vector histogram comprises horizontal and vertical components of said motion vectors.
Claim 31
Independent Claim
114 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating motion vectors for each of said frames; forming a motion vector histogram for each of said frames; generating average horizontal and vertical components from said motion vector histogram for each of said frames; identifying unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and translating each frame by said unwanted horizontal and vertical components; wherein said identifying includes filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components for each of said frames; and wherein said filtering is user-adjustable.
Claim 32
Independent Claim
114 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating motion vectors for each of said frames; forming a motion vector histogram for each of said frames; generating average horizontal and vertical components from said motion vector histogram for each of said frames; identifying unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and translating each frame by said unwanted horizontal and vertical components; wherein said identifying includes filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components for each of said frames; and wherein said filtering is user-adjustable.
Claim 33
Dependent Claim
16 words
The method in claim 24 , wherein said motion vectors follow corresponding points between adjacent frames.
Claim 34
Dependent Claim
20 words
The method in claim 24 , wherein said motion vector histogram comprises horizontal and vertical components of said motion vectors.
Claim 35
Independent Claim
131 words
A method of using a computer program for stabilizing an image sequence formed from a plurality of successive frames comprising: using said computer program to calculate motion vectors for each of said frames; using said computer program to form a motion vector histogram for each of said frames; using said computer program to generate average horizontal and vertical components from said motion vector histogram for each of said frames; using said computer program to identify unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and using said computer program to translate each frame by said unwanted horizontal and vertical components; and further comprising using said computer program to remove unreliable motion vectors from said motion vector histogram for each of said frames.
Claim 36
Independent Claim
131 words
A method of using a computer program for stabilizing an image sequence formed from a plurality of successive frames comprising: using said computer program to calculate motion vectors for each of said frames; using said computer program to form a motion vector histogram for each of said frames; using said computer program to generate average horizontal and vertical components from said motion vector histogram for each of said frames; using said computer program to identify unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and using said computer program to translate each frame by said unwanted horizontal and vertical components; and further comprising using said computer program to remove unreliable motion vectors from said motion vector histogram for each of said frames.
Claim 37
Dependent Claim
16 words
The method in claim 27 , wherein said motion vectors follow corresponding points between adjacent frames.
Claim 38
Dependent Claim
20 words
The method in claim 27 , wherein said motion vector histogram comprises horizontal and vertical components of said motion vectors.
Claim 39
Dependent Claim
43 words
The method in claim 27 , wherein said using said computer program to identify unwanted horizontal and vertical components for each of said frames includes using said computer program to filter said average horizontal and vertical components from two or more successive frames.
Claim 40
Dependent Claim
30 words
The method in claim 27 , wherein said using said computer program to remove includes using said computer program to discard values from said motion vector histogram below a threshold.
Claim 41
Dependent Claim
11 words
The method in claim 31 , wherein said threshold is user-adjustable.
Claim 42
Independent Claim
164 words
A method of using a computer program for stabilizing an image sequence formed from a plurality of successive frames comprising: using said computer program to calculate motion vectors for each of said frames; using said computer program to form a motion vector histogram for each of said frames; using said computer program to generate average horizontal and vertical components from said motion vector histogram for each of said frames; using said computer program to identify unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and using said computer program to translate each frame by said unwanted horizontal and vertical components; and wherein said using said computer program to identify unwanted horizontal and vertical components for each of said frames includes using said computer program to filter said average horizontal and vertical components from two or more successive frames; and wherein said using said computer program to filter comprises using said computer program to highpass filter.
Claim 43
Independent Claim
164 words
A method of using a computer program for stabilizing an image sequence formed from a plurality of successive frames comprising: using said computer program to calculate motion vectors for each of said frames; using said computer program to form a motion vector histogram for each of said frames; using said computer program to generate average horizontal and vertical components from said motion vector histogram for each of said frames; using said computer program to identify unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and using said computer program to translate each frame by said unwanted horizontal and vertical components; and wherein said using said computer program to identify unwanted horizontal and vertical components for each of said frames includes using said computer program to filter said average horizontal and vertical components from two or more successive frames; and wherein said using said computer program to filter comprises using said computer program to highpass filter.
Claim 44
Independent Claim
158 words
A method of using a computer program for stabilizing an image sequence formed from a plurality of successive frames comprising: using said computer program to calculate motion vectors for each of said frames; using said computer program to form a motion vector histogram for each of said frames; using said computer program to generate average horizontal and vertical components from said motion vector histogram for each of said frames; using said computer program to identify unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and using said computer program to translate each frame by said unwanted horizontal and vertical components; and wherein said using said computer program to identify unwanted horizontal and vertical components for each of said frames includes using said computer program to filter said average horizontal and vertical components from two or more successive frames; and wherein said using said computer program to filter is user-adjustable.
Claim 45
Independent Claim
158 words
A method of using a computer program for stabilizing an image sequence formed from a plurality of successive frames comprising: using said computer program to calculate motion vectors for each of said frames; using said computer program to form a motion vector histogram for each of said frames; using said computer program to generate average horizontal and vertical components from said motion vector histogram for each of said frames; using said computer program to identify unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and using said computer program to translate each frame by said unwanted horizontal and vertical components; and wherein said using said computer program to identify unwanted horizontal and vertical components for each of said frames includes using said computer program to filter said average horizontal and vertical components from two or more successive frames; and wherein said using said computer program to filter is user-adjustable.
Claim 46
Independent Claim
174 words
A method of using a computer program for stabilizing an image sequence formed from a plurality of successive frames comprising: using said computer program to calculate motion vectors for each of said frames; using said computer program to form a motion vector histogram for each of said frames; using said computer program to remove unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; using said computer program to generate average horizontal and vertical components from said motion vector histogram for each of said frames; using said computer program to identify unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and using said computer program to translate each frame by said unwanted horizontal and vertical components; wherein said using said computer program to remove includes using said computer program to discard values from said motion vector histogram below a threshold and said threshold is determined adaptively by said computer program for each of said frames.
Claim 47
Independent Claim
174 words
A method of using a computer program for stabilizing an image sequence formed from a plurality of successive frames comprising: using said computer program to calculate motion vectors for each of said frames; using said computer program to form a motion vector histogram for each of said frames; using said computer program to remove unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; using said computer program to generate average horizontal and vertical components from said motion vector histogram for each of said frames; using said computer program to identify unwanted horizontal and vertical components for each of said frames based on said average horizontal and vertical components; and using said computer program to translate each frame by said unwanted horizontal and vertical components; wherein said using said computer program to remove includes using said computer program to discard values from said motion vector histogram below a threshold and said threshold is determined adaptively by said computer program for each of said frames.
Claim 48
Independent Claim
134 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating a plurality of motion vectors for each of said frames, wherein said motion vectors follow corresponding points between adjacent frames; forming a motion vector histogram for each of said frames from horizontal and vertical components of said motion vectors; removing unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; generating average horizontal and vertical components from said processed motion vector histogram for each of said frames; filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components for each of said frames; and translating each frame by said unwanted horizontal and vertical components; wherein said filtering is adjustable.
Claim 49
Independent Claim
134 words
A method for stabilizing an image sequence formed from a plurality of successive frames comprising: calculating a plurality of motion vectors for each of said frames, wherein said motion vectors follow corresponding points between adjacent frames; forming a motion vector histogram for each of said frames from horizontal and vertical components of said motion vectors; removing unreliable motion vectors from said motion vector histogram to form a processed motion vector histogram for each of said frames; generating average horizontal and vertical components from said processed motion vector histogram for each of said frames; filtering said average horizontal and vertical components from two or more successive frames to identify unwanted horizontal and vertical components for each of said frames; and translating each frame by said unwanted horizontal and vertical components; wherein said filtering is adjustable.
Claim 50
Dependent Claim
11 words
The method of claim 36 , wherein said filtering is user-adjustable.
References Cited (Backward Citations)
US5734933A
Cited
US5111511A
Cited
EP0358267A2
Cited
EP0458239A2
Cited
EP0468628A2
Cited
US5510834A
Cited
US5748231A
Cited
US5629988A
Cited
US5473379A
Cited
US5592226A
Cited
US5748321A
Cited
US6072542A
Cited
US6298144B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-10-26 | 2008-04-26 | 2008-10-26 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-10-26 | 2012-04-26 | 2012-10-26 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-10-26 | 2016-04-26 | 2016-10-26 | $7700.00 | Window Closed / Lapsed |