Patent US8619150B2 successfully refreshed from Google Patents.
US8619150B2
Active / In Force
US
⏱️ 3.5 years remaining
Ranking key video frames using camera fixation
Assignee: Monument Peak Ventures LLC
•
Filing: 2010-05-25
•
Granted: 2013-12-31
•
Expires: 2030-05-25
Abstract
Abstract A method for ranking key video frames for a digital video having a time sequence of video frames, comprising using a processor to perform the steps of: analyzing the digital video to determine a camera fixation pattern; determining a set of key video frames for the digital video; and ranking the key video frames responsive to the camera fixation pattern.
Inventors
- 👤 Aaron T. Deever
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:15
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/70; G06F16/71
Claims Analysis
Total Claims: 18
Claim 1
Independent Claim
109 words
A method for ranking video frames for a digital video having a time sequence of video frames, the method comprising: analyzing, by a computing device, the digital video to determine a camera fixation pattern; determining, by the computing device, a set of video frames for the digital video; and ranking, by the computing device, the video frames responsive to the camera fixation pattern, wherein the camera fixation pattern represents regions of an image scene being captured in each video frame of the set of video frames, and wherein the ranking the video frames is based on how many video frames comprise a similar captured region of the image scene.
Claim 2
Independent Claim
109 words
A method for ranking video frames for a digital video having a time sequence of video frames, the method comprising: analyzing, by a computing device, the digital video to determine a camera fixation pattern; determining, by the computing device, a set of video frames for the digital video; and ranking, by the computing device, the video frames responsive to the camera fixation pattern, wherein the camera fixation pattern represents regions of an image scene being captured in each video frame of the set of video frames, and wherein the ranking the video frames is based on how many video frames comprise a similar captured region of the image scene.
Claim 3
Dependent Claim
29 words
The method of claim 1 , wherein the analyzing the digital video to determine the camera fixation pattern comprises performing global motion analysis to determine the camera fixation pattern.
Claim 4
Dependent Claim
17 words
The method of claim 2 , wherein the global motion analysis includes analyzing data from an accelerometer.
Claim 5
Dependent Claim
22 words
The method of claim 2 , wherein the global motion analysis includes analyzing the digital video using a digital motion estimation algorithm.
Claim 6
Dependent Claim
18 words
The method of claim 1 , further comprising quantizing the camera fixation pattern into camera fixation pattern regions.
Claim 7
Dependent Claim
41 words
The method of claim 5 , wherein each camera fixation pattern region of the camera fixation pattern has an associated fixation value that is a function of a number of video frames having fixation locations in that camera fixation pattern region.
Claim 8
Dependent Claim
17 words
The method of claim 5 , wherein each video frame has a corresponding camera fixation pattern region.
Claim 9
Dependent Claim
17 words
The method of claim 6 , wherein the video frames are initially ranked by the fixation value.
Claim 10
Dependent Claim
19 words
The method of claim 8 , wherein the ranking of the video frames is subsequently adjusted to reduce redundancy.
Claim 11
Dependent Claim
82 words
The method of claim 1 , wherein the determining the set of video frames comprises: analyzing the digital video to determine an importance value as a function of time; forming a warped time representation of the digital video by temporal relocation of the video frames responsive to the importance value as a function of time; subdividing the warped time representation into a set of equal intervals; and selecting a video frame for each interval by analyzing the video frames within each interval.
Claim 12
Dependent Claim
37 words
The method of claim 1 , further comprising: forming video snippets corresponding to highest-ranked video frames; assembling the video snippets to form a video summary; and storing a representation of the video summary in a processor-accessible memory.
Claim 13
Dependent Claim
169 words
A digital video camera system comprising: an image sensor; an optical system configured to form an image of a scene onto the image sensor; a data processing system; and a memory system communicatively connected to the data processing system and storing instructions configured to cause the data processing system to implement a method for providing ranked video frames for a digital video, wherein the instructions comprise: instructions to capture a digital video using the image sensor, the digital video having a time sequence of video frames; instructions to analyze the digital video to determine a camera fixation pattern; instructions to determine a set of video frames for the digital video; and instructions to rank the video frames responsive to the camera fixation pattern, wherein the camera fixation pattern represents regions of an image scene being captured in each video frame of the set of video frames, and wherein the ranking the video frames is based on how many video frames comprise a similar captured region of the image scene.
Claim 14
Dependent Claim
169 words
A digital video camera system comprising: an image sensor; an optical system configured to form an image of a scene onto the image sensor; a data processing system; and a memory system communicatively connected to the data processing system and storing instructions configured to cause the data processing system to implement a method for providing ranked video frames for a digital video, wherein the instructions comprise: instructions to capture a digital video using the image sensor, the digital video having a time sequence of video frames; instructions to analyze the digital video to determine a camera fixation pattern; instructions to determine a set of video frames for the digital video; and instructions to rank the video frames responsive to the camera fixation pattern, wherein the camera fixation pattern represents regions of an image scene being captured in each video frame of the set of video frames, and wherein the ranking the video frames is based on how many video frames comprise a similar captured region of the image scene.
Claim 15
Dependent Claim
94 words
The digital video camera system of claim 12 , the instructions to determine the set of video frames comprise: instructions to analyze the digital video to determine an importance value as a function of time; instructions to form a warped time representation of the digital video by temporal relocation of the video frames responsive to the importance value as a function of time; instructions to subdivide the warped time representation into a set of equal intervals; and instructions to select a video frame for each interval by analyzing the video frames within each interval.
Claim 16
Dependent Claim
37 words
The digital video camera system of claim 12 , wherein the instructions to rank the video frames comprises instructions to rank video frames corresponding to regions of high camera fixation higher than regions of lower camera fixation.
Claim 17
Dependent Claim
30 words
The method of claim 1 , wherein the ranking the video frames comprises ranking video frames corresponding to regions of high camera fixation higher than regions of lower camera fixation.
Claim 18
Dependent Claim
37 words
The method of claim 1 , wherein the analyzing the digital video to determine a camera fixation pattern comprises determining pixel offsets between consecutive video frames and tracing cumulative pixel offsets throughout the set of video frames.
References Cited (Backward Citations)
US3971065A
Cited
US4642678A
Cited
US4774574A
Cited
US5189511A
Cited
US5493335A
Cited
US6292218B1
Cited
US5668597A
Cited
US5818439A
Cited
US5652621A
Cited
US5995095A
Cited
US6192162B1
Cited
US6833865B1
Cited
US7403224B2
Cited
US6934056B2
Cited
US6462754B1
Cited
US20080043848A1
Cited
US7046731B2
Cited
US7055168B1
Cited
US7409144B2
Cited
US7035435B2
Cited
US20040052505A1
Cited
US20060290821A1
Cited
US20050191729A1
Cited
US7483618B1
Cited
US7542077B2
Cited
US20060257048A1
Cited
US20070182861A1
Cited
US20070183497A1
Cited
US20070237225A1
Cited
WO2007122541A2
Cited
EP2063635A1
Cited
US20090007202A1
Cited
US20090160957A1
Cited
US20100128118A1
Cited
US20100290529A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2016-12-30 | 2017-07-01 | 2017-12-31 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2020-12-30 | 2021-07-01 | 2021-12-31 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2024-12-30 | 2025-07-01 | 2025-12-31 | $7700.00 | Window Closed / Lapsed |