Patent US299317A successfully refreshed from Google Patents.
US8379154B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Key-frame extraction from video
Assignee: Hewlett Packard Development Co LP
•
Filing: 2006-05-12
•
Granted: 2013-02-19
•
Expires: 2026-05-12
Abstract
Abstract Techniques that enable flexible key-frame extraction from video. Key-frame extraction according to the present teachings includes segmenting a video into a set of shots each having a set of video frames and selecting a set of key-frames from the shots in response to an image quality of the corresponding video frames. The present techniques include a set of user selectable modes that enable key-frame extraction to be adapted to an underlying platform.
Inventors
- 👤 Tong Zhang
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 11:21
CPC Classifications
G; G11; G11B; G11B27/00; G11B27/10; G11B27/19; G11B27/28
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
118 words
A method for key-frame extraction, comprising: segmenting a video of video frames into a set of shots each having a set of the video frames of the video, by: determining a color histogram for each video frame; determining a difference in the color histograms of each pair of a plurality of pairs of consecutive video frames of the video of video frames; determining a mean and variance in the difference in the color histograms of each pair; determining an adaptive threshold based on the mean and the variance; detecting shot boundaries within the video using the adaptive threshold; and selecting a set of key-frames from the shots in response to an image quality of the corresponding video frames.
Claim 2
Independent Claim
118 words
A method for key-frame extraction, comprising: segmenting a video of video frames into a set of shots each having a set of the video frames of the video, by: determining a color histogram for each video frame; determining a difference in the color histograms of each pair of a plurality of pairs of consecutive video frames of the video of video frames; determining a mean and variance in the difference in the color histograms of each pair; determining an adaptive threshold based on the mean and the variance; detecting shot boundaries within the video using the adaptive threshold; and selecting a set of key-frames from the shots in response to an image quality of the corresponding video frames.
Claim 3
Dependent Claim
24 words
The method of claim 1 , wherein selecting includes selecting the key-frames in response to a video content change in the corresponding video frames.
Claim 4
Dependent Claim
24 words
The method of claim 2 , wherein selecting includes determining the video content change by determining a histogram difference in the corresponding video frames.
Claim 5
Dependent Claim
22 words
The method of claim 1 , wherein selecting includes selecting the key-frames in response to an entropy for each corresponding video frame.
Claim 6
Dependent Claim
22 words
The method of claim 1 , wherein selecting includes selecting the key-frames in response to a sharpness for each corresponding video frame.
Claim 7
Dependent Claim
22 words
The method of claim 1 , wherein selecting includes selecting the key-frames in response to a contrast for each corresponding video frame.
Claim 8
Dependent Claim
19 words
The method of claim 1 , wherein selecting includes selecting the key-frames in response to a user selected mode.
Claim 9
Dependent Claim
29 words
The method of claim 7 , wherein selecting a set of key-frames includes selecting a fixed number of key-frames for the video as specified by the user selected mode.
Claim 10
Dependent Claim
25 words
The method of claim 7 , wherein selecting includes selecting a fixed rate of key-frames for the video as specified by the user selected mode.
Claim 11
Dependent Claim
25 words
The method of claim 7 , wherein selecting includes selecting one key-frame for each shot in the video as specified by the user selected mode.
Claim 12
Dependent Claim
129 words
A video system including a key-frame extractor that segments a video of video frames into a set of shots each having a set of the video of the video frames and that selects a set of key-frames from the shots in response to an image quality of the corresponding video frames, wherein the key-frame extractor segments the video by: determining a color histogram for each video frame; determining a difference in the color histograms of each pair of a plurality of pairs of consecutive video frames of the video of video frames; determining a mean and variance in the difference in the color histograms of each pair; determining an adaptive threshold based on the mean and the variance; and, detecting shot boundaries within the video using the adaptive threshold.
Claim 13
Dependent Claim
129 words
A video system including a key-frame extractor that segments a video of video frames into a set of shots each having a set of the video of the video frames and that selects a set of key-frames from the shots in response to an image quality of the corresponding video frames, wherein the key-frame extractor segments the video by: determining a color histogram for each video frame; determining a difference in the color histograms of each pair of a plurality of pairs of consecutive video frames of the video of video frames; determining a mean and variance in the difference in the color histograms of each pair; determining an adaptive threshold based on the mean and the variance; and, detecting shot boundaries within the video using the adaptive threshold.
Claim 14
Dependent Claim
26 words
The video system of claim 11 , wherein the key-frame extractor selects the key-frames in response to a video content change in the corresponding video frames.
Claim 15
Dependent Claim
21 words
The video system of claim 12 , wherein the key-frame extractor selects the key-frames in response to a user selected mode.
Claim 16
Dependent Claim
21 words
The video system of claim 13 , wherein the user selected mode specifies a fixed number of key-frames for the video.
Claim 17
Dependent Claim
22 words
The video system of claim 14 , wherein the key-frame extractor selects the key-frames by ranking the shots according length and content.
Claim 18
Dependent Claim
32 words
The video system of claim 15 , wherein the key-frame extractor selects the key-frames by splitting one of the shots into two shots at a video frame having a greatest content change.
Claim 19
Dependent Claim
23 words
The video system of claim 14 , wherein the key-frame extractor selects the key-frames by removing a key-frame having a low image quality.
Claim 20
Dependent Claim
24 words
The video system of claim 14 , wherein the key-frame extractor selects the key-frames by removing a key-frame that corresponds to a short shot.
Claim 21
Dependent Claim
21 words
The video system of claim 13 , wherein the user selected mode specifies a fixed rate of key-frames for the video.
Claim 22
Dependent Claim
58 words
The video system of claim 19 , wherein the key-frame extractor selects the key-frames by dividing the video into a set of segments having a fixed length in response to the fixed rate by allocating one key-frame to each of a set of segments in the video in response to a set of shot boundaries and content changes.
References Cited (Backward Citations)
US5576950A
Cited
US6782049B1
Cited
US7184100B1
Cited
US6771268B1
Cited
US20020146168A1
Cited
WO2003101097A1
Cited
US20040052505A1
Cited
US7739598B2
Cited
US7131059B2
Cited
US7496228B2
Cited
US7512286B2
Cited
US7447337B2
Cited
US20070182861A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2016-02-19 | 2016-08-20 | 2017-02-19 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2020-02-19 | 2020-08-20 | 2021-02-19 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2024-02-19 | 2024-08-20 | 2025-02-19 | $7700.00 | Window Closed / Lapsed |