Patent US6288559B1 successfully refreshed from Google Patents.
Patent JPS5679374A successfully refreshed from Google Patents.
Patent US6771268B1 successfully refreshed from Google Patents.
US6771268B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Video skimming system utilizing the vector rank filter
Assignee: Sharp Laboratories of America Inc
•
Filing: 2000-03-03
•
Granted: 2004-08-03
•
Expires: 2020-03-03
Abstract
Abstract Automated summarization of digital video sequences is accomplished using a vector rank filter. The consecutive frames of a digital video sequence can be represented as feature vectors which are successively accumulated in a set of vectors. The distortion of the set by the addition of each successive vector or the cumulative distance from each successive vector to all other vectors in the set is determined by a vector rank filter. When the distortion exceeds a threshold value the end of a video segment is detected. Each frame in a video segment can be ranked according to its relative similarity to the other frames of the set by applying the vector rank filter to the feature vectors representing the video frames. To produce a summary of a video sequence which is most representative of the content of the sequence, frames are chosen that correspond to vectors that are the least distant to or produce the least distortion of the set of vectors representing the segment. The ranking of the relative distortion can be used as the basis for selecting more than one frame from each segment to produce a hierarchy of summaries containing greater numbers of the frames having the most representative content.
Inventors
- 👤 Regis J. Crinon
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 21:50
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/70; G06F16/78; G06F16/783; G06F16/7847; G06F16/73; G06F16/738; G06F16/739
Claims Analysis
Total Claims: 14
Claim 1
Independent Claim
109 words
A method of identifying a key video frame within a plurality of video frames comprising the steps of: (a) dividing said plurality of video frames into at least two segments; (b) characterizing said plurality of video frames as a plurality of feature vectors; (c) identifying for each of at least two segments a first level key feature vector that minimizes a distortion of said feature vectors included in said segment; (d) identifying a second level key feature vector that minimizes distortion of a set of first level key feature vectors; and (e) identifying a video frame corresponding to said second level key feature vector as said key video frame.
Claim 2
Independent Claim
109 words
A method of identifying a key video frame within a plurality of video frames comprising the steps of: (a) dividing said plurality of video frames into at least two segments; (b) characterizing said plurality of video frames as a plurality of feature vectors; (c) identifying for each of at least two segments a first level key feature vector that minimizes a distortion of said feature vectors included in said segment; (d) identifying a second level key feature vector that minimizes distortion of a set of first level key feature vectors; and (e) identifying a video frame corresponding to said second level key feature vector as said key video frame.
Claim 3
Dependent Claim
29 words
The method of claim 1 wherein said first level key feature vector that minimizes said distortion of said plurality of feature vectors is identified by a vector rank filter.
Claim 4
Dependent Claim
32 words
The method of claim 1 wherein said second level key feature vector that minimizes said distortion of said set of first level key feature vectors is identified by a vector rank filter.
Claim 5
Dependent Claim
25 words
The method of claim 1 wherein at least one feature vector of said plurality of feature vectors is a vector signal describing an image histogram.
Claim 6
Dependent Claim
28 words
The method of claim 1 wherein at least one feature vector of said plurality of feature vectors is a vector signal describing an ordered set of image samples.
Claim 7
Dependent Claim
31 words
The method of claim 1 wherein at least one feature vector of said plurality of feature vectors is a vector signal which includes a component describing luminance of said video frame.
Claim 8
Dependent Claim
33 words
The method of claim 1 wherein at least one feature vector of said plurality of feature vectors is a vector signal which includes a component describing the average intensity of said video frame.
Claim 9
Independent Claim
129 words
A method of identifying a key video frame within a plurality of video frames comprising the steps of: (a) dividing said plurality of video frames into at least two segments; (b) characterizing said plurality of video frames as a plurality of feature vectors; (c) identifying for each of at least two segments a first level key feature vector that minimizes a distortion of said feature vectors included in said segment; (d) accumulating a set of said first level key feature vectors corresponding to said segments occurring in a predetermined period; (e) identifying a second level key feature vector that minimizes distortion of said set of first level key feature vectors; and (f) identifying a video frame corresponding to said second level key feature vector as said key video frame.
Claim 10
Independent Claim
129 words
A method of identifying a key video frame within a plurality of video frames comprising the steps of: (a) dividing said plurality of video frames into at least two segments; (b) characterizing said plurality of video frames as a plurality of feature vectors; (c) identifying for each of at least two segments a first level key feature vector that minimizes a distortion of said feature vectors included in said segment; (d) accumulating a set of said first level key feature vectors corresponding to said segments occurring in a predetermined period; (e) identifying a second level key feature vector that minimizes distortion of said set of first level key feature vectors; and (f) identifying a video frame corresponding to said second level key feature vector as said key video frame.
Claim 11
Independent Claim
105 words
A method of summarizing of a plurality of video frames comprising the steps of: (a) dividing said plurality of video frames into at least two segments, each segment comprising at least one video frame; (b) defining a feature vector representative of each of said video frames; (c) identifying as a key feature vector a feature vector that minimizes a distortion of said feature vectors included in said segment; (d) ranking a saliency of a key feature vector relative to other key feature vectors; (f) selecting a video frame for said summary on a basis of said saliency ranking of a corresponding a key feature vector.
Claim 12
Independent Claim
105 words
A method of summarizing of a plurality of video frames comprising the steps of: (a) dividing said plurality of video frames into at least two segments, each segment comprising at least one video frame; (b) defining a feature vector representative of each of said video frames; (c) identifying as a key feature vector a feature vector that minimizes a distortion of said feature vectors included in said segment; (d) ranking a saliency of a key feature vector relative to other key feature vectors; (f) selecting a video frame for said summary on a basis of said saliency ranking of a corresponding a key feature vector.
Claim 13
Dependent Claim
30 words
The method of claim 9 wherein said saliency is a function of a distortion of a set of key feature vectors produced by a feature vector included in said set.
Claim 14
Dependent Claim
46 words
The method of claim 9 wherein said saliency is a function of a distortion of a set of key feature vectors produced by a feature vector included in said set and a number of video frames included in said segment represented by said key feature vector.
References Cited (Backward Citations)
US5875108A
Cited
US5903454A
Cited
US6081750A
Cited
US5774357A
Cited
US5867386A
Cited
US5920477A
Cited
US6002833A
Cited
US6038367A
Cited
US5717814A
Cited
US5610653A
Cited
US5724472A
Cited
US6011895A
Cited
US6151444A
Cited
US6208805B1
Cited
US5696869A
Cited
US6091886A
Cited
US6304715B1
Cited
US5684918A
Cited
US5233681A
Cited
USRE36801E
Cited
USD354059S
Cited
US5600364A
Cited
US5734853A
Cited
US6052554A
Cited
US5682195A
Cited
US5659350A
Cited
US5798785A
Cited
US6160989A
Cited
US6181335B1
Cited
US5600573A
Cited
US6201536B1
Cited
US5990927A
Cited
US5986690A
Cited
US5559549A
Cited
USD348251S
Cited
US5913013A
Cited
US5664046A
Cited
US5434678A
Cited
US6269216B1
Cited
US6067401A
Cited
US6072934A
Cited
US5589945A
Cited
US5987211A
Cited
US5634849A
Cited
US6230501B1
Cited
US5635982A
Cited
USD381991S
Cited
USD368263S
Cited
US5664227A
Cited
USD402310S
Cited
US5797001A
Cited
US5710884A
Cited
US5761881A
Cited
US5901246A
Cited
US5900867A
Cited
US5958006A
Cited
US5926624A
Cited
US5986692A
Cited
US5892536A
Cited
US6088455A
Cited
JPH1132267A
Cited
US5973683A
Cited
US5995095A
Cited
US6252544B1
Cited
JPH11261908A
Cited
WO1999065237A1
Cited
JP2000013755A
Cited
US6233389B1
Cited
US6215526B1
Cited
US6289165B1
Cited
US6342904B1
Cited
US6331859B1
Cited
USD435561S
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-08-03 | 2008-02-02 | 2008-08-03 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-08-03 | 2012-02-02 | 2012-08-03 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-08-03 | 2016-02-02 | 2016-08-03 | $7700.00 | Window Closed / Lapsed |