Abstract A method of hierarchical digital video summarization and browsing includes inputting a digital video signal for a digital video sequence and generating a hierarchical summary based on keyframes of the video sequence. Additional steps may include computing histograms for the digital video sequence; detecting shot boundaries within the digital video sequence; determining the number of keyframes to be allocated within each shot; locating the actual position of each keyframe within each shot; identifying keyframe locations by the largest consecutive difference criteria; pruning keyframes for an shot without meaningful action; extracting keyframes efficiently in the case of compressed video; and browsing the shots using the hierarchical keyframe summary.
A method of hierarchical digital video summarization and browsing comprising: inputting a digital video signal for a digital video sequence; and generating a hierarchical keyframe summary; developing at least one coarser level summary from a given keyframe summary wherein said developing includes statistical clustering using a pairwise K-means clustering algorithm, of histogram vectors of keyframes.
Claim 2
Independent Claim
55 words
A method of hierarchical digital video summarization and browsing comprising: inputting a digital video signal for a digital video sequence; and generating a hierarchical keyframe summary; developing at least one coarser level summary from a given keyframe summary wherein said developing includes statistical clustering using a pairwise K-means clustering algorithm, of histogram vectors of keyframes.
Claim 3
Dependent Claim
23 words
The method of claim 1 where only those keyframes that are consecutive in time are allowed to be included in the same cluster.
Claim 4
Dependent Claim
34 words
The method of claim 1 which includes selecting keyframes to represent keyframe clusters and choosing keyframes as those frames within the clusters whose histogram vectors are closest to the centroid vectors of the clusters.
Claim 5
Dependent Claim
26 words
The method of claim 1 wherein said selecting includes selecting the keyframes in the second and existing subsequent clusters on the basis of largest difference-from-the-previous-keyframe criterion.