US7149974B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Reduced representations of video sequences
Assignee: Fujifilm Business Innovation Corp
•
Filing: 2002-04-03
•
Granted: 2006-12-12
•
Expires: 2022-04-03
Abstract
Abstract A system that represents a video sequence comprising plurality of video clips as a number of images. The plurality of video clips is represented as a reduced representation of video images. A video clip is represented as a keyframe, wherein multiple keyframes may then be arranged according to chronological order. All or only a representative portion of the video clips can be represented as keyframes. The size of the keyframe may be configured to represent the length or importance of the video clip. The keyframe may depict an entire frame of a video clip, or a region of meaningful information within a frame of a video clip. Multiple keyframes may be arranged in a two dimensional array, in an S-shaped curve, or some other pattern. The keyframes may depict motion of an object occurring over time in the video clip by configuring groups of pixels in the key frame. Configuring groups of pixels may include colorizing pixel groups and depicting pixel groups at a semi-transparent level according to the number of frames between the keyframe and the frame containing the object in motion.
Inventors
- 👤 Andreas Girgensohn
- 👤 Frank M. Shipman, III
- 👤 Lynn D. Wilcox
- 👤 Patrick Chiu
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:15
CPC Classifications
G; G11; G11B; G11B27/00; G11B27/02; G11B27/031; G11B27/034; G06; G06F; G06F16/00; G06F16/70; G06F16/73; G06F16/738; G06F16/739; G06F16/78; G06F16/783; G06F16/7847; G06F16/785; G06F16/786; G11B27/10; G11B27/34; G11B2220/00; G11B2220/20; G11B2220/25; G11B2220/2537; G11B2220/2562
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
123 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence, wherein each of the plurality of keyframes is reduced in size proportional to the importance of the video clip associated with each keyframe; and a keyframe display region, having the same area as a keyframe, for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence.
Claim 2
Dependent Claim
123 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence, wherein each of the plurality of keyframes is reduced in size proportional to the importance of the video clip associated with each keyframe; and a keyframe display region, having the same area as a keyframe, for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence.
Claim 3
Dependent Claim
142 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence, wherein each of the plurality of keyframes is reduced In size proportional to the importance of the video clip associated with each keyframe the importance of the video clip associated with each keyframe is determined by a length of the video clip; and a keyframe display region, having the same area as a keyframe, for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence.
Claim 4
Dependent Claim
142 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence, wherein each of the plurality of keyframes is reduced In size proportional to the importance of the video clip associated with each keyframe the importance of the video clip associated with each keyframe is determined by a length of the video clip; and a keyframe display region, having the same area as a keyframe, for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence.
Claim 5
Dependent Claim
119 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at leas ta portion of the plurality of video clips of the video sequence, wherein each of said plurality of keyframes comprises a region of meaningful information selected by performing a keyframe foreground/background separation; and a keyframe display region for displaying only the regions of meaningful information, the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence.
Claim 6
Dependent Claim
119 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at leas ta portion of the plurality of video clips of the video sequence, wherein each of said plurality of keyframes comprises a region of meaningful information selected by performing a keyframe foreground/background separation; and a keyframe display region for displaying only the regions of meaningful information, the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence.
Claim 7
Dependent Claim
201 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence wherein at least one of the plurality of keyframes from at least one of the plurality of video clips indicates motion of an object within the at least one video clip, the motion indicated by configuring a plurality of pixels in the at least one keyframe that change throughout the video clip by varying levels of transparency, the object corresponding to the object in motion in a particular frame before or after the at least one keyframe of the at least one video clip, the level of transparency corresponding to a number of frames between the at least one keyframe and the particular frame in the video clip; and a keyframe display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence.
Claim 8
Dependent Claim
201 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence wherein at least one of the plurality of keyframes from at least one of the plurality of video clips indicates motion of an object within the at least one video clip, the motion indicated by configuring a plurality of pixels in the at least one keyframe that change throughout the video clip by varying levels of transparency, the object corresponding to the object in motion in a particular frame before or after the at least one keyframe of the at least one video clip, the level of transparency corresponding to a number of frames between the at least one keyframe and the particular frame in the video clip; and a keyframe display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence.
Claim 9
Dependent Claim
201 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence wherein at least one of the plurality of keyframes from at least one of the plurality of video clips indicates motion of an object within the at least one video clip, the motion indicated by a group of pixels that are colorized to indicate the location of the object in a particular frame of the at least one video clip, the colorization of the group of pixels corresponding to whether the particular frame occurs before or after the at least one keyframe, an intensity of the colorization of the group of pixels corresponding to the number of frames between the particular frame and the at least one keyframe; and a keyframe display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence.
Claim 10
Dependent Claim
201 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence wherein at least one of the plurality of keyframes from at least one of the plurality of video clips indicates motion of an object within the at least one video clip, the motion indicated by a group of pixels that are colorized to indicate the location of the object in a particular frame of the at least one video clip, the colorization of the group of pixels corresponding to whether the particular frame occurs before or after the at least one keyframe, an intensity of the colorization of the group of pixels corresponding to the number of frames between the particular frame and the at least one keyframe; and a keyframe display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence.
Claim 11
Dependent Claim
121 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video dips of the video sequence; and a keyframe display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed by at least one of cropping and scaling to reduce the plurality of keyframes in size, proportional to the importance of the video clip associated with each keyframe, so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence.
Claim 12
Dependent Claim
121 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video dips of the video sequence; and a keyframe display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed by at least one of cropping and scaling to reduce the plurality of keyframes in size, proportional to the importance of the video clip associated with each keyframe, so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence.
Claim 13
Dependent Claim
144 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence; a keytrame display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed by at least one of cropping and scaling to reduce the plurality of keyframes in size, proportional to the importance of the video clip associated with each keyframe, so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence; and an importance of each of the plurality of video clips is determined by a length of each of the plurality of video clips.
Claim 14
Dependent Claim
144 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence; a keytrame display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed by at least one of cropping and scaling to reduce the plurality of keyframes in size, proportional to the importance of the video clip associated with each keyframe, so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence; and an importance of each of the plurality of video clips is determined by a length of each of the plurality of video clips.
Claim 15
Dependent Claim
140 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence, wherein each of said plurality of keyframes comprrises a region of meaningful information, said region of meaningful information selected by performing a foreground/background separation on each of said plurality of keyframes; and a keyframe display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region, so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence, and so that the keyframe display region displays only the meaningful regions of the plurality of keyframes.
Claim 16
Dependent Claim
140 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence, wherein each of said plurality of keyframes comprrises a region of meaningful information, said region of meaningful information selected by performing a foreground/background separation on each of said plurality of keyframes; and a keyframe display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region, so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence, and so that the keyframe display region displays only the meaningful regions of the plurality of keyframes.
Claim 17
Dependent Claim
137 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence; and a keyframe display region for displaying the plurality of keyframes in chronological sequence arranged in an S-shaped curve, wherein a downward offset between adjacent keyframes in the keyframe display region is greater than the upward offset between adjacent keyframes in the keyframe display region in order to present the S-shaped curve with a generally downward slope, and wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video dips in the video sequence.
Claim 18
Dependent Claim
137 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence; and a keyframe display region for displaying the plurality of keyframes in chronological sequence arranged in an S-shaped curve, wherein a downward offset between adjacent keyframes in the keyframe display region is greater than the upward offset between adjacent keyframes in the keyframe display region in order to present the S-shaped curve with a generally downward slope, and wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video dips in the video sequence.
Claim 19
Dependent Claim
221 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence wherein a keyframe from a video clip indicates motion of an object within the video clip, wherein the object is indicated by a group of pixels at a certain level of transparency corresponding to the number of frames between the keyframe and the particular frame in the video clip, the object corresponding to the object In motion in a particular frame before or after the keyframe of the video clip; and a keyframe display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence. wherein the object is indicated by a group of pixels at a certain level of transparency, the object corresponding to the object in motion in a particular frame before or after the keyframe of the video clip, the level of transparency corresponding to the number of frames between the keyframe and the particular frame in the video clip.
Claim 20
Dependent Claim
221 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence wherein a keyframe from a video clip indicates motion of an object within the video clip, wherein the object is indicated by a group of pixels at a certain level of transparency corresponding to the number of frames between the keyframe and the particular frame in the video clip, the object corresponding to the object In motion in a particular frame before or after the keyframe of the video clip; and a keyframe display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence. wherein the object is indicated by a group of pixels at a certain level of transparency, the object corresponding to the object in motion in a particular frame before or after the keyframe of the video clip, the level of transparency corresponding to the number of frames between the keyframe and the particular frame in the video clip.
Claim 21
Dependent Claim
238 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence wherein a keyframe from a video clip indicates motion of an object within the video clip, wherein the object is indicated by a group of pixels that are colorized to indicate the location of the object in a particular frame of the video clip, the color of the group of pixels corresponding to whether the particular frame occurs before or after the keyframe, the intensity of the color of the group of pixels corresponding to the number of frames between the particular frame and the key frame; and a keyframe display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence. wherein the object is indicated by a group of pixels at a certain level of transparency, the object corresponding to the object in motion in a particular frame before or after the keyframe of the video clip, the level of transparency corresponding to the number of frames between the keyframe and the particular frame in the video clip.
Claim 22
Dependent Claim
238 words
A reduced representation of a video sequence comprised of a plurality of video clips, the reduced representation comprising: a plurality of keyframes from at least a portion of the plurality of video clips of the video sequence wherein a keyframe from a video clip indicates motion of an object within the video clip, wherein the object is indicated by a group of pixels that are colorized to indicate the location of the object in a particular frame of the video clip, the color of the group of pixels corresponding to whether the particular frame occurs before or after the keyframe, the intensity of the color of the group of pixels corresponding to the number of frames between the particular frame and the key frame; and a keyframe display region for displaying the plurality of keyframes in chronological sequence, wherein the plurality of keyframes is processed so as to fit within the keyframe display region and so that the keyframe display region includes a plurality of keyframes from a representative portion of the plurality of video clips in the video sequence. wherein the object is indicated by a group of pixels at a certain level of transparency, the object corresponding to the object in motion in a particular frame before or after the keyframe of the video clip, the level of transparency corresponding to the number of frames between the keyframe and the particular frame in the video clip.
References Cited (Backward Citations)
US5359712A
Cited
US5425140A
Cited
US5920316A
Cited
US5920313A
Cited
US5828371A
Cited
US6052492A
Cited
US6616700B1
Cited
US6647535B1
Cited
US6925602B1
Cited
US6807361B1
Cited
US20020175917A1
Cited
US20030190143A1
Cited
US20030189588A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2009-12-11 | 2010-06-12 | 2010-12-12 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2013-12-11 | 2014-06-12 | 2014-12-12 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2017-12-11 | 2018-06-12 | 2018-12-12 | $7700.00 | Window Closed / Lapsed |