US5521841A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Browsing contents of a given video sequence
Assignee: Siemens Corp
•
Filing: 1994-03-31
•
Granted: 1996-05-28
•
Expires: 2014-03-31
Abstract
Abstract A method for representing contents of a video sequence for allowing a user to rapidly view a video sequence in order to find a particular desired point within the sequence and/or to decide whether the contents of a video sequence are relevant to a user, the video sequence having been pre-processed to detect scene changes and to build Rframes, and for allowing a user to scroll through the Rframes and to stop at a selected Rframe for processing, comprises playing the video sequence from a point of the selected Rframe, detecting all Rframes having respective degrees of similarity to the Rframe selected by the user, and presenting the similar Rframes to the user in a size or scale representative of the degrees of similarity.
Inventors
- 👤 Farshid Arman
- 👤 Remi Depommier
- 👤 Arding Hsu
- 👤 Ming-Yee Chiu
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-02 18:26
CPC Classifications
G; G11; G11B; G11B27/00; G11B27/02; G11B27/031; G11B27/034; G06; G06F; G06F16/00; G06F16/70; G06F16/74; G06F16/745; G06F16/78; G06F16/783; G06F16/7847; G06F16/785; G06F16/7854; G06F3/00; G06F3/01; G06F3/048; G06F3/0484; G06F3/0485; G09; G09B; G09B5/00; G09B5/06; G09B5/065; G11B27/10; G11B27/19; G11B27/28; G11B27/34; H; H04; H04N; H04N5/00; H04N5/14; H04N5/147
Claims Analysis
Total Claims: 11
Claim 1
Independent Claim
154 words
A computer-implemented method for representing contents of a video sequence for allowing a user to rapidly view a video sequence in order to find a particular desired point within said sequence and/or to decide whether said contents of a video sequence are relevant to a user, said video sequence having been pre-processed to detect scene changes and to build Rframes, an Rframe being a representation of a sequence of images, and for allowing a user to scroll through said Rframes in a given manner and to stop at a selected Rframe for processing, said method comprising: (a) playing said video sequence from the beginning of a shot represented by said selected Rframe to the end of said shot; (b) detecting all Rframes having respective degrees of similarity to said Rframe selected by said user; and (c) presenting said similar Rframes to said user in a size or scale representative of said degrees of similarity.
Claim 2
Dependent Claim
154 words
A computer-implemented method for representing contents of a video sequence for allowing a user to rapidly view a video sequence in order to find a particular desired point within said sequence and/or to decide whether said contents of a video sequence are relevant to a user, said video sequence having been pre-processed to detect scene changes and to build Rframes, an Rframe being a representation of a sequence of images, and for allowing a user to scroll through said Rframes in a given manner and to stop at a selected Rframe for processing, said method comprising: (a) playing said video sequence from the beginning of a shot represented by said selected Rframe to the end of said shot; (b) detecting all Rframes having respective degrees of similarity to said Rframe selected by said user; and (c) presenting said similar Rframes to said user in a size or scale representative of said degrees of similarity.
Claim 3
Dependent Claim
34 words
A method for representing contents of a video sequence in accordance with claim 1, wherein step (b) is performed by evaluating Rframe shape properties represented by using a respective moment for each Rframe image.
Claim 4
Dependent Claim
136 words
A method for representing contents of a video sequence in accordance with claim 2, wherein said moment of said R frame image is defined as: m.sub.pq =ΣΣx.sup.p y.sup.q ƒ(x,y) (2) where, in reference to an image f(x,y), m 00 corresponds to a total mass of a frame and m 20 correspond to moments of inertia about the x and y axes, and a moment invariant derived therefrom is defined as ##EQU9## and the first few moment invariants are defined as φ.sub. =η.sub. 2 +η.sub. 02 φ.sub.2 =(η.sub.20 -η.sub.02).sup.2 +4η.sub.11.sup.2 ( 4) φ.sub.3 =(η.sub.30 -3η.sub.12).sup.2 +(3η.sub.21 -η.sub.03).sup.2 The shape of each Rframe is then represented using the vector σ defined as: σ={φ.sub.1, φ.sub.2, φ.sub.3, . . . , φ.sub.7 }(5) and a "metric distance" ψ(α,β) is used to measure the similarity of two Rframes: ψ(α,β)=|σ.sub.α -σ.sub.β |.sup.2
Claim 5
Dependent Claim
29 words
A method for representing contents of a video sequence in accordance with claim 1, wherein step (b) is performed by evaluating Rframe color properties represented by using color histograms.
Claim 6
Dependent Claim
35 words
A method for representing contents of a video sequence in accordance with claim 1, wherein step (b) is performed by evaluating shape properties represented by using moments and Rframe color properties represented using color histograms.
Claim 7
Dependent Claim
196 words
A method for representing contents of a video sequence in accordance with claim 5, wherein said moment of said R frame is defined as: m.sub.pq =ΣΣx.sup.p y.sup.q ƒ(x,y) (2) and a moment invariant derived therefrom is defined as ##EQU10## the first few moment invariants are defined as φ.sub. =η.sub. 2 +η.sub. 02 φ.sub.2 =(η.sub.20 -η.sub.02).sup.2 +4η.sub.11.sup.2 ( 4) φ.sub.3 =(η.sub.30 -3η.sub.12).sup.2 +(3η.sub.21 -η.sub.03).sup.2 The shape of each Rframe is then represented using the vector σ defined as: σ={φ.sub.1, φ.sub.2, φ.sub.3, . . . , φ.sub.7 }(5) and a "metric distance" is used to measure the similarity of two Rframes: ψ(α,β)=|σ.sub.α -σ.sub.β |.sup.2 and wherein a color histogram is obtained by counting how many times each color appears in each Rframe, using hue and saturation components of the HSI color space to calculate the color histogram for each Rframe; and measuring similarity by the technique of histogram intersection, defined as: ##EQU11## where α and β are the two histograms, whereby the result of this intersection indicates how many pixels in one image have corresponding pixels of the same color in the other image, and the measure is normalized using: ##EQU12## where β i is the ith histogram.
Claim 8
Dependent Claim
165 words
A computer-implemented method for representing contents of a video sequence for allowing a user to rapidly view a video sequence in order to find a particular desired point within said sequence and/or to decide whether said contents of a video sequence are relevant to a user, said video sequence having been pre-processed to detect scene changes and to build Rframes, an Rframe being a representation of a sequence of images, and for allowing a user to scroll in a given order through said Rframes and to stop at a selected Rframe for processing, said method comprising: (a) playing said video sequence from the beginning of a shot represented by said selected Rframe to the end of said shot; (b) detecting all Rframes having respective degrees of similarity to said Rframe selected by said user; and (c) presenting Rframes having one of a predetermined degree of similarity to said Rframe selected by said user and predetermined degree of dissimilarity to said Rframe selected by said user.
Claim 9
Dependent Claim
165 words
A computer-implemented method for representing contents of a video sequence for allowing a user to rapidly view a video sequence in order to find a particular desired point within said sequence and/or to decide whether said contents of a video sequence are relevant to a user, said video sequence having been pre-processed to detect scene changes and to build Rframes, an Rframe being a representation of a sequence of images, and for allowing a user to scroll in a given order through said Rframes and to stop at a selected Rframe for processing, said method comprising: (a) playing said video sequence from the beginning of a shot represented by said selected Rframe to the end of said shot; (b) detecting all Rframes having respective degrees of similarity to said Rframe selected by said user; and (c) presenting Rframes having one of a predetermined degree of similarity to said Rframe selected by said user and predetermined degree of dissimilarity to said Rframe selected by said user.
Claim 10
Dependent Claim
83 words
A method for representing contents of a video sequence in accordance with claim 7, comprising the steps of: comparing remaining, non-selected Rframes in said video sequence using moment and color histogram-based descriptions; mapping similarity measures using: ##EQU13## where ζ=ε(α, β i ) for mapping of color histogram intersection output of the equation Ω.sub.histogram [ε(α,β.sub.i)] ε {1,2,3} and ζ=(α,β i ) for mapping moment distance measure of the equation Ω.sub.moment [(α,β.sub.i)] ε {1,2,3}, where Ω=3signifies very similar, Ω=2 somewhat similar, and Ω=1 not similar.
Claim 11
Dependent Claim
72 words
A method for representing contents of a video sequence in accordance with claim 8, wherein if Ωmoment=1 then the output of said comparing using said color-histogram-based description is ignored; if Ωmoment=3 then a final output is very similar, an only exception being when color-based output Whistogram=1 in which case said final output will also be 2, or somewhat similar; and utilizing mapping from using said color-histogram-based description when Wmoment is not conclusive.
References Cited (Backward Citations)
US4943866A
Cited
US4949193A
Cited
US4685003A
Cited
US4979050A
Cited
US4755956A
Cited
US4876597A
Cited
US5065345A
Cited
US5109482A
Cited
US5179449A
Cited
US4970663A
Cited
US5136395A
Cited
US5267351A
Cited
US5101364A
Cited
US5083860A
Cited
US5283864A
Cited
US5307456A
Cited
US5317732A
Cited
US5177513A
Cited
US5388197A
Cited
US5355450A
Cited
US5404316A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1999-05-28 | 1999-11-27 | 2000-05-28 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2003-05-28 | 2003-11-27 | 2004-05-28 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2007-05-28 | 2007-11-27 | 2008-05-28 | $7700.00 | Window Closed / Lapsed |