Patent US7203620B2 successfully refreshed from Google Patents.
← Back to Patent Explorer
US7203620B2 Expired / Lapsed US ⏱️ 0.0 years remaining

Summarization of video content

Assignee: Sharp Corp
•
Filing: 2002-05-23
•
Granted: 2007-04-10
•
Expires: 2022-05-23
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Summarization of video content including sports.

Inventors

  • 👤 Baoxin Li

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 10:36
CPC Classifications
A; A63; A63B; A63B24/00; A63B24/0003; G; G06; G06F; G06F16/00; G06F16/70; G06F16/73; G06F16/738; G06F16/739; G06F16/78; G06F16/783; G06F16/7834; G06F16/7847; G06F16/785; G06F16/786; G11; G11B; G11B27/00; G11B27/02; G11B27/031; G11B27/10; G11B27/102; G11B27/19; G11B27/28; A63B2220/00; A63B2220/80; A63B2220/806; A63B2220/807

Claims Analysis

Total Claims: 70
Claim 1
Independent Claim 73 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video based upon an event, wherein said event is determined automatically by a computer based upon a probabilistic inference technique, where each of said segments includes a plurality of frames of said video; and (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 2
Independent Claim 73 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video based upon an event, wherein said event is determined automatically by a computer based upon a probabilistic inference technique, where each of said segments includes a plurality of frames of said video; and (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 3
Dependent Claim 14 words
The method of claim 1 wherein said probabilistic inference technique includes a Bayesian Network.
Claim 4
Dependent Claim 15 words
The method of claim 1 wherein said probabilistic inference technique includes a Hidden Markov Model.
Claim 5
Dependent Claim 15 words
The method of claim 1 wherein said probabilistic inference technique is applied to pre-identified segments.
Claim 6
Dependent Claim 18 words
The method of claim 1 wherein said probabilistic inference technique is free from being applied to pre-identified segments.
Claim 7
Dependent Claim 15 words
The method of claim 1 wherein said probabilistic inference technique uses training sequences of segments.
Claim 8
Independent Claim 89 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video, where each of said segments is automatically identified by a computer includes a plurality of frames of said video, based upon a series of activities defined by the rules of said sports that could potentially result in at least one of: (i) a score; (ii) preventing a score; and (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 9
Independent Claim 89 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video, where each of said segments is automatically identified by a computer includes a plurality of frames of said video, based upon a series of activities defined by the rules of said sports that could potentially result in at least one of: (i) a score; (ii) preventing a score; and (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 10
Dependent Claim 27 words
The method of claim 7 wherein said summarization of said plurality of segments is in the same temporal order as said plurality of segments within said video.
Claim 11
Dependent Claim 18 words
The method of claim 7 wherein said activities are determined based upon the color characteristics of said video.
Claim 12
Dependent Claim 14 words
The method of claim 7 wherein said activities are determined based upon scene changes.
Claim 13
Independent Claim 77 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video based upon detecting a play of said sports, wherein said identifying includes a computer automatically detecting the start and end of said play, where each of said segments includes a plurality of frames of said video; and (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 14
Independent Claim 77 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video based upon detecting a play of said sports, wherein said identifying includes a computer automatically detecting the start and end of said play, where each of said segments includes a plurality of frames of said video; and (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 15
Dependent Claim 22 words
The method of claim 11 wherein said detecting the end of said play is based upon detecting said start of said play.
Claim 16
Dependent Claim 16 words
The method of claim 11 wherein said summarization identifies said plurality of segments of said video.
Claim 17
Dependent Claim 31 words
The method of claim 11 wherein said summarization is a summarized video comprising said plurality of segments excluding at least a portion of said video other than said plurality of segments.
Claim 18
Independent Claim 78 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video, wherein the start of said plurality of segments is identified automatically by a computer based upon a frame of said video having color characteristics, where each of said segments includes a plurality of frames of said video; and (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 19
Independent Claim 78 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video, wherein the start of said plurality of segments is identified automatically by a computer based upon a frame of said video having color characteristics, where each of said segments includes a plurality of frames of said video; and (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 20
Dependent Claim 18 words
The method of claim 15 wherein said color characteristics are based on spatial regions having sufficient color homogeneity.
Claim 21
Dependent Claim 20 words
The method of claim 15 further comprising said color characteristics are based upon different spatially displaced regions having different colors.
Claim 22
Independent Claim 92 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video, wherein the start of said plurality of segments is identified automatically by a computer based upon anticipated characteristics of said plurality of segments from an anticipated camera angle used to obtain said start of said plurality of segments, where each of said segments includes a plurality of frames of said video; and (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 23
Independent Claim 92 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video, wherein the start of said plurality of segments is identified automatically by a computer based upon anticipated characteristics of said plurality of segments from an anticipated camera angle used to obtain said start of said plurality of segments, where each of said segments includes a plurality of frames of said video; and (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 24
Dependent Claim 15 words
The method of claim 18 wherein said characteristics includes spatially displaced regions of predetermined characteristics.
Claim 25
Dependent Claim 12 words
The method of claim 18 wherein said characteristics includes predefined motion characteristics.
Claim 26
Dependent Claim 19 words
The method of claim 18 wherein the end of said plurality of segments is based upon a scene change.
Claim 27
Independent Claim 99 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer wherein the start of said plurality of segments is based upon a play of said sports, where each of said segments includes a plurality of frames of said video; (b) creating a first summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video; and (c) creating another summarization of said video from said plurality of segments, wherein said another summarization has a duration shorter than said first summarization.
Claim 28
Independent Claim 99 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer wherein the start of said plurality of segments is based upon a play of said sports, where each of said segments includes a plurality of frames of said video; (b) creating a first summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video; and (c) creating another summarization of said video from said plurality of segments, wherein said another summarization has a duration shorter than said first summarization.
Claim 29
Dependent Claim 15 words
The method of claim 22 wherein said another summarization is selected based upon audio information.
Claim 30
Dependent Claim 15 words
The method of claim 22 wherein said another summarization is selected based upon textual information.
Claim 31
Dependent Claim 31 words
The method of claim 22 further comprising creating a further summarization of said video from said plurality of segments, wherein said further summarization has a duration shorter than said another summarization.
Claim 32
Independent Claim 78 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video wherein the start of said plurality of segments is based upon a play of said sports, where each of said segments includes a plurality of frames of said video; (b) creating a summary of said video from said plurality of segments, wherein said summary has a duration based upon the bandwidth requirements of the transmitting said summary to a user.
Claim 33
Independent Claim 78 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video wherein the start of said plurality of segments is based upon a play of said sports, where each of said segments includes a plurality of frames of said video; (b) creating a summary of said video from said plurality of segments, wherein said summary has a duration based upon the bandwidth requirements of the transmitting said summary to a user.
Claim 34
Dependent Claim 14 words
The method of claim 26 including transmitting to said user through a wireless connection.
Claim 35
Dependent Claim 13 words
The method of claim 26 including transmitting to said user through the Internet.
Claim 36
Dependent Claim 17 words
The method of claim 26 wherein said summary is based upon a user profile of said user.
Claim 37
Independent Claim 85 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video wherein the start of said plurality of segments is based upon a play of said sports, where each of said segments includes a plurality of frames of said video; (b) creating a summary of said video from said plurality of segments, wherein said summary includes fewer frames than said sports video, wherein said plurality of segments were selected based upon a caption module of said sports video.
Claim 38
Independent Claim 85 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video wherein the start of said plurality of segments is based upon a play of said sports, where each of said segments includes a plurality of frames of said video; (b) creating a summary of said video from said plurality of segments, wherein said summary includes fewer frames than said sports video, wherein said plurality of segments were selected based upon a caption module of said sports video.
Claim 39
Dependent Claim 14 words
The method of claim 30 wherein said caption module detects captions within said video.
Claim 40
Dependent Claim 14 words
The method of claim 31 wherein said caption module recognizes information with said caption.
Claim 41
Independent Claim 114 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer wherein said identifying for at least one of said segments includes detecting the start of said segment based upon processing of a first single frame of said video, where each of said segments includes a plurality of frames of said video; (b) verifying that said first single frame is an appropriate start of said segment based upon processing of another single frame temporally relevant to said first single frame; and (c) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 42
Independent Claim 114 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer wherein said identifying for at least one of said segments includes detecting the start of said segment based upon processing of a first single frame of said video, where each of said segments includes a plurality of frames of said video; (b) verifying that said first single frame is an appropriate start of said segment based upon processing of another single frame temporally relevant to said first single frame; and (c) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 43
Independent Claim 82 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said sports video automatically by a computer, wherein said identifying for the end of at least one of said segments is based upon detecting a scene change, where each of said segments includes a plurality of frames of said sports video; and (b) creating a summarization of said sports video by including said plurality of segments, where said summarization includes fewer frames than said sports video.
Claim 44
Independent Claim 82 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said sports video automatically by a computer, wherein said identifying for the end of at least one of said segments is based upon detecting a scene change, where each of said segments includes a plurality of frames of said sports video; and (b) creating a summarization of said sports video by including said plurality of segments, where said summarization includes fewer frames than said sports video.
Claim 45
Dependent Claim 19 words
The method of claim 34 wherein said scene change is based upon a threshold between at least two frames.
Claim 46
Dependent Claim 19 words
The method of claim 34 wherein said scene change is based upon a gradual transition below a threshold level.
Claim 47
Independent Claim 93 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer, where each of said segments includes a plurality of frames of said video; (b) identifying a plurality of segments, automatically by a computer, that are temporally separated by a sufficiently short duration; (c) based upon said identifying as a result of (b) connecting said identified plurality of segments; and (d) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 48
Independent Claim 93 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer, where each of said segments includes a plurality of frames of said video; (b) identifying a plurality of segments, automatically by a computer, that are temporally separated by a sufficiently short duration; (c) based upon said identifying as a result of (b) connecting said identified plurality of segments; and (d) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 49
Dependent Claim 21 words
The method of claim 37 wherein said connecting includes discarding the frames of said video between said identified plurality of segments.
Claim 50
Dependent Claim 33 words
The method of claim 37 wherein said connecting results in a single segment that includes said identified plurality of segments together with the frames of said video between said identified plurality of segments.
Claim 51
Dependent Claim 93 words
method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer, where each of said segments includes a plurality of frames of said video; (b) identifying at least one of said segments, automatically by a computer, that has a temporally sufficiently short duration; (c) based upon said identifying as a result of (b) removing said identified segment from said summarization; and (d) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 52
Dependent Claim 93 words
method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer, where each of said segments includes a plurality of frames of said video; (b) identifying at least one of said segments, automatically by a computer, that has a temporally sufficiently short duration; (c) based upon said identifying as a result of (b) removing said identified segment from said summarization; and (d) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video.
Claim 53
Dependent Claim 21 words
The method of claim 40 wherein said connecting includes discarding the frames of said video between said identified plurality of segments.
Claim 54
Dependent Claim 33 words
The method of claim 40 wherein said connecting results in a single segment that includes said identified plurality of segments together with the frames of said video between said identified plurality of segments.
Claim 55
Independent Claim 100 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer wherein each of said segments includes a play of said sports, wherein said segments include full-speed plays and slow motion plays of said full-speed plays; and (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video, where a user may select from: (i)said summarization including only full-speed plays; (ii)said summarization including only slow motion plays; (iii) said summarization including both full-speed plays and slow motion plays.
Claim 56
Independent Claim 100 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer wherein each of said segments includes a play of said sports, wherein said segments include full-speed plays and slow motion plays of said full-speed plays; and (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video, where a user may select from: (i)said summarization including only full-speed plays; (ii)said summarization including only slow motion plays; (iii) said summarization including both full-speed plays and slow motion plays.
Claim 57
Independent Claim 84 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer wherein each of said segments includes a play of said sports; (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video; and (c) removing at least one of said segments from said summary based, at least in part, upon audio information related to said at least one of said segments.
Claim 58
Independent Claim 84 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer wherein each of said segments includes a play of said sports; (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video; and (c) removing at least one of said segments from said summary based, at least in part, upon audio information related to said at least one of said segments.
Claim 59
Dependent Claim 16 words
The method of claim 44 wherein said audio information is obtained exclusively from a temporal analysis.
Claim 60
Independent Claim 87 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer wherein each of said segments includes a play of said sports; (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video; and (c) modifying the duration of at least one of said segments from said summary based, at least in part, upon audio information related to said at least one of said segments.
Claim 61
Independent Claim 87 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video automatically by a computer wherein each of said segments includes a play of said sports; (b) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video; and (c) modifying the duration of at least one of said segments from said summary based, at least in part, upon audio information related to said at least one of said segments.
Claim 62
Dependent Claim 16 words
The method of claim 46 wherein said audio information is obtained exclusively from a temporal analysis.
Claim 63
Independent Claim 50 words
A method of processing a video comprising: (a) providing a description of said video; (b) identifying a plurality of segments of said video automatically by a computer based upon said description; (c) generating another video based upon said identified segments, wherein said another video has less frames than said video.
Claim 64
Independent Claim 50 words
A method of processing a video comprising: (a) providing a description of said video; (b) identifying a plurality of segments of said video automatically by a computer based upon said description; (c) generating another video based upon said identified segments, wherein said another video has less frames than said video.
Claim 65
Dependent Claim 20 words
The method of claim 48 wherein said video is transcoded in accordance with the channel capacity of a transmission medium.
Claim 66
Dependent Claim 20 words
The method of claim 48 wherein said video is transcoded in accordance with the storage capacity of a storage device.
Claim 67
Dependent Claim 13 words
The method of claim 48 wherein said description is compliant with MPEG-7 standard.
Claim 68
Dependent Claim 13 words
The method of claim 48 wherein said description is compliant with TV-Anytime standard.
Claim 69
Independent Claim 81 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video wherein each of said segments includes a play of said sports; (b) detecting a commercial within said video; and (c) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video, where said plurality of segments of said video sufficiently temporally close to said commercial are free from being included within said summarization.
Claim 70
Independent Claim 81 words
A method of processing a video including sports comprising: (a) identifying a plurality of segments of said video wherein each of said segments includes a play of said sports; (b) detecting a commercial within said video; and (c) creating a summarization of said video by including said plurality of segments, where said summarization includes fewer frames than said video, where said plurality of segments of said video sufficiently temporally close to said commercial are free from being included within said summarization.

References Cited (Backward Citations)

US4183056A Cited
US4321635A Cited
US4253108A Cited
US4298884A Cited
US4520404A Cited
US4937685A Cited
US4729044A Cited
US5027400A Cited
US5109482A Cited
US5101364A Cited
US5148154A Cited
US5861881A Cited
US6081750A Cited
US5867386A Cited
US5774357A Cited
US5903454A Cited
US5920477A Cited
US5875108A Cited
US6208805B1 Cited
US5610653A Cited
US6011895A Cited
US6038367A Cited
US6304715B1 Cited
US5724472A Cited
US6151444A Cited
US5717814A Cited
US6002833A Cited
US5684918A Cited
US5696869A Cited
US6091886A Cited
US5654769A Cited
US5452016A Cited
US5200825A Cited
USRE36801E Cited
USD354059S Cited
USD348251S Cited
US5559549A Cited
US6052554A Cited
US5659350A Cited
US5600364A Cited
US5600573A Cited
US6201536B1 Cited
US5734853A Cited
US5990927A Cited
US5682195A Cited
US5986690A Cited
US6160989A Cited
US5798785A Cited
US6181335B1 Cited
US5333091B1 Cited
US5333091B2 Cited
US5333091A Cited
US5987211A Cited
US5634849A Cited
US6269216B1 Cited
US5434678A Cited
US6067401A Cited
US6072934A Cited
US5913013A Cited
US5664046A Cited
US5589945A Cited
US5339393A Cited
US5424770A Cited
US6275268B1 Cited
US5923365A Cited
US6195497B1 Cited
US5521841A Cited
US6230501B1 Cited
US5635982A Cited
USD368263S Cited
USD381991S Cited
US5675752A Cited
US5664227A Cited
USD402310S Cited
US5797001A Cited
US5805733A Cited
US5821945A Cited
US5710884A Cited
US5761881A Cited
US5901246A Cited
US5900867A Cited
US5958006A Cited
US6556767B2 Cited
US5959681A Cited
US5969755A Cited
US5959697A Cited
US5920360A Cited
US5778108A Cited
US5933811A Cited
US5926624A Cited
US5892536A Cited
US5986692A Cited
US6141060A Cited
US5875107A Cited
US6161142A Cited
US6088455A Cited
JPH1132267A Cited
US6014183A Cited
US6219837B1 Cited
US6055018A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2010-04-09 2010-10-09 2011-04-10 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2014-04-09 2014-10-09 2015-04-10 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2018-04-09 2018-10-09 2019-04-10 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag