Video retrieval of MPEG compressed sequences using DC and motion signatures

Claim 1

A method comprising the steps of: partitioning an at least one frame of a video clip into a plurality of window pairs, each of the plurality of window pairs including a first window and a second window, creating at least one signature corresponding to the at least one frame based on a plurality of differences between each first window and each second window of the plurality of window pairs; and storing the at least one signature in a database.

Claim 2

A method comprising the steps of: partitioning an at least one frame of a video clip into a plurality of window pairs, each of the plurality of window pairs including a first window and a second window, creating at least one signature corresponding to the at least one frame based on a plurality of differences between each first window and each second window of the plurality of window pairs; and storing the at least one signature in a database.

Claim 3

A method for identifying video clips similar to a query video clip, said method comprising: creating a signature of each of the video clips and the query video clip by partitioning an at least one frame of each of the video clips and the query video clip into a plurality of window pairs, each of the plurality of window pairs including a first window and a second window, and creating the signature corresponding to the at least one frame of each of the video clips and the query video clip based on a plurality of differences between each first window and each second window of the plurality of window pairs; determining a score of the similarity of the signature of each of the video clips to the signature of the query video clip; and ordering the video clips based on the score.

Claim 4

A method for identifying video clips similar to a query video clip, said method comprising: creating a signature of each of the video clips and the query video clip by partitioning an at least one frame of each of the video clips and the query video clip into a plurality of window pairs, each of the plurality of window pairs including a first window and a second window, and creating the signature corresponding to the at least one frame of each of the video clips and the query video clip based on a plurality of differences between each first window and each second window of the plurality of window pairs; determining a score of the similarity of the signature of each of the video clips to the signature of the query video clip; and ordering the video clips based on the score.

Claim 8

A method comprising the steps of: creating a signature of a query video clip by partitioning an at least one frame of the query video clip into a plurality of window pairs, each of the plurality of window pairs including a first window and a second window, and creating the signature corresponding to the at least one frame of the query video clip based on a plurality of differences between each first window and each second window of the plurality of window pairs; comparing the signature of the query video clip to signatures of a plurality of video clips in a database; and retrieving at least one of the plurality of video clips responsive to the comparison.

Claim 9

A method comprising the steps of: creating a signature of a query video clip by partitioning an at least one frame of the query video clip into a plurality of window pairs, each of the plurality of window pairs including a first window and a second window, and creating the signature corresponding to the at least one frame of the query video clip based on a plurality of differences between each first window and each second window of the plurality of window pairs; comparing the signature of the query video clip to signatures of a plurality of video clips in a database; and retrieving at least one of the plurality of video clips responsive to the comparison.

Claim 11

An apparatus comprising: a source that supplies a plurality of video clips; and an information retrieval system that: extracts signatures from the plurality of video clips and from a query video clip based on a difference between a first window and a second window of a plurality of window pairs of an at least one frame from each of the plurality of video clips and from the query video clip, identifies at least one of the plurality of video clips similar to the query video clip by comparing the signature of the query video clip to the signatures of the plurality of video clips, and retrieves from the video source the at least one of the plurality of video clips similar to the query video clip.

Claim 12

An apparatus comprising: a source that supplies a plurality of video clips; and an information retrieval system that: extracts signatures from the plurality of video clips and from a query video clip based on a difference between a first window and a second window of a plurality of window pairs of an at least one frame from each of the plurality of video clips and from the query video clip, identifies at least one of the plurality of video clips similar to the query video clip by comparing the signature of the query video clip to the signatures of the plurality of video clips, and retrieves from the video source the at least one of the plurality of video clips similar to the query video clip.

Claim 13

An apparatus comprising: an archival and signature extraction section that extracts a plurality of signatures from a plurality of video clips based on a difference between a first window and a second window of a plurality of window pairs of an at least one frame from each of the plurality of video clips; and a database that stores the signatures.

Claim 14

An apparatus comprising: an archival and signature extraction section that extracts a plurality of signatures from a plurality of video clips based on a difference between a first window and a second window of a plurality of window pairs of an at least one frame from each of the plurality of video clips; and a database that stores the signatures.

Claim 15

An apparatus comprising: a source that supplies video clips and video clip signatures that are based on a difference between a first window and a second window of a plurality of window pairs of an at least one frame of the video clips; and an information retrieval system that: extracts a query signature from a query video clip, compares the query signature to the video clip signatures, and retrieves from the video source a video clip responsive to the comparison.

Claim 16

An apparatus comprising: a source that supplies video clips and video clip signatures that are based on a difference between a first window and a second window of a plurality of window pairs of an at least one frame of the video clips; and an information retrieval system that: extracts a query signature from a query video clip, compares the query signature to the video clip signatures, and retrieves from the video source a video clip responsive to the comparison.

Claim 22

An apparatus for retrieving and displaying a plurality of video clips from video sources, said apparatus comprising: a source supplying the video clips; an information retrieval system comprising: an archival and signature extraction section for encoding each of the video clips and a query video clip into an MPEG format if the query video clip and the video clips are not in the MPEG format, and extracting signatures of query video clip and the video clips, wherein the signatures of the video clips are based on a difference between DC components of windows of a frame within the video clips, and the signature of the query video clip is based on a difference between DC components of windows of a frame within the query video clip, a database for storing the signatures of the video clip, and a retrieval subsystem identifying the video clips similar to the query video clip by comparing the signature of the query video clip to the signatures of the video clips; and a display for displaying the video clips similar to the query video clip.

Claim 23

An apparatus for retrieving and displaying a plurality of video clips from video sources, said apparatus comprising: a source supplying the video clips; an information retrieval system comprising: an archival and signature extraction section for encoding each of the video clips and a query video clip into an MPEG format if the query video clip and the video clips are not in the MPEG format, and extracting signatures of query video clip and the video clips, wherein the signatures of the video clips are based on a difference between DC components of windows of a frame within the video clips, and the signature of the query video clip is based on a difference between DC components of windows of a frame within the query video clip, a database for storing the signatures of the video clip, and a retrieval subsystem identifying the video clips similar to the query video clip by comparing the signature of the query video clip to the signatures of the video clips; and a display for displaying the video clips similar to the query video clip.

Claim 28

An apparatus comprising: a video source providing video clips, said video source comprising: an MPEG video server providing the video clips encoded using an MPEG encoding standard, a live video source providing the video clips, and a network source providing the video clips encoded using an encoding standard other than the MPEG encoding standard; a video information retrieval system, coupled to the video source, extracting signatures from the video clips and comparing a signature extracted from a query video clip to the signatures, said video information retrieval system comprising: an archival and signature extractor that: at least partially re-encodes, using the MPEG encoding standard, the video clips, if the video clips are not encoded using the MPEG encoding standard, and extracts the signatures from the video clips if the video clips are encoded or re-encoded using the MPEG encoding standard, wherein the signatures from the video clips are based on a difference between DC components of the MPEG encodings of windows of a frame within the video clips, and the signature from the query video clip is based on a difference between DC components of the MPEG encodings of windows of a frame within the query video clip, a database, coupled to the archival and signature extractor, that stores the signatures, along with identifying data of the respective video clips corresponding to the signatures, and a retrieval subsystem, coupled to the database, that compares the signature of a query video clip with the signatures stored in the database, and determines a similarity between the signature of the query video clip and each of the signatures stored in the database, said retrieval subsystem comprising: a similarity calculator for calculating the similarity; an ordering unit, coupled to the similarity calculator, for ordering the signatures based on the similarity, and a fetch and display unit, coupled to the ordering unit, for retrieving video clips corresponding to the signatures; and a user interface, coupled to the video retrieval subsystem, for displaying the video clips.

Claim 29

An apparatus comprising: a video source providing video clips, said video source comprising: an MPEG video server providing the video clips encoded using an MPEG encoding standard, a live video source providing the video clips, and a network source providing the video clips encoded using an encoding standard other than the MPEG encoding standard; a video information retrieval system, coupled to the video source, extracting signatures from the video clips and comparing a signature extracted from a query video clip to the signatures, said video information retrieval system comprising: an archival and signature extractor that: at least partially re-encodes, using the MPEG encoding standard, the video clips, if the video clips are not encoded using the MPEG encoding standard, and extracts the signatures from the video clips if the video clips are encoded or re-encoded using the MPEG encoding standard, wherein the signatures from the video clips are based on a difference between DC components of the MPEG encodings of windows of a frame within the video clips, and the signature from the query video clip is based on a difference between DC components of the MPEG encodings of windows of a frame within the query video clip, a database, coupled to the archival and signature extractor, that stores the signatures, along with identifying data of the respective video clips corresponding to the signatures, and a retrieval subsystem, coupled to the database, that compares the signature of a query video clip with the signatures stored in the database, and determines a similarity between the signature of the query video clip and each of the signatures stored in the database, said retrieval subsystem comprising: a similarity calculator for calculating the similarity; an ordering unit, coupled to the similarity calculator, for ordering the signatures based on the similarity, and a fetch and display unit, coupled to the ordering unit, for retrieving video clips corresponding to the signatures; and a user interface, coupled to the video retrieval subsystem, for displaying the video clips.