US8170280B2 — Integrated systems and methods for video-based ob…

Claim 1

Independent Claim 168 words

A method for tracking object images in video files, comprising the steps of: receiving a video file, wherein the video file comprises a plurality of frames; extracting an image of an object from a particular frame in the video file; extracting a subsequent image of an object from a subsequent frame in the video file; calculating a similarity value between the extracted object image from the particular frame and the subsequent extracted object image from the subsequent frame; if the calculated similarity value exceeds a predetermined similarity threshold, collecting the extracted object images from the video file into an object group; extracting a plurality of object features from the extracted object images collected in the object group; generating an object model based on the plurality of extracted object features, where the object model is associated with an object identifier; and updating the object model with additional object features extracted from one or more additional object images collected in the object group but extracted from an additional video file.

Claim 2

Independent Claim 168 words

A method for tracking object images in video files, comprising the steps of: receiving a video file, wherein the video file comprises a plurality of frames; extracting an image of an object from a particular frame in the video file; extracting a subsequent image of an object from a subsequent frame in the video file; calculating a similarity value between the extracted object image from the particular frame and the subsequent extracted object image from the subsequent frame; if the calculated similarity value exceeds a predetermined similarity threshold, collecting the extracted object images from the video file into an object group; extracting a plurality of object features from the extracted object images collected in the object group; generating an object model based on the plurality of extracted object features, where the object model is associated with an object identifier; and updating the object model with additional object features extracted from one or more additional object images collected in the object group but extracted from an additional video file.

Claim 3

Dependent Claim 70 words

The method of claim 1 , further comprising the steps of: identifying one or more optimal object images from the images collected in the object group, where the plurality of object features are extracted from the one or more optimal object images identified from the images collected in the object group and where the plurality of object features comprise image data associated with the one or more optimal object images.

Claim 4

Dependent Claim 26 words

The method of claim 2 , wherein the plurality of object features in the object model are weighted based on the relative importance of each feature.

Claim 5

Dependent Claim 22 words

The method of claim 2 , wherein the one or more optimal object images are identified based on properties of the image.

Claim 6

Dependent Claim 21 words

The method of claim 4 , wherein the image properties comprise one or more of resolution, occlusion, brightness, scale, and pose.

Claim 7

Dependent Claim 35 words

The method of claim 2 , wherein the one or more optimal object images are identified by calculating a similarity score between the images in the object group and learned examples of optimal object images.

Claim 8

Dependent Claim 97 words

The method of claim 1 , further comprising the steps of: identifying one or more optimal object images from the images in the object group; retrieving one or more predefined object models, wherein each object model is associated with an object identifier; calculating an average similarity value between the one or more identified optimal object images and each of the one or more predefined object models; and if at least one of the calculated average similarity values exceeds a predetermined average similarity threshold, labeling the object images in the object group according to the respective object identifier.

Claim 9

Dependent Claim 35 words

The method of claim 7 , further comprising the step of if none of the calculated average similarity values exceeds a predetermined average similarity threshold, labeling the object images in the object group as unknown.

Claim 10

Dependent Claim 18 words

The method of claim 7 , wherein the average similarity value is calculated based on a predefined algorithm.

Claim 11

Dependent Claim 33 words

The method of claim 7 , wherein the average similarity value is calculated by comparing object features of the optimal object images to object features of the one or more predefined object models.

Claim 12

Dependent Claim 17 words

The method of claim 1 , wherein the similarity value, is calculated based on a predefined algorithm.

Claim 13

Dependent Claim 48 words

The method of claim 1 , wherein the similarity value is calculated by comparing object features, spatial features, and contextual features of the extracted object image from the particular frame to object features, spatial features, and contextual features of the subsequent extracted object image from the subsequent frame.

Claim 14

Dependent Claim 18 words

The method of claim 12 , wherein the spatial features comprise data associated with physical distances in images.

Claim 15

Dependent Claim 22 words

The method of claim 12 , wherein the contextual features comprise data associated with elements surrounding an object image in a frame.

Claim 16

Dependent Claim 15 words

The method of claim 1 , wherein the object group is stored in a database.

Claim 17

Dependent Claim 21 words

The method of claim 1 , wherein the object group comprises a plurality of object, images similar to the extracted images.

Claim 18

Dependent Claim 14 words

The method of claim 1 , wherein the object images comprise images of faces.

Claim 19

Independent Claim 177 words

A method of tracking a specific object through a plurality of frames of a video wherein each frame of the video includes a plurality of objects, comprising the steps of: dividing the video into one or more scenes; identifying, an image of the specific object in a first frame of one of the one or more scenes; assigning the image of the specific object from the first frame of the respective scene to an object group; analyzing a subsequent frame of the respective scene to identify a potential additional image of the specific object; calculating a similarity value between the image of the specific object from the first frame and the potential additional image of the specific object from the subsequent frame; if the calculated similarity value exceeds a predetermined similarity threshold, assigning the potential additional image to the object group; and repeating the steps of analyzing and calculating for additional subsequent frames of the respective scene whereby the object group has assigned thereto all images of the specific object in the analyzed frames of the video.

Claim 20

Independent Claim 177 words

A method of tracking a specific object through a plurality of frames of a video wherein each frame of the video includes a plurality of objects, comprising the steps of: dividing the video into one or more scenes; identifying, an image of the specific object in a first frame of one of the one or more scenes; assigning the image of the specific object from the first frame of the respective scene to an object group; analyzing a subsequent frame of the respective scene to identify a potential additional image of the specific object; calculating a similarity value between the image of the specific object from the first frame and the potential additional image of the specific object from the subsequent frame; if the calculated similarity value exceeds a predetermined similarity threshold, assigning the potential additional image to the object group; and repeating the steps of analyzing and calculating for additional subsequent frames of the respective scene whereby the object group has assigned thereto all images of the specific object in the analyzed frames of the video.

Claim 21

Dependent Claim 30 words

The method of claim 18 , further comprising the step of selecting the specific object, from the plurality of objects in the, first frame of the one or more scenes.

Claim 22

Dependent Claim 37 words

The method of claim 18 , wherein the step of assigning the image of the specific object to the object group includes associating in a database the image with the frame from which the image was identified.

Claim 23

Dependent Claim 18 words

The method of claim 18 , wherein the subsequent frame is a frame immediately following the first frame.

Claim 24

Dependent Claim 22 words

The method of claim 18 , wherein there is at least one interposing frame between the first frame and the subsequent frame.

Claim 25

Dependent Claim 42 words

The method of claim 18 , wherein the step of calculating a similarity value comprises comparing object features of the image of the specific object from the first frame and the potential additional image of the specific object from the subsequent frame.

Claim 26

Independent Claim 138 words

A method for generating an object model from one or more images in a video, comprising the steps of: receiving a video file, wherein the video file comprises a plurality of video frames; detecting an object image from one of the plurality of video frames; if the detected object image is an optimal object image, extracting a plurality of object features from the optimal object image; determining whether an object model already exists for the object represented by the optimal object image; if an object model does not exist for the object, generating an object model comprising the plurality of object features extracted from the optimal object image; and updating the object model with additional object features extracted from one or more additional optimal object images associated with the object extracted from one or more additional video files.

Claim 27

Independent Claim 138 words

A method for generating an object model from one or more images in a video, comprising the steps of: receiving a video file, wherein the video file comprises a plurality of video frames; detecting an object image from one of the plurality of video frames; if the detected object image is an optimal object image, extracting a plurality of object features from the optimal object image; determining whether an object model already exists for the object represented by the optimal object image; if an object model does not exist for the object, generating an object model comprising the plurality of object features extracted from the optimal object image; and updating the object model with additional object features extracted from one or more additional optimal object images associated with the object extracted from one or more additional video files.

Claim 28

Dependent Claim 37 words

The method of claim 24 , further comprising the step of if an object model already exists for the object, adding the plurality of object features extracted from the optimal object image to the already-existing object model.

Claim 29

Dependent Claim 28 words

The method of claim 24 , farther comprising the step of determining that the detected object image is an optimal object image based on properties of the image.

Claim 30

Dependent Claim 21 words

The method of claim 26 , wherein the image properties comprise one or more of resolution, occlusion, brightness, scale, and pose.

Claim 31

Dependent Claim 39 words

The method of claim 24 , further comprising the step of determining that the detected object image is an optimal object image by calculating a similarity value between the detected object image and learned examples of optimal object images.

Claim 32

Independent Claim 182 words

A system for identifying object images from videos, comprising: a processor; a computer program product that includes a computer-readable medium that is usable by the processor, the medium having stored thereon a sequence of instructions that when executed by the processor causes the execution of the steps of: retrieving a video, wherein the video comprises a plurality of frames; extracting a plurality of object images from the plurality of frames; grouping similar object images together into a group based on a similarity score calculated between features in the plurality of object images; calculating an average similarity score for the plurality of object images in the group as compared to one or more stored object models, where each object model is associated with a respective object identifier; if the calculated average similarity score does not exceed a predetermined threshold, labeling the plurality of object images in the group as unknown; and if the calculated average similarity score exceeds the predefined threshold, identifying the plurality of object images in the group based on the respective object identifier of the most similar stored object model.

Claim 33

Independent Claim 182 words

A system for identifying object images from videos, comprising: a processor; a computer program product that includes a computer-readable medium that is usable by the processor, the medium having stored thereon a sequence of instructions that when executed by the processor causes the execution of the steps of: retrieving a video, wherein the video comprises a plurality of frames; extracting a plurality of object images from the plurality of frames; grouping similar object images together into a group based on a similarity score calculated between features in the plurality of object images; calculating an average similarity score for the plurality of object images in the group as compared to one or more stored object models, where each object model is associated with a respective object identifier; if the calculated average similarity score does not exceed a predetermined threshold, labeling the plurality of object images in the group as unknown; and if the calculated average similarity score exceeds the predefined threshold, identifying the plurality of object images in the group based on the respective object identifier of the most similar stored object model.

Claim 34

Dependent Claim 23 words

The system of claim 29 , further comprising a database for storing one or more videos and the one or more object models.

Claim 35

Dependent Claim 34 words

The system of claim 29 , wherein the average similarity score is calculated by comparing object features of the plurality of object images to object features of the one or more stored object models.

Annuity Stage	Window Opens	Payment Deadline	Surcharge Period Until	Estimated Fee	Status
3.5 Years (Year 4)	2015-05-01	2015-10-31	2016-05-01	$2000.00	Window Closed / Lapsed
7.5 Years (Year 8)	2019-05-01	2019-10-31	2020-05-01	$3760.00	Window Closed / Lapsed
11.5 Years (Year 12)	2023-05-01	2023-10-31	2024-05-01	$7700.00	Window Closed / Lapsed

Integrated systems and methods for video-based object modeling, recognition, and tracking

Abstract

Inventors

Bibliographic Details

Claims Analysis

References Cited (Backward Citations)

USPTO Annuity & Maintenance Windows

Assigned Categories & Tags

Assign Category Tag