Patent US7804506B2 successfully refreshed from Google Patents.
US7804506B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
System and method for tracking an object in a video and linking information thereto
Assignee: Creatier Interactive LLC
•
Filing: 2004-02-25
•
Granted: 2010-09-28
•
Expires: 2024-02-25
Abstract
Abstract An image processing system for use in development and playback of interactive video. In a development mode of operation, pixel or video objects are selected in a frame by way of a development graphical user interface. The system automatically tracks the selected pixel objects in the preceding and succeeding video frames by determining range limits for various color variables of the selected pixel object to compensate for the effects in lighting changes and decompression effects. The system automatically locates pixel objects within the calculated range limits in the preceding and succeeding video frames and generates a pixel object file which identifies the coordinates of the selected pixel object in each frame. The pixel object file is linked to a data object file which links the selected pixel objects to data objects. The pixel object file and data object file, collectively “linked video files,” are created during a development mode of operation. During a playback mode of operation, the linked video files are imported to a video hosting platform which includes a video playback application and a common media player application programming interface (API) for playback of the video content. The video playback application supports processing of the linked video files to enable pixel objects to be selected by a pointing device and linked to data objects by way of a client side graphical user interface.
Inventors
- 👤 Daniel Louis Bates
- 👤 Jorge Geaga
- 👤 Glenn Christopher Arnold
- 👤 Thach Cam Le
- 👤 Ann Marie Kaesman
- 👤 Thomas Jaroszewicz
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 11:24
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/20; H04N21/23; H04N21/235; G; G06; G06F; G06F16/00; G06F16/70; G06F16/74; G06F16/748; G06T; G06T7/00; G06T7/20; G06T7/246; G06V; G06V10/00; G06V10/20; G06V10/24; H04N21/40; H04N21/43; H04N21/435; H04N21/47; H04N21/472; H04N21/4722; H04N21/4725; H04N21/80; H04N21/85; H04N21/854; H04N21/858; H04N21/8583
Claims Analysis
Total Claims: 26
Claim 1
Independent Claim
391 words
An image processing system for processing video content in a sequence of video frames and linking a pixel object embedded in said video content to data corresponding to the pixel object, the image processing system comprising: a video capture system for capturing a frame of said sequence of video frames; a user interface for enabling a user to select the pixel object in said captured frame, said video capture system determining a range of color values corresponding to the selected pixel object; a pixel object tracking system configured to track the selected pixel object through a plurality of the sequence of video frames based on the determined range of color values; a video linking system which generates a linked video file that is separate from and not embedded in said sequence of video frames, said linked video file comprising (i) a pixel object file identifying the selected pixel object by frame number and location within the captured video frame and at least one subsequent video frame, and (ii) a separate data object file that includes information related to the object that corresponds to the selected pixel object, the data object file being linked to the corresponding pixel object file, wherein said linked video file is configured to be exportable to a media player so that a location in said sequence of video frames selected by a pointing device during playback of the video frames can be linked with the data object when said selected location corresponds to the selected pixel object; wherein said video linking system samples said video content at a sample rate which is a divisor of plural standard playback rates; and wherein said video capture system determines the range of color values corresponding to the selected pixel object by: (i) determining a value of at least one of (ia) a hue, and (ib) a color variable, of at least one pixel of the selected pixel object, (ii) applying a predetermined value range to the determined value, (iii) analyzing pixels that (iiia) fall within a predetermined distance of said at least one pixel of the selected pixel object, and (iiib) fall within the applied value range, (iv) determining a further range of values based on the analyzed pixels, and (v) using the determined range of further values as said range of color values corresponding to the selected pixel object.
Claim 2
Dependent Claim
391 words
An image processing system for processing video content in a sequence of video frames and linking a pixel object embedded in said video content to data corresponding to the pixel object, the image processing system comprising: a video capture system for capturing a frame of said sequence of video frames; a user interface for enabling a user to select the pixel object in said captured frame, said video capture system determining a range of color values corresponding to the selected pixel object; a pixel object tracking system configured to track the selected pixel object through a plurality of the sequence of video frames based on the determined range of color values; a video linking system which generates a linked video file that is separate from and not embedded in said sequence of video frames, said linked video file comprising (i) a pixel object file identifying the selected pixel object by frame number and location within the captured video frame and at least one subsequent video frame, and (ii) a separate data object file that includes information related to the object that corresponds to the selected pixel object, the data object file being linked to the corresponding pixel object file, wherein said linked video file is configured to be exportable to a media player so that a location in said sequence of video frames selected by a pointing device during playback of the video frames can be linked with the data object when said selected location corresponds to the selected pixel object; wherein said video linking system samples said video content at a sample rate which is a divisor of plural standard playback rates; and wherein said video capture system determines the range of color values corresponding to the selected pixel object by: (i) determining a value of at least one of (ia) a hue, and (ib) a color variable, of at least one pixel of the selected pixel object, (ii) applying a predetermined value range to the determined value, (iii) analyzing pixels that (iiia) fall within a predetermined distance of said at least one pixel of the selected pixel object, and (iiib) fall within the applied value range, (iv) determining a further range of values based on the analyzed pixels, and (v) using the determined range of further values as said range of color values corresponding to the selected pixel object.
Claim 3
Dependent Claim
34 words
The system as recited in claim 1 , wherein said video linking system samples said video content at a sample rate of a divisor of 30 frames per second and 12 frames per second.
Claim 4
Dependent Claim
19 words
The system as recited in claim 2 , wherein said sample rate is at least 3 frames per second.
Claim 5
Dependent Claim
23 words
The system as recited in claim 1 , wherein said video linking system is configured to identify segment breaks in said video content.
Claim 6
Dependent Claim
60 words
The system as recited in claim 4 , wherein said segment breaks are determined by determining the median average pixel values for a series of frames and comparing changes in the pixel values relative to the median average and indicating a segment break when the change in pixel values represents at least a predetermined change relative to the median average.
Claim 7
Dependent Claim
77 words
The image processing system as recited in claim 1 , further including a video playback application for playing back video content and said linked video file, wherein said video playback application is configured to (i) determine if locations selected by a pointing device during playback of the video content correspond to said selected pixel object and (ii) provide a link to a corresponding data object when said selected location corresponds to one of said selected pixel object.
Claim 8
Dependent Claim
30 words
The system as recited in claim 1 , wherein said video linking system samples said video content at a sample rate of a divisor of NTSC and PAL frame rates.
Claim 9
Dependent Claim
31 words
The system as recited in claim 1 , wherein said video linking system samples said video content at a sample rate of a divisor of NTSC and 12 FPS frame rates.
Claim 10
Dependent Claim
34 words
The system as recited in claim 1 , wherein said video linking system samples said video content at a sample rate of a divisor of NTSC, PAL, 15 FPS, and 12 FPS frame rates.
Claim 11
Dependent Claim
30 words
The system as recited in claim 1 , wherein said video linking system samples said video content at a sample rate of a divisor of NTSC and movie frame rates.
Claim 12
Dependent Claim
23 words
The system as recited in claim 1 , wherein said video linking system clusters the sampled video content with plural frames per cluster.
Claim 13
Dependent Claim
60 words
The system as recited in claim 1 , further comprising a pixel object tracking system which includes a processor which automatically tracks the selected pixel object in other frames, said pixel object tracking system including a system for automatically determining changes in the characteristics of said pixel object based upon changes in lighting and automatically compensating based upon those changes.
Claim 14
Dependent Claim
338 words
An image processing system for processing video content in a sequence of video frames and linking a pixel object embedded in said video content to data corresponding to the pixel object, the image processing system comprising: a video capture system for capturing a sequence of video frames; a user interface for enabling a user to select a pixel object in at least one of the captured frames, said video capture system determining a range of color values corresponding to the selected pixel object; a pixel object tracking system configured to track the selected pixel object through a plurality of the sequence of video frames based on the determined range of color values; and a video linking system which generates a linked video file that is separate from and not embedded in said sequence of video frames, said linked video file comprising (i) a pixel object file which identifies, by frame number and location within the frame, the selected pixel object in the captured frame and at least one subsequent frame, and (ii) a separate data object file which includes data that corresponds to the selected pixel object, said linked video file being configured to be exportable to a media player, said video linking system sampling said video content at a sample rate which is a divisor of plural standard playback rates, wherein said video capture system determines the range of color values corresponding to the selected pixel object by: (i) determining a value of at least one of (ia) a hue, and (ib) a color variable, of at least one pixel of the selected pixel object, (ii) applying a predetermined value range to the determined value, (iii) analyzing pixels that (iiia) fall within a predetermined distance of said at least one pixel of the selected pixel object, and (iiib) fall within the applied value range, (iv) determining a further range of values based on the analyzed pixels, and (v) using the determined range of further values as said range of color values corresponding to the selected pixel object.
Claim 15
Dependent Claim
338 words
An image processing system for processing video content in a sequence of video frames and linking a pixel object embedded in said video content to data corresponding to the pixel object, the image processing system comprising: a video capture system for capturing a sequence of video frames; a user interface for enabling a user to select a pixel object in at least one of the captured frames, said video capture system determining a range of color values corresponding to the selected pixel object; a pixel object tracking system configured to track the selected pixel object through a plurality of the sequence of video frames based on the determined range of color values; and a video linking system which generates a linked video file that is separate from and not embedded in said sequence of video frames, said linked video file comprising (i) a pixel object file which identifies, by frame number and location within the frame, the selected pixel object in the captured frame and at least one subsequent frame, and (ii) a separate data object file which includes data that corresponds to the selected pixel object, said linked video file being configured to be exportable to a media player, said video linking system sampling said video content at a sample rate which is a divisor of plural standard playback rates, wherein said video capture system determines the range of color values corresponding to the selected pixel object by: (i) determining a value of at least one of (ia) a hue, and (ib) a color variable, of at least one pixel of the selected pixel object, (ii) applying a predetermined value range to the determined value, (iii) analyzing pixels that (iiia) fall within a predetermined distance of said at least one pixel of the selected pixel object, and (iiib) fall within the applied value range, (iv) determining a further range of values based on the analyzed pixels, and (v) using the determined range of further values as said range of color values corresponding to the selected pixel object.
Claim 16
Dependent Claim
34 words
The system as recited in claim 13 , wherein said video linking system samples said video content at a sample rate of a divisor of 30 frames per second and 12 frames per second.
Claim 17
Dependent Claim
19 words
The system as recited in claim 13 , wherein said sample rate is at least 3 frames per second.
Claim 18
Dependent Claim
80 words
The image processing system as recited in claim 13 , further including a video playback application for playing back video content and said linked video file, wherein said video playback application is configured to (i) determine if a location selected by a pointing device during playback of the video content corresponds to the selected pixel object and (ii) provide a link to a data object in the data object file when said selected location corresponds to the selected pixel object.
Claim 19
Dependent Claim
30 words
The system as recited in claim 13 , wherein said video linking system samples said video content at a sample rate of a divisor of NTSC and PAL frame rates.
Claim 20
Dependent Claim
31 words
The system as recited in claim 13 , wherein said video linking system samples said video content at a sample rate of a divisor of NTSC and 12 FPS frame rates.
Claim 21
Dependent Claim
34 words
The system as recited in claim 13 , wherein said video linking system samples said video content at a sample rate of a divisor of NTSC, PAL, 15 FPS, and 12 FPS frame rates.
Claim 22
Dependent Claim
30 words
The system as recited in claim 13 , wherein said video linking system samples said video content at a sample rate of a divisor of NTSC and movie frame rates.
Claim 23
Dependent Claim
23 words
The system as recited in claim 13 , wherein said video linking system clusters the sampled video content with plural frames per cluster.
Claim 24
Dependent Claim
61 words
The system as recited in claim 13 , further comprising a pixel object tracking system which includes a processor which automatically tracks said selected pixel object in other frames, said pixel object tracking system including a system for automatically determining changes in the characteristics of said selected pixel object based upon changes in lighting and automatically compensating based upon those changes.
Claim 25
Dependent Claim
357 words
An image processing system for processing video content in a sequence of video frames and linking a pixel object embedded in said video content to corresponding data, the image processing system comprising: a video capture system for capturing a sequence of video frames; a user interface for enabling a user to select a pixel object in at least one of the captured frames, said video capture system determining a range of color values corresponding to the selected pixel object; a pixel object tracking system configured to track the selected pixel object through a plurality of the sequence of video frames based on the determined range of color values; and a video linking system which generates a linked video file that is separate from and not embedded in said sequence of video frames, said linked video file comprising (i) a pixel object file which identifies, by frame number and location within the frame, the selected pixel object in the at least one captured frame and at least one subsequent frame, and (ii) a separate data object file, linked to the pixel object file, which includes data corresponding to the selected pixel object, said video linking system being configured to be exportable to a media player, said video linking system sampling said video content at a sample rate which is a divisor multiple of plural standard playback rates, said video linking system clustering the sampled video content with plural frames per cluster, wherein said video capture system determines the range of color values corresponding to the selected pixel object by: (i) determining a value of at least one of (ia) a hue, and (ib) a color variable, of at least one pixel of the selected pixel object, (ii) applying a predetermined value range to the determined value, (iii) analyzing pixels that (iiia) fall within a predetermined distance of said at least one pixel of the selected pixel object, and (iiib) fall within the applied value range, (iv) determining a further range of values based on the analyzed pixels, and (v) using the determined range of further values as said range of color values corresponding to the selected pixel object.
Claim 26
Dependent Claim
357 words
An image processing system for processing video content in a sequence of video frames and linking a pixel object embedded in said video content to corresponding data, the image processing system comprising: a video capture system for capturing a sequence of video frames; a user interface for enabling a user to select a pixel object in at least one of the captured frames, said video capture system determining a range of color values corresponding to the selected pixel object; a pixel object tracking system configured to track the selected pixel object through a plurality of the sequence of video frames based on the determined range of color values; and a video linking system which generates a linked video file that is separate from and not embedded in said sequence of video frames, said linked video file comprising (i) a pixel object file which identifies, by frame number and location within the frame, the selected pixel object in the at least one captured frame and at least one subsequent frame, and (ii) a separate data object file, linked to the pixel object file, which includes data corresponding to the selected pixel object, said video linking system being configured to be exportable to a media player, said video linking system sampling said video content at a sample rate which is a divisor multiple of plural standard playback rates, said video linking system clustering the sampled video content with plural frames per cluster, wherein said video capture system determines the range of color values corresponding to the selected pixel object by: (i) determining a value of at least one of (ia) a hue, and (ib) a color variable, of at least one pixel of the selected pixel object, (ii) applying a predetermined value range to the determined value, (iii) analyzing pixels that (iiia) fall within a predetermined distance of said at least one pixel of the selected pixel object, and (iiib) fall within the applied value range, (iv) determining a further range of values based on the analyzed pixels, and (v) using the determined range of further values as said range of color values corresponding to the selected pixel object.
References Cited (Backward Citations)
US20050182759A1
Cited
US6859799B1
Cited
US6253238B1
Cited
US6397181B1
Cited
US7003156B1
Cited
US6819797B1
Cited
US6990448B2
Cited
US20050086703A1
Cited
US7178107B2
Cited
US6424370B1
Cited
US20050022107A1
Cited
US6493707B1
Cited
US6549643B1
Cited
US6697796B2
Cited
US20030226150A1
Cited
US6744908B2
Cited
US6642940B1
Cited
US7054812B2
Cited
US20020069218A1
Cited
US6925474B2
Cited
US7032182B2
Cited
US20020087530A1
Cited
US7024020B2
Cited
WO2003041393A3
Cited
US20030122860A1
Cited
US20040215660A1
Cited
US20040233233A1
Cited
US20050044105A1
Cited
US20050044056A1
Cited
US20050128318A1
Cited
US20050223031A1
Cited
US20050223034A1
Cited
US20060271594A1
Cited
US20050271304A1
Cited
US20060082662A1
Cited
US3878557A
Cited
US5204749A
Cited
US4719584A
Cited
US4758714A
Cited
US5053607A
Cited
US4797920A
Cited
US4969189A
Cited
US4924303A
Cited
US5125022A
Cited
US5297194A
Cited
US5885086A
Cited
US5724091A
Cited
US6204843B1
Cited
US6252586B1
Cited
USH1506H
Cited
US5430809A
Cited
US5751286A
Cited
US6067401A
Cited
US5463728A
Cited
EP0615223A1
Cited
EP0624040A2
Cited
US5590261A
Cited
US5775995A
Cited
US5517605A
Cited
US5343529A
Cited
US5841978A
Cited
US5475756A
Cited
US5907597A
Cited
US5875303A
Cited
US6154879A
Cited
US6269348B1
Cited
US5767894A
Cited
US5677955A
Cited
US5729741A
Cited
US5752160A
Cited
US5907323A
Cited
US6205231B1
Cited
US5684715A
Cited
US5912980A
Cited
US5737553A
Cited
US6411725B1
Cited
US5745103A
Cited
US6008820A
Cited
US5874985A
Cited
US6005602A
Cited
US5781228A
Cited
US5659742A
Cited
US20020056136A1
Cited
US5708845A
Cited
US5793414A
Cited
US5819286A
Cited
US5822530A
Cited
US6016349A
Cited
US5794249A
Cited
US6536043B1
Cited
US6222937B1
Cited
US5867584A
Cited
US6006256A
Cited
US6240555B1
Cited
US6008816A
Cited
US6457018B1
Cited
US5929849A
Cited
US5778187A
Cited
US5872857A
Cited
US6018748A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2013-09-27 | 2014-03-29 | 2014-09-28 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2017-09-27 | 2018-03-29 | 2018-09-28 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2021-09-27 | 2022-03-29 | 2022-09-28 | $7700.00 | Window Closed / Lapsed |