US6950123B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method for simultaneous visual tracking of multiple bodies in a closed structured environment
Assignee: Aurora Operations Inc
•
Filing: 2002-03-22
•
Granted: 2005-09-27
•
Expires: 2022-03-22
Abstract
Abstract Simultaneous tracking of multiple objects in a sequence of video frames captured by multiple cameras may be accomplished by extracting a foreground elements from a background in a frame, segmenting objects from the foreground surface, tracking objects within the frame, globally tracking positions of objects over time across multiple frames, fusing track data of objects obtained from multiple cameras to infer object positions, and resolving conflicts to estimate most likely object positions over time. Embodiments of the present invention improve substantially over existing trackers by including a technique for extraction of the region of interest that corresponds to a playing field, a technique for segmenting players from the field under varying illuminations, a template matching criteria that does not rely on specific shapes or color coherency of objects but on connected component properties, and techniques for reasoning about occlusions and consolidating tracking data from multiple cameras.
Inventors
- 👤 Fernando C. M. Martins
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:45
CPC Classifications
G; G01; G01S; G01S3/00; G01S3/78; G01S3/781; G01S3/782; G01S3/785; G01S3/786; G01S3/7864; G06; G06T; G06T7/00; G06T7/20; G06T7/292; G06V; G06V10/00; G06V10/20; G06V10/24; G06T2207/00; G06T2207/30; G06T2207/30221; G06T2207/30241
Claims Analysis
Total Claims: 29
Claim 1
Independent Claim
87 words
A method of simultaneous tracking of multiple objects in a sequence of video frames captured by multiple cameras comprising: extracting a foreground image from a background image in a frame; segmenting objects from the foreground image; tracking objects within the frame by identifying the largest connected components inside each objects region of interest; globally tracking positions of objects over time across multiple frames; fusing track data of objects obtained from multiple cameras to infer object positions; and resolving conflicts to estimate most likely object positions over time.
Claim 2
Independent Claim
87 words
A method of simultaneous tracking of multiple objects in a sequence of video frames captured by multiple cameras comprising: extracting a foreground image from a background image in a frame; segmenting objects from the foreground image; tracking objects within the frame by identifying the largest connected components inside each objects region of interest; globally tracking positions of objects over time across multiple frames; fusing track data of objects obtained from multiple cameras to infer object positions; and resolving conflicts to estimate most likely object positions over time.
Claim 3
Dependent Claim
34 words
The method of claim 1 , wherein segmenting the objects from the foreground image comprises segmenting the objects from the foreground image by examining motion of the objects in the sequence of video frames.
Claim 4
Dependent Claim
20 words
The method of claim 2 , wherein examining motion of the objects comprises using a two tier hierarchical median filter.
Claim 5
Dependent Claim
30 words
The method of claim 3 , wherein segmenting objects from the foreground image comprises segmenting objects from the foreground image under varying illuminations of the foreground image and the objects.
Claim 6
Dependent Claim
57 words
The method of claim 3 , wherein segmenting objects comprises computing a difference between a current frame and a field model to produce a difference image, applying a field template to clip a region of interest from the difference image to produce a clipped difference image, and enhancing the clipped difference image to produce an object image.
Claim 7
Dependent Claim
21 words
The method of claim 1 , wherein globally tracking positions of objects over time comprises using a sequential Monte Carlo technique.
Claim 8
Dependent Claim
20 words
The method of claim 1 , wherein fusing track data of objects comprises disambiguating disparities due to occlusion of objects.
Claim 9
Dependent Claim
28 words
The method of claim 1 , wherein the foreground image comprises a playing field for a sporting event and the objects comprise players participating in the sporting event.
Claim 10
Dependent Claim
29 words
The method of claim 1 , further comprising initializing object tracking processing by creating a foreground image template, calibrating the cameras, and identifying visible objects on a first frame.
Claim 11
Dependent Claim
110 words
An article comprising: a storage medium having a plurality of machine accessible instructions, wherein when the instructions are executed by a processor, the instructions provide for simultaneous tracking of multiple objects in a sequence of video frames captured by multiple cameras by extracting a foreground image from a background image in a frame; segmenting objects from the foreground image; tracking objects within the frame by identifying the largest connected components inside each object's region of interest; globally tracking positions of objects over time across multiple frames; fusing track data of objects obtained from multiple cameras to infer object positions; and resolving conflicts to estimate most likely object positions over time.
Claim 12
Dependent Claim
110 words
An article comprising: a storage medium having a plurality of machine accessible instructions, wherein when the instructions are executed by a processor, the instructions provide for simultaneous tracking of multiple objects in a sequence of video frames captured by multiple cameras by extracting a foreground image from a background image in a frame; segmenting objects from the foreground image; tracking objects within the frame by identifying the largest connected components inside each object's region of interest; globally tracking positions of objects over time across multiple frames; fusing track data of objects obtained from multiple cameras to infer object positions; and resolving conflicts to estimate most likely object positions over time.
Claim 13
Dependent Claim
38 words
The article of claim 10 , wherein instructions for segmenting the objects from the foreground image comprise instructions for segmenting the objects from the foreground image by examining motion of the objects in the sequence of video frames.
Claim 14
Dependent Claim
24 words
The article of claim 11 , wherein instructions for examining motion of the objects comprise instructions for implementing a two tier hierarchical median filter.
Claim 15
Dependent Claim
34 words
The article of claim 12 , wherein instructions for segmenting objects from the foreground image comprise instructions for segmenting objects from the foreground image under varying illuminations of the foreground image and the objects.
Claim 16
Dependent Claim
61 words
The article of claim 12 , wherein instructions for segmenting objects comprise instructions for computing a difference between a current frame and a field model to produce a difference image, applying a field template to clip a region of interest from the difference image to produce a clipped difference image, and enhancing the clipped difference image to produce an object image.
Claim 17
Dependent Claim
24 words
The article of claim 10 , wherein instructions for globally tracking positions of objects over time comprise instructions implementing a sequential Monte Carlo technique.
Claim 18
Dependent Claim
24 words
The article of claim 10 , wherein instructions for fusing track data of objects comprise instructions for disambiguating disparities due to occlusion of objects.
Claim 19
Dependent Claim
28 words
The article of claim 10 , wherein the foreground image comprises a playing field for a sporting event and the objects comprise players participating in the sporting event.
Claim 20
Dependent Claim
31 words
The article of claim 10 , further comprising instructions for initializing object tracking processing by creating a foreground image template, calibrating the cameras, and identifying visible objects on a first frame.
Claim 21
Independent Claim
155 words
A system for simultaneous tracking of multiple objects in a three dimensional physical scene by analysis of a sequence of video frames comprising: a plurality of video cameras to generate a plurality of sequences of video frames representing the scene over time; and a processing system having at least one processor to simultaneously track the multiple objects, the processing system comprising a field model generator component to extract a foreground image from a background image in a frame; a segmentation component to segment objects from the foreground image; a tracking component to track objects within the frame by identifying the largest connected components inside each object's region of interest and to globally track positions of objects over time across multiple frames; and a data fusion component to fuse track data of objects obtained from the plurality of video cameras to infer object positions, and to resolve conflicts to estimate most likely object positions over time.
Claim 22
Independent Claim
155 words
A system for simultaneous tracking of multiple objects in a three dimensional physical scene by analysis of a sequence of video frames comprising: a plurality of video cameras to generate a plurality of sequences of video frames representing the scene over time; and a processing system having at least one processor to simultaneously track the multiple objects, the processing system comprising a field model generator component to extract a foreground image from a background image in a frame; a segmentation component to segment objects from the foreground image; a tracking component to track objects within the frame by identifying the largest connected components inside each object's region of interest and to globally track positions of objects over time across multiple frames; and a data fusion component to fuse track data of objects obtained from the plurality of video cameras to infer object positions, and to resolve conflicts to estimate most likely object positions over time.
Claim 23
Dependent Claim
29 words
The system of claim 19 , wherein the segmentation component segments the objects from the foreground image by examining motion of the objects in the sequence of video frames.
Claim 24
Dependent Claim
22 words
The system of claim 20 , wherein the segmentation component examines motion of the objects using a two tier hierarchical median filter.
Claim 25
Dependent Claim
26 words
The system of claim 21 , wherein the segmentation component segments objects from the foreground image under varying illuminations of the foreground image and the objects.
Claim 26
Dependent Claim
57 words
The system of claim 21 , wherein the segmentation component computes a difference between a current frame and a field model to produce a difference image, applies a field template to clip a region of interest from the difference image to produce a clipped difference image, and enhances the clipped difference image to produce an object image.
Claim 27
Dependent Claim
23 words
The system of claim 19 , wherein the tracking component globally tracks positions of objects over time using a sequential Monte Carlo technique.
Claim 28
Dependent Claim
18 words
The system of claim 19 , wherein the data fusion component disambiguates disparities due to occlusion of objects.
Claim 29
Dependent Claim
33 words
The system of claim 19 , further comprising an initialization component to initialize object tracking processing by creating a foreground image template, calibrating the cameras, and identifying visible objects on a first frame.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2008-09-26 | 2009-03-28 | 2009-09-27 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2012-09-26 | 2013-03-28 | 2013-09-27 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2016-09-26 | 2017-03-28 | 2017-09-27 | $7700.00 | Window Closed / Lapsed |