← Back to Patent Explorer
US7327383B2 Expired / Lapsed US ⏱️ 0.0 years remaining

Correlating captured images and timed 3D event data

Assignee: Kodak Alaris LLC
•
Filing: 2003-11-04
•
Granted: 2008-02-05
•
Expires: 2023-11-04
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method for correlating tracking data associated with an activity occurring in a three-dimensional space with images captured within the space comprises the steps of: (a) locating a camera with respect to the three-dimensional space, wherein the camera at a given location has a determinable orientation and field of view that encompasses at least a portion of the space; (b) capturing a plurality of images with the camera and storing data corresponding to the images, including a capture time for each image; (c) capturing tracking data from identification tags attached to the people and/or objects within the space and storing the tracking data, including a tag capture time for each time that a tag is remotely accessed; (d) correlating each image and the tracking data by interrelating tracking data having a tag capture time in substantial correspondence with the capture time of each image, thereby generating track data corresponding to each image; (e) utilizing the track data to determine positions of the people and/or objects within the three dimensional space at the capture time of each image; and (f) utilizing the location and orientation of the camera to determine the portion of the space captured in each image and thereby reduce the track data to a track data subset corresponding to people and/or objects positioned within the portion of space captured in each image.

Inventors

  • 👤 Michael A. Valleriano
  • 👤 Christopher I. Marshall
  • 👤 Mark A. Bobb

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 18:55
CPC Classifications
H; H04; H04N; H04N1/00; H04N1/32; H04N1/32101; H04N2201/00; H04N2201/32; H04N2201/3201; H04N2201/3202; H04N2201/3212; H04N2201/3214; H04N2201/3215

Claims Analysis

Total Claims: 26
Claim 1
Independent Claim 256 words
A method for correlating tracking data, associated with an activity occurring in a three-dimensional space, with images captured within the space, wherein remotely-accessible identification tags attached to people and/or objects associated with the activity are linked to one or more databases that uniquely identify characteristics of the people and/or objects, said method comprising the steps of: (a) locating a camera with respect to the three-dimensional space, wherein the camera at a given location has a determinable orientation and field of view that encompasses at least a portion of the space; (b) capturing a plurality of images with the camera and storing data corresponding to the images, including a capture time for each image; (c) capturing tracking data from the identification tags attached to the people and/or objects within the space and storing the tracking data, including a tag capture time for each time that a tag is remotely accessed; (d) correlating each image and the tracking data by interrelating tracking data having a tag capture time in substantial correspondence with the capture time of each image, thereby generating track data corresponding to each image; (e) utilizing the track data to determine positions of the people and/or objects within the three dimensional space at the capture time of each image; and (f) utilizing the location and orientation of the camera to determine the portion of the space captured in each image and thereby reduce the track data to a track data subset corresponding to people and/or objects positioned within the portion of space captured in each image.
Claim 2
Independent Claim 256 words
A method for correlating tracking data, associated with an activity occurring in a three-dimensional space, with images captured within the space, wherein remotely-accessible identification tags attached to people and/or objects associated with the activity are linked to one or more databases that uniquely identify characteristics of the people and/or objects, said method comprising the steps of: (a) locating a camera with respect to the three-dimensional space, wherein the camera at a given location has a determinable orientation and field of view that encompasses at least a portion of the space; (b) capturing a plurality of images with the camera and storing data corresponding to the images, including a capture time for each image; (c) capturing tracking data from the identification tags attached to the people and/or objects within the space and storing the tracking data, including a tag capture time for each time that a tag is remotely accessed; (d) correlating each image and the tracking data by interrelating tracking data having a tag capture time in substantial correspondence with the capture time of each image, thereby generating track data corresponding to each image; (e) utilizing the track data to determine positions of the people and/or objects within the three dimensional space at the capture time of each image; and (f) utilizing the location and orientation of the camera to determine the portion of the space captured in each image and thereby reduce the track data to a track data subset corresponding to people and/or objects positioned within the portion of space captured in each image.
Claim 3
Dependent Claim 47 words
The method as claimed in claim 1 further comprising the steps of: (g) selecting an image from the plurality of images; and (h) utilizing the track data subset to identify characteristics of the people and/or objects positioned within the portion of space captured in the selected image.
Claim 4
Dependent Claim 60 words
The method as claimed in claim 1 further comprising the steps of: (g) selecting a participant and/or object ID associated with a particular identification tag attached to a particular person and/or object; and (h) utilizing the track data subset corresponding to people and/or objects within each image to identify one or more images in which the person and/or object appears.
Claim 5
Dependent Claim 59 words
The method as claimed in claim 1 wherein remotely-accessible identification tags are placed on the camera or on apparatus supporting the camera and the tracking data captured in step (c) includes tracking data from the tags on the camera or on apparatus supporting the camera and the location and orientation of the camera is determined from the tracking data.
Claim 6
Dependent Claim 35 words
The method as claimed in claim 1 wherein the camera has a field of view that is oriented along a predetermined line of sight, and wherein the orientation is determined from the line of sight.
Claim 7
Dependent Claim 74 words
The method as claimed in claim 1 wherein the three-dimensional space includes activities occurring in a plurality of physically-limited locations within the space and information regarding these physically-limited locations is included in the tracking data captured in step (c) and utilized in step (g) to further reduce the track data to a track data subset corresponding to people and/or objects positioned within a physically-limited location within the portion of space captured in each image.
Claim 8
Dependent Claim 59 words
The method as claimed in claim 6 wherein the activity is a game or like gathering that is played on a playing field in a sports facility, and the physically-limited location is at least one of a particular sports facility, a particular playing field as defined by its boundaries, or a particular defined area within a particular playing field.
Claim 9
Dependent Claim 46 words
The method as claimed in claim 1 wherein an optical limitation is utilized in step (g) to further reduce the track data to a track data subset corresponding to people and/or objects positioned within an optically-limited volume within the portion of space captured in each image.
Claim 10
Dependent Claim 52 words
The method as claimed in claim 8 wherein the optical limitation is a depth of field limitation of the camera, wherein the track data subset corresponds to people and/or objects positioned within both the portion of space captured in each image and the optically-limited volume defined by the depth of field limitation.
Claim 11
Dependent Claim 47 words
The method as claimed in claim 1 wherein one or more inclusions are utilized in step (g) to further reduce the track data to a track data subset corresponding to an included subset of people and/or objects positioned within the portion of space captured in each image.
Claim 12
Dependent Claim 53 words
The method as claimed in claim 9 wherein one or more inclusions are utilized in step (g) to include track data in the track data subset corresponding to certain included people and/or objects positioned within the portion of space captured in each image but that are nonetheless outside the depth of field limitation.
Claim 13
Dependent Claim 47 words
The method as claimed in claim 1 wherein one or more exclusions are utilized in step (g) to further reduce the track data to a track data subset that excludes certain people and/or objects that are nonetheless positioned within the portion of space captured in each image.
Claim 14
Dependent Claim 69 words
The method as claimed in claim 1 wherein the activity is a game or like kind of competitive gathering played out on a three-dimensional space comprising a bounded field and the tracking data includes identifiers for one or more participants appearing in an image and wherein step (g) further comprises correlating the images and the tracking data to identify one or more of the participants appearing in the images.
Claim 15
Dependent Claim 41 words
The method as claimed in claim 13 further comprising the step (h) of utilizing the track data subset to link to one or more databases containing biographical details of the participants positioned within the portion of space captured in each image.
Claim 16
Dependent Claim 14 words
The method as claimed in claim 1 wherein the camera is a digital camera.
Claim 17
Dependent Claim 14 words
The method as claimed in claim 1 wherein the camera is a film camera.
Claim 18
Independent Claim 282 words
A system for correlating tracking data, associated with an activity occurring in a three-dimensional space, with images captured within the space, wherein remotely-accessible identification tags attached to people and/or objects associated with the activity are linked to one or more databases that uniquely identify characteristics of the people and/or objects, said system comprising: an imaging system including one or more cameras located at given locations with respect to the three-dimensional space, wherein each camera has a determinable orientation and field of view that encompasses at least a portion of the space, thereby enabling the imaging system to capture a plurality of images of the portion of the space and store data corresponding to the images, including a capture time for each image; a tracking system for capturing tracking data from the identification tags attached to the people and/or objects within the space and storing the tracking data, including a tag capture time for each time that a tag is remotely accessed; and a correlation and data reduction stage for (1) correlating the selected image and the tracking data by interrelating tracking data having a tag capture time in substantial correspondence with the capture time of the selected image, thereby generating track data corresponding to the selected image; (2) utilizing the track data to determine positions of the people and/or objects within the three dimensional space at the capture time of the selected image; and (3) utilizing the location and orientation of the camera to determine the portion of the space captured in the selected image and thereby reduce the track data to a track data subset corresponding to people and/or objects positioned within the portion of space captured in the selected image.
Claim 19
Independent Claim 282 words
A system for correlating tracking data, associated with an activity occurring in a three-dimensional space, with images captured within the space, wherein remotely-accessible identification tags attached to people and/or objects associated with the activity are linked to one or more databases that uniquely identify characteristics of the people and/or objects, said system comprising: an imaging system including one or more cameras located at given locations with respect to the three-dimensional space, wherein each camera has a determinable orientation and field of view that encompasses at least a portion of the space, thereby enabling the imaging system to capture a plurality of images of the portion of the space and store data corresponding to the images, including a capture time for each image; a tracking system for capturing tracking data from the identification tags attached to the people and/or objects within the space and storing the tracking data, including a tag capture time for each time that a tag is remotely accessed; and a correlation and data reduction stage for (1) correlating the selected image and the tracking data by interrelating tracking data having a tag capture time in substantial correspondence with the capture time of the selected image, thereby generating track data corresponding to the selected image; (2) utilizing the track data to determine positions of the people and/or objects within the three dimensional space at the capture time of the selected image; and (3) utilizing the location and orientation of the camera to determine the portion of the space captured in the selected image and thereby reduce the track data to a track data subset corresponding to people and/or objects positioned within the portion of space captured in the selected image.
Claim 20
Dependent Claim 37 words
The system as claimed in claim 17 further comprising an output stage for utilizing the track data subset to identify characteristics of the people and/or objects positioned within the portion of space captured in the selected image.
Claim 21
Dependent Claim 52 words
The system as claimed in claim 17 wherein remotely-accessible identification tags are placed on the camera or on apparatus supporting the camera and the tracking system processes tracking data from the tags on the camera or on apparatus supporting the camera in order to determine the location and orientation of the camera.
Claim 22
Dependent Claim 18 words
The system as claimed in claim 17 wherein the remotely accessible identification tags are radio frequency identification tags.
Claim 23
Dependent Claim 72 words
The system as claimed in claim 17 wherein the activity is a game or like kind of competitive gathering played out on a three-dimensional space comprising a bounded field and the tracking data includes identifiers for one or more participants appearing in an image, and wherein the correlation and data reduction stage further correlates the images and the tracking data to identify one or more of the participants appearing in the images.
Claim 24
Dependent Claim 46 words
The system as claimed in claim 21 further comprising one or more databases containing biographical details of the participants, wherein data identifying one or more of the participants appearing in the images is used to link to the databases to retrieve biographical details concerning the participants.
Claim 25
Dependent Claim 14 words
The system as claimed in claim 17 wherein the camera is a digital camera.
Claim 26
Dependent Claim 14 words
The system as claimed in claim 17 wherein the camera is a film camera.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2011-02-04 2011-08-06 2012-02-05 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2015-02-04 2015-08-06 2016-02-05 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2019-02-04 2019-08-06 2020-02-05 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag