Patent US6567116B1 successfully refreshed from Google Patents.
US6567116B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Multiple object tracking system
Assignee: INTHEPLAY Inc
•
Filing: 1998-11-20
•
Granted: 2003-05-20
•
Expires: 2018-11-20
Abstract
Abstract A system 100 for tracking the movement of multiple objects within a predefined area using a combination of overhead X-Y filming cameras 25 and tracking cameras 24 with attached frequency selective filter 24 f . Also employed are perspective Z filming cameras 25 and tracking 24 cameras with filter 24 f . Objects to be tracked have been marked to include some form of frequency selective reflective material, such as an ink. Marked objects such as patches 7 r and 7 l , sticker 9 and tape 4 a have been specified and are attachable to said multiple objects. System 100 radiates selected energy 23 a throughout the predefined area of tracking that is specifically chosen to reflect off said reflective materials used to mark said objects. Reflected energy such as 7 m , 9 a and 4 b is then received by tracking cameras 24 while all other ambient light is blocked by filter 24 f . Local Computer System 60 continuously captures images from said tracking cameras 24 which include only the minimum information created by said reflected energy. System 60 efficiently locates said markings on said multiple objects and uses this location information to analyze synchronously captured unfiltered images from filming cameras 25 . Using said location information along with pre-knowledge concerning said multiple objects maximum rate of speed and maximum size as well as calculated information such as the vectors of direction, acceleration and velocity based upon previous movements, system 60 is able to efficiently find and extract the background the portion of the unfiltered images that represents said multiple objects.
Inventors
- 👤 James A. Aman
- 👤 William R. Haller
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 19:38
CPC Classifications
A; A63; A63B; A63B24/00; A63B24/0021; A63B71/00; A63B71/06; A63B71/0605; G; G01; G01S; G01S17/00; G01S17/66; G01S17/87; G06; G06T; G06T7/00; G06T7/20; G06T7/246; A63B2024/0025; A63B2102/00; A63B2102/24; A63B2208/00; A63B2208/12; A63B2220/00; A63B2220/10; A63B2220/13; A63B2220/30; A63B2220/40; A63B2220/80; A63B2220/806; G06V; G06V10/00; G06V10/20; G06V10/24; G06V10/245
Claims Analysis
Total Claims: 81
Claim 1
Independent Claim
115 words
An automated system for following the movement of one and more objects within a predefined area using an energy source that emits energy at least including a narrow band of tracking energy, the system comprising: one and more marks placed upon the one and more objects that reflect only the narrow band of tracking energy; one and more tracking detectors placed throughout the predefined area that receive the reflected narrow band of tracking energy; and a computer system responsive to the detectors that analyzes the narrow band of tracking energy received by the detectors and creates a database of movement information related to the one and more marks placed upon the one and more objects.
Claim 2
Dependent Claim
115 words
An automated system for following the movement of one and more objects within a predefined area using an energy source that emits energy at least including a narrow band of tracking energy, the system comprising: one and more marks placed upon the one and more objects that reflect only the narrow band of tracking energy; one and more tracking detectors placed throughout the predefined area that receive the reflected narrow band of tracking energy; and a computer system responsive to the detectors that analyzes the narrow band of tracking energy received by the detectors and creates a database of movement information related to the one and more marks placed upon the one and more objects.
Claim 3
Dependent Claim
15 words
The automated system of claim 1 wherein the narrow band of tracking energy is non-visible.
Claim 4
Dependent Claim
20 words
The automated system of claim 2 further comprising one and more lamps emitting the narrow band of non-visible tracking energy.
Claim 5
Dependent Claim
21 words
The automated system of claim 3 wherein the one and more lamps are physically separated from the one and more detectors.
Claim 6
Dependent Claim
21 words
The automated system of claim 1 wherein the narrow band of tracking energy is constantly radiated, reflected, and received without interruption.
Claim 7
Dependent Claim
23 words
The automated system of claim 1 wherein the one and more marks are embedded onto the surface of the one and more objects.
Claim 8
Dependent Claim
44 words
The automated system of claim 6 wherein the one and more marks are optionally embedded onto the surface of a material that is attached to the one and more objects in such a way that it remains flat to the surface of the object.
Claim 9
Dependent Claim
23 words
The automated system of claim 1 wherein one or more of the marks placed upon each object bears indicia uniquely identifying that object.
Claim 10
Dependent Claim
30 words
The automated system of claim 8 wherein the computer system determines the identity of each object based solely upon the information obtained from the one or more indicia bearing marks.
Claim 11
Dependent Claim
50 words
The automated system of claim 8 wherein the detectors are one and more first tracking cameras arranged in a grid formation overhead of the predefined area where the one and more objects move, the first tracking cameras being used to track the X-Y movement of the one and more objects.
Claim 12
Dependent Claim
46 words
The automated system of claim 10 wherein at least one of the one or more indicia bearing marks are placed upon a top surface of each of the one and more objects such that it is consistently in the view of the overhead first tracking cameras.
Claim 13
Dependent Claim
53 words
The automated system of claim 11 wherein the computer system determines the identity of each object based solely upon the information obtained from the at least one indicia bearing mark that was placed upon the top of each one and more object as viewed through the grid of overhead first tracking X-Y cameras.
Claim 14
Dependent Claim
50 words
The automated system of claim 1 wherein the detectors are one and more first tracking cameras arranged in a grid formation overhead of the predefined area where the one and more objects move, the first tracking cameras being used to track the X-Y movement of the one and more objects.
Claim 15
Dependent Claim
33 words
The automated system of claim 13 wherein additional detectors in the form of one and more second tracking cameras are placed at perspective views to the movement of the one and more objects.
Claim 16
Dependent Claim
41 words
The automated system of claim 14 wherein additional detectors in the form of one and more filming cameras are included in order to receive visible light images corresponding to the non-visible light images received by the first and second tracking cameras.
Claim 17
Dependent Claim
39 words
The automated system of claim 14 wherein the computer determines Z dimension information about the one and more marks placed upon each of the one and more objects based upon images from the one and more second tracking cameras.
Claim 18
Dependent Claim
27 words
The automated system of claim 14 wherein the one and more first and second tracking cameras are further fitted with a lens filter to block visible light.
Claim 19
Dependent Claim
36 words
The automated system of claim 15 wherein the computer system receives the visible light images from the filming cameras and stores these images cross-indexed with the tracking information obtained from the first an second tracking cameras.
Claim 20
Dependent Claim
72 words
The automated system of claim 18 wherein the location information determined by the computer system using the images of the first and second tracking cameras and pertaining to any and all marks is used to selectively process a portion of the images of the filming cameras by performing a comparison of these images to the pre-known background thereby identifying a foreground object without having to process all the pixels of the images.
Claim 21
Dependent Claim
15 words
The automated system of claim 1 wherein the location of each mark is tracked individually.
Claim 22
Dependent Claim
21 words
The automated system of claim 20 wherein the shape of the one and more marks provides information about the object's orientation.
Claim 23
Dependent Claim
22 words
The automated system of claim 21 wherein the spatial arrangement of the one and more marks provides information about the object's orientation.
Claim 24
Dependent Claim
69 words
The automated system of claim 22 wherein the information calculated by the computer system concerning the location of the one and more marks and therefore of the location of the one and more objects onto which the marks have been placed comprises the current location, direction of movement, velocity, acceleration, and orientation of the object associated with the time the images were captured from which the information was determined.
Claim 25
Dependent Claim
28 words
The automated system of claim 9 wherein the information calculated by the computer system is automatically stored in a database cross-linked to and retrievable by the identified object.
Claim 26
Dependent Claim
35 words
The automated system of claim 24 wherein the information calculated and automatically stored in the database by the computer system is further analyzed to create new comparison information that is also stored in the database.
Claim 27
Dependent Claim
41 words
The automated system of claim 25 further comprising a remote computer system and wherein the information calculated and automatically stored in the database by the computer system as well as the new comparison information is transmittable to the remote computer system.
Claim 28
Dependent Claim
30 words
The automated system of claim 26 wherein the remote computer system is capable of recreating a graphic representation of the movement of the tracked objects based upon the transmitted information.
Claim 29
Dependent Claim
123 words
An automated system for following the movement of one and more objects within a predefined area using an energy source that emits energy at least including a narrow band of non-visible tracking energy, the system comprising: one and more flat embedded marks placed upon the one and more objects that reflect only the narrow band of non-visible tracking energy; one and more first tracking detectors placed throughout the predefined area that receive the narrow band of non-visible tracking energy; and a computer system responsive to the first tracking detectors that analyzes the narrow band of non-visible tracking energy received by the detectors and creates a database of movement information related to the one and more marks placed upon the one and more objects.
Claim 30
Dependent Claim
123 words
An automated system for following the movement of one and more objects within a predefined area using an energy source that emits energy at least including a narrow band of non-visible tracking energy, the system comprising: one and more flat embedded marks placed upon the one and more objects that reflect only the narrow band of non-visible tracking energy; one and more first tracking detectors placed throughout the predefined area that receive the narrow band of non-visible tracking energy; and a computer system responsive to the first tracking detectors that analyzes the narrow band of non-visible tracking energy received by the detectors and creates a database of movement information related to the one and more marks placed upon the one and more objects.
Claim 31
Dependent Claim
21 words
The automated system of claim 28 wherein the narrow band of tracking energy is in either the ultraviolet or infrared spectrum.
Claim 32
Dependent Claim
20 words
The automated system of claim 28 further comprising one and more lamps emitting the narrow band of non-visible tracking energy.
Claim 33
Dependent Claim
22 words
The automated system of claim 30 wherein the one and more lamps are physically separated from the one or more tracking cameras.
Claim 34
Dependent Claim
21 words
The automated system of claim 28 wherein the narrow band of tracking energy is constantly radiated, reflected, and received without interruption.
Claim 35
Dependent Claim
44 words
The automated system of claim 28 wherein the one and more marks are optionally embedded onto the surface of a material that is attached to the one and more objects in such a way that it remains flat to the surface of the object.
Claim 36
Dependent Claim
23 words
The automated system of claim 28 wherein one or more of the marks placed upon each object bears indicia uniquely identifying that object.
Claim 37
Dependent Claim
30 words
The automated system of claim 34 wherein the computer system determines the identity of each object based solely upon the information obtained from the one or more indicia bearing marks.
Claim 38
Dependent Claim
50 words
The automated system of claim 34 wherein the detectors are one and more first tracking cameras arranged in a grid formation overhead of the predefined area where the one and more objects move, the first tracking cameras being used to track the X-Y movement of the one and more objects.
Claim 39
Dependent Claim
46 words
The automated system of claim 36 wherein at least one of the one or more indicia bearing marks are placed upon a top surface of each of the one and more objects such that it is consistently in the view of the overhead first tracking cameras.
Claim 40
Dependent Claim
53 words
The automated system of claim 37 wherein the computer system determines the identity of each object based solely upon the information obtained from the at least one indicia bearing mark that was placed upon the top of each one and more object as viewed through the grid of overhead first tracking X-Y cameras.
Claim 41
Dependent Claim
50 words
The automated system of claim 38 wherein the detectors are one and more first tracking cameras arranged in a grid formation overhead of the predefined area where the one and more objects move, the first tracking cameras being used to track the X-Y movement of the one and more objects.
Claim 42
Dependent Claim
33 words
The automated system of claim 39 wherein additional detectors in the form of one and more second tracking cameras are placed at perspective views to the movement of the one and more objects.
Claim 43
Dependent Claim
41 words
The automated system of claim 40 wherein additional detectors in the form of one and more filming cameras are included in order to receive visible light images corresponding to the non-visible light images received by the first and second tracking cameras.
Claim 44
Dependent Claim
39 words
The automated system of claim 40 wherein the computer determines Z dimension information about the one and more marks placed upon each of the one and more objects based upon images from the one and more second tracking cameras.
Claim 45
Dependent Claim
27 words
The automated system of claim 40 wherein the one and more first and second tracking cameras are further fitted with a lens filter to block visible light.
Claim 46
Dependent Claim
36 words
The automated system of claim 41 wherein the computer system receives the visible light images from the filming cameras and stores these images cross-indexed with the tracking information obtained from the first and second tracking cameras.
Claim 47
Dependent Claim
72 words
The automated system of claim 44 wherein the location information determined by the computer system using the images of the first and second tracking cameras and pertaining to any and all marks is used to selectively process a portion of the images of the filming cameras by performing a comparison of these images to the pre-known background thereby identifying a foreground object without having to process all the pixels of the images.
Claim 48
Dependent Claim
15 words
The automated system of claim 28 wherein the location of each mark is tracked individually.
Claim 49
Dependent Claim
21 words
The automated system of claim 46 wherein the shape of the one and more marks provides information about the object's orientation.
Claim 50
Dependent Claim
22 words
The automated system of claim 47 wherein the spatial arrangement of the one and more marks provides information about the object's orientation.
Claim 51
Dependent Claim
69 words
The automated system of claim 48 wherein the information calculated by the computer system concerning the location of the one and more marks and therefore of the location of the one and more objects onto which the marks have been placed comprises the current location, direction of movement, velocity, acceleration, and orientation of the object associated with the time the images were captured from which the information was determined.
Claim 52
Dependent Claim
28 words
The automated system of claim 28 wherein the information calculated by the computer system is automatically stored in a database cross-linked to and retrievable by the identified object.
Claim 53
Dependent Claim
35 words
The automated system of claim 50 wherein the information calculated and automatically stored in the database by the computer system is further analyzed to create new comparison information that is also stored in the database.
Claim 54
Dependent Claim
41 words
The automated system of claim 51 further comprising a remote computer system and wherein the information calculated and automatically stored in the database by the computer system as well as the new comparison information is transmittable to the remote computer system.
Claim 55
Dependent Claim
30 words
The automated system of claim 52 wherein the remote computer system is capable of recreating a graphic representation of the movement of the tracked objects based upon the transmitted information.
Claim 56
Dependent Claim
161 words
An automated system for following the movement of one and more objects within a predefined area using an energy source that emits energy at least including a narrow band of non-visible tracking energy, the system comprising: one and more flat embedded marks of one and more various shapes placed upon one and more objects that constantly reflect only the narrow band of non-visible tracking energy, wherein at least one of the marks placed on each object bears indicia uniquely identifying that object and is located upon a top surface of the object; one and more tracking cameras arranged in a grid formation overhead of the predefined area that constantly receive the narrow band of non-visible tracking energy; and a computer system responsive to the overhead tracking cameras that analyzes the narrow band of non-visible tracking energy received by the cameras and creates a database of movement information related to the one and more marks placed upon the one and more objects.
Claim 57
Dependent Claim
161 words
An automated system for following the movement of one and more objects within a predefined area using an energy source that emits energy at least including a narrow band of non-visible tracking energy, the system comprising: one and more flat embedded marks of one and more various shapes placed upon one and more objects that constantly reflect only the narrow band of non-visible tracking energy, wherein at least one of the marks placed on each object bears indicia uniquely identifying that object and is located upon a top surface of the object; one and more tracking cameras arranged in a grid formation overhead of the predefined area that constantly receive the narrow band of non-visible tracking energy; and a computer system responsive to the overhead tracking cameras that analyzes the narrow band of non-visible tracking energy received by the cameras and creates a database of movement information related to the one and more marks placed upon the one and more objects.
Claim 58
Dependent Claim
15 words
The automated system of claim 54 wherein ultraviolet is used as the non-visible tracking energy.
Claim 59
Dependent Claim
14 words
The automated system of claim 54 wherein infrared is used as the tracking energy.
Claim 60
Dependent Claim
44 words
The automated system of claim 54 wherein the one and more marks are optionally embedded onto the surface of a material that is attached to the one and more objects in such a way that it remains flat to the surface of the object.
Claim 61
Dependent Claim
28 words
The automated system of claim 54 wherein additional one and more perspective tracking cameras are placed at perspective views to the movement of the one and more objects.
Claim 62
Dependent Claim
34 words
The automated system of claim 58 wherein additional one and more filming cameras are included in order to receive visible light images corresponding to the images received by the first and second tracking cameras.
Claim 63
Dependent Claim
39 words
The automated system of claim 58 wherein the computer determines Z dimension information about the one and more marks placed upon each of the one and more objects based upon images from the one and more perspective tracking cameras.
Claim 64
Dependent Claim
36 words
The automated system of claim 60 wherein the computer system receives the visible light images from the filming cameras and stores these images cross-indexed with the tracking information obtained from the overhead and perspective tracking cameras.
Claim 65
Dependent Claim
91 words
The automated system of claim 61 wherein the database of movement information includes one or more of the current location, direction of movement, velocity, acceleration, and orientation associated with the time the images were captured and related individually to each of the one and more marks and collectively to each object onto which the marks were placed, the information being cross-linked to and retrievable by each object's identity as solely determined by the information obtained from the at least one indicia bearing mark placed upon a top surface of each object.
Claim 66
Independent Claim
169 words
A method for following the movement of one and more objects within a predefined area that contains visible energy for viewing the movement and non-visible energy for tracking the movement, comprising the steps of: placing one and more marks that only reflect the non-visible tracking energy upon the objects to be tracked before the objects enter the predefined area; placing one and more detectors capable of receiving the non-visible tracking energy throughout the predefined area before the objects enter the predefined area; receiving the reflected non-visible tracking energy off the one and more marks with one or more of the one and more tracking detectors placed throughout the predefined area; analyzing the received reflections of the non-visible tracking energy with a computer attached to the detectors to determine the movement and orientation information of each mark individually; and determining the movement and orientation of each individual object by associating the determined information relating to each individual mark with that of all other all marks attached to the same object.
Claim 67
Independent Claim
169 words
A method for following the movement of one and more objects within a predefined area that contains visible energy for viewing the movement and non-visible energy for tracking the movement, comprising the steps of: placing one and more marks that only reflect the non-visible tracking energy upon the objects to be tracked before the objects enter the predefined area; placing one and more detectors capable of receiving the non-visible tracking energy throughout the predefined area before the objects enter the predefined area; receiving the reflected non-visible tracking energy off the one and more marks with one or more of the one and more tracking detectors placed throughout the predefined area; analyzing the received reflections of the non-visible tracking energy with a computer attached to the detectors to determine the movement and orientation information of each mark individually; and determining the movement and orientation of each individual object by associating the determined information relating to each individual mark with that of all other all marks attached to the same object.
Claim 68
Dependent Claim
28 words
The method of claim 63 wherein the visible energy and non-visible energy are emitted from energy sources placed throughout the predefined tracking area prior to tracking the objects.
Claim 69
Dependent Claim
14 words
The method of claim 64 wherein the energy sources are one and more lamps.
Claim 70
Dependent Claim
40 words
The method of claim 63 further comprising the step of first placing a mark upon a material and then attaching one and more of the marked materials to the object to be tracked before the object enters the predefined area.
Claim 71
Dependent Claim
22 words
The method of claim 65 wherein the marks placed upon the objects and the materials are flat and embedded onto these surfaces.
Claim 72
Dependent Claim
39 words
The method of claim 63 further comprising the step of placing at least one mark bearing a unique indicia that only reflects the non-visible tracking energy upon each object to be tracked before the object enters the predefined area.
Claim 73
Dependent Claim
42 words
The method of claim 68 further comprising the step of receiving the reflected non-visible tracking energy off the at least one mark bearing a unique indicia with one or more of the one and more tracking detectors placed throughout the predefined area.
Claim 74
Dependent Claim
50 words
The method of claim 69 further comprising the step of analyzing the received reflections of the non-visible tracking energy off the at least one mark bearing the unique indicia with the computer attached to the detectors in order to determine the identity of each individual mark bearing a unique indicia.
Claim 75
Dependent Claim
52 words
The method of claim 70 further comprising the step of determining the identity of each individual object based solely upon the determined identity of each individual mark bearing a unique indicia attached to the object and relating the determined identity information to the determined movement and orientation information for the same object.
Claim 76
Dependent Claim
35 words
The method of claim 71 further comprising the step of developing statistics relating to individual and select groups of objects by comparing and analyzing the determined movement, orientation and identity information of all individual objects.
Claim 77
Dependent Claim
21 words
The method of claim 63 wherein the one and more detectors are tracking cameras capable of receiving the non-visible tracking energy.
Claim 78
Dependent Claim
63 words
The method of claim 13 wherein the step of placing the one and more detectors capable of receiving the non-visible energy throughout the predefined area further comprises the step of arranging a set of first tracking cameras in a grid formation overhead of the predefined area, the first tracking cameras being used to track the X-Y movement of the one and more objects.
Claim 79
Dependent Claim
68 words
The method of claim 74 wherein the step of placing the one and more detectors capable of receiving the non-visible energy throughout the predefined area further comprises the step of arranging a set of second tracking cameras that are placed at perspective views to the movement of the one and more objects, the second tracking cameras being used to track the Z movement of the and more objects.
Claim 80
Dependent Claim
33 words
The method of claim 75 further comprising the step of placing one and more filming cameras capable of receiving the visible energy throughout the predefined area before the objects enter the predefined area.
Claim 81
Dependent Claim
35 words
The method of claim 76 further comprising the step of receiving visible light images from the filming cameras and storing these images cross-indexed with the tracking information obtained from the first and second tracking cameras.
References Cited (Backward Citations)
US4189747A
Cited
US4664378A
Cited
US4545576A
Cited
US4539590A
Cited
US4675816A
Cited
US4673183A
Cited
US4764668A
Cited
GB2191361A
Cited
US4866414A
Cited
US4905315A
Cited
US4980871A
Cited
US5023709A
Cited
US5268734A
Cited
US5082263A
Cited
US5150895A
Cited
US5406501A
Cited
US5138322A
Cited
US5647015A
Cited
US5401026A
Cited
US5471383A
Cited
US5617335A
Cited
US5363297A
Cited
US5489886A
Cited
US5446701A
Cited
US5346210A
Cited
US5394824A
Cited
US5413345A
Cited
US5473369A
Cited
US5508736A
Cited
WO1995010915A1
Cited
US5504477A
Cited
US5602760A
Cited
US5485163A
Cited
US5731785A
Cited
FR2726370A1
Cited
US5936656A
Cited
US5768151A
Cited
WO1997002699A1
Cited
US5564698A
Cited
US5912700A
Cited
US6079862A
Cited
EP0813040A2
Cited
US5700204A
Cited
US5734343A
Cited
EP0959444A1
Cited
WO1998046029A1
Cited
US5926780A
Cited
US6061644A
Cited
WO1999044698A2
Cited
WO2000031560A2
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-05-19 | 2006-11-18 | 2007-05-20 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-05-19 | 2010-11-18 | 2011-05-20 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-05-19 | 2014-11-18 | 2015-05-20 | $7700.00 | Window Closed / Lapsed |