US7529411B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Interactive system for recognition analysis of multiple streams of video
Assignee: Identiv Inc
•
Filing: 2005-03-15
•
Granted: 2009-05-05
•
Expires: 2025-03-15
Abstract
Abstract A method of identifying an object captured in a video image in a multi-camera video surveillance system is disclosed. Sets of identifying information are stored in profiles, each profile being associated with one object. The disclosed method of identifying an object includes comparing identifying information extracted from images captured by the video surveillance system to one or more stored profiles. A confidence score is calculated for each comparison and used to determine a best match between the extracted set of identifying information and an object. In one embodiment, the method is used as part of a facial recognition system incorporated into a video surveillance system.
Inventors
- 👤 Gordon T. Haupt
- 👤 J. Andrew Freeman
- 👤 Stephen D. Fleischer
- 👤 Robert P. Vallone
- 👤 Stephen G. Russell
- 👤 Timothy B. Frederick
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 09:48
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/172; G06V20/00; G06V20/40; G06V20/50; G06V20/52; G06V40/168; H; H04; H04N; H04N21/00; H04N21/40; H04N21/43; H04N21/44; H04N21/44008; H04N5/00; H04N5/76; H04N5/765; H04N5/77; H04N5/78; H04N5/781; H04N7/00; H04N7/18; H04N7/181
Claims Analysis
Total Claims: 56
Claim 1
Independent Claim
197 words
A method of determining a best match between a target profile and a set of stored profiles, wherein a profile contains a set of identifying information extracted from an image set associated with the profile, wherein the set of stored profiles corresponds to a plurality of different objects, the method comprising computer-implemented steps of: generating a plurality of confidence scores, wherein each confidence score of the plurality of confidence scores is based on a comparison between a feature set of the target profile and a feature set of a profile in the set of stored profiles, wherein each confidence score numerically represents the similarity between the feature set of the target profile and a feature set of a profile in the set of stored profiles; generating, from the plurality of confidence scores, a plurality of weighted confidence scores based on information external to the feature sets; and selecting, from the set of stored profiles, a particular profile as the best match for the target profile based on the plurality of weighted confidence scores; wherein the method is performed by one or more computing devices programmed to be a special purpose machine pursuant to instructions from program software.
Claim 2
Independent Claim
197 words
A method of determining a best match between a target profile and a set of stored profiles, wherein a profile contains a set of identifying information extracted from an image set associated with the profile, wherein the set of stored profiles corresponds to a plurality of different objects, the method comprising computer-implemented steps of: generating a plurality of confidence scores, wherein each confidence score of the plurality of confidence scores is based on a comparison between a feature set of the target profile and a feature set of a profile in the set of stored profiles, wherein each confidence score numerically represents the similarity between the feature set of the target profile and a feature set of a profile in the set of stored profiles; generating, from the plurality of confidence scores, a plurality of weighted confidence scores based on information external to the feature sets; and selecting, from the set of stored profiles, a particular profile as the best match for the target profile based on the plurality of weighted confidence scores; wherein the method is performed by one or more computing devices programmed to be a special purpose machine pursuant to instructions from program software.
Claim 3
Dependent Claim
25 words
The method of claim 1 wherein each stored profile has an age, and the information used to weight the confidence scores comprises profile age information.
Claim 4
Dependent Claim
38 words
The method of claim 2 wherein a first stored profile is older than a second stored profile, and wherein a weighting factor for said second stored profile is greater than a weighting factor for said first stored profile.
Claim 5
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 3 .
Claim 6
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 2 .
Claim 7
Dependent Claim
68 words
The method of claim 1 wherein the image set associated with the target profile is captured by a first camera at a first time, and wherein the information used to weight the confidence scores comprises information associated with whether a best matching profile has been determined for another profile associated with another image set captured by the first camera within a predetermined time frame of the first time.
Claim 8
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 6 .
Claim 9
Dependent Claim
67 words
The method of claim 1 wherein the image set associated with the target profile is captured by a first camera at a first time, and the information used to weight the confidence scores comprises information associated with whether a best matching profile has been determined for another profile associated with another image set captured by a second camera within a predetermined time frame of the first time.
Claim 10
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 8 .
Claim 11
Dependent Claim
33 words
The method of claim 1 wherein the information used to weight the confidence scores comprises a rate of confirmed correct identifications associated with at least one profile in the set of stored profiles.
Claim 12
Dependent Claim
51 words
The method of claim 10 wherein a first stored profile has a confirmed correct identification rate that is greater than a confirmed correct identification rate of a second stored profile, and wherein a weighting factor for said first stored profile is greater than a weighting factor for said second stored profile.
Claim 13
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 11 .
Claim 14
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 10 .
Claim 15
Dependent Claim
17 words
The method of claim 1 wherein an image set is acquired from a multi-camera video surveillance system.
Claim 16
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 14 .
Claim 17
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 1 .
Claim 18
Dependent Claim
28 words
The method of claim 1 , wherein the information external to the feature sets includes information about people that correspond to profiles in the set of stored profiles.
Claim 19
Dependent Claim
31 words
The method of claim 17 , wherein the information external to the feature sets includes information about categories assigned to people that correspond to profiles in the set of stored profiles.
Claim 20
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 18 .
Claim 21
Dependent Claim
30 words
The method of claim 17 , wherein the information external to the feature sets includes information about schedules of people that correspond to profiles in the set of stored profiles.
Claim 22
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 20 .
Claim 23
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 17 .
Claim 24
Independent Claim
258 words
A method of determining a best matching object for a target profile in an object recognition system in which each object recognized by the system is associated with one or more profiles in a set of stored profiles, wherein each profile in the set of stored profiles contains a set of identifying information extracted from an image set associated with the profile, the method comprising the computer-implemented steps of: generating a plurality of confidence scores, wherein each confidence score of the plurality of confidence scores is based on a comparison between the target profile and a different profile in the set of stored profiles; for each profile in the set of stored profiles, identifying an object associated with said each profile; generating a value for each object of a plurality of different objects wherein the method is performed by one or more computing devices programmed to be a special purpose machine pursuant to instructions from program software, wherein the value generated for each object is based on one or more confidence scores, of the plurality of confidence scores, associated with one or more profiles of said each object; wherein the step of generating a value for each object includes, for at least one of the plurality of different objects, generating a value for the object based on confidence scores associated with a plurality of profiles of the object; and selecting, from the plurality of different objects, a best matching object based, at least in part, on the values generated for each object of the plurality of different objects.
Claim 25
Independent Claim
258 words
A method of determining a best matching object for a target profile in an object recognition system in which each object recognized by the system is associated with one or more profiles in a set of stored profiles, wherein each profile in the set of stored profiles contains a set of identifying information extracted from an image set associated with the profile, the method comprising the computer-implemented steps of: generating a plurality of confidence scores, wherein each confidence score of the plurality of confidence scores is based on a comparison between the target profile and a different profile in the set of stored profiles; for each profile in the set of stored profiles, identifying an object associated with said each profile; generating a value for each object of a plurality of different objects wherein the method is performed by one or more computing devices programmed to be a special purpose machine pursuant to instructions from program software, wherein the value generated for each object is based on one or more confidence scores, of the plurality of confidence scores, associated with one or more profiles of said each object; wherein the step of generating a value for each object includes, for at least one of the plurality of different objects, generating a value for the object based on confidence scores associated with a plurality of profiles of the object; and selecting, from the plurality of different objects, a best matching object based, at least in part, on the values generated for each object of the plurality of different objects.
Claim 26
Dependent Claim
50 words
The method of claim 23 , wherein: the step of generating a value comprises determining, for each object, a number of occurrences of that object being associated with a confidence score, and the step of selecting a best matching object comprises selecting the object with a greatest number of occurrences.
Claim 27
Dependent Claim
37 words
The method of claim 24 , wherein the step of generating a value comprises determining, for each object, a number of occurrences of that object being associated with a confidence score that exceeds a predetermined minimum threshold.
Claim 28
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 25 .
Claim 29
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 24 .
Claim 30
Dependent Claim
46 words
The method of claim 23 , wherein: the step of generating a value comprises calculating, for each object, a weighted average of confidence scores associated with that object; and the step of selecting a best matching object comprises selecting the object with a greatest weighted average.
Claim 31
Dependent Claim
58 words
The method of claim 28 , wherein each stored profile has an age, the step of calculating a weighted average of confidence scores comprises: for each object, weighting each confidence score associated with the object in accordance with the age of the profile associated with the confidence score, and averaging all weighted confidence scores associated with that object.
Claim 32
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 29 .
Claim 33
Dependent Claim
52 words
The method of claim 28 , wherein the step of calculating a weighted average of confidence scores comprises: for each object, determining when the object was last identified by the object recognition system, and weighting the average confidence scores associated with that object in accordance with when the object was last identified.
Claim 34
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 31 .
Claim 35
Dependent Claim
35 words
The method of claim 28 , additionally comprising the step of: ranking the generated confidence scores; wherein the step of calculating a weighted average of confidence scores comprises using the rankings to weight confidence scores.
Claim 36
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 33 .
Claim 37
Dependent Claim
41 words
The method of claim 28 , additionally comprising the step of: receiving access information from an access control system; wherein the step of calculating a weighted average of confidence scores comprises using the received access information to weight the confidence scores.
Claim 38
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 35 .
Claim 39
Dependent Claim
23 words
The method of claim 28 , wherein an object comprises a person, and a set of identifying information comprises a facial feature set.
Claim 40
Dependent Claim
51 words
The method of claim 37 , additionally comprising the step of: for each person associated with a profile used to generate a confidence score, determining organizational information about the person, wherein the step of calculating a weighted average of confidence scores comprises using the organizational information to weight the confidence scores.
Claim 41
Dependent Claim
64 words
The method of claim 38 , wherein the target profile has a creation time, and the organizational information includes a work shift associated with the person, wherein the step of calculating a weighted average of confidence scores comprises determining whether the work shift of the person corresponds to the creation time of the target profile, and using said determination to weight the confidence scores.
Claim 42
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 39 .
Claim 43
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 37 .
Claim 44
Dependent Claim
64 words
The method of claim 38 , wherein the target profile has a location, and the organizational information includes at least one authorized location associated with the person, wherein the step of calculating a weighted average of confidence scores comprises determining whether any authorized location of the person corresponds to the location of the target profile, and using said determination to weight the confidence scores.
Claim 45
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 42 .
Claim 46
Dependent Claim
64 words
The method of claim 38 , wherein the target profile has a location, and the organizational information includes at least one organizational department associated with the person, wherein the step of calculating a weighted average of confidence scores comprises determining whether any organizational department of the person corresponds to the location of the target profile, and using said determination to weight the confidence scores.
Claim 47
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 44 .
Claim 48
Dependent Claim
61 words
The method of claim 38 , wherein the organizational information includes at least one organizational department associated with the person, wherein the step of calculating a weighted average of confidence scores comprises determining whether another person associated with at least one organization department associated with the person has been identified by the system in time and location proximity with the person.
Claim 49
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 46 .
Claim 50
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 38 .
Claim 51
Dependent Claim
64 words
The method of claim 28 , wherein each stored profile has a rate of correct identifications, wherein the step of calculating a weighted average of confidence scores comprises: for each object, weighting each confidence score associated with the object in accordance with the correct identification rate of the profile associated with the confidence score, and averaging all weighted confidence scores associated with that object.
Claim 52
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 49 .
Claim 53
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 28 .
Claim 54
Dependent Claim
108 words
The method of claim 23 , additionally comprising the steps of: determining if any of the plurality of confidence scores exceed a predetermined minimum threshold, and if no scores exceed the minimum threshold, then the method further comprising the steps of: providing a view of the image set associated with the target profile to a user to determine if the object in the image set matches an object recognized by the object recognition system, and if the user determines that the object in the image does not match a recognized object, enrolling the object as a new object and saving the target profile associated with the new object.
Claim 55
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 52 .
Claim 56
Dependent Claim
49 words
A computer-readable storage medium storing instructions, wherein the computer-readable storage medium includes at least one of volatile storage or non-volatile storage, wherein the instructions are instructions which, when executed by one or more processors, cause the one or more processors to perform the method recited in claim 23 .
References Cited (Backward Citations)
US5073950A
Cited
US5077805A
Cited
US5539454A
Cited
US5844991A
Cited
US5715325A
Cited
US5850470A
Cited
US6184926B1
Cited
US6097429A
Cited
US6188381B1
Cited
US6154133A
Cited
US6038333A
Cited
EP0947963A1
Cited
US6476858B1
Cited
US6646676B1
Cited
US20020030738A1
Cited
US7337127B1
Cited
US6542075B2
Cited
US7016532B2
Cited
WO2003047258A1
Cited
US20030123713A1
Cited
US20040161133A1
Cited
US6725383B2
Cited
US20040028391A1
Cited
US20040001615A1
Cited
US20040001142A1
Cited
US20040008258A1
Cited
US20040095236A1
Cited
US20040080615A1
Cited
US20040042643A1
Cited
US20040078260A1
Cited
US20040086093A1
Cited
US20040130620A1
Cited
US20040117638A1
Cited
US6791603B2
Cited
US20040183667A1
Cited
US7421097B2
Cited
US7310442B2
Cited
US20050232462A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2012-05-04 | 2012-11-03 | 2013-05-05 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2016-05-04 | 2016-11-03 | 2017-05-05 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2020-05-04 | 2020-11-03 | 2021-05-05 | $7700.00 | Window Closed / Lapsed |