Patent US7382895B2 successfully refreshed from Google Patents.
US7382895B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Tailgating and reverse entry detection, alarm, recording and prevention using machine vision
Assignee: Newton Security Inc
•
Filing: 2003-04-08
•
Granted: 2008-06-03
•
Expires: 2023-04-08
Abstract
Abstract Unauthorized entry into controlled access areas using tailgating or reverse entry methods is detected using machine vision methods. Camera images of the controlled area are processed to identify and track objects in the controlled area. In a preferred embodiment, this processing includes 3D surface analysis to distinguish and classify objects in the field of view. Feature extraction, color analysis, and pattern recognition may also be used for identification and tracking of objects. Integration with security monitoring and control systems provides notification when a tailgating or reverse entry event has occurred. More reliable operation in practical circumstances is thus obtained, such as when multiple people are using an entrance or exit under variable light and shadow conditions. Electronic access control systems may further be combined with the machine vision methods of the invention to more effectively prevent tailgating or reverse entry.
Inventors
- 👤 John W. Bramblet
- 👤 Carl R. Witty
- 👤 Seth Michael LaForge
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-07 07:20
CPC Classifications
G; G07; G07C; G07C9/00; G06; G06V; G06V20/00; G06V20/50; G06V20/52; G07C9/10; G07C9/15
Claims Analysis
Total Claims: 56
Claim 1
Independent Claim
309 words
A method for detecting a violation of security of a controlled access area, comprising: (a) acquiring one or more stereoscopic images of an area of observation, wherein objects in the area of observation are characterized by (1) an object type and (2) an authorization status indicating whether the object is authorized with respect to the controlled access area; (b) analyzing the one or more images using a machine vision processing system to identify a first object in the area of observation and to classify the first object in a first object type among a plurality of object types that are pre-defined in the machine vision processing system, said first object having supplied an authorization with respect to the controlled access area, and further using the machine vision processing system to identify a second object in the area of observation and to classify the second object in a second object type among the plurality of pre-defined object types, wherein the authorization status of each of the objects is determined separately from classifying the object in an object type; and (c) applying one or more access control rules to the information obtained from the image analysis to determine whether the second object is attempting to breach the controlled access area by utilizing the authorization supplied by the first object in violation thereof, wherein the controlled access area is limited to objects that are classified in a defined object type and have a status that is authorized with respect to the controlled access area, and wherein the one or more access control rules determine whether the second object is attempting to breach the controlled access area by separately determining (1) whether the classification of the second object is in the defined object type and (2) whether the second object has a status that is authorized with respect to the controlled access area.
Claim 2
Independent Claim
309 words
A method for detecting a violation of security of a controlled access area, comprising: (a) acquiring one or more stereoscopic images of an area of observation, wherein objects in the area of observation are characterized by (1) an object type and (2) an authorization status indicating whether the object is authorized with respect to the controlled access area; (b) analyzing the one or more images using a machine vision processing system to identify a first object in the area of observation and to classify the first object in a first object type among a plurality of object types that are pre-defined in the machine vision processing system, said first object having supplied an authorization with respect to the controlled access area, and further using the machine vision processing system to identify a second object in the area of observation and to classify the second object in a second object type among the plurality of pre-defined object types, wherein the authorization status of each of the objects is determined separately from classifying the object in an object type; and (c) applying one or more access control rules to the information obtained from the image analysis to determine whether the second object is attempting to breach the controlled access area by utilizing the authorization supplied by the first object in violation thereof, wherein the controlled access area is limited to objects that are classified in a defined object type and have a status that is authorized with respect to the controlled access area, and wherein the one or more access control rules determine whether the second object is attempting to breach the controlled access area by separately determining (1) whether the classification of the second object is in the defined object type and (2) whether the second object has a status that is authorized with respect to the controlled access area.
Claim 3
Dependent Claim
44 words
The method of claim 1 , in which the one or more access control rules determine whether the second object is attempting to breach the controlled access area based on proximity of the second object to the first object in the area of observation.
Claim 4
Dependent Claim
58 words
The method of claim 2 , in which the authorization of the first object is to enter the controlled access area, and the one or more access control rules determine whether the second object is attempting to enter the controlled access area by maintaining proximity to the first object as the first object enters the controlled access area.
Claim 5
Dependent Claim
58 words
The method of claim 2 , in which the authorization of the first object is to exit the controlled access area, and the one or more access control rules determine whether the second object is attempting to enter the controlled access area by maintaining proximity to the first object as the first object exits the controlled access area.
Claim 6
Dependent Claim
33 words
The method of claim 1 , in which analyzing the one or more images further comprises using the machine vision processing system to identify motion of the first object and the second object.
Claim 7
Dependent Claim
40 words
The method of claim 5 , in which the one or more access control rules determine whether the second object is attempting to breach the controlled access area based on motion of the second object relative to the first object.
Claim 8
Dependent Claim
35 words
The method of claim 6 , in which the one or more access control rules determine whether the second object is following the motion of the first object with respect to the controlled access area.
Claim 9
Dependent Claim
32 words
The method of claim 1 , further comprising triggering an alarm when the one or more access control rules determine that the second object is attempting to breach the controlled access area.
Claim 10
Dependent Claim
48 words
The method of claim 1 , further comprising, in response to determining that the second object is attempting to breach the controlled access area, causing an access limiting device associated with the controlled access area to prevent the breach of the controlled access area by the second object.
Claim 11
Dependent Claim
42 words
The method of claim 9 , in which causing the access limiting device to prevent the breach of the controlled access area comprises causing the access limiting device to block passage by the second object with respect to the controlled access area.
Claim 12
Dependent Claim
28 words
The method of claim 9 , in which causing the access limiting device to prevent the breach of the controlled access area comprises locking the access limiting device.
Claim 13
Dependent Claim
54 words
The method of claim 9 , in which the access limiting device has a normal direction of operation and in which causing the access limiting device to prevent the breach of the controlled access area comprises reversing the direction of operation of the access limiting device to be opposite the normal direction of operation.
Claim 14
Dependent Claim
27 words
The method of claim 12 , in which the access limiting device is a revolving structure and the direction of rotation of the revolving structure is reversed.
Claim 15
Dependent Claim
31 words
The method of claim 1 , further comprising causing one or more access limiting devices to block passage of the second object and contain the second object within a defined area.
Claim 16
Dependent Claim
55 words
The method of claim 1 , further comprising receiving access control information from an access control system and applying the one or more access control rules to the access control information in combination with the information obtained from the image analysis to determine whether the second object is attempting to breach the controlled access area.
Claim 17
Dependent Claim
42 words
The method of claim 15 , further comprising triggering an alarm when the one or more access control rules applied to the access control information and image analysis information determine that the second object is attempting to breach the controlled access area.
Claim 18
Dependent Claim
48 words
The method of claim 15 , further comprising, in response to determining that the second object is attempting to breach the controlled access area, causing an access limiting device associated with the controlled access area to prevent the breach of the controlled access area by the second object.
Claim 19
Dependent Claim
42 words
The method of claim 17 , in which causing the access limiting device to prevent the breach of the controlled access area comprises causing the access limiting device to block passage by the second object with respect to the controlled access area.
Claim 20
Dependent Claim
28 words
The method of claim 17 , in which causing the access limiting device to prevent the breach of the controlled access area comprises locking the access limiting device.
Claim 21
Dependent Claim
54 words
The method of claim 17 , in which the access limiting device has a normal direction of operation and in which causing the access limiting device to prevent the breach of the controlled access area comprises reversing the direction of operation of the access limiting device to be opposite the normal direction of operation.
Claim 22
Dependent Claim
27 words
The method of claim 20 , in which the access limiting device is a revolving door and the direction of rotation of the revolving door is reversed.
Claim 23
Dependent Claim
34 words
The method of claim 1 , in which analyzing the one or more images using a machine vision processing system further comprises using a three-dimensional surface analysis to identify the first or second object.
Claim 24
Dependent Claim
34 words
The method of claim 1 , in which analyzing the one or more images using a machine vision processing system further comprises using a three-dimensional surface analysis to classify the first or second object.
Claim 25
Dependent Claim
28 words
The method of claim 1 , in which analyzing the one or more images further comprises determining the presence of a connection between the first and second objects.
Claim 26
Dependent Claim
14 words
The method of claim 1 , further comprising recording the one or more images.
Claim 27
Dependent Claim
15 words
The method of claim 1 , further comprising recording information obtained from the image analysis.
Claim 28
Dependent Claim
28 words
The method of claim 1 , further comprising recording information resulting from applying the one or more access control rules to the information obtained from the image analysis.
Claim 29
Dependent Claim
18 words
The method of claim 1 , further comprising defining a region of interest within the area of observation.
Claim 30
Dependent Claim
39 words
The method of claim 28 , further comprising defining a plurality of regions of interest and applying the one or more access control rules based on the region of interest in which the first or second objects are located.
Claim 31
Dependent Claim
25 words
The method of claim 28 , further comprising using an interactive user interface that displays the area of observation to define the region of interest.
Claim 32
Dependent Claim
20 words
The method of claim 1 , further comprising using an interactive user interface to configure properties of the image analysis.
Claim 33
Dependent Claim
22 words
The method of claim 1 , further comprising using an interactive user interface to configure properties of the machine vision processing system.
Claim 34
Dependent Claim
32 words
The method of claim 1 , further comprising using an interactive user interface to configure properties of an access control system that provides access control information to the machine vision processing system.
Claim 35
Independent Claim
257 words
An apparatus for detecting a security violation with respect to a controlled access area, comprising: (a) a stereoscopic imaging device for acquiring one or more stereoscopic images of an area of observation, wherein objects in the area of observation are characterized by (1) an object type and (2) an authorization status indicating whether the object is authorized with respect to the controlled access area; and (b) a machine vision processing system in communication with the stereoscopic imaging device to receive the one or more images, the machine vision processing system being further configured to analyze the one or more images to identify an object in the area of observation and to classify the object in an object type among a plurality of object types that are pre-defined in the machine vision processing system, and apply one or more access control rules to determine whether the object is attempting to breach the controlled access area in violation of security of the controlled access area, wherein the controlled access area is limited to objects that are classified in a defined object type and have a status that is authorized with respect to the controlled access area, and wherein the one or more access control rules applied by the machine vision processing system determine whether the object is attempting to breach the controlled access area by separately determining (1) whether the classification of the object is in the defined object type and (2) whether the second object has a status that is authorized with respect to the controlled access area.
Claim 36
Independent Claim
257 words
An apparatus for detecting a security violation with respect to a controlled access area, comprising: (a) a stereoscopic imaging device for acquiring one or more stereoscopic images of an area of observation, wherein objects in the area of observation are characterized by (1) an object type and (2) an authorization status indicating whether the object is authorized with respect to the controlled access area; and (b) a machine vision processing system in communication with the stereoscopic imaging device to receive the one or more images, the machine vision processing system being further configured to analyze the one or more images to identify an object in the area of observation and to classify the object in an object type among a plurality of object types that are pre-defined in the machine vision processing system, and apply one or more access control rules to determine whether the object is attempting to breach the controlled access area in violation of security of the controlled access area, wherein the controlled access area is limited to objects that are classified in a defined object type and have a status that is authorized with respect to the controlled access area, and wherein the one or more access control rules applied by the machine vision processing system determine whether the object is attempting to breach the controlled access area by separately determining (1) whether the classification of the object is in the defined object type and (2) whether the second object has a status that is authorized with respect to the controlled access area.
Claim 37
Dependent Claim
61 words
The apparatus of claim 34 , in which the object in the area of observation is a suspect object, the apparatus further comprising a position sensor disposed on a background object in the area of observation, the machine vision processing system being further configured to use information received from the position sensor to define the background object from the suspect object.
Claim 38
Dependent Claim
16 words
The apparatus of claim 35 , in which the position sensor is disposed on a door.
Claim 39
Dependent Claim
38 words
The apparatus of claim 35 , in which the machine vision processing system is further configured to perform a calibration procedure that correlates position sensor information to a position of the background object for determining a background image.
Claim 40
Dependent Claim
79 words
The apparatus of claim 34 , in which the controlled access area has a designated access point, the machine vision processing system being further configured to determine the direction of motion of the object with respect to the designated access point and apply the one or more access control rules to determine whether the object is attempting to breach the controlled access area by using the designated access point in violation of the security of the controlled access area.
Claim 41
Dependent Claim
55 words
The apparatus of claim 38 , in which the machine vision processing system is further configured to analyze the one or more images to determine the speed of motion of the object and apply the one or more access control rules to determine whether the speed of motion of the object indicates a thrown object.
Claim 42
Dependent Claim
55 words
The apparatus of claim 38 , in which the machine vision processing system is further configured to analyze the one or more images to determine the trajectory of motion of the object and apply the one or more access control rules to determine whether the trajectory of motion of the object indicates a thrown object.
Claim 43
Dependent Claim
43 words
The apparatus of claim 34 , further comprising an alarm that is triggered when the one or more access control rules determine that the object is attempting to breach the controlled access area in violation of the security of the controlled access area.
Claim 44
Dependent Claim
86 words
The apparatus of claim 34 , in which the object in the area of observation is a second object, the machine vision processing system being further configured to identify and classify a first object in the area of observation having supplied an authorization with respect to the controlled access area, and to apply the one or more access control rules to determine whether the second object is attempting to breach the controlled access area by utilizing the authorization supplied by the first object in violation thereof.
Claim 45
Dependent Claim
47 words
The apparatus of claim 42 , in which the one or more access control rules are configured to determine whether the second object is attempting to breach the controlled access area based on proximity of the second object to the first object in the area of observation.
Claim 46
Dependent Claim
61 words
The apparatus of claim 43 , in which the authorization of the first object is to enter the controlled access area, and the one or more access control rules are configured to determine whether the second object is attempting to enter the controlled access area by maintaining proximity to the first object as the first object enters the controlled access area.
Claim 47
Dependent Claim
61 words
The apparatus of claim 43 , in which the authorization of the first object is to exit the controlled access area, and the one or more access control rules are configured to determine whether the second object is attempting to enter the controlled access area by maintaining proximity to the first object as the first object exits the controlled access area.
Claim 48
Dependent Claim
38 words
The apparatus of claim 34 , further comprising an access control system associated with the controlled access area in which the access control system is configured to receive information from the object for accessing the controlled access area.
Claim 49
Dependent Claim
36 words
The apparatus of claim 46 , further comprising an access limiting device in communication with the access control system, in which the access control system is configured to control the operation of the access limiting device.
Claim 50
Dependent Claim
27 words
The apparatus of claim 34 , wherein the stereoscopic imaging device for acquiring the one or more stereographic images is placed directly overhead the area of observation.
Claim 51
Dependent Claim
19 words
The method of claim 1 , in which the controlled access area is limited to objects classified as vehicles.
Claim 52
Dependent Claim
19 words
The method of claim 1 , in which the controlled access area is limited to objects classified as packages.
Claim 53
Dependent Claim
19 words
The method of claim 1 , in which the controlled access area is limited to objects classified as persons.
Claim 54
Dependent Claim
36 words
The method of claim 1 , wherein if the second object is classified in an object type that is not allowed for the authorization supplied by the first object, the method further comprises actuating an alarm.
Claim 55
Dependent Claim
31 words
The method of claim 1 , wherein if the second object is classified in an object type that is not allowed for any authorization, the method further comprises actuating an alarm.
Claim 56
Dependent Claim
26 words
The method of claim 1 , wherein the second object type of the second object is different than the first object type of the first object.
References Cited (Backward Citations)
US3564132A
Cited
US3727034A
Cited
US4000400A
Cited
US4303851A
Cited
US4847485A
Cited
US4799243A
Cited
US6493878B1
Cited
US5201906A
Cited
JPH0567264A
Cited
US5519784A
Cited
US5581625A
Cited
EP0706062B1
Cited
WO1996038820A1
Cited
US6081619A
Cited
WO1998008208A2
Cited
US5866887A
Cited
EP0847030A2
Cited
US6720874B2
Cited
US20020070858A1
Cited
US20030002712A1
Cited
US20030107649A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2011-06-03 | 2011-12-03 | 2012-06-03 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2015-06-03 | 2015-12-03 | 2016-06-03 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2019-06-03 | 2019-12-03 | 2020-06-03 | $7700.00 | Window Closed / Lapsed |