US5969755A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Motion based event detection system and method
Assignee: Texas Instruments Inc
•
Filing: 1997-02-05
•
Granted: 1999-10-19
•
Expires: 2017-02-05
Abstract
Abstract A method to provide automatic content-based video indexing from object motion is described. Moving objects in video from a surveillance camera 11 detected in the video sequence using motion segmentation methods by motion segmentor 21. Objects are tracked through segmented data in an object tracker 22. A symbolic representation of the video is generated in the form of an annotated graphics describing the objects and their movement. A motion analyzer 23 analyzes results of object tracking and annotates the graph motion with indices describing several events. The graph is then indexed using a rule based classification scheme to identify events of interest such as appearance/disappearance, deposit/removal, entrance/exit, and motion/rest of objects. Clips of the video identified by spatio-temporal, event, and object-based queries are recalled to view the desired video.
Inventors
- 👤 Jonathan D. Courtney
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-31 20:15
CPC Classifications
H; H04; H04N; H04N7/00; H04N7/18; H04N7/188; G; G06; G06F; G06F16/00; G06F16/70; G06F16/78; G06F16/783; G06F16/7837; G06F16/7847; G06F16/786; G06V; G06V20/00; G06V20/50; G06V20/52; G06V40/00; G06V40/20; G06V40/23; H04N19/00; H04N19/10; H04N19/134; H04N19/142; H04N19/169; H04N19/179; H04N19/50; H04N19/503; H04N19/85; H04N19/87; G06V10/00; G06V10/40; G06V10/62; G11; G11B; G11B27/00; G11B27/10; G11B27/34; H04N19/20
Claims Analysis
Total Claims: 28
Claim 1
Independent Claim
83 words
A method of providing video indexing comprising the steps of: (a) detecting objects in video to provide detected objects comprising the step of performing motion segmentation including image differencing, thresholding, morphology and connected component analysis; (b) analyzing motion of said detected objects comprising the step of tracking said detected objects using linear prediction of object position; (c) generating a symbolic motion description of object motion; and (d) placing index marks in said symbolic motion description to identify occurrence of events in the video.
Claim 2
Independent Claim
83 words
A method of providing video indexing comprising the steps of: (a) detecting objects in video to provide detected objects comprising the step of performing motion segmentation including image differencing, thresholding, morphology and connected component analysis; (b) analyzing motion of said detected objects comprising the step of tracking said detected objects using linear prediction of object position; (c) generating a symbolic motion description of object motion; and (d) placing index marks in said symbolic motion description to identify occurrence of events in the video.
Claim 3
Dependent Claim
29 words
The method of claim 1 wherein said step of detecting objects includes performing motion segmentation comprising the steps of image differencing, thresholding, connected component analysis, image smoothing and morphology.
Claim 4
Dependent Claim
22 words
The method of claim 1 wherein said analyzing step includes associating objects in successive frames of said video using a mutual-nearest-neighbor criterion.
Claim 5
Dependent Claim
22 words
The method of claim 1 wherein said analyzing step includes determining paths of said objects and intersection with paths of other objects.
Claim 6
Dependent Claim
24 words
The method of claim 1 wherein said generating step includes generating a directed graph reflective of the paths and path intersections of said objects.
Claim 7
Dependent Claim
22 words
The method of claim 1 wherein said generating step includes generating a record of image statistics for objects in every video frame.
Claim 8
Dependent Claim
27 words
The method of claim 6 wherein said generating a record of image statistics step includes generating size, shape, position, and time-stamp of objects in every video frame.
Claim 9
Dependent Claim
23 words
The method of claim 1 wherein said generating step includes generating hierarchical graph node groupings reflective of paths and intersections of said objects.
Claim 10
Dependent Claim
28 words
The method of claim 8 wherein said placing index marks step includes placement of index marks corresponding to motion events in accordance with said hierarchical graph node groupings.
Claim 11
Dependent Claim
17 words
The method of claim 9 wherein said placing index marks step includes use of a rule-based classifier.
Claim 12
Dependent Claim
35 words
The method of claim 9 wherein said placing index marks step corresponding to motion events includes placement of one or more marks corresponding to appearance, disappearance, deposit, removal, entrance, exit, motion, or rest of objects.
Claim 13
Independent Claim
72 words
A method of providing video indexing comprising the steps of: (a) detecting objects in a video to provide detected objects; (b) analyzing motion of said detected objects; (c) generating a symbolic motion description of object motion; and (d) placing index marks in said symbolic motion description to identify occurrence of events in the video, said generating step includes generating primary and secondary graph links reflective of the likelihood of accurate motion analysis.
Claim 14
Independent Claim
72 words
A method of providing video indexing comprising the steps of: (a) detecting objects in a video to provide detected objects; (b) analyzing motion of said detected objects; (c) generating a symbolic motion description of object motion; and (d) placing index marks in said symbolic motion description to identify occurrence of events in the video, said generating step includes generating primary and secondary graph links reflective of the likelihood of accurate motion analysis.
Claim 15
Independent Claim
83 words
A method of providing video indexing comprising the steps of: (a) detecting objects in a video to provide detected objects; (b) analyzing motion of said detected objects; (c) generating a symbolic motion description of object motion; and (d) placing index marks in said symbolic motion description to identify occurrence of events in the video, said generating step includes generating hierarchial graph node groupings reflective of paths and intersections of said objects, said hierarchial graph node groupings reflect the likelihood of accurate motion analysis.
Claim 16
Independent Claim
83 words
A method of providing video indexing comprising the steps of: (a) detecting objects in a video to provide detected objects; (b) analyzing motion of said detected objects; (c) generating a symbolic motion description of object motion; and (d) placing index marks in said symbolic motion description to identify occurrence of events in the video, said generating step includes generating hierarchial graph node groupings reflective of paths and intersections of said objects, said hierarchial graph node groupings reflect the likelihood of accurate motion analysis.
Claim 17
Independent Claim
102 words
A method for real-time detection of video events comprising the steps of: (a) detecting object in real-time video to provide detected objects; said step of detecting including performing motion segmentation comprising the steps of image differencing, thresholding, connected components analysis and morphology; (b) analyzing motion of said detected objects including the step of tracking said detected objects using linear prediction of object positions; (c) generating a symbolic motion description of object motion; (d) placing index marks in said symbolic motion description to identify occurrence of events in video; and (e) providing a signal in response to the occurrence of said video events.
Claim 18
Independent Claim
102 words
A method for real-time detection of video events comprising the steps of: (a) detecting object in real-time video to provide detected objects; said step of detecting including performing motion segmentation comprising the steps of image differencing, thresholding, connected components analysis and morphology; (b) analyzing motion of said detected objects including the step of tracking said detected objects using linear prediction of object positions; (c) generating a symbolic motion description of object motion; (d) placing index marks in said symbolic motion description to identify occurrence of events in video; and (e) providing a signal in response to the occurrence of said video events.
Claim 19
Dependent Claim
19 words
The method of claim 14 wherein said step of providing a signal for the purpose of sounding an alarm.
Claim 20
Dependent Claim
16 words
The method of claim 14 wherein said step of providing a signal to make a record.
Claim 21
Dependent Claim
28 words
The method of claim 15 wherein said step of providing a signal comprises initiation of an automated action by signaling one of a computer program or electronic device.
Claim 22
Independent Claim
115 words
A method to assist human analysis of video data comprising the steps of: (a) detecting objects in a video to provide detected objects; said detecting step including performing motion segmentation comprising the steps of image differencing, thresholding, connected component analysis and morphology; (b) analyzing motion of said objects; said analyzing step including the step of tracking said detected objects using linear prediction of said object positions; (c) generating a symbolic motion description of object motion; (d) placing index marks in said symbolic motion description to identify occurrence of events in video; (e) receiving content-base queries; (f) matching queries with symbolic video information and said index marks; and (g) providing video sequences corresponding to the query.
Claim 23
Independent Claim
115 words
A method to assist human analysis of video data comprising the steps of: (a) detecting objects in a video to provide detected objects; said detecting step including performing motion segmentation comprising the steps of image differencing, thresholding, connected component analysis and morphology; (b) analyzing motion of said objects; said analyzing step including the step of tracking said detected objects using linear prediction of said object positions; (c) generating a symbolic motion description of object motion; (d) placing index marks in said symbolic motion description to identify occurrence of events in video; (e) receiving content-base queries; (f) matching queries with symbolic video information and said index marks; and (g) providing video sequences corresponding to the query.
Claim 24
Dependent Claim
33 words
The method of claim 18 wherein said step of receiving content-base queries includes receiving queries with constraints involving one or more of a video clip, time interval, object, spatial region, or motion event.
Claim 25
Dependent Claim
18 words
The method of claim 19 wherein constraints for said queries may be specified by manipulation of video clips.
Claim 26
Dependent Claim
38 words
The method of claim 19 wherein said step of matching queries with symbolic video information includes filtering symbolic information to meet the query constraints of one or more video clip, time interval, object, spatial region, or motion event.
Claim 27
Independent Claim
103 words
A method to assist human analysis of video data comprising the steps of: (a) detecting objects in a video to provide detected objects; (b) analyzing motion of said objects; (c) generating a symbolic motion description of object motion; (d) placing index marks in said symbolic motion description to identify occurrence of events in video; (e) receiving content-based queries; (f) matching queries with symbolic video information and said index marks; and (g) providing video sequences corresponding to the query, said step of providing video sequences includes a system clipboard with sets of video clips for progressive refinement of content based queries and query results.
Claim 28
Independent Claim
103 words
A method to assist human analysis of video data comprising the steps of: (a) detecting objects in a video to provide detected objects; (b) analyzing motion of said objects; (c) generating a symbolic motion description of object motion; (d) placing index marks in said symbolic motion description to identify occurrence of events in video; (e) receiving content-based queries; (f) matching queries with symbolic video information and said index marks; and (g) providing video sequences corresponding to the query, said step of providing video sequences includes a system clipboard with sets of video clips for progressive refinement of content based queries and query results.
References Cited (Backward Citations)
JPS63318039A
Cited
US5243418A
Cited
US5428774A
Cited
US5550965A
Cited
US5666157A
Cited
US5721692A
Cited
US5734737A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-10-18 | 2003-04-19 | 2003-10-19 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-10-18 | 2007-04-19 | 2007-10-19 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-10-18 | 2011-04-19 | 2011-10-19 | $7700.00 | Window Closed / Lapsed |