US6546117B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Video object segmentation using active contour modelling with global relaxation
Assignee: WASHINGTON, University of
•
Filing: 1999-06-10
•
Granted: 2003-04-08
•
Expires: 2019-06-10
Abstract
Abstract A system for image object tracking and segmentation, includes (i) a modified adaptive resonance theory-2 (M-ART2) model for detecting changes of scenes, (ii) a two-dimensional correlative autopredicitve search (2D CAPS) method for object tracking, (iii) a derivation of contour energy for use in modelling an object edge, and (iv) an active contour model with global relaxation for defining optimal image object boundaries. The modelled object boundary is derived from an edge potential energy calculation and a set of current edge points. For each edge point, several candidate data points are also selected. Rather than calculate an energy value for each potential contours, a solution is achieved by comparing energy differences along a travel path. The selected contour is built in steps. An optimal path is selected from the potential paths.
Inventors
- 👤 Shijun Sun
- 👤 Yongmin Kim
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 18:04
CPC Classifications
G; G06; G06T; G06T9/00; G06T9/001; G06T7/00; G06T7/20; G06T7/254; G06T9/20; G06V; G06V10/00; G06V10/20; G06V10/24; G06V10/26; G06V10/267; G06V10/28; G06V10/34; G06V10/40; G06V10/56; G06V10/70; G06V10/74; G06V10/75; G06V10/755; G06V10/62
Claims Analysis
Total Claims: 24
Claim 1
Independent Claim
272 words
A method for modelling a desired contour of an image object comprising: receiving a first set of data points corresponding to the image object and a contour of the image object; selecting a second set of N data points corresponding to an initial estimate of the contour; for each one data point among said second set of data points, selecting a corresponding plurality of M candidate data points from the first set of data points, the second set of data points and the corresponding plurality of candidate data points forming an array of (M+1) by N data points; selecting a starting set of M+1 data points, which includes a data point among the second set of data points and its corresponding plurality of M candidate data points; for each data point among the starting set of M+1 data points, selecting an optimal object contour path to derive M+1 optimal object contour paths which estimate the contour of the image object, in which each one optimal contour path is selected segment by segment, wherein a next segment is added to said each one optimal object contour path by selecting one data point among an adjacent set of M+1 data points, the adjacent set of M+1 data points including a data point from the second set of data points and its corresponding plurality of candidate data points, the selected one data point for said next segment being selected by calculating an energy difference relative to the initial estimate of the contour for each one data point among said adjacent set of M+1 data points; and selecting one of the M+1 optimal object contour paths.
Claim 2
Independent Claim
272 words
A method for modelling a desired contour of an image object comprising: receiving a first set of data points corresponding to the image object and a contour of the image object; selecting a second set of N data points corresponding to an initial estimate of the contour; for each one data point among said second set of data points, selecting a corresponding plurality of M candidate data points from the first set of data points, the second set of data points and the corresponding plurality of candidate data points forming an array of (M+1) by N data points; selecting a starting set of M+1 data points, which includes a data point among the second set of data points and its corresponding plurality of M candidate data points; for each data point among the starting set of M+1 data points, selecting an optimal object contour path to derive M+1 optimal object contour paths which estimate the contour of the image object, in which each one optimal contour path is selected segment by segment, wherein a next segment is added to said each one optimal object contour path by selecting one data point among an adjacent set of M+1 data points, the adjacent set of M+1 data points including a data point from the second set of data points and its corresponding plurality of candidate data points, the selected one data point for said next segment being selected by calculating an energy difference relative to the initial estimate of the contour for each one data point among said adjacent set of M+1 data points; and selecting one of the M+1 optimal object contour paths.
Claim 3
Dependent Claim
22 words
The method of claim 1 , further comprising the step of deriving edge potential energy for the first set of data points.
Claim 4
Dependent Claim
100 words
The method of claim 2 , in which the step of selecting a corresponding plurality of M candidate data points from the first set of data points, comprises, for each one data point among said second set of data points: grouping into M groups the data points in the vicinity of said one data point of the second set of data points, in which each one of the M groups includes a plurality of data points; and selecting as a candidate data point, the data point from each one of the M groups which has the optimal edge potential energy.
Claim 5
Dependent Claim
40 words
The method of claim 1 , in which the desired contour is tracked and modelled within a scene sequence of image frames, the method further comprising: determining for a current image frame whether there has been a change of scene.
Claim 6
Dependent Claim
50 words
The method of claim 4 , further comprising: where there has not been a change in scene, searching the current image frame for presence of the image object; and identifying said first set of data points corresponding to the image object where presence of the image object has been found.
Claim 7
Dependent Claim
65 words
The method of claim 1 , in which the desired contour is tracked and modelled within a scene sequence of image frames, the method further comprising prior to said step of receiving: searching the current image frame for presence of the image object; and where presence of the image object has been found, identifying said first set of data points corresponding to the image object.
Claim 8
Independent Claim
361 words
A method for tracking an image object within a sequence of frames and modelling a desired contour of the image object, the method comprising: determining for a current image frame whether there has been a change of scene; where there has not been a change in scene, searching the current image frame for presence of the image object; where presence of the image object has been found, identifying a first set of data points corresponding to the image object and a second set of N data points corresponding to an initial estimate of the desired contour of the image object, wherein said second set of data points define a current object contour, the first set of data points including at least the second set of data points; deriving edge potential energy for the first set of data points; for each one data point among said second set of data points, selecting a corresponding plurality of M candidate data points from the first set of data points, the second set of data points and the corresponding plurality of candidate data points forming an array of (M+1) by N data points; selecting a starting set of M+1 data points, which includes a data point among the second set of data points and its corresponding plurality of M candidate data points; for each data point among the starting set of M+1 data points, selecting an optimal object contour path to derive M+1 optimal object contour paths which estimate the contour of the image object, in which each one optimal contour path is selected segment by segment, wherein a next segment is added to said each one optimal object contour path by selecting one data point among an adjacent set of M+1 data points, the adjacent set of M+1 data points including a data point from the second set of data points and its corresponding plurality of candidate data points, the selected one data point for said next segment being selected by calculating an energy difference relative to the current object contour for each one data point among said adjacent set of M+1 data points; and selecting one of the M+1 optimal object contour paths.
Claim 9
Independent Claim
361 words
A method for tracking an image object within a sequence of frames and modelling a desired contour of the image object, the method comprising: determining for a current image frame whether there has been a change of scene; where there has not been a change in scene, searching the current image frame for presence of the image object; where presence of the image object has been found, identifying a first set of data points corresponding to the image object and a second set of N data points corresponding to an initial estimate of the desired contour of the image object, wherein said second set of data points define a current object contour, the first set of data points including at least the second set of data points; deriving edge potential energy for the first set of data points; for each one data point among said second set of data points, selecting a corresponding plurality of M candidate data points from the first set of data points, the second set of data points and the corresponding plurality of candidate data points forming an array of (M+1) by N data points; selecting a starting set of M+1 data points, which includes a data point among the second set of data points and its corresponding plurality of M candidate data points; for each data point among the starting set of M+1 data points, selecting an optimal object contour path to derive M+1 optimal object contour paths which estimate the contour of the image object, in which each one optimal contour path is selected segment by segment, wherein a next segment is added to said each one optimal object contour path by selecting one data point among an adjacent set of M+1 data points, the adjacent set of M+1 data points including a data point from the second set of data points and its corresponding plurality of candidate data points, the selected one data point for said next segment being selected by calculating an energy difference relative to the current object contour for each one data point among said adjacent set of M+1 data points; and selecting one of the M+1 optimal object contour paths.
Claim 10
Dependent Claim
100 words
The method of claim 7 , in which the step of selecting a corresponding plurality of M candidate data points from the first set of data points, comprises, for each one data point among said second set of data points: grouping into M groups, the data points in the vicinity of said one data point of the second set of data points, in which each one of the M groups includes a plurality of data points; and selecting as a candidate data point, the data point from each one of the M groups which has the optimal edge potential energy.
Claim 11
Independent Claim
281 words
An apparatus for modelling a desired contour of an image object, the apparatus receiving a first set of data points corresponding to the image object and the desired contour, the apparatus comprising: means for selecting a second set of N data points corresponding to an initial estimate of the contour; means for selecting, for each one data point among said second set of data points, a corresponding plurality of M candidate data points from the first set of data points, the second set of data points and the corresponding plurality of candidate data points forming an array of (M+1) by N data points; means for selecting a starting set of M+1 data points, which includes a data point among the second set of data points and its corresponding plurality of M candidate data points; means for selecting, for each data point among the starting set of M+1 data points, an optimal object contour path to derive M+1 optimal object contour paths which estimate the contour of the image object, in which each one optimal contour path is selected segment by segment, wherein a next segment is added to said each one optimal object contour path by selecting one data point among an adjacent set of M+1 data points, the adjacent set of M+1 data points including a data point from the second set of data points and its corresponding plurality of candidate data points, the selected one data point for said next segment being selected by calculating an energy difference relative to the current object contour for each one data point among said adjacent set of M+1 data points; and means for selecting one of the M+1 optimal object contour paths.
Claim 12
Independent Claim
281 words
An apparatus for modelling a desired contour of an image object, the apparatus receiving a first set of data points corresponding to the image object and the desired contour, the apparatus comprising: means for selecting a second set of N data points corresponding to an initial estimate of the contour; means for selecting, for each one data point among said second set of data points, a corresponding plurality of M candidate data points from the first set of data points, the second set of data points and the corresponding plurality of candidate data points forming an array of (M+1) by N data points; means for selecting a starting set of M+1 data points, which includes a data point among the second set of data points and its corresponding plurality of M candidate data points; means for selecting, for each data point among the starting set of M+1 data points, an optimal object contour path to derive M+1 optimal object contour paths which estimate the contour of the image object, in which each one optimal contour path is selected segment by segment, wherein a next segment is added to said each one optimal object contour path by selecting one data point among an adjacent set of M+1 data points, the adjacent set of M+1 data points including a data point from the second set of data points and its corresponding plurality of candidate data points, the selected one data point for said next segment being selected by calculating an energy difference relative to the current object contour for each one data point among said adjacent set of M+1 data points; and means for selecting one of the M+1 optimal object contour paths.
Claim 13
Dependent Claim
21 words
The apparatus of claim 9 , further comprising means for deriving edge potential energy for the first set of data points.
Claim 14
Dependent Claim
104 words
The apparatus of claim 10 , in which the means for selecting a corresponding plurality of M candidate data points from the first set of data points, comprises: means for grouping into M groups, for each one data point among said second set of data points, the data points in the vicinity of said one data point of the second set of data points, in which each one of the M groups includes a plurality of data points; and means for selecting as a candidate data point, the data point from each one of the M groups which has the optimal edge potential energy.
Claim 15
Dependent Claim
42 words
The apparatus of claim 9 , in which the desired contour is tracked and modelled within a scene sequence of image frames, the apparatus further comprising: means for determining for a current image frame whether there has been a change of scene.
Claim 16
Dependent Claim
54 words
The apparatus of claim 12 , further comprising: means for searching the current image frame for presence of the image object, where there has not been a change in scene; and means for identifying the first set of data points corresponding to the image object where presence of the image object has been found.
Claim 17
Dependent Claim
63 words
The apparatus of claim 9 , in which the desired contour is tracked and modelled within a scene sequence of image frames, the apparatus further comprising: means for searching the current image frame for presence of the image object; and means for identifying the first set of data points corresponding to the image object where presence of the image object has been found.
Claim 18
Independent Claim
286 words
An apparatus for modelling a desired contour of an image object, the apparatus receiving a first set of data points corresponding to the image object and the desired contour, the apparatus comprising: a processor which selects a second set of N data points corresponding to an initial estimate of the contour; a processor which selects, for each one data point among said second set of data points, a corresponding plurality of M candidate data points from the first set of data points, the second set of data points and the corresponding plurality of candidate data points forming an array of (M+1) by N data points; a processor which selects a starting set of M+1 data points, which includes a data point among the second set of data points and its corresponding plurality of M candidate data points; a processor which selects, for each data point among the starting set of M+1 data points, an optimal object contour path to derive M+1 optimal object contour paths which estimate the contour of the image object, in which each one optimal contour path is selected segment by segment, wherein a next segment is added to said each one optimal object contour path by selecting one data point among an adjacent set of M+1 data points, the adjacent set of M+1 data points including a data point from the second set of data points and its corresponding plurality of candidate data points, the selected one data point for said next segment being selected by calculating an energy difference relative to the current object contour for each one data point among said adjacent set of M+1 data points; and a processor which selects one of the M+1 optimal object contour paths.
Claim 19
Independent Claim
286 words
An apparatus for modelling a desired contour of an image object, the apparatus receiving a first set of data points corresponding to the image object and the desired contour, the apparatus comprising: a processor which selects a second set of N data points corresponding to an initial estimate of the contour; a processor which selects, for each one data point among said second set of data points, a corresponding plurality of M candidate data points from the first set of data points, the second set of data points and the corresponding plurality of candidate data points forming an array of (M+1) by N data points; a processor which selects a starting set of M+1 data points, which includes a data point among the second set of data points and its corresponding plurality of M candidate data points; a processor which selects, for each data point among the starting set of M+1 data points, an optimal object contour path to derive M+1 optimal object contour paths which estimate the contour of the image object, in which each one optimal contour path is selected segment by segment, wherein a next segment is added to said each one optimal object contour path by selecting one data point among an adjacent set of M+1 data points, the adjacent set of M+1 data points including a data point from the second set of data points and its corresponding plurality of candidate data points, the selected one data point for said next segment being selected by calculating an energy difference relative to the current object contour for each one data point among said adjacent set of M+1 data points; and a processor which selects one of the M+1 optimal object contour paths.
Claim 20
Dependent Claim
16 words
The apparatus of claim 15 , wherein all the processors are embodied in a common processor.
Claim 21
Dependent Claim
22 words
The apparatus of claim 15 , further comprising a processor which derives edge potential energy for the first set of data points.
Claim 22
Dependent Claim
106 words
The apparatus of claim 15 , in which the processor which selects a corresponding plurality of M candidate data points from the first set of data points, comprises: processing means for grouping into M groups, for each one data point among said second set of data points, the data points in the vicinity of said one data point of the second set of data points, in which each one of the M groups includes a plurality of data points; and processing means for selecting as a candidate data point, the data point from each one of the M groups which has the optimal edge potential energy.
Claim 23
Dependent Claim
43 words
The apparatus of claim 15 , in which the desired contour is tracked and modelled within a scene sequence of image frames, the apparatus further comprising: processing means for determining for a current image frame whether there has been a change of scene.
Claim 24
Dependent Claim
65 words
The apparatus of claim 15 , in which the desired contour is tracked and modelled within a scene sequence of image frames, the apparatus further comprising: processing means for searching the current image frame for presence of the image object; and processing means for identifying the first set of data points corresponding to the image object where presence of the image object has been found.
References Cited (Backward Citations)
US5142590A
Cited
US5133021A
Cited
US5157738A
Cited
US5239591A
Cited
EP0806733A2
Cited
US20010024516A1
Cited
US5999651A
Cited
US6195445B1
Cited
US6201543B1
Cited
US6346124B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-04-07 | 2006-10-07 | 2007-04-08 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-04-07 | 2010-10-07 | 2011-04-08 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-04-07 | 2014-10-07 | 2015-04-08 | $7700.00 | Window Closed / Lapsed |