Patent US5280530A successfully refreshed from Google Patents.
US5280530A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for tracking a moving object
Assignee: US Philips Corp
•
Filing: 1991-09-05
•
Granted: 1994-01-18
•
Expires: 2011-09-05
Abstract
Abstract A method of tracking a moving object in a scene, for example the face of a person in videophone applications, comprises forming an initial template of the face, extracting a mask outlining the face, dividing the template into a plurality (for example sixteen) sub-templates, searching the next frame to find a match with the template, searching the next frame to find a match with each of the sub-templates, determining the displacements of each of the sub-templates with respect to the template, using the displacements to determine affine transform coefficients and performing an affine transform to produce an updated template and updated mask.
Inventors
- 👤 Timothy I. P. Trew
- 👤 Gabriele C. Seeling
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 23:29
CPC Classifications
H; H04; H04N; H04N7/00; H04N7/14; H04N7/141; G; G01; G01S; G01S3/00; G01S3/78; G01S3/782; G01S3/785; G01S3/786; G01S3/7864; G06; G06T; G06T7/00; G06T7/20; G06T7/223; G06T7/246; G06T7/248; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06V40/168; H04N19/00; H04N19/50; H04N19/503; H04N19/51; H04N19/537; H04N19/543; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/30; G06T2207/30196; G06T2207/30201; G06V10/00; G06V10/40; G06V10/62; H04N19/20
Claims Analysis
Total Claims: 15
Claim 1
Independent Claim
222 words
A method of tracking the movement of a three dimensional object in a scene over a series of two dimensional picture frames, the method comprising the steps of a) forming an initial template in an initial frame of the series, said initial template including the moving object to be tracked; b) dividing said initial template into a plurality of sub-templates which are not associated with specific features of said object; c) searching a subsequent frame of said series to locate a first region of said subsequent frame which matches said initial template and determining a first displacement in position between said initial template and said first region of said subsequent frame; d) searching said subsequent frame of said series to locate respective sub-regions of said subsequent frame of said series which match respective sub-templates of the initial template and determining respective additional displacements in position between each sub-template and its respective matched sub-region of said subsequent frame; e) determining from the first displacement and the additional displacements, a relative displacement in position between said first region of said subsequent frame and said respective sub-regions of said subsequent frame; f) using said relative displacement to determine coefficients for a bivariate transform capable of mapping said first and additional displacements in position; and g) performing said bivariate transform to produce an updated initial template.
Claim 2
Independent Claim
222 words
A method of tracking the movement of a three dimensional object in a scene over a series of two dimensional picture frames, the method comprising the steps of a) forming an initial template in an initial frame of the series, said initial template including the moving object to be tracked; b) dividing said initial template into a plurality of sub-templates which are not associated with specific features of said object; c) searching a subsequent frame of said series to locate a first region of said subsequent frame which matches said initial template and determining a first displacement in position between said initial template and said first region of said subsequent frame; d) searching said subsequent frame of said series to locate respective sub-regions of said subsequent frame of said series which match respective sub-templates of the initial template and determining respective additional displacements in position between each sub-template and its respective matched sub-region of said subsequent frame; e) determining from the first displacement and the additional displacements, a relative displacement in position between said first region of said subsequent frame and said respective sub-regions of said subsequent frame; f) using said relative displacement to determine coefficients for a bivariate transform capable of mapping said first and additional displacements in position; and g) performing said bivariate transform to produce an updated initial template.
Claim 3
Dependent Claim
46 words
A method as claimed in claim 1 comprising the further steps of: a) extracting a mask from the initial frame outlining said object; b) producing an updated mask using said bivariate transform; and c) determining the boundary of said updated initial template using said updated mask.
Claim 4
Dependent Claim
31 words
A method as claimed in claim 1 or claim 2 in which the search for each of the sub-regions is restricted to a limited area with respect to said first region.
Claim 5
Dependent Claim
41 words
A method as claimed in claim 2 comprising the further step of: setting the luminance of each pixel within the mask to a first constant value and setting the luminance of each pixel outside the mask to a second constant value.
Claim 6
Dependent Claim
32 words
A method as claimed in claim 1, comprising the further step of discarding each sub-template in which the object to be tracked occupies less than a given portion of that subtemplate's area.
Claim 7
Dependent Claim
43 words
A method as claimed in claim 1 comprising the further steps of: discarding any sub-template for which a respective sub-region cannot be found, determining whether a minimum number of sub-templates remain, and if so using their respective additional displacements to calculate said coefficients.
Claim 8
Dependent Claim
32 words
A method as claimed in claim 6 in which when less than the minimum number of sub-templates remain, the search area for matching the initial template is increased for the subsequent frame.
Claim 9
Dependent Claim
49 words
A method as claimed in claim 2 comprising the further steps of: a) comparing the updated initial template with a second region of the subsequent frame corresponding to said updated mask, and b) using the results of the comparison to control the gain correction term of a Kalman filter.
Claim 10
Dependent Claim
16 words
A method as claimed in claim 2 in which the bivariate transform is an affine transform.
Claim 11
Independent Claim
234 words
An apparatus for tracking the movement of a three dimensional object in a scene over a series of two dimensional picture frames, said apparatus comprising in combination: a) means for forming an initial template in an initial frame of the series, said initial template including the moving object to be tracked; b) means for dividing said initial template into a plurality of sub-templates which are not associated with specific features of said object; c) means for searching a subsequent frame of said series to locate a first region of said subsequent frame which matches said initial template and determining a first displacement in position between said initial template and said first region of said subsequent frame; d) means for searching said subsequent frame of said series to locate respective sub-regions of said subsequent frame of said series which match respective sub-templates of the initial template and determining respective additional displacements in position between each sub-template and its respective matched sub-regions of said subsequent frame; e) means for determining from the first displacement and the additional displacements, a relative displacement in position between said first region of said subsequent frame and said respective sub-regions of said subsequent frame; f) means for determining coefficients for a bivariate transform capable of mapping said first and additional displacements in position using said relative displacement; and g) means for performing said bivariate transform to produce an updated initial template.
Claim 12
Independent Claim
234 words
An apparatus for tracking the movement of a three dimensional object in a scene over a series of two dimensional picture frames, said apparatus comprising in combination: a) means for forming an initial template in an initial frame of the series, said initial template including the moving object to be tracked; b) means for dividing said initial template into a plurality of sub-templates which are not associated with specific features of said object; c) means for searching a subsequent frame of said series to locate a first region of said subsequent frame which matches said initial template and determining a first displacement in position between said initial template and said first region of said subsequent frame; d) means for searching said subsequent frame of said series to locate respective sub-regions of said subsequent frame of said series which match respective sub-templates of the initial template and determining respective additional displacements in position between each sub-template and its respective matched sub-regions of said subsequent frame; e) means for determining from the first displacement and the additional displacements, a relative displacement in position between said first region of said subsequent frame and said respective sub-regions of said subsequent frame; f) means for determining coefficients for a bivariate transform capable of mapping said first and additional displacements in position using said relative displacement; and g) means for performing said bivariate transform to produce an updated initial template.
Claim 13
Dependent Claim
49 words
The apparatus as claimed in claim 10, further comprising: a) means for extracting a mask from the initial frame outlining said object; b) means for producing an updated mask using said bivariate transform; and c) means for determining the boundary of said updated initial template using said updated mask.
Claim 14
Dependent Claim
45 words
Apparatus as claimed in claim 11 further comprising means for comparing the updated initial template with a second region of the subsequent frame corresponding to said updated mask and using the results of the comparison to control the gain correction term of a Kalman filter.
Claim 15
Dependent Claim
48 words
Apparatus as claimed in claim 10 further comprising means for discarding any sub-template for which a respective sub-region cannot be found, means for determining whether a minimum number of sub-templates remain, and means for, where a minimum number remain, using their respective additional displacements to calculate the coefficients.
References Cited (Backward Citations)
US4799267A
Cited
US4644582A
Cited
US4825394A
Cited
US4760445A
Cited
US4868871A
Cited
US4799131A
Cited
US4931868A
Cited
US5111511A
Cited
US5018218A
Cited
US5034986A
Cited
US5157732A
Cited
US5062056A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1997-01-17 | 1997-07-19 | 1998-01-18 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2001-01-17 | 2001-07-19 | 2002-01-18 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2005-01-17 | 2005-07-19 | 2006-01-18 | $7700.00 | Window Closed / Lapsed |