Patent US6404900B1 successfully refreshed from Google Patents.
US6404900B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method for robust human face tracking in presence of multiple persons
Assignee: Sharp Laboratories of America Inc
•
Filing: 1999-01-14
•
Granted: 2002-06-11
•
Expires: 2019-01-14
Abstract
Abstract A method for robust human face tracking in the presence of multiple facial images includes taking a frame from a color video sequence as a current input image; filtering the current input image to form a filtered image; estimating the locations and sizes of faces in the filtered image based on a projection histogram of the filtered image; estimating face motion in the filtered image; and outputting the location and size of the tracked faces within the filtered image.
Inventors
- 👤 Richard J. Qian
- 👤 Kristine E. Matthews
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 11:17
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/20; G06T7/246; G06T7/248; G06T7/277; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/30; G06T2207/30196; G06T2207/30201
Claims Analysis
Total Claims: 25
Claim 1
Independent Claim
152 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image, including: determining a sample mean μ and standard deviation σ using all of the samples in a distribution; setting μ t (0)=μ and δ=max (a*σ, b*image-width) where a and b are scaling factors, resulting in an initial trimmed mean μ(k) within an initial trimmed interval (k); determining a trimmed mean μ t (k+1) which is used to define the interval [μ t (k)−δ, μ t (k)+δ]; redetermining the trimmed mean until |μ t (k+1)−μ t (k)|<ε where ε is tolerance; and determining a robust mean μ* within a final trimmed interval; and extracting and outputting the tracked face regions.
Claim 2
Independent Claim
152 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image, including: determining a sample mean μ and standard deviation σ using all of the samples in a distribution; setting μ t (0)=μ and δ=max (a*σ, b*image-width) where a and b are scaling factors, resulting in an initial trimmed mean μ(k) within an initial trimmed interval (k); determining a trimmed mean μ t (k+1) which is used to define the interval [μ t (k)−δ, μ t (k)+δ]; redetermining the trimmed mean until |μ t (k+1)−μ t (k)|<ε where ε is tolerance; and determining a robust mean μ* within a final trimmed interval; and extracting and outputting the tracked face regions.
Claim 3
Dependent Claim
19 words
The method of claim 1 wherein said filtering includes filtering to represent the current input image in chromaticity space.
Claim 4
Dependent Claim
15 words
The method of claim 1 which includes estimating face motion via a linear Kalman filter.
Claim 5
Dependent Claim
16 words
The method of claim 3 which further includes smoothing the face motion during a post-processing step.
Claim 6
Independent Claim
95 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image; determining the size of a facial area by: determining the trimmed standard deviation σ t based on the samples within the interval [μ*−δ, μ*+δ]; and setting size=c*σ t where c is a scaling factor; and extracting and outputting the tracked face regions.
Claim 7
Independent Claim
95 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image; determining the size of a facial area by: determining the trimmed standard deviation σ t based on the samples within the interval [μ*−δ, μ*+δ]; and setting size=c*σ t where c is a scaling factor; and extracting and outputting the tracked face regions.
Claim 8
Dependent Claim
19 words
The method of claim 5 wherein said filtering includes filtering to represent the current input image in chromaticity space.
Claim 9
Dependent Claim
16 words
The method of claim 5 which further includes estimating face motion via a linear Kalman filter.
Claim 10
Dependent Claim
16 words
The method of claim 7 which further includes smoothing the face motion during a post-processing step.
Claim 11
Independent Claim
120 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image determining the size of a facial area by: determining the trimmed standard deviation σ t based on the samples within the interval [μ*−δ, μ*+δ]; If h(μ*+d*σ t )≧g*h(μ*) or h(μ*−d*σ t )≧g*h(μ*) where, e.g., d=1.0 and g=0.4, then increase σ t until the condition is no longer true; and setting size=c*σ t , where c is a scaling factor; and extracting and outputting the tracked face regions.
Claim 12
Independent Claim
120 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image determining the size of a facial area by: determining the trimmed standard deviation σ t based on the samples within the interval [μ*−δ, μ*+δ]; If h(μ*+d*σ t )≧g*h(μ*) or h(μ*−d*σ t )≧g*h(μ*) where, e.g., d=1.0 and g=0.4, then increase σ t until the condition is no longer true; and setting size=c*σ t , where c is a scaling factor; and extracting and outputting the tracked face regions.
Claim 13
Dependent Claim
19 words
The method of claim 9 wherein said filtering includes filtering to represent the current input image in chromaticity space.
Claim 14
Dependent Claim
16 words
The method of claim 9 which further includes estimating face motion via a linear Kalman filter.
Claim 15
Dependent Claim
16 words
The method of claim 11 which further includes smoothing the face motion during a post-processing step.
Claim 16
Independent Claim
152 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image determining the size of a facial area by: setting width = 1 ( 2 N + 1 ) ∑ i = - N N h y ( μ y * + i ) ; and setting height = 1 ( 2 N + 1 ) ∑ i = - N N h x ( μ x * + i ) , wherein N determines the number of samples used in the determination of the size of the facial image; and extracting and outputting the tracked face regions.
Claim 17
Independent Claim
152 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image determining the size of a facial area by: setting width = 1 ( 2 N + 1 ) ∑ i = - N N h y ( μ y * + i ) ; and setting height = 1 ( 2 N + 1 ) ∑ i = - N N h x ( μ x * + i ) , wherein N determines the number of samples used in the determination of the size of the facial image; and extracting and outputting the tracked face regions.
Claim 18
Dependent Claim
19 words
The method of claim 13 wherein said filtering includes filtering to represent the current input image in chromaticity space.
Claim 19
Dependent Claim
16 words
The method of claim 13 which further includes estimating face motion via a linear Kalman filter.
Claim 20
Dependent Claim
16 words
The method of claim 9 which further includes smoothing the face motion during a post-processing step.
Claim 21
Independent Claim
140 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image determining the size of a facial area by determining the size from a projection histogram of a clipped region of the color-filtered image by: forming the clipped projection histogram h y c by projecting columns in the color-filtered image within the range [μ x *−Δ, μ x *+Δ], where Δ determines the number of samples used in the determination; determining size in the y direction based on h y c ; and estimating face locations for tracking facial motion; and extracting and outputting the tracked face regions.
Claim 22
Independent Claim
140 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image determining the size of a facial area by determining the size from a projection histogram of a clipped region of the color-filtered image by: forming the clipped projection histogram h y c by projecting columns in the color-filtered image within the range [μ x *−Δ, μ x *+Δ], where Δ determines the number of samples used in the determination; determining size in the y direction based on h y c ; and estimating face locations for tracking facial motion; and extracting and outputting the tracked face regions.
Claim 23
Dependent Claim
19 words
The method of claim 17 wherein said filtering includes filtering to represent the current input image in chromaticity space.
Claim 24
Dependent Claim
16 words
The method of claim 17 which further includes estimating face motion via a linear Kalman filter.
Claim 25
Dependent Claim
16 words
The method of claim 19 which further includes smoothing the face motion during a post-processing step.
References Cited (Backward Citations)
US4527283A
Cited
US4481665A
Cited
US4975960A
Cited
US4903311A
Cited
US5086480A
Cited
US4912559A
Cited
US4975969A
Cited
US4998285A
Cited
US4991223A
Cited
US5103484A
Cited
US5150432A
Cited
US5187574A
Cited
US5280530A
Cited
US5095467A
Cited
US5164992A
Cited
US5323470A
Cited
US5450504A
Cited
US5430809A
Cited
US5469374A
Cited
US5644386A
Cited
US5592176A
Cited
US5642431A
Cited
US5912980A
Cited
US6188777B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2005-06-10 | 2005-12-10 | 2006-06-11 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2009-06-10 | 2009-12-10 | 2010-06-11 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2013-06-10 | 2013-12-10 | 2014-06-11 | $7700.00 | Window Closed / Lapsed |