Patent US6404900B1 successfully refreshed from Google Patents.
← Back to Patent Explorer
US6404900B1 Expired / Lapsed US ⏱️ 0.0 years remaining

Method for robust human face tracking in presence of multiple persons

Assignee: Sharp Laboratories of America Inc
•
Filing: 1999-01-14
•
Granted: 2002-06-11
•
Expires: 2019-01-14
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method for robust human face tracking in the presence of multiple facial images includes taking a frame from a color video sequence as a current input image; filtering the current input image to form a filtered image; estimating the locations and sizes of faces in the filtered image based on a projection histogram of the filtered image; estimating face motion in the filtered image; and outputting the location and size of the tracked faces within the filtered image.

Inventors

  • 👤 Richard J. Qian
  • 👤 Kristine E. Matthews

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 11:17
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/20; G06T7/246; G06T7/248; G06T7/277; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/30; G06T2207/30196; G06T2207/30201

Claims Analysis

Total Claims: 25
Claim 1
Independent Claim 152 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image, including: determining a sample mean μ and standard deviation σ using all of the samples in a distribution; setting μ t (0)=μ and δ=max (a*σ, b*image-width) where a and b are scaling factors, resulting in an initial trimmed mean μ(k) within an initial trimmed interval (k); determining a trimmed mean μ t (k+1) which is used to define the interval [μ t (k)−δ, μ t (k)+δ]; redetermining the trimmed mean until |μ t (k+1)−μ t (k)|<ε where ε is tolerance; and determining a robust mean μ* within a final trimmed interval; and extracting and outputting the tracked face regions.
Claim 2
Independent Claim 152 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image, including: determining a sample mean μ and standard deviation σ using all of the samples in a distribution; setting μ t (0)=μ and δ=max (a*σ, b*image-width) where a and b are scaling factors, resulting in an initial trimmed mean μ(k) within an initial trimmed interval (k); determining a trimmed mean μ t (k+1) which is used to define the interval [μ t (k)−δ, μ t (k)+δ]; redetermining the trimmed mean until |μ t (k+1)−μ t (k)|<ε where ε is tolerance; and determining a robust mean μ* within a final trimmed interval; and extracting and outputting the tracked face regions.
Claim 3
Dependent Claim 19 words
The method of claim 1 wherein said filtering includes filtering to represent the current input image in chromaticity space.
Claim 4
Dependent Claim 15 words
The method of claim 1 which includes estimating face motion via a linear Kalman filter.
Claim 5
Dependent Claim 16 words
The method of claim 3 which further includes smoothing the face motion during a post-processing step.
Claim 6
Independent Claim 95 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image; determining the size of a facial area by: determining the trimmed standard deviation σ t based on the samples within the interval [μ*−δ, μ*+δ]; and setting size=c*σ t where c is a scaling factor; and extracting and outputting the tracked face regions.
Claim 7
Independent Claim 95 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image; determining the size of a facial area by: determining the trimmed standard deviation σ t based on the samples within the interval [μ*−δ, μ*+δ]; and setting size=c*σ t where c is a scaling factor; and extracting and outputting the tracked face regions.
Claim 8
Dependent Claim 19 words
The method of claim 5 wherein said filtering includes filtering to represent the current input image in chromaticity space.
Claim 9
Dependent Claim 16 words
The method of claim 5 which further includes estimating face motion via a linear Kalman filter.
Claim 10
Dependent Claim 16 words
The method of claim 7 which further includes smoothing the face motion during a post-processing step.
Claim 11
Independent Claim 120 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image determining the size of a facial area by: determining the trimmed standard deviation σ t based on the samples within the interval [μ*−δ, μ*+δ]; If h(μ*+d*σ t )≧g*h(μ*) or h(μ*−d*σ t )≧g*h(μ*) where, e.g., d=1.0 and g=0.4, then increase σ t until the condition is no longer true; and setting size=c*σ t , where c is a scaling factor; and extracting and outputting the tracked face regions.
Claim 12
Independent Claim 120 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image determining the size of a facial area by: determining the trimmed standard deviation σ t based on the samples within the interval [μ*−δ, μ*+δ]; If h(μ*+d*σ t )≧g*h(μ*) or h(μ*−d*σ t )≧g*h(μ*) where, e.g., d=1.0 and g=0.4, then increase σ t until the condition is no longer true; and setting size=c*σ t , where c is a scaling factor; and extracting and outputting the tracked face regions.
Claim 13
Dependent Claim 19 words
The method of claim 9 wherein said filtering includes filtering to represent the current input image in chromaticity space.
Claim 14
Dependent Claim 16 words
The method of claim 9 which further includes estimating face motion via a linear Kalman filter.
Claim 15
Dependent Claim 16 words
The method of claim 11 which further includes smoothing the face motion during a post-processing step.
Claim 16
Independent Claim 152 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image determining the size of a facial area by: setting width = 1 ( 2  N + 1 )   ∑ i = - N N   h y  ( μ y * + i ) ; and setting height = 1 ( 2  N + 1 )   ∑ i = - N N   h x  ( μ x * + i ) , wherein N determines the number of samples used in the determination of the size of the facial image; and extracting and outputting the tracked face regions.
Claim 17
Independent Claim 152 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image determining the size of a facial area by: setting width = 1 ( 2  N + 1 )   ∑ i = - N N   h y  ( μ y * + i ) ; and setting height = 1 ( 2  N + 1 )   ∑ i = - N N   h x  ( μ x * + i ) , wherein N determines the number of samples used in the determination of the size of the facial image; and extracting and outputting the tracked face regions.
Claim 18
Dependent Claim 19 words
The method of claim 13 wherein said filtering includes filtering to represent the current input image in chromaticity space.
Claim 19
Dependent Claim 16 words
The method of claim 13 which further includes estimating face motion via a linear Kalman filter.
Claim 20
Dependent Claim 16 words
The method of claim 9 which further includes smoothing the face motion during a post-processing step.
Claim 21
Independent Claim 140 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image determining the size of a facial area by determining the size from a projection histogram of a clipped region of the color-filtered image by: forming the clipped projection histogram h y c by projecting columns in the color-filtered image within the range [μ x *−Δ, μ x *+Δ], where Δ determines the number of samples used in the determination; determining size in the y direction based on h y c ; and estimating face locations for tracking facial motion; and extracting and outputting the tracked face regions.
Claim 22
Independent Claim 140 words
A method for robust human face tracking in the presence of multiple facial images comprising: taking a frame from a color video sequence as a current input image; filtering the current input image in chromaticity space; estimating the locations of faces in the image based on a projection histogram of the filtered image determining the size of a facial area by determining the size from a projection histogram of a clipped region of the color-filtered image by: forming the clipped projection histogram h y c by projecting columns in the color-filtered image within the range [μ x *−Δ, μ x *+Δ], where Δ determines the number of samples used in the determination; determining size in the y direction based on h y c ; and estimating face locations for tracking facial motion; and extracting and outputting the tracked face regions.
Claim 23
Dependent Claim 19 words
The method of claim 17 wherein said filtering includes filtering to represent the current input image in chromaticity space.
Claim 24
Dependent Claim 16 words
The method of claim 17 which further includes estimating face motion via a linear Kalman filter.
Claim 25
Dependent Claim 16 words
The method of claim 19 which further includes smoothing the face motion during a post-processing step.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2005-06-10 2005-12-10 2006-06-11 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2009-06-10 2009-12-10 2010-06-11 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2013-06-10 2013-12-10 2014-06-11 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag