Patent US6263113B1 successfully refreshed from Google Patents.
US6263113B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method for detecting a face in a digital image
Assignee: Philips North America LLC
•
Filing: 1998-12-11
•
Granted: 2001-07-17
•
Expires: 2018-12-11
Abstract
Abstract In order to detect a face disposed within a digital image, the pixels of the image are grouped based on whether they are skin color. The edges of the skin colored areas are removed by eliminating pixels that have surrounding pixels with a high variance in the luminance component. The resulting connected components are classified to determine whether they could include a face. The classification includes examining: the area of the bounding box of the component, the aspect ratio, the ratio of detected skin to the area of the bounding box, the orientation of elongated objects, and the distance between the center of the bounding box and the center of mass of the component. Components which are still considered facial candidates are mapped on to a graph. The minimum spanning trees of the graphs are extracted and the corresponding components which remain are again classified for whether they could include a face. Each graph is split into two by removing the weakest edge and the corresponding components which remain are yet again classified. The graph is continually broken down until a bounding box formed around the resulting graphs is smaller than a threshold. Finally, a heuristic is performed to eliminate false positives. The heuristic compares the ratio of pixels with high variance to the total number of pixels in a face candidate component.
Inventors
- 👤 Mohamed Abdel-Mottaleb
- 👤 Ahmed Elgammal
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 11:07
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06V40/165; G06V40/162; G06T; G06T2210/00; G06T2210/12
Claims Analysis
Total Claims: 10
Claim 1
Independent Claim
155 words
A method for detecting a face disposed within a digital image, comprising the steps of: providing a digital image composed of a plurality of pixels; providing a binary image from the digital image by detecting skin colored pixels; removing pixels corresponding to edges in the luminance component of said binary image thereby producing binary image components; mapping said binary image components into at least one graph; and classifying said mapped binary image components as facial and non-facial types wherein the facial types serve as facial candidates, further comprising the step of applying a heuristic, said heuristic including in the following steps: applying a morphological closing operation on each of said facial candidates to produce at least one closed facial candidate; determining high variance pixels in said closed facial candidate; determining the ratio between said high variance pixels and the total number of pixels in said closed facial candidate; and comparing said ratio to a threshold.
Claim 2
Independent Claim
155 words
A method for detecting a face disposed within a digital image, comprising the steps of: providing a digital image composed of a plurality of pixels; providing a binary image from the digital image by detecting skin colored pixels; removing pixels corresponding to edges in the luminance component of said binary image thereby producing binary image components; mapping said binary image components into at least one graph; and classifying said mapped binary image components as facial and non-facial types wherein the facial types serve as facial candidates, further comprising the step of applying a heuristic, said heuristic including in the following steps: applying a morphological closing operation on each of said facial candidates to produce at least one closed facial candidate; determining high variance pixels in said closed facial candidate; determining the ratio between said high variance pixels and the total number of pixels in said closed facial candidate; and comparing said ratio to a threshold.
Claim 3
Independent Claim
174 words
A method for detecting a face disposed within a digital image, comprising the steps of: providing a digital image composed of a plurality of pixels; providing a binary image from the digital image by detecting skin colored pixels; removing pixels corresponding to edges in the luminance component of said binary image thereby producing binary image components; mapping said binary image components into at least one graph; and classifying said mapped binary image components as facial and non-facial types wherein the facial types serve as facial candidates wherein said step of removing includes: applying a mask to a plurality of said pixels including an examined pixel; determining the variance between said examined pixel and pixels disposed within said mask; and comparing said variance to a variance threshold wherein: said step of removing is repeated for decreasing variance thresholds until a size or said binary image components is below a component size threshold; and after each step of removing, each of said binary image components is classified as one of the facial type and non-facial type.
Claim 4
Independent Claim
174 words
A method for detecting a face disposed within a digital image, comprising the steps of: providing a digital image composed of a plurality of pixels; providing a binary image from the digital image by detecting skin colored pixels; removing pixels corresponding to edges in the luminance component of said binary image thereby producing binary image components; mapping said binary image components into at least one graph; and classifying said mapped binary image components as facial and non-facial types wherein the facial types serve as facial candidates wherein said step of removing includes: applying a mask to a plurality of said pixels including an examined pixel; determining the variance between said examined pixel and pixels disposed within said mask; and comparing said variance to a variance threshold wherein: said step of removing is repeated for decreasing variance thresholds until a size or said binary image components is below a component size threshold; and after each step of removing, each of said binary image components is classified as one of the facial type and non-facial type.
Claim 5
Independent Claim
181 words
A method for detecting a face disposed within a digital image, comprising the steps of: providing a digital image composed of a plurality of pixels; providing a binary image from the digital image by detecting skin colored pixels; removing pixels corresponding to edges in the luminance component of said binary image thereby producing binary image components; mapping said binary image components into at least one graph; and classifying said mapped binary image components as facial and non-facial types wherein the facial types serve as facial candidates wherein said step of removing includes: applying a mask to a plurality of said pixels including an examined pixel; determining the variance between said examined pixel and pixels disposed within said mask; and comparing said variance to a variance threshold wherein: said step of removing is repeated for decreasing variance thresholds until a size of said binary image components is below a component size threshold; and after each step of removing, each of said binary image components is classified as one of the facial type and non-facial type, wherein said binary image components are connected.
Claim 6
Independent Claim
181 words
A method for detecting a face disposed within a digital image, comprising the steps of: providing a digital image composed of a plurality of pixels; providing a binary image from the digital image by detecting skin colored pixels; removing pixels corresponding to edges in the luminance component of said binary image thereby producing binary image components; mapping said binary image components into at least one graph; and classifying said mapped binary image components as facial and non-facial types wherein the facial types serve as facial candidates wherein said step of removing includes: applying a mask to a plurality of said pixels including an examined pixel; determining the variance between said examined pixel and pixels disposed within said mask; and comparing said variance to a variance threshold wherein: said step of removing is repeated for decreasing variance thresholds until a size of said binary image components is below a component size threshold; and after each step of removing, each of said binary image components is classified as one of the facial type and non-facial type, wherein said binary image components are connected.
Claim 7
Independent Claim
121 words
A method for detecting a face disposed within a digital image, comprising the steps of: providing a digital image composed of a plurality of pixels; providing a binary image from the digital image by detecting skin colored pixels; removing pixels corresponding to edges in the luminance component of said binary image thereby producing binary image components; mapping said binary image components into at least one graph; and classifying said mapped binary image components as facial and non-facial types wherein the facial types serve as facial candidates, wherein said step of mapping comprises the following steps: representing each component as a vertex; connecting vertices with an edge when close in space and similar in color, thereby forming said at least one graph.
Claim 8
Independent Claim
121 words
A method for detecting a face disposed within a digital image, comprising the steps of: providing a digital image composed of a plurality of pixels; providing a binary image from the digital image by detecting skin colored pixels; removing pixels corresponding to edges in the luminance component of said binary image thereby producing binary image components; mapping said binary image components into at least one graph; and classifying said mapped binary image components as facial and non-facial types wherein the facial types serve as facial candidates, wherein said step of mapping comprises the following steps: representing each component as a vertex; connecting vertices with an edge when close in space and similar in color, thereby forming said at least one graph.
Claim 9
Independent Claim
206 words
A method for detecting a face disposed within a digital image, comprising the steps of: providing a digital image composed of a plurality of pixels; providing a binary image from the digital image by detecting skin colored pixels; removing pixels corresponding to edges in the luminance component of said binary image thereby producing binary image components; mapping said binary image components into at least one graph; and classifying said mapped binary image components as facial and non-facial types wherein the facial types serve as facial candidates, wherein said step of mapping comprises the following steps: representing each component as a vertex; connecting vertices with an edge when close in space and similar in color, thereby forming said at least one graph, wherein each edge has an associated weight and further comprising the steps of: extracting the minimum spanning tree of each graph; classifying the corresponding binary image components of each graph as one of the facial type and non-facial type; removing the edge in each graph with the greatest weight thereby forming two smaller graphs; and repeating said step of classifying the corresponding binary image components for each of said smaller graphs until a bounding box around said smaller graphs is smaller than a graph threshold.
Claim 10
Independent Claim
206 words
A method for detecting a face disposed within a digital image, comprising the steps of: providing a digital image composed of a plurality of pixels; providing a binary image from the digital image by detecting skin colored pixels; removing pixels corresponding to edges in the luminance component of said binary image thereby producing binary image components; mapping said binary image components into at least one graph; and classifying said mapped binary image components as facial and non-facial types wherein the facial types serve as facial candidates, wherein said step of mapping comprises the following steps: representing each component as a vertex; connecting vertices with an edge when close in space and similar in color, thereby forming said at least one graph, wherein each edge has an associated weight and further comprising the steps of: extracting the minimum spanning tree of each graph; classifying the corresponding binary image components of each graph as one of the facial type and non-facial type; removing the edge in each graph with the greatest weight thereby forming two smaller graphs; and repeating said step of classifying the corresponding binary image components for each of said smaller graphs until a bounding box around said smaller graphs is smaller than a graph threshold.
References Cited (Backward Citations)
US5905807A
Cited
EP0654749A2
Cited
US5781650A
Cited
US5912721A
Cited
EP0836326A2
Cited
US6072903A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-07-16 | 2005-01-15 | 2005-07-17 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-07-16 | 2009-01-15 | 2009-07-17 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-07-16 | 2013-01-15 | 2013-07-17 | $7700.00 | Window Closed / Lapsed |