Patent US6661907B2 successfully refreshed from Google Patents.
US6661907B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Face detection in digital images
Assignee: Canon Inc
•
Filing: 1999-06-07
•
Granted: 2003-12-09
•
Expires: 2019-06-07
Abstract
Abstract The present invention discloses the detection of faces in digital images. Rather than subjecting the entire image ( 1 ) to computationally intensive face detection analysis, the image is instead segmented into regions ( 2 ) each of which has a substantially homogeneous color. Only those regions ( 2 ) having a predominantly skin color are then subjected to the face detection analysis. Preferably the face detection analysis is independent of facial color.
Inventors
- 👤 Edwin Ho
- 👤 Alison Joan Lennon
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:46
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06V40/162
Claims Analysis
Total Claims: 34
Claim 1
Independent Claim
113 words
A method of detecting a face in a colour digital image captured by a camera, said method comprising the steps of: segmenting the colour digital image into a plurality of regions each having a substantially homogenous colour; testing the colour of each region created in said segmenting step to determine those regions having predominantly skin colour, wherein said testing uses a colour distribution model that is dependent on settings of the camera upon capture of the colour digital image; and subjecting only the regions determined in said testing step to facial feature analysis whereby the regions created in said segmenting step not having predominantly skin colour are not subjected to facial feature analysis.
Claim 2
Independent Claim
113 words
A method of detecting a face in a colour digital image captured by a camera, said method comprising the steps of: segmenting the colour digital image into a plurality of regions each having a substantially homogenous colour; testing the colour of each region created in said segmenting step to determine those regions having predominantly skin colour, wherein said testing uses a colour distribution model that is dependent on settings of the camera upon capture of the colour digital image; and subjecting only the regions determined in said testing step to facial feature analysis whereby the regions created in said segmenting step not having predominantly skin colour are not subjected to facial feature analysis.
Claim 3
Dependent Claim
17 words
The method as claimed in claim 1 , wherein said colour distribution model utilizes previously sampled data.
Claim 4
Dependent Claim
42 words
The method as claimed in claim 2 , wherein the colour distribution model is selected from a group consisting of models utilizing previously sampled data taken from images taken with use of a flash and images taken without use of a flash.
Claim 5
Dependent Claim
21 words
The method as claimed in claim 1 , wherein chromatic colours derived from RGB values are used in said testing step.
Claim 6
Dependent Claim
22 words
The method as claimed in claim 1 , wherein the facial feature analysis in said subjecting step is independent of facial colour.
Claim 7
Dependent Claim
15 words
The method as claimed in claim 5 wherein the facial feature analysis comprises edge detection.
Claim 8
Dependent Claim
49 words
The method as claimed in claim 6 , wherein the edge detection utilises an edge detection filter comprising a second derivative Gaussian function in a first direction substantially orthogonal to an edge to be detected and a Gaussian function in a second direction substantially orthogonal to the first direction.
Claim 9
Dependent Claim
23 words
The method as defined in claim 6 , wherein the facial feature analysis is carried out utilising the spatial relationship of detected edges.
Claim 10
Dependent Claim
64 words
The method as defined in claim 1 , wherein said segmenting step includes growing a region by determining the average colour of a group of pixels, determining the difference between the average colour of the group and the average colour of pixels adjacent to the group, and, if the colour difference is less than a predetermined threshold, adding the adjacent pixels to the group.
Claim 11
Independent Claim
107 words
An apparatus for detecting a face in a colour digital image captured by a camera, said apparatus comprising: segmenting means to segment said image into a plurality of regions each having a substantially homogeneous colour; colour detecting means coupled to said segmenting means to determine those regions having predominantly skin colour, said colour detecting means using a colour distribution model that is dependent on settings of the camera at a time of capture of the colour digital image when determining regions of predominantly skin colour; and analysis means coupled to said colour detection means to subject only those regions having predominantly skin colour to facial feature analysis.
Claim 12
Independent Claim
107 words
An apparatus for detecting a face in a colour digital image captured by a camera, said apparatus comprising: segmenting means to segment said image into a plurality of regions each having a substantially homogeneous colour; colour detecting means coupled to said segmenting means to determine those regions having predominantly skin colour, said colour detecting means using a colour distribution model that is dependent on settings of the camera at a time of capture of the colour digital image when determining regions of predominantly skin colour; and analysis means coupled to said colour detection means to subject only those regions having predominantly skin colour to facial feature analysis.
Claim 13
Dependent Claim
28 words
The apparatus as claimed in claim 10 , wherein said colour detecting means includes a storage means storing previously sampled data for use in said colour distribution model.
Claim 14
Dependent Claim
42 words
The apparatus as claimed in claim 11 , wherein the colour distribution model is selected from a group consisting of models utilizing previously sampled data taken from images taken with use of a flash and images taken without use of a flash.
Claim 15
Dependent Claim
27 words
The apparatus as claimed in claim 10 , further comprising chromatic colour calculations means to derive chromatic colour values from RGB values of the digital colour image.
Claim 16
Dependent Claim
22 words
The apparatus as claimed in claim 10 , wherein the facial feature analysis of said analysis means is independent of facial colour.
Claim 17
Dependent Claim
24 words
The apparatus as claimed in claim 14 , wherein said analysis means includes an edge detector to detect edges in the digital colour image.
Claim 18
Dependent Claim
49 words
The apparatus as claimed in claim 15 , wherein said analysis means has an edge detection filter comprising a second derivative Gaussian function in a first direction substantially orthogonal to an edge to be detected and a Gaussian function in a second direction substantially orthogonal to the first direction.
Claim 19
Dependent Claim
26 words
The apparatus as claimed in claim 15 or 16 , wherein said analysis means includes a spatial determinator to determine a spatial relationship of detected edges.
Claim 20
Dependent Claim
66 words
The apparatus as claimed in claim 10 , further comprising an accumulator means and a colour difference means to determine a difference between the average colour of a group of pixels and the average colour of pixels adjacent to that group, wherein if the colour difference is less than a predetermined threshold, the adjacent pixels are added to said accumulator means to thereby grow a region.
Claim 21
Dependent Claim
133 words
A computer readable medium incorporating a computer program product for detecting a face in a colour digital image captured by a camera, said computer program product including a sequence of computer implementable instructions for carrying out the steps of: segmenting the colour digital image into a plurality of regions each having a substantially homogenous colour; testing the colour of each region created in said segmenting step to determine those regions having predominantly skin colour, wherein said testing uses a colour distribution model that is dependent on settings of the camera at a time of capture of colour digital image; and subjecting only the regions determined in said testing step to facial feature analysis whereby the regions created in said segmenting step not having predominantly skin colour are not subjected to facial feature analysis.
Claim 22
Dependent Claim
133 words
A computer readable medium incorporating a computer program product for detecting a face in a colour digital image captured by a camera, said computer program product including a sequence of computer implementable instructions for carrying out the steps of: segmenting the colour digital image into a plurality of regions each having a substantially homogenous colour; testing the colour of each region created in said segmenting step to determine those regions having predominantly skin colour, wherein said testing uses a colour distribution model that is dependent on settings of the camera at a time of capture of colour digital image; and subjecting only the regions determined in said testing step to facial feature analysis whereby the regions created in said segmenting step not having predominantly skin colour are not subjected to facial feature analysis.
Claim 23
Dependent Claim
19 words
The computer readable medium as claimed in claim 19 , wherein said colour distribution model utilizes previously sampled data.
Claim 24
Dependent Claim
44 words
The computer readable medium as claimed in claim 20 , wherein the colour distribution model is selected from a group consisting of models utilizing previously sampled data taken from images taken with use of a flash and images taken without use of a flash.
Claim 25
Dependent Claim
23 words
The computer readable medium as claimed in claim 19 , wherein chromatic colours derived from RGB values are used in said testing step.
Claim 26
Dependent Claim
24 words
The computer readable medium as claimed in claim 19 , wherein the facial feature analysis in said subjecting step is independent of facial colour.
Claim 27
Dependent Claim
18 words
The computer readable medium as claimed in claim 23 , wherein the facial feature analysis comprises edge detection.
Claim 28
Dependent Claim
51 words
The computer readable medium as claimed in claim 24 , wherein the edge detection utilises an edge detection filter comprising a second derivative Gaussian function in a first direction substantially orthogonal to an edge to be detected and a Gaussian function in a second direction substantially orthogonal to the first direction.
Claim 29
Dependent Claim
25 words
The computer readable medium as claimed in claim 24 , wherein the facial feature analysis is carried out utilising a spatial relationship of detected edges.
Claim 30
Dependent Claim
66 words
The computer readable medium as claimed in claim 19 , wherein said segmenting step includes growing a region by determining the average colour of a group of pixels, determining the difference between the average colour of the group and the average colour of pixels adjacent to the group, and, if the colour difference is less than a predetermined threshold, adding the adjacent pixels to the group.
Claim 31
Independent Claim
109 words
A method of detecting a face in a colour digital image captured by a camera, said method comprising the steps of: segmenting the colour digital image into a plurality of regions each having a substantially homogenous colour; testing the colour of each region created in said segmenting step to determine those regions having predominantly skin colour, wherein said testing uses a threshold altered by settings of the camera upon capture of the colour digital image; and subjecting only the regions determined in said testing step to facial feature analysis whereby the regions created in said segmenting step not having predominantly skin colour are not subjected to facial feature analysis.
Claim 32
Independent Claim
109 words
A method of detecting a face in a colour digital image captured by a camera, said method comprising the steps of: segmenting the colour digital image into a plurality of regions each having a substantially homogenous colour; testing the colour of each region created in said segmenting step to determine those regions having predominantly skin colour, wherein said testing uses a threshold altered by settings of the camera upon capture of the colour digital image; and subjecting only the regions determined in said testing step to facial feature analysis whereby the regions created in said segmenting step not having predominantly skin colour are not subjected to facial feature analysis.
Claim 33
Dependent Claim
127 words
A computer readable medium incorporating a computer program product for detecting a face in a colour digital image captured by a camera, said computer program product including a sequence of computer implementable instructions for carrying out the steps of: segmenting the colour digital image into a plurality of regions each having a substantially homogenous colour; testing the colour of each region created in said segmenting step to determine those regions having predominantly skin color, wherein said testing uses a threshold altered by settings of the camera upon capture of the colour digital image; and subjecting only the regions determined in said testing step to facial feature analysis whereby the regions created in said segmenting step not having predominantly skin colour are not subjected to facial feature analysis.
Claim 34
Dependent Claim
127 words
A computer readable medium incorporating a computer program product for detecting a face in a colour digital image captured by a camera, said computer program product including a sequence of computer implementable instructions for carrying out the steps of: segmenting the colour digital image into a plurality of regions each having a substantially homogenous colour; testing the colour of each region created in said segmenting step to determine those regions having predominantly skin color, wherein said testing uses a threshold altered by settings of the camera upon capture of the colour digital image; and subjecting only the regions determined in said testing step to facial feature analysis whereby the regions created in said segmenting step not having predominantly skin colour are not subjected to facial feature analysis.
References Cited (Backward Citations)
US5933524A
Cited
US5715377A
Cited
US5912980A
Cited
US5949962A
Cited
US6028960A
Cited
US6188777B1
Cited
US6292574B1
Cited
US6360002B2
Cited
US6148092A
Cited
US6504942B1
Cited
US6072496A
Cited
US6263113B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-12-08 | 2007-06-09 | 2007-12-09 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-12-08 | 2011-06-09 | 2011-12-09 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-12-08 | 2015-06-09 | 2015-12-09 | $7700.00 | Window Closed / Lapsed |