US6940545B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Face detecting camera and method
Assignee: Monument Peak Ventures LLC
•
Filing: 2000-02-28
•
Granted: 2005-09-06
•
Expires: 2020-02-28
Abstract
Abstract A method for determining the presence of a face from image data includes a face detection algorithm having two separate algorithmic steps: a first step of prescreening image data with a first component of the algorithm to find one or more face candidate regions of the image based on a comparison between facial shape models and facial probabilities assigned to image pixels within the region; and a second step of operating on the face candidate regions with a second component of the algorithm using a pattern matching technique to examine each face candidate region of the image and thereby confirm a facial presence in the region, whereby the combination of these components provides higher performance in terms of detection levels than either component individually. In a camera implementation, a digital camera includes an algorithm memory for storing an algorithm comprised of the aforementioned first and second components and an electronic processing section for processing the image data together with the algorithm for determining the presence of one or more faces in the scene. Facial data indicating the presence of faces may be used to control, e.g., exposure parameters of the capture of an image, or to produce processed image data that relates, e.g., color balance, to the presence of faces in the image, or the facial data may be stored together with the image data on a storage medium.
Inventors
- 👤 Lawrence A. Ray
- 👤 Henry Nicponski
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:39
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06V40/162; G06V40/165; H; H04; H04N; H04N23/00; H04N23/60; H04N23/61; H04N23/611; H04N23/64; H04N23/70; H04N2101/00; H04N5/00; H04N5/76; H04N5/765; H04N5/77; H04N5/772
Claims Analysis
Total Claims: 47
Claim 1
Independent Claim
202 words
A digital camera for capturing an image of a scene, said digital camera comprising: a capture section for capturing an image and producing image data; an electronic processing section for processing the image data to determine the presence of one or more faces in the image; face data means associated with the processing section for generating face data corresponding to at least one attribute of at least one of the faces in the image; a storage medium for storing the image data; and recording means associated with the processing section for recording the face data with the image data on the storage medium; wherein the electronic processing section utilizes a face detection algorithm having a first component and a second component; the first component comprising a pre-screening pattern recognizer that searches for image windows likely to contain faces, the first component having a first rate of false positives and determining a plurality of face candidates; the second component comprising a posterior probability function classifier, the second component having a second rate of false positives lower than the first rate of false positives, and processing the plurality of face candidates to determine the presence of the one or more faces in the image.
Claim 2
Dependent Claim
202 words
A digital camera for capturing an image of a scene, said digital camera comprising: a capture section for capturing an image and producing image data; an electronic processing section for processing the image data to determine the presence of one or more faces in the image; face data means associated with the processing section for generating face data corresponding to at least one attribute of at least one of the faces in the image; a storage medium for storing the image data; and recording means associated with the processing section for recording the face data with the image data on the storage medium; wherein the electronic processing section utilizes a face detection algorithm having a first component and a second component; the first component comprising a pre-screening pattern recognizer that searches for image windows likely to contain faces, the first component having a first rate of false positives and determining a plurality of face candidates; the second component comprising a posterior probability function classifier, the second component having a second rate of false positives lower than the first rate of false positives, and processing the plurality of face candidates to determine the presence of the one or more faces in the image.
Claim 3
Dependent Claim
34 words
The digital camera as claimed in claim 1 wherein the face data corresponds to at least one of the location, orientation, scale and pose of at least one of the faces in the image.
Claim 4
Dependent Claim
25 words
The digital camera as claimed in claim 1 wherein the electronic processing section further provides an indication that one or more faces have been detected.
Claim 5
Dependent Claim
40 words
The digital camera as claimed in claim 3 further comprising a framing device for framing the image, and wherein the electronic processing section provides an indication in the framing device identifying the one or more faces that have been detected.
Claim 6
Dependent Claim
31 words
The digital camera as claimed in claim 4 wherein the framing device is either an optical viewfinder that images the scene or an electronic display device that reproduces the image data.
Claim 7
Dependent Claim
36 words
The digital camera as claimed in claim 1 wherein the recording means records the captured image data in the storage medium in digital folders dedicated to images with a particular number of faces in the scenes.
Claim 8
Dependent Claim
51 words
The digital camera as claimed in claim 1 wherein the electronic processing section further includes a face recognition algorithm and a data base of known faces for generating facial identities, and wherein the recording means labels one or more images in the storage medium with the facial identities of known faces.
Claim 9
Dependent Claim
42 words
The digital camera as claimed in claim 1 wherein the capture section further includes an exposure control section responsive to the presence of one or more faces for optimally exposing the image for at least one of the faces in the scene.
Claim 10
Dependent Claim
33 words
The digital camera as claimed in claim 8 wherein the exposure control section optimally exposes the image for either the preponderance of faces in the scene or the largest face in the scene.
Claim 11
Dependent Claim
44 words
The digital camera as claimed in claim 8 wherein the capture section further includes a flash unit, and wherein the electronic processing section controls activation of the flash unit in order to optimize exposure for at least one of the faces in the scene.
Claim 12
Dependent Claim
117 words
A digital camera for capturing an image of a scene, said digital camera comprising: a capture section for capturing an image and producing image data; an electronic processing section for processing the image data to determine the presence of one or more faces in the scene; face data means associated with the processing section for generating face data corresponding to at least one attribute of at least one of the faces in the image; a composition algorithm associated with the processing section for processing the face data and generating composition suggestions for a user of the digital camera in response to the processed face data; and a display device for displaying the composition suggestions to the user.
Claim 13
Dependent Claim
117 words
A digital camera for capturing an image of a scene, said digital camera comprising: a capture section for capturing an image and producing image data; an electronic processing section for processing the image data to determine the presence of one or more faces in the scene; face data means associated with the processing section for generating face data corresponding to at least one attribute of at least one of the faces in the image; a composition algorithm associated with the processing section for processing the face data and generating composition suggestions for a user of the digital camera in response to the processed face data; and a display device for displaying the composition suggestions to the user.
Claim 14
Dependent Claim
76 words
A digital camera as claimed in claim 11 wherein the composition suggestions include at least one of (a) an indication that a main subject is too small in the image, (b) an indication that following the law of thirds will lead to a more pleasing composition, (c) an indication that one or faces have been cut off in the image, and (c) an indication that a horizontal alignment of subjects should be avoided in the image.
Claim 15
Dependent Claim
111 words
A digital camera for capturing an image of a scene, said digital camera comprising: a capture section for capturing an image and producing image data; an electronic processing section for processing the image data to determine the presence of one or more faces in the scene and generating face data therefrom; an orientation algorithm associated with the processing section for generating orientation data indicating orientation of the image based on the orientation of at least one of the faces in the image; a storage medium for storing the image data; and recording means associated with the processing section for recording the orientation data with the image data on the storage medium.
Claim 16
Dependent Claim
111 words
A digital camera for capturing an image of a scene, said digital camera comprising: a capture section for capturing an image and producing image data; an electronic processing section for processing the image data to determine the presence of one or more faces in the scene and generating face data therefrom; an orientation algorithm associated with the processing section for generating orientation data indicating orientation of the image based on the orientation of at least one of the faces in the image; a storage medium for storing the image data; and recording means associated with the processing section for recording the orientation data with the image data on the storage medium.
Claim 17
Dependent Claim
20 words
The digital camera as claimed in claim 1 wherein the posterior probability function classifier comprises a maximum a posteriori classifier.
Claim 18
Dependent Claim
160 words
A digital camera for capturing an image of a scene and producing image data, said digital camera comprising: an algorithm memory storing an algorithm for determining the presence of one or more faces in the image, said algorithm comprised of a first component and a second component; and an electronic processing section for processing the image data together with the algorithm for determining the presence of one or more faces in the image; the first component of the algorithm comprising a pre-screening pattern recognizer that searches for image windows likely to contain faces, the first component having a first rate of false positives and determining a plurality of face candidates; the second component of the algorithm comprising a posterior probability function classifier, the second component having a second rate of false positives lower than the first rate of false positives, and processing the plurality of face candidates to determine the presence of the one or more faces in the image.
Claim 19
Dependent Claim
160 words
A digital camera for capturing an image of a scene and producing image data, said digital camera comprising: an algorithm memory storing an algorithm for determining the presence of one or more faces in the image, said algorithm comprised of a first component and a second component; and an electronic processing section for processing the image data together with the algorithm for determining the presence of one or more faces in the image; the first component of the algorithm comprising a pre-screening pattern recognizer that searches for image windows likely to contain faces, the first component having a first rate of false positives and determining a plurality of face candidates; the second component of the algorithm comprising a posterior probability function classifier, the second component having a second rate of false positives lower than the first rate of false positives, and processing the plurality of face candidates to determine the presence of the one or more faces in the image.
Claim 20
Dependent Claim
226 words
A digital camera for capturing an image of a scene and producing image data, said digital camera comprising: an algorithm memory storing an algorithm for determining the presence of one or more faces in the image, said algorithm comprised of a first component and a second component; an electronic processing section for processing the image data together with the algorithm for determining the presence of one or more faces in the image, said processing section generating processed image data and face data corresponding to at least one of the location, orientation, scale and pose of at least one of the faces in the image; a storage medium; and an interface for transferring the processed image data and the face data to the storage medium whereby the face data is stored with the processed image data on the storage medium; the first component of the algorithm comprising a pre-screening pattern recognizer that searches for image windows likely to contain faces, the first component having a first rate of false positives and determining a plurality of face candidates; the second component of the algorithm comprising a posterior probability function classifier, the second component having a second rate of false positives lower than the first rate of false positives, and processing the plurality of face candidates to determine the presence of the one or more faces in the image.
Claim 21
Dependent Claim
226 words
A digital camera for capturing an image of a scene and producing image data, said digital camera comprising: an algorithm memory storing an algorithm for determining the presence of one or more faces in the image, said algorithm comprised of a first component and a second component; an electronic processing section for processing the image data together with the algorithm for determining the presence of one or more faces in the image, said processing section generating processed image data and face data corresponding to at least one of the location, orientation, scale and pose of at least one of the faces in the image; a storage medium; and an interface for transferring the processed image data and the face data to the storage medium whereby the face data is stored with the processed image data on the storage medium; the first component of the algorithm comprising a pre-screening pattern recognizer that searches for image windows likely to contain faces, the first component having a first rate of false positives and determining a plurality of face candidates; the second component of the algorithm comprising a posterior probability function classifier, the second component having a second rate of false positives lower than the first rate of false positives, and processing the plurality of face candidates to determine the presence of the one or more faces in the image.
Claim 22
Dependent Claim
193 words
A digital camera for capturing an image of a scene, said digital camera comprising: an image capture section for capturing an image with an image sensor and producing image data; an algorithm memory storing an algorithm for determining the presence of one or more faces in the image, said algorithm comprised of a first component and a second component; and an electronic processing section for processing the image data together with the algorithm for determining the presence of one or more faces in the image and controlling the capture of images by the capture section as a function of the presence of faces in the image; the first component of the algorithm comprising a pre-screening pattern recognizer that searches for image windows likely to contain faces, the first component having a first rate of false positives and determining a plurality of face candidates; the second component of the algorithm comprising a posterior probability function classifier, the second component having a second rate of false positives lower than the first rate of false positives, and processing the plurality of face candidates to determine the presence of the one or more faces in the image.
Claim 23
Dependent Claim
193 words
A digital camera for capturing an image of a scene, said digital camera comprising: an image capture section for capturing an image with an image sensor and producing image data; an algorithm memory storing an algorithm for determining the presence of one or more faces in the image, said algorithm comprised of a first component and a second component; and an electronic processing section for processing the image data together with the algorithm for determining the presence of one or more faces in the image and controlling the capture of images by the capture section as a function of the presence of faces in the image; the first component of the algorithm comprising a pre-screening pattern recognizer that searches for image windows likely to contain faces, the first component having a first rate of false positives and determining a plurality of face candidates; the second component of the algorithm comprising a posterior probability function classifier, the second component having a second rate of false positives lower than the first rate of false positives, and processing the plurality of face candidates to determine the presence of the one or more faces in the image.
Claim 24
Dependent Claim
28 words
The camera as claimed in claim 17 wherein the electronic processing section controls the exposure of the image in relation to the presence of faces in the image.
Claim 25
Dependent Claim
28 words
The camera as claimed in claim 17 wherein the electronic processing section controls the focus of the image in relation to the presence of faces in the image.
Claim 26
Dependent Claim
28 words
The camera as claimed in claim 17 wherein the electronic processing section controls the illumination of the image in relation to the presence of faces in the image.
Claim 27
Dependent Claim
152 words
A digital camera for capturing an image of a scene and producing image data, said digital camera comprising: an algorithm memory storing an algorithm for determining the presence of one or more faces in the image, said algorithm comprised of a first component and a second component; and an electronic processing section for processing the image data together with the algorithm for determining the presence of one or more faces in the image in order to produce processed image data that relates to the presence of faces in the image; the first component of the algorithm determining a plurality of face candidates utilizing a pattern matching technique that identifies image windows likely to contain faces based on color and shape information; the second component of the algorithm processing the plurality of face candidates using a maximum a posteriori classifier to determine the presence of the one or more faces in the image.
Claim 28
Dependent Claim
152 words
A digital camera for capturing an image of a scene and producing image data, said digital camera comprising: an algorithm memory storing an algorithm for determining the presence of one or more faces in the image, said algorithm comprised of a first component and a second component; and an electronic processing section for processing the image data together with the algorithm for determining the presence of one or more faces in the image in order to produce processed image data that relates to the presence of faces in the image; the first component of the algorithm determining a plurality of face candidates utilizing a pattern matching technique that identifies image windows likely to contain faces based on color and shape information; the second component of the algorithm processing the plurality of face candidates using a maximum a posteriori classifier to determine the presence of the one or more faces in the image.
Claim 29
Dependent Claim
39 words
The camera as claimed in claim 21 wherein the electronic processing section is responsive to the location of faces in the image in order to produce processed image data that is color balanced for the faces in the image.
Claim 30
Dependent Claim
41 words
The camera as claimed in claim 21 wherein the electronic processing section is responsive to the location of faces in the image in order to produce processed image data that is corrected for red eye in the faces in the image.
Claim 31
Dependent Claim
55 words
The camera as claimed in claim 21 further including a display device and wherein the electronic processing section is responsive to the location of faces in the image in order to produce processed data that is applied to the display device to identify the location of faces in image data displayed on the display device.
Claim 32
Dependent Claim
38 words
The camera as claimed in claim 21 wherein the electronic processing section is responsive to the location of faces in the image in order to produce processed data that provides composition aids to a photographer using the camera.
Claim 33
Dependent Claim
130 words
A digital camera for capturing an image of a scene and producing image data, said digital camera comprising: an algorithm memory storing a face detection algorithm for determining the presence of one or more faces in the image data and a composition algorithm for suggesting composition adjustments based on certain predetermined composition principles; and an electronic processing section for processing the image data together with the algorithms for determining the presence of one or more faces in the scene and their relation to certain predetermined composition principles, said processing section generating face data corresponding to at least one of the location, orientation, scale and pose of at least one of the faces in the image and composition suggestions corresponding to deviation of the face data from the predetermined composition principles.
Claim 34
Dependent Claim
130 words
A digital camera for capturing an image of a scene and producing image data, said digital camera comprising: an algorithm memory storing a face detection algorithm for determining the presence of one or more faces in the image data and a composition algorithm for suggesting composition adjustments based on certain predetermined composition principles; and an electronic processing section for processing the image data together with the algorithms for determining the presence of one or more faces in the scene and their relation to certain predetermined composition principles, said processing section generating face data corresponding to at least one of the location, orientation, scale and pose of at least one of the faces in the image and composition suggestions corresponding to deviation of the face data from the predetermined composition principles.
Claim 35
Dependent Claim
24 words
The camera as claimed in claim 26 wherein the predetermined composition principle is location of the faces in relation to a rule of thirds.
Claim 36
Dependent Claim
24 words
The camera as claimed in claim 26 wherein the predetermined composition principle is the size of the faces in relation to the overall image.
Claim 37
Dependent Claim
27 words
The camera as claimed in claim 26 wherein the predetermined composition principle is location of the faces so as to prevent occlusion by edges of the frame.
Claim 38
Dependent Claim
25 words
The camera as claimed in claim 26 wherein the predetermined composition principle is variety in location of the faces with respect to a common line.
Claim 39
Dependent Claim
174 words
A hybrid camera for capturing an image of a scene on both an electronic medium and a film medium having a magnetic layer, said hybrid camera comprising: an image capture section for capturing an image with an image sensor and producing image data; means for capturing the image on the film medium; an electronic processing section for processing the image data to determine the presence of one or more faces in the scene; face data means associated with the electronic processing section for generating face data corresponding to at least one of the location, scale and pose of at least one of the faces in the image; means for writing the face data on the magnetic layer of the film medium; and orientation data means associated with the electronic processing section for generating orientation data indicating orientation of the image based on the orientation of at least one of the faces in the image; wherein recording means associated with the processing section records the orientation data on the magnetic layer of the film medium.
Claim 40
Dependent Claim
174 words
A hybrid camera for capturing an image of a scene on both an electronic medium and a film medium having a magnetic layer, said hybrid camera comprising: an image capture section for capturing an image with an image sensor and producing image data; means for capturing the image on the film medium; an electronic processing section for processing the image data to determine the presence of one or more faces in the scene; face data means associated with the electronic processing section for generating face data corresponding to at least one of the location, scale and pose of at least one of the faces in the image; means for writing the face data on the magnetic layer of the film medium; and orientation data means associated with the electronic processing section for generating orientation data indicating orientation of the image based on the orientation of at least one of the faces in the image; wherein recording means associated with the processing section records the orientation data on the magnetic layer of the film medium.
Claim 41
Dependent Claim
39 words
The hybrid camera as claimed in claim 31 further comprising: a storage medium for storing the image data; and recording means associated with the processing section for recording the face data with the image data on the storage medium.
Claim 42
Dependent Claim
24 words
The hybrid camera as claimed in claim 31 wherein the electronic processing section provides an indication that one or more faces have been detected.
Claim 43
Dependent Claim
40 words
The hybrid camera as claimed in claim 33 further comprising a framing device for framing the image, and wherein the electronic processing section provides an indication in the framing device identifying the one or more faces that have been detected.
Claim 44
Dependent Claim
50 words
The hybrid camera as claimed in claim 31 wherein the electronic processing section further includes a face recognition algorithm and a data base of known faces for generating facial identities, and wherein the recording means records the facial identities of known faces on the magnetic layer of the film medium.
Claim 45
Dependent Claim
20 words
The camera as claimed in claim 28 wherein the composition suggestions include moving the camera closer to the main subject.
Claim 46
Dependent Claim
39 words
The hybrid camera as claimed in claim 31 further comprising an exposure control section responsive to the presence of one or more faces for optimally exposing the film medium for at least one of the faces in the scene.
Claim 47
Dependent Claim
40 words
The hybrid camera as claimed in claim 37 further comprising a flash unit, and wherein the exposure control section controls activation of the flash unit in order to optimize exposure for at least one of the faces in the scene.
References Cited (Backward Citations)
US4503508A
Cited
US5086480A
Cited
US5012522A
Cited
JPH03144427A
Cited
US5103254A
Cited
US5719951A
Cited
US5164992A
Cited
US5283644A
Cited
US5430809A
Cited
US5432864A
Cited
US5749000A
Cited
US5432863A
Cited
US5835616A
Cited
US5629752A
Cited
US5870138A
Cited
US5710833A
Cited
US5642431A
Cited
US5781665A
Cited
US5715325A
Cited
US5850470A
Cited
US5687412A
Cited
US6271876B1
Cited
US5986764A
Cited
US6035074A
Cited
US5973734A
Cited
US6597817B1
Cited
US5873007A
Cited
US6608914B1
Cited
US6332033B1
Cited
US6278491B1
Cited
US6263113B1
Cited
US6301440B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2008-09-05 | 2009-03-07 | 2009-09-06 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2012-09-05 | 2013-03-07 | 2013-09-06 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2016-09-05 | 2017-03-07 | 2017-09-06 | $7700.00 | Window Closed / Lapsed |