US5905563A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Blink detection face image processing apparatus utilizing retinal reflection image
Assignee: Mitsubishi Electric Corp
•
Filing: 1998-01-16
•
Granted: 1999-05-18
•
Expires: 2018-01-16
Abstract
Abstract A face image processing apparatus is adapted to extract a retinal reflection image accurately and decide the opened and closed states of eyes correctly, regardless of reflection images of eyeglasses, which exist around the retinal reflection image. The face image processing apparatus includes a lighting unit 11 for irradiating a face of a person 1 to be detected, a photographing unit 10 for photographing a face image of the detected person 1, a binarization unit 21 for binarizing a variable-density (light and shade) image, a feature extracting unit 23 for extracting binarized white pixel regions, and an eye-state decision unit 24 for deciding the eye states of the detected person 1. The feature extracting unit 23 sets the most of entire white pixel regions as the retinal reflection image candidate regions, distinguishes and extracts the retinal reflection images and the reflection images according to an attribute of a previous screen by a correlation of the present screen candidates and the previous screen candidates, whereby a false detection of the reflection images can be prevented. At the same time, the feature extracting unit 23 creates the retinal reflection image candidates according to the relative positional relation of the left and right eyes, thereby extracting the retinal reflection images accurately through complementation of these two extractions, regardless of the reflection images such as the eye glasses which might exist around the retinal reflection images.
Inventors
- 👤 Takayuki Yamamoto
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-06 17:19
CPC Classifications
A; A61; A61B; A61B3/00; A61B3/10; A61B3/113; A61B3/12; G; G06; G06V; G06V40/00; G06V40/10; G06V40/18
Claims Analysis
Total Claims: 11
Claim 1
Independent Claim
170 words
A face image processing apparatus comprising: a retinal reflection image creation optical means for creating retinal reflection images in eye balls of a person; an image input means for inputting a face image of said person; a binarization means for binarizing a light and shade image obtained by said image input means; a retinal reflection image candidate creation means for defining retinal reflection image candidate regions in a binarized image; a retinal reflection image region extraction means for extracting a retinal reflection image region from a group of said retinal reflection image candidate regions; and an eye-state decision means for determining whether an eye is in an opened or a closed state according to said retinal reflection image region extracted by said retinal reflection image region extraction means; wherein, said retinal reflection image region extraction means comprises a retinal reflection image candidate region correlation extraction means for correlating a retinal reflection image candidate region of a present time with a retinal reflection image candidate region of a predetermined previous time.
Claim 2
Dependent Claim
170 words
A face image processing apparatus comprising: a retinal reflection image creation optical means for creating retinal reflection images in eye balls of a person; an image input means for inputting a face image of said person; a binarization means for binarizing a light and shade image obtained by said image input means; a retinal reflection image candidate creation means for defining retinal reflection image candidate regions in a binarized image; a retinal reflection image region extraction means for extracting a retinal reflection image region from a group of said retinal reflection image candidate regions; and an eye-state decision means for determining whether an eye is in an opened or a closed state according to said retinal reflection image region extracted by said retinal reflection image region extraction means; wherein, said retinal reflection image region extraction means comprises a retinal reflection image candidate region correlation extraction means for correlating a retinal reflection image candidate region of a present time with a retinal reflection image candidate region of a predetermined previous time.
Claim 3
Dependent Claim
37 words
A face image processing apparatus according to claim 1, wherein said retinal reflection image candidate creation means comprises a prohibiting region setting means for preventing a creation of a retinal reflection image candidate within a binarized image.
Claim 4
Dependent Claim
55 words
A face image processing apparatus according to claim 1, wherein said retinal reflection image candidate creation means comprises a left and right retinal reflection images simultaneous search region setting means for setting a region, for which a retinal reflection image candidate creation is implemented, to a range including the left and right retinal reflection images.
Claim 5
Dependent Claim
40 words
A face image processing apparatus according to claim 1, wherein said retinal reflection image candidate creation means comprises a retinal reflection image candidate region separation means for separating said retinal reflection image candidate regions neighboring or contacting with each other.
Claim 6
Dependent Claim
77 words
A face image processing apparatus according to claim 1, wherein said retinal reflection image candidate region correlation extraction means comprises a retinal reflection image candidate region correlation overlap selection means which selects, if a plurality of retinal reflection image candidate regions of the present time are correlated in an overlapping manner with the same retinal reflection image candidate regions of the predetermined previous time, any one of said retinal reflection image candidate regions of the present time.
Claim 7
Dependent Claim
89 words
A face image processing apparatus according to claim 5, wherein said retinal reflection image candidate region correlation overlap selection means comprises a retinal reflection image candidate region conflict exclusion restoration means for renewing and correlating the retinal reflection image candidate regions of the present time, which have been excluded from the correlation with the same retinal reflection image candidate regions of the predetermined previous time effected by said retinal reflection image candidate region correlation overlap selection means, with other retinal reflection image candidate regions of the predetermined previous time.
Claim 8
Dependent Claim
76 words
A face image processing apparatus according to claim 1, wherein said retinal reflection image candidate region extraction means comprises a retinal reflection image decision means for evaluating the retinal reflection image candidate regions which are being extracted as the retinal reflection image at the present time, and for abolishing the retinal reflection image candidate regions which are being extracted as the retinal reflection image at the present time, in based upon a result of the evaluation.
Claim 9
Dependent Claim
57 words
A face image processing apparatus according to claim 7, wherein said retinal reflection image decision means further comprises a non-retinal reflection image region extraction means for continuously extracting, independent of the retinal reflection image regions, the retinal reflection image candidate regions which have been abolished as the non-retinal reflection images by said retinal reflection image decision means.
Claim 10
Dependent Claim
92 words
A face image processing apparatus according to claim 1, wherein said retinal reflection image extraction means comprises: a retinal reflection image relative position relation extraction means for extracting, to the left and right simultaneously, the retinal reflection image candidate regions of the present time as the left and right retinal reflection images; and a retinal reflection image region selection means for selecting one of two kids of retinal reflection image regions extracted by said retinal reflection image canadidate region correlation extraction means and said retinal reflection image relative position relation extraction means.
Claim 11
Dependent Claim
35 words
A face image processing apparatus according to claim 1, wherein said binarization means comprises a binarized threshold value control means for controlling a binarized threshold value corresponding to a size of a retinal reflection image.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-05-17 | 2002-11-16 | 2003-05-18 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-05-17 | 2006-11-16 | 2007-05-18 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-05-17 | 2010-11-16 | 2011-05-18 | $7700.00 | Window Closed / Lapsed |