US5905807A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Apparatus for extracting feature points from a facial image
Assignee: Panasonic Holdings Corp
•
Filing: 1996-09-05
•
Granted: 1999-05-18
•
Expires: 2016-09-05
Abstract
Abstract A facial image picture data is processed by an edge extraction part, which performs edge extraction on the inputted image picture. The processed data is then converted by a binary level conversion part for each preestimated point of facial elements. An image picture arithmetic processing part performs time-to-time arithmetic computation of correlation values between the data of the binary-leveled edged-image picture and the data having been previously stored in the shape data-base part, and issues an output including extracted data of feature points of the facial image picture.
Inventors
- 👤 Yoshiyasu Kado
- 👤 Masamichi Nakagawa
- 👤 Fumio Maehara
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 17:54
CPC Classifications
G; G06; G06T; G06T9/00; A; A61; A61B; A61B5/00; A61B5/117; A61B5/1171; A61B5/1176; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/168; H; H04; H04N; H04N19/00; H04N19/20
Claims Analysis
Total Claims: 14
Claim 1
Independent Claim
280 words
An apparatus for outputting data indicative of matching features of a face with data in a data-base, said apparatus comprising: an image picture inputter for receiving an input image of a face, said image including a plurality of facial feature searching regions each of which corresponds to a respective facial feature of said face; an edge extractor for processing said input image of said face to form an edged-image of said face; a binary level converter for dividing said image into said plurality of facial feature searching regions and subsequently performing a binary level conversion on said edged-image of said face corresponding to a plurality of facial feature points of said face, said binary level converter converting said edged-image of said face into a binary-leveled edged-image of said face; a shape data-base permanently storing a plurality of shape data as a reference data-base for said plurality of facial feature points, said shape data comprising coordinate data and gradient vectors in x,y coordinates; an image picture arithmetic processor for determining an amount of correspondence by computing a correlation value between data of each of said plurality of facial feature points of said binary-leveled edged-image of said face and each corresponding one of said plurality of facial feature points of said shape data stored in said shape data-base; a shape data-base changer for changing copied data of said plurality of shape data copied from said shape data-base; and an outputter for outputting data indicative of said matching features of said face based on said correlation value and said copied data, wherein using both said edge extractor and said binary level converter results in decreased sensitivity of said apparatus to changes in lighting.
Claim 2
Independent Claim
280 words
An apparatus for outputting data indicative of matching features of a face with data in a data-base, said apparatus comprising: an image picture inputter for receiving an input image of a face, said image including a plurality of facial feature searching regions each of which corresponds to a respective facial feature of said face; an edge extractor for processing said input image of said face to form an edged-image of said face; a binary level converter for dividing said image into said plurality of facial feature searching regions and subsequently performing a binary level conversion on said edged-image of said face corresponding to a plurality of facial feature points of said face, said binary level converter converting said edged-image of said face into a binary-leveled edged-image of said face; a shape data-base permanently storing a plurality of shape data as a reference data-base for said plurality of facial feature points, said shape data comprising coordinate data and gradient vectors in x,y coordinates; an image picture arithmetic processor for determining an amount of correspondence by computing a correlation value between data of each of said plurality of facial feature points of said binary-leveled edged-image of said face and each corresponding one of said plurality of facial feature points of said shape data stored in said shape data-base; a shape data-base changer for changing copied data of said plurality of shape data copied from said shape data-base; and an outputter for outputting data indicative of said matching features of said face based on said correlation value and said copied data, wherein using both said edge extractor and said binary level converter results in decreased sensitivity of said apparatus to changes in lighting.
Claim 3
Dependent Claim
47 words
An apparatus in accordance with claim 1, said apparatus further comprising: a facial feature region determiner for determining locations of others of said plurality of facial feature searching regions based on said data output from said outputter with respect to a determination of a first facial feature.
Claim 4
Dependent Claim
37 words
An apparatus in accordance with claim 2, wherein: a region of irises of said face is determined before said facial feature region determiner determines said locations of said others of said plurality of facial feature searching regions.
Claim 5
Dependent Claim
34 words
An apparatus in accordance with claim 2, further comprising a second binary level converter arranged to perform binary level conversion before said processing of said input image of said face by said edge extractor.
Claim 6
Dependent Claim
78 words
An apparatus in accordance with claim 4, when said: second binary level converter is connected to said edge extractor and is arranged to receive an output of said facial feature region determiner, to divide one of said plurality of facial feature searching regions into a plurality of smaller sub-regions, and to determine a binary level conversion threshold value for each of said plurality of smaller sub-regions from a brightness distribution of each of said plurality of smaller sub-regions.
Claim 7
Dependent Claim
60 words
Amended) An apparatus in accordance with claim 1, said apparatus further comprising: an adoption/rejection selector for obtaining expected positions of said plurality of facial features, which obtains and determines an accuracy of positions of said plurality of facial features, and which discards any erroneously extracted facial features prior to processing said input image of said face by said edge extractor.
Claim 8
Dependent Claim
43 words
An apparatus in accordance with claim 1, wherein: said edge extractor includes a computer using a Sobel operator which produces gradient vectors for respective pixels of said image of said face, said gradient vectors having magnitudes and directions indicative of said facial features.
Claim 9
Dependent Claim
37 words
An apparatus in accordance with claim 1, wherein: an arithmetic computation performed by said image picture arithmetic processor is an inner product between compared gradient vectors of said binary-leveled edged-image of said face and respective shape data.
Claim 10
Dependent Claim
39 words
An apparatus in accordance with claim 8, wherein: a location of at least one of said plurality of facial feature searching regions is determined by a location on said image of said face where said correlation value is largest.
Claim 11
Dependent Claim
38 words
An apparatus in accordance with claim 3, wherein: said respective locations of said others of said plurality of facial feature searching regions are determined with reference to a position of said region of said irises of said face.
Claim 12
Dependent Claim
116 words
An apparatus in accordance with claim 1 wherein said shape data-base changer changes said copied data by a method comprising: (1) displacing said coordinate data by ±1 in a direction of said gradient vector, (2) changing said direction of said gradient vector after said step of displacing said coordinate data, so as to match said shape data at said displaced coordinate data, (3) repeating steps (1) and (2) by displacing said coordinate data further by ±1 thereby pursuing an increase in value of said correlation value, and (4) ceasing said repeating step when one of said value of said correlation value no longer increases and said value of said correlation value exceeds a predetermined threshold value.
Claim 13
Dependent Claim
82 words
An apparatus in accordance with claim 1, wherein said shape data comprises: said coordinate data which are defined as: P k =(l k , m k ), where l k , m k , are x, y coordinates of a k-th position at which said shape data is given, respectively, and said gradient vectors are defined as: v k =(v x , v y ), where v x 2 +v y 2 =1 and 1≦k≦n (where n is a number of positions).
Claim 14
Dependent Claim
82 words
An apparatus in accordance with claim 2, wherein said shape data comprises: said coordinate data which are defined as: P k =(l k , m k ), where l k , m k , are x, y coordinates of a k-th position at which said shape data is given, respectively, and said gradient vectors are defined as: v k =(v x , v y ), where v x 2 +v y 2 =1 and 1≦k≦n (where n is a number of positions).
References Cited (Backward Citations)
US3648240A
Cited
US3805238A
Cited
US4055833A
Cited
US4699149A
Cited
US4805223A
Cited
US4724542A
Cited
US5008946A
Cited
US4975969A
Cited
US5012522A
Cited
US5231674A
Cited
US5210797A
Cited
US4993068A
Cited
US5164992A
Cited
US5163094A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-05-17 | 2002-11-16 | 2003-05-18 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-05-17 | 2006-11-16 | 2007-05-18 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-05-17 | 2010-11-16 | 2011-05-18 | $7700.00 | Window Closed / Lapsed |