← Back to Patent Explorer
US5629752A Expired / Lapsed US ⏱️ 0.0 years remaining

Method of determining an exposure amount using optical recognition of facial features

Assignee: Fujifilm Holdings Corp
•
Filing: 1995-10-27
•
Granted: 1997-05-13
•
Expires: 2015-10-27
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract In a method of determining an exposure amount, image data is fetched, and an image is divided into a plurality of regions by binarization or another technique, a shape pattern representing a contour of the head of a human figure is detected, and a face candidate region is set in accordance with the detected pattern. Next, a shape pattern representing a contour of the face of the human figure, a shape pattern representing an internal structure of the face of the human figure, and a shape pattern representing a contour of the body of the human figure are detected respectively. The consistency of a face candidate region is determined consecutively by the detected patterns, and a region having the highest probability of being a region corresponding to the face of the human figure is determined. The above processing is carried out a plurality of times while a threshold for binarization and parameters for controlling the relative fineness of the division of the image are varied. The data on the finally determined facial region is outputted as a result of determination.

Inventors

  • 👤 Naoto Kinjo

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-27 07:09
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G03; G03B; G03B27/00; G03B27/72; G03B27/80

Claims Analysis

Total Claims: 34
Claim 1
Independent Claim 195 words
A method of determining an exposure amount, comprising the steps of: searching a first shape pattern which is present in an original image and is peculiar to a first portion of a human figure; setting a region estimated to correspond to a face of the human figure, in accordance with a size and a direction of the searched first shape pattern and a positional relationship between the face of the human figure and the first portion; determining a region having a high probability of being a region corresponding to the face of the human figure in the original image, by searching whether or not a second shape pattern peculiar to at least one second portion different from the first portion of the human figure is present in a range of search set in accordance with the set size and direction of the first shape pattern in the original image and a positional relationship between the face of the human figure and the second portion; and determining an exposure amount for printing the original image onto a printing material on the basis of at least one of a color and a density of the determined region.
Claim 2
Independent Claim 195 words
A method of determining an exposure amount, comprising the steps of: searching a first shape pattern which is present in an original image and is peculiar to a first portion of a human figure; setting a region estimated to correspond to a face of the human figure, in accordance with a size and a direction of the searched first shape pattern and a positional relationship between the face of the human figure and the first portion; determining a region having a high probability of being a region corresponding to the face of the human figure in the original image, by searching whether or not a second shape pattern peculiar to at least one second portion different from the first portion of the human figure is present in a range of search set in accordance with the set size and direction of the first shape pattern in the original image and a positional relationship between the face of the human figure and the second portion; and determining an exposure amount for printing the original image onto a printing material on the basis of at least one of a color and a density of the determined region.
Claim 3
Dependent Claim 80 words
A method of determining an exposure amount according to claim 1, wherein the first shape pattern and the second shape pattern include at least one of a shape pattern representing a contour of the head of the human figure, a shape pattern representing a contour of the face of the human figure, a shape pattern representing an internal structure of the face of the human figure, and a shape pattern representing a contour of the body of the human figure.
Claim 4
Dependent Claim 60 words
A method of determining an exposure amount according to claim 1, wherein the search of the first shape pattern and the second shape pattern is effected by dividing the original image into a plurality of regions each consisting of a plurality of pixels whose densities or colors are identical or similar, and by using contours of the plurality of regions.
Claim 5
Dependent Claim 53 words
A method of determining an exposure amount according to claim 1, wherein the search of the first shape pattern and the second shape pattern is effected by detecting an edge which is present in the original image, by determining a center line of the detected edge, and by using the determined center line.
Claim 6
Dependent Claim 49 words
A method of determining an exposure amount according to claim 1, wherein, prior to the search of the first shape pattern, a region having a low probability of corresponding to the human figure in the original image is excluded from a subject of search of the first shape pattern.
Claim 7
Dependent Claim 122 words
A method of determining an exposure amount according to claim 2, wherein the search of the shape pattern representing the contour of the head of the human figure as the first shape pattern or the second shape pattern is effected by: dividing the original image into a plurality of regions each consisting of a plurality of pixels whose densities or colors are identical or similar; detecting at least one concave or convex portion on the basis of contours of the plurality of regions; determining whether or not the at least one concave or convex portion detected corresponds to the contour of the head of the human figure, on the basis of characteristic quantities of the at least one concave or convex portion.
Claim 8
Dependent Claim 115 words
A method of determining an exposure amount according to claim 2, wherein the search of the shape pattern representing the contour of the head of the human figure as the first shape pattern or the second shape pattern is effected by: detecting an edge which is present in the original image; determining a center line of the detected edge; detecting at least one concave or convex portion on the basis of the determined center line; and determining whether or not the at least one concave or convex portion detected corresponds to the contour of the head of the human figure, on the basis of characteristic quantities of the at least one concave or convex portion.
Claim 9
Dependent Claim 132 words
A method of determining an exposure amount according to claim 2, wherein the search of the shape pattern representing the contour of the face of the human figure as the first shape pattern or the second shape pattern is effected by: dividing the original image into a plurality of regions each consisting of a plurality of pixels whose densities or colors are identical or similar; detecting at least two concave and/or convex portions on the basis of contours of the plurality of regions; and determining whether or not the at least two concave and/or convex portions detected correspond to the contour of the face of the human figure according to a degree of axial symmetry, on the basis of relationships of characteristic quantities of the at least two concave and/or convex portions.
Claim 10
Dependent Claim 122 words
A method of determining an exposure amount according to claim 2, wherein the search of the shape pattern representing the contour of the face of the human figure as the first shape pattern or the second shape pattern is effected by: detecting an edge which is present in the original image; determining a center line of the detected edge; detecting at least two concave and/or convex portions on the basis of the determined center line; and determining whether or not the at least two concave and/or convex portions detected corresponds to the contour of the face of the human figure according to a degree of axial symmetry, on the basis of characteristic quantities of the at least two concave and/or convex portions.
Claim 11
Dependent Claim 161 words
A method of determining an exposure amount according to claim 2, wherein the search of a shape pattern representing a pair of eyes among shape patterns representing the contour of the internal structure of the human figure as the first shape pattern or the second shape pattern is effected by: dividing the original image into a plurality of regions each consisting of a plurality of pixels whose densities or colors are identical or similar; extracting a plurality of elliptical regions from among regions divided by contours of the plurality of regions; detecting a pair of elliptical regions whose similarity is greater than or equal to a predetermined value, on the basis of matching processing using characteristic quantities of the detected plurality of elliptical regions; and determining whether or not the pair of elliptical regions corresponds to the pair of eyes of the face of the human figure, according to the degree of axial symmetry of the detected pair of elliptical regions.
Claim 12
Dependent Claim 153 words
A method of determining an exposure amount according to claim 2, wherein the search of a shape pattern representing a pair of eyes among shape patterns representing the contour of the internal structure of the human figure as the first shape pattern or the second shape pattern is effected by: detecting an edge which is present in the original image; determining a center line of the detected edge; extracting a plurality of elliptical regions from among regions divided by the determined center line; detecting a pair of elliptical regions whose similarity is greater than or equal to a predetermined value, on the basis of matching processing using characteristic quantities of the detected plurality of elliptical regions; and determining whether or not the pair of elliptical regions corresponds to the pair of eyes of the face of the human figure, according to the degree of axial symmetry of the detected pair of elliptical regions.
Claim 13
Dependent Claim 176 words
A method of determining an exposure amount according to claim 2, wherein the search of the shape pattern representing the contour of the body of the human figure as the first shape pattern or the second shape pattern is effected by: dividing the original image into a plurality of regions each consisting of a plurality of pixels whose densities or colors are identical or similar; detecting at least two concave and/or convex portions on the basis of contours of the plurality of regions; detecting a plurality of sets of concave and/or convex portions corresponding to a contour continuing from the neck to each shoulder of the human figure, and a contour from each shoulder to an arm portion or to a lower portion of the body, on the basis of relationships of characteristic quantities of the at least two concave and/or convex portions; and determining whether the at least two concave and/or convex portions detected corresponds to the contour of the body of the human figure according to a degree of axial symmetry of the sets.
Claim 14
Dependent Claim 168 words
A method of determining an exposure amount according to claim 2, wherein the search of the shape pattern representing the contour of the body of the human figure as the first shape pattern or the second shape pattern is effected by: detecting an edge which is present in the original image; determining a center line of the detected edge; detecting at least two concave and/or convex portions on the basis of the determined center line; detecting a plurality of sets of concave and/or convex portions corresponding to a contour continuing from the neck to each shoulder of the human figure, and a contour from each shoulder to an arm portion or to a lower portion of the body, on the basis of relationships of characteristic quantities of the at least two concave and/or convex portions; and determining whether the at least two concave and/or convex portions detected corresponds to the contour of the body of the human figure according to a degree of axial symmetry of the sets.
Claim 15
Dependent Claim 184 words
A method of determining an exposure amount according to claim 5, wherein, among regions obtained by dividing the original image into a plurality of regions each consisting of a plurality of pixels whose densities or colors are identical or similar, the following regions are excluded as regions having a low probability of corresponding to the human figure in the original image: a region in which the ratio of a linear portion occupied in the contour of the region is greater than or equal to a predetermined value; a region whose axial symmetry is less than or equal to a predetermined value; a region in which the number of concave and/or convex portions is greater than or equal to a predetermined value; a region whose ratio of contact with an outer edge of the image is greater than or equal to a predetermined value; a region whose contrast in the density within the region is less than or equal to a predetermined value; and a region whose density changes with a predetermined pattern or whose density shows a repetition of a predetermined pattern of change.
Claim 16
Dependent Claim 191 words
A method of determining an exposure amount according to claim 5, wherein, among regions obtained by detecting an edge which is present in the original image, by determining a center line of the detected edge, and by being divided by the determined center line of the edge, the following regions are excluded as regions having a low probability of corresponding to the human figure in the original image: a region in which the ratio of a linear portion occupied in the contour of the region is greater than or equal to a predetermined value; a region whose axial symmetry is less than or equal to a predetermined value; a region in which the number of concave and/or convex portions is greater than or equal to a predetermined value; a region whose ratio of contact with an outer edge of the image is greater than or equal to a predetermined value; a region whose contrast in the density within the region is less than or equal to a predetermined value; and a region whose density changes with a predetermined pattern or whose density shows a repetition of a predetermined pattern of change.
Claim 17
Independent Claim 194 words
A method of determining an exposure amount, comprising the steps of: searching a plurality of kinds of shape patterns which are present in an original image and are peculiar to particular portions of a human figure; setting a plurality of regions estimated to correspond to a face of the human figure, in accordance with a size and a direction of each of the searched shape patterns and a positional relationship between the face of the human figure and each of the particular portions; weighting the set regions by using as subjects of search the plurality of shape patterns peculiar to the particular portions of the human figure; determining a region having a highest probability of being a region corresponding to the face of the human figure in the original image, on the basis of ranges of the plurality of regions set as regions to be estimated to correspond to the face of the human figure and weighting factors imparted to the respective regions; and determining an exposure amount for printing the original image onto a printing material on the basis of at least one of a color and a density of the determined region.
Claim 18
Independent Claim 194 words
A method of determining an exposure amount, comprising the steps of: searching a plurality of kinds of shape patterns which are present in an original image and are peculiar to particular portions of a human figure; setting a plurality of regions estimated to correspond to a face of the human figure, in accordance with a size and a direction of each of the searched shape patterns and a positional relationship between the face of the human figure and each of the particular portions; weighting the set regions by using as subjects of search the plurality of shape patterns peculiar to the particular portions of the human figure; determining a region having a highest probability of being a region corresponding to the face of the human figure in the original image, on the basis of ranges of the plurality of regions set as regions to be estimated to correspond to the face of the human figure and weighting factors imparted to the respective regions; and determining an exposure amount for printing the original image onto a printing material on the basis of at least one of a color and a density of the determined region.
Claim 19
Dependent Claim 79 words
A method of determining an exposure amount according to claim 16, wherein the shape patterns peculiar to the particular portions of the human figure include a shape pattern representing a contour of the head of the human figure, a shape pattern representing a contour of the face of the human figure, a shape pattern representing an internal structure of the face of the human figure, and a shape pattern representing a contour of the body of the human figure.
Claim 20
Dependent Claim 56 words
A method of determining an exposure amount according to claim 16, wherein the search of each of the shape patterns is effected by dividing the original image into a plurality of regions each consisting of a plurality of pixels whose densities or colors are identical or similar, and by using contours of the plurality of regions.
Claim 21
Dependent Claim 49 words
A method of determining an exposure amount according to claim 16, wherein the search of each of the shape patterns is effected by detecting an edge which is present in the original image, by determining a center line of the detected edge, and by using the determined center line.
Claim 22
Dependent Claim 70 words
A method of determining an exposure amount according to claim 16, wherein a weighting factor with a positive sign is imparted to the set region estimated to correspond to the face of the human figure, a region having a low probability of corresponding to the face of the human figure in the original image is determined, and a weighting factor with a negative sign is imparted to the determined region.
Claim 23
Dependent Claim 116 words
A method of determining an exposure amount according to claim 17, wherein the search of the shape pattern representing the contour of the head of the human figure as the shape pattern is effected by: dividing the original image into a plurality of regions each consisting of a plurality of pixels whose densities or colors are identical or similar; detecting at least one concave or convex portion on the basis of contours of the plurality of regions; determining whether or not the at least one concave or convex portion detected corresponds to the contour of the head of the human figure, on the basis of characteristic quantities of the at least one concave or convex portion.
Claim 24
Dependent Claim 105 words
A method of determining an exposure amount according to claim 17, wherein the search of the shape pattern representing the contour of the head of the human figure is effected by: detecting an edge which is present in the original image; determining a center line of the detected edge; detecting at least one concave or convex portion on the basis of the determined center line; and determining whether or not the at least one concave or convex portion detected corresponds to the contour of the head of the human figure, on the basis of characteristic quantities of the at least one concave or convex portion.
Claim 25
Dependent Claim 122 words
A method of determining an exposure amount according to claim 17, wherein the search of the shape pattern representing the contour of the face of the human figure is effected by: dividing the original image into a plurality of regions each consisting of a plurality of pixels whose densities or colors are identical or similar; detecting at least two concave and/or convex portions on the basis of contours of the plurality of regions; and determining whether or not the at least two concave and/or convex portions detected correspond to the contour of the face of the human figure according to a degree of axial symmetry, on the basis of relationships of characteristic quantities of the at least two concave and/or convex portions.
Claim 26
Dependent Claim 112 words
A method of determining an exposure amount according to claim 17, wherein the search of the shape pattern representing the contour of the face of the human figure is effected by: detecting an edge which is present in the original image; determining a center line of the detected edge; detecting at least two concave and/or convex portions on the basis of the determined center line; and determining whether or not the at least two concave and/or convex portions detected corresponds to the contour of the face of the human figure according to a degree of axial symmetry, on the basis of characteristic quantities of the at least two concave and/or convex portions.
Claim 27
Dependent Claim 151 words
A method of determining an exposure amount according to claim 17, wherein the search of a shape pattern representing a pair of eyes among shape patterns representing the contour of the internal structure of the human figure is effected by: dividing the original image into a plurality of regions each consisting of a plurality of pixels whose densities or colors are identical or similar; extracting a plurality of elliptical regions from among regions divided by contours of the plurality of regions; detecting a pair of elliptical regions whose similarity is greater than or equal to a predetermined value, on the basis of matching processing using characteristic quantities of the detected plurality of elliptical regions; and determining whether or not the pair of elliptical regions corresponds to the pair of eyes of the face of the human figure, according to the degree of axial symmetry of the detected pair of elliptical regions.
Claim 28
Dependent Claim 143 words
A method of determining an exposure amount according to claim 17, wherein the search of a shape pattern representing a pair of eyes among shape patterns representing the contour of the internal structure of the human figure is effected by: detecting an edge which is present in the original image; determining a center line of the detected edge; extracting a plurality of elliptical regions from among regions divided by the determined center line; detecting a pair of elliptical regions whose similarity is greater than or equal to a predetermined value, on the basis of matching processing using characteristic quantities of the detected plurality of elliptical regions; and determining whether or not the pair of elliptical regions corresponds to the pair of eyes of the face of the human figure, according to the degree of axial symmetry of the detected pair of elliptical regions.
Claim 29
Dependent Claim 166 words
A method of determining an exposure amount according to claim 17, wherein the search of the shape pattern representing the contour of the body of the human figure is effected by: dividing the original image into a plurality of regions each consisting of a plurality of pixels whose densities or colors are identical or similar; detecting at least two concave and/or convex portions on the basis of contours of the plurality of regions; detecting a plurality of sets of concave and/or convex portions corresponding to a contour continuing from the neck to each shoulder of the human figure, and a contour from each shoulder to an arm portion or to a lower portion of the body, on the basis of relationships of characteristic quantities of the at least two concave and/or convex portions; and determining whether the at least two concave and/or convex portions detected corresponds to the contour of the body of the human figure according to a degree of axial symmetry of the sets.
Claim 30
Dependent Claim 158 words
A method of determining an exposure amount according to claim 17, wherein the search of the shape pattern representing the contour of the body of the human figure is effected by: detecting an edge which is present in the original image; determining a center line of the detected edge; detecting at least two concave and/or convex portions on the basis of the determined center line; detecting a plurality of sets of concave and/or convex portions corresponding to a contour continuing from the neck to each shoulder of the human figure, and a contour from each shoulder to an arm portion or to a lower portion of the body, on the basis of relationships of characteristic quantities of the at least two concave and/or convex portions; and determining whether the at least two concave and/or convex portions detected corresponds to the contour of the body of the human figure according to a degree of axial symmetry of the sets.
Claim 31
Independent Claim 225 words
A method of extracting a figure, comprising the steps of: setting in advance a plurality of partial shape patterns on the basis of a plurality of characteristic partial shapes constituting a figure subject to extraction; effecting for each of the plurality of partial shape patterns the searching of the partial shape pattern which is present in an image and the setting of a candidate region in which a particular portion or the whole of the figure subject to extraction is estimated to be present in the image, in accordance with a size and a direction of the searched partial shape pattern and a position of the partial shape represented by the partial shape pattern in the figure subject to extraction; determining for each of the set candidate regions the consistency as a region in which the particular portion or the whole of the figure subject to extraction is present, on the basis of a relationship with each of the detected partial shape patterns; determining a candidate region having a high probability of the particular portion or the whole of the figure subject to extraction being present, on the basis of the consistency determined for each of the candidate regions; and extracting the candidate region determined to have the high probability of the particular portion or the whole of the figure subject to extraction being present.
Claim 32
Independent Claim 225 words
A method of extracting a figure, comprising the steps of: setting in advance a plurality of partial shape patterns on the basis of a plurality of characteristic partial shapes constituting a figure subject to extraction; effecting for each of the plurality of partial shape patterns the searching of the partial shape pattern which is present in an image and the setting of a candidate region in which a particular portion or the whole of the figure subject to extraction is estimated to be present in the image, in accordance with a size and a direction of the searched partial shape pattern and a position of the partial shape represented by the partial shape pattern in the figure subject to extraction; determining for each of the set candidate regions the consistency as a region in which the particular portion or the whole of the figure subject to extraction is present, on the basis of a relationship with each of the detected partial shape patterns; determining a candidate region having a high probability of the particular portion or the whole of the figure subject to extraction being present, on the basis of the consistency determined for each of the candidate regions; and extracting the candidate region determined to have the high probability of the particular portion or the whole of the figure subject to extraction being present.
Claim 33
Dependent Claim 258 words
A method of extracting a figure according to claim 29, wherein states of the figure subject to extraction in the image are classified in advance into a plurality of states; a plurality of kinds of parameters are set in advance for each of the plurality of partial shape patterns in correspondence with respective ones of the plurality of classified states as parameters defining search conditions at the time of searching the partial shape patterns; by using each of the plurality of kinds of parameters corresponding to the plurality of states, processing is effected for performing the search of a partial shape pattern and the setting of a candidate region for each of the plurality of partial shape patterns, for determining consistency for each of the set candidate regions, and for determining and extracting a candidate region having a high probability of the particular portion or the whole of the figure subject to extraction being present; or if it is determined that there is no candidate region having the high probability of the particular portion or the whole of the figure subject to extraction being present as a result of effecting the processing by using a parameter corresponding to a predetermined one of the plurality of states, the processing is repeated by using another one of the parameters corresponding to a state different from the predetermined state, and if is determined that there is a candidate region having the high probability of the particular portion or the whole of the figure subject to extraction being present, the processing ends.
Claim 34
Dependent Claim 62 words
A method of extracting a figure according to claim 30, wherein the states of the figure subject to extraction in the image include at least one of the size of the figure subject to extraction in the image, the direction of the figure subject to extraction in the image, and the direction of an object represented by the figure subject to extraction.

References Cited (Backward Citations)

US3652991A Cited
US4055833A Cited
US4754487A Cited
JPS6380242A Cited
US5012522A Cited
US5029312A Cited
JPH04346332A Cited
US5278921A Cited
US5410609A Cited
US5337164A Cited
US5563960A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2000-05-12 2000-11-11 2001-05-13 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2004-05-12 2004-11-11 2005-05-13 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2008-05-12 2008-11-11 2009-05-13 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag