US6332033B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
System for detecting skin-tone regions within an image
Assignee: Sharp Corp
•
Filing: 2000-08-14
•
Granted: 2001-12-18
•
Expires: 2020-08-14
Abstract
Abstract A system detects a face within an image by receiving the image which includes a plurality of pixels, where a plurality of the pixels of the image is represented by respective groups of at least three values. The image is filtered by transforming a plurality of the respective groups of the at least three values to respective groups of less than three values, where the respective groups of the less than three values has less dependency on brightness than the respective groups of the at least three values. Regions of the image representative of skin-tones are determined based on the filtering. A first distribution of the regions of the image representative of the skin-tones in a first direction is calculated. A second distribution of the regions of the image representative of the skin-tones in a second direction is calculated, where the first direction and the second direction are different. The face within the image is located based on the first distribution and the second distribution. The estimated face location may also be used for tracking the face between frames of a video.
Inventors
- 👤 Richard Qian
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:42
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/90; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06V40/162; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/10024; G06T2207/30; G06T2207/30196; G06T2207/30201
Claims Analysis
Total Claims: 76
Claim 1
Independent Claim
199 words
A method of detecting a skin-tone image comprising the steps of: (a) receiving said image including a plurality of pixels, where a plurality of said pixels of said image is represented by respective groups of at least three values; (b) filtering said image by transforming a plurality of said respective groups of said at least three values, where said respective groups of said less than three values has less dependency on brightness than said respective groups of said at least three values; (c) determining regions of aid image representative of skin-tones based on said filtering of step (b); (d) calculating a first distribution of said regions of said image representative of said skin-tones in a first direction; (e) calculating a second distribution of said regions of said image representative of said skin-tones in a second direction, where said first direction and said second direction are different, the alignment of said first direction does not change based on the color distribution of said image, and the alignment of said second direction does not change based on the color distribution of said image; and (f) locating said skin-tone region within said image based on said first distribution and said second distribution.
Claim 2
Independent Claim
199 words
A method of detecting a skin-tone image comprising the steps of: (a) receiving said image including a plurality of pixels, where a plurality of said pixels of said image is represented by respective groups of at least three values; (b) filtering said image by transforming a plurality of said respective groups of said at least three values, where said respective groups of said less than three values has less dependency on brightness than said respective groups of said at least three values; (c) determining regions of aid image representative of skin-tones based on said filtering of step (b); (d) calculating a first distribution of said regions of said image representative of said skin-tones in a first direction; (e) calculating a second distribution of said regions of said image representative of said skin-tones in a second direction, where said first direction and said second direction are different, the alignment of said first direction does not change based on the color distribution of said image, and the alignment of said second direction does not change based on the color distribution of said image; and (f) locating said skin-tone region within said image based on said first distribution and said second distribution.
Claim 3
Dependent Claim
15 words
The method of claim 1 where said image includes from a video containing multiple images.
Claim 4
Dependent Claim
12 words
The method of claim 1 where said image includes a human face.
Claim 5
Dependent Claim
22 words
The method of claim 1 where said at least three values includes a red value, a green value, and a blue value.
Claim 6
Dependent Claim
62 words
The method of claim 4 where said respective groups of less than three values includes, a r value defined by said red value divided by the summation of said red value, said green value, and said blue value, and a g value defined by said green value divided by the summation of said red value, said green value, and said blue value.
Claim 7
Dependent Claim
19 words
The method of claim 1 wherein at least one of said regions is an individual pixel of said image.
Claim 8
Dependent Claim
17 words
The method of claim 1 wherein said determining of step (c) is based on a polygonal shape.
Claim 9
Dependent Claim
16 words
The method of claim 1 wherein said determining of step (c) is based on a circle.
Claim 10
Dependent Claim
20 words
The method of claim 1 wherein at least one of said first distribution and said second distribution is a histogram.
Claim 11
Dependent Claim
13 words
The method of claim 1 wherein said first distribution is in a x-direction.
Claim 12
Dependent Claim
13 words
The method of claim 10 wherein said second distribution is in a y-direction.
Claim 13
Dependent Claim
17 words
The method of claim 11 wherein said first distribution and said second distribution are in orthogonal directions.
Claim 14
Dependent Claim
18 words
The method of claim 1 wherein said first distribution and said second distribution are independent of each other.
Claim 15
Dependent Claim
59 words
The method of claim 1 further comprising the steps of: (a) calculating a first generally central location of said first distribution; (b) calculating a first generally central location of said second distribution; and (c) locating said skin-tone region based on said first generally central location of said first distribution and said first generally central location of said second distribution.
Claim 16
Dependent Claim
32 words
The method of claim 14 wherein at least one of said first generally central location of said first distribution and said first generally central location of said second distribution is a mean.
Claim 17
Dependent Claim
28 words
The method of claim 14 wherein the size of said skin-tone region is based on the variance of said first distribution and the variance of said second distribution.
Claim 18
Dependent Claim
14 words
The method of claim 1 wherein said skin-tone region is tracked between subsequent frames.
Claim 19
Dependent Claim
18 words
The method of claim 17 wherein jitter movement of said skin-tone region is reduced between said subsequent frames.
Claim 20
Independent Claim
194 words
A method of detecting a skin-tone region within an image comprising the steps of: (a) receiving said image including a plurality of pixels, where a plurality of said pixels of said image is represented by respective groups of at least three values; (b) filtering said image by transforming a plurality of said respective groups of said at least three values in said first color space to respective groups of less than three values in a second color space where said respective groups of said less than three values has less dependency on brightness than said respective groups of said at least three values; (c) determining regions of said image representative of skin-tones based on said filtering of step (b); (d) calculating a first distribution of said regions of said image representative of said skin-tones in a first direction in said first color space; (e) calculating a second distribution of said regions of said image representative of said skin-tones in a second direction in said first color space, where said first direction and second direction are different; and (f) locating said skin-tones region within said image based on said first distribution and said second distribution.
Claim 21
Independent Claim
194 words
A method of detecting a skin-tone region within an image comprising the steps of: (a) receiving said image including a plurality of pixels, where a plurality of said pixels of said image is represented by respective groups of at least three values; (b) filtering said image by transforming a plurality of said respective groups of said at least three values in said first color space to respective groups of less than three values in a second color space where said respective groups of said less than three values has less dependency on brightness than said respective groups of said at least three values; (c) determining regions of said image representative of skin-tones based on said filtering of step (b); (d) calculating a first distribution of said regions of said image representative of said skin-tones in a first direction in said first color space; (e) calculating a second distribution of said regions of said image representative of said skin-tones in a second direction in said first color space, where said first direction and second direction are different; and (f) locating said skin-tones region within said image based on said first distribution and said second distribution.
Claim 22
Dependent Claim
15 words
The method of claim 19 where said image includes from a video containing multiple images.
Claim 23
Dependent Claim
12 words
The method of claim 19 where said image includes a human face.
Claim 24
Dependent Claim
20 words
The method of claim 19 where said first and second direction are independent of the color distribution of said image.
Claim 25
Dependent Claim
15 words
The method of claim 19 where said first and second directions are temporarily the same.
Claim 26
Dependent Claim
19 words
The method of claim 19 wherein at least one of said regions is an individual pixel of said image.
Claim 27
Dependent Claim
17 words
The method of claim 19 wherein said determining of step (c) is based on a polygonal shape.
Claim 28
Dependent Claim
16 words
The method of claim 19 wherein said determining of step (c) is based on a circle.
Claim 29
Dependent Claim
20 words
The method of claim 19 wherein at least one of said first distribution and said second distribution is a histogram.
Claim 30
Dependent Claim
13 words
The method of claim 19 wherein said first distribution is in a x-direction.
Claim 31
Dependent Claim
13 words
The method of claim 28 wherein said second distribution is in a y-direction.
Claim 32
Dependent Claim
17 words
The method of claim 29 wherein said first distribution and said second distribution are in orthogonal directions.
Claim 33
Dependent Claim
18 words
The method of claim 19 wherein said first distribution and said second distribution are independent of each other.
Claim 34
Dependent Claim
59 words
The method of claim 19 further comprising the steps of: (a) calculating a first generally central location of said first distribution; (b) calculating a first generally central location of said second distribution; and (c) locating said skin-tone region based on said first generally central location of said first distribution and said first generally central location of said second distribution.
Claim 35
Dependent Claim
32 words
The method of claim 32 wherein at least one of said first generally central location of said first distribution and said first generally central location of said second distribution is a mean.
Claim 36
Dependent Claim
28 words
The method of claim 32 wherein the size of said skin-tone region is based on the variance of said first distribution and the variance of said second distribution.
Claim 37
Dependent Claim
14 words
The method of claim 19 wherein said skin-tone region is tracked between subsequent frames.
Claim 38
Dependent Claim
18 words
The method of claim 35 wherein jitter movement of said skin-tone region is reduced between said subsequent frames.
Claim 39
Independent Claim
182 words
A method of detecting a skin-tone region within an image comprising the steps of: (a) receiving said image including a plurality of pixels of said image is represented by respective groups of at last three values; (b) filtering said image by transforming a plurality of said respective groups of said at least three values to respective groups of less than three values, where said respective groups of said less than three values has less dependency on brightness than said respective groups of said at least three values; (c) determining regions of said image representative of skin-tones based on said filtering of step (b) and based on at least one of a polygonal shape and a circle; (d) calculating a first distribution of said regions of said image representative of said skin-tones in a first direction; (e) calculating a second distribution of said regions of said image representative of said skin-tones in a second direction, where said first direction and said second direction are different; and (f) locating said skin-tone region within said image based on said first distribution and said second distribution.
Claim 40
Independent Claim
182 words
A method of detecting a skin-tone region within an image comprising the steps of: (a) receiving said image including a plurality of pixels of said image is represented by respective groups of at last three values; (b) filtering said image by transforming a plurality of said respective groups of said at least three values to respective groups of less than three values, where said respective groups of said less than three values has less dependency on brightness than said respective groups of said at least three values; (c) determining regions of said image representative of skin-tones based on said filtering of step (b) and based on at least one of a polygonal shape and a circle; (d) calculating a first distribution of said regions of said image representative of said skin-tones in a first direction; (e) calculating a second distribution of said regions of said image representative of said skin-tones in a second direction, where said first direction and said second direction are different; and (f) locating said skin-tone region within said image based on said first distribution and said second distribution.
Claim 41
Dependent Claim
15 words
The method of claim 37 where said image includes from a video containing multiple images.
Claim 42
Dependent Claim
12 words
The method of claim 37 where said image includes a human face.
Claim 43
Dependent Claim
22 words
The method of claim 37 where said at least three values includes a red value, a green value, and a blue value.
Claim 44
Dependent Claim
62 words
The method of claim 40 where said respective groups of less than three values includes, a r value defined by said red value divided by the summation of said red value, said green value, and said blue value, and a g value defined by said green value divided by the summation of said red value, said green value, and said blue value.
Claim 45
Dependent Claim
19 words
The method of claim 37 wherein at least one of said regions is an individual pixel of said image.
Claim 46
Dependent Claim
17 words
The method of claim 37 wherein said determining of step (c) is based on a polygonal shape.
Claim 47
Dependent Claim
16 words
The method of claim 37 wherein said determining of step (c) is based on a circle.
Claim 48
Dependent Claim
20 words
The method of claim 37 wherein at least one of said first distribution and said second distribution is a histogram.
Claim 49
Dependent Claim
13 words
The method of claim 37 wherein said first distribution is in a x-direction.
Claim 50
Dependent Claim
13 words
The method of claim 46 wherein said second distribution is in a y-direction.
Claim 51
Dependent Claim
17 words
The method of claim 47 wherein said first distribution and said second distribution are in orthogonal directions.
Claim 52
Dependent Claim
18 words
The method of claim 37 wherein said first distribution and said second distribution are independent of each other.
Claim 53
Dependent Claim
59 words
The method of claim 37 further comprising the steps of: (a) calculating a first generally central location of said first distribution; (b) calculating a first generally central location of said second distribution; and (c) locating said skin-tone region based on said first generally central location of said first distribution and said first generally central location of said second distribution.
Claim 54
Dependent Claim
32 words
The method of claim 50 wherein at least one of said first generally central location of said first distribution and said first generally central location of said second distribution is a mean.
Claim 55
Dependent Claim
28 words
The method of claim 50 wherein the size of said skin-tone region is based on the variance of said first distribution and the variance of said second distribution.
Claim 56
Dependent Claim
14 words
The method of claim 51 wherein said skin-tone region is tracked between subsequent frames.
Claim 57
Dependent Claim
18 words
The method of claim 53 wherein jitter movement of said skin-tone region is reduced between said subsequent frames.
Claim 58
Independent Claim
200 words
A method of detecting a skin-tone region within an image comprising the steps of: (a) receiving said image in an image color space including a plurality of pixels, where a plurality of said pixels of said image is represented by respective groups of at least three values; (b) filtering said image by transforming a plurality of said respective groups of said at least three values to respective groups of less than three values in a transformed color space, where said respective groups of said less than three values has less dependency on brightness than said respective groups of said at least three values; (c) determining pixels in said image color space representative of skin-tones based on said filtering of step (b); (d) calculating a first distribution of said pixels of said image representative of said skin-tones in a first direction, (e) calculating a second distribution of said pixels of said image representative of said skin-tones in a second direction, where said first direction and said second direction are different and said first direction and said second direction are the same; and (f) locating said skin-tone region within said image color space based on said first distribution and said second distribution.
Claim 59
Independent Claim
200 words
A method of detecting a skin-tone region within an image comprising the steps of: (a) receiving said image in an image color space including a plurality of pixels, where a plurality of said pixels of said image is represented by respective groups of at least three values; (b) filtering said image by transforming a plurality of said respective groups of said at least three values to respective groups of less than three values in a transformed color space, where said respective groups of said less than three values has less dependency on brightness than said respective groups of said at least three values; (c) determining pixels in said image color space representative of skin-tones based on said filtering of step (b); (d) calculating a first distribution of said pixels of said image representative of said skin-tones in a first direction, (e) calculating a second distribution of said pixels of said image representative of said skin-tones in a second direction, where said first direction and said second direction are different and said first direction and said second direction are the same; and (f) locating said skin-tone region within said image color space based on said first distribution and said second distribution.
Claim 60
Dependent Claim
15 words
The method of claim 55 where said image includes from a video containing multiple images.
Claim 61
Dependent Claim
12 words
The method of claim 54 where said image includes a human face.
Claim 62
Dependent Claim
22 words
The method of claim 55 where said at least three values includes a red value, a green value, and a blue value.
Claim 63
Dependent Claim
49 words
The method of claim 58 where said respective groups of less than three values includes, a r value defined by said red value divided by the summation of said red value, said green value divided by the summation of said red value, said green value, and said blue value.
Claim 64
Dependent Claim
19 words
The method of claim 55 wherein at least one of said regions is an individual pixel of said image.
Claim 65
Dependent Claim
17 words
The method of claim 55 wherein said determining of step (c) is based on a polygonal shape.
Claim 66
Dependent Claim
16 words
The method of claim 55 wherein said determining of step (c) is based on a circle.
Claim 67
Dependent Claim
20 words
The method of claim 55 wherein at least one of said first distribution and said second distribution is a histogram.
Claim 68
Dependent Claim
13 words
The method of claim 55 wherein said first distribution is in a x-direction.
Claim 69
Dependent Claim
13 words
The method of claim 64 wherein said second distribution is in a y-direction.
Claim 70
Dependent Claim
17 words
The method of claim 65 wherein said first distribution and said second distribution are in orthogonal directions.
Claim 71
Dependent Claim
18 words
The method of claim 55 wherein said first distribution and said second distribution are independent of each other.
Claim 72
Dependent Claim
59 words
The method of claim 55 further comprising the steps of: (a) calculating a first generally central location of said first distribution; (b) calculating a first generally central location of said second distribution; and (c) locating said skin-tone region based on said first generally central location of said first distribution and said first generally central location of said second distribution.
Claim 73
Dependent Claim
32 words
The method of claim 68 wherein at least one of said first generally central location of said first distribution and said first generally central location of said second distribution is a mean.
Claim 74
Dependent Claim
28 words
The method of claim 68 wherein the size of said skin-tone region is based on the variance of said first distribution and the variance of said second distribution.
Claim 75
Dependent Claim
14 words
The method of claim 55 wherein said skin-tone region is tracked between subsequent frames.
Claim 76
Dependent Claim
18 words
The method of claim 71 wherein jitter movement of said skin-tone region is reduced between said subsequent frames.
References Cited (Backward Citations)
US4975960A
Cited
US5130935A
Cited
US5103484A
Cited
US5130789A
Cited
US5719951A
Cited
US5187574A
Cited
US5280530A
Cited
US5164992A
Cited
US5450504A
Cited
US5680481A
Cited
US5430809A
Cited
US5412738A
Cited
US5557688A
Cited
US5781650A
Cited
US5629752A
Cited
US5497430A
Cited
US5642431A
Cited
US6148092A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-12-17 | 2005-06-18 | 2005-12-18 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-12-17 | 2009-06-18 | 2009-12-18 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-12-17 | 2013-06-18 | 2013-12-18 | $7700.00 | Window Closed / Lapsed |