US7379568B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Weak hypothesis generation apparatus and method, learning apparatus and method, detection apparatus and method, facial expression learning apparatus and method, facial expression recognition apparatus and method, and robot apparatus
Assignee: Sony Corp
•
Filing: 2004-06-17
•
Granted: 2008-05-27
•
Expires: 2024-06-17
Abstract
Abstract A facial expression recognition system that uses a face detection apparatus realizing efficient learning and high-speed detection processing based on ensemble learning when detecting an area representing a detection target and that is robust against shifts of face position included in images and capable of highly accurate expression recognition, and a learning method for the system, are provided. When learning data to be used by the face detection apparatus by Adaboost, processing to select high-performance weak hypotheses from all weak hypotheses, then generate new weak hypotheses from these high-performance weak hypotheses on the basis of statistical characteristics, and select one weak hypothesis having the highest discrimination performance from these weak hypotheses, is repeated to sequentially generate a weak hypothesis, and a final hypothesis is thus acquired. In detection, using an abort threshold value that has been learned in advance, whether provided data can be obviously judged as a non-face is determined every time one weak hypothesis outputs the result of discrimination. If it can be judged so, processing is aborted. A predetermined Gabor filter is selected from the detected face image by an Adaboost technique, and a support vector for only a feature quantity extracted by the selected filter is learned, thus performing expression recognition.
Inventors
- 👤 Javier R. Movellan
- 👤 Marian S. Bartlett
- 👤 Gwendolen C. Littlewort
- 👤 John Hershey
- 👤 Ian R. Fasel
- 👤 Eric C. Carlson
- 👤 Josh Susskind
- 👤 Kohtaro Sabe
- 👤 Kenta Kawamoto
- 👤 Kenichi Hidai
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 09:39
CPC Classifications
G; G06; G06N; G06N3/00; G06N3/004; G06F; G06F18/00; G06F18/20; G06F18/21; G06F18/214; G06V; G06V10/00; G06V10/70; G06V10/77; G06V10/774; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06V40/165; G06V40/174; G06V40/175
Claims Analysis
Total Claims: 19
Claim 1
Independent Claim
150 words
A weak hypothesis generation apparatus for generating a weak hypothesis for estimating whether provided data is a detection target or not by using a data set including plural learning samples, each of which has been labeled as a detection target or non-detection target, the weak hypothesis generation apparatus comprising: a selection unit for selecting a part of plural hypotheses and selecting one or plural weak hypotheses having higher estimation performance than others with respect to the data set of the selected part of the hypotheses, as high-performance weak hypotheses; a new weak hypothesis generation unit for generating one or more new weak hypotheses formed by adding a predetermined modification to the high-performance weak hypotheses, as new weak hypotheses; and a weak hypothesis selection unit for selecting one weak hypothesis having the highest estimation performance with respect to the data set, from the high-performance weak hypotheses and the new weak hypotheses.
Claim 2
Dependent Claim
150 words
A weak hypothesis generation apparatus for generating a weak hypothesis for estimating whether provided data is a detection target or not by using a data set including plural learning samples, each of which has been labeled as a detection target or non-detection target, the weak hypothesis generation apparatus comprising: a selection unit for selecting a part of plural hypotheses and selecting one or plural weak hypotheses having higher estimation performance than others with respect to the data set of the selected part of the hypotheses, as high-performance weak hypotheses; a new weak hypothesis generation unit for generating one or more new weak hypotheses formed by adding a predetermined modification to the high-performance weak hypotheses, as new weak hypotheses; and a weak hypothesis selection unit for selecting one weak hypothesis having the highest estimation performance with respect to the data set, from the high-performance weak hypotheses and the new weak hypotheses.
Claim 3
Dependent Claim
37 words
The weak hypothesis generation apparatus as claimed in claim 1 , wherein the new weak hypothesis generation unit generates new weak hypotheses from the high-performance weak hypotheses on the basis of statistical characteristics of the detection target.
Claim 4
Dependent Claim
86 words
The weak hypothesis generation apparatus as claimed in claim 1 , wherein the learning samples are images, the weak hypotheses are adapted for extracting features from a predetermined area in a provided image and estimating whether the provided image is a detection target or not, on the basis of the extracted features, and the new weak hypothesis generation unit generates the new weak hypotheses for extracting the features from a new area shifted from the predetermined area in the high-performance weak hypotheses by a predetermined quantity.
Claim 5
Dependent Claim
90 words
The weak hypothesis generation apparatus as claimed in claim 1 , wherein the learning samples are images, the weak hypotheses are adapted for extracting features from a predetermined area in a provided image and estimating whether the provided image is a detection target or not, on the basis of the extracted features, and the new weak hypothesis generation unit generates the new weak hypotheses for extracting the features from a new area acquired by converting the scale of the predetermined area in the high-performance weak hypotheses to a predetermined size.
Claim 6
Dependent Claim
100 words
The weak hypothesis generation apparatus as claimed in claim 1 , wherein the learning samples are images, the weak hypotheses are adapted for extracting features from a predetermined area in a provided image and estimating whether the provided image is a detection target or not, on the basis of the extracted features, and the new weak hypothesis generation unit generates the new weak hypotheses for extracting the features from a new area acquired by converting the predetermined area in the high-performance weak hypotheses utilizing symmetry of the detection target and/or the new area and the predetermined area before the conversion.
Claim 7
Dependent Claim
51 words
The weak hypothesis generation apparatus as claimed in claim 1 , wherein data weighting is set for each learning sample of the data set, and estimation performance with respect to the data set is calculated on the basis of the data weighting set for each learning sample of the data set.
Claim 8
Dependent Claim
53 words
The weak hypothesis generation apparatus as claimed in claim 6 , further comprising a data weighting update unit for updating the data weighting of each of the learning samples on the basis of the estimation performance with respect to the data set, of the weak hypothesis selected by the weak hypothesis selection unit.
Claim 9
Dependent Claim
41 words
The weak hypothesis generation apparatus as claimed in claim 7 , wherein every time the data weighting is updated by the data weighting update unit, processing to generate a weak hypothesis by selecting one of the plural weak hypothesis is repeated.
Claim 10
Dependent Claim
63 words
The weak hypothesis generation apparatus as claimed in claim 7 , wherein the data weighting update unit updates the data weighting in such a manner that the data weighting of a learning sample on which the estimation value outputted by the weak hypothesis is incorrect becomes relatively larger than the data weighting of a learning sample on which the estimation value is correct.
Claim 11
Dependent Claim
26 words
The weak hypothesis generation apparatus as claimed in claim 7 , wherein the weak hypothesis deterministically outputs a result of estimation with respect to provided data.
Claim 12
Dependent Claim
26 words
The weak hypothesis generation apparatus as claimed in claim 7 , wherein the weak hypothesis probabilistically outputs a result of estimation with respect to provided data.
Claim 13
Dependent Claim
97 words
The weak hypothesis generation apparatus as claimed in claim 6 , wherein the data set includes a variable density image representing the detection target and a variable density image representing the non-detection target, and the weak hypothesis estimates whether a variable density image provided as an input is a detection target or not on the basis of the difference between the sum of brightness values in one or plural rectangular boxes and the sum of brightness values in the other rectangular boxes in a group of two or more rectangular boxes contained in the variable density image.
Claim 14
Dependent Claim
150 words
A weak hypothesis generation method for generating a weak hypothesis for estimating whether provided data is a detection target or not by using a data set including plural learning samples, each of which has been labeled as a detection target or non-detection target, the weak hypothesis generation method comprising: a selection step of selecting a part of plural hypotheses and selecting one or plural weak hypotheses having higher estimation performance than others with respect to the data set of the selected part of the hypotheses, as high-performance weak hypotheses; a new weak hypothesis generation step of generating one or more new weak hypotheses formed by adding a predetermined modification to the high-performance weak hypotheses, as new weak hypotheses; and a weak hypothesis selection step of selecting one weak hypothesis having the highest estimation performance with respect to the data set, from the high-performance weak hypotheses and the new weak hypotheses.
Claim 15
Dependent Claim
150 words
A weak hypothesis generation method for generating a weak hypothesis for estimating whether provided data is a detection target or not by using a data set including plural learning samples, each of which has been labeled as a detection target or non-detection target, the weak hypothesis generation method comprising: a selection step of selecting a part of plural hypotheses and selecting one or plural weak hypotheses having higher estimation performance than others with respect to the data set of the selected part of the hypotheses, as high-performance weak hypotheses; a new weak hypothesis generation step of generating one or more new weak hypotheses formed by adding a predetermined modification to the high-performance weak hypotheses, as new weak hypotheses; and a weak hypothesis selection step of selecting one weak hypothesis having the highest estimation performance with respect to the data set, from the high-performance weak hypotheses and the new weak hypotheses.
Claim 16
Dependent Claim
135 words
A weak hypothesis generation apparatus for generating a weak hypothesis for estimating whether provided data is a detection target or not by using a data set including plural learning samples each of which has been labeled as a detection target or non-detection target, the weak hypothesis generation apparatus comprising: a selection unit for selecting a part of plural weak hypotheses; a new weak hypothesis generation unit for generating one or more new weak hypotheses formed by adding a predetermined modification to the part of the weak hypotheses selected by the selection unit, as new weak hypotheses; and a weak hypothesis selection unit for selecting one weak hypothesis having the highest estimation performance with respect to the data set, from the part of the weak hypotheses selected by the selection unit and the new weak hypotheses.
Claim 17
Dependent Claim
135 words
A weak hypothesis generation apparatus for generating a weak hypothesis for estimating whether provided data is a detection target or not by using a data set including plural learning samples each of which has been labeled as a detection target or non-detection target, the weak hypothesis generation apparatus comprising: a selection unit for selecting a part of plural weak hypotheses; a new weak hypothesis generation unit for generating one or more new weak hypotheses formed by adding a predetermined modification to the part of the weak hypotheses selected by the selection unit, as new weak hypotheses; and a weak hypothesis selection unit for selecting one weak hypothesis having the highest estimation performance with respect to the data set, from the part of the weak hypotheses selected by the selection unit and the new weak hypotheses.
Claim 18
Dependent Claim
135 words
A weak hypothesis generation method for generating a weak hypothesis for estimating whether provided data is a detection target or not by using a data set including plural learning samples each of which has been labeled as a detection target or non-detection target, the weak hypothesis generation method comprising: a selection step of selecting a part of plural weak hypotheses; a new weak hypothesis generation step of generating one or more new weak hypotheses formed by adding a predetermined modification to the part of the weak hypotheses selected at the selection step, as new weak hypotheses; and a weak hypothesis selection step of selecting one weak hypothesis having the highest estimation performance with respect to the data set, from the part of the weak hypotheses selected at the selection step and the new weak hypotheses.
Claim 19
Dependent Claim
135 words
A weak hypothesis generation method for generating a weak hypothesis for estimating whether provided data is a detection target or not by using a data set including plural learning samples each of which has been labeled as a detection target or non-detection target, the weak hypothesis generation method comprising: a selection step of selecting a part of plural weak hypotheses; a new weak hypothesis generation step of generating one or more new weak hypotheses formed by adding a predetermined modification to the part of the weak hypotheses selected at the selection step, as new weak hypotheses; and a weak hypothesis selection step of selecting one weak hypothesis having the highest estimation performance with respect to the data set, from the part of the weak hypotheses selected at the selection step and the new weak hypotheses.
References Cited (Backward Citations)
US5479575A
Cited
US5819247A
Cited
US6287765B1
Cited
US6374197B1
Cited
US6317700B1
Cited
US7130446B2
Cited
US7203669B2
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2011-05-27 | 2011-11-26 | 2012-05-27 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2015-05-27 | 2015-11-26 | 2016-05-27 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2019-05-27 | 2019-11-26 | 2020-05-27 | $7700.00 | Window Closed / Lapsed |