Patent US5751777A successfully refreshed from Google Patents.
Patent US5710833A successfully refreshed from Google Patents.
US5710833A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Detection, recognition and coding of complex objects using probabilistic eigenspace analysis
Assignee: Massachusetts Institute of Technology
•
Filing: 1995-04-20
•
Granted: 1998-01-20
•
Expires: 2015-04-20
Abstract
Abstract Methods and apparatus for detecting instances of a selected object or object feature in a digitally represented scene utilize analysis of probability densities to determine whether an input image (or portion thereof) represents such an instance. The invention filters images of objects that, although in some ways similar to the object under study, fail to qualify as typical instances of that object. The invention is useful in the detection and recognition of virtually any multifeatured entity such as human faces, features thereof (e.g., eyes), as well as non-rigid and articulated objects such as human hands.
Inventors
- 👤 Baback Moghaddam
- 👤 Alex Pentland
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-31 23:42
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/16; G06F; G06F16/00; G06F16/70; G06F16/73; G06F16/738; G06F16/739
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
112 words
A method for detecting selected features in digitally represented input images, the method comprising the steps of: a. representing a training set of instances of the selected feature as a set of eigenvectors in a multidimensional image space; b. representing portions of the input image as input vectors in the image space; c. performing a density-estimation analysis on the input vectors to estimate, for each input vector, a probability level indicative of the likelihood that the input vector corresponds to an image portion containing an instance of the selected feature, wherein said density estimation analysis is based on all vector components; and d. identifying image portions having the highest associated probability levels.
Claim 2
Independent Claim
112 words
A method for detecting selected features in digitally represented input images, the method comprising the steps of: a. representing a training set of instances of the selected feature as a set of eigenvectors in a multidimensional image space; b. representing portions of the input image as input vectors in the image space; c. performing a density-estimation analysis on the input vectors to estimate, for each input vector, a probability level indicative of the likelihood that the input vector corresponds to an image portion containing an instance of the selected feature, wherein said density estimation analysis is based on all vector components; and d. identifying image portions having the highest associated probability levels.
Claim 3
Dependent Claim
115 words
The method of claim 1 wherein the step of performing a density-estimation analysis comprises the steps of: a. dividing the image space into a principal subspace and an orthogonal subspace, the principal subspace including a unimodal set of principal eigenvectors; b. computing the distance between a point identified by an input vector and the principal subspace; c. projecting the input vector onto the principal subspace; d. computing the probability distribution of the input-vector projection with respect to the principal eigenvectors; and e. estimating, from the computed distance and the computed probability distribution, the probability level indicative of the likelihood that the input vector corresponds to an image portion containing an instance of the selected feature.
Claim 4
Dependent Claim
63 words
The method of claim 2 wherein the estimating step comprises computing a first marginal probability density in the principal subspace and a second marginal probability density in the orthogonal subspace, the first density being a true density, the second density being an estimated density and the first and second densities being statistically consistent with one another, and multiplying the first and second densities.
Claim 5
Dependent Claim
120 words
The method of claim 1 wherein the step of performing a density-estimation analysis comprises the steps of: a. dividing the image space into a principal subspace and an orthogonal subspace, the principal subspace including a multimodal set of principal eigenvectors; b. computing the distance between a point identified by an input vector and the principal subspace; c. projecting the input vector onto the principal subspace; d. computing the probability distribution of the input-vector projection with respect to the principal eigenvectors using a parametric mixture model; and e. estimating, from the computed distance and the computed probability distribution, the probability level indicative of the likelihood that the input vector corresponds to an image portion containing an instance of the selected feature.
Claim 6
Dependent Claim
42 words
The method of claim 1 further comprising a recognition step of determining, for each identified image portion, which one, if any, of a reference set of digitally represented instances of the selected feature the instance contained in the identified image portion resembles.
Claim 7
Dependent Claim
44 words
The method of claim 5 wherein the reference set of digitally represented instances is represented by a plurality of vectors in the principal subspace and the recognition step comprises projecting the input vector onto the principal subspace and locating the instance vector closest thereto.
Claim 8
Dependent Claim
22 words
The method of claim 1 further comprising the step of encoding each identified image portion as a set of quantized projection coefficients.
Claim 9
Dependent Claim
11 words
The method of claim 1 wherein the selected features are faces.
Claim 10
Dependent Claim
12 words
The method of claim 1 wherein the selected features are facial features.
Claim 11
Independent Claim
123 words
An apparatus for detecting selected features in digitally represented input images comprising: a. a computer memory for storing the input images; b. means for representing a training set of instances of the selected feature as a set of eigenvectors in a multidimensional image space; c. means for isolating at least a portion of the stored input image and representing it as an input vector in the image space; and d. image processing means for performing a density-estimation analysis and analyzing an input vector to estimate, for each input vector, a probability level indicative of the likelihood that the input vector corresponds to an image portion containing an instance of the selected feature, wherein said density estimation analysis is based on all vector components.
Claim 12
Independent Claim
123 words
An apparatus for detecting selected features in digitally represented input images comprising: a. a computer memory for storing the input images; b. means for representing a training set of instances of the selected feature as a set of eigenvectors in a multidimensional image space; c. means for isolating at least a portion of the stored input image and representing it as an input vector in the image space; and d. image processing means for performing a density-estimation analysis and analyzing an input vector to estimate, for each input vector, a probability level indicative of the likelihood that the input vector corresponds to an image portion containing an instance of the selected feature, wherein said density estimation analysis is based on all vector components.
Claim 13
Dependent Claim
80 words
The apparatus of claim 10 wherein each input is represented as a plurality of pixels, and further comprising: a. means for representing the input image at a plurality of scales; b. means for defining, for each scaled image, a window including a fixed number of pixels of the image, and transferring the contents of each window to the image-processing means to generate a probability level for each window; and c. means for identifying the window having the highest associated probability.
Claim 14
Dependent Claim
110 words
The apparatus of claim 10 wherein the image-processing means is configured to: a. divide the image space into a principal subspace and an orthogonal subspace, the principal subspace including a unimodal set of principal eigenvectors; b. compute the distance between a point identified by an input vector and the principal subspace; c. project the input vector onto the principal subspace; d. compute the probability distribution of the input-vector projection with respect to the principal eigenvectors; and e. estimate, from the computed distance and the computed probability distribution, the probability level indicative of the likelihood that the input vector corresponds to an image portion containing an instance of the selected feature.
Claim 15
Dependent Claim
16 words
The apparatus of claim 12 wherein the image-processing means estimates the probability level using maximum-likelihood analysis.
Claim 16
Dependent Claim
28 words
The apparatus of claim 10 further comprising means for identifying, based on probability level, at least one input vector likely to contain an instance of the selected feature.
Claim 17
Dependent Claim
112 words
The apparatus of claim 14 wherein the training set of feature instances are generated at a single viewing angle, and further comprising means for isolating and processing the input-image portion corresponding to each identified input vector, said means comprising: a. means for normalizing the input-image portion with respect to translation and scale; b. means for identifying a plurality of subfeatures in the input-image portion; c. validation means for analyzing identified subfeatures for geometric consistency with a stored template; d. warping means for spatially aligning validated input-image portions for consistency with the viewing angle; and e. masking means for deleting those portions of the input image that do not correspond to the feature.
Claim 18
Dependent Claim
20 words
The apparatus of claim 15 further comprising contrast-normalization means for processing the masked image to compensate for variations in contrast.
Claim 19
Dependent Claim
70 words
The apparatus of claim 15 further comprising: a. a database for storing each of the training images as a set of projection coefficients onto a set of eigenvectors; b. identification means comprising (i) means for projecting the masked image onto the set of eigenvectors to obtain a set of input projection coefficients, and (ii) means for locating the training image whose projection coefficients most closely match the input projection coefficients.
Claim 20
Dependent Claim
36 words
The apparatus of claim 17 wherein the identification means includes means for computing a confidence level indicative of the degree to which the coefficients of the selected training image match the coefficients of the input projection.
Claim 21
Dependent Claim
22 words
The apparatus of claim 15 further comprising a reconstruction module for reconstructing the input image from the isolated and processed input-image portion.
Claim 22
Dependent Claim
42 words
The apparatus of claim 15 further comprising an encoder module that itself comprises: a. means for projecting the masked image onto a set of eigenvectors to obtain a set of input projection coefficients; and b. means for quantizing the input projection coefficients.
References Cited (Backward Citations)
US4259661A
Cited
US4752957A
Cited
US4998286A
Cited
WO1989000461A1
Cited
US4838644A
Cited
US5111516A
Cited
WO1991000775A1
Cited
WO1991001183A1
Cited
US5101446A
Cited
US5245675A
Cited
US5164992A
Cited
US5432864A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-01-19 | 2001-07-21 | 2002-01-20 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-01-19 | 2005-07-21 | 2006-01-20 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-01-19 | 2009-07-21 | 2010-01-20 | $7700.00 | Window Closed / Lapsed |