US5764790A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method of storing and retrieving images of people, for example, in photographic archives and for the construction of identikit images
Assignee: Fondazione Bruno Kessler
•
Filing: 1995-08-29
•
Granted: 1998-06-09
•
Expires: 2015-08-29
Abstract
Abstract In a method of storing and retrieving images of people, for example, in photographic archives and for the construction of identikit images, each characteristic (or feature) of the images to be stored is associated with a region the size of which corresponds to the average size of the feature in the images stored. If {F i } i=1 . . . , N is a set of images of the feature, where F i is the image associated with each of the N people in the data base, on the basis of these images, a new set of images {Φ j } j=0 , 1, . . . N of the type ##EQU1## is generated, of which a subset {Φ} i=0 . . . K can be used to approximate, encode, compare and construct images of the type in question in an interactive manner. The method is particularly applicable to techniques for searching photographic archives and for the construction of identikit images.
Inventors
- 👤 Roberto Brunelli
- 👤 Ornella Mich
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 13:41
CPC Classifications
G; G06; G06T; G06T11/00; G06F; G06F16/00; G06F16/50; G06F16/53; G06F16/532; G06V; G06V40/00; G06V40/10; G06V40/16
Claims Analysis
Total Claims: 44
Claim 1
Independent Claim
232 words
A method of storing a plurality of N images of people, particularly but not exclusively in order to form photographic archives or identikit systems in which the images to be stored are distinguished by sets of features F, wherein said method comprises the steps of: analysing said images, each of said features having a respective image i in each of said images, then associating with each feature an average region the size of which corresponds to the average size of the feature in the plurality of images, generating from said respective images a set of new images according to the expansion: ##EQU13## in which ##EQU14## C.sub.Fij =(F.sub.i -Φ.sub.0)·Φ.sub.j Φ.sub.j ·Φ.sub.t =δ.sub.jt j, t=1 , . . . , N ##EQU15## and selecting those new images Φ.sub.j in which 1≦j ≦N as eigenvectors of the covariance matrix in the set {F.sub.i -Φ.sub.0 } so that the respective eigenvalue λ.sub.Fj can be associated with each eigenvector, the set of new images then being arranged in a manner such that λ.sub.Fj ≧λ.sub.Ft when j>XFt when j <t, and storing said respective images in the form of vectors C.sub.Fi ={C.sub.Fil, . . . , C.sub.Fik }, k<N where k is a number usually much less than N so that a set of vectors, one for each of the regions of the face used in the method, is associated with each of the images of the plurality.
Claim 2
Independent Claim
232 words
A method of storing a plurality of N images of people, particularly but not exclusively in order to form photographic archives or identikit systems in which the images to be stored are distinguished by sets of features F, wherein said method comprises the steps of: analysing said images, each of said features having a respective image i in each of said images, then associating with each feature an average region the size of which corresponds to the average size of the feature in the plurality of images, generating from said respective images a set of new images according to the expansion: ##EQU13## in which ##EQU14## C.sub.Fij =(F.sub.i -Φ.sub.0)·Φ.sub.j Φ.sub.j ·Φ.sub.t =δ.sub.jt j, t=1 , . . . , N ##EQU15## and selecting those new images Φ.sub.j in which 1≦j ≦N as eigenvectors of the covariance matrix in the set {F.sub.i -Φ.sub.0 } so that the respective eigenvalue λ.sub.Fj can be associated with each eigenvector, the set of new images then being arranged in a manner such that λ.sub.Fj ≧λ.sub.Ft when j>XFt when j <t, and storing said respective images in the form of vectors C.sub.Fi ={C.sub.Fil, . . . , C.sub.Fik }, k<N where k is a number usually much less than N so that a set of vectors, one for each of the regions of the face used in the method, is associated with each of the images of the plurality.
Claim 3
Dependent Claim
30 words
A method according to claim 1, wherein each image is reconstructed according to the equation ##EQU16## in order to reconstruct each of the images from the respective set of vectors.
Claim 4
Dependent Claim
32 words
A method according to claim 2, wherein said vectors have co-ordinates the values of the which are selected by moving cursors to positions with which values for the corresponding co-ordinates are associated.
Claim 5
Dependent Claim
58 words
A method according to claim 2, wherein said images are reconstructed by operating on a region with larger dimensions than the average region, the calculation of said covariance matrix and of the values of said expansion being limited to the average region, the region outside the average region, and inside the enlarged used for connecting the various features.
Claim 6
Dependent Claim
32 words
A method according to claim 1, wherein said method further comprises the step of identifying images having a disparity of less than a predetermined threshold disparity to reduce said plurality of images.
Claim 7
Dependent Claim
45 words
A method according to claim 5, wherein said disparity is calculated by an equation of the type ##EQU17## where T represents the number of pixels of the image considered as a vector, X and Y being the two images between which the disparity is calculated.
Claim 8
Dependent Claim
67 words
A method according to claim 5, wherein said disparity is calculated according to the equation d.sup.2 p=1-P.sub.xy in which P xy represents the standardized correlation coefficient ##EQU18## in which ##EQU19## μ xy represents a second-order centered moment of the variables X and Y representative of the images between which the disparity is calculated and T represents the number of pixels of the image considered as a vector.
Claim 9
Dependent Claim
29 words
A method according to claim 1, wherein said plurality of images is divided into subsets of images having substantially similar features, the method being applied to these subsets separately.
Claim 10
Dependent Claim
34 words
A method according to claim 1, wherein said plurality of images is subjected to geometric standardization so that the images of said plurality are of uniform size and orientation, before the analysis is begun.
Claim 11
Dependent Claim
38 words
A method according to claim 9, wherein said geometric standardization operation comprises the step of identifying the position of each pupil of each of said images and the operation of bringing said position to a predetermined reference position.
Claim 12
Dependent Claim
27 words
A method according to claim 1, wherein the images (F) of said plurality are subjected to a standardization of their intensity values before the analysis is begun.
Claim 13
Dependent Claim
34 words
A method according to claim 11, wherein said standardization of the intensity values is carried out by causing the average intensity value of a specific region of the image to assume a predetermined value.
Claim 14
Dependent Claim
67 words
A method according to claim 1, wherein each image F of said plurality are subjected to a transformation of the type ##EQU20## where ##EQU21## and F is the original image and the symbol * represents the convolution operation, K G δ represents a Gaussan convolution kernel, the parameter a (standard deviation) of which is correlated with the interocular distance of said image before the analysis is begun.
Claim 15
Dependent Claim
36 words
A method according to claim 2, wherein, in the reconstruction step, the images are reconstructed as the sum of the features available and of an average image corresponding to an arithmetic mean of the images stored.
Claim 16
Dependent Claim
112 words
A method according to claim 1, wherein said method further comprises the step of associating, with each of the features, a respective priority and a respective map of values the size of which corresponds to that of the overall image, in which are identified: a region outside the respective feature, an inner region of the respective feature, corresponding to the average region used for calculating the covariance matrix and the expansion values, and a transition region, and the step of setting the map values to 1 in the inner region, to 0 in the outer region and to an intermediate value in the transition region, thus achieving a blending of the features.
Claim 17
Dependent Claim
73 words
A method according to claim 15, wherein the transitional region is one-dimensional and said intermediate value is selected by a law of the type: ##EQU22## where x is the one-dimensional coordinate with the one-dimensional region being defined as r.sub.F = X.sub.1, X.sub.2 ! R.sub.F = X.sub.0, X.sub.j) where r F is the inner region, (R F -r F ) is the transition region, where X 0 < 1 <X 2 <X 3 .
Claim 18
Dependent Claim
51 words
A method according to claim 15, wherein the transitional region is two-dimensional and the intermediate value is the product of the functions W F of the x-co-ordinate and y-co-ordinate, respectively, the reconstruction value being given by ( . . . (((F.sub.0 (1-W.sub.1)+W.sub.1 F.sub.1) (1-W.sub.2)+W.sub.2 F.sub.2) (1-W.sub.3)+W.sub.3 F.sub.3) . . . ).
Claim 19
Dependent Claim
82 words
A method according to claim 1, wherein said method further comprises the step of comparing the images stored with an additional image in the course of formation, generating a respective similarity parameter, then sorting the set of images stored in order of increasing disparity or dissimilarity values with respect to the image in the course of construction, and the step of displaying a certain number of stored images having a certain degree of similarity to the images in the course of construction.
Claim 20
Dependent Claim
90 words
A method according to claim 18, wherein said disparity or dissimilarity is defined according to an equation of the type ##EQU23## where Q is the number of features which can be selected; a F =1 or 0 according to whether the feature has been selected or not, the quantity ##EQU24## and represents a standardization factor with which to weight the various features, and the vectors C F , C Fi the image being constructed and the image i of the data base, respectively, within the limits of the feature F.
Claim 21
Dependent Claim
34 words
A method according to claim 19, wherein pointing to (selecting) one of the images displayed replaces the descriptive components of the feature selected in the image being constructed with those of the image selected.
Claim 22
Dependent Claim
52 words
A method according to claim 19, wherein said set of images in the data base is organized and presented in a hierarchical manner, and wherein pointing to (selecting) one of the images displayed replaces the descriptive components of the features selected in the image being constructed with those of the image selected.
Claim 23
Independent Claim
222 words
A system for storing a plurality of N images of people, particularly but not exclusively in order to form photographic archives or identikit systems, in which the images to be stored are distinguished by sets of features F, characterized in that it comprises: acquisition and analysis means for analyzing the images, each of the features having a respective image F i in each of the images, and then for associating with each feature an average region, the size of which corresponds to the average size of the feature in the plurality of images, processor means for generating, from the respective images, a set of new images such that ##EQU25## where ##EQU26## C.sub.Fij =(F.sub.i -Φ.sub.0)Φ.sub.j Φ.sub.j ·Φ.sub.t =δ.sub.jt j, t=1, . . . , N ##EQU27## the new images Φ.sub.j in which 1<j<N being selected as eigenvectors of the covariance matrix in the set {F.sub.i -Φ.sub.0 } so that a respective eigenvalue λ.sub.Fj can be associated with each eigenvector, the processing means then sorting the set of new images in a manner such that λ.sub.Fj ≧λ.sub.Ft when j<t and storing the respective images in the form of vectors C.sub.Fi ={C.sub.Fil, . . . , C.sub.Fik } so that a set of vectors, one for each of the regions of the face used in the system, is associated with each image of the plurality.
Claim 24
Independent Claim
222 words
A system for storing a plurality of N images of people, particularly but not exclusively in order to form photographic archives or identikit systems, in which the images to be stored are distinguished by sets of features F, characterized in that it comprises: acquisition and analysis means for analyzing the images, each of the features having a respective image F i in each of the images, and then for associating with each feature an average region, the size of which corresponds to the average size of the feature in the plurality of images, processor means for generating, from the respective images, a set of new images such that ##EQU25## where ##EQU26## C.sub.Fij =(F.sub.i -Φ.sub.0)Φ.sub.j Φ.sub.j ·Φ.sub.t =δ.sub.jt j, t=1, . . . , N ##EQU27## the new images Φ.sub.j in which 1<j<N being selected as eigenvectors of the covariance matrix in the set {F.sub.i -Φ.sub.0 } so that a respective eigenvalue λ.sub.Fj can be associated with each eigenvector, the processing means then sorting the set of new images in a manner such that λ.sub.Fj ≧λ.sub.Ft when j<t and storing the respective images in the form of vectors C.sub.Fi ={C.sub.Fil, . . . , C.sub.Fik } so that a set of vectors, one for each of the regions of the face used in the system, is associated with each image of the plurality.
Claim 25
Dependent Claim
43 words
A system according to claim 22, wherein it comprises restoring means for reconstructing each of the images from the respective set of vectors, the restoring means reconstructing each image according to the equation ##EQU28## where K is a number much less than N.
Claim 26
Dependent Claim
33 words
A system according to claim 23, wherein it comprises cursor means for selecting the co-ordinates of the vectors, the position of the cursor means being associated with a value for the corresponding co-ordinate.
Claim 27
Dependent Claim
58 words
A system according to claim 23, wherein said restoring means operate on a region with larger dimensions than the average region, the calculation of the covariance matrix and of the values of said equation being limited to the average region, the region outside the average region and inside the enlarged region being used for connecting the various features.
Claim 28
Dependent Claim
32 words
A system according to claim 22, wherein said processing means reduce the plurality of images by identifying amongst them the images the disparity of which is less than a predetermined threshold disparity.
Claim 29
Dependent Claim
47 words
A system according to claim 26, wherein said processing means calculate the disparity with an equation of the type ##EQU29## where T represents the number of pixels of the image considered as a vector, X and Y being the two images between which the disparity is calculated.
Claim 30
Dependent Claim
68 words
A system according to claim 26, wherein said processing means calculate the disparity according to the equation d.spsp..sup.P =1-P.sub.xy where P xy represents the standardized correlation coefficient ##EQU30## in which ##EQU31## μxy represents a second order centered movement of the variables X and Y representative of the images between which the disparity is calculated and T represents the number of pixels of the image considered as a vector.
Claim 31
Dependent Claim
23 words
A system according to claim 22, wherein said processing means divide the plurality of images into subsets of images having substantially similar features.
Claim 32
Dependent Claim
48 words
A system according to claim 22, wherein it comprises pre-processing means which act between the acquisition and analysis means and the processing means, and in which the plurality of images is subjected to geometric standardization so that the images of the plurality are of uniform size and orientation.
Claim 33
Dependent Claim
32 words
A system according to claim 30, wherein said pre-processing means identify the position of each pupil of each of said images, the pre-processing means bringing this position to a predetermined reference position.
Claim 34
Dependent Claim
40 words
A system according to claim 22, wherein it comprises pre-processing means which act between the acquisition and analysis means and the processing means, and in which the images of the plurality are subjected to a standardization of their intensity values.
Claim 35
Dependent Claim
34 words
A system according to claim 32, wherein the preprocessing means cause the average intensity value of a specific region of the image to assume a predetermined value during the standardization of the intensity values.
Claim 36
Dependent Claim
77 words
A system according to claim 22, wherein it comprises pre-processing means which act between the acquisition and analysis means and the processing means, and in which each image F of the plurality is subjected to a transformation of the type ##EQU32## where ##EQU33## F is the original image and the symbol * represents the convolution operation, K G (δ) represents a Gaussian convolution kernel the parameter δ (standard deviation) of which is correlated to the interocular distance.
Claim 37
Dependent Claim
34 words
A system according to claim 23, wherein said restoring means reconstruct the images as the sum of the features available and of an average image corresponding to an arithmetic mean of the images stored.
Claim 38
Dependent Claim
113 words
A system according to claim 22, wherein said processing means associate with each of the features a respective priority and a respective map of values the size of which corresponds to that of the overall image, in which are identified: a region outside the respective feature, an inner region of the respective feature corresponding to the average region used for calculating the covariance matrix and the expansion values, and a transition region, and wherein the processing means set the map values to 1 in the inner region, to 0 in the outer region and to an intermediate value in the transition region so that the restoring means achieve a blending of the features.
Claim 39
Dependent Claim
71 words
A system according to claim 36, wherein the transitional region is one-dimensional and said intermediate value is selected by a law of the type: ##EQU34## where x is the one-dimensional coordinate the one-dimensional region being defined as r.sub.F = X.sub.1, X.sub.2 ! R.sub.F X.sub.0, X.sub.3 ! where X 0 <X 1 <X 2 ,X 3 and r F is the inner region, (R F -r F ) is the transition region.
Claim 40
Dependent Claim
55 words
A system according to claim 36, wherein the transitional region is two-dimensional, the processing means process the intermediate value using the product of the functions W F of the x-co-ordinate and the y-coordinate, respectively, the restored value being given by ( . . . (((F.sub.0 (1-W.sub.1)+W.sub.1 F.sub.1) (1-W.sub.2)+W.sub.2 F.sub.2) (1-FW.sub.3)+W.sub.3 F.sub.3) . . . ).
Claim 41
Dependent Claim
84 words
A system according to claim 23, wherein said processing means compare the images stored with an additional image in the course of formation to generate a respective similarity parameter, and then sort the set of images stored in order of increasing values of disparity or dissimilarity with respect to the images in the course of construction, the system also comprising restoring means for displaying a certain number of stored images having a certain degree of similarity to the images in the course of construction.
Claim 42
Dependent Claim
91 words
A system according to claim 39, wherein said disparity or dissimilarity is defined according to an equation of the type ##EQU35## where Q is the number of features which can be selected, a F =1 or 0 according to whether the feature has been selected or not, the quantity ##EQU36## and represents a standardization factor with which to weight the various features/ and the vectors C F , C Fi represent the image being constructed and the image i of the data base, respectively, within the limits of the feature F.
Claim 43
Dependent Claim
42 words
A system according to claim 40, wherein said system comprises means for pointing to (selecting) one of the images displayed and means for replacing the descriptive components of the features selected in the image being formed with those of the image selected.
Claim 44
Dependent Claim
52 words
A system according to claim 40, wherein said set of images of the data base is organized and presented in a hierarchical manner, and wherein pointing to (selecting) one of the images displayed replaces the descriptive components of the features selected in the image being constructed with those of the image selected.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-06-08 | 2001-12-08 | 2002-06-09 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-06-08 | 2005-12-08 | 2006-06-09 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-06-08 | 2009-12-08 | 2010-06-09 | $7700.00 | Window Closed / Lapsed |