US5987456A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Image retrieval by syntactic characterization of appearance
Assignee: University of Massachusetts Boston
•
Filing: 1997-10-28
•
Granted: 1999-11-16
•
Expires: 2017-10-28
Abstract
Abstract An image retrieval method which includes producing multiscale vectors associated with points in a set of database images, indexing the database vectors to produce a database vector index, producing query multiscale vectors associated with points in a query image, and matching the query vectors with the indexed database vectors to identify a database image which is similar to the query image. Each of the database multiscale vectors and the query multiscale vectors includes multiple single scale vectors associated with corresponding spatial scales. The method can include applying a single scale image processing procedure at each of the spatial scales to produce single scale vectors and combining single scale vectors each associate with a given point in an image to form a multiscale vector associated with that point. The single scale image processing procedure can include evaluating multiple smoothed spatial derivatives of image intensity at a point in an image and transforming the spatial derivatives to produce a single scale vector which is insensitive to rotation of the image about the point.
Inventors
- 👤 Srinivas Ravela
- 👤 Raghavan Manmatha
- 👤 Edward Riseman
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 17:59
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/50; G06F16/58; G06F16/583; G06F16/5838; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99933; Y10S707/99934; Y10S707/99935
Claims Analysis
Total Claims: 27
Claim 1
Independent Claim
153 words
A method of image retrieval comprising: applying a database multiscale image processing procedure to each of a plurality of database images producing a plurality of database multiscale vectors, wherein each multiscale vector characterizes a region about a different one of a corresponding plurality of points in the images; indexing the database vectors to produce a database vector index; applying a query multiscale image processing procedure to a query image to produce a plurality of query multiscale vectors, wherein each query multiscale vector characterizes a region about a different one of a corresponding plurality of points in the query image; and matching the plurality of query vectors with the plurality of indexed database vectors to identify a database image which is similar to the query image; wherein each of the database multiscale vectors and the query multiscale vectors includes a plurality of single scale vectors associated with a corresponding plurality of database spatial scales.
Claim 2
Independent Claim
153 words
A method of image retrieval comprising: applying a database multiscale image processing procedure to each of a plurality of database images producing a plurality of database multiscale vectors, wherein each multiscale vector characterizes a region about a different one of a corresponding plurality of points in the images; indexing the database vectors to produce a database vector index; applying a query multiscale image processing procedure to a query image to produce a plurality of query multiscale vectors, wherein each query multiscale vector characterizes a region about a different one of a corresponding plurality of points in the query image; and matching the plurality of query vectors with the plurality of indexed database vectors to identify a database image which is similar to the query image; wherein each of the database multiscale vectors and the query multiscale vectors includes a plurality of single scale vectors associated with a corresponding plurality of database spatial scales.
Claim 3
Dependent Claim
76 words
The method of claim 1 wherein the database image processing procedure and the query multiscale image processing procedure applied to an image each includes: applying a single scale image processing procedure to the image at each of the plurality of database spatial scales to a produce a plurality of single scale vectors; and combining single scale vectors each associated with a same point in the image to form a multiscale vector associated with that same point.
Claim 4
Dependent Claim
66 words
The method of claim 2 wherein the single scale image processing procedure applied to the image includes: evaluating a plurality of smoothed spatial derivatives of image intensity at a point in the image; and transforming the plurality of spatial derivatives to produce a single scale vector associated with the point such that the single scale vector is insensitive to rotation of the image about the point.
Claim 5
Dependent Claim
28 words
The method of claim 3 wherein evaluating the smoothed spatial derivatives of image intensity includes the step of filtering the image using a derivative of a Gaussian function.
Claim 6
Dependent Claim
29 words
The method of claim 1 further comprising: accepting a specification of a salient region of the query image; and selecting the plurality of query points within the salient region.
Claim 7
Dependent Claim
30 words
The method of claim 1 wherein matching further includes the step of comparing relative location of points associated with query vectors with relative locations of points associated with database vectors.
Claim 8
Dependent Claim
48 words
The method of claim 1 wherein each of the query vectors further includes a plurality of single scale vectors associated with a corresponding plurality of additional spatial scales, and matching includes the step of selecting a subset of the single scale vectors in each of the query vectors.
Claim 9
Dependent Claim
28 words
The method of claim 1 wherein matching further includes accessing the database vector index to find database vectors that have similar values to one of the query vectors.
Claim 10
Dependent Claim
36 words
The method of claim 1 wherein the single scale vectors included in each of the database multiscale vectors and the query multiscale vectors characterize regions about a same point in an image as that multiscale vector.
Claim 11
Dependent Claim
165 words
A computer program stored on a computer readable medium for causing a computer to perform the functions of: applying a database multiscale image processing procedure to each of a plurality of database images producing a plurality of database multiscale vectors, wherein each multiscale vector characterizes a region about a different one of a corresponding plurality of points in the images; indexing the database vectors to produce a database vector index; applying a query multiscale image processing procedure to a query image to produce a plurality of query multiscale vectors, wherein each query multiscale vector characterizes a region about a different one of a corresponding plurality of points in the query image; and matching the plurality of query vectors with the plurality of indexed database vectors to identify a database image which is similar to the query image; wherein each of the database multiscale vectors and the query multiscale vectors includes a plurality of single scale vectors associated with a corresponding plurality of database spatial scales.
Claim 12
Dependent Claim
165 words
A computer program stored on a computer readable medium for causing a computer to perform the functions of: applying a database multiscale image processing procedure to each of a plurality of database images producing a plurality of database multiscale vectors, wherein each multiscale vector characterizes a region about a different one of a corresponding plurality of points in the images; indexing the database vectors to produce a database vector index; applying a query multiscale image processing procedure to a query image to produce a plurality of query multiscale vectors, wherein each query multiscale vector characterizes a region about a different one of a corresponding plurality of points in the query image; and matching the plurality of query vectors with the plurality of indexed database vectors to identify a database image which is similar to the query image; wherein each of the database multiscale vectors and the query multiscale vectors includes a plurality of single scale vectors associated with a corresponding plurality of database spatial scales.
Claim 13
Dependent Claim
77 words
The computer program of claim 10 wherein the database image processing procedure and the query multiscale image processing procedure applied to an image each includes: applying a single scale image processing procedure to the image at each of the plurality of database spatial scales to a produce a plurality of single scale vectors; and combining single scale vectors each associate with a same point in the image to form a multiscale vector associated with that same point.
Claim 14
Dependent Claim
67 words
The computer program of claim 10 wherein the single scale image processing procedure applied to the image includes: evaluating a plurality of smoothed spatial derivatives of image intensity at a point in the image; and transforming the plurality of spatial derivatives to produce a single scale vector associated with the point such that the single scale vector is insensitive to rotation of the image about the point.
Claim 15
Dependent Claim
29 words
The computer program of claim 12 wherein evaluating the smoothed spatial derivatives of image intensity includes the step of filtering the image using a derivative of a Gaussian function.
Claim 16
Dependent Claim
38 words
The computer program of claim 10 for further causing the computer to perform the functions of: accepting a specification of a salient region of the query image; and selecting the plurality of query points within the salient region.
Claim 17
Dependent Claim
34 words
The computer program of claim 10 wherein the function of matching further includes the step of comparing relative location of points associated with query vectors with relative locations of points associated with database vectors.
Claim 18
Dependent Claim
49 words
The computer program of claim 10 wherein each of the query vectors further includes a plurality of single scale vectors associated with a corresponding plurality of additional spatial scales, and the function of matching includes selecting a subset of the single scale vectors in each of the query vectors.
Claim 19
Dependent Claim
32 words
The computer program of claim 10 wherein the function of matching further includes accessing the database vector index to find database vectors that have similar values to one of the query vectors.
Claim 20
Dependent Claim
37 words
The computer program of claim 10 wherein the single scale vectors included in each of the database multiscale vectors and the query multiscale vectors characterize regions about a same point in an image as that multiscale vector.
Claim 21
Dependent Claim
128 words
An image retrieval system for comparing a query image to a plurality of database images comprising: a database image processor; a plurality of database multiscale vectors produced by applying each of the plurality of database images as input to the database image processor; a database vector index for accessing the database vectors; a query image processor; a plurality of query multiscale vectors produced by applying the query image as input the query image processor; and means for matching the plurality of query vectors with the indexed database vectors to identify a database image which is similar to the query image; wherein each of the database multiscale vectors and the query multiscale vectors includes a plurality of single scale vectors associated with a corresponding plurality of database spatial scales.
Claim 22
Dependent Claim
128 words
An image retrieval system for comparing a query image to a plurality of database images comprising: a database image processor; a plurality of database multiscale vectors produced by applying each of the plurality of database images as input to the database image processor; a database vector index for accessing the database vectors; a query image processor; a plurality of query multiscale vectors produced by applying the query image as input the query image processor; and means for matching the plurality of query vectors with the indexed database vectors to identify a database image which is similar to the query image; wherein each of the database multiscale vectors and the query multiscale vectors includes a plurality of single scale vectors associated with a corresponding plurality of database spatial scales.
Claim 23
Dependent Claim
64 words
The system of claim 19 wherein the database image processor and the query image processor each includes: a derivative processor used to compute a plurality of smoothed spatial derivatives of an input image for each of the database spatial scales; and a feature processor which takes the plurality of derivatives and whose output is insensitive to rotation of the input image around a point.
Claim 24
Dependent Claim
37 words
The system of claim 19 wherein the query image processor includes a means for accepting a specification of a salient region of the query image, and the database vectors are associated with points within the salient region.
Claim 25
Dependent Claim
28 words
The system of claim 19 wherein the means for matching further includes a spatial matcher that compares relative locations of query points and relative locations of database points.
Claim 26
Dependent Claim
51 words
The system of claim 19 wherein each of the query vectors further includes a plurality of single scale vectors associated with a corresponding plurality of additional spatial scales, and the means for matching includes a means for selecting a subset of the single scale vectors in each of the query vectors.
Claim 27
Dependent Claim
38 words
The image retrieval system of claim 19 wherein the single scale vectors included in each of the database multiscale vectors and the query multiscale vectors characterize regions about a same point in an image as that multiscale vector.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-11-15 | 2003-05-17 | 2003-11-16 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-11-15 | 2007-05-17 | 2007-11-16 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-11-15 | 2011-05-17 | 2011-11-16 | $7700.00 | Window Closed / Lapsed |