US6748398B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Relevance maximizing, iteration minimizing, relevance-feedback, content-based image retrieval (CBIR)
Assignee: Microsoft Technology Licensing LLC
•
Filing: 2001-03-30
•
Granted: 2004-06-08
•
Expires: 2021-03-30
Abstract
Abstract An implementation of a technology, described herein, for relevance-feedback, content-based facilitating accurate and efficient image retrieval minimizes the number of iterations for user feedback regarding the semantic relevance of exemplary images while maximizing the resulting relevance of each iteration. One technique for accomplishing this is to use a Bayesian classifier to treat positive and negative feedback examples with different strategies. In addition, query refinement techniques are applied to pinpoint the users' intended queries with respect to their feedbacks. These techniques further enhance the accuracy and usability of relevance feedback. This abstract itself is not intended to limit the scope of this patent. The scope of the present invention is pointed out in the appending claims.
Inventors
- 👤 Hong-Jiang Zhang
- 👤 Zhong Su
- 👤 Xingquan Zhu
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 11:25
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/50; G06F16/58; G06F16/583; G06F16/5838; G06F18/00; G06F18/20; G06F18/21; G06F18/217; G06F18/2178; G06F18/22; G06F18/24; G06F18/241; G06F18/2415; G06F18/24155; G06F18/40; G06V; G06V10/00; G06V10/70; G06V10/74; G06V10/761; G06V10/77; G06V10/778; G06V10/7784; G06V10/94; G06V10/945; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99932; Y10S707/99933; Y10S707/99934; Y10S707/99935; Y10S707/99936; Y10S707/99941; Y10S707/99943; Y10S707/99944; Y10S707/99945; Y10S707/99948
Claims Analysis
Total Claims: 24
Claim 1
Independent Claim
242 words
A method for improving iterative results of Content-Based Image Retrieval (CBIR) using relevance feedback, the method comprising: obtaining a set of positive feedback images and a set of negative feedback images via relevance feedback, the set of positive feedback images are those images deemed semantically relevant and the set of negative feedback images are those deemed semantically less relevant; within a feature space, moving a positive candidate image towards the set of positive feedback images by adjusting distance metrics of the positive candidate image, the positive candidate images having similar low-level features as those of the set of positive feedback images, wherein the adjusting of distance metrics of the positive candidate image employs this evaluation: Dis ( j ) = ∑ i = 0 N R w i * ( 1 - Sim ( j , X i + ) ) ; where j is the positive candidate image; N R is a number of images in the set of positive feedback images; X i + , i=1, . . . N R is defined as the i th image; w i is the normalized weight of the images in the set of positive feedback images; within a feature space, distancing a negative candidate images from the set of positive feedback images by adjusting distance metrics of the negative candidate image, the negative candidate images having similar low-level features as those of the set of negative feedback images.
Claim 2
Independent Claim
242 words
A method for improving iterative results of Content-Based Image Retrieval (CBIR) using relevance feedback, the method comprising: obtaining a set of positive feedback images and a set of negative feedback images via relevance feedback, the set of positive feedback images are those images deemed semantically relevant and the set of negative feedback images are those deemed semantically less relevant; within a feature space, moving a positive candidate image towards the set of positive feedback images by adjusting distance metrics of the positive candidate image, the positive candidate images having similar low-level features as those of the set of positive feedback images, wherein the adjusting of distance metrics of the positive candidate image employs this evaluation: Dis ( j ) = ∑ i = 0 N R w i * ( 1 - Sim ( j , X i + ) ) ; where j is the positive candidate image; N R is a number of images in the set of positive feedback images; X i + , i=1, . . . N R is defined as the i th image; w i is the normalized weight of the images in the set of positive feedback images; within a feature space, distancing a negative candidate images from the set of positive feedback images by adjusting distance metrics of the negative candidate image, the negative candidate images having similar low-level features as those of the set of negative feedback images.
Claim 3
Dependent Claim
22 words
A method as recited in claim 1 further comprising constructing a Bayesian classifier of a positive feedback image by positive candidate images.
Claim 4
Dependent Claim
27 words
A method as recited in claim 1 further comprising employing a Bayesian decision boundary function to determine the probability of an image being a positive candidate image.
Claim 5
Dependent Claim
66 words
A method as recited in claim 1 , wherein the moving further comprises: normalizing features of an image within a feature space; initializing parameters of the classifier; updating the parameters using the features of the new positive feedback images; calculating distances based upon a Bayesian decision boundary function; sorting images based upon calculated distances, wherein the sort is performed as if no negative feedback images exist.
Claim 6
Dependent Claim
26 words
A computer comprising one or more computer-readable media having computer-executable instructions that, when executed by the computer, perform the method as recited in claim 1 .
Claim 7
Dependent Claim
21 words
A computer-readable medium having computer-executable instructions that, when executed by a computer, performs the method as recited in claim 1 .
Claim 8
Independent Claim
127 words
A method for improving the evaluation of the similarity of images based upon image features, the method comprising calculating a weighted similarity distance between a first image and a set of images as a distance between them in a feature space, wherein the calculating employs this evaluation: Dis ( j ) = ∑ i = 0 N R w i * ( 1 - Sim ( j , X i + ) ) ; where j is the first image; N R is a number of images in the set of images; X i + , i=1, . . . N R is defined as the i th image; w i is the normalized weight of the images in the set of images.
Claim 9
Independent Claim
127 words
A method for improving the evaluation of the similarity of images based upon image features, the method comprising calculating a weighted similarity distance between a first image and a set of images as a distance between them in a feature space, wherein the calculating employs this evaluation: Dis ( j ) = ∑ i = 0 N R w i * ( 1 - Sim ( j , X i + ) ) ; where j is the first image; N R is a number of images in the set of images; X i + , i=1, . . . N R is defined as the i th image; w i is the normalized weight of the images in the set of images.
Claim 10
Dependent Claim
26 words
A computer comprising one or more computer-readable media having computer-executable instructions that, when executed by the computer, perform the method as recited in claim 7 .
Claim 11
Dependent Claim
21 words
A computer-readable medium having computer-executable instructions that, when executed by a computer, performs the method as recited in claim 7 .
Claim 12
Independent Claim
149 words
A method for improving the evaluation of the similarity of images based upon image features, the method comprising defining a subject image to be similar to a set of example images because it is within a minimal distance of the set of example images within a feature space, wherein the distance between the subject image and the set of example images is calculated based upon this evaluation: Dis ( j ) = ∑ i = 0 N R w i * ( 1 - Sim ( j , X i + ) ) ; where j is the subject image; N R is a number of images in the set of example images; X i + , i=1, . . . N R is defined as the i th image; w i is the normalized weight of the images in the set of example images.
Claim 13
Independent Claim
149 words
A method for improving the evaluation of the similarity of images based upon image features, the method comprising defining a subject image to be similar to a set of example images because it is within a minimal distance of the set of example images within a feature space, wherein the distance between the subject image and the set of example images is calculated based upon this evaluation: Dis ( j ) = ∑ i = 0 N R w i * ( 1 - Sim ( j , X i + ) ) ; where j is the subject image; N R is a number of images in the set of example images; X i + , i=1, . . . N R is defined as the i th image; w i is the normalized weight of the images in the set of example images.
Claim 14
Dependent Claim
33 words
A method as recited in claim 10 further comprising repeating the defining for each example image in a set of example images and for each subject image in a set of subject images.
Claim 15
Dependent Claim
55 words
A method as recited in claim 10 further comprising: repeating the defining for each example image in a set of example images and for each subject image in a set of subject images; ranking similarly of each subject image in the set of subject images to each example image in the set of example images.
Claim 16
Dependent Claim
26 words
A computer comprising one or more computer-readable media having computer-executable instructions that, when executed by the computer, perform the method as recited in claim 10 .
Claim 17
Dependent Claim
21 words
A computer-readable medium having computer-executable instructions that, when executed by a computer, performs the method as recited in claim 10 .
Claim 18
Independent Claim
249 words
A system for improving iterative results of Content-Based Image Retrieval (CBIR) using relevance feedback, the system comprising: a relevance feedback sub-system configured to obtain a set of positive feedback images and a set of negative feedback images via relevance feedback, the set of positive feedback images are those images deemed semantically relevant and the set of negative feedback images are those deemed semantically less relevant; a feedback analyzer configured, within a feature space, to: move a positive candidate images towards the set of positive feedback images by adjusting distance metrics of the positive candidate image, the positive candidate image having similar low-level features as those of the set of positive feedback images, wherein the adjusting of distance metric of the positive candidate image employs this evaluation: Dis ( j ) = ∑ i = 0 N R w i * ( 1 - Sim ( j , X i + ) ) ; where j is the positive candidate image; N R is a number of images in the set of positive feedback images; X i + , i=1, . . . N R is defined as the i th image; w i is the normalized weight of the images in the set of positive feedback images; distance a negative candidate image from the set of positive feedback images by adjusting distance metrics of the negative candidate images, the negative candidate image having similar low-level features as those of the set of negative feedback images.
Claim 19
Independent Claim
249 words
A system for improving iterative results of Content-Based Image Retrieval (CBIR) using relevance feedback, the system comprising: a relevance feedback sub-system configured to obtain a set of positive feedback images and a set of negative feedback images via relevance feedback, the set of positive feedback images are those images deemed semantically relevant and the set of negative feedback images are those deemed semantically less relevant; a feedback analyzer configured, within a feature space, to: move a positive candidate images towards the set of positive feedback images by adjusting distance metrics of the positive candidate image, the positive candidate image having similar low-level features as those of the set of positive feedback images, wherein the adjusting of distance metric of the positive candidate image employs this evaluation: Dis ( j ) = ∑ i = 0 N R w i * ( 1 - Sim ( j , X i + ) ) ; where j is the positive candidate image; N R is a number of images in the set of positive feedback images; X i + , i=1, . . . N R is defined as the i th image; w i is the normalized weight of the images in the set of positive feedback images; distance a negative candidate image from the set of positive feedback images by adjusting distance metrics of the negative candidate images, the negative candidate image having similar low-level features as those of the set of negative feedback images.
Claim 20
Dependent Claim
29 words
A system as recited in claim 15 , wherein the feedback analyzer is further configured to construct a Bayesian classifier of a positive feedback image by positive candidate images.
Claim 21
Dependent Claim
42 words
A system as recited in claim 15 , wherein the feedback analyzer is further configured to define a subject image to be similar to an example image because it is within a minimal distance of the example image within a feature space.
Claim 22
Independent Claim
270 words
A system for improving iterative results of Content-Based Image Retrieval (CBIR) using relevance feedback, the system comprising: a memory comprising a set of computer program instructions; and a processor coupled to the memory, the processor being configured to execute the computer program instructions, which comprise: obtaining a set of positive feedback images and a set of negative feedback images via relevance feedback, the set of positive feedback images are those images deemed semantically relevant and the set of negative feedback images are those deemed semantically less relevant; within a feature space, moving a positive candidate image towards the set of positive feedback images by adjusting distance metrics of the positive candidate image, the positive candidate image having similar low-level features as those of the set of positive feedback images, wherein the adjusting of distance metrics of the positive candidate image employs this evaluation: Dis ( j ) = ∑ i = 0 N R w i * ( 1 - Sim ( j , X i + ) ) ; where j is the positive candidate image; N R is a number of images in the set of positive feedback images; X i + , i=1, . . . N R is defined as the i th image; w i is the normalized weight of the images in the set of positive feedback images; within a feature space, distancing a negative candidate image from the set of positive feedback images by adjusting distance metrics of the negative candidate image, the negative candidate images having similar low-level features as those of the set of negative feedback images.
Claim 23
Independent Claim
270 words
A system for improving iterative results of Content-Based Image Retrieval (CBIR) using relevance feedback, the system comprising: a memory comprising a set of computer program instructions; and a processor coupled to the memory, the processor being configured to execute the computer program instructions, which comprise: obtaining a set of positive feedback images and a set of negative feedback images via relevance feedback, the set of positive feedback images are those images deemed semantically relevant and the set of negative feedback images are those deemed semantically less relevant; within a feature space, moving a positive candidate image towards the set of positive feedback images by adjusting distance metrics of the positive candidate image, the positive candidate image having similar low-level features as those of the set of positive feedback images, wherein the adjusting of distance metrics of the positive candidate image employs this evaluation: Dis ( j ) = ∑ i = 0 N R w i * ( 1 - Sim ( j , X i + ) ) ; where j is the positive candidate image; N R is a number of images in the set of positive feedback images; X i + , i=1, . . . N R is defined as the i th image; w i is the normalized weight of the images in the set of positive feedback images; within a feature space, distancing a negative candidate image from the set of positive feedback images by adjusting distance metrics of the negative candidate image, the negative candidate images having similar low-level features as those of the set of negative feedback images.
Claim 24
Dependent Claim
31 words
A system as recited in claim 18 , wherein the properties of valid input indicate parameters of input by defining boundary delimitations of such parameters and define assumptions regarding such parameters.
References Cited (Backward Citations)
US5442778A
Cited
US5751286A
Cited
US5619709A
Cited
US5873056A
Cited
US5855015A
Cited
US5893095A
Cited
US6282549B1
Cited
US5899999A
Cited
US5889506A
Cited
US6038560A
Cited
US6134532A
Cited
US5987457A
Cited
US6175829B1
Cited
US6094652A
Cited
US6345274B1
Cited
US6020955A
Cited
US6189002B1
Cited
US6567797B1
Cited
US6347313B1
Cited
US6510406B1
Cited
US6304864B1
Cited
US6311194B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-06-08 | 2007-12-08 | 2008-06-08 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-06-08 | 2011-12-08 | 2012-06-08 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-06-08 | 2015-12-08 | 2016-06-08 | $7700.00 | Window Closed / Lapsed |