Annotating images

Claim 3

The method of claim 1 , wherein the input image is stored in the digital data repository in an image file including the plurality of image labels as metadata.

Claim 4

The method of claim 1 , wherein the collection of digital images comprises a plurality of reference images, and wherein identifying the plurality of nearest neighbor images comprises: determining, for each reference image, a corresponding whole-image distance representing a degree of difference between the input image and the reference image; and identifying reference images closest to the input image, as measured by the whole-image distances, as the plurality of nearest neighbors.

Claim 5

The method of claim 1 , wherein ranking of the one or more second image labels comprises sorting the one or more second image labels according to a local frequency of each of the second image labels in the one or more remaining nearest neighbor images.

Claim 6

The method of claim 3 , wherein the whole-image distance comprises a combination of feature distances, each feature distance representing a degree of difference between an image feature associated with the input image and a corresponding image feature associated with the corresponding reference image.

Claim 7

The method of claim 5 , wherein at least one image feature is a global image feature extracted from both the input image and the reference image.

Claim 8

The method of claim 5 , wherein at least one image feature is a local image feature extracted from both the input image and the reference image.

Claim 9

The method of claim 5 , wherein each feature distance is weighted equally in the whole-image distance.

Claim 10

The method of claim 5 , wherein two or more feature distances are weighted differently from one another in the whole-image distance.

Claim 11

The method of claim 5 , further comprising: calculating a weighting for each of the feature distances based on the collection of digital images, wherein the collection of digital images is a group of training images comprising pairs of similar and dissimilar images.

Claim 12

The method of claim 5 , further comprising: calculating at least one of the feature distances as a difference between a texture feature of the input image and a corresponding texture feature of the corresponding reference image.

Claim 13

The method of claim 5 , further comprising: calculating at least one of the feature distances as a difference between a color feature of the input image and a corresponding color feature of the corresponding reference image.

Claim 16

The system of claim 13 , wherein the collection of digital images comprises a plurality of reference images, and wherein identifying the plurality of nearest neighbor images comprises: determining, for each reference image, a corresponding whole-image distance representing a degree of difference between the input image and the reference image; and identifying the reference images closest to the input image, as measured by the whole-image distances, as the plurality of nearest neighbors.

Claim 17

The system of claim 13 , wherein ranking of the one or more second image labels comprises sorting the one or more second image labels according to a local frequency of each of the second image labels in the one or more remaining nearest neighbor images.

Claim 18

The system of claim 14 , wherein the whole-image distance comprises a combination of feature distances, each feature distance representing a degree of difference between an image feature associated with the input image and a corresponding image feature associated with the corresponding reference image.

Claim 19

The system of claim 16 , wherein at least one image feature is a global image feature extracted from both the input image and the reference image.

Claim 20

The system of claim 16 , wherein at least one image feature is a local image feature extracted from both the input image and the reference image.

Claim 21

The system of claim 16 , wherein each feature distance is weighted equally in the whole-image distance.

Claim 22

The system of claim 16 , wherein two or more feature distances are weighted differently from one another in the whole-image distance.

Claim 23

The system of claim 16 , wherein the server is operable to perform operations further comprising: calculating a weighting for each of the feature distances based on the collection of digital images, wherein the collection of digital images is a group of training images comprising pairs of similar and dissimilar images.

Claim 24

The system of claim 16 , wherein the server is operable to perform operations further comprising: calculating at least one of the feature distances as a difference between a texture feature of the input image and a corresponding texture feature of the corresponding reference image.

Claim 25

The system of claim 16 , wherein the server is operable to perform operations further comprising: calculating at least one of the feature distances as a difference between a color feature of the input image and a corresponding color feature of the corresponding reference image.

Claim 26

A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising: receiving an input image in the data processing apparatus; identifying a plurality of nearest neighbor images of the input image from among a collection of digital images stored on computer-readable media by operation of the data processing apparatus, wherein each of the one or more nearest neighbor images is associated with a respective one or more image labels; assigning a plurality of image labels to the input image, wherein the plurality of image labels are selected by the data processing apparatus from the image labels associated with the nearest neighbor images, ranking one or more first image labels according to a respective frequency of occurrence in the collection of digital images, wherein each of the one or more first image labels is associated with a first nearest neighbor image; ranking one or more second image labels, each of the second image labels being associated with one or more remaining nearest neighbor images, wherein ranking of the one or more second image labels comprises sorting the one or more second image labels according to a co-occurrence of each of the second image labels with each first image label in the collection of digital images, and wherein assigning the plurality of image labels comprises (1) assigning at least one of the first image labels to the input image based on the ranking of the one or more first image labels and (2) assigning at least one of the second image labels to the input image based on the ranking of the one or more second image labels; and storing in a digital data repository the input image having the assigned plurality of image labels.

Claim 27

A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising: receiving an input image in the data processing apparatus; identifying a plurality of nearest neighbor images of the input image from among a collection of digital images stored on computer-readable media by operation of the data processing apparatus, wherein each of the one or more nearest neighbor images is associated with a respective one or more image labels; assigning a plurality of image labels to the input image, wherein the plurality of image labels are selected by the data processing apparatus from the image labels associated with the nearest neighbor images, ranking one or more first image labels according to a respective frequency of occurrence in the collection of digital images, wherein each of the one or more first image labels is associated with a first nearest neighbor image; ranking one or more second image labels, each of the second image labels being associated with one or more remaining nearest neighbor images, wherein ranking of the one or more second image labels comprises sorting the one or more second image labels according to a co-occurrence of each of the second image labels with each first image label in the collection of digital images, and wherein assigning the plurality of image labels comprises (1) assigning at least one of the first image labels to the input image based on the ranking of the one or more first image labels and (2) assigning at least one of the second image labels to the input image based on the ranking of the one or more second image labels; and storing in a digital data repository the input image having the assigned plurality of image labels.

Claim 28

The computer storage medium of claim 24 , wherein the collection of digital images comprises a plurality of reference images, and wherein identifying the plurality of nearest neighbor images comprises: determining, for each reference image, a corresponding whole-image distance representing a degree of difference between the input image and the reference image; and identifying one or more reference images closest to the input image, as measured by the whole-image distances, as the plurality of nearest neighbors.

Claim 29

The computer storage medium of claim 24 , wherein ranking of the one or more second image labels comprises sorting the one or more second image labels according to a local frequency of each of the second image labels in the one or more remaining nearest neighbor images.

Claim 30

The computer storage medium of claim 25 , wherein the whole-image distance comprises a combination of feature distances, each feature distance representing a degree of difference between an image feature associated with the input image and a corresponding image feature associated with the corresponding reference image.

Claim 31

The computer storage medium of claim 27 , wherein at least one image feature is a global image feature extracted from both the input image and the reference image.

Claim 32

The computer storage medium of claim 27 , wherein at least one image feature is a local image feature extracted from both the input image and the reference image.

Claim 33

The computer storage medium of claim 27 , wherein each feature distance is weighted equally in the whole-image distance.

Claim 34

The computer storage medium of claim 27 , wherein two or more feature distances are weighted differently from one another in the whole-image distance.

Claim 35

The computer storage medium of claim 27 , operable to cause data processing apparatus to perform operations further comprising: calculating a weighting for each of the feature distances based on the collection of digital images, wherein the collection of digital images is a group of training images comprising pairs of similar and dissimilar images.

Claim 36

The computer storage medium of claim 27 , operable to cause data processing apparatus to perform operations further comprising: calculating at least one of the feature distances as a difference between a texture feature of the input image and a corresponding texture feature of the corresponding reference image.

Claim 37

The computer storage medium of claim 27 , operable to cause data processing apparatus to perform operations further comprising: calculating at least one of the feature distances as a difference between a color feature of the input image and a corresponding color feature of the corresponding reference image.