Method and apparatus for representing colored surfaces via a surface color code book

Claim 1

A method of forming a color code book comprising the steps: identifying a plurality of color surfaces; creating a representation of each of said color surfaces within an optimal color space, said optimal color space luminance and pose invariant; encoding said representation of each of said plurality of color surfaces assigning a label to each of said plurality of color surfaces; forming an association between each of said representations with a corresponding one of said labels, and forming a color code book by compiling together all said associations.

Claim 2

A method of forming a color code book comprising the steps: identifying a plurality of color surfaces; creating a representation of each of said color surfaces within an optimal color space, said optimal color space luminance and pose invariant; encoding said representation of each of said plurality of color surfaces assigning a label to each of said plurality of color surfaces; forming an association between each of said representations with a corresponding one of said labels, and forming a color code book by compiling together all said associations.

Claim 5

A method of forming a color book comprising the steps: identifying a plurality of color surfaces; assigning a corresponding label to each of said plurality of color surfaces; acquiring, within a first color space, a plurality of images for each of said plurality of color surfaces wherein an imaging condition of each of said plurality of images varies; determining a second color space; projecting each of said plurality of images into a second color space, said projecting comprising: projecting each of said plurality of images into an intermediate color space, calculating an optimal color space based upon a distribution of said plurality of images in said intermediate color space, and assigning said second color space equal to said optimal color space; based on said projections, encoding a representation of each of said plurality of color surfaces within said second color space; assigning a corresponding label to each of said plurality of color surfaces; for each of said plurality of color surfaces, forming an association between each of said representations and said assigned corresponding label, and forming a color code book by compiling together all said associations.

Claim 6

A method of forming a color book comprising the steps: identifying a plurality of color surfaces; assigning a corresponding label to each of said plurality of color surfaces; acquiring, within a first color space, a plurality of images for each of said plurality of color surfaces wherein an imaging condition of each of said plurality of images varies; determining a second color space; projecting each of said plurality of images into a second color space, said projecting comprising: projecting each of said plurality of images into an intermediate color space, calculating an optimal color space based upon a distribution of said plurality of images in said intermediate color space, and assigning said second color space equal to said optimal color space; based on said projections, encoding a representation of each of said plurality of color surfaces within said second color space; assigning a corresponding label to each of said plurality of color surfaces; for each of said plurality of color surfaces, forming an association between each of said representations and said assigned corresponding label, and forming a color code book by compiling together all said associations.

Claim 19

A method of forming a color code book comprising the steps: acquiring, within a first color space, a plurality of training images for each of said plurality of color surfaces wherein said plurality of training images are acquired under varying image conditions; forming a second color space having at least 4 dimensions; mapping each of said plurality of training images from said first color space to said second color space to form a first set of corresponding clusters of pixels; performing cluster analysis on said first set of corresponding clusters wherein two orthogonal vectors are identified which form a third color space; mapping each of said plurality of training images from said first color space into a second set of corresponding clusters within said third color space; creating a mathematical representation of each cluster in said second set of corresponding clusters; for a selected one surface of said plurality of color surfaces, forming a class code by grouping together said mathematical representations associated with all of said corresponding clusters belonging to said selected one surface, and repeating for each of said plurality of color surfaces; associating with each said class code a class label, and forming a color code book comprising each of said class codes and said associated class label.

Claim 20

A method of forming a color code book comprising the steps: acquiring, within a first color space, a plurality of training images for each of said plurality of color surfaces wherein said plurality of training images are acquired under varying image conditions; forming a second color space having at least 4 dimensions; mapping each of said plurality of training images from said first color space to said second color space to form a first set of corresponding clusters of pixels; performing cluster analysis on said first set of corresponding clusters wherein two orthogonal vectors are identified which form a third color space; mapping each of said plurality of training images from said first color space into a second set of corresponding clusters within said third color space; creating a mathematical representation of each cluster in said second set of corresponding clusters; for a selected one surface of said plurality of color surfaces, forming a class code by grouping together said mathematical representations associated with all of said corresponding clusters belonging to said selected one surface, and repeating for each of said plurality of color surfaces; associating with each said class code a class label, and forming a color code book comprising each of said class codes and said associated class label.

Claim 31

A system for forming a color code book comprising: a plurality of color surfaces; a semantic label assigned to each of said plurality of color surfaces; within a first color space a set of image patches for each of said plurality of color surfaces wherein each image member of said set represents a varying imaging condition; a luminance invariant color space said image patches mapped thereto; a second color space; a set of pixel clusters formed by projecting said members of said sets of mapped image patches from said first luminance invariant color space into second color space; a mathematical representation of each cluster member of said set of pixel clusters; a plurality of groupings of said mathematical representations wherein each grouping comprises all mathematical representations corresponding to said cluster members belonging to one of said plurality of color surfaces; a semantic label assigned to each of said plurality of color surfaces; for each semantic label, an association comprising said semantic label and one of said plurality of groupings wherein said one of said plurality of groupings corresponds to a one of said plurality of color surfaces having said each semantic label; a color code book which comprises a compilation of said associations.

Claim 32

A system for forming a color code book comprising: a plurality of color surfaces; a semantic label assigned to each of said plurality of color surfaces; within a first color space a set of image patches for each of said plurality of color surfaces wherein each image member of said set represents a varying imaging condition; a luminance invariant color space said image patches mapped thereto; a second color space; a set of pixel clusters formed by projecting said members of said sets of mapped image patches from said first luminance invariant color space into second color space; a mathematical representation of each cluster member of said set of pixel clusters; a plurality of groupings of said mathematical representations wherein each grouping comprises all mathematical representations corresponding to said cluster members belonging to one of said plurality of color surfaces; a semantic label assigned to each of said plurality of color surfaces; for each semantic label, an association comprising said semantic label and one of said plurality of groupings wherein said one of said plurality of groupings corresponds to a one of said plurality of color surfaces having said each semantic label; a color code book which comprises a compilation of said associations.