System and method for segmentation of images of objects that are occluded by a semi-transparent material

Claim 2

A computer imaging system, having one or more memories and one or more central processing units (CPU), the system segmenting images of one or more objects from a background image, the system comprising: one or more image acquisition units that acquire the background image and a combined image of one or more of the objects in front of the background image, the background image and the combined image having two or more spectral bands and being stored in one or more of the memories; an intensity transform that isolates a light intensity component from each of the combined image and background image, so that a relative reflectance value for each of the spectral bands in both the combined image and background image remains; and a comparison process that performs a pixel by pixel comparison to determine a set of locations where the relative reflectance values differ between the combined image and background image, the set of locations representing a portion of the combined image corresponding to the objects without the background.

Claim 3

A system, as in claim 1 , where the relative reflectance value includes any one or more of the following: a hue, a saturation, a normalized color component, a combination of a hue and a saturation, a set of hues, a set of saturations, and a set of combined hues and saturations.

Claim 4

A system, as in claim 1 , where the intensity transform includes any one or more of the following: HSI, HSV, color component ratios, fractional color components, CIE L*u*v* hue angle and saturation, and CIE L*a*b* hue angle and saturation.

Claim 5

A computer imaging system, having one or more memories and one or more central processing units (CPU), the system segmenting images of one or more objects from a background image, the system comprising: one or more image acquisition units that acquire the background imaged and a combined image of one or more of the objects in front of the background image, the background image and the combined image having two or more spectral bands and being stored in one or more of the memories; a normalization function that normalizes the background image and the combined image so that corresponding pixels have the same response in both images; an intensity transform that isolates a light intensity component from each of the combined image and background image, so that a pixel-wise reflectance value for each of the spectral bands in both the combined image and background image remains; and a comparison process that performs a pixel by pixel comparison to determine a set of locations where the reflectance values are dissimilar in the combined image and background image, the set of locations representing a portion of the combined image corresponding to the objects without the background.

Claim 6

A computer imaging system, having one or more memories and one or more central processing units (CPU), the system segmenting images of one or more objects from a background image, the system comprising: one or more image acquisition units that acquire the background imaged and a combined image of one or more of the objects in front of the background image, the background image and the combined image having two or more spectral bands and being stored in one or more of the memories; a normalization function that normalizes the background image and the combined image so that corresponding pixels have the same response in both images; an intensity transform that isolates a light intensity component from each of the combined image and background image, so that a pixel-wise reflectance value for each of the spectral bands in both the combined image and background image remains; and a comparison process that performs a pixel by pixel comparison to determine a set of locations where the reflectance values are dissimilar in the combined image and background image, the set of locations representing a portion of the combined image corresponding to the objects without the background.

Claim 7

A system, as in claim 4 , where the correspondence determination of the normalization function includes any one or more of the following: a) pixels having the same image location in the combined image and the background image and the location having no image of the object, and b) a correspondence between two or more sets of pixel locations where the regions imaged are known to have the same response.

Claim 8

A system, as in claim 4 , where the response includes any one or more of the follow: a hue value, a saturation value, a combination of one or more hues and a saturation value, and a combination of one or more hues, a saturation, and an intensity value.

Claim 9

A system, as in claim 4 , where the pixel-wise reflectance value includes any one or more of the following: a hue, a saturation, a normalized color component, a combination of a hue and a saturation, a set of hues, and a set of combined hues and a saturation.

Claim 10

A system, as in claim 4 , where the intensity transform includes any one or more of the following: HSI, HSV, color component ratios, fractional color components, CIE L*u*v* hue angle and saturation, and CIE L*a*b* hue angle and saturation.

Claim 11

A computer imaging system, having one or more memories and one or more central processing units (CPU), the system segmenting images of one or more objects from a background image, the system comprising: one or more image acquisition units that acquire the background imaged and a combined image of one or more of the objects in front of the background image, the background image and the combined image having two or more spectral bands and being stored in one or more of the memories; a normalization function that normalizes the background image and the combined image so that corresponding pixels have the same response in both images; an intensity transform that isolates a light intensity component from each of the combined image and background image, so that a pixel-wise reflectance value for each of the spectral bands in both the combined image and background image remains, the intensity transform also providing an intensity value for the associated pixel; and a comparison process that performs a pixel by pixel comparison to determine a set of locations where any of the reflectance values and associated intensity value are dissimilar in the combined image and background image, the set of locations representing a portion of the combined image corresponding to the objects without the background.

Claim 12

A computer imaging system, having one or more memories and one or more central processing units (CPU), the system segmenting images of one or more objects from a background image, the system comprising: one or more image acquisition units that acquire the background imaged and a combined image of one or more of the objects in front of the background image, the background image and the combined image having two or more spectral bands and being stored in one or more of the memories; a normalization function that normalizes the background image and the combined image so that corresponding pixels have the same response in both images; an intensity transform that isolates a light intensity component from each of the combined image and background image, so that a pixel-wise reflectance value for each of the spectral bands in both the combined image and background image remains, the intensity transform also providing an intensity value for the associated pixel; and a comparison process that performs a pixel by pixel comparison to determine a set of locations where any of the reflectance values and associated intensity value are dissimilar in the combined image and background image, the set of locations representing a portion of the combined image corresponding to the objects without the background.

Claim 13

A system, as in claim 9 , further comprising a cleaning process that removes pixels from the set of locations where the saturation value of the pixels is different from an average saturation value of the pixels in the set by more than a saturation threshold.

Claim 14

A system, as in claim 9 , further comprising a cleaning process that removes pixels from the set of locations where the intensity value of the pixels is different from an average intensity value of the pixels in the set by more than an intensity threshold.

Claim 15

A system, as in claim 9 , further comprising a smoothing process that adds pixels to the set of locations where local density of foreground pixels exceeds a first smoothing threshold in order to smooth the boundary.

Claim 16

A system, as in claim 9 , comprising a smoothing process that removes pixels from the set of locations where local density of foreground pixels falls below a second smoothing threshold in order to smooth the boundary.

Claim 17

A system, as in claim 9 , further comprising a connecting process comprising the steps of: determining a set of foreground connected components on the set of locations: determining the area of each of the foreground connected components; and removing any component that has an area less than a percentage of the area of the largest component in order to eliminate one or more outlying portions of the set of locations.

Claim 18

A system, as in claim 9 , further comprising a connecting process comprising the steps of: determining a set of foreground and background connected components on the set of locations: determining the area of the foreground and background connected components; and adding to the foreground set of locations any background component that has an area less than a percentage of the area of the largest foreground component in order to fill in one or more holes in the set of locations.

Claim 21

A computer imaging system, having one or more memories and one or more central processing units (CPU), the system segmenting images of one or more objects from a background image, the system comprising: means for acquiring the background image and a combined image of one or more of the objects in front of the background image, the background image and the combined image having two or more spectral bands and being stored in one or more of the memories; means for isolating a light intensity component from each of the combined image and background image, so that a relative reflectance value for each of the spectral bands in both the combined image and background image remains; and means for performing a pixel by pixel comparison to determine a set of locations where the relative reflectance values that differ between the combined image and background image, the set of locations representing a portion of the combined image corresponding to the objects without the background.

Claim 22

A computer imaging system, having one or more memories and one or more central processing units (CPU), the system segmenting images of one or more objects from a background image, the system comprising: means for acquiring the background image and a combined image of one or more of the objects in front of the background image, the background image and the combined image having two or more spectral bands and being stored in one or more of the memories; means for isolating a light intensity component from each of the combined image and background image, so that a relative reflectance value for each of the spectral bands in both the combined image and background image remains; and means for performing a pixel by pixel comparison to determine a set of locations where the relative reflectance values that differ between the combined image and background image, the set of locations representing a portion of the combined image corresponding to the objects without the background.

Claim 23

A computer program product having a method comprising the steps of: acquiring the background imaged and a combined image of one or more of the objects in front of the background image, the background image and the combined image having two or more spectral bands and being stored in one or more of the memories; isolating a light intensity component from each of the combined image and background image, so that a relative reflectance value for each of the spectral bands in both the combined image and background image remains; and performing a pixel by pixel comparison to determine a set of locations where the relative reflectance values differ between the combined image and background image, the set of locations representing a portion of the combined image corresponding to the objects without the background.

Claim 24

A computer program product having a method comprising the steps of: acquiring the background imaged and a combined image of one or more of the objects in front of the background image, the background image and the combined image having two or more spectral bands and being stored in one or more of the memories; isolating a light intensity component from each of the combined image and background image, so that a relative reflectance value for each of the spectral bands in both the combined image and background image remains; and performing a pixel by pixel comparison to determine a set of locations where the relative reflectance values differ between the combined image and background image, the set of locations representing a portion of the combined image corresponding to the objects without the background.