Patent US4984072A successfully refreshed from Google Patents.
US4984072A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System and method for color image enhancement
Assignee: WETZLER LEONARD
•
Filing: 1988-07-25
•
Granted: 1991-01-08
•
Expires: 2008-07-25
Abstract
Abstract A system and method for color enhancing an image or a series of images such as a motion picture by digitally capturing the images, interactively defining masks corresponding to objects in the images having similar hues, creating regions from these masks, and for each region, defining a color transfer function for converting image gray-scale information to unique values of Hue, Luminance, and Saturation. The gray-scale values within each region are then processed through that region's color transfer function, and the resulting colors applied to the image and stored for later retrieval and display.
Inventors
- 👤 Barry B. Sandrew
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 13:03
CPC Classifications
G; G06; G06T; G06T11/00; G06T11/10; H; H04; H04N; H04N9/00; H04N9/11
Claims Analysis
Total Claims: 44
Claim 1
Independent Claim
149 words
A method of color enhancing an image comprising the steps of: a. capturing the image digitally, as a series of picture elements, each having a gray-scale value representative of its brightness; b. defining on or more masks, each comprising one or more closed regions of picture elements representative of one or more operator-perceived objects within the image having the same operator-designated hue; c. defining a color transfer function for each of said masks identifying each of said picture element gray-scale values within each of said masks with a unique combination of hue, luminance, and saturation values; d. applying said color transfer function for each of said masks to said corresponding picture element gray-scale values, thereby deriving unique combinations of hue, saturation, and luminance values corresponding to each gray-scale value; and e. assigning said derived hue, saturation, and luminance values to said picture elements corresponding to each of said masks.
Claim 2
Independent Claim
149 words
A method of color enhancing an image comprising the steps of: a. capturing the image digitally, as a series of picture elements, each having a gray-scale value representative of its brightness; b. defining on or more masks, each comprising one or more closed regions of picture elements representative of one or more operator-perceived objects within the image having the same operator-designated hue; c. defining a color transfer function for each of said masks identifying each of said picture element gray-scale values within each of said masks with a unique combination of hue, luminance, and saturation values; d. applying said color transfer function for each of said masks to said corresponding picture element gray-scale values, thereby deriving unique combinations of hue, saturation, and luminance values corresponding to each gray-scale value; and e. assigning said derived hue, saturation, and luminance values to said picture elements corresponding to each of said masks.
Claim 3
Dependent Claim
21 words
The method of claim 1 wherein said picture element gray-scale values are modified prior to step (d) by stretching the gray-scale.
Claim 4
Dependent Claim
21 words
The method of claim 1 wherein said picture element gray-scale values are modified prior to step (d) by compressing the gray-scale.
Claim 5
Dependent Claim
21 words
The method of claim 1 wherein said picture element gray-scale values are modified prior to step (d) by sliding the gray-scale.
Claim 6
Dependent Claim
93 words
The method of claim 1, step (c) further comprising the steps of: a. selecting an arbitrary operator-defined hue value intended for application to the picture elements corresponding to each of said masks; b. selecting a range of luminance values representative of the brightness of said picture elements corresponding to each of said masks; c. selecting a range of saturation values representative of the saturations of the picture elements corresponding to each of said masks; d. constructing a predetermined color transfer function relating said range of luminance values to said range of saturation values.
Claim 7
Dependent Claim
80 words
The method of claim 5 further comprising: for at least one operator-defined mask, for which an operator defined arbitrarily selected hue value has been designated in accordance with step (a) of claim 5, selecting at least one arbitrary second hue value representative of an operator-designated hue of an illumination source; and wherein step (d) of claim 5 further comprises constructing a predetermined hue-luminance-saturation transfer function relating said ranges of saturation and luminance values to said first and second hue values.
Claim 8
Dependent Claim
83 words
The method of claim 1, step (c) further comprising the steps of: a. selecting a luminance value representative of the average brightness of the picture elements corresponding to said mask; b. selecting a range of hue values representative of the hues of said picture elements corresponding to said mask; c. selecting a range of saturation values representative of the saturations corresponding to said mask; d. constructing a predetermined hue-saturation transfer function relating said range of hue values to said range of saturation values.
Claim 9
Dependent Claim
32 words
The method of claim 1 wherein at least one of said regions is defined by manually designating the bounds of one or more areas using a pointing device to define a mask.
Claim 10
Independent Claim
247 words
A method of color enhancing a series of image frames comprising the steps of: a. capturing and storing each image frame digitally, as a series of picture elements, each having a gray-scale value representative of its brightness; b. designating one of said captured frames as a key frame; c. using said key frame, defining one or more maps, each comprising one or more closed regions of picture elements representative of one or more objects designated to have the same hue; d. defining for at least one of said maps a color transfer function identifying said picture element gray-scale values with unique combinations of hue, luminance, and saturation values; e. correlating said picture element gray-scale values to said color transfer function, thereby deriving unique hue, saturation, and luminance values corresponding to each gray-scale value, and f. assignign said hue, saturation, and luminance values to said picture elements comprising said map; g. storing said map in association with said key frame; h. sequentially recalling said stored image frames, and for each frame: i. comparing said recalled frame with the preceding frame, to determine differences in the locations of said objects; j. establishing a modified map by modifying a copy of each of said maps by selective deletion of picture elements which no longer define said objects, and addition of picture elements which define said objects, in accordance with said determined differences in the locations of said objects,; and k. storing said modified maps in association with said recalled frames.
Claim 11
Independent Claim
247 words
A method of color enhancing a series of image frames comprising the steps of: a. capturing and storing each image frame digitally, as a series of picture elements, each having a gray-scale value representative of its brightness; b. designating one of said captured frames as a key frame; c. using said key frame, defining one or more maps, each comprising one or more closed regions of picture elements representative of one or more objects designated to have the same hue; d. defining for at least one of said maps a color transfer function identifying said picture element gray-scale values with unique combinations of hue, luminance, and saturation values; e. correlating said picture element gray-scale values to said color transfer function, thereby deriving unique hue, saturation, and luminance values corresponding to each gray-scale value, and f. assignign said hue, saturation, and luminance values to said picture elements comprising said map; g. storing said map in association with said key frame; h. sequentially recalling said stored image frames, and for each frame: i. comparing said recalled frame with the preceding frame, to determine differences in the locations of said objects; j. establishing a modified map by modifying a copy of each of said maps by selective deletion of picture elements which no longer define said objects, and addition of picture elements which define said objects, in accordance with said determined differences in the locations of said objects,; and k. storing said modified maps in association with said recalled frames.
Claim 12
Independent Claim
153 words
A system for color enhancing an image comprising: a. means for capturing the image digitally, as a series of picture elements, each having a gray-scale value representative of its brightness; b. means for defining one or more masks, each comprising one or more closed regions of picture elements representative of one or more operator-perceived objects within the image having the same operator-designated hue; c. means for defining a color transfer function for each of said masks identifying said picture element gray-scale values within each of said masks with unique combinations of hue, luminance, and saturation values; d. means for applying said color transfer function for each of said masks to said corresponding picture element gray-scale values, thereby deriving unique combinations of hue, saturation, and luminance values corresponding to each gray-scale value; and e. means for assigning said derived hue, saturation, and luminance values to said picture elements corresponding to each of said masks.
Claim 13
Independent Claim
153 words
A system for color enhancing an image comprising: a. means for capturing the image digitally, as a series of picture elements, each having a gray-scale value representative of its brightness; b. means for defining one or more masks, each comprising one or more closed regions of picture elements representative of one or more operator-perceived objects within the image having the same operator-designated hue; c. means for defining a color transfer function for each of said masks identifying said picture element gray-scale values within each of said masks with unique combinations of hue, luminance, and saturation values; d. means for applying said color transfer function for each of said masks to said corresponding picture element gray-scale values, thereby deriving unique combinations of hue, saturation, and luminance values corresponding to each gray-scale value; and e. means for assigning said derived hue, saturation, and luminance values to said picture elements corresponding to each of said masks.
Claim 14
Independent Claim
191 words
A method of color enhancing a source image comprising the steps of: a. recording said source image digitally, as a first series of picture elements, each having a gray-scale value representative of its brightness; b. defining a first series of one or more masks within said source image, each comprising one or more closed regions of picture elements representative of one or more operator-perceived objects within the image having the same operator-designated hue; c. defining a color transfer function for each of said masks identifying said picture element gray-scale values with unique combinations of hue, luminance, and saturation values; d. applying said color transfer function to each of said picture element gray-scale values, thereby deriving unique combinations of hue, saturation, and luminance values corresponding to each gray-scale value; and e. assigning said derived hue, saturation, and luminance values to a second series of picture elements in a second series of masks, each such mask corresponding in shape, size and position to a mask in said first series of masks, and storing said assigned values for said picture elements of said second series of masks as a recording of an output image.
Claim 15
Independent Claim
191 words
A method of color enhancing a source image comprising the steps of: a. recording said source image digitally, as a first series of picture elements, each having a gray-scale value representative of its brightness; b. defining a first series of one or more masks within said source image, each comprising one or more closed regions of picture elements representative of one or more operator-perceived objects within the image having the same operator-designated hue; c. defining a color transfer function for each of said masks identifying said picture element gray-scale values with unique combinations of hue, luminance, and saturation values; d. applying said color transfer function to each of said picture element gray-scale values, thereby deriving unique combinations of hue, saturation, and luminance values corresponding to each gray-scale value; and e. assigning said derived hue, saturation, and luminance values to a second series of picture elements in a second series of masks, each such mask corresponding in shape, size and position to a mask in said first series of masks, and storing said assigned values for said picture elements of said second series of masks as a recording of an output image.
Claim 16
Dependent Claim
95 words
The method of claim 1, step (d) further comprising the steps of: (a) determining whether said unique saturation value which corresponds to said picture element gray-scale value is beyond a maximum saturation value limit which approximates the maximum, visually perceivable saturation value for said unique luminance value which corresponds to said picture element gray-scale value; and (b) assigning said maximum saturation value as a new saturation value for said picture element if said unique saturation value is beyond the maximum saturation value for said unique luminance values which corresponds to said picture element gray-scale value.
Claim 17
Dependent Claim
30 words
The method of claim 12, wherein the new saturation value is black if said unique luminance value is less than 500 on a luminance scale ranging from 0 to 1000.
Claim 18
Dependent Claim
30 words
The method of claim 12, wherein the new saturation value is white if said unique luminance value is greater than 500 on a luminance scale ranging from 0 to 1000.
Claim 19
Dependent Claim
31 words
The method of claim 12, wherein said maximum saturation values for all unique luminance values defines a boundary for a double conic space in a hue, luminance, saturation (HLS) coordinate system.
Claim 20
Dependent Claim
30 words
The method of claim 15, wherein said double conic space is symmetrical about a central point located midway between a maximum unique luminance value and a minimum unique luminance value.
Claim 21
Dependent Claim
16 words
The method of claim 15, wherein said double conic space is asymmetrical about said central point.
Claim 22
Dependent Claim
31 words
The method of claim 17, wherein each cone in said asymmetrical double conic space has a base and an apex and the base-to-apex distance is different for each of said cones.
Claim 23
Dependent Claim
52 words
The method of claim 6 wherein said predetermined hue-luminance-saturation transfer function is adapted to cause the hue values of said operator defined mask to be displayed in brighter portions thereof as if said operator defined mask hue value was the hue value of said operator designated hue value of an illumination source.
Claim 24
Independent Claim
75 words
A system for coloring a monochrome image having a plurality of regions comprising: a. means for digitally storing said image as a multiplicity of pixels, each represented by a specific gray scale value; b. means for storing a product of a separate color transfer function for each of said regions; and c. means for digitally storing, for each pixel, a region identifier by which one of said color transfer functions is associated with said pixel.
Claim 25
Independent Claim
75 words
A system for coloring a monochrome image having a plurality of regions comprising: a. means for digitally storing said image as a multiplicity of pixels, each represented by a specific gray scale value; b. means for storing a product of a separate color transfer function for each of said regions; and c. means for digitally storing, for each pixel, a region identifier by which one of said color transfer functions is associated with said pixel.
Claim 26
Dependent Claim
23 words
The system of claim 20 wherein said color transfer function is constructed of operator manipulated relationships of hue, luminance, saturation and gray-scale values.
Claim 27
Dependent Claim
26 words
The system of claim 20 wherein (a) and (c) are part of a multi-bit memory structure comprising a first memory structure and a second memory structure.
Claim 28
Dependent Claim
34 words
The system of claim 22 wherein for each pixel of said image, said first memory structure contains an 8 bit gray-scale value and said second memory structure contains a 4 bit region identifier value.
Claim 29
Dependent Claim
26 words
The system of claim 22 further comprising an additional memory structure adapted to contain pixel identification information designating which pixels are identified with a particular region.
Claim 30
Dependent Claim
90 words
The system of claim 20 wherein a. said color transfer functions are constructed of operator manipulated relationships of hue, luminance, saturation and gray-scale values; b. (a) and (c) of claim 23, are part of a multi-bit memory structure comprising, for each pixel, a first memory structure containing an 8 bit of gray-scale value and a second memory structure containing a 4 bit region identifier value; and c. an additional one-bit memory structure adapted to contain, for each pixel, pixel identification information designating which pixels are identified with a particular region.
Claim 31
Independent Claim
58 words
A system for coloring a monochrome image having a plurality of regions comprising: a. means for digitally storing said image as a multiplicity of pixels, each represented by a specific gray scale value; and b. means for digitally storing, for each pixel, a region identifier by which each of said pixels is associated with one of said regions.
Claim 32
Independent Claim
58 words
A system for coloring a monochrome image having a plurality of regions comprising: a. means for digitally storing said image as a multiplicity of pixels, each represented by a specific gray scale value; and b. means for digitally storing, for each pixel, a region identifier by which each of said pixels is associated with one of said regions.
Claim 33
Dependent Claim
31 words
The system of claim 26 wherein a color transfer function is associated with each of said regions and is constructed of operator manipulated relationships of hue, luminance, saturation and gray-scale values.
Claim 34
Dependent Claim
26 words
The system of claim 26 wherein (a) and (b) are part of a multi-bit memory structure comprising a first memory structure and a second memory structure.
Claim 35
Dependent Claim
34 words
The system of claim 28 wherein for each pixel of said image, said first memory structure contains an 8 bit gray-scale value and said second memory structure contains a 4 bit region identifier value.
Claim 36
Dependent Claim
26 words
The system of claim 28 further comprising an additional memory structure adapted to contain pixel identification information designating which pixels are identified with a particular region.
Claim 37
Dependent Claim
89 words
The system of claim 27 wherein a. said color transfer function is constructed of operator manipulated relationships of hue, luminance, saturation and gray-scale values; b. (a) and (b) of claim 29, are part of a multi-bit memory structure comprising, for each pixel, a first memory structure containing an 8 bit gray-scale value and a second memory structure containing a 4 bit region identifier value; and c. an additional one-bit memory structure adapted to contain, for each pixel, pixel identification information designating which pixel are identified with a particular region.
Claim 38
Independent Claim
60 words
A system for coloring a monochrome image having a plurality of regions comprising: a. means for digitally storing said image as a multiplicity of pixels, each represented by a specific gray scale value; and b. means for digitally storing, for each pixel, a region identifier by which one of a color transfer function is associated with each of said regions.
Claim 39
Independent Claim
60 words
A system for coloring a monochrome image having a plurality of regions comprising: a. means for digitally storing said image as a multiplicity of pixels, each represented by a specific gray scale value; and b. means for digitally storing, for each pixel, a region identifier by which one of a color transfer function is associated with each of said regions.
Claim 40
Dependent Claim
25 words
The system of claim 32 wherein each of said color transfer functions is constructed of operator manipulated relationships of hue, luminance, saturation and gray-scale values.
Claim 41
Dependent Claim
26 words
The system of claim 32 wherein (a) and (b) are part of a multi-bit memory structure comprising a first memory structure and a second memory structure.
Claim 42
Dependent Claim
34 words
The system of claim 34 wherein for each pixel of said image, said first memory structure contains an 8 bit gray-scale value and said second memory structure contains a 4 bit region identifier value.
Claim 43
Dependent Claim
26 words
The system of claim 34 further comprising an additional memory structure adapted to contain pixel identification information designating which pixels are identified with a particular region.
Claim 44
Dependent Claim
89 words
The system of claim 32 wherein a. said color transfer functions are constructed of operator manipulated relationships of hue, luminance, saturation and gray-scale values; b. (a) and (b) of claim 35, are part of a multi-bit memory structure comprising, for each pixel, a first memory structure containing an 8 bit gray-scale value and a second memory structure containing a 4 bit region identifier value; and c. an additional one-bit memory structure adapted to contain, for each pixel, pixel identification information designating which pixels are identified with a particular region.
References Cited (Backward Citations)
US2593925A
Cited
US2804500A
Cited
US2799722A
Cited
US2790844A
Cited
US2874212A
Cited
US2883763A
Cited
US2974190A
Cited
US2982814A
Cited
US3005042A
Cited
GB933938A
Cited
US3258528A
Cited
US3551589A
Cited
US3558811A
Cited
US3486242A
Cited
US3560644A
Cited
US3595987A
Cited
US3617626A
Cited
US3612755A
Cited
US3761607A
Cited
US3603962A
Cited
US3647942A
Cited
US3710011A
Cited
US3673317A
Cited
US3772465A
Cited
US3742125A
Cited
US3706841A
Cited
US3784736A
Cited
US3770885A
Cited
US3770884A
Cited
US3769458A
Cited
US3848856A
Cited
US3972067A
Cited
US4054904A
Cited
US3971068A
Cited
US4149185A
Cited
US4183046A
Cited
US4258385A
Cited
US4334240A
Cited
US4329710A
Cited
US4318121A
Cited
US4549172A
Cited
US4606625A
Cited
US4608596A
Cited
US4590511A
Cited
US4725879A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1994-01-07 | 1994-07-09 | 1995-01-08 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1998-01-07 | 1998-07-09 | 1999-01-08 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2002-01-07 | 2002-07-09 | 2003-01-08 | $7700.00 | Window Closed / Lapsed |