Patent US6563945B2 successfully refreshed from Google Patents.
← Back to Patent Explorer
US6563945B2 Expired / Lapsed US ⏱️ 0.0 years remaining

Pictorial digital image processing incorporating image and output device modifications

Assignee: Hewlett Packard Development Co LP
•
Filing: 2001-01-29
•
Granted: 2003-05-13
•
Expires: 2021-01-29
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Image-dependent tone and color reproduction processing of digital images is accomplished by creating a spatially blurred and sub-sampled version of the original image, and applying knowledge of the capture device physical characteristics to obtain statistics related to the scene or original captured. The statistics are used for image-dependent linearization of the captured image data based on an OECF model, and in conjunction with information about the output medium, to calculate image-specific preferred tone reproduction curves based on a preferred reproduction model. These curves may be applied to the red, green, and blue channels of RGB-type images to produce preferred tone and color reproduction, or to the luminance channel of luminance-chrominance type images to produce preferred tone reproduction. Alternately, the linearized image data may be reproduced directly. Also, if the original is assumed to already possess preferred reproduction, the preferred reproduction model may be used to undo the preferred reproduction on the original. The image data can then be processed for reproduction on output media with different density ranges and color gamuts. All the processing described can be accomplished automatically, but the access to accurate scene information afforded by the image-dependent linearization, and to the perceptually intuitive parameters controlling the calculation of the preferred reproduction curves, also allows for simple, intuitive manual adjustment.

Inventors

  • 👤 Jack M. Holm

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 13:02
CPC Classifications
H; H04; H04N; H04N1/00; H04N1/46; H04N1/56; H04N1/60; H04N1/6083; H04N1/6088; H04N1/40; H04N1/407; H04N1/4072; H04N1/6027; H04N1/603; H04N23/00; H04N23/80; H04N23/82; H04N23/83; H04N23/84; H04N23/88

Claims Analysis

Total Claims: 28
Claim 1
Independent Claim 86 words
A method of pictorial digital image processing comprising the steps of: constructing a scaled version of original image data; processing the scaled version of the original image data to collect luminance statistics; obtaining visual density capabilities of an output device to be used for producing a processed image; determining a tone reproduction curve from the luminance statistics and a visual density range; and transforming the original image data into color space values, using the tone reproduction curve, for producing the processed image with the output device.
Claim 2
Independent Claim 86 words
A method of pictorial digital image processing comprising the steps of: constructing a scaled version of original image data; processing the scaled version of the original image data to collect luminance statistics; obtaining visual density capabilities of an output device to be used for producing a processed image; determining a tone reproduction curve from the luminance statistics and a visual density range; and transforming the original image data into color space values, using the tone reproduction curve, for producing the processed image with the output device.
Claim 3
Dependent Claim 32 words
The method of claim 1 in which the step of processing the scaled version of the original image data includes collecting exposure statistics from the scaled version of the original image data.
Claim 4
Dependent Claim 32 words
The method of claim 2 in which the step of determining the tone reproduction curve includes adjusting the tone reproduction curve to compensate for variations in reflectance determined from the exposure statistics.
Claim 5
Dependent Claim 58 words
The method of claim 2 in which the step of processing the scaled version of the original image data includes using the exposure statistics to determine the influence of flare and transforming the scaled version of the original image data into scaled image linear scene values using conversions that are modified to account for the influence of flare.
Claim 6
Dependent Claim 34 words
The method of claim 4 including the further step of storing the conversions that are modified to account for the influence of flare for use in said step of transforming the original image data.
Claim 7
Dependent Claim 36 words
The method of claim 5 in which the step of processing the scaled version of the original image data includes transforming the scaled image linear scene values into scaled image color space values using color transformations.
Claim 8
Dependent Claim 31 words
The method of claim 6 in which the step of processing the scaled version of the original image data includes collecting the luminance statistics from the scaled image color space values.
Claim 9
Dependent Claim 38 words
The method of claim 1 in which the step of transforming the original image data includes transforming the original image data into original image linear scene values using the stored conversions that were modified to account for flare.
Claim 10
Dependent Claim 34 words
The method of claim 8 in which the step of transforming the original image data includes transforming the original image linear scene values into original image intermediate color space values using the color transformations.
Claim 11
Dependent Claim 38 words
The method of claim 9 in which the step of transforming the original image data includes transforming the original image intermediate color space values into the color space values for the output device using the tone reproduction curve.
Claim 12
Dependent Claim 66 words
The method of claim 1 in which the step of transforming the original image data includes transforming the original image data into original image linear scene values, transforming the original image linear values into original image intermediate color space values using color transformations, and transforming the original image intermediate color space values into the color space values for the output device using the tone reproduction curve.
Claim 13
Dependent Claim 18 words
The method of claim 11 in which the tone reproduction curve takes the form of a lookup table.
Claim 14
Dependent Claim 17 words
The method of claim 11 in which the tone reproduction curve is applied to multiple color channels.
Claim 15
Dependent Claim 16 words
The method of claim 13 in which the color channels are red, green, and blue channels.
Claim 16
Dependent Claim 46 words
The method of claim 11 including a further step of obtaining conversion functions for the output device and the step of transforming the original image data includes incorporating both the tone reproduction curve and the conversion functions for the output device in a common lookup table.
Claim 17
Dependent Claim 28 words
The method of claim 1 in which the step of determining the tone reproduction curve provides for changing a shape of the curve through a continuum of values.
Claim 18
Dependent Claim 53 words
The method of claim 1 in which the step of determining the tone reproduction curve includes determining both a scene pictorial dynamic range from the luminance statistics and an output pictorial dynamic range from the visual density capabilities of the output device and relating the two dynamic ranges in the tone reproduction curve.
Claim 19
Dependent Claim 26 words
The method of claim 17 in which the step of obtaining the visual density capabilities of the output device includes assuming capabilities of the output device.
Claim 20
Dependent Claim 42 words
The method of claim 17 in which the step of determining the tone reproduction curve includes applying an S-shaped flex adjustment to the tone reproduction curve based on a comparison between the scene pictorial dynamic range and the output pictorial dynamic range.
Claim 21
Dependent Claim 56 words
The method of claim 17 in which the step of processing the scaled version of the original image data includes collecting exposure statistics and the step of determining the tone reproduction curve includes applying a shift adjustment to the tone reproduction curve based on the exposure statistics from the scaled version of the original image data.
Claim 22
Dependent Claim 40 words
The method of claim 17 including a further step of obtaining data for intended viewing conditions of the processed image and the step of determining the tone reproduction curve includes adjustments for the intended viewing conditions of the processed image.
Claim 23
Dependent Claim 31 words
The method of claim 21 in which the step of determining the tone reproduction curve includes adjusting the output pictorial dynamic range for the intended viewing conditions of the processed image.
Claim 24
Dependent Claim 19 words
The method of claim 1 in which the step of determining the tone reproduction curve includes incorporating operator input.
Claim 25
Dependent Claim 22 words
The method of claim 23 in which the operator input includes adjustments to the tone reproduction curve relating to contrast and brightness.
Claim 26
Dependent Claim 21 words
The method of claim 23 in which the operator input includes adjustments to the tone reproduction curve relating to viewing conditions.
Claim 27
Dependent Claim 43 words
The method of claim 1 in which the step of constructing the scaled version of original image data includes spatially blurring the original image data and sub-sampling blurred data of the original image to produce the scaled version of the original image data.
Claim 28
Dependent Claim 30 words
The method of claim 1 in which the step of determining the tone reproduction curve includes an adjustment based on an estimate of scene key obtained from the luminance statistics.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2006-05-12 2006-11-11 2007-05-13 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2010-05-12 2010-11-11 2011-05-13 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2014-05-12 2014-11-11 2015-05-13 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag