Patent US7480421B2 successfully refreshed from Google Patents.
US7480421B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Rendering of high dynamic range images
Assignee: Canon Inc
•
Filing: 2005-05-23
•
Granted: 2009-01-20
•
Expires: 2025-05-23
Abstract
Abstract White balance normalization of a high dynamic range image is performed by identifying a first image adaptation point for a relatively lighter portion of the image and a second image adaptation point for a relatively darker portion of the image. A first white point adjustment for the lighter portion of the image is performed using the first image adaptation point and a second white point adjustment for the darker portion of the image is performed using the second image adaptation point. Thus, multiple illumination sources can be taken into account in rendering a high dynamic range image, providing a more visually appealing rendered image.
Inventors
- 👤 Sharon A. Henley
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 13:14
CPC Classifications
H; H04; H04N; H04N1/00; H04N1/46; H04N1/56; H04N1/60; H04N1/6027; G; G06; G06T; G06T5/00; G06T5/40; G06T5/50; G06T5/90; G06T5/92; H04N1/387; H04N1/3871; H04N1/6083; H04N1/6086; G06T2207/00; G06T2207/20; G06T2207/20021; G06T2207/20172; G06T2207/20208
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
190 words
A method for processing high dynamic range image data which includes pixels whose values have a high dynamic range, so as to obtain counterpart image data which is renderable, the method comprising: using computer to perform the following steps: classifying each pixel of the high dynamic range image data into one of at least two different portions which include a relatively lighter portion and a relatively darker portion; identifying an image adaptation point for each of said different portions, said identifying step including the steps of identifying a first image adaptation point for the lighter portion and identifying a second image adaptation point for the darker portion; and performing white point adjustment for the value of each pixel in each of said different portions by using the corresponding image adaptation point for each said portion, said step of performing white point adjustment including the steps of performing a first white point adjustment for the values of pixels of the lighter portion using the first image adaptation point and performing a second white point adjustment for the values of the pixels of the darker portion using the second image adaptation point.
Claim 2
Independent Claim
190 words
A method for processing high dynamic range image data which includes pixels whose values have a high dynamic range, so as to obtain counterpart image data which is renderable, the method comprising: using computer to perform the following steps: classifying each pixel of the high dynamic range image data into one of at least two different portions which include a relatively lighter portion and a relatively darker portion; identifying an image adaptation point for each of said different portions, said identifying step including the steps of identifying a first image adaptation point for the lighter portion and identifying a second image adaptation point for the darker portion; and performing white point adjustment for the value of each pixel in each of said different portions by using the corresponding image adaptation point for each said portion, said step of performing white point adjustment including the steps of performing a first white point adjustment for the values of pixels of the lighter portion using the first image adaptation point and performing a second white point adjustment for the values of the pixels of the darker portion using the second image adaptation point.
Claim 3
Dependent Claim
22 words
The method of claim 1 , further comprising determining the relatively lighter portion and the relatively darker portion using a threshold value.
Claim 4
Dependent Claim
57 words
The method of claim 2 , wherein the threshold value is measured in luminance, wherein the relatively lighter portion includes an area of the image having a luminance value greater than the threshold value, and the relatively darker portion includes an area of the image having a luminance value less tart or equal to the threshold value.
Claim 5
Dependent Claim
40 words
The method of claim 3 , further comprising determining the threshold value by: calculating a cumulative histogram of luminance of the image; and equating the threshold value to a luminance value at a point of minimal slope of the histogram.
Claim 6
Dependent Claim
29 words
The method of claim 3 , further comprising determining the threshold value by: determining an ISODATA threshold of the image; and equating the threshold value to the ISODATA threshold.
Claim 7
Dependent Claim
56 words
The method of claim 1 , wherein the first white point adjustment is based on a first grey world assumption for the relatively lighter portion using the first image adaptation point, and the second white point adjustment is based on a second grey world assumption for the relatively darker portion using the second image adaptation point.
Claim 8
Dependent Claim
58 words
The method of claim 1 , wherein the first white point adjustment is based on a first perfect reflecting diffuser assumption for the relatively lighter portion using the first image adaptation point, and the second white point adjustment is based on a second perfect reflecting diffuser assumption for the relatively darker portion using the second image adaptation point.
Claim 9
Dependent Claim
111 words
The method of claim 1 , wherein: the first white point adjustment is based on a first ratio of a first grey world assumption to a first perfect reflecting diffuser assumption; the second white point adjustment is based on a second ratio of a second grey world assumption to a second perfect reflecting diffuser assumption; and the first grey world assumption and the first perfect reflecting diffuser assumption are determined for the relatively lighter portion and based on the first image adaptation point, and the second grey world assumption and the second perfect reflecting diffuser assumption are determined for the relatively darker portion and based on the second image adaptation point.
Claim 10
Dependent Claim
32 words
The method of claim 1 , further comprising: normalizing the image so that an image minimum value equals zero, an image maximum value equals one, and an image mean value equals 0.5.
Claim 11
Dependent Claim
52 words
The method of claim 9 , further comprising: converting the normalized image to an HSV image in HSV format; performing at least one saturation boost and a sharpness enhancement on the HSV image to obtain a new HSV image; and converting the new HSV image to an RGB image in RGB format.
Claim 12
Dependent Claim
37 words
The method of claim 10 , further comprising: calculating a cumulative histogram of luminance of the new HSV image; and equating a threshold value to a luminance value at a point of minimal slope of the histogram.
Claim 13
Dependent Claim
51 words
The method of claim 11 , wherein the relatively lighter portion includes a portion of the RGB image having a luminance value greater than the threshold value, and the relatively darker portion includes a portion of the RGB image having a luminance value less than or equal to the threshold value.
Claim 14
Dependent Claim
15 words
The method of claim 12 , wherein a user selects the level of saturation boost.
Claim 15
Dependent Claim
40 words
The method of claim 1 , wherein the first and second adaptation points are identified using an identifying process, and the identifying process is selected from the group consisting of the grey world assumption and the point of highest luminance.
Claim 16
Dependent Claim
24 words
The method of claim 1 , further comprising rendering the image subsequent to the first white point adjustment and the second white point adjustment.
Claim 17
Dependent Claim
22 words
The method of claim 15 , wherein rendering further includes applying an image-dependent gamma correction, a saturation adjustment, and a sharpening filter.
Claim 18
Independent Claim
193 words
An apparatus for processing high dynamic range image data which includes pixels whose values have a high dynamic range, so as to obtain counterpart image data which is renderable, the apparatus comprising: classifying means for classifying each pixel of the high dynamic range image data into one of two different portions which include a relatively lighter portion and a relatively darker portion; an identification means for identifying an image adaptation point for each of said different portions, said identification means including means for identifying a first image adaptation point for the lighter portion and for identifying a second image adaptation point for the darker portion; and a white point adjustment means for performing white point adjustment for the value of each pixel in each of said different portions by using the corresponding image adaptation point for each said portion, said white point adjustment means including means for performing a first white point adjustment for the values of the pixels of the lighter portion using the first image adaptation point and for performing a second white point adjustment for the values of the pixels of the darker portion using the second image adaptation point.
Claim 19
Independent Claim
193 words
An apparatus for processing high dynamic range image data which includes pixels whose values have a high dynamic range, so as to obtain counterpart image data which is renderable, the apparatus comprising: classifying means for classifying each pixel of the high dynamic range image data into one of two different portions which include a relatively lighter portion and a relatively darker portion; an identification means for identifying an image adaptation point for each of said different portions, said identification means including means for identifying a first image adaptation point for the lighter portion and for identifying a second image adaptation point for the darker portion; and a white point adjustment means for performing white point adjustment for the value of each pixel in each of said different portions by using the corresponding image adaptation point for each said portion, said white point adjustment means including means for performing a first white point adjustment for the values of the pixels of the lighter portion using the first image adaptation point and for performing a second white point adjustment for the values of the pixels of the darker portion using the second image adaptation point.
Claim 20
Dependent Claim
40 words
A computer-readable medium that stores computer-executable process steps, said computer-executable process steps for performing white balance normalization of a high dynamic range image, the computer-executable instructions executable to perform a method according to any of claims 1 to 16 .
Claim 21
Independent Claim
200 words
An apparatus for processing high dynamic range image data which includes pixels whose values have a high dynamic range, so as to obtain counterpart image data which is renderable, the apparatus comprising: a classifying unit adapted to classify each pixel of the high dynamic range image data into one of at least two different portions which include a relatively lighter portion and a relatively darker portion; an identifying unit adapted to identify an image adaptation point for each of said different portions, said identifying step including the steps of identifying a first image adaptation point for the lighter portion and identifying a second image adaptation point for the darker portion; and a performing unit adapted to perform white point adjustment for the value of each pixel in each of said different portions by using the corresponding image adaptation point for each said portion, wherein said performing unit performs white point adjustment including the steps of performing a first white point adjustment for the values of the pixels of the lighter portion using the first image adaptation point and performs a second white point adjustment for the values of the pixels of the darker portion using the second image adaptation point.
Claim 22
Independent Claim
200 words
An apparatus for processing high dynamic range image data which includes pixels whose values have a high dynamic range, so as to obtain counterpart image data which is renderable, the apparatus comprising: a classifying unit adapted to classify each pixel of the high dynamic range image data into one of at least two different portions which include a relatively lighter portion and a relatively darker portion; an identifying unit adapted to identify an image adaptation point for each of said different portions, said identifying step including the steps of identifying a first image adaptation point for the lighter portion and identifying a second image adaptation point for the darker portion; and a performing unit adapted to perform white point adjustment for the value of each pixel in each of said different portions by using the corresponding image adaptation point for each said portion, wherein said performing unit performs white point adjustment including the steps of performing a first white point adjustment for the values of the pixels of the lighter portion using the first image adaptation point and performs a second white point adjustment for the values of the pixels of the darker portion using the second image adaptation point.
References Cited (Backward Citations)
US5548333A
Cited
US5982926A
Cited
US5852673A
Cited
US6111980A
Cited
JPH10293841A
Cited
US20040207734A1
Cited
US6825884B1
Cited
US20050220340A1
Cited
US6809761B1
Cited
US20020147980A1
Cited
US20030103677A1
Cited
US6801296B2
Cited
US20030184827A1
Cited
US20040051790A1
Cited
US20040136603A1
Cited
US20040190770A1
Cited
US20050271280A1
Cited
US20060204123A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2012-01-20 | 2012-07-21 | 2013-01-20 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2016-01-20 | 2016-07-21 | 2017-01-20 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2020-01-20 | 2020-07-21 | 2021-01-20 | $7700.00 | Window Closed / Lapsed |