US7146059B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method of performing fast bilateral filtering and using the same for the display of high-dynamic-range images
Assignee: Massachusetts Institute of Technology
•
Filing: 2003-03-05
•
Granted: 2006-12-05
•
Expires: 2023-03-05
Abstract
Abstract A method of performing bilateral filtering and using the method for displaying high-dynamic-range images is presented. The method reduces the contrast of the image while preserving detail of the image. The presently disclosed method incorporates a two-scale decomposition of the image into a base layer encoding large-scale variations, and a detail layer. The base layer has its contrast reduced, thereby preserving detail. The base layer is obtained using an edge-preserving bilateral filter. The bilateral filter is a non-linear filter, where the weight of each pixel is computed using a Gaussian in the spatial domain multiplied by an influence function in the intensity domain that decreases the weight of pixels with large intensity differences. The bilateral filtering is accelerated by using a piecewise-linear approximation in the intensity domain and appropriate subsampling.
Inventors
- 👤 Frédéric Durand
- 👤 Julie Dorsey
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 17:06
CPC Classifications
G; G06; G06T; G06T5/00; G06T5/50; G06T5/40; G06T5/90; G06T2207/00; G06T2207/20; G06T2207/20024; G06T2207/20028; G06T2207/20048; G06T2207/20056
Claims Analysis
Total Claims: 31
Claim 1
Independent Claim
64 words
A method of performing piece-wise linear bilateral filtering comprising: computing a weight of each of a plurality of pixels of an image using a Gaussian in a spatial domain; and multiplying said weight by an influence function in the intensity domain wherein a weight of a pixel with a large intensity difference from weights of other pixels of said plurality of pixels is reduced.
Claim 2
Independent Claim
64 words
A method of performing piece-wise linear bilateral filtering comprising: computing a weight of each of a plurality of pixels of an image using a Gaussian in a spatial domain; and multiplying said weight by an influence function in the intensity domain wherein a weight of a pixel with a large intensity difference from weights of other pixels of said plurality of pixels is reduced.
Claim 3
Dependent Claim
100 words
The method of claim 1 wherein said computing and said multiplying are done in accordance with the formula: J s = 1 k ( s ) ∑ ρ ∈ Ω f ( p - s ) g ( I p - I s ) I p wherein J s is the output for pixel s, k(s) is a normalization term, f is the Gaussian in the spatial domain, g is the Guassian in the intensity domain, I p is the intensity for the image, and I s is the intensity for the pixel.
Claim 4
Dependent Claim
76 words
The method of claim 2 where k(s) is determined in accordance with the formula: k ( s ) = ∑ ρ ∈ Ω f ( p - s ) g ( I p - I s ) where f is the Gaussian in the spatial domain, g is the Guassian in the intensity domain, I p is the intensity for the image, and I s is the intensity for the pixel.
Claim 5
Dependent Claim
17 words
The method of claim 1 wherein said multiplying comprises utilizing a piecewise-linear approximation in the intensity domain.
Claim 6
Dependent Claim
29 words
The method of claim 1 wherein said piecewise-linear approximation comprises discretizing a set of signal intensities into segment values and computing a linear filter for each said segment value.
Claim 7
Dependent Claim
14 words
The method of claim 5 wherein said computing includes utilizing a Fast Fourier Transform(FFT).
Claim 8
Dependent Claim
14 words
The method of claim 1 wherein said computing comprises down-sampling in the spatial domain.
Claim 9
Dependent Claim
111 words
The method of claim 7 wherein said down-sampling is done in accordance with the formula: J s j = 1 k j ( s ) ∑ ρ ∈ Ω f ( p - s ) g ( I p t - I j ) I p = 1 k j ( s ) ∑ ρ ∈ Ω f ( p - s ) H p j wherein the final output of the filter for a pixel s is then a linear interpolation between the output J s j of the two closest values i j of I s .
Claim 10
Dependent Claim
56 words
The method of claim 8 wherein k j ( s ) = ∑ ρ ∈ Ω f ( p - s ) g ( I p - i j ) = ∑ ρ ∈ Ω f ( p - s ) G j ( p ) .
Claim 11
Dependent Claim
42 words
The method of claim 9 wherein said down-sampling comprises dividing said image in sub-images and when a difference between a maximum intensity and a minimum intensity is more reduced in said sub-image than said image then using fewer segments for said sub-images.
Claim 12
Dependent Claim
17 words
The method of claim 10 wherein said down-sampled version of said image is obtained using nearest-neighbor down-sampling.
Claim 13
Dependent Claim
23 words
The method of claim 11 wherein the output of the linear filters on said down-sampled image are linearly recombined at the full resolution.
Claim 14
Dependent Claim
15 words
The method of claim 1 further comprising detecting dubious pixels and fixing said dubious pixels.
Claim 15
Dependent Claim
40 words
The method of claim 13 wherein said fixing comprises: providing a low-pass version of the output of the bilateral filter; and assigning a value of a linear interpretation to the pixel depending on the log of the uncertainty normalization value.
Claim 16
Independent Claim
81 words
A method for reducing contrast while preserving detail comprising: selecting a high dynamic range digital image; decomposing said image into an intensity layer and a color layer; running said intensity layer through a bilateral filter to obtain a base layer; dividing said intensity layer by said base layer to obtain a detail layer; reducing contrast in said base layer; and recombining said base layer having reduced contrast with said detail layer and said color layer to obtain a reduced contrast image.
Claim 17
Independent Claim
81 words
A method for reducing contrast while preserving detail comprising: selecting a high dynamic range digital image; decomposing said image into an intensity layer and a color layer; running said intensity layer through a bilateral filter to obtain a base layer; dividing said intensity layer by said base layer to obtain a detail layer; reducing contrast in said base layer; and recombining said base layer having reduced contrast with said detail layer and said color layer to obtain a reduced contrast image.
Claim 18
Dependent Claim
71 words
The method of claim 15 wherein said running said intensity layer through a bilateral filter comprises: computing a weight of each of a plurality of pixels of an image using a Gaussian in a spatial domain; and multiplying said weight by an influence function in the intensity domain wherein a weight of a pixel with a large intensity difference from weights of other pixels of said plurality of pixels is reduced.
Claim 19
Dependent Claim
100 words
The method of claim 16 wherein said computing and said multiplying are done in accordance with the formula: J s = 1 k ( s ) ∑ ρ ∈ Ω f ( p - s ) g ( I p - I s ) I p wherein J s is the output for pixel s, k(s) is a normalization term, f is the Gaussian in the spatial domain, g is the Guassian in the intensity domain, I p is the intensity for the image, and I s is the intensity for the pixel.
Claim 20
Dependent Claim
76 words
The method of claim 17 where k(s) is determined in accordance with the formula: k ( s ) = ∑ ρ ∈ Ω f ( p - s ) g ( I p - I s ) where f is the Gaussian in the spatial domain, g is the Guassian in the intensity domain, I p is the intensity for the image, and I s is the intensity for the pixel.
Claim 21
Dependent Claim
15 words
The method of claim 16 wherein said computing includes utilizing a Fast Fourier Transform (FFT).
Claim 22
Dependent Claim
17 words
The method of claim 16 wherein said multiplying comprises utilizing a piecewise-linear approximation in the intensity domain.
Claim 23
Dependent Claim
14 words
The method of claim 16 wherein said computing comprises sub-sampling in the spatial domain.
Claim 24
Dependent Claim
28 words
The method of claim 16 wherein said sub-sampling comprises discretizing a set of signal intensities into segment values and computing a linear filter for each said segment value.
Claim 25
Dependent Claim
111 words
The method of claim 21 wherein said sub-sampling is done in accordance with the formula: J s j = 1 k j ( s ) ∑ ρ ∈ Ω f ( p - s ) g ( I p t - I j ) I p = 1 k j ( s ) ∑ ρ ∈ Ω f ( p - s ) H p j wherein the final output of the filter for a pixel s is then a linear interpolation between the output J s j of the two closest values i j of I s .
Claim 26
Dependent Claim
56 words
The method of claim 23 wherein k j ( s ) = ∑ ρ ∈ Ω f ( p - s ) g ( I p - i j ) = ∑ ρ ∈ Ω f ( p - s ) G j ( p ) .
Claim 27
Dependent Claim
42 words
The method of claim 24 wherein said sub-sampling comprises dividing said image in sub-images and when a difference between a maximum intensity and a minimum intensity is more reduced in said sub-image than said image then using fewer segments for said sub-images.
Claim 28
Dependent Claim
17 words
The method of claim 16 wherein said computing is done using a down-sampled version of said image.
Claim 29
Dependent Claim
17 words
The method of claim 26 wherein said down-sampled version of said image is obtained using nearest-neighbor down-sampling.
Claim 30
Dependent Claim
19 words
The method of claim 16 further comprising detecting dubious pixels and fixing said dubious pixels using a normalization factor.
Claim 31
Dependent Claim
40 words
The method of claim 28 wherein said fixing comprises: providing a low-pass version of the output of the bilateral filter; and assigning a value of a linear interpretation to the pixel depending on the log of the uncertainty normalization value.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2009-12-04 | 2010-06-05 | 2010-12-05 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2013-12-04 | 2014-06-05 | 2014-12-05 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2017-12-04 | 2018-06-05 | 2018-12-05 | $7700.00 | Window Closed / Lapsed |