US6717698B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Tone scale processing based on image modulation activity
Assignee: Monument Peak Ventures LLC
•
Filing: 2000-02-02
•
Granted: 2004-04-06
•
Expires: 2020-02-02
Abstract
Abstract A method for generating an image-dependent tone scale curve includes (a) computing an image activity histogram for an input image value as a function of the number of neighboring pixels that have a predetermined amount of image modulation exclusive of a predetermined noise modulation; and (b) constructing an image-dependent tone scale curve from the image activity histogram. The predetermined amount of image modulation may comprise any image value within two specified intervals each bounded by a noise threshold and a modulation threshold. In another aspect, a tone scale curve that optimizes the rendering of image activity is generated under one or more constraints. More particularly, one or more slope-limit constraints and/or point constraints are established and then a tone scale function is constructed by applying the slope-limit constraints in a tone scale derivative space. An image activity histogram is computed and applied to the tone scale slopefunction. Finally, the tone scale slope function is integrated to generate the tone scale curve.
Inventors
- 👤 Hsien-Che Lee
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:07
CPC Classifications
H; H04; H04N; H04N1/00; H04N1/46; H04N1/56; H04N1/60; H04N1/6027; G; G06; G06T; G06T5/00; G06T5/40; G06T5/90; G06T5/92
Claims Analysis
Total Claims: 34
Claim 1
Independent Claim
116 words
A method of generating an image-dependent tone scale curve in order to enhance a digital input image comprised of a plurality of image pixels, each pixel characterized by an image value that is input to the tone scale curve, said method comprising the steps of: (a) computing image activity based on a specified degree of image modulation in the neighborhood of an input pixel; (b) utilizing the image activity to compute an image activity histogram for an input image value as a function of the number of neighboring pixels that have a predetermined amount of image modulation exclusive of a predetermined noise modulation; and (c) constructing an image-dependent tone scale curve from the image activity histogram.
Claim 2
Independent Claim
116 words
A method of generating an image-dependent tone scale curve in order to enhance a digital input image comprised of a plurality of image pixels, each pixel characterized by an image value that is input to the tone scale curve, said method comprising the steps of: (a) computing image activity based on a specified degree of image modulation in the neighborhood of an input pixel; (b) utilizing the image activity to compute an image activity histogram for an input image value as a function of the number of neighboring pixels that have a predetermined amount of image modulation exclusive of a predetermined noise modulation; and (c) constructing an image-dependent tone scale curve from the image activity histogram.
Claim 3
Dependent Claim
36 words
The method as claimed in claim 1 wherein the predetermined amount of image modulation computed in step (b) comprises an image value within two specified intervals each bounded by a noise threshold and a modulation threshold.
Claim 4
Independent Claim
114 words
A method of generating a tone scale curve that optimizes the rendering of image activity under one or more constraints, said tone scale curve operating upon a digital input image comprised of a plurality of image values that are input to the tone scale curve, said method comprising the steps of: (a) establishing one or more slope-limit constraints; (b) constructing a tone scale slope function by applying the slope-limit constraints in a tone scale derivative space; (c) computing an image activity histogram from a measure of image activity; (d) applying the image activity histogram to the tone scale slope function; and (e) integrating the tone scale slope function to generate the tone scale curve.
Claim 5
Independent Claim
114 words
A method of generating a tone scale curve that optimizes the rendering of image activity under one or more constraints, said tone scale curve operating upon a digital input image comprised of a plurality of image values that are input to the tone scale curve, said method comprising the steps of: (a) establishing one or more slope-limit constraints; (b) constructing a tone scale slope function by applying the slope-limit constraints in a tone scale derivative space; (c) computing an image activity histogram from a measure of image activity; (d) applying the image activity histogram to the tone scale slope function; and (e) integrating the tone scale slope function to generate the tone scale curve.
Claim 6
Dependent Claim
39 words
The method as claimed in claim 3 further comprising: (f) establishing one or more point constraints; and (g) constructing the tone scale slope function in a piecewise manner by applying the point constraints in the tone scale derivative space.
Claim 7
Dependent Claim
23 words
The method as claimed in claim 4 wherein the point constraints comprise at least one of a balance point and a white point.
Claim 8
Dependent Claim
29 words
The method claimed in claim 3 wherein the image activity measure in step (c) is measured by the response of the input image to a bandpass or highpass filter.
Claim 9
Dependent Claim
26 words
The method claimed in claim 3 wherein the image activity measure in step (c) is measured by the gray level co-occurrence statistics of the input image.
Claim 10
Dependent Claim
48 words
The method claimed in claim 3 wherein the image activity measure in step (c) is measured by counting, for each pixel in the input image, the number of neighboring pixels that have an image value within two specified intervals, which are bounded by noise thresholds and modulation thresholds.
Claim 11
Dependent Claim
28 words
The method claimed in claim 3 wherein the image activity measure in step (c) is measured by the response of the input image to an image gradient operator.
Claim 12
Dependent Claim
27 words
The method claimed in claim 3 wherein the image activity measure in step (c) is measured by counting the number of level-crossings for each input image value.
Claim 13
Dependent Claim
16 words
The method as claimed in claim 3 wherein the slope-limit constraint comprises a skin contrast constraint.
Claim 14
Independent Claim
118 words
A method of generating a tone scale curve that optimizes the rendering of image activity under one or more constraints, said tone scale curve operating upon a digital input image comprised of a plurality of image values that are input to the tone scale curve, said method comprising the steps of: (a) establishing one or more point constraints; (b) constructing a tone scale slope function in a piecewise manner by applying the point constraints in a tone scale derivative space; (c) computing an image activity histogram from a measure of image activity; (d) applying the image activity histogram to the tone scale slope function; and (e) integrating the tone scale slope function to generate the tone scale curve.
Claim 15
Independent Claim
118 words
A method of generating a tone scale curve that optimizes the rendering of image activity under one or more constraints, said tone scale curve operating upon a digital input image comprised of a plurality of image values that are input to the tone scale curve, said method comprising the steps of: (a) establishing one or more point constraints; (b) constructing a tone scale slope function in a piecewise manner by applying the point constraints in a tone scale derivative space; (c) computing an image activity histogram from a measure of image activity; (d) applying the image activity histogram to the tone scale slope function; and (e) integrating the tone scale slope function to generate the tone scale curve.
Claim 16
Dependent Claim
35 words
The method as claimed in claim 12 further comprising: (f) establishing one or more slope-limit constraints; and (g) constructing the tone scale slope function by applying the slope-limit constraints in the tone scale derivative space.
Claim 17
Dependent Claim
23 words
The method as claimed in claim 12 wherein the point constraints comprise at least one of a balance point and a white point.
Claim 18
Dependent Claim
16 words
The method as claimed in claim 13 wherein the slope-limit constraint comprises a skin contrast constraint.
Claim 19
Dependent Claim
48 words
The method claimed in claim 12 wherein the image activity measure in step (c) is measured by counting, for each pixel in the input image, the number of neighboring pixels that have an image value within two specified intervals, which are bounded by noise thresholds and modulation thresholds.
Claim 20
Independent Claim
181 words
A method of generating a tone scale curve that optimizes the rendering of image activity under a set of slope-limit constraints, said tone scale curve operating upon a digital input image comprises of a plurality of image values that are input to the tone scale curve, said method comprising the steps of: (a) choosing an anchor point for the input image; (b) storing the slope limits in at least one slope constraint array; (c) computing an image activity histogram; (d) copying a minimum slope limit from the slope constraint array to a slope array; (e) computing the available output dynamic range on both sides the anchor point by subtracting the integral of the slope array from a total output dynamic range; (f) distributing the available output dynamic range over the slope array according to the image activity histogram; (g) comparing the values in the slope array against those in the slope-constraint array and resetting the values in the slope array within the limits specified in the slope-constraint array; and (h) integrating the slope array to obtain the desired tone scale curve.
Claim 21
Independent Claim
181 words
A method of generating a tone scale curve that optimizes the rendering of image activity under a set of slope-limit constraints, said tone scale curve operating upon a digital input image comprises of a plurality of image values that are input to the tone scale curve, said method comprising the steps of: (a) choosing an anchor point for the input image; (b) storing the slope limits in at least one slope constraint array; (c) computing an image activity histogram; (d) copying a minimum slope limit from the slope constraint array to a slope array; (e) computing the available output dynamic range on both sides the anchor point by subtracting the integral of the slope array from a total output dynamic range; (f) distributing the available output dynamic range over the slope array according to the image activity histogram; (g) comparing the values in the slope array against those in the slope-constraint array and resetting the values in the slope array within the limits specified in the slope-constraint array; and (h) integrating the slope array to obtain the desired tone scale curve.
Claim 22
Independent Claim
104 words
A method of generating a tone scale curve that preserves the contrast of skin or facial regions in the image, said tone scale curve operating upon a digital input image comprises of a plurality of image values that are input to the tone scale curve, said method comprising the steps of: (a) detecting skin or facial pixels in the input image; (b) forming a skin pixel histogram; (c) computing a tonal range of the skin pixels from the skin pixel histogram; and (d) constraining a slope of the tonal range of the skin pixels on the tone scale curve to user specified slope limits.
Claim 23
Independent Claim
104 words
A method of generating a tone scale curve that preserves the contrast of skin or facial regions in the image, said tone scale curve operating upon a digital input image comprises of a plurality of image values that are input to the tone scale curve, said method comprising the steps of: (a) detecting skin or facial pixels in the input image; (b) forming a skin pixel histogram; (c) computing a tonal range of the skin pixels from the skin pixel histogram; and (d) constraining a slope of the tonal range of the skin pixels on the tone scale curve to user specified slope limits.
Claim 24
Independent Claim
106 words
A method of generating a tone scale curve that preserves the brightness of white objects, said tone scale curve operating upon a digital input image comprised of a plurality of image values that are input to the tone scale curve, said method comprising the steps of: (a) determining a balance point; (b) detecting white pixels in the input image, where each white pixel is a predetermined amount above the balance point; (c) forming a white pixel histogram; (d) computing a minimum white point of the white pixels from the white pixel histogram; and (e) forcing the tone scale curve to go through the minimum white point.
Claim 25
Independent Claim
106 words
A method of generating a tone scale curve that preserves the brightness of white objects, said tone scale curve operating upon a digital input image comprised of a plurality of image values that are input to the tone scale curve, said method comprising the steps of: (a) determining a balance point; (b) detecting white pixels in the input image, where each white pixel is a predetermined amount above the balance point; (c) forming a white pixel histogram; (d) computing a minimum white point of the white pixels from the white pixel histogram; and (e) forcing the tone scale curve to go through the minimum white point.
Claim 26
Dependent Claim
133 words
A computer program product for generating an image-dependent tone scale curve in order to enhance a digital input image comprised of a plurality of image pixels, each pixel characterized by an image value that is input to the tone scale curve, said computer program product comprising: a computer readable storage medium having a computer program stored thereon for performing the steps of: (a) computing image activity based on a specified degree of image modulation in the neighborhood of an input pixel: (b) utilizing the image activity to compute an image activity histogram for an input image value as a function of the number of neighboring pixels that have a predetermined amount of image modulation exclusive of a predetermined noise modulation; and (c) constructing an image-dependent tone scale curve from the image activity histogram.
Claim 27
Dependent Claim
133 words
A computer program product for generating an image-dependent tone scale curve in order to enhance a digital input image comprised of a plurality of image pixels, each pixel characterized by an image value that is input to the tone scale curve, said computer program product comprising: a computer readable storage medium having a computer program stored thereon for performing the steps of: (a) computing image activity based on a specified degree of image modulation in the neighborhood of an input pixel: (b) utilizing the image activity to compute an image activity histogram for an input image value as a function of the number of neighboring pixels that have a predetermined amount of image modulation exclusive of a predetermined noise modulation; and (c) constructing an image-dependent tone scale curve from the image activity histogram.
Claim 28
Dependent Claim
38 words
The computer program product as claimed in claim 20 wherein the predetermined amount of image modulation computed in step (b) comprises an image value within two specified intervals each bounded by a noise threshold and a modulation threshold.
Claim 29
Dependent Claim
131 words
A computer program product for generating a tone scale curve that optimizes the rendering of image activity under one or more constraints, said tone scale curve operating upon a digital input image comprised of a plurality of image values that are input to the tone scale curve, said computer program product comprising: a computer readable storage medium having a computer program stored thereon for performing the steps of: (a) establishing one or more slope-limit constraints; (b) constructing a tone scale slope function by applying the slope-limit constraints in a tone scale derivative space; (c) computing an image activity histogram from a measure of image activity; (d) applying the image activity histogram to the tone scale slope function; and (e) integrating the tone scale slope function to generate the tone scale curve.
Claim 30
Dependent Claim
131 words
A computer program product for generating a tone scale curve that optimizes the rendering of image activity under one or more constraints, said tone scale curve operating upon a digital input image comprised of a plurality of image values that are input to the tone scale curve, said computer program product comprising: a computer readable storage medium having a computer program stored thereon for performing the steps of: (a) establishing one or more slope-limit constraints; (b) constructing a tone scale slope function by applying the slope-limit constraints in a tone scale derivative space; (c) computing an image activity histogram from a measure of image activity; (d) applying the image activity histogram to the tone scale slope function; and (e) integrating the tone scale slope function to generate the tone scale curve.
Claim 31
Dependent Claim
18 words
The computer program product as claimed in claim 22 wherein the slope-limit constraint comprises a skin contrast constraint.
Claim 32
Dependent Claim
135 words
A computer program product for generating a tone scale curve that optimizes the rendering of image activity under one or more constraints, said tone scale curve operating upon a digital input image comprised of a plurality of image values that are input to the tone scale curve, said computer program product comprising: a computer readable storage medium having a computer program stored thereon for performing the steps of: (a) establishing one or more point constraints; (b) constructing a tone scale slope function in a piecewise manner by applying the point constraints in a tone scale derivative space; (c) computing an image activity histogram from a measure of image activity; (d) applying the image activity histogram to the tone scale slope function; and (e) integrating the tone scale slope function to generate the tone scale curve.
Claim 33
Dependent Claim
135 words
A computer program product for generating a tone scale curve that optimizes the rendering of image activity under one or more constraints, said tone scale curve operating upon a digital input image comprised of a plurality of image values that are input to the tone scale curve, said computer program product comprising: a computer readable storage medium having a computer program stored thereon for performing the steps of: (a) establishing one or more point constraints; (b) constructing a tone scale slope function in a piecewise manner by applying the point constraints in a tone scale derivative space; (c) computing an image activity histogram from a measure of image activity; (d) applying the image activity histogram to the tone scale slope function; and (e) integrating the tone scale slope function to generate the tone scale curve.
Claim 34
Dependent Claim
25 words
The computer program product as claimed in claim 24 wherein the point constraints comprises at least one of a balance point and a white point.
References Cited (Backward Citations)
US4654722A
Cited
US5016043A
Cited
US4945406A
Cited
US5012333A
Cited
US5544258A
Cited
US5633511A
Cited
US5923775A
Cited
US5978106A
Cited
US6097836A
Cited
US5822453A
Cited
US6285798B1
Cited
JP2000115538A
Cited
US6236751B1
Cited
US6438264B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-04-06 | 2007-10-06 | 2008-04-06 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-04-06 | 2011-10-06 | 2012-04-06 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-04-06 | 2015-10-06 | 2016-04-06 | $7700.00 | Window Closed / Lapsed |