Patent US7978909B2 successfully refreshed from Google Patents.
US7978909B2
Active / In Force
US
⏱️ 3.8 years remaining
Image processing apparatus, image processing method, computer program, and storage medium
Assignee: Canon Inc
•
Filing: 2010-08-18
•
Granted: 2011-07-12
•
Expires: 2030-08-18
Abstract
Abstract An image processing apparatus includes a calculating unit configured to calculate an evaluation amount of poor color tone for every pixel in an image and an extracting unit configured to extract a candidate pixel having the poor color tone on the basis of the evaluation amount. The evaluation amount is calculated from red and green components of the image.
Inventors
- 👤 Kiyoshi Umeda
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:01
CPC Classifications
H; H04; H04N; H04N1/00; H04N1/46; H04N1/56; H04N1/60; H04N1/62; H04N1/624; G; G06; G06T; G06T5/00; G06T5/10; G06T5/20; G06T5/77; G06T7/00; G06T7/10; G06T7/13; G06T7/90; G06V; G06V40/00; G06V40/10; G06V40/18; G06V40/193; G06T2207/00; G06T2207/30; G06T2207/30196; G06T2207/30201; G06T2207/30216
Claims Analysis
Total Claims: 18
Claim 1
Independent Claim
253 words
An image processing apparatus comprising: a calculating unit configured to calculate an evaluation amount of color tone for a pixel in an image; an extracting unit configured to extract a candidate pixel indicating poor color tone on the basis of the evaluation amount calculated by the calculating unit; an area extracting unit configured to extract an area formed of a plurality of candidate pixels extracted by the extracting unit, to determine whether the extracted area has a predetermined shape, and to extract the area that is determined to have the predetermined shape as a candidate area; an area combining unit configured to combine a plurality of candidate areas by determining a distance between the plurality of candidate areas by using a threshold for determining the distance between the plurality of candidate areas extracted by the area extracting unit, determining a shape of a circumscribed area by using an aspect ratio of the area circumscribed by the plurality of candidate areas, and combining the plurality of candidate areas in accordance with determination results of the distance between the plurality of candidate areas and the shape of the circumscribed area, wherein the calculating unit applies weights to an R component and a G component of the image, applies a weight smaller than the weights of the R component and the G component to a B component of the image, and calculates the evaluation amount from the R component, the G component and the B component of the image to which the weights have been applied.
Claim 2
Dependent Claim
253 words
An image processing apparatus comprising: a calculating unit configured to calculate an evaluation amount of color tone for a pixel in an image; an extracting unit configured to extract a candidate pixel indicating poor color tone on the basis of the evaluation amount calculated by the calculating unit; an area extracting unit configured to extract an area formed of a plurality of candidate pixels extracted by the extracting unit, to determine whether the extracted area has a predetermined shape, and to extract the area that is determined to have the predetermined shape as a candidate area; an area combining unit configured to combine a plurality of candidate areas by determining a distance between the plurality of candidate areas by using a threshold for determining the distance between the plurality of candidate areas extracted by the area extracting unit, determining a shape of a circumscribed area by using an aspect ratio of the area circumscribed by the plurality of candidate areas, and combining the plurality of candidate areas in accordance with determination results of the distance between the plurality of candidate areas and the shape of the circumscribed area, wherein the calculating unit applies weights to an R component and a G component of the image, applies a weight smaller than the weights of the R component and the G component to a B component of the image, and calculates the evaluation amount from the R component, the G component and the B component of the image to which the weights have been applied.
Claim 3
Dependent Claim
238 words
An image processing method comprising the steps of: calculating an evaluation amount of color tone for a pixel in an image; extracting a candidate pixel indicating poor color tone on the basis of the evaluation amount calculated in the calculating step; extracting an area formed of a plurality of candidate pixels extracted in the candidate pixel extracting step, to determine whether the extracted area has a predetermined shape, and to extract the area that is determined to have the predetermined shape as a candidate area; and combining a plurality of the candidate areas by determining a distance between the plurality of candidate areas by using a threshold for determining the distance between the plurality of candidate areas extracted in the area extracting step, determining a shape of a circumscribed area by using an aspect ratio of the area circumscribed by the plurality of candidate areas, and combing the plurality of candidate areas in accordance with determination results of the distance between the plurality of candidate areas and the shape of the circumscribed area, wherein the calculating step applies weights to an R component and a G component of the image, applies a weight smaller than the weights of the R component and the G component to a B component of the image, and calculates the evaluation amount from the R component, the G component and the B component of the image to which the weights have been applied.
Claim 4
Dependent Claim
238 words
An image processing method comprising the steps of: calculating an evaluation amount of color tone for a pixel in an image; extracting a candidate pixel indicating poor color tone on the basis of the evaluation amount calculated in the calculating step; extracting an area formed of a plurality of candidate pixels extracted in the candidate pixel extracting step, to determine whether the extracted area has a predetermined shape, and to extract the area that is determined to have the predetermined shape as a candidate area; and combining a plurality of the candidate areas by determining a distance between the plurality of candidate areas by using a threshold for determining the distance between the plurality of candidate areas extracted in the area extracting step, determining a shape of a circumscribed area by using an aspect ratio of the area circumscribed by the plurality of candidate areas, and combing the plurality of candidate areas in accordance with determination results of the distance between the plurality of candidate areas and the shape of the circumscribed area, wherein the calculating step applies weights to an R component and a G component of the image, applies a weight smaller than the weights of the R component and the G component to a B component of the image, and calculates the evaluation amount from the R component, the G component and the B component of the image to which the weights have been applied.
Claim 5
Dependent Claim
58 words
The image processing apparatus according to claim 1 , wherein the extracting unit sets a predetermined window area near a target pixel in the image, determines a threshold from the evaluation amount of a pixel included in the window area, and extracts the candidate pixel by binarizing the evaluation value of the target pixel by using the threshold.
Claim 6
Dependent Claim
33 words
The image processing apparatus according to claim 3 , wherein the extracting unit sets the window area for a plurality of pixels on the same line as the target pixel in the image.
Claim 7
Dependent Claim
65 words
The image processing apparatus according to claim 4 , wherein the extracting unit extracts a candidate pixel by scanning the target pixel in a direction opposite to a scanning direction on the line after scanning the target pixel in the direction of the same line and extracting a candidate pixel, and sets a pixel extracted in both of the two scannings as the candidate pixel.
Claim 8
Dependent Claim
26 words
The image processing apparatus according to claim 1 , wherein an area having the predetermined shape has a shape close to a circle or an ellipse.
Claim 9
Dependent Claim
68 words
The image processing apparatus according to claim 1 , further comprising: a determining unit configured to determine whether or not the candidate area is set as a correction area, on the basis of a characteristic amount of an eye calculated from a candidate area extracted by the area extracting unit; and a correcting unit configured to perform a process for correcting poor color tone for the correction area.
Claim 10
Dependent Claim
61 words
The image processing apparatus according to claim 7 , wherein the determining unit calculates a plurality of characteristic amounts of the eye from the candidate area, and in a case where the candidate area satisfies all of the characteristic amounts or a predetermined condition of a predetermined characteristic amount of the characteristic amounts, determines the candidate area as the correction area.
Claim 11
Dependent Claim
158 words
The image processing apparatus according to claim 8 , further comprising: a calculating unit configured to calculate a first weight in accordance with a distance between a pixel in the correction area and the center of the correction area; a calculating unit configured to calculate a second weight in accordance with a ratio of the evaluation amount of a target pixel in the image and a maximum value of an evaluation amount of a pixel in the correction area; a calculating unit configured to calculate a third weight in accordance with a ratio of a luminance of the target pixel and a luminance of a pixel in the correction area; a determining unit configured to determine a correction amount of luminance and a color difference component by using the first, the second and the third weights; and a correcting unit configured to correct luminance and a color difference component of the target pixel by using the correction amount.
Claim 12
Dependent Claim
49 words
The image processing apparatus according to claim 9 , wherein the determining unit determines a correction amount of the luminance component by using the first, the second and the third weights, and determines a correction amount of the color difference component by using the first and the second weights.
Claim 13
Dependent Claim
45 words
The image processing apparatus according to claim 1 , further comprising an area removing unit configured to remove a smaller candidate area in a case where the smaller candidate area than a candidate area exists near the candidate area connected by the area connecting unit.
Claim 14
Dependent Claim
89 words
The image processing apparatus according to claim 1 , wherein the area combining unit combines the plurality of candidate areas in a case where a value calculated by dividing a sum of dimensions of a plurality of candidate areas including candidate pixels extracted by the extracting unit by a dimension of an area circumscribing the plurality of candidate areas is larger than the threshold, and an aspect ratio of an area circumscribing the plurality of candidate areas is larger than any aspect ratios of the plurality of candidate areas.
Claim 15
Dependent Claim
89 words
The image processing apparatus according to claim 1 , wherein the area combining unit combines the plurality of candidate areas in a case where a value calculated by dividing a sum of dimensions of a plurality of candidate areas including candidate pixels extracted by the extracting unit by a dimension of an area circumscribing the plurality of candidate areas is larger than the threshold, and a shape of an area circumscribing the plurality of candidate areas is closer to a square than any of the plurality of candidate areas.
Claim 16
Dependent Claim
26 words
A non-transitory computer readable storage medium storing a computer program configured to let a computer function as the image processing apparatus according to claim 1 .
Claim 17
Dependent Claim
32 words
The image processing apparatus according to claim 1 , wherein the calculating unit is configured to calculate an evaluation amount of color tone of an eye for a pixel in the image.
Claim 18
Dependent Claim
29 words
The image processing method according to claim 2 , comprising the step of calculating an evaluation amount of color tone of an eye for a pixel in the image.
References Cited (Backward Citations)
US20030142285A1
Cited
US20040228542A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2014-07-11 | 2015-01-10 | 2015-07-12 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2018-07-11 | 2019-01-10 | 2019-07-12 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2022-07-11 | 2023-01-10 | 2023-07-12 | $7700.00 | Window Closed / Lapsed |