US9727951B2
Active / In Force
US
⏱️ 7.3 years remaining
Image processing apparatus and method for controlling the apparatus
Assignee: Canon Inc
•
Filing: 2014-03-07
•
Granted: 2017-08-08
•
Expires: 2034-03-07
Abstract
Abstract An image processing apparatus and a method thereof for correcting image data in accordance with a feature of the image data, calculates a brightness component of image data and a color difference component of image data, determines whether the image data is a nightscape image or an underexposed image using the calculated brightness component and color difference component, and corrects the image data which has been determined as a nightscape image or an underexposed image.
Inventors
- 👤 Hiroyuki Sakai
- 👤 Kiyoshi Umeda
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:49
CPC Classifications
G06T5/001; H; H04; H04N; H04N1/00; H04N1/46; H04N1/56; H04N1/60; H04N1/6072; G06K9/00664; G06T11/001; G; G06; G06T; G06T11/00; G06T11/10; G06V; G06V20/00; G06V20/10; G06T2207/00; G06T2207/30; G06T2207/30168
Claims Analysis
Total Claims: 47
Claim 1
Independent Claim
150 words
A data processing apparatus comprising: (a) a memory storing instructions; and (b) one or more processors that execute the instructions and cause the data processing apparatus to function as: (i) an obtaining unit configured to obtain a feature amount related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; (ii) a determination unit configured to determine a scene of the image data among a plurality of scenes including at least underexposure, using at least the feature amount related to brightness and a feature amount related to a variance of the plurality of color-difference values obtained by the obtaining unit; and (iii) a correction unit configured to correct the image data in accordance with the scene determined by the determination unit.
Claim 2
Dependent Claim
150 words
A data processing apparatus comprising: (a) a memory storing instructions; and (b) one or more processors that execute the instructions and cause the data processing apparatus to function as: (i) an obtaining unit configured to obtain a feature amount related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; (ii) a determination unit configured to determine a scene of the image data among a plurality of scenes including at least underexposure, using at least the feature amount related to brightness and a feature amount related to a variance of the plurality of color-difference values obtained by the obtaining unit; and (iii) a correction unit configured to correct the image data in accordance with the scene determined by the determination unit.
Claim 3
Dependent Claim
77 words
The data processing apparatus according to claim 1 , wherein the determination unit determines whether or not the scene of the image data is underexposure based on a relationship among the feature amount related to the brightness of the plurality of pixels, the feature amount related to the variance of the color-difference values of the plurality of pixels obtained by the obtaining unit, and predetermined feature amounts related to respective brightness and a color-difference value indicating underexposure.
Claim 4
Dependent Claim
136 words
The data processing apparatus according to claim 1 , wherein the determination unit (i) calculates a distance between coordinates of the feature amount related to the brightness and the feature amount related to the variance of the color difference values obtained by the obtaining unit and coordinates of respective brightness and color-difference values indicating underexposure, in a feature amount space including at least the feature amount related to the brightness and the feature amount related to the variance of the color-difference values, and (ii) determines that the scene of the image data is a scene that is set on coordinates in which the calculated distance is the shortest from the coordinates of the feature amount related to the brightness and the feature amount related to the variance of the color-difference values obtained by the obtaining unit.
Claim 5
Dependent Claim
39 words
The data processing apparatus according to claim 1 , wherein the feature amount related to the brightness is luminance values of each pixel of at least a portion of pixels of a plurality of pixels in the image data.
Claim 6
Dependent Claim
44 words
The data processing apparatus according to claim 1 , wherein the feature amount related to the brightness is an average value of luminance values of each pixel of at least a portion of the pixels of the plurality of pixels of the image data.
Claim 7
Dependent Claim
53 words
The data processing apparatus according to claim 1 , wherein the feature amount related to the brightness is any one of a Y component in a YCbCr color space, an L component in an Lab color system, an L component in an Luv system, and a V component in an HSV color space.
Claim 8
Dependent Claim
35 words
The data processing apparatus according to claim 1 , wherein the color-difference value is one of (i) a Cb component in a YCbCr color space and (ii) a Cr component in the YCbCr color space.
Claim 9
Dependent Claim
79 words
The data processing apparatus according to claim 1 , wherein the feature amount related to the brightness is at least one of an average value of luminance of the plurality of pixels of the image data, a maximum value of luminance of the plurality of pixels of the image data, a minimum value of luminance of the plurality of pixels of the image data, and a median value of luminance of the plurality of pixels of the image data.
Claim 10
Dependent Claim
118 words
The data processing apparatus according to claim 1 , wherein the feature amount related to the variance of the plurality of color-difference values is at least one of a difference value obtained by subtracting a minimum value of a color-difference value from a maximum value of a color-difference value of the plurality of color-difference values, a variance of color-difference values of the plurality of pixels in the neighborhood of a pixel having a maximum value of luminance of the plurality of pixels of the image data, and a variance of color-difference values of the plurality of pixels in the neighborhood of a pixel having a minimum value of luminance of the plurality of pixels of the image data.
Claim 11
Dependent Claim
41 words
The data processing apparatus according to claim 1 , wherein, if the determination unit determines that the scene of the image data is underexposure, the correction unit corrects the image data using a correction characteristic for making the image data lighter.
Claim 12
Independent Claim
109 words
A method of controlling a data processing apparatus, the method comprising: obtaining a feature amount related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; and determining a scene of the image data among a plurality of scenes including at least Underexposure, using at least the obtained feature amount related to the brightness and a feature amount related to a variance of the obtained plurality of color-difference values; and correcting the image data in accordance with the determined scene.
Claim 13
Independent Claim
109 words
A method of controlling a data processing apparatus, the method comprising: obtaining a feature amount related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; and determining a scene of the image data among a plurality of scenes including at least Underexposure, using at least the obtained feature amount related to the brightness and a feature amount related to a variance of the obtained plurality of color-difference values; and correcting the image data in accordance with the determined scene.
Claim 14
Dependent Claim
118 words
A non-transitory computer readable storage medium storing a program for causing a computer to execute a data accessing method, the method comprising: obtaining a feature amount related to brightness of each pixel of at least a part a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; determining a scene of the image data among a plurality of scenes including at least underexposure, using at least the obtained feature amount related to the brightness and a feature amount related to a variance of the obtained plurality of color-difference values; and correcting the image data in accordance with the determined scene.
Claim 15
Dependent Claim
118 words
A non-transitory computer readable storage medium storing a program for causing a computer to execute a data accessing method, the method comprising: obtaining a feature amount related to brightness of each pixel of at least a part a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; determining a scene of the image data among a plurality of scenes including at least underexposure, using at least the obtained feature amount related to the brightness and a feature amount related to a variance of the obtained plurality of color-difference values; and correcting the image data in accordance with the determined scene.
Claim 16
Dependent Claim
144 words
A data processing apparatus comprising: (a) a memory storing instructions; and (b) one or more processors that execute the instructions and cause the data processing apparatus to function as: (i) an obtaining unit configured to obtain a feature amount related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; (ii) a decision unit configured to decide information for correcting brightness of the image data, using at least the feature amount related to the brightness and a maximum value and a minimum value of the plurality of color-difference values obtained by the obtaining unit; and (iii) a correction unit configured to correct brightness of the image data using the information decided by the decision unit.
Claim 17
Dependent Claim
144 words
A data processing apparatus comprising: (a) a memory storing instructions; and (b) one or more processors that execute the instructions and cause the data processing apparatus to function as: (i) an obtaining unit configured to obtain a feature amount related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; (ii) a decision unit configured to decide information for correcting brightness of the image data, using at least the feature amount related to the brightness and a maximum value and a minimum value of the plurality of color-difference values obtained by the obtaining unit; and (iii) a correction unit configured to correct brightness of the image data using the information decided by the decision unit.
Claim 18
Dependent Claim
117 words
A non-transitory computer readable storage medium storing a program for causing a computer to execute a data processing method, the method comprising: obtaining feature amounts related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels included in the image data; deciding information for correcting brightness of the image data, using at least the feature amount related to the brightness of the plurality of pixels and a maximum value and a minimum value of the obtained plurality of color difference values; and correcting brightness of the image data using the decided information.
Claim 19
Dependent Claim
117 words
A non-transitory computer readable storage medium storing a program for causing a computer to execute a data processing method, the method comprising: obtaining feature amounts related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels included in the image data; deciding information for correcting brightness of the image data, using at least the feature amount related to the brightness of the plurality of pixels and a maximum value and a minimum value of the obtained plurality of color difference values; and correcting brightness of the image data using the decided information.
Claim 20
Independent Claim
105 words
A method of controlling a data processing apparatus, the method comprising: obtaining feature amounts related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels included in the image data; deciding information for correcting brightness of the image data, using at least the feature amount related to the brightness of the plurality of pixels and a maximum value and a minimum value of the obtained plurality of color-difference values; and correcting brightness of the image data using the decided information.
Claim 21
Independent Claim
105 words
A method of controlling a data processing apparatus, the method comprising: obtaining feature amounts related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels included in the image data; deciding information for correcting brightness of the image data, using at least the feature amount related to the brightness of the plurality of pixels and a maximum value and a minimum value of the obtained plurality of color-difference values; and correcting brightness of the image data using the decided information.
Claim 22
Dependent Claim
70 words
The method according to claim 11 , wherein the determining determines that the scene of the image data is underexposure based on a relationship among the feature amount related to the brightness of the plurality of pixels, the feature amount related to the variance of the obtained color-difference values of the plurality of pixels, and predetermined feature amounts related to respective brightness and the variance of color-difference values indicating underexposure.
Claim 23
Dependent Claim
124 words
The method according to claim 11 , wherein the determining (i) calculates a distance between coordinates of the feature amount related to the brightness and the feature amount related to the variance of the obtained color-difference values and coordinates of respective brightness and a color-difference value indicating underexposure, in a feature amount space including at least the feature amount related to the brightness and the feature amount related to the variance of the color difference, and (ii) determines that the scene of the image data is a scene that is set on coordinates in which the calculated distance is the shortest from the coordinates of the feature amount related to the brightness and the feature amount related to the variance of the color-difference values.
Claim 24
Dependent Claim
31 words
The method according to claim 11 , wherein the feature amount related to the brightness is an average value of luminance values of the plurality of pixels of the image data.
Claim 25
Dependent Claim
77 words
The method according to claim 11 , wherein the feature amount related to the brightness is at least one of an average value of luminance of the plurality of pixels of the image data, a maximum value of luminance of the plurality of pixels of the image data, a minimum value of luminance of the plurality of pixels of the image data, and a median value of luminance of the plurality of pixels of the image data.
Claim 26
Dependent Claim
135 words
The method according to claim 11 , wherein the feature amount related to the variance of the color-difference values of the plurality of pixels is at least one of a variance of color-difference values of the plurality of pixels of the image data, a difference value obtained by subtracting a minimum value of a color-difference value from a maximum value of color-difference values of the plurality of pixels of the image data, a variance of color-difference values of the plurality of pixels in the neighborhood of a pixel having a maximum value of luminance of the plurality of pixels of the image data, and a variance of color-difference values of the plurality of pixels in the neighborhood of a pixel having a minimum value of luminance of the plurality of pixels of the image data.
Claim 27
Dependent Claim
164 words
A data processing apparatus comprising: (a) a memory storing instructions; and (b) one or more processors that execute the instructions and cause the data processing apparatus to function as: (i) an obtaining unit configured to obtain a feature amount related to brightness of each pixel of at least a part of a plurality of pixels in image data and a feature amount related to a color difference value of each pixel of at least a part of a plurality of pixels in the image data; (ii) a determination unit configured to determine a scene of the image data; and (iii) a correction unit configured to correct the image data in accordance with the scene determined by the determination unit, wherein a determination by the determination unit includes discriminating at least one of an underexposure scene and a nightscape scene, using at least the feature amount related to brightness and the feature amount related to a plurality of color-difference values obtained by the obtaining unit.
Claim 28
Dependent Claim
164 words
A data processing apparatus comprising: (a) a memory storing instructions; and (b) one or more processors that execute the instructions and cause the data processing apparatus to function as: (i) an obtaining unit configured to obtain a feature amount related to brightness of each pixel of at least a part of a plurality of pixels in image data and a feature amount related to a color difference value of each pixel of at least a part of a plurality of pixels in the image data; (ii) a determination unit configured to determine a scene of the image data; and (iii) a correction unit configured to correct the image data in accordance with the scene determined by the determination unit, wherein a determination by the determination unit includes discriminating at least one of an underexposure scene and a nightscape scene, using at least the feature amount related to brightness and the feature amount related to a plurality of color-difference values obtained by the obtaining unit.
Claim 29
Independent Claim
117 words
A method of controlling a data processing apparatus, the method comprising: obtaining a feature amount related to brightness of each pixel of at least a part of a plurality of pixels in image data and a feature amount related to a color-difference value of each pixel of least a part a plurality of pixels in the image data; determining a scene of the image data; and correcting the image data in accordance with the determined scene, wherein a determination in the determining includes discriminating at least one of an underexposure scene and a nightscape scene, using at least the feature amount related to brightness and the obtained feature amount related to the obtained plurality of color-difference values.
Claim 30
Independent Claim
117 words
A method of controlling a data processing apparatus, the method comprising: obtaining a feature amount related to brightness of each pixel of at least a part of a plurality of pixels in image data and a feature amount related to a color-difference value of each pixel of least a part a plurality of pixels in the image data; determining a scene of the image data; and correcting the image data in accordance with the determined scene, wherein a determination in the determining includes discriminating at least one of an underexposure scene and a nightscape scene, using at least the feature amount related to brightness and the obtained feature amount related to the obtained plurality of color-difference values.
Claim 31
Dependent Claim
66 words
The method according to claim 22 , wherein the determining determines that the scene of the image data is underexposure based on a relationship among the feature amount related to the brightness of the plurality of pixels, the feature amount related to the obtained color-difference values of the plurality of pixels, and predetermined feature amounts related to respective brightness and a color-difference value indicating being underexposure.
Claim 32
Dependent Claim
117 words
The method according to claim 22 , wherein the determining (i) calculates a distance between coordinates of the feature amount related to the brightness and the feature amount related to the obtained color-difference values and coordinates of respective brightness and color-difference values indicating nightscape and underexposure, in a feature amount space including at least the feature amount related to the brightness and the feature amount related to the color-difference values, and (ii) determines that the scene of the image data is a scene that is set on coordinates in which the calculated distance is the shortest from the coordinates of the feature amount related to the brightness and the feature amount related to the obtained color-difference values.
Claim 33
Dependent Claim
31 words
The method according to claim 22 , wherein the feature amount related to the brightness is an average value of luminance values of the plurality of pixels of the image data.
Claim 34
Dependent Claim
77 words
The method according to claim 22 , wherein the feature amount related to the brightness is at least one of an average value of luminance of the plurality of pixels of the image data, a maximum value of luminance of the plurality of pixels of the image data, a minimum value of luminance of the plurality of pixels of the image data, and a median value of luminance of the plurality of pixels of the image data.
Claim 35
Dependent Claim
132 words
The method according to claim 22 , wherein the feature amount related to the color-difference values of the plurality of pixels is at least one of a variance of color-difference values of the plurality of pixels of the image data, a difference value obtained by subtracting a minimum value of a color-difference value from a maximum value of color-difference values of the plurality of pixels of the image data, a variance of color difference of the plurality of pixels in the neighborhood of a pixel having a maximum value of luminance of the plurality of pixels of the image data, and a variance of color-difference values of the plurality of pixels in the neighborhood of a pixel having a minimum value of luminance of the plurality of pixels of the image data.
Claim 36
Dependent Claim
57 words
The method according to claim 22 , wherein the correcting corrects the image data using a correction characteristic being different from a correction characteristic used in a case that the determining determines that the scene of the image data is underexposure, when it is determined in the determining that the scene of the image data is nightscape.
Claim 37
Dependent Claim
29 words
The apparatus according to claim 1 , wherein the determination unit determines the scene of the image data among the plurality of scenes including at least underexposure and nightscape.
Claim 38
Dependent Claim
62 words
The data processing apparatus according to claim 29 , wherein the correction unit is configured to correct the image data using a correction characteristic being different from a correction characteristic used in a case of the determination unit determining that the scene of the image data is underexposure, when the determination unit determines that the scene of the image data is nightscape.
Claim 39
Dependent Claim
86 words
The data processing apparatus according to claim 30 , wherein, if the determination unit determines that the scene of the image data is (i) nightscape, the correction unit makes a correction in a way that dark pixels of the image data are made darker and light pixels of the image data are made lighter, and (ii) underexposure, the correction unit makes a correction in a way that dark pixels of the image data are made lighter and light pixels of the image data are made darker.
Claim 40
Dependent Claim
30 words
The method according to claim 11 , wherein, in the determining, the scene of the image data is determined among the plurality of scenes including at least underexposure and nightscape.
Claim 41
Dependent Claim
33 words
The apparatus according to claim 13 , wherein the decision unit decides the information for correcting brightness of the image data using a difference value between the maximum value and the minimum value.
Claim 42
Dependent Claim
141 words
A data processing apparatus comprising: (a) a memory storing instructions; (b) one or more processors that execute the instructions and cause the data processing apparatus to function as: (i) an obtaining unit configured to obtain feature amounts related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; (ii) a decision unit configured to decide information for correcting brightness of the image data, using at least the feature amount related to the brightness and a difference of two color-difference values among the plurality of color-difference values obtained by the obtaining unit; and (iii) a correction unit configured to correct brightness of the image data using the information decided by the decision unit.
Claim 43
Dependent Claim
141 words
A data processing apparatus comprising: (a) a memory storing instructions; (b) one or more processors that execute the instructions and cause the data processing apparatus to function as: (i) an obtaining unit configured to obtain feature amounts related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; (ii) a decision unit configured to decide information for correcting brightness of the image data, using at least the feature amount related to the brightness and a difference of two color-difference values among the plurality of color-difference values obtained by the obtaining unit; and (iii) a correction unit configured to correct brightness of the image data using the information decided by the decision unit.
Claim 44
Independent Claim
97 words
A method of controlling a data processing apparatus, the method comprising: obtaining feature amounts related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; deciding information for correcting brightness of the image data, using at least the feature amount related to the brightness and a difference of two color-difference values among the obtained plurality of pixels; and correcting brightness of the image data using the decided information.
Claim 45
Independent Claim
97 words
A method of controlling a data processing apparatus, the method comprising: obtaining feature amounts related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; deciding information for correcting brightness of the image data, using at least the feature amount related to the brightness and a difference of two color-difference values among the obtained plurality of pixels; and correcting brightness of the image data using the decided information.
Claim 46
Dependent Claim
107 words
A non-transitory computer-readable storage medium storing a program for causing a processor to execute a data processing method, the method comprising: obtaining feature amounts related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; deciding information for correcting brightness of the image data using at least the feature amount related to the brightness and a difference of two color-difference values among the obtained plurality of pixels; and correcting brightness of the image data using the decided information.
Claim 47
Dependent Claim
107 words
A non-transitory computer-readable storage medium storing a program for causing a processor to execute a data processing method, the method comprising: obtaining feature amounts related to brightness of each pixel of at least a part of a plurality of pixels in image data and a color-difference value of each pixel of at least a part of a plurality of pixels in the image data; deciding information for correcting brightness of the image data using at least the feature amount related to the brightness and a difference of two color-difference values among the obtained plurality of pixels; and correcting brightness of the image data using the decided information.
References Cited (Backward Citations)
US4972223A
Cited
US5940530A
Cited
US20030030825A1
Cited
US7303134B2
Cited
JP4057147B2
Cited
US7010160B1
Cited
US6694051B1
Cited
JP2002520968A
Cited
US6462835B1
Cited
JP2000196894A
Cited
US6806981B1
Cited
US6650771B1
Cited
US7006668B2
Cited
US20020081026A1
Cited
US6859552B2
Cited
JP2002232728A
Cited
JP2002369075A
Cited
US7184174B2
Cited
US20030038956A1
Cited
US6965645B2
Cited
US20070041637A1
Cited
US20030099407A1
Cited
US7167597B2
Cited
US7315657B2
Cited
US7362370B2
Cited
US7242800B2
Cited
US20030174886A1
Cited
US7369163B2
Cited
US20030179298A1
Cited
US20030184671A1
Cited
US7580064B2
Cited
JP2004104464A
Cited
US8358355B2
Cited
US7847841B2
Cited
US7639284B2
Cited
US7447377B2
Cited
US20050134702A1
Cited
US7728844B2
Cited
US7974467B2
Cited
US8941755B2
Cited
JP2007158579A
Cited
US20080253684A1
Cited
JP2007228221A
Cited
US7853078B2
Cited
US8035727B2
Cited
JP2008244769A
Cited
US8085323B2
Cited
US8213733B2
Cited
US20090034837A1
Cited
JP2009038523A
Cited
US20090034840A1
Cited
US20140044354A1
Cited
US20090041347A1
Cited
US8488015B2
Cited
US7995135B2
Cited
US8059187B2
Cited
US20090231630A1
Cited
US8363125B2
Cited
US8718359B2
Cited
US8743272B2
Cited
US8463038B2
Cited
US8472713B2
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2020-08-07 | 2021-02-06 | 2021-08-08 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2024-08-07 | 2025-02-06 | 2025-08-08 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2028-08-07 | 2029-02-06 | 2029-08-08 | $7700.00 | Pending Window |