Patent US7129983B2 successfully refreshed from Google Patents.
US7129983B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Control of a flash unit in a digital camera
Assignee: Nokia Technologies Oy
•
Filing: 2002-05-31
•
Granted: 2006-10-31
•
Expires: 2022-05-31
Abstract
Abstract The invention is based on a method for controlling a flash unit in connection with a digital image sensor without a mechanical shutter, wherein the exposure of the image sensor is performed in sub-areas, such as pixel rows or columns, or in another order, by using a rolling electronic shutter or the like. Thus, the exposure of said sub-areas of the image sensor takes place at least partly at different times. According to the invention, during the time of exposure of one image, i.e. substantially all the sub-areas of the image sensor, several discrete, successive flashes of the flash unit are used to achieve even exposure of the image area, which the flashes are timed in such a way that each single flash is triggered at a point of time which is common to the integration or exposure time of as many successive sub-areas of the image sensor as possible. According to the invention, the successive light flashes are also timed in such a way that one and only one flash of the flash unit occurs during the integration or exposure time of each single sub-area. By the present invention, the significant advantage is attained that the invention minimizes the number of light flashes required for one image while it also secures that each sub-area of the sensor to be exposed at a different time is illuminated as evenly as possible.
Inventors
- 👤 Henry Rantanen
- 👤 Jukka Yrjänäinen
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 11:38
CPC Classifications
H; H04; H04N; H04N23/00; H04N23/70; H04N23/74; H04N25/00; H04N25/50; H04N25/53; H04N25/531
Claims Analysis
Total Claims: 31
Claim 1
Independent Claim
195 words
A method for controlling a flash unit used for illuminating an object to be imaged in connection with an electronic image sensor based on a 2-dimensional pixel matrix, the electronic image sensor having a plurality of discrete sub-areas that combine to form an image area, wherein an exposure of the image sensor to form one image is performed by exposure of all of the sub-areas by using a rolling electronic shutter, wherein the exposure of at least some of said sub-areas takes place at different times during a time of exposure of said one image, and further wherein, several discrete, successive flashes of the flash unit are used to achieve even exposure of the image area, which flashes are timed in such a way that each single flash is performed at a point of time which is common to an integration or exposure time of as many successive sub-areas greater than one of the image sensor as possible, and that the successive flashes of the flash unit are also timed in such a way that one and only one flash of the flash unit occurs during the integration or exposure time of each single sub-area.
Claim 2
Independent Claim
195 words
A method for controlling a flash unit used for illuminating an object to be imaged in connection with an electronic image sensor based on a 2-dimensional pixel matrix, the electronic image sensor having a plurality of discrete sub-areas that combine to form an image area, wherein an exposure of the image sensor to form one image is performed by exposure of all of the sub-areas by using a rolling electronic shutter, wherein the exposure of at least some of said sub-areas takes place at different times during a time of exposure of said one image, and further wherein, several discrete, successive flashes of the flash unit are used to achieve even exposure of the image area, which flashes are timed in such a way that each single flash is performed at a point of time which is common to an integration or exposure time of as many successive sub-areas greater than one of the image sensor as possible, and that the successive flashes of the flash unit are also timed in such a way that one and only one flash of the flash unit occurs during the integration or exposure time of each single sub-area.
Claim 3
Dependent Claim
101 words
The method according to claim 1 , wherein the control of the flash unit is applied in connection with an image sensor to be exposed pixel row by pixel row, wherein the number of pixel rows to be simultaneously covered by one light flash is determined from the ratio between the integration or exposure time of a single pixel row and a processing time of a single pixel row, which pixel row processing time indicates the time taken for a pixel row reset function and/or read function, and which exposure time and processing time are substantially equal for all pixel rows.
Claim 4
Dependent Claim
101 words
The method according to claim 1 , wherein the control of the flash unit is applied in connection with an image sensor to be exposed pixel column by pixel column, wherein the number of pixel columns to be simultaneously covered by one light flash is determined from the ratio between the integration or exposure time of a single pixel column and a processing time of a single pixel column, which pixel column processing time indicates the time taken for a pixel column reset function and/or read function, and which exposure time and processing time are substantially equal for all pixel columns.
Claim 5
Dependent Claim
28 words
The method according to claim 1 , wherein successive flashes of the flash unit, required for one image, are triggered by using one or several discrete flash units.
Claim 6
Dependent Claim
30 words
The method according to claim 4 , wherein the successive flashes of the flash unit, required per one image, are triggered as alternating flashes of two or more flash units.
Claim 7
Dependent Claim
30 words
The method according to claim 4 , wherein a single flash unit is based on the use of a flash tube, a discharge lamp or another corresponding thermal light source.
Claim 8
Dependent Claim
28 words
The method according to claim 4 , wherein a single flash unit is based on the use of a light emitting diode or another corresponding non-thermal light source.
Claim 9
Dependent Claim
27 words
The method according to claim 1 , wherein the control of the flash unit is applied for producing a fill-in flash in camera shooting under illuminated conditions.
Claim 10
Dependent Claim
47 words
The method according to claim 1 , wherein an image taken by using the flash unit and stored in electrical format is subjected to post-processing to improve image quality by utilizing information about the size of image sub-areas corresponding to successive separate flashes of the flash unit.
Claim 11
Dependent Claim
30 words
The method according to claim 9 , wherein the post-processing is used to correct a shift caused between said sub-areas due to the movement of the object to be imaged.
Claim 12
Dependent Claim
30 words
The method according to claim 9 , wherein two or more images taken in succession are subjected to post-processing by combining them into a single super-resolution image by image processing.
Claim 13
Dependent Claim
29 words
The method according to claim 1 , wherein the flash unit control is applied in a digital camera function implemented in or in connection with a portable, battery-operated device.
Claim 14
Dependent Claim
18 words
The method according to claim 12 , wherein the flash unit control is applied in a mobile station.
Claim 15
Independent Claim
214 words
A device for controlling a flash unit used for illuminating an object to be imaged in connection with an electronic image sensor based on a 2-dimensional pixel matrix, the electronic image sensor having a plurality of discrete sub-areas that combine to form an image area, wherein the device is arranged to perform an exposure of the image sensor to form one image by exposure of all of the sub-areas by using a rolling electronic shutter, wherein the exposure of at least some of said sub-areas takes place at different times during a time of exposure of said one image, said device being further arranged to use several discrete, successive flashes of a flash unit to achieve even exposure of the image area, and the device being further arranged to time the flashes in such a way that the device is able to perform each single flash at a point of time which is common to the integration or exposure time of as many successive sub-areas greater than one of the image sensor as possible, and that the device is arranged to time the successive flashes of the flash unit in such a way that one and only one flash of the flash unit occurs during the integration or exposure time of each single sub-area.
Claim 16
Independent Claim
214 words
A device for controlling a flash unit used for illuminating an object to be imaged in connection with an electronic image sensor based on a 2-dimensional pixel matrix, the electronic image sensor having a plurality of discrete sub-areas that combine to form an image area, wherein the device is arranged to perform an exposure of the image sensor to form one image by exposure of all of the sub-areas by using a rolling electronic shutter, wherein the exposure of at least some of said sub-areas takes place at different times during a time of exposure of said one image, said device being further arranged to use several discrete, successive flashes of a flash unit to achieve even exposure of the image area, and the device being further arranged to time the flashes in such a way that the device is able to perform each single flash at a point of time which is common to the integration or exposure time of as many successive sub-areas greater than one of the image sensor as possible, and that the device is arranged to time the successive flashes of the flash unit in such a way that one and only one flash of the flash unit occurs during the integration or exposure time of each single sub-area.
Claim 17
Dependent Claim
102 words
The device according to claim 14 being arranged to apply the control of the flash unit in connection with an image sensor to be exposed pixel row by pixel row, and further to determine the number of pixel rows to be simultaneously covered by one light flash from the ratio between the integration or exposure time of a single pixel row and a processing time of a single pixel row, which pixel row processing time indicates the time taken for a pixel row reset function and/or read function, and which exposure time and processing time are substantially equal for all pixel rows.
Claim 18
Dependent Claim
102 words
The device according to claim 14 being arranged to apply the control of the flash unit in connection with an image sensor to be exposed pixel column by pixel column, and further to determine the number of pixel columns to be simultaneously covered by one light flash from the ratio between the integration or exposure time of a single pixel column and a processing time of a single pixel column, which pixel column processing time indicates the time taken for a pixel column reset function and/or read function, and which exposure time and processing time are substantially equal for all pixel columns.
Claim 19
Dependent Claim
19 words
The device according to claim 14 , wherein the image sensor is based on complimentary metal oxide semiconductor technology.
Claim 20
Dependent Claim
18 words
The device according to claim 14 , being a portable, battery-operated device comprising means for digital camera functions.
Claim 21
Dependent Claim
210 words
A computer program product for controlling a flash unit used for illuminating an object to be imaged in connection with an electronic image sensor based on a 2-dimensional pixel matrix, the electronic image sensor having a plurality of discrete sub-areas that combine to form an image area, comprising code means stored on a readable medium and adapted, when run on a computer, to perform an exposure of the image sensor to form one image by exposure of all of the sub-areas by using a rolling electronic shutter, wherein the exposure of at least some of said sub-areas takes place at different times during a time of exposure of said on image, and further, to use several discrete, successive flashes of a flash unit to achieve even exposure of the image area, which flashes are timed in such a way that each single flash is performed at a point of time which is common to the integration or exposure time of as many successive sub-areas greater than one of the image sensor as possible, and that the successive flashes of the flash unit are also timed in such a way that one and only one flash of the flash unit occurs during the integration or exposure time of each single sub-area.
Claim 22
Dependent Claim
210 words
A computer program product for controlling a flash unit used for illuminating an object to be imaged in connection with an electronic image sensor based on a 2-dimensional pixel matrix, the electronic image sensor having a plurality of discrete sub-areas that combine to form an image area, comprising code means stored on a readable medium and adapted, when run on a computer, to perform an exposure of the image sensor to form one image by exposure of all of the sub-areas by using a rolling electronic shutter, wherein the exposure of at least some of said sub-areas takes place at different times during a time of exposure of said on image, and further, to use several discrete, successive flashes of a flash unit to achieve even exposure of the image area, which flashes are timed in such a way that each single flash is performed at a point of time which is common to the integration or exposure time of as many successive sub-areas greater than one of the image sensor as possible, and that the successive flashes of the flash unit are also timed in such a way that one and only one flash of the flash unit occurs during the integration or exposure time of each single sub-area.
Claim 23
Independent Claim
136 words
A method comprising: providing several discrete, successive flashes of a flash unit to illuminate an object to be imaged by an electronic image sensor having a 2-dimensional pixel matrix that forms an image area, wherein the image area comprises a plurality of discrete sub-areas that combine to form said image area, wherein the successive flashes are provided so as to evenly expose the image area of an electronic image sensor, and timing said successive flashes in such a way that each single flash is performed at a point of time which is common to an integration or exposure time of as many successive sub-areas greater than one of the image sensor as possible and so that one and only one flash of the flash unit occurs during the integration or exposure time of each single sub-area.
Claim 24
Independent Claim
136 words
A method comprising: providing several discrete, successive flashes of a flash unit to illuminate an object to be imaged by an electronic image sensor having a 2-dimensional pixel matrix that forms an image area, wherein the image area comprises a plurality of discrete sub-areas that combine to form said image area, wherein the successive flashes are provided so as to evenly expose the image area of an electronic image sensor, and timing said successive flashes in such a way that each single flash is performed at a point of time which is common to an integration or exposure time of as many successive sub-areas greater than one of the image sensor as possible and so that one and only one flash of the flash unit occurs during the integration or exposure time of each single sub-area.
Claim 25
Dependent Claim
35 words
The method according to claim 20 , wherein said sub-areas are each pixel rows of said two-dimensional pixel matrix and wherein each successive flash of the flash unit simultaneously exposes a number of pixel rows.
Claim 26
Dependent Claim
70 words
The method according to claim 21 , wherein said number of pixel rows is determined from the ratio between the integration or exposure time of a single pixel row and a processing time of a single pixel row, which pixel row processing time indicates the time taken for a pixel row reset function and/or read function, and which exposure time and processing time are substantially equal for all pixel rows.
Claim 27
Dependent Claim
35 words
The method according to claim 20 , wherein said sub-areas are each pixel columns of said two-dimensional pixel matrix and wherein each successive flash of the flash unit simultaneously exposes a number of pixel columns.
Claim 28
Dependent Claim
70 words
The method according to claim 23 , wherein said number of pixel columns is determined from the ratio between the integration or exposure time of a single pixel column and a processing time of a single pixel column, which pixel column processing time indicates the time taken for a pixel column reset function and/or read function, and which exposure time and processing time are substantially equal for all pixel columns.
Claim 29
Dependent Claim
47 words
The method according to claim 20 , further comprising storing data corresponding to the exposed image area of the electronic image sensor and post-processing the stored data so as to improve image quality by utilizing information about the size of said sub-areas corresponding to the successive flashes.
Claim 30
Dependent Claim
30 words
The method according to claim 25 , wherein the post-processing is used to correct a shift caused between said sub-areas due to the movement of the object to be imaged.
Claim 31
Dependent Claim
30 words
The method according to claim 25 , wherein two or more images taken in succession are subjected to post-processing by combining them into a single super-resolution image by image processing.
References Cited (Backward Citations)
US4284333A
Cited
JPH09312799A
Cited
US6278490B1
Cited
US5752097A
Cited
WO1999005853A1
Cited
US6654062B1
Cited
US20050057674A1
Cited
US6404987B1
Cited
EP0989741A2
Cited
JP2000196951A
Cited
JP2000262677A
Cited
US6856356B1
Cited
US20020080254A1
Cited
US6584283B2
Cited
EP1263215A2
Cited
US20030062582A1
Cited
US20030030744A1
Cited
US20040223075A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2009-10-30 | 2010-05-01 | 2010-10-31 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2013-10-30 | 2014-05-01 | 2014-10-31 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2017-10-30 | 2018-05-01 | 2018-10-31 | $7700.00 | Window Closed / Lapsed |