US5929908A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Image sensing apparatus which performs dynamic range expansion and image sensing method for dynamic range expansion
Assignee: Canon Inc
•
Filing: 1996-01-30
•
Granted: 1999-07-27
•
Expires: 2016-01-30
Abstract
Abstract An image sensing apparatus which senses an object a plurality of times in different exposures to obtain a plurality of images and makes a single image with a widened dynamic range by processing the plurality of sensed images, generates a histogram of signal levels of an image sensed in a proper exposure by using a histogram generator, automatically decides whether a dynamic range expansion processing is to be processed or not on the basis of the generated histogram by using a dynamic range expansion deciding unit, determines a parameter for sensing another image of the object in an exposure which is different from the proper exposure in accordance with a decision by the dynamic range expansion deciding unit by using a parameter determination unit, and obtains a single image of the object by processing the image sensed in the proper exposure and the image sensed by using the parameter determined by said parameter determination unit an image processing unit. When an image sensing apparatus is not equipped with a photometer, a pre-sensing operation is performed, an image sensed in the pre-sensing operation is analyzed to find a proper exposure, and this image is also used in the dynamic range expansion processing. A part or whole image data of a plurality of images which are obtained as above and necessary for the dynamic range expansion processing are compressed by a compressing unit and the compressed image data is used in the dynamic range expansion processing.
Inventors
- 👤 Kenji Takahashi
- 👤 Yoshiro Udagawa
- 👤 Masato Ikeda
- 👤 Eiichiro Ikeda
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:59
CPC Classifications
H; H04; H04N; H04N23/00; H04N23/70; H04N19/00; H04N19/50; H04N19/503
Claims Analysis
Total Claims: 35
Claim 1
Independent Claim
147 words
An image sensing apparatus which sense an object a plurality of times in different exposures to obtain a plurality of images and makes a single image with a widened dynamic range by processing the plurality of sensed images, said apparatus comprising: histogram generating means for generating a histogram of signal levels of a first image sensed in a first exposure; deciding means for deciding whether a dynamic range expansion processing is to be processed or not on the basis of the histogram generated by said histogram generating means; parameter determination means for determining a plurality of parameters for sensing a plurality of images of the object in exposures which are different from the first exposure and from each other; and image processing means for processing the first image and the plurality of images sensed by using the determined parameters to obtain a single image of the object.
Claim 2
Dependent Claim
147 words
An image sensing apparatus which sense an object a plurality of times in different exposures to obtain a plurality of images and makes a single image with a widened dynamic range by processing the plurality of sensed images, said apparatus comprising: histogram generating means for generating a histogram of signal levels of a first image sensed in a first exposure; deciding means for deciding whether a dynamic range expansion processing is to be processed or not on the basis of the histogram generated by said histogram generating means; parameter determination means for determining a plurality of parameters for sensing a plurality of images of the object in exposures which are different from the first exposure and from each other; and image processing means for processing the first image and the plurality of images sensed by using the determined parameters to obtain a single image of the object.
Claim 3
Dependent Claim
42 words
The image sensing apparatus according to claim 1, wherein, when said deciding means decides to perform the dynamic range expansion processing, said parameter determination means determines a parameter and said image processing means processes the first image and the plurality of images.
Claim 4
Dependent Claim
47 words
The image sensing apparatus according to claim 1, wherein, when said deciding means decides not to perform the dynamic range expansion processing, said parameter determination means does not determines a parameter, the plurality of images are not sensed, and said image processing means outputs the first image.
Claim 5
Dependent Claim
64 words
The image sensing apparatus according to claim 1, wherein said deciding means decides whether the dynamic range expansion is to be performed or not be comparing at least one total number of events occurred in at least one predetermined range of the signal levels in the histogram generated by said histogram generating means to a threshold predetermined by a range of the signal levels.
Claim 6
Dependent Claim
35 words
The image sensing apparatus according to claim 1, wherein a parameter used for decision by said deciding means whether the dynamic range expansion processing is to be performed or not is set by a user.
Claim 7
Dependent Claim
61 words
The image sensing apparatus according to claim 1, wherein said parameter determination means determines a number of images to be sensed in different exposures which are different from the first exposure and parameters for sensing the images on the basis of at least one total number of events in at least one predetermined range of the signal levels in the histogram.
Claim 8
Dependent Claim
184 words
An image sensing apparatus which sense an object a plurality of times in different exposures to obtain a plurality of images and makes a single image with a widened dynamic range by processing the plurality of sensed images, said apparatus comprising: histogram generating means for generating a histogram of signal levels of a first image sensed in a first exposure; deciding means for deciding whether a dynamic range expansion is to be performed or not by comparing at least one total number of events occurred in at least one predetermined range of the signal levels in the histogram generated by said histogram generating means to a threshold predetermined by a range of the signal levels; parameter determination means for determining a parameter for sensing a second image of the object in a second exposure which is different from the first exposure in accordance with a decision by said deciding means; and image processing means for obtaining a single image of the object by processing the first image and the second image which is sensed by using the parameter determined by said parameter determination means.
Claim 9
Dependent Claim
184 words
An image sensing apparatus which sense an object a plurality of times in different exposures to obtain a plurality of images and makes a single image with a widened dynamic range by processing the plurality of sensed images, said apparatus comprising: histogram generating means for generating a histogram of signal levels of a first image sensed in a first exposure; deciding means for deciding whether a dynamic range expansion is to be performed or not by comparing at least one total number of events occurred in at least one predetermined range of the signal levels in the histogram generated by said histogram generating means to a threshold predetermined by a range of the signal levels; parameter determination means for determining a parameter for sensing a second image of the object in a second exposure which is different from the first exposure in accordance with a decision by said deciding means; and image processing means for obtaining a single image of the object by processing the first image and the second image which is sensed by using the parameter determined by said parameter determination means.
Claim 10
Dependent Claim
177 words
An image sensing apparatus which sense an object a plurality of times in different exposures to obtain a plurality of images and makes a single image with a widened dynamic range by processing the plurality of sensed images, said apparatus comprising: histogram generating means for generating a histogram of signal levels of a first image sensed in a first exposure; deciding means for deciding whether a dynamic range expansion processing is to be processed or not on the basis of the histogram generated by said histogram generating means and a parameter indicating whether the dynamic range expansion processing is to be performed which is set by a user; parameter determination means for determining a parameter for sensing a second image of the object in a second exposure which is different from the first exposure in accordance with a decision by said deciding means; and image processing means for obtaining a single image of the object by processing the first image and the second image which is sensed by using the parameter determined by said parameter determination means.
Claim 11
Dependent Claim
177 words
An image sensing apparatus which sense an object a plurality of times in different exposures to obtain a plurality of images and makes a single image with a widened dynamic range by processing the plurality of sensed images, said apparatus comprising: histogram generating means for generating a histogram of signal levels of a first image sensed in a first exposure; deciding means for deciding whether a dynamic range expansion processing is to be processed or not on the basis of the histogram generated by said histogram generating means and a parameter indicating whether the dynamic range expansion processing is to be performed which is set by a user; parameter determination means for determining a parameter for sensing a second image of the object in a second exposure which is different from the first exposure in accordance with a decision by said deciding means; and image processing means for obtaining a single image of the object by processing the first image and the second image which is sensed by using the parameter determined by said parameter determination means.
Claim 12
Dependent Claim
176 words
An image sensing apparatus which sense an object a plurality of times in different exposures to obtain a plurality of images and makes a single image with a widened dynamic range by processing the plurality of sensed images, said apparatus comprising: histogram generating means for generating a histogram of signal levels of a first image sensed in a first exposure; deciding means for deciding whether a dynamic range expansion processing is to be processed or not on the basis of the histogram generated by said histogram generating means; parameter determination means for determining a number of images to be sensed in different exposures which are different from the first exposure and parameters for sensing the images on the basis of at least one total number of events in at least one predetermined range of the signal levels in the histogram; and image processing means for obtaining a single image of the object by processing the first image and the images which are sensed in different exposures by using the parameters determined by said parameter determination means.
Claim 13
Dependent Claim
176 words
An image sensing apparatus which sense an object a plurality of times in different exposures to obtain a plurality of images and makes a single image with a widened dynamic range by processing the plurality of sensed images, said apparatus comprising: histogram generating means for generating a histogram of signal levels of a first image sensed in a first exposure; deciding means for deciding whether a dynamic range expansion processing is to be processed or not on the basis of the histogram generated by said histogram generating means; parameter determination means for determining a number of images to be sensed in different exposures which are different from the first exposure and parameters for sensing the images on the basis of at least one total number of events in at least one predetermined range of the signal levels in the histogram; and image processing means for obtaining a single image of the object by processing the first image and the images which are sensed in different exposures by using the parameters determined by said parameter determination means.
Claim 14
Dependent Claim
44 words
The image sensing apparatus according to claim 9, wherein a user sets the number of the images to be sensed in different exposures which is different from the first exposure and the parameters used for sensing the images instead of the parameter determination means.
Claim 15
Dependent Claim
167 words
An image processing apparatus which makes a single image with a widened dynamic range by processing a plurality of images obtained by sensing an object a plurality of times in different exposures, said apparatus comprising: an interface for receiving the plurality of images; histogram generating means for generating a histogram of signal levels of a first image out of the plurality of received images which is sensed in a first exposure; deciding means for deciding whether a dynamic range expansion processing is to be processed or not on the basis of the histogram generated by said histogram generating means; parameter determination means for determining a plurality of parameters for sensing a plurality of images of the object in exposures which are different from the first exposure and from each other in accordance with a decision by said deciding means; and image processing means for processing the first image and the plurality of images sensed by using the determined parameters to obtain a single image of the object.
Claim 16
Dependent Claim
167 words
An image processing apparatus which makes a single image with a widened dynamic range by processing a plurality of images obtained by sensing an object a plurality of times in different exposures, said apparatus comprising: an interface for receiving the plurality of images; histogram generating means for generating a histogram of signal levels of a first image out of the plurality of received images which is sensed in a first exposure; deciding means for deciding whether a dynamic range expansion processing is to be processed or not on the basis of the histogram generated by said histogram generating means; parameter determination means for determining a plurality of parameters for sensing a plurality of images of the object in exposures which are different from the first exposure and from each other in accordance with a decision by said deciding means; and image processing means for processing the first image and the plurality of images sensed by using the determined parameters to obtain a single image of the object.
Claim 17
Dependent Claim
22 words
The image processing apparatus according to claim 11, wherein said image processing apparatus is used by connecting to an image sensing apparatus.
Claim 18
Dependent Claim
158 words
An image sensing method of sensing an object a plurality of times in different exposures to obtain a plurality of images and making a single image with a widened dynamic range by processing the plurality of sensed images, said method comprising: a histogram generating step of generating a histogram of signal levels of a first image sensed in a first exposure; a deciding step of deciding whether a dynamic range expansion processing is to be performed on the basis of the histogram generated at said histogram generating step; a parameter determination step of determining a plurality of parameters for sensing a plurality of images of the object in exposures which are different from the first exposure and from each other in accordance with a decision at said deciding step; and an image processing step of processing the first image and the plurality of images sensed by using the determined parameters to obtain a single image of the object.
Claim 19
Dependent Claim
158 words
An image sensing method of sensing an object a plurality of times in different exposures to obtain a plurality of images and making a single image with a widened dynamic range by processing the plurality of sensed images, said method comprising: a histogram generating step of generating a histogram of signal levels of a first image sensed in a first exposure; a deciding step of deciding whether a dynamic range expansion processing is to be performed on the basis of the histogram generated at said histogram generating step; a parameter determination step of determining a plurality of parameters for sensing a plurality of images of the object in exposures which are different from the first exposure and from each other in accordance with a decision at said deciding step; and an image processing step of processing the first image and the plurality of images sensed by using the determined parameters to obtain a single image of the object.
Claim 20
Dependent Claim
177 words
An image sensing apparatus which senses an object a plurality of times in different exposures to obtain a plurality of images and makes a single image with a widened dynamic range by processing the plurality of sensed images, said apparatus comprising: an image sensor for sensing the object so as to obtain an image and outputting the obtained image; operation means for finding a proper exposure by using a first image sensed in a first image sensing operation and a first exposure used to sense the first image; deciding means for deciding whether a dynamic range expansion processing is to be performed; image sensor control means for controlling said image sensor to sense a second image and a third image so that the first, second, and third images are sensed in proper, over, and under exposures on the basis of the proper exposure obtained by said operation means and the first exposure; and image processing means for, depending upon a decision by said deciding means, generating a single image by using the first, second and third images.
Claim 21
Dependent Claim
177 words
An image sensing apparatus which senses an object a plurality of times in different exposures to obtain a plurality of images and makes a single image with a widened dynamic range by processing the plurality of sensed images, said apparatus comprising: an image sensor for sensing the object so as to obtain an image and outputting the obtained image; operation means for finding a proper exposure by using a first image sensed in a first image sensing operation and a first exposure used to sense the first image; deciding means for deciding whether a dynamic range expansion processing is to be performed; image sensor control means for controlling said image sensor to sense a second image and a third image so that the first, second, and third images are sensed in proper, over, and under exposures on the basis of the proper exposure obtained by said operation means and the first exposure; and image processing means for, depending upon a decision by said deciding means, generating a single image by using the first, second and third images.
Claim 22
Dependent Claim
43 words
The image sensing apparatus according to claim 14, wherein said image processing means generates the single image without using the first image when a difference between the first exposure and the proper exposure obtained by said operation means is over a predetermined value.
Claim 23
Dependent Claim
23 words
The image sensing apparatus according to claim 14, wherein the first image obtained in the first image sensing operation is of one frame.
Claim 24
Dependent Claim
23 words
The image sensing apparatus according to claim 14, wherein the first image obtained in the first image sensing operation is of one field.
Claim 25
Dependent Claim
63 words
The image sensing apparatus according to claim 14, wherein, when the first exposure is the proper exposure obtained by said operation means, said image sensor control means controls the image sensor so as to sense the second image in the second exposure which is different form the first exposure and which is decided on the basis of luminance distribution of the first image.
Claim 26
Dependent Claim
36 words
The image sensing apparatus according to claim 14, wherein said image sensor control means controls said image sensor so that it senses an image by frame in an exposure which is different from the first exposure.
Claim 27
Dependent Claim
36 words
The image sensing apparatus according to claim 14, wherein said image sensor control means controls said image sensor so that it senses an image by field in an exposure which is different from the first exposure.
Claim 28
Dependent Claim
176 words
An image sensing method of sensing an object a plurality of times in different exposures to obtain a plurality of images and making a single image with a widened dynamic range by processing the plurality of sensed images, said method comprising: a first image sensing step of sensing a first image of the object and outputting the first image; an operation step of finding a proper exposure by using the first image sensed at the first image sensing step and a first exposure used to sense the first image; a deciding step of deciding whether a dynamic range expansion processing is to be performed; a second image sensing step of sensing a second image and a third image so that the first, second, and third images are sensed in proper, over, and under exposures on the basis of the proper exposure obtained at said operation step and the first exposure; and an image processing step of, depending upon a decision at said deciding step, generating a single image by using the first, second and third images.
Claim 29
Dependent Claim
176 words
An image sensing method of sensing an object a plurality of times in different exposures to obtain a plurality of images and making a single image with a widened dynamic range by processing the plurality of sensed images, said method comprising: a first image sensing step of sensing a first image of the object and outputting the first image; an operation step of finding a proper exposure by using the first image sensed at the first image sensing step and a first exposure used to sense the first image; a deciding step of deciding whether a dynamic range expansion processing is to be performed; a second image sensing step of sensing a second image and a third image so that the first, second, and third images are sensed in proper, over, and under exposures on the basis of the proper exposure obtained at said operation step and the first exposure; and an image processing step of, depending upon a decision at said deciding step, generating a single image by using the first, second and third images.
Claim 30
Dependent Claim
45 words
The image sensing method according to claim 21, wherein, at said image processing step, the single image is generated without using the first image when a difference between the first exposure and the proper exposure obtained at said operation step is over a predetermined value.
Claim 31
Dependent Claim
23 words
The image sensing method according to claim 21, wherein the first image obtained at the first image sensing step is of one frame.
Claim 32
Dependent Claim
23 words
The image sensing method according to claim 21, wherein the first image obtained at the first image sensing step is of one field.
Claim 33
Dependent Claim
58 words
The image sensing method according to claim 21, wherein, when the first exposure is the proper exposure obtained at said operation step, at said second image sensing step, the second image is sensed in the second exposure which is different from the first exposure and which is decided on the basis of luminance distribution of the first image.
Claim 34
Dependent Claim
33 words
The image sensing method according to claim 21, wherein, at said second image sensing step, the second image is sensed by frame in the second exposure which is different from the first exposure.
Claim 35
Dependent Claim
33 words
The image sensing method according to claim 21, wherein, at said second image sensing step, the second image is sensed by field in the second exposure which is different from the first exposure.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-07-26 | 2003-01-25 | 2003-07-27 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-07-26 | 2007-01-25 | 2007-07-27 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-07-26 | 2011-01-25 | 2011-07-27 | $7700.00 | Window Closed / Lapsed |