US5909244A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Real time adaptive digital image processing for dynamic range remapping of imagery including low-light-level visible imagery
Assignee: Massachusetts Institute of Technology
•
Filing: 1996-09-05
•
Granted: 1999-06-01
•
Expires: 2016-09-05
Abstract
Abstract An imaging system is provided for imaging a scene to produce a sequence of image frames of the scene at a frame rate, R, of at least about 25 image frames per second. The system includes an optical input port, a charge-coupled imaging device, an analog signal processor, and an analog-to-digital processor (A/D). The A/D digitizes the amplified pixel signal to produce a digital image signal formatted as a sequence of image frames each of a plurality of digital pixel values and having a dynamic range of digital pixel values represented by a number of digital bits, B, where B is greater than 8. A digital image processor is provided for processing digital pixel values in the sequence of image frames to produce an output image frame sequence at the frame rate, R, representative of the imaged scene, with a latency of no more than about 1/R and a dynamic range of image frame pixel values represented by a number of digital bits, D, where D is less than B. The output image frame sequence is characterized by noise-limited resolution of at least a minimum number, N M , of line pairs per millimeter, referred to the charge-coupled imaging device pixel array, in an imaged scene as a function of illuminance of the input light impinging the charge-coupled imaging device pixels.
Inventors
- 👤 Allen M. Waxman
- 👤 Alan N. Gove
- 👤 David A. Fay
- 👤 James E. Carrick
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-28 22:47
CPC Classifications
H; H04; H04N; H04N5/00; H04N5/14; H04N5/20; H04N25/00
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
377 words
An image processing system for adaptively processing a sequence of input digital image frames each represented by an array of digital pixel values corresponding to a scene image and having a dynamic range represented by a number of digital bits, B, to produce at a frame rate, R, a sequence of digital output image frames each represented by an array of digital output pixel values having an output dynamic range represented by a number of output digital bits, D, the system comprising: a center-surround-shunt processor connected to receive the sequence of input digital image frames at the frame rate, R, and for each frame to evaluate each pixel value based on neighboring pixel values in that frame's pixel value array to produce a corresponding enhanced pixel value that results in enhanced local spatial contrast in the scene image, the center-surround-shunt processor adaptively normalizing each resulting frame of enhanced pixel values to a prespecified pixel value range; a statistics processor connected to receive the sequence of input digital image frames to determine for each input frame a measure of mean scene image brightness, and connected to receive the enhanced frame pixel values to determine for each enhanced frame a measure of mean enhanced image brightness and a measure of enhanced pixel value standard deviation across the enhanced frame; a remapping function processor connected to receive for each input frame the measure of mean enhanced frame image brightness and the measure of enhanced pixel value standard deviation across the corresponding enhanced frame and in response to construct a pixel value remapping function based on the received measures, the remapping function constituting a rule for remapping the enhanced and normalized pixel values from the center surround-shunt processor to a preselected output dynamic range represented by the number of digital bits D; and a remap processor connected to receive the enhanced and normalized pixel values from the center surround-shunt processor and connected to the remapping function processor to apply a remapping function to the enhanced and normalized pixel values for rescaling each enhanced and normalized pixel value to the output dynamic range and to produce at the frame rate, R, and with a latency time of no more than about 1/R, a sequence of output image frames of remapped pixel values.
Claim 2
Dependent Claim
377 words
An image processing system for adaptively processing a sequence of input digital image frames each represented by an array of digital pixel values corresponding to a scene image and having a dynamic range represented by a number of digital bits, B, to produce at a frame rate, R, a sequence of digital output image frames each represented by an array of digital output pixel values having an output dynamic range represented by a number of output digital bits, D, the system comprising: a center-surround-shunt processor connected to receive the sequence of input digital image frames at the frame rate, R, and for each frame to evaluate each pixel value based on neighboring pixel values in that frame's pixel value array to produce a corresponding enhanced pixel value that results in enhanced local spatial contrast in the scene image, the center-surround-shunt processor adaptively normalizing each resulting frame of enhanced pixel values to a prespecified pixel value range; a statistics processor connected to receive the sequence of input digital image frames to determine for each input frame a measure of mean scene image brightness, and connected to receive the enhanced frame pixel values to determine for each enhanced frame a measure of mean enhanced image brightness and a measure of enhanced pixel value standard deviation across the enhanced frame; a remapping function processor connected to receive for each input frame the measure of mean enhanced frame image brightness and the measure of enhanced pixel value standard deviation across the corresponding enhanced frame and in response to construct a pixel value remapping function based on the received measures, the remapping function constituting a rule for remapping the enhanced and normalized pixel values from the center surround-shunt processor to a preselected output dynamic range represented by the number of digital bits D; and a remap processor connected to receive the enhanced and normalized pixel values from the center surround-shunt processor and connected to the remapping function processor to apply a remapping function to the enhanced and normalized pixel values for rescaling each enhanced and normalized pixel value to the output dynamic range and to produce at the frame rate, R, and with a latency time of no more than about 1/R, a sequence of output image frames of remapped pixel values.
Claim 3
Dependent Claim
29 words
The image processing system of claim 1 further comprising a display connected to receive the output digital image frame sequence for displaying the sequence at the frame rate, R.
Claim 4
Dependent Claim
55 words
The image processing system of claim 1 wherein the number of digital bits, D, that represent the output dynamic range, is less than the number of digital bits, B, that represent the dynamic range of the input digital image frames, whereby the image processing system compresses the dynamic range of the input digital image frames.
Claim 5
Dependent Claim
41 words
The image processing system of claim 2 wherein the number of digital bits, D, that represent the output dynamic range, is selected to correspond to displayable dynamic range of the display on which the output image frames are to be displayed.
Claim 6
Dependent Claim
25 words
The image processing system of claim 3 wherein the number of digital bits, B, representing the input digital frame dynamic range, is greater than 8.
Claim 7
Dependent Claim
28 words
The image processing system of claim 5 wherein the number of digital bits, D, representing the compressed dynamic range of remapped pixel values is no larger than 8.
Claim 8
Dependent Claim
42 words
The image processing system of claim 6 wherein the number of digital bits, B, representing the input digital frame dynamic range, is 12, and wherein the number of digital bits, D, representing the compressed dynamic range of remapped pixel values, is 8.
Claim 9
Dependent Claim
20 words
The image processing system of claim 1 wherein the frame rate, R, is at least about 25 frames per second.
Claim 10
Dependent Claim
70 words
The image processing system of claim 1 wherein the remapping function constructed by the remapping function processor comprises a look-up table arranged with look-up table addresses, each address having a corresponding pixel value, and correspondingly wherein each enhanced pixel value is evaluated by the remap processor as a look-up table address and the look-up table pixel value corresponding to that address is output as the corresponding remapped output pixel value.
Claim 11
Dependent Claim
40 words
The image processing system of claim 1 wherein the neighboring pixel values on which the center-surround shunt processor bases evaluation of an input frame pixel value comprises a Gaussian weighted local neighborhood of pixel values in the corresponding input frame.
Claim 12
Dependent Claim
30 words
The image processing system of claim 1 wherein the normalized pixel value range to which the center-surround-shunt processor normalizes each frame of enhanced digital pixel values is -1 to +1.
Claim 13
Dependent Claim
41 words
The image processing system of claim 1 wherein the center-surround-shunt processor is limited in its evaluation pixel values in an input frame to produce only corresponding enhanced pixel values that result in enhanced positive local spatial contrast in the scene image.
Claim 14
Dependent Claim
104 words
The image processing system of claim 1 wherein: each frame in the input digital frame sequence is designated F i , where i is the frame number in the sequence; the measure of mean scene image brightness determined by the statistics processor for frame F i is employed by the center-surround shunt processor to produce enhanced pixel values for frame F i+1 ; and the measure of mean enhanced frame image brightness and the measure of enhanced pixel value standard deviation for frame F i is employed by the remapping function processor to construct a pixel value remapping function for frame F i+2 .
Claim 15
Dependent Claim
25 words
The image processing system of claim 1 wherein the input digital frame sequence corresponds to a visible scene image characterized by an arbitrary scene illuminance.
Claim 16
Dependent Claim
19 words
The image processing system of claim 1 wherein the input digital frame sequence corresponds to an X-ray scene image.
Claim 17
Dependent Claim
19 words
The image processing system of claim 1 wherein the input digital frame sequence corresponds to an infrared scene image.
Claim 18
Dependent Claim
20 words
The image processing system of claim 1 wherein the input digital frame sequence corresponds to a magnetic resonance scene image.
Claim 19
Dependent Claim
19 words
The image processing system of claim 1 wherein the input digital frame sequence corresponds to a radar scene image.
Claim 20
Dependent Claim
19 words
The image processing system of claim 1 wherein the input digital frame sequence corresponds to an acoustic scene image.
Claim 21
Dependent Claim
19 words
The image processing system of claim 1 wherein the input digital frame sequence corresponds to a thermal scene image.
Claim 22
Dependent Claim
19 words
The image processing system of claim 1 wherein the input digital frame sequence corresponds to an ultraviolet scene image.
Claim 23
Dependent Claim
20 words
The image processing system of claim 1 wherein the input digital frame sequence corresponds to a millimeter wave scene image.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-05-31 | 2002-11-30 | 2003-06-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-05-31 | 2006-11-30 | 2007-06-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-05-31 | 2010-11-30 | 2011-06-01 | $7700.00 | Window Closed / Lapsed |