← Back to Patent Explorer
US20040169746A1 Expired / Lapsed US ⏱️ 0.0 years remaining

Defective pixel filtering for digital imagers

Assignee: Individual
•
Filing: 2004-03-10
•
Granted: —
•
Expires: 2024-03-10
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Defective pixels in a CMOS array give rise to spot noise that diminishes the integrity of the resulting image. Because CMOS arrays and digital logic can be fabricated on the same integrated circuit using the same processing technology and relatively inexpensive and fast circuit can be employed to digitally filter the pixel data stream and to identify pixels having values that do not fall in the range defined by the immediately neighboring pixels and the deviate from the neighboring pixels by more than a threshold amount. Such conditions would indicate that the deviation is caused by a defective pixel rather than by desired image data. The threshold amount can be preprogrammed or can be provided by a user or can be dynamically set using feedback indicating image quality. The filter would also provide a solution for other sensors such as CCD, although a single chip solution would likely not be possible.

Inventors

  • 👤 Zhiliang Chen
  • 👤 Eugene Dierschke
  • 👤 Steven Clynes
  • 👤 Anli Liu

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 17:58
CPC Classifications
H; H04; H04N; H04N5/00; H04N5/14; H04N5/16; H04N23/00; H04N23/70; H04N23/76; H04N25/00; H04N25/60; H04N25/68; H04N25/683; H04N5/20

Claims Analysis

Total Claims: 38
Claim 1
Independent Claim 96 words
1 . A digital imaging device comprising: a substrate; a sensor array formed on the substrate, the array generating an electrical signal corresponding to the amount of light impinging upon the array; and imaging logic formed on the substrate, coupled to the sensor array and receiving the electrical signal, the imaging logic including an analog to digital converter receiving the electrical signal and outputting digital pixel values; and a defective pixel filter receiving the digital pixel values and detecting defective pixels on the basis of variations between a selected pixel value and its neighboring pixel values.
Claim 2
Dependent Claim 96 words
1 . A digital imaging device comprising: a substrate; a sensor array formed on the substrate, the array generating an electrical signal corresponding to the amount of light impinging upon the array; and imaging logic formed on the substrate, coupled to the sensor array and receiving the electrical signal, the imaging logic including an analog to digital converter receiving the electrical signal and outputting digital pixel values; and a defective pixel filter receiving the digital pixel values and detecting defective pixels on the basis of variations between a selected pixel value and its neighboring pixel values.
Claim 3
Dependent Claim 29 words
2 . The digital imaging device of claim 1 further comprising: a corrected pixel value calculator receiving as input the neighboring pixel values and outputting a corrected pixel value.
Claim 4
Dependent Claim 23 words
3 . The digital imaging device of claim 1 further comprising: a first in first out register wherein said pixel values are stored.
Claim 5
Dependent Claim 24 words
4 . The digital imaging device of claim 1 wherein the defective pixel filter and the corrected pixel value calculator operate in real time.
Claim 6
Dependent Claim 18 words
5 . The digital imaging device of claim 1 wherein the sensor array is comprised of CMOS cells.
Claim 7
Dependent Claim 18 words
6 . The digital imaging device of claim 1 wherein the digital pixel values are ten bit values.
Claim 8
Dependent Claim 72 words
7 . The digital imaging device of claim 1 wherein the defective pixel filter comprises: means for detecting whether the selected pixel is outside an acceptable range defined by its neighboring pixel values; means for determining whether the selected pixel deviates from a first neighboring pixel by greater than a threshold value; and means for determining whether the selected pixel deviates from a second neighboring pixel by greater than a threshold value.
Claim 9
Dependent Claim 21 words
8 . The digital imaging device of claim 7 wherein the threshold value is a pre-determined value stored in a register.
Claim 10
Dependent Claim 18 words
9 . The digital imaging device of claim 7 wherein the threshold value is selected by an end-user.
Claim 11
Dependent Claim 23 words
10 . The digital imaging device of claim 7 wherein the threshold value if determined from a feedback signal indicative of image quality.
Claim 12
Dependent Claim 160 words
11 . A method for detecting a defective pixel based upon the luminance values generated by the pixel element and its two nearest neighbors comprising: determining a first difference value between the luminance value of the pixel and the luminance value of a first neighboring pixel; comparing the first difference value to a pre-determined threshold value; determining a second difference value between the luminance of the pixel and the luminance value of a second neighboring pixel; comparing the second difference value to the pre-determined threshold value; detecting whether the luminance value for the pixel falls within an acceptable range defined by the luminance value for the first neighboring pixel and the luminance value for the second neighboring pixel; and identifying the pixel element as defective if the luminance value for the pixel element does not fall within the acceptable range and neither the first difference value nor the second difference value is less than or equal to the threshold value.
Claim 13
Dependent Claim 160 words
11 . A method for detecting a defective pixel based upon the luminance values generated by the pixel element and its two nearest neighbors comprising: determining a first difference value between the luminance value of the pixel and the luminance value of a first neighboring pixel; comparing the first difference value to a pre-determined threshold value; determining a second difference value between the luminance of the pixel and the luminance value of a second neighboring pixel; comparing the second difference value to the pre-determined threshold value; detecting whether the luminance value for the pixel falls within an acceptable range defined by the luminance value for the first neighboring pixel and the luminance value for the second neighboring pixel; and identifying the pixel element as defective if the luminance value for the pixel element does not fall within the acceptable range and neither the first difference value nor the second difference value is less than or equal to the threshold value.
Claim 14
Dependent Claim 37 words
12 . The method of claim 11 further including the step of: calculating a corrected luminance value for the pixel element; and substituting the corrected luminance value in place of the luminance value of the pixel element.
Claim 15
Dependent Claim 35 words
13 . The method of claim 12 wherein the corrected luminance value is the average of the luminance value of the first neighboring pixel element and the luminance value of the second neighboring pixel element.
Claim 16
Dependent Claim 28 words
14 . The method of claim 12 wherein the corrected luminance value is determined by interpolating over two or more neighboring pixels on either side of the pixel.
Claim 17
Dependent Claim 16 words
15 . The method of claim 11 wherein said threshold value is stored in a register.
Claim 18
Dependent Claim 21 words
16 . The method of claim 11 wherein said threshold value is determined from a feedback signal indicative of image quality.
Claim 19
Dependent Claim 17 words
17 . The method of claim 11 wherein said luminance value is a ten bit digital value.
Claim 20
Dependent Claim 16 words
18 . The method of claim 11 wherein said method steps are performed in real time.
Claim 21
Dependent Claim 290 words
19 . A defective pixel filter comprising: a first comparator circuit receiving as input a first pixel value and a second pixel value and outputting a valid logic signal to a first input of an AND circuit and to a first inverter when the first pixel value is greater than the second pixel value; a first difference calculator receiving as input said first pixel value and said second pixel value and outputting to a first input of a second comparator circuit a first difference value corresponding to the difference between said first and second pixel values; said second comparator circuit also receiving as input a threshold value and outputting a valid logic signal to a first input of an OR circuit when the first difference value is less than or equal to said threshold value; a third comparator circuit receiving as input said second pixel value and a third pixel value and outputting a valid logic signal to a second input of said first AND circuit and to a second inverter when the second pixel value is greater than the third pixel value; and a second difference calculator receiving as input said second pixel value and said third pixel value and outputting a second difference value corresponding to the difference between said second and third pixel values to a first input of a fourth comparator circuit; said fourth comparator circuit also receiving as input a threshold value and outputting a valid logic signal to a third input of said OR circuit when the second difference value is less than or equal to said threshold value; and a second AND circuit coupled to said first and second inverters and having an output coupled to a fourth input of said OR circuit.
Claim 22
Dependent Claim 290 words
19 . A defective pixel filter comprising: a first comparator circuit receiving as input a first pixel value and a second pixel value and outputting a valid logic signal to a first input of an AND circuit and to a first inverter when the first pixel value is greater than the second pixel value; a first difference calculator receiving as input said first pixel value and said second pixel value and outputting to a first input of a second comparator circuit a first difference value corresponding to the difference between said first and second pixel values; said second comparator circuit also receiving as input a threshold value and outputting a valid logic signal to a first input of an OR circuit when the first difference value is less than or equal to said threshold value; a third comparator circuit receiving as input said second pixel value and a third pixel value and outputting a valid logic signal to a second input of said first AND circuit and to a second inverter when the second pixel value is greater than the third pixel value; and a second difference calculator receiving as input said second pixel value and said third pixel value and outputting a second difference value corresponding to the difference between said second and third pixel values to a first input of a fourth comparator circuit; said fourth comparator circuit also receiving as input a threshold value and outputting a valid logic signal to a third input of said OR circuit when the second difference value is less than or equal to said threshold value; and a second AND circuit coupled to said first and second inverters and having an output coupled to a fourth input of said OR circuit.
Claim 23
Dependent Claim 69 words
20 . The defective pixel filter of claim 19 further comprising: a corrected pixel calculation block receiving as input said first and third pixel values and outputting a corrected pixel value; a multiplexer having a first input coupled to the output of said corrected pixel calculation block, and receiving as a second input said pixel value, and having a control input coupled to an output of said OR circuit.
Claim 24
Dependent Claim 16 words
21 . The defective pixel filter of claim 19 further comprising registers for storing pixel values.
Claim 25
Dependent Claim 54 words
22 . The defective pixel filter of claim 19 being operative in both monochrome and color mode and further comprising at least one multiplexer receiving as input the pixel values stored in at least two registers, and outputting one of said pixel values in response to an indication of monochrome or color mode operation.
Claim 26
Dependent Claim 22 words
23 . The defective pixel filter of claim 19 wherein said first, second, and third pixel values are ten bit digital values.
Claim 27
Dependent Claim 22 words
24 . The defective pixel filter of claim 19 further comprising a threshold value register in which is stored said threshold value.
Claim 28
Dependent Claim 22 words
25 . The defective pixel filter of claim 19 wherein said comparator circuits, difference calculators, and registers are fabricated with CMOS processes.
Claim 29
Dependent Claim 26 words
26 . The defective pixel filter of claim 19 wherein said comparator circuits and difference calculators are formed by a general purpose microprocessor running programmed instructions.
Claim 30
Dependent Claim 172 words
27 . A digital imager comprising: a lens mechanism; a sensor array positioned within a focal plane of said lens mechanism; an analog buffer and amplifier coupled to an output of said sensor array; and imaging logic coupled to said amplifier; wherein said imaging logic includes a defective pixel filter comprising: means for detecting whether a first pixel is outside an acceptable range defined by luminance values of first and second neighboring pixels; means for determining whether said first pixel deviates from said first neighboring pixel by greater than a threshold value and means for determining whether said first pixel deviates from said second neighboring pixel by greater than a threshold value; means for calculating a corrected pixel value; and means for substituting said corrected pixel value for said first pixel if said first pixel is outside said acceptable range and said first pixel deviates from said first neighboring pixel by greater than a threshold value and said first pixel deviates from said second neighboring pixel by greater than a threshold value.
Claim 31
Dependent Claim 172 words
27 . A digital imager comprising: a lens mechanism; a sensor array positioned within a focal plane of said lens mechanism; an analog buffer and amplifier coupled to an output of said sensor array; and imaging logic coupled to said amplifier; wherein said imaging logic includes a defective pixel filter comprising: means for detecting whether a first pixel is outside an acceptable range defined by luminance values of first and second neighboring pixels; means for determining whether said first pixel deviates from said first neighboring pixel by greater than a threshold value and means for determining whether said first pixel deviates from said second neighboring pixel by greater than a threshold value; means for calculating a corrected pixel value; and means for substituting said corrected pixel value for said first pixel if said first pixel is outside said acceptable range and said first pixel deviates from said first neighboring pixel by greater than a threshold value and said first pixel deviates from said second neighboring pixel by greater than a threshold value.
Claim 32
Dependent Claim 22 words
28 . The digital imager of claim 27 further including: a microprocessor coupled to said imaging logic and providing thereto control signals.
Claim 33
Dependent Claim 21 words
29 . The digital imager of claim 27 further including: an input/output port coupled to said microprocessor and said imaging logic;
Claim 34
Dependent Claim 23 words
30 . The digital imager of claim 27 wherein said sensor array and said imaging logic are fabricated on a single integrated circuit.
Claim 35
Dependent Claim 17 words
31 . The digital imager of claim 27 wherein the sensor array is comprised of CMOS cells.
Claim 36
Dependent Claim 17 words
32 . The digital imager of claim 27 wherein the sensor array is comprised of CCD cells.
Claim 37
Dependent Claim 17 words
33 . The digital imager of claim 27 wherein the imaging logic is realized in combinational logic.
Claim 38
Dependent Claim 23 words
34 . The digital imager of claim 27 wherein the imaging logic is realized in a microprocessor operating in response to programmed instructions.

References Cited (Backward Citations)

US4167754A Cited
US5327246A Cited
US6509927B1 Cited
US5995675A Cited
US6707493B1 Cited

USPTO Annuity & Maintenance Windows

Maintenance schedule is calculated for granted US utility patents.

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag