Patent US5889554A successfully refreshed from Google Patents.
US5889554A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Process and system for generating a full color image of multispectral image from the image data of a CCD image sensor with a mosaic color filter
Assignee: Intellectual Ventures Fund 83 LLC
•
Filing: 1996-10-23
•
Granted: 1999-03-30
•
Expires: 2016-10-23
Abstract
Abstract Process and system for producing color images and/or multispectral images in which an optical arrangement (3) images a scene on a CCD image sensor (2), said sensor being covered by a mosaic filter with a periodically repeating basic pattern (GM). A following analog/digital converter (5) produces digital signals from all pixels pij of the CCD image sensor (2). The basic pattern (GM) consists of a minimum of five different filter elements. In addition, an image memory (6) is provided which is divided into image memory levels (B0, B1, . . . , BnF). The process comprises the follow steps: storing of values (wert[i][j][0]) of each individual pixel (pij) of the CCD image sensor (2) in a dedicated level B0 of the image memory (6), said values being determined by the CCD image sensor (2) and converted by a following analog/digital converter (5) into digital values; determining an "unfocussed image" in the following way: for each color f and for each pixel p the neighboring pixels of color f are measured, their values read from B0 and combined to arrive at a weighted average value; storing of values (wert[i][j][f]) for all the different filter elements on the CCD image sensor in dedicated image memory levels (B1, B2, . . . BnF); calculating final color values (C1, C2, . . . ,CnF) by means of additive image sharpening; and storing the final color values (C1, C2, . . . ,CnF) in dedicated image memory levels (B1, B2, . . . BnF).
Inventors
- 👤 Ulrich Mutze
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 22:44
CPC Classifications
H; H04; H04N; H04N25/00; H04N25/10; H04N25/11; H04N25/13; H04N25/135; H04N23/00; H04N23/80; H04N23/84; H04N23/843; H04N25/131; H04N25/133; H04N2209/00; H04N2209/04; H04N2209/041; H04N2209/042; H04N2209/045; H04N2209/046
Claims Analysis
Total Claims: 25
Claim 1
Independent Claim
246 words
Process for generating color images and/or multispectral images in which an optical arrangement (3) images a scene on a CCD image sensor (2), said sensor being covered by a mosaic filter with a periodic basic pattern (GM), characterized in that the basic pattern (GM) consists of five different color filter elements and in that the process comprises the following steps: storing values (wert 1! j! 0!) of each individual pixel (p ij ) of the CCD image sensor (2) in a dedicated level B 0 of an image memory (6), said values being measured by the CCD image sensor (2) and being transformed by a following analog/digital converter (5) into digital values; determining an "unfocussed image" by calculating a neighboring pixel of color f for each color f and for each pixel p, reading their values from B 0 and combining them to arrive at a weighted average value; storing values (wert i! j! f!) for all the different filter elements on the CCD image sensor (2) in dedicated image memory levels (B 1 , B 2 , . . . , B nF ); calculating of final color values (C 1 , C 2 , . . . , C nF ) by means of additive image sharpening; and storing the final color values (C 1 , C 2 , . . . , C nF ) in dedicated image memory levels (B 1 , B 2 , . . . , B nF ).
Claim 2
Dependent Claim
246 words
Process for generating color images and/or multispectral images in which an optical arrangement (3) images a scene on a CCD image sensor (2), said sensor being covered by a mosaic filter with a periodic basic pattern (GM), characterized in that the basic pattern (GM) consists of five different color filter elements and in that the process comprises the following steps: storing values (wert 1! j! 0!) of each individual pixel (p ij ) of the CCD image sensor (2) in a dedicated level B 0 of an image memory (6), said values being measured by the CCD image sensor (2) and being transformed by a following analog/digital converter (5) into digital values; determining an "unfocussed image" by calculating a neighboring pixel of color f for each color f and for each pixel p, reading their values from B 0 and combining them to arrive at a weighted average value; storing values (wert i! j! f!) for all the different filter elements on the CCD image sensor (2) in dedicated image memory levels (B 1 , B 2 , . . . , B nF ); calculating of final color values (C 1 , C 2 , . . . , C nF ) by means of additive image sharpening; and storing the final color values (C 1 , C 2 , . . . , C nF ) in dedicated image memory levels (B 1 , B 2 , . . . , B nF ).
Claim 3
Dependent Claim
31 words
Process according to claim 1, characterized in that the final color values (C 1 , C 2 , . . . , C nF ) are calculated by multiplicative image sharpening.
Claim 4
Dependent Claim
25 words
Process according to claim 1, characterized in that illumination prevailing when photographing a scene can be transformed into an illumination of a different spectral composition.
Claim 5
Dependent Claim
29 words
Process according to claim 3, characterized in that when photographing a scene, a white reference body with known spectral reflection properties is added to the scene to be photographed.
Claim 6
Dependent Claim
70 words
Process according to claim 3, characterized in that a data memory of processor (8) stores the data for different illuminations, said data being transferable from the memory according to a chosen illumination, or characterized in that the processor (8) uses data obtained from an illuminated reference body to calculate the data necessary to make a change to a different spectral illumination and stores them in the memory of processor (8).
Claim 7
Dependent Claim
21 words
Process according to claim 1, characterized in that the basic pattern (GM) used in the mosaic consists of a pentaspectral pattern.
Claim 8
Dependent Claim
46 words
Process according to claim 6, characterized in that a distance from a starting pixel is defined in such a way that in an area defined by a chosen distance there are at least two pixels with the least frequently occurring color f of a filter element.
Claim 9
Dependent Claim
28 words
Process according to claim 7, characterized in that in the neighborhood of the starting pixel there are four to six pixels with the least frequently occurring filter color.
Claim 10
Dependent Claim
34 words
Process according to claim 6, characterized in that the pixels at equal distance from a starting pixel are assigned to an equivalence class and in that these pixels have a same weighting factor w.
Claim 11
Dependent Claim
40 words
Process according to claim 9, characterized in that equivalence classes and the weighting factors for the periodic basic pattern (GM) are stored in the memory of processor (8) in order to reduce a time to produce a final color image.
Claim 12
Dependent Claim
165 words
System for generating color images and/or multispectral images by means of an optical arrangement (3) which images a scene on a CCD image sensor (2), said CCD image sensor (2) being covered by a mosaic filter with a periodic basic pattern (GM) and connected to a following analog/digital converter (5) which produces digital signals from all pixels p ij of the CCD image sensor (2), characterized in that the basic pattern (GM) is built up of at least five different filter elements, and a digital image memory (6) with random access is provided, said memory having a number of image memory levels (B 1 , B 2 , . . . B nF ) which corresponds equally to the number of different filter elements of the basic pattern (GM) and having in addition an image memory level B 0 which stores the digital signals of all pixels p ij of the CCD image sensor (2), said digital signals being generated by the analog/digital converter (5).
Claim 13
Dependent Claim
165 words
System for generating color images and/or multispectral images by means of an optical arrangement (3) which images a scene on a CCD image sensor (2), said CCD image sensor (2) being covered by a mosaic filter with a periodic basic pattern (GM) and connected to a following analog/digital converter (5) which produces digital signals from all pixels p ij of the CCD image sensor (2), characterized in that the basic pattern (GM) is built up of at least five different filter elements, and a digital image memory (6) with random access is provided, said memory having a number of image memory levels (B 1 , B 2 , . . . B nF ) which corresponds equally to the number of different filter elements of the basic pattern (GM) and having in addition an image memory level B 0 which stores the digital signals of all pixels p ij of the CCD image sensor (2), said digital signals being generated by the analog/digital converter (5).
Claim 14
Dependent Claim
32 words
System according to claim 11, characterized in that a processor (8) is used to control the system, organization and access of a digital image memory (6) and to evaluate digital image data.
Claim 15
Dependent Claim
16 words
System according to claim 11, characterized in that the basic pattern (GM) is a pentaspectral pattern.
Claim 16
Dependent Claim
116 words
System according to claim 11, characterized in that each individual level of image memory levels (B1, B2, . . . B nF ) stores only data of a specific color value wert i! j! f!, and in that color values wert i! j! f! consist of the digital data of the color values of pixels p ij of the CCD image sensor (2), said pixels p ij being provided with filter elements of the specific color f, and in that the digital values for pixels p ij of the CCD image sensor (2) which are not provided with the filter element of the specific color f can be evaluated with the help of the processor (8).
Claim 17
Dependent Claim
45 words
System according to claim 14, characterized in that a distance from a starting pixel is defined in such a way that in an area defined by a chosen distance there are at least two pixels of the least frequently occurring color of a filter element.
Claim 18
Dependent Claim
28 words
System according to claim 15, characterized in that in the neighborhood of the starting pixel there are four to six pixels with the least frequently occurring filter color.
Claim 19
Dependent Claim
31 words
System according to claim 16, characterized in that those pixels equidistant from the starting pixel are assigned to an equivalence class and in that these pixels have a constant weighting factor.
Claim 20
Dependent Claim
32 words
System according to claim 17, characterized in that in the case of a periodic basic pattern (GM) the equivalence classes and the weighting factors are stored in the memory of processor (8).
Claim 21
Dependent Claim
174 words
System for generating color images and/or multispectral images by means of an optical arrangement (3) which images a scene on a CCD image sensor (2), said CCD image sensor (2) being covered by a mosaic filter with a periodic basic pattern (GM) and connected to a following analog/digital converter (5) which produces digital signals from all pixels pij of the CCD image sensor (2), characterized in that the basic pattern (GM) is built up of at least five different filter elements, and a pentaspectral pattern is built up of three pixel rows and three pixel columns and in that pixels p 11 , p 22 and p 33 are provided with a red filter element R, pixels p 13 , p 21 and p 32 with a blue filter element B, pixel p 23 with a green filter element G, pixel p 12 with a green filter element G' and pixel p 31 with a green filter element G", the maximum spectral transparency of G' being less than the maximum spectral transparency of G".
Claim 22
Dependent Claim
174 words
System for generating color images and/or multispectral images by means of an optical arrangement (3) which images a scene on a CCD image sensor (2), said CCD image sensor (2) being covered by a mosaic filter with a periodic basic pattern (GM) and connected to a following analog/digital converter (5) which produces digital signals from all pixels pij of the CCD image sensor (2), characterized in that the basic pattern (GM) is built up of at least five different filter elements, and a pentaspectral pattern is built up of three pixel rows and three pixel columns and in that pixels p 11 , p 22 and p 33 are provided with a red filter element R, pixels p 13 , p 21 and p 32 with a blue filter element B, pixel p 23 with a green filter element G, pixel p 12 with a green filter element G' and pixel p 31 with a green filter element G", the maximum spectral transparency of G' being less than the maximum spectral transparency of G".
Claim 23
Dependent Claim
69 words
System according to claim 19, characterized in that the maximum spectral transparency of red filter element R is 595 nm, the maximum spectral transparency of blue filter element B is 445 nm, the maximum spectral transparency of green filter element G is 545 nm, the maximum spectral transparency of green filter element G' is 494 nm and the maximum spectral transparency of green filter element G" is 570 nm.
Claim 24
Dependent Claim
172 words
System for generating color images and/or multispectral images by means of an optical arrangement (3) which images a scene on a CCD image sensor (2), said CCD image sensor (2) being covered by a mosaic filter with a periodic basic pattern (GM) and connected to a following analog/digital converter (5) which produces digital signals from all pixels pij of the CCD image sensor (2), characterized in that the basic pattern (GM) is built up of at least five different filter elements, and a pentaspectral Bayer pattern is built up of three pixel rows and three pixel columns, and in that pixels p 22 and p 33 are provided with a red filter element R, pixels p 21 and p 13 with a blue filter element B, pixels p 12 and p 23 with a green filter element G, pixel p 32 with a green filter element G' and pixel p 11 with a green filter element G", the maximum spectral transparency of G' being less than the maximum spectral transparency of G".
Claim 25
Dependent Claim
172 words
System for generating color images and/or multispectral images by means of an optical arrangement (3) which images a scene on a CCD image sensor (2), said CCD image sensor (2) being covered by a mosaic filter with a periodic basic pattern (GM) and connected to a following analog/digital converter (5) which produces digital signals from all pixels pij of the CCD image sensor (2), characterized in that the basic pattern (GM) is built up of at least five different filter elements, and a pentaspectral Bayer pattern is built up of three pixel rows and three pixel columns, and in that pixels p 22 and p 33 are provided with a red filter element R, pixels p 21 and p 13 with a blue filter element B, pixels p 12 and p 23 with a green filter element G, pixel p 32 with a green filter element G' and pixel p 11 with a green filter element G", the maximum spectral transparency of G' being less than the maximum spectral transparency of G".
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-03-29 | 2002-09-28 | 2003-03-30 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-03-29 | 2006-09-28 | 2007-03-30 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-03-29 | 2010-09-28 | 2011-03-30 | $7700.00 | Window Closed / Lapsed |