US7570810B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus applying digital image filtering to color filter array data
Assignee: Seiko Epson Corp
•
Filing: 2005-02-24
•
Granted: 2009-08-04
•
Expires: 2025-02-24
Abstract
Abstract A method and graphics controller for processing an image is provided wherein color filter array (CFA) data representing the image is received from a digital image capture device into a buffer, a digital filter effect is applied to the CFA data to generate filtered CFA data representing a filtered image, and the filtered image is displayed in real time on a display.
Inventors
- 👤 Barinder Singh Rai
- 👤 Eric Jeffrey
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:00
CPC Classifications
H; H04; H04N; H04N23/00; H04N23/80; H04N23/84; H04N25/00; H04N25/10; H04N25/11; H04N25/13; H04N25/134; H04N2209/00; H04N2209/04; H04N2209/041; H04N2209/042; H04N2209/045; H04N2209/046; H04N23/60; H04N23/63
Claims Analysis
Total Claims: 33
Claim 1
Independent Claim
180 words
A method for processing an image, the method comprising: receiving color filter array (CFA) data representing an image from a digital image capture device into a buffer; wherein an imaging device performs the following operations: applying a digital filter effect to the CFA data to generate one of filtered CFA data or filtered RGB data representing a filtered image, the applying including, for each particular pixel represented in the CFA data, calculating a new red, a new green, and a new blue intensity value for the particular pixel, the calculating including, generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and solving a reduced convolution equation using the nearest neighbor array to obtain the new intensity value of the particular pixel color, wherein the reduced convolution equation combines terms in the nearest neighbor array; and displaying the filtered image in real time on a display in the digital image capture device.
Claim 2
Independent Claim
180 words
A method for processing an image, the method comprising: receiving color filter array (CFA) data representing an image from a digital image capture device into a buffer; wherein an imaging device performs the following operations: applying a digital filter effect to the CFA data to generate one of filtered CFA data or filtered RGB data representing a filtered image, the applying including, for each particular pixel represented in the CFA data, calculating a new red, a new green, and a new blue intensity value for the particular pixel, the calculating including, generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and solving a reduced convolution equation using the nearest neighbor array to obtain the new intensity value of the particular pixel color, wherein the reduced convolution equation combines terms in the nearest neighbor array; and displaying the filtered image in real time on a display in the digital image capture device.
Claim 3
Dependent Claim
12 words
The method of claim 1 wherein the CFA data is Bayer data.
Claim 4
Dependent Claim
71 words
The method of claim 1 wherein the applying a digital filter effect generates filtered CFA data, the solving a reduced convolution equation further comprising applying a convolution filter to the nearest neighbor array wherein each particular pixel color is calculated by multiplying pixels in the nearest neighbor array by a respective predetermined constant coefficient to generate a plurality of products and dividing a sum of the products by a divide-by value.
Claim 5
Dependent Claim
96 words
The method of claim 3 wherein the buffer is a line buffer and the receiving comprises storing five lines of the CFA data at a time in the line buffer, the applying a digital filter effect comprising calculating a line of the filtered CFA data at a time using the CFA data stored in the line buffer wherein after each line of the filtered CFA data is calculated, a new line is received into the line buffer and an oldest line is deleted thereby providing data for calculating a next line of the filtered CFA data.
Claim 6
Dependent Claim
15 words
The method of claim 1 wherein the applying is performed by a hardware digital filter.
Claim 7
Dependent Claim
28 words
The method of claim 3 wherein the convolution filter is one of a soften filter, blur filter, sharpen filter, emboss filter, directional blur filter, and edge detect filter.
Claim 8
Dependent Claim
49 words
The method of claim 1 wherein the displaying the filtered image in real time comprises generating a plurality of frames of video at regular intervals, each of the frames being filtered and displayed on the display with the digital filter effect applied within a predefined time from the receiving.
Claim 9
Dependent Claim
15 words
The method of claim 1 further comprising selectively storing the filtered image in non-volatile memory.
Claim 10
Dependent Claim
21 words
The method of claim 8 wherein the filtered CFA data is converted into a compressed image format prior to the storing.
Claim 11
Dependent Claim
16 words
The method of claim 1 further comprising selectively transmitting the filtered image to a remote destination.
Claim 12
Dependent Claim
19 words
The method of claim 1 wherein the digital filter effect is selected from a plurality of digital filter effects.
Claim 13
Dependent Claim
43 words
The method of claim 1 , wherein the positions in the nearest neighbor value are combined with respective predetermined constant coefficients and wherein one of the positions in the nearest neighboring pixels corresponds to one of the positions substituted with the nearest neighbor.
Claim 14
Independent Claim
212 words
A method for processing an image, the method comprising: receiving color filter array (CFA) data representing an image from a digital image capture device into a buffer, wherein an imaging device perform the following operations: wherein an imaging device performs the following operations: applying a convolution filter to the CFA data to generate filtered CFA data representing a filtered image; and displaying the filtered image in real time on a display in the digital image capture device, wherein the applying the convolution filter comprises for each particular pixel represented in the CFA data, calculating a new value for the particular pixel by passing old values of the particular pixel and neighboring pixels having a same color as the particular pixel through an algorithm wherein the old values are each multiplied by a respective predetermined constant coefficient resulting in a plurality of products and the sum of the products are divided by a divide-by value, the calculating including generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and wherein the algorithm employs a reduced convolution equation that combines terms in the nearest neighbor array.
Claim 15
Independent Claim
212 words
A method for processing an image, the method comprising: receiving color filter array (CFA) data representing an image from a digital image capture device into a buffer, wherein an imaging device perform the following operations: wherein an imaging device performs the following operations: applying a convolution filter to the CFA data to generate filtered CFA data representing a filtered image; and displaying the filtered image in real time on a display in the digital image capture device, wherein the applying the convolution filter comprises for each particular pixel represented in the CFA data, calculating a new value for the particular pixel by passing old values of the particular pixel and neighboring pixels having a same color as the particular pixel through an algorithm wherein the old values are each multiplied by a respective predetermined constant coefficient resulting in a plurality of products and the sum of the products are divided by a divide-by value, the calculating including generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and wherein the algorithm employs a reduced convolution equation that combines terms in the nearest neighbor array.
Claim 16
Dependent Claim
29 words
The method of claim 13 wherein the convolution filter provides one of a soften effect, blur effect, emboss effect, directional blur effect, or edge detect effect to the image.
Claim 17
Dependent Claim
24 words
The method of claim 13 wherein the algorithm is selected from a plurality of algorithms depending upon on the color of the particular pixel.
Claim 18
Dependent Claim
20 words
The method of claim 13 wherein the applying a convolution filter comprises passing the CFA data through a hardware filter.
Claim 19
Dependent Claim
67 words
The method of claim 13 further comprising: generating a video data stream comprising generating a plurality of frames of the filtered CFA data at regular intervals; and displaying the video data stream as a video on the display, each of the frames of the video data stream being filtered and displayed on the display within a predefined time on the display with the digital filter effect applied.
Claim 20
Dependent Claim
18 words
The method of claim 17 further comprising selectively storing at least one of the frames in non-volatile memory.
Claim 21
Independent Claim
183 words
A method for processing an image, the method comprising: receiving color filter array (CFA) data representing an image from a digital image capture device into a buffer, wherein an imaging device perform the following operations: wherein an imaging device performs the following operations: applying a convolution filter to the CFA data to generate filtered RGB data representing a filtered image; and displaying the filtered image in real time on a display in the digital image capture device, wherein the applying the convolution filter comprises for each particular pixel represented in the CFA data, calculating a red, a green, and a blue RGB intensity value for the particular pixel, the calculating including, generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and solving a reduced convolution equation using the nearest neighbor array to obtain the RGB intensity value of the particular pixel color, wherein the reduced convolution equation combines terms in the nearest neighbor array.
Claim 22
Independent Claim
183 words
A method for processing an image, the method comprising: receiving color filter array (CFA) data representing an image from a digital image capture device into a buffer, wherein an imaging device perform the following operations: wherein an imaging device performs the following operations: applying a convolution filter to the CFA data to generate filtered RGB data representing a filtered image; and displaying the filtered image in real time on a display in the digital image capture device, wherein the applying the convolution filter comprises for each particular pixel represented in the CFA data, calculating a red, a green, and a blue RGB intensity value for the particular pixel, the calculating including, generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and solving a reduced convolution equation using the nearest neighbor array to obtain the RGB intensity value of the particular pixel color, wherein the reduced convolution equation combines terms in the nearest neighbor array.
Claim 23
Dependent Claim
29 words
The method of claim 19 wherein the convolution filter provides one of a soften effect, blur effect, emboss effect, directional blur effect, or edge detect effect to the image.
Claim 24
Dependent Claim
24 words
The method of claim 19 wherein the algorithm is selected from a plurality of algorithms depending upon on the color of the particular pixel.
Claim 25
Dependent Claim
24 words
The method of claim 19 wherein the applying a convolution filter comprises passing the CFA data through a combined hardware filter and CFA-to-RGB converter.
Claim 26
Dependent Claim
67 words
The method of claim 19 further comprising: generating a video data stream comprising generating a plurality of frames of the filtered RGB data at regular intervals; and displaying the video data stream as a video on the display, each of the frames of the video data stream being filtered and displayed on the display within a predefined time on the display with the digital filter effect applied.
Claim 27
Dependent Claim
18 words
The method of claim 23 further comprising selectively storing at least one of the frames in non-volatile memory.
Claim 28
Dependent Claim
156 words
A graphics controller for processing an image, the graphics controller comprising: a buffer receiving color filter array (CFA) data representing an image from a digital image capture device; and a convolution filter that applies a convolution filter effect to the CFA data thereby generating filtered CFA data representing a filtered image, wherein the convolution filter, for each particular pixel represented in the CFA data, calculates a new red, a new green, and a new blue intensity value for the particular pixel, the calculating including, generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and solving a reduced convolution equation using the nearest neighbor array to obtain the new intensity value of the particular pixel color, wherein the reduced convolution equation combines terms in the nearest neighbor array.
Claim 29
Dependent Claim
156 words
A graphics controller for processing an image, the graphics controller comprising: a buffer receiving color filter array (CFA) data representing an image from a digital image capture device; and a convolution filter that applies a convolution filter effect to the CFA data thereby generating filtered CFA data representing a filtered image, wherein the convolution filter, for each particular pixel represented in the CFA data, calculates a new red, a new green, and a new blue intensity value for the particular pixel, the calculating including, generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and solving a reduced convolution equation using the nearest neighbor array to obtain the new intensity value of the particular pixel color, wherein the reduced convolution equation combines terms in the nearest neighbor array.
Claim 30
Dependent Claim
30 words
The graphics controller of claim 25 wherein the convolution filter provides one of a soften effect, blur effect, emboss effect, directional blur effect, or edge detect effect to the image.
Claim 31
Dependent Claim
25 words
The graphics controller of claim 25 wherein the algorithm is selected from a plurality of algorithms depending upon on a color of the particular pixel.
Claim 32
Dependent Claim
27 words
The graphics controller of claim 25 , wherein a video data stream comprising a plurality of frames of the filtered CFA data is generated at regular intervals.
Claim 33
Dependent Claim
41 words
The method of claim 19 , wherein the terms in the common nearest neighbor array are multiplied by respective predetermined constant coefficients and wherein one of the adjacent neighboring pixels corresponds to one of the positions substituted with the nearest neighbor.
References Cited (Backward Citations)
US3971065A
Cited
US5696848A
Cited
US5506619A
Cited
US5568192A
Cited
US20020044691A1
Cited
US6091862A
Cited
US6570616B1
Cited
US6348929B1
Cited
US6424753B1
Cited
US6593963B1
Cited
US6205245B1
Cited
US6870564B1
Cited
US6744916B1
Cited
US6825876B1
Cited
US6771811B1
Cited
US20010045988A1
Cited
EP1289309A1
Cited
US20030048368A1
Cited
US20030122937A1
Cited
JP2003199119A
Cited
EP1308888A1
Cited
US20030128893A1
Cited
US7206458B2
Cited
JP2003199115A
Cited
US20030218679A1
Cited
EP1326209A1
Cited
US7227991B2
Cited
WO2003107274A2
Cited
EP1394742A1
Cited
US7079705B2
Cited
US20050031222A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2012-08-03 | 2013-02-02 | 2013-08-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2016-08-03 | 2017-02-02 | 2017-08-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2020-08-03 | 2021-02-02 | 2021-08-04 | $7700.00 | Window Closed / Lapsed |