← Back to Patent Explorer
US7570810B2 Expired / Lapsed US ⏱️ 0.0 years remaining

Method and apparatus applying digital image filtering to color filter array data

Assignee: Seiko Epson Corp
•
Filing: 2005-02-24
•
Granted: 2009-08-04
•
Expires: 2025-02-24
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method and graphics controller for processing an image is provided wherein color filter array (CFA) data representing the image is received from a digital image capture device into a buffer, a digital filter effect is applied to the CFA data to generate filtered CFA data representing a filtered image, and the filtered image is displayed in real time on a display.

Inventors

  • 👤 Barinder Singh Rai
  • 👤 Eric Jeffrey

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 10:00
CPC Classifications
H; H04; H04N; H04N23/00; H04N23/80; H04N23/84; H04N25/00; H04N25/10; H04N25/11; H04N25/13; H04N25/134; H04N2209/00; H04N2209/04; H04N2209/041; H04N2209/042; H04N2209/045; H04N2209/046; H04N23/60; H04N23/63

Claims Analysis

Total Claims: 33
Claim 1
Independent Claim 180 words
A method for processing an image, the method comprising: receiving color filter array (CFA) data representing an image from a digital image capture device into a buffer; wherein an imaging device performs the following operations: applying a digital filter effect to the CFA data to generate one of filtered CFA data or filtered RGB data representing a filtered image, the applying including, for each particular pixel represented in the CFA data, calculating a new red, a new green, and a new blue intensity value for the particular pixel, the calculating including, generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and solving a reduced convolution equation using the nearest neighbor array to obtain the new intensity value of the particular pixel color, wherein the reduced convolution equation combines terms in the nearest neighbor array; and displaying the filtered image in real time on a display in the digital image capture device.
Claim 2
Independent Claim 180 words
A method for processing an image, the method comprising: receiving color filter array (CFA) data representing an image from a digital image capture device into a buffer; wherein an imaging device performs the following operations: applying a digital filter effect to the CFA data to generate one of filtered CFA data or filtered RGB data representing a filtered image, the applying including, for each particular pixel represented in the CFA data, calculating a new red, a new green, and a new blue intensity value for the particular pixel, the calculating including, generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and solving a reduced convolution equation using the nearest neighbor array to obtain the new intensity value of the particular pixel color, wherein the reduced convolution equation combines terms in the nearest neighbor array; and displaying the filtered image in real time on a display in the digital image capture device.
Claim 3
Dependent Claim 12 words
The method of claim 1 wherein the CFA data is Bayer data.
Claim 4
Dependent Claim 71 words
The method of claim 1 wherein the applying a digital filter effect generates filtered CFA data, the solving a reduced convolution equation further comprising applying a convolution filter to the nearest neighbor array wherein each particular pixel color is calculated by multiplying pixels in the nearest neighbor array by a respective predetermined constant coefficient to generate a plurality of products and dividing a sum of the products by a divide-by value.
Claim 5
Dependent Claim 96 words
The method of claim 3 wherein the buffer is a line buffer and the receiving comprises storing five lines of the CFA data at a time in the line buffer, the applying a digital filter effect comprising calculating a line of the filtered CFA data at a time using the CFA data stored in the line buffer wherein after each line of the filtered CFA data is calculated, a new line is received into the line buffer and an oldest line is deleted thereby providing data for calculating a next line of the filtered CFA data.
Claim 6
Dependent Claim 15 words
The method of claim 1 wherein the applying is performed by a hardware digital filter.
Claim 7
Dependent Claim 28 words
The method of claim 3 wherein the convolution filter is one of a soften filter, blur filter, sharpen filter, emboss filter, directional blur filter, and edge detect filter.
Claim 8
Dependent Claim 49 words
The method of claim 1 wherein the displaying the filtered image in real time comprises generating a plurality of frames of video at regular intervals, each of the frames being filtered and displayed on the display with the digital filter effect applied within a predefined time from the receiving.
Claim 9
Dependent Claim 15 words
The method of claim 1 further comprising selectively storing the filtered image in non-volatile memory.
Claim 10
Dependent Claim 21 words
The method of claim 8 wherein the filtered CFA data is converted into a compressed image format prior to the storing.
Claim 11
Dependent Claim 16 words
The method of claim 1 further comprising selectively transmitting the filtered image to a remote destination.
Claim 12
Dependent Claim 19 words
The method of claim 1 wherein the digital filter effect is selected from a plurality of digital filter effects.
Claim 13
Dependent Claim 43 words
The method of claim 1 , wherein the positions in the nearest neighbor value are combined with respective predetermined constant coefficients and wherein one of the positions in the nearest neighboring pixels corresponds to one of the positions substituted with the nearest neighbor.
Claim 14
Independent Claim 212 words
A method for processing an image, the method comprising: receiving color filter array (CFA) data representing an image from a digital image capture device into a buffer, wherein an imaging device perform the following operations: wherein an imaging device performs the following operations: applying a convolution filter to the CFA data to generate filtered CFA data representing a filtered image; and displaying the filtered image in real time on a display in the digital image capture device, wherein the applying the convolution filter comprises for each particular pixel represented in the CFA data, calculating a new value for the particular pixel by passing old values of the particular pixel and neighboring pixels having a same color as the particular pixel through an algorithm wherein the old values are each multiplied by a respective predetermined constant coefficient resulting in a plurality of products and the sum of the products are divided by a divide-by value, the calculating including generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and wherein the algorithm employs a reduced convolution equation that combines terms in the nearest neighbor array.
Claim 15
Independent Claim 212 words
A method for processing an image, the method comprising: receiving color filter array (CFA) data representing an image from a digital image capture device into a buffer, wherein an imaging device perform the following operations: wherein an imaging device performs the following operations: applying a convolution filter to the CFA data to generate filtered CFA data representing a filtered image; and displaying the filtered image in real time on a display in the digital image capture device, wherein the applying the convolution filter comprises for each particular pixel represented in the CFA data, calculating a new value for the particular pixel by passing old values of the particular pixel and neighboring pixels having a same color as the particular pixel through an algorithm wherein the old values are each multiplied by a respective predetermined constant coefficient resulting in a plurality of products and the sum of the products are divided by a divide-by value, the calculating including generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and wherein the algorithm employs a reduced convolution equation that combines terms in the nearest neighbor array.
Claim 16
Dependent Claim 29 words
The method of claim 13 wherein the convolution filter provides one of a soften effect, blur effect, emboss effect, directional blur effect, or edge detect effect to the image.
Claim 17
Dependent Claim 24 words
The method of claim 13 wherein the algorithm is selected from a plurality of algorithms depending upon on the color of the particular pixel.
Claim 18
Dependent Claim 20 words
The method of claim 13 wherein the applying a convolution filter comprises passing the CFA data through a hardware filter.
Claim 19
Dependent Claim 67 words
The method of claim 13 further comprising: generating a video data stream comprising generating a plurality of frames of the filtered CFA data at regular intervals; and displaying the video data stream as a video on the display, each of the frames of the video data stream being filtered and displayed on the display within a predefined time on the display with the digital filter effect applied.
Claim 20
Dependent Claim 18 words
The method of claim 17 further comprising selectively storing at least one of the frames in non-volatile memory.
Claim 21
Independent Claim 183 words
A method for processing an image, the method comprising: receiving color filter array (CFA) data representing an image from a digital image capture device into a buffer, wherein an imaging device perform the following operations: wherein an imaging device performs the following operations: applying a convolution filter to the CFA data to generate filtered RGB data representing a filtered image; and displaying the filtered image in real time on a display in the digital image capture device, wherein the applying the convolution filter comprises for each particular pixel represented in the CFA data, calculating a red, a green, and a blue RGB intensity value for the particular pixel, the calculating including, generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and solving a reduced convolution equation using the nearest neighbor array to obtain the RGB intensity value of the particular pixel color, wherein the reduced convolution equation combines terms in the nearest neighbor array.
Claim 22
Independent Claim 183 words
A method for processing an image, the method comprising: receiving color filter array (CFA) data representing an image from a digital image capture device into a buffer, wherein an imaging device perform the following operations: wherein an imaging device performs the following operations: applying a convolution filter to the CFA data to generate filtered RGB data representing a filtered image; and displaying the filtered image in real time on a display in the digital image capture device, wherein the applying the convolution filter comprises for each particular pixel represented in the CFA data, calculating a red, a green, and a blue RGB intensity value for the particular pixel, the calculating including, generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and solving a reduced convolution equation using the nearest neighbor array to obtain the RGB intensity value of the particular pixel color, wherein the reduced convolution equation combines terms in the nearest neighbor array.
Claim 23
Dependent Claim 29 words
The method of claim 19 wherein the convolution filter provides one of a soften effect, blur effect, emboss effect, directional blur effect, or edge detect effect to the image.
Claim 24
Dependent Claim 24 words
The method of claim 19 wherein the algorithm is selected from a plurality of algorithms depending upon on the color of the particular pixel.
Claim 25
Dependent Claim 24 words
The method of claim 19 wherein the applying a convolution filter comprises passing the CFA data through a combined hardware filter and CFA-to-RGB converter.
Claim 26
Dependent Claim 67 words
The method of claim 19 further comprising: generating a video data stream comprising generating a plurality of frames of the filtered RGB data at regular intervals; and displaying the video data stream as a video on the display, each of the frames of the video data stream being filtered and displayed on the display within a predefined time on the display with the digital filter effect applied.
Claim 27
Dependent Claim 18 words
The method of claim 23 further comprising selectively storing at least one of the frames in non-volatile memory.
Claim 28
Dependent Claim 156 words
A graphics controller for processing an image, the graphics controller comprising: a buffer receiving color filter array (CFA) data representing an image from a digital image capture device; and a convolution filter that applies a convolution filter effect to the CFA data thereby generating filtered CFA data representing a filtered image, wherein the convolution filter, for each particular pixel represented in the CFA data, calculates a new red, a new green, and a new blue intensity value for the particular pixel, the calculating including, generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and solving a reduced convolution equation using the nearest neighbor array to obtain the new intensity value of the particular pixel color, wherein the reduced convolution equation combines terms in the nearest neighbor array.
Claim 29
Dependent Claim 156 words
A graphics controller for processing an image, the graphics controller comprising: a buffer receiving color filter array (CFA) data representing an image from a digital image capture device; and a convolution filter that applies a convolution filter effect to the CFA data thereby generating filtered CFA data representing a filtered image, wherein the convolution filter, for each particular pixel represented in the CFA data, calculates a new red, a new green, and a new blue intensity value for the particular pixel, the calculating including, generating a nearest neighbor array for each particular pixel color where positions in the array are filled with a nearest neighbor pixel of a same color of the particular pixel color along a row of the CFA data; and solving a reduced convolution equation using the nearest neighbor array to obtain the new intensity value of the particular pixel color, wherein the reduced convolution equation combines terms in the nearest neighbor array.
Claim 30
Dependent Claim 30 words
The graphics controller of claim 25 wherein the convolution filter provides one of a soften effect, blur effect, emboss effect, directional blur effect, or edge detect effect to the image.
Claim 31
Dependent Claim 25 words
The graphics controller of claim 25 wherein the algorithm is selected from a plurality of algorithms depending upon on a color of the particular pixel.
Claim 32
Dependent Claim 27 words
The graphics controller of claim 25 , wherein a video data stream comprising a plurality of frames of the filtered CFA data is generated at regular intervals.
Claim 33
Dependent Claim 41 words
The method of claim 19 , wherein the terms in the common nearest neighbor array are multiplied by respective predetermined constant coefficients and wherein one of the adjacent neighboring pixels corresponds to one of the positions substituted with the nearest neighbor.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2012-08-03 2013-02-02 2013-08-04 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2016-08-03 2017-02-02 2017-08-04 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2020-08-03 2021-02-02 2021-08-04 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag