Patent US20020101434A1 successfully refreshed from Google Patents.
US20020101434A1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Image interpolating device
Assignee: Pentax Corp
•
Filing: 2002-01-22
•
Granted: —
•
Expires: 2022-01-22
Abstract
Abstract An image interpolating device comprises a color filter, in which R, G, and B color filter elements are disposed in a checkerboard arrangement, and an imaging device which generates R, G, and B-signals corresponding to the color filter elements. In an interpolation process, the difference between a first comparative value V 1 and a second comparative value V 2 is compared. V 1 is determined using color signals of pixels offset in the right and left directions to an objective pixel. V 2 is determined using color signals of pixel offset in the upper and lower directions to the objective pixel. When V 1 is less than V 2, an arithmetic mean of G-signals of pixels offset in the right and left directions by one pixel is obtained as an interpolated G-signal. When V 1 is not less than V 2, an arithmetic mean of G-signals of pixels offset in the upper and lower directions by one pixel is obtained as the interpolated G-signal.
Inventors
- 👤 Nobuaki Abe
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 17:49
CPC Classifications
H; H04; H04N; H04N23/00; H04N23/80; H04N23/84; H04N23/843; H04N25/00; H04N25/10; H04N25/11; H04N25/13; H04N25/134; H04N2209/00; H04N2209/04; H04N2209/041; H04N2209/042; H04N2209/045; H04N2209/046
Claims Analysis
Total Claims: 15
Claim 1
Independent Claim
615 words
1 . An image interpolating device comprising: a color filter having a first row, in which red(R) and green(G) color filter elements are alternately aligned in the horizontal direction, and a second row, in which G and blue(B) color filter elements are alternately aligned in the horizontal direction, said second row being adjacent to the upper or lower side of said first row; an imaging device that generates first R, G, and B-signals which are pixel signals corresponding to said color filter elements; a pattern-setting processor that extracts images belonging to a first pattern, in which a pixel having said first R-signal is positioned at the upper-left corner of a 2×2 pixel matrix, a second pattern, in which a pixel having said first G-signal is positioned at the upper-right corner of said 2×2 pixel matrix, a third pattern, in which a pixel having said first G-signal is positioned at the lower-left corner of said 2×2 pixel matrix, and a fourth pattern, in which a pixel having said first B-signal is positioned at the lower-right corner of said 2×2 pixel matrix, from said first R, G, and B-signals generated by said imaging device; a first G-interpolation processor that, regarding a first objective pixel contained in said images belonging to said first pattern, obtains a first interpolated G-signal based on a first difference signal, which is a difference between said first G-signals of pixels offset from said first objective pixel in the right and left directions or the upper and lower directions by one pixel, second difference signals, each of which is a difference between said first R-signal of said first objective pixel and said first R-signal of a pixel offset from said first objective pixel in the right, left, upper, or lower direction by two pixels, third difference signals, each of which is a difference between said first R-signal of said first objective pixel and said first G-signal of a pixel offset from said first objective pixel in the right, left, upper, or lower direction by one pixel; a second G-interpolation processor that, regarding a fourth objective pixel contained in said images belonging to said fourth pattern, obtains a second interpolated G-signal based on a fourth difference signal, which is a difference between said first G-signals of pixels offset from said fourth objective pixel in the right and left directions or the upper and lower directions by one pixel, fifth difference signals, each of which is a difference between said first B-signal of said fourth objective pixel and said first B-signal of a pixel offset from said fourth objective pixel in the right, left, upper, or lower direction by two pixels, sixth difference signals, each of which is a difference between said first B-signal of said fourth objective pixel and said first G-signal of a pixel offset from said fourth objective pixel in the right, left, upper, or lower direction by one pixel; an R/B-interpolation processor that, regarding second and third objective pixels contained in said images belonging to said second and third patterns, obtains second R and B-signals by utilizing said first R and B-signals of pixels adjacent to said second and third objective pixels; a B-interpolation processor that extracts a first similar pixel which has the closest luminance value to that of said first objective pixel, from pixels adjacent to said first objective pixel, and obtains a third B-signal based on a pixel of said first similar pixel; and an R-interpolation processor that extracts a second similar pixel which has the closest luminance value to that of said fourth objective pixel, from pixels adjacent to said fourth objective pixel, and obtains a third R-signal based on a pixel signal of said second similar pixel.
Claim 2
Dependent Claim
615 words
1 . An image interpolating device comprising: a color filter having a first row, in which red(R) and green(G) color filter elements are alternately aligned in the horizontal direction, and a second row, in which G and blue(B) color filter elements are alternately aligned in the horizontal direction, said second row being adjacent to the upper or lower side of said first row; an imaging device that generates first R, G, and B-signals which are pixel signals corresponding to said color filter elements; a pattern-setting processor that extracts images belonging to a first pattern, in which a pixel having said first R-signal is positioned at the upper-left corner of a 2×2 pixel matrix, a second pattern, in which a pixel having said first G-signal is positioned at the upper-right corner of said 2×2 pixel matrix, a third pattern, in which a pixel having said first G-signal is positioned at the lower-left corner of said 2×2 pixel matrix, and a fourth pattern, in which a pixel having said first B-signal is positioned at the lower-right corner of said 2×2 pixel matrix, from said first R, G, and B-signals generated by said imaging device; a first G-interpolation processor that, regarding a first objective pixel contained in said images belonging to said first pattern, obtains a first interpolated G-signal based on a first difference signal, which is a difference between said first G-signals of pixels offset from said first objective pixel in the right and left directions or the upper and lower directions by one pixel, second difference signals, each of which is a difference between said first R-signal of said first objective pixel and said first R-signal of a pixel offset from said first objective pixel in the right, left, upper, or lower direction by two pixels, third difference signals, each of which is a difference between said first R-signal of said first objective pixel and said first G-signal of a pixel offset from said first objective pixel in the right, left, upper, or lower direction by one pixel; a second G-interpolation processor that, regarding a fourth objective pixel contained in said images belonging to said fourth pattern, obtains a second interpolated G-signal based on a fourth difference signal, which is a difference between said first G-signals of pixels offset from said fourth objective pixel in the right and left directions or the upper and lower directions by one pixel, fifth difference signals, each of which is a difference between said first B-signal of said fourth objective pixel and said first B-signal of a pixel offset from said fourth objective pixel in the right, left, upper, or lower direction by two pixels, sixth difference signals, each of which is a difference between said first B-signal of said fourth objective pixel and said first G-signal of a pixel offset from said fourth objective pixel in the right, left, upper, or lower direction by one pixel; an R/B-interpolation processor that, regarding second and third objective pixels contained in said images belonging to said second and third patterns, obtains second R and B-signals by utilizing said first R and B-signals of pixels adjacent to said second and third objective pixels; a B-interpolation processor that extracts a first similar pixel which has the closest luminance value to that of said first objective pixel, from pixels adjacent to said first objective pixel, and obtains a third B-signal based on a pixel of said first similar pixel; and an R-interpolation processor that extracts a second similar pixel which has the closest luminance value to that of said fourth objective pixel, from pixels adjacent to said fourth objective pixel, and obtains a third R-signal based on a pixel signal of said second similar pixel.
Claim 3
Dependent Claim
52 words
2 . A device according to claim 1 , wherein said first G-interpolation processor obtains said first interpolated G-signal, based on the absolute value of said first difference signal, a sum of the absolute values of said second difference signals, and a sum of the absolute values of said third difference signals.
Claim 4
Dependent Claim
321 words
3 . A device according to claim 1 , wherein said first G-interpolation processor compares a first comparative value V 1 indicated by the following first formula with a second comparative value V 2 indicated by the following second formula, said first G-interpolation processor obtaining an average of said first G-signals from pixels offset from said first objective pixel in the right and left directions by one pixel as said first interpolated G-signal when said first comparative value V 1 is less than said second comparative value V 2 , and obtaining an average of said first G-signals from pixels offset from said first objective pixel in the upper and lower directions by one pixel as said first interpolated G-signal when said first comparative value V 1 is not less than said second comparative value V 2 . V 1 =|G ( x− 1, y )− G ( x+ 1, y )|+ ca x (| R ( x− 2, y )− R ( x,y )|+| R ( x+ 2, y )− R ( x,y )|) + cb x (| G ( x− 1, y )− R ( x,y )|+| G ( x+ 1, y )− R ( x,y )|) V 2 =|G ( x,y− 1)− G ( x,y+ 1)|+ ca x (| R ( x,y− 2)− R ( x,y )|+| R ( x,y+ 2)− R ( x,y )|) + cb x (| G ( x,y− 1)− R ( x,y )|+| G ( x,y+ 1)− R ( x,y )|) wherein G(x+1,y), G(x−1,y), G(x,y+1), and G(x,y−1) are said first G-signals of pixels offset from said first objective pixel in the right, left, lower, and upper directions by one pixel, R(x+2,y), R(x−2,y), R(x,y+2), and R(x,y−2) are said first R-signals of pixels offset from said first objective pixel in the right, left, lower, and upper directions by two pixels, R(x,y) is said first R-signal of said first objective pixel, and ca and cb are coefficients.
Claim 5
Dependent Claim
51 words
4 . A device according to claim 1 , wherein said second G-interpolation processor obtains said second interpolated G-signal, based on the absolute value of said fourth difference signal,a sum of the absolute values of said fifth difference signals, and a sum of the absolute values of said sixth difference signals.
Claim 6
Dependent Claim
321 words
5 . A device according to claim 1 , wherein said second G-interpolation processor compares a third comparative value V 3 indicated by the following third formula with a fourth comparative value V 4 indicated by the following fourth formula, said second G-interpolation processor obtaining an average of said first G-signals from pixels offset from said fourth objective pixel in the right and left directions by one pixel as said second interpolated G-signal when said third comparative value V 3 is less than said fourth comparative value V 4 , and obtaining an average of said first G-signals from pixels offset from said fourth objective pixel in the upper and lower directions by one pixel as said second interpolated G-signal when said third comparative value V 3 is not less than said fourth comparative value V 4 . V 3 =|G ( x− 1, y )− G ( x+ 1, y )|+ ca x (| B ( x− 2, y )− B ( x,y )|+| B ( x+ 2, y )− B ( x,y )|) + cb x (| G ( x− 1, y )− B ( x,y )|+| G ( x+ 1, y )− B ( x,y )|) V 4 =|G ( x,y− 1)− G ( x,y+ 1)|+ ca x (| B ( x,y− 2)− B ( x,y )|+| B ( x,y+ 2)− B ( x,y )|) + cb x (| G ( x,y− 1)− B ( x,y )|+| G ( x,y+ 1)− B ( x,y )|) wherein G(x+1,y), G(x−1,y), G(x,y+1), and G(x,y−1) are said first G-signals of pixels offset from said fourth objective pixel in the right, left, lower, and upper directions by one pixel, B(x+2,y), B(x−2,y), B(x,y+2), and B(x,y−2) are said first B-signals of pixels offset from said fourth objective pixel in the right, left, lower, and upper directions by two pixels, B(x,y) is said first B-signal of said fourth objective pixel, and ca and cb are coefficients.
Claim 7
Dependent Claim
42 words
6 . A device according to claim 1 , wherein said pixels, which are adjacent to said second and third objective pixels and which are utilized in said R/B-interpolation processor, are contained in said images belonging to said first and fourth patterns.
Claim 8
Dependent Claim
47 words
7 . A device according to claim 1 , wherein said pixels, which are adjacent to said first and fourth objective pixels and which are utilized in both said B-interpolation processor and said R-interpolation processor, are contained in said images belonging to said second and third patterns.
Claim 9
Dependent Claim
40 words
8 . A device according to claim 1 , wherein said B-interpolation processor and said R-interpolation processor respectively extract said first and second similar pixels, using said first G-signals of said pixels adjacent to said first and fourth objective pixels.
Claim 10
Dependent Claim
44 words
9 . A device according to claim 1 , wherein said B-interpolation processor obtains said third B-signal, on the assumption that said color difference signal Cb of said first objective pixel is equal to said color difference signal Cb of said first similar pixel.
Claim 11
Dependent Claim
44 words
10 . A device according to claim 1 , wherein said R-interpolation processor obtains said third R-signal, on the assumption that said color difference signal Cr of said fourth objective pixel is equal to said color difference signal Cr of said second similar pixel.
Claim 12
Dependent Claim
58 words
11 . A device according to claim 1 , wherein said B-interpolation processor obtains said third B-signal, using said color difference signal Cb and a modified luminance value which is obtained by multiplying said luminance value by a ratio of said first interpolated G-signal of said first objective pixel and said first G-signal of said first similar pixel.
Claim 13
Dependent Claim
117 words
12 . A device according to claim 11 , wherein said B-interpolation processor obtains said third B-signal, according to the following formula. Y= 0.299× R ( x′,y′ )+0.587× G ( x′,y′ )+0.114× B ( x′,y′ ) Cb=− 0.169× R ( x′,y′ )−0.331× G ( x′,y′ )+0.5× B ( x′,y′ ) YG=Y×G ( x,y )/ G ( x′,y′ ) b=YG+ 1.772×Cb wherein Y is a luminance value of said first similar pixel, R(x′,y′), G(x′,y′), and B(x′,y′) are said second R, first G, and second B-signals of said first similar pixel, G(x,y) is said first interpolated G-signal of said first objective pixel, b is said third B-signal obtained by said B-interpolation processor, and YG is said modified luminance value.
Claim 14
Dependent Claim
58 words
13 . A device according to claim 1 , wherein said R-interpolation processor obtains said third R-signal, using said color difference signal Cr and a modified luminance value which is obtained by multiplying said luminance value by a ratio of said second interpolated G-signal of said fourth objective pixel and said first G-signal of said second similar pixel.
Claim 15
Dependent Claim
117 words
14 . A device according to claim 13 , wherein said R-interpolation processor obtains said third R-signal, according to the following formula. Y= 0.299× R ( x′,y′ )+0.587× G ( x′,y′ )+0.114× B ( x′,y′ ) Cr= 0.5× R ( x′,y′ )−0.419× G ( x′,y′ )−0.081× B ( x′,y′ ) YG=Y×G ( x,y )/ G ( x′,y′ ) r=YG+ 1.402×Cr wherein Y is a luminance value of said second similar pixel, R(x′,y′), G(x′,y′), and B(x′,y′) are said second R, first G, and second B-signals of said second similar pixel, G(x,y) is said second interpolated G-signal of said fourth objective pixel, r is said third R-signal obtained by said R-interpolation processor, and YG is said modified luminance value.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
Maintenance schedule is calculated for granted US utility patents.