Patent US6771835B2 successfully refreshed from Google Patents.
US6771835B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Two-dimensional non-linear interpolation system based on edge information and two-dimensional mixing interpolation system using the same
Assignee: Samsung Electronics Co Ltd
•
Filing: 2001-05-01
•
Granted: 2004-08-03
•
Expires: 2021-05-01
Abstract
Abstract A 2-dimensional non-linear interpolation system and method based on edge information includes an edge detector, an edge direction modifier, a near-edge coefficient generator, a filter coefficient generator and a non-linear interpolation unit. The edge detector detects edge information among pixels from a video signal applied through an input terminal. The edge direction modifier converts the edge information detected by the edge detector on the basis of a center point among peripheral pixels of an interpolation position and outputs modified edge information. The near-edge coefficient generator converts the coordinates of the interpolation position based on the modified edge information to generate a converted interpolation position, generates edge patterns corresponding to the converted interpolation position, and generates a plurality of 2-dimensional interpolation coefficients in response to predetermined one-dimensional non-linear interpolation filter coefficients. The filter coefficient generator generates the one-dimensional non-linear interpolation filter coefficients in response to the coordinates of the converted interpolation position, the edge patterns and predetermined one-dimensional filter coefficients. The non-linear interpolation unit multiplies data values associated with the peripheral pixels by the plurality of 2-dimensional non-linear interpolation coefficients to perform non-linear interpolation. Accordingly, even when a video image is magnified using non-linear interpolation, the resolution of a text or graphic image can be maintained without distortion of edges and aliasing.
Inventors
- 👤 Yong In Han
- 👤 Hweihn Chung
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:15
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/40; G06T3/403; G06T5/00; G06T5/20; G06T7/00; G06T7/10; G06T7/12; H; H04; H04N; H04N1/00; H04N1/387; H04N1/393; H04N1/3935; H04N1/40; H04N1/409; H04N1/4092; G06T2207/00; G06T2207/10; G06T2207/10016
Claims Analysis
Total Claims: 24
Claim 1
Independent Claim
161 words
An interpolation system comprising: an edge detector for detecting edge information among pixels from a video signal applied through an input terminal; an edge direction modifier for converting the edge information detected by the edge detector on the basis of a center point among peripheral pixels of an interpolation position and outputting modified edge information; a near-edge coefficient generator for converting the coordinates of the interpolation position based on the modified edge information to generate a converted interpolation position, generating edge patterns corresponding to the converted interpolation position, and generating a plurality of two-dimensional interpolation coefficients in response to predetermined one-dimensional non-linear interpolation filter coefficients; a filter coefficient generator for generating the one-dimensional non-linear interpolation filter coefficients in response to the coordinates of the converted interpolation position, the edge patterns and predetermined one-dimensional filter coefficients; and a non-linear interpolation unit for multiplying data values associated with the peripheral pixels by the plurality of two-dimensional non-linear interpolation coefficients to perform non-linear interpolation.
Claim 2
Dependent Claim
161 words
An interpolation system comprising: an edge detector for detecting edge information among pixels from a video signal applied through an input terminal; an edge direction modifier for converting the edge information detected by the edge detector on the basis of a center point among peripheral pixels of an interpolation position and outputting modified edge information; a near-edge coefficient generator for converting the coordinates of the interpolation position based on the modified edge information to generate a converted interpolation position, generating edge patterns corresponding to the converted interpolation position, and generating a plurality of two-dimensional interpolation coefficients in response to predetermined one-dimensional non-linear interpolation filter coefficients; a filter coefficient generator for generating the one-dimensional non-linear interpolation filter coefficients in response to the coordinates of the converted interpolation position, the edge patterns and predetermined one-dimensional filter coefficients; and a non-linear interpolation unit for multiplying data values associated with the peripheral pixels by the plurality of two-dimensional non-linear interpolation coefficients to perform non-linear interpolation.
Claim 3
Dependent Claim
45 words
The interpolation system of claim 1 , wherein the edge direction modifier generates the modified edge information comprising a center edge including horizontal, vertical and diagonal components and a border edge on the basis of the center point of four pixels around the interpolation position.
Claim 4
Dependent Claim
189 words
The interpolation system of claim 2 , wherein the near-edge coefficient generator comprises: a prototype center edge and rotation angle determiner for receiving the modified edge information and determining a prototype center edge, comprising a reference of the shape of an edge, and a rotation angle corresponding to the prototype center edge; a coordinate converter for converting the coordinates of the interpolation position according to the rotation angle and outputting converted coordinates as the coordinates of the converted interpolation position; an edge pattern determiner for receiving the coordinates of the converted interpolation position and generating the different types of edge patterns in response to the border edge and the prototype center edge; a near-edge interpolation coefficient calculator for performing an operation on the converted interpolation position and the one-dimensional non-linear interpolation filter coefficients in response to the prototype center edge and generating first through fourth near-edge two-dimensional non-linear interpolation coefficients in response to the results of the operation; and a coordinate rerotating unit for rerotating the first through fourth near-edge two-dimensional non-linear interpolation coefficients by the rotation angle and outputting the rerotated coefficients as the two-dimensional non-linear interpolation coefficients.
Claim 5
Dependent Claim
90 words
The interpolation system of claim 3 , wherein the prototype center edge generated by the prototype center edge and rotation angle determiner is one of a corner type edge, a perpendicular type edge, a full line edge, a cross bar edge, a half line edge and a diagonal type edge depending on the shape of the center edge, and each of the prototype center edges of the five types other than the cross bar is represented using at least one rotation angle among the angles 0°, 90°, 180° and 270°.
Claim 6
Dependent Claim
160 words
The interpolation system of claim 3 , wherein the coordinates of the converted interpolation position are obtained according to the relationships: [ X ′ Y ′ ] = [ cos θ - sin θ sin θ cos θ ] [ X Y ] X = x - 0.5 , Y = Y - 0.5 x ′ = cos θ x - sin θ y + ( sin θ - cos θ + 1 ) * 0.5 y ′ = sin θx + cos θ y + ( 1 - sin θ - cos θ ) * 0.5 where x and y are the coordinates of the interpolation position, x′ and y′ are the coordinates of the converted interpolation position, and θ represents the rotation angle.
Claim 7
Dependent Claim
49 words
The interpolation system of claim 3 , wherein the edge pattern determiner divides the edge patterns into a single edge pattern, a twin edge pattern and a periodic edge pattern depending on the absence or existence of the border edge which has been rotated according to the rotation angle.
Claim 8
Dependent Claim
100 words
The interpolation system of claim 6 , wherein the edge pattern determiner comprises a multiplexer for receiving the bits of the rotated border edge as an input signal and selectively outputs bits of the rotated border edge in response to predetermined bits of data indicating the prototype center edge and the coordinates of the converted interpolation position, outputs horizontal and diagonal edge patterns by adding a predetermined bit indicating a diagonal edge to a horizontal border edge among the outputs of the multiplexer, and outputs a vertical border edge among the outputs of the multiplexer as a vertical edge pattern.
Claim 9
Dependent Claim
99 words
The interpolation system of claim 3 , wherein the near-edge interpolation coefficient calculator comprises: a multiplexer for receiving the coordinates of the one-dimensional non-linear filter interpolation coefficients, the coordinates of the converted interpolation position, the complements of the coordinates and one of the near-edge two-dimensional interpolation coefficients as multiple inputs, and data of predetermined bits indicating the prototype center edge as a selection signal; and a plurality of multipliers for combining the outputs of the multiplexer, multiplying the combined outputs by each other, and outputting the multiplied results as the first through fourth near edge two-dimensional non-linear interpolation coefficients.
Claim 10
Dependent Claim
18 words
The interpolation system of claim 1 , further comprising a look-up table for storing the one-dimensional filter coefficients.
Claim 11
Independent Claim
83 words
A method of performing two-dimensional non-linear interpolation on an input video signal, the method comprising: (a) detecting edge information from the input video signal; (b) modifying the detected edge information to generate modified edge information; (c) generating two-dimensional non-linear interpolation coefficients in response to the modified edge information and predetermined one-dimensional non-linear interpolation filter coefficients; and (d) multiplying data values associated with peripheral pixels around a current interpolation position by the two-dimensional non-linear interpolation coefficients, thereby performing non-linear interpolation on the video signal.
Claim 12
Independent Claim
83 words
A method of performing two-dimensional non-linear interpolation on an input video signal, the method comprising: (a) detecting edge information from the input video signal; (b) modifying the detected edge information to generate modified edge information; (c) generating two-dimensional non-linear interpolation coefficients in response to the modified edge information and predetermined one-dimensional non-linear interpolation filter coefficients; and (d) multiplying data values associated with peripheral pixels around a current interpolation position by the two-dimensional non-linear interpolation coefficients, thereby performing non-linear interpolation on the video signal.
Claim 13
Dependent Claim
173 words
The method of claim 10 , wherein step (c) comprises: (c1) receiving the modified edge information, determining one among a plurality of prototype center edges as a center edge type and determining a rotation angle corresponding to the selected prototype center edge; (c2) converting the coordinates of the current interpolation position according to the rotation angle and generating the coordinates of a converted interpolation position; (c3) generating a plurality of edge patterns in response to the coordinates of the converted interpolation position and a border edge of the modified edge information; (c4) generating the one-dimensional non-linear interpolation filter coefficients in response to the coordinates of the converted interpolation position, the plurality of edge patterns and predetermined one-dimensional filter coefficients; (c5) generating near-edge two-dimensional non-linear interpolation coefficients in response to the prototype center edge, the coordinates of the converted interpolation position and the one-dimensional non-linear interpolation filter coefficients; and (c6) rerotating the near-edge two-dimensional non-linear interpolation coefficients by the rotation angle and outputting the results of the rerotation as the two-dimensional non-linear interpolation coefficients.
Claim 14
Dependent Claim
84 words
The method of claim 11 , wherein during step (c1), the prototype center edges comprise at least one of a corner type edge, a perpendicular type edge, a full line edge, a cross bar edge, a half line edge and a diagonal type edge depending on the shape of the center edge, and each of the prototype center edges of the five types other than the cross bar is represented using at least one rotation angle among the angles 0°, 90°, 180° and 270°.
Claim 15
Dependent Claim
48 words
The method of claim 11 , wherein step (c3) generates the edge patterns which are divided into a single edge pattern, a twin edge pattern and a periodic edge pattern depending on the absence or existence of the border edge which has been rotated by the rotation angle.
Claim 16
Dependent Claim
71 words
The method of claim 11 , wherein the step (c5) comprises the sub-steps of: (c51) selectively outputting the coordinates of the one-dimensional non-linear filter interpolation coefficients, the coordinates of the converted interpolation position and the complements of the coordinates as vertical and horizontal values; and (c52) combining the selectively output values, multiplying the combined values by each other, and outputting the multiplied results as the near edge two-dimensional non-linear interpolation coefficients.
Claim 17
Dependent Claim
181 words
A two-dimensional mixing interpolation system comprising: an edge detection and non-linear interpolation coefficient generation unit for detecting edge information among pixels from a video signal received at an input terminal, modifying the detected edge information according to predetermined edge patterns, obtaining a plurality of two-dimensional non-linear interpolation coefficients based on the modified edge information among a plurality of adjacent pixels around a pixel to be interpolated, and generating an edge signal indicating the absence or existence of an edge among the plurality of adjacent pixels around the pixel to be interpolated; a linear interpolation unit for multiplying data values associated with n*n pixels around the pixel to be interpolated by vertical interpolation coefficients and by horizontal interpolation coefficients to perform linear interpolation; a non-linear interpolation unit for multiplying data values associated with the plurality of adjacent pixels by the plurality of two-dimensional non-linear interpolation coefficients to perform non-linear interpolation near an edge; and a multiplexer for selectively outputting an interpolated pixel from the linear interpolation unit or an interpolated pixel from the non-linear interpolation unit in response to the edge information.
Claim 18
Dependent Claim
181 words
A two-dimensional mixing interpolation system comprising: an edge detection and non-linear interpolation coefficient generation unit for detecting edge information among pixels from a video signal received at an input terminal, modifying the detected edge information according to predetermined edge patterns, obtaining a plurality of two-dimensional non-linear interpolation coefficients based on the modified edge information among a plurality of adjacent pixels around a pixel to be interpolated, and generating an edge signal indicating the absence or existence of an edge among the plurality of adjacent pixels around the pixel to be interpolated; a linear interpolation unit for multiplying data values associated with n*n pixels around the pixel to be interpolated by vertical interpolation coefficients and by horizontal interpolation coefficients to perform linear interpolation; a non-linear interpolation unit for multiplying data values associated with the plurality of adjacent pixels by the plurality of two-dimensional non-linear interpolation coefficients to perform non-linear interpolation near an edge; and a multiplexer for selectively outputting an interpolated pixel from the linear interpolation unit or an interpolated pixel from the non-linear interpolation unit in response to the edge information.
Claim 19
Dependent Claim
152 words
The two-dimensional mixing interpolation system of claim 15 , wherein the edge detection and non-linear interpolation coefficient generation unit comprises: an edge detector for detecting the edge information among pixels from the video signal; an edge direction modifier for modifying the edge information detected by the edge detector on the basis of a pivot of the plurality of adjacent pixels around an interpolation position and outputting the modified edge information; an edge coefficient generator for converting the coordinates of the interpolation position based on the modified edge information to generate a converted interpolation position, generating edge patterns corresponding to the converted interpolation position, and generating the plurality of two-dimensional non-linear interpolation coefficients in response to predetermined one-dimensional non-linear interpolation filter coefficients; and a filter coefficient generator for generating the one-dimensional non-linear interpolation filter coefficients in response to the coordinates of the converted interpolation position, the edge patterns and predetermined one-dimensional filter coefficients.
Claim 20
Dependent Claim
212 words
A two-dimensional mixing interpolation system comprising: an edge detection and non-linear interpolation coefficient generation unit for detecting edge information among pixels from a video signal input through an input terminal, modifying the detected edge information according to predetermined edge patterns, obtaining a plurality of two-dimensional non-linear interpolation coefficients based on the modified edge information among a plurality of adjacent pixels around a pixel to be interpolated, and generating an edge signal indicating the absence or existence of an edge among the plurality of adjacent pixels around the pixel to be interpolated; a vertical linear interpolation unit for multiplying data values associated with n*n pixels around the pixel to be interpolated by plurality of vertical interpolation coefficients to perform vertical interpolation; a first multiplexer for selectively outputting vertically interpolated pixels from the vertical linear interpolation unit or the plurality of adjacent pixels in response to the edge signal; a second multiplexer for selectively outputting a plurality of horizontal interpolation coefficients or the plurality of two-dimensional non-linear interpolation coefficients in response to the edge signal; and a horizontal and near-edge interpolation unit for multiplying data values associated with pixels selectively output from the first multiplexer by interpolation coefficients selectively output from the second multiplexer to perform linear interpolation or non-linear interpolation near an edge.
Claim 21
Dependent Claim
212 words
A two-dimensional mixing interpolation system comprising: an edge detection and non-linear interpolation coefficient generation unit for detecting edge information among pixels from a video signal input through an input terminal, modifying the detected edge information according to predetermined edge patterns, obtaining a plurality of two-dimensional non-linear interpolation coefficients based on the modified edge information among a plurality of adjacent pixels around a pixel to be interpolated, and generating an edge signal indicating the absence or existence of an edge among the plurality of adjacent pixels around the pixel to be interpolated; a vertical linear interpolation unit for multiplying data values associated with n*n pixels around the pixel to be interpolated by plurality of vertical interpolation coefficients to perform vertical interpolation; a first multiplexer for selectively outputting vertically interpolated pixels from the vertical linear interpolation unit or the plurality of adjacent pixels in response to the edge signal; a second multiplexer for selectively outputting a plurality of horizontal interpolation coefficients or the plurality of two-dimensional non-linear interpolation coefficients in response to the edge signal; and a horizontal and near-edge interpolation unit for multiplying data values associated with pixels selectively output from the first multiplexer by interpolation coefficients selectively output from the second multiplexer to perform linear interpolation or non-linear interpolation near an edge.
Claim 22
Independent Claim
156 words
A method of performing two-dimensional mixing interpolation on an input video signal, the method comprising: (a) detecting edge information among a plurality of adjacent pixels around a pixel to be interpolated from the input video signal and modifying the detected edge information into a predetermined edge pattern; (b) obtaining a plurality of two-dimensional non-linear interpolation coefficients based on the edge pattern; (c) determining whether an edge exists among the plurality of pixels around the pixel to be interpolated; (d) multiplying data values associated with n*n pixels around the pixel to be interpolated by a plurality of vertical and horizontal interpolation coefficients to perform linear interpolation when it is determined that an edge does not exist in step (c); and (e) multiplying data values associated with the plurality of adjacent pixels by the plurality of two-dimensional non-linear interpolation coefficients to perform non-linear interpolation near an edge when it is determined that an edge exists in step (c).
Claim 23
Independent Claim
156 words
A method of performing two-dimensional mixing interpolation on an input video signal, the method comprising: (a) detecting edge information among a plurality of adjacent pixels around a pixel to be interpolated from the input video signal and modifying the detected edge information into a predetermined edge pattern; (b) obtaining a plurality of two-dimensional non-linear interpolation coefficients based on the edge pattern; (c) determining whether an edge exists among the plurality of pixels around the pixel to be interpolated; (d) multiplying data values associated with n*n pixels around the pixel to be interpolated by a plurality of vertical and horizontal interpolation coefficients to perform linear interpolation when it is determined that an edge does not exist in step (c); and (e) multiplying data values associated with the plurality of adjacent pixels by the plurality of two-dimensional non-linear interpolation coefficients to perform non-linear interpolation near an edge when it is determined that an edge exists in step (c).
Claim 24
Dependent Claim
130 words
The method of claim 18 , wherein steps (c) through (e) comprise: (f) multiplying data values associated with the n*n pixels around the pixel to be interpolated by the vertical interpolation coefficients to perform vertical linear interpolation and generating vertically interpolated pixels; (g) determining whether an edge exists among the plurality of adjacent pixels; (h) multiplying data values associated with the vertically interpolated pixels generated in the step (f) by the horizontal interpolation coefficients to perform horizontal linear interpolation when it is determined that an edge does not exist in step (g); and (i) multiplying data values associated with the plurality of adjacent pixels by the plurality of two-dimensional non-linear interpolation coefficients to perform non-linear interpolation near an edge when it is determined that an edge exists in step (g).
References Cited (Backward Citations)
US5748788A
Cited
US5467439A
Cited
US5368033A
Cited
US5799113A
Cited
US5936681A
Cited
US6570673B2
Cited
US6392765B1
Cited
JPH11261849A
Cited
US6236766B1
Cited
US6307569B1
Cited
US6411305B1
Cited
US6714688B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-08-03 | 2008-02-02 | 2008-08-03 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-08-03 | 2012-02-02 | 2012-08-03 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-08-03 | 2016-02-02 | 2016-08-03 | $7700.00 | Window Closed / Lapsed |