Patent US6339434B1 successfully refreshed from Google Patents.
US6339434B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Image scaling circuit for fixed pixed resolution display
Assignee: Pixelworks Inc
•
Filing: 1998-11-23
•
Granted: 2002-01-15
•
Expires: 2018-11-23
Abstract
Abstract An image scaling circuit for increasing or decreasing the size of a sampled image to match a fixed resolution display. The circuit includes means for resizing the image in the horizontal and vertical dimension using independent sample rate converters. The sample rate converters increase or decrease the image size by a factor of Lx/Mx in the horizontal dimension and Ly/My in the vertical dimension where Lx and Ly are integers and Mx and My are decimal numbers of arbitrary precision to provide fine scaling control. In addition, image warping is conveniently implemented by varying the down sample ratios Mx and My on a pixel by pixel and/or line by line basis.
Inventors
- 👤 Michael G. West
- 👤 Robert Y. Greenberg
- 👤 Alan L. Zimmerman
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 08:47
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/40; G06T3/4023; G09; G09G; G09G5/00; G09G5/36; G09G5/39; G09G5/391; G09G5/395; G09G2340/00; G09G2340/04; G09G2340/0407
Claims Analysis
Total Claims: 52
Claim 1
Independent Claim
157 words
A sample rate converter circuit for processing digital image data to resize a corresponding image, the sample rate converter circuit comprising: input means for receiving an input stream of pixel values having a first sample rate; an up sampler means for increasing the sample rate of the input stream to form an intermediate sample stream responsive to the input stream and having an up sample rate greater than the first sample rate; FIR filter means for filtering the intermediate sample stream to form a FIR filtered intermediate sample stream; and a down sampler means for decreasing the sample rate of the FIR filtered intermediate sample stream to form an output sample stream having a down sample rate less than the up sample rate wherein the down sampler means is arranged to reduce the sample rate of the intermediate sample stream by a down sampling factor, the down sampling factor being a selected decimal number of arbitrary precision.
Claim 2
Dependent Claim
157 words
A sample rate converter circuit for processing digital image data to resize a corresponding image, the sample rate converter circuit comprising: input means for receiving an input stream of pixel values having a first sample rate; an up sampler means for increasing the sample rate of the input stream to form an intermediate sample stream responsive to the input stream and having an up sample rate greater than the first sample rate; FIR filter means for filtering the intermediate sample stream to form a FIR filtered intermediate sample stream; and a down sampler means for decreasing the sample rate of the FIR filtered intermediate sample stream to form an output sample stream having a down sample rate less than the up sample rate wherein the down sampler means is arranged to reduce the sample rate of the intermediate sample stream by a down sampling factor, the down sampling factor being a selected decimal number of arbitrary precision.
Claim 3
Dependent Claim
26 words
A sample rate converter according to claim 1 wherein the up sampler means is arranged to increase the up sample rate by a selected integer factor.
Claim 4
Dependent Claim
17 words
A sample rate converter according to claim 2 wherein the integer factor is a power of two.
Claim 5
Dependent Claim
178 words
A sample rate converter circuit for processing digital image data to resize a corresponding image, the sample rate converter circuit comprising: input means for receiving an input stream of pixel values having a first sample rate; an up sampler means for increasing the sample rate of the input stream to form an intermediate sample stream responsive to the input stream and having an up sample rate greater than the first sample rate; FIR filter means for filtering the intermediate sample stream to form a FIR filtered intermediate sample stream; and a down sampler means for decreasing the sample rate of the FIR filtered intermediate sample stream to form an output sample stream having a down sample rate less than the up sample rate wherein the down sampler means is arranged to reduce the sample rate of the intermediate sample stream by a selected decimal factor; wherein the down sampler means includes means for selecting the decimal factor by selecting one of an adjacent pair of samples of the FIR filtered intermediate sample stream as an output sample value.
Claim 6
Dependent Claim
178 words
A sample rate converter circuit for processing digital image data to resize a corresponding image, the sample rate converter circuit comprising: input means for receiving an input stream of pixel values having a first sample rate; an up sampler means for increasing the sample rate of the input stream to form an intermediate sample stream responsive to the input stream and having an up sample rate greater than the first sample rate; FIR filter means for filtering the intermediate sample stream to form a FIR filtered intermediate sample stream; and a down sampler means for decreasing the sample rate of the FIR filtered intermediate sample stream to form an output sample stream having a down sample rate less than the up sample rate wherein the down sampler means is arranged to reduce the sample rate of the intermediate sample stream by a selected decimal factor; wherein the down sampler means includes means for selecting the decimal factor by selecting one of an adjacent pair of samples of the FIR filtered intermediate sample stream as an output sample value.
Claim 7
Dependent Claim
36 words
A sample rate converter according to claim 1 wherein the down sampler includes means for determining an output sample value responsive to values of an adjacent pair of samples of the FIR filtered intermediate sample stream.
Claim 8
Dependent Claim
51 words
A sample rate converter according to claim 5 including means for selecting one of an adjacent pair of samples of the FIR filtered intermediate sample stream and means for interpolating between the values of the selected adjacent pair of samples of the intermediate sample stream to form the output sample value.
Claim 9
Dependent Claim
35 words
A sample rate converter according to claim 1 including an image warping means for scaling the digital image data so as to produce an output image that is warped in relation to an input image.
Claim 10
Dependent Claim
28 words
A sample rate converter according to claim 7 wherein the image warping means includes means for varying the up sample rate or the down sample rate or both.
Claim 11
Dependent Claim
44 words
A sample rate converter according to claim 8 wherein the down sample rate is constant within each line and varies linearly from line to line of the output sample stream to create an output image having a keystone effect relative to the pixelated image.
Claim 12
Dependent Claim
40 words
A sample rate converter according to claim 8 wherein the down sample rate varies within each line of the output sample stream to create an output image having an aspect ratio different than an aspect ratio of the input image.
Claim 13
Dependent Claim
167 words
A sample rate converter circuit for processing digital image data to modify the sample rate of a corresponding pixelated image, the sample rate converter circuit comprising: an input buffer for receiving an input stream of pixel values having a first sample rate; an up sampler circuit for increasing the sample rate of the input stream by an integer up sample factor L so as to form an intermediate sample stream responsive to the input stream and having an intermediate sample rate equal to L times the first sample rate; a FIR filter for low-pass filtering the intermediate sample stream to form a FIR filtered sample stream; and a down sampler circuit for decreasing the sample rate of the FIR filtered sample stream by a selected decimal down sample factor M so as to form an output sample stream having an output sample rate equal to 1/M times the intermediate sample stream sample rate whereby the output sample rate is equal to L/M times the first sample rate.
Claim 14
Dependent Claim
167 words
A sample rate converter circuit for processing digital image data to modify the sample rate of a corresponding pixelated image, the sample rate converter circuit comprising: an input buffer for receiving an input stream of pixel values having a first sample rate; an up sampler circuit for increasing the sample rate of the input stream by an integer up sample factor L so as to form an intermediate sample stream responsive to the input stream and having an intermediate sample rate equal to L times the first sample rate; a FIR filter for low-pass filtering the intermediate sample stream to form a FIR filtered sample stream; and a down sampler circuit for decreasing the sample rate of the FIR filtered sample stream by a selected decimal down sample factor M so as to form an output sample stream having an output sample rate equal to 1/M times the intermediate sample stream sample rate whereby the output sample rate is equal to L/M times the first sample rate.
Claim 15
Dependent Claim
20 words
A sample rate converter circuit according to claim 11 wherein the up sample factor L is a power of two.
Claim 16
Dependent Claim
59 words
A sample rate converter circuit according to claim 11 wherein: the FIR filter includes a plurality of multiplier circuits, each multiplier circuit arranged to multiply a selected input pixel value by a selected FIR coefficient to form a respective product; and the FIR filter includes an adder arranged for summing the products together to calculate an output pixel value.
Claim 17
Dependent Claim
17 words
A sample rate converter circuit according to claim 13 wherein the plurality of multipliers are integer multipliers.
Claim 18
Dependent Claim
67 words
A sample rate converter circuit according to claim 13 wherein the input buffer comprises a pipeline formed of unit delay elements and wherein the input buffer comprises a plurality of taps, each tap connecting a respective one of the delay elements to an input of a corresponding one of the multiplier circuits for providing the selected input pixel value to the corresponding one of the multiplier circuits.
Claim 19
Dependent Claim
67 words
A sample rate converter circuit according to claim 13 wherein the input buffer comprises a pipeline of line memory buffers and wherein the input buffer comprises a plurality of taps, each tap connecting a respective one of the line memory buffers to an input of a corresponding one of the multiplier circuits for providing the selected input pixel value to the corresponding one of the multiplier circuits.
Claim 20
Dependent Claim
33 words
A sample rate converter circuit according to claim 13 wherein the FIR filter has a length equal to L*N, where L is the integer up sample factor and N is a selected integer.
Claim 21
Dependent Claim
266 words
A sample rate converter circuit for processing digital image data to modify the sample rate of a corresponding pixelated image, the sample rate converter circuit comprising: an input buffer for receiving an input stream of pixel values having a first sample rate; an up sampler circuit for increasing the sample rate of the input stream by an integer up sample factor L so as to form an intermediate sample stream responsive to the input stream and having an intermediate sample rate equal to L times the first sample rate; a FIR filter for low-pass filtering the intermediate sample stream to form a FIR filtered sample stream; and a down sampler circuit for decreasing the sample rate of the FIR filtered sample stream by a selected decimal down sample factor M so as to form an output sample stream having an output sample rate equal to 1/M times the intermediate sample stream sample rate whereby the output sample rate is equal to L/M times the first sample rate; a memory for storing one or more sets of coefficients, each set of coefficients corresponding to a respective FIR phase; and an FIR phase calculation circuit for determining a subset of input pixels and a corresponding FIR phase for each input pixel of the subset of input pixels; wherein the FIR filter includes a plurality of multiplier circuits, each multiplier circuit arranged to multiply a selected input pixel value by a selected FIR coefficient to form a respective product; and wherein the FIR filter includes an adder arranged for summing the products together to calculate an output pixel value.
Claim 22
Dependent Claim
266 words
A sample rate converter circuit for processing digital image data to modify the sample rate of a corresponding pixelated image, the sample rate converter circuit comprising: an input buffer for receiving an input stream of pixel values having a first sample rate; an up sampler circuit for increasing the sample rate of the input stream by an integer up sample factor L so as to form an intermediate sample stream responsive to the input stream and having an intermediate sample rate equal to L times the first sample rate; a FIR filter for low-pass filtering the intermediate sample stream to form a FIR filtered sample stream; and a down sampler circuit for decreasing the sample rate of the FIR filtered sample stream by a selected decimal down sample factor M so as to form an output sample stream having an output sample rate equal to 1/M times the intermediate sample stream sample rate whereby the output sample rate is equal to L/M times the first sample rate; a memory for storing one or more sets of coefficients, each set of coefficients corresponding to a respective FIR phase; and an FIR phase calculation circuit for determining a subset of input pixels and a corresponding FIR phase for each input pixel of the subset of input pixels; wherein the FIR filter includes a plurality of multiplier circuits, each multiplier circuit arranged to multiply a selected input pixel value by a selected FIR coefficient to form a respective product; and wherein the FIR filter includes an adder arranged for summing the products together to calculate an output pixel value.
Claim 23
Dependent Claim
26 words
A sample rate converter circuit according to claim 18 wherein each set of coefficients includes only coefficients corresponding to non-zero terms of the intermediate sample stream.
Claim 24
Dependent Claim
40 words
A sample rate converter circuit according to claim 18 wherein the FIR phase calculation circuit includes an image warping circuit for scaling the pixelated image by varying the up sample factor L or the down sample factor M or both.
Claim 25
Dependent Claim
46 words
A sample rate converter circuit according to claim 20 wherein the down sample factor M is constant within each line and varies linearly from line to line of the pixelated image to create an output pixel image having a keystone effect relative to the pixelated image.
Claim 26
Dependent Claim
41 words
A sample rate converter circuit according to claim 20 wherein the down sample factor M varies within each line of the pixelated image to create an output image having an aspect ratio different than an aspect ratio of the pixelated image.
Claim 27
Dependent Claim
124 words
A pixelated display controller integrated circuit, comprising: a vertical scalar circuit; and a horizontal scalar circuit, the vertical and horizontal scalar circuits together forming a two-dimensional image scaling subsystem; wherein each of the vertical and horizontal scalar circuits comprises a multi-rate FIR filter system, each multi-rate FIR filter system comprising an up sampler circuit, a low-pass FIR filter, and a down-sampler circuit, wherein at least one of the up sampler circuits has an up sampling factor of L; and wherein the down-sampler circuit corresponding to said one of the up sampler circuits has a down sampling factor of M, where M is a decimal number, whereby at least one of the vertical and horizontal scalar circuits provides a rational scaling factor equal to L/M.
Claim 28
Dependent Claim
124 words
A pixelated display controller integrated circuit, comprising: a vertical scalar circuit; and a horizontal scalar circuit, the vertical and horizontal scalar circuits together forming a two-dimensional image scaling subsystem; wherein each of the vertical and horizontal scalar circuits comprises a multi-rate FIR filter system, each multi-rate FIR filter system comprising an up sampler circuit, a low-pass FIR filter, and a down-sampler circuit, wherein at least one of the up sampler circuits has an up sampling factor of L; and wherein the down-sampler circuit corresponding to said one of the up sampler circuits has a down sampling factor of M, where M is a decimal number, whereby at least one of the vertical and horizontal scalar circuits provides a rational scaling factor equal to L/M.
Claim 29
Dependent Claim
27 words
A pixelated display controller system according to claim 23 wherein each low-pass FIR filter has a cutoff frequency approximately equal to the smaller of 1/M and 1/L.
Claim 30
Dependent Claim
18 words
A pixelated display controller system according to claim 23 wherein L=2 n and n is a positive integer.
Claim 31
Dependent Claim
18 words
A pixelated display controller system according to claim 23 wherein M is represented as a 16-bit real number.
Claim 32
Dependent Claim
20 words
A pixelated display controller system according to claim 23 wherein the controller system is implemented in a monolithic integrated circuit.
Claim 33
Dependent Claim
39 words
A pixelated display controller system according to claim 23 wherein the vertical and horizontal scalar circuits implement scaling factors of Ly/My and Lx/Mx respectively, where Lx and Ly are powers of two and Mx and My are decimal numbers.
Claim 34
Dependent Claim
35 words
A sample rate converter according to claim 23 including an image warping means for scaling digital input image data so as to produce an output image that is warped in relation to an input image.
Claim 35
Dependent Claim
30 words
A sample rate converter according to claim 29 wherein the image warping means includes means for varying the up sample factor L or the down sample factor M or both.
Claim 36
Dependent Claim
45 words
A sample rate converter according to claim 30 wherein the down sample factor M is constant within each line and varies linearly from line to line of the output sample stream to create an output image having a keystone effect relative to the pixelated image.
Claim 37
Dependent Claim
41 words
A sample rate converter according to claim 30 wherein the down sample factor M varies within each line of the output sample stream to create an output image having an aspect ratio different than an aspect ratio of the input image.
Claim 38
Dependent Claim
26 words
A pixelated display controller system according to claim 23 including a frame buffer coupled to either the vertical or horizontal scaling circuits for storing pixelated images.
Claim 39
Dependent Claim
23 words
A pixelated display controller system according to claim 33 wherein the frame buffer converts an input refresh rate to an output refresh rate.
Claim 40
Dependent Claim
19 words
A pixelated display controller system according to claim 33 wherein the frame buffer includes synchronous dynamic random access memory.
Claim 41
Dependent Claim
39 words
A pixelated display controller system according to claim 35 wherein the frame buffer includes synchronous dynamic random access memory sufficient to store up to SXGA images at 24 bits per pixel or UXGA/HDTV images at 16 bits per pixel.
Claim 42
Independent Claim
217 words
A method for rationally scaling a digital image having a series of digital image pixel values in a FIR filter scaling circuit, the method comprising: receiving a series of input pixel values Ix; selecting an up sample factor L, the up sample factor being a power of 2; selecting a down sample factor M, the down sample factor M being a decimal number of arbitrary precision; sizing the FIR filter scaling circuit as an integer multiple N times L so that the number of non-zero multiplies to realize the filter is N with every Lth filter coefficient multiplying a non-zero input pixel value; selecting a group of non-zero input pixel values; identifying a set of FIR filter coefficients for the group of non-zero input pixel values that multiply respective non-zero input pixel values in the FIR filter; multiplying the group of input pixel values by the identified coefficients to form N products; calculating a value of the initial output pixel position as a sum of the N products, whereby the number of multiply operations in the filter is reduced to N rather than N*L; and repeating the selecting, identifying, multiplying, and calculating steps for subsequent output pixel positions so as to form a series of scaled output pixel values responsive to the series of input pixel values.
Claim 43
Independent Claim
217 words
A method for rationally scaling a digital image having a series of digital image pixel values in a FIR filter scaling circuit, the method comprising: receiving a series of input pixel values Ix; selecting an up sample factor L, the up sample factor being a power of 2; selecting a down sample factor M, the down sample factor M being a decimal number of arbitrary precision; sizing the FIR filter scaling circuit as an integer multiple N times L so that the number of non-zero multiplies to realize the filter is N with every Lth filter coefficient multiplying a non-zero input pixel value; selecting a group of non-zero input pixel values; identifying a set of FIR filter coefficients for the group of non-zero input pixel values that multiply respective non-zero input pixel values in the FIR filter; multiplying the group of input pixel values by the identified coefficients to form N products; calculating a value of the initial output pixel position as a sum of the N products, whereby the number of multiply operations in the filter is reduced to N rather than N*L; and repeating the selecting, identifying, multiplying, and calculating steps for subsequent output pixel positions so as to form a series of scaled output pixel values responsive to the series of input pixel values.
Claim 44
Independent Claim
246 words
A method for rationally scaling a digital image having a series of digital image pixel values in a FIR filter scaling circuit, the method comprising: receiving a series of input pixel values Ix; selecting an up sample factor L, the up sample factor being a power of 2; selecting a down sample factor M, the down sample factor M being a decimal number of arbitrary precision; sizing the FIR filter scaling circuit as an integer multiple N times L so that the number of non-zero multiplies to realize the filter is N with every Lth filter coefficient multiplying a non-zero input pixel value; selecting a group of non-zero input pixel values; identifying a set of FIR filter coefficients for the group of non-zero input pixel values that multiply respective non-zero input pixel values in the FIR filter; multiplying the group of input pixel values by the identified coefficients to form N products; calculating a value of the initial output pixel position as a sum of the N products, whereby the number of multiply operations in the filter is reduced to N rather than N*L; and repeating the selecting, identifying, multiplying, and calculating steps for subsequent output pixel positions so as to form a series of scaled output pixel values responsive to the series of input pixel values; wherein identifying a set of FIR filter coefficients includes calculating a FIR phase and using the FIR phase to select one of a plurality of predetermined sets of coefficients.
Claim 45
Independent Claim
246 words
A method for rationally scaling a digital image having a series of digital image pixel values in a FIR filter scaling circuit, the method comprising: receiving a series of input pixel values Ix; selecting an up sample factor L, the up sample factor being a power of 2; selecting a down sample factor M, the down sample factor M being a decimal number of arbitrary precision; sizing the FIR filter scaling circuit as an integer multiple N times L so that the number of non-zero multiplies to realize the filter is N with every Lth filter coefficient multiplying a non-zero input pixel value; selecting a group of non-zero input pixel values; identifying a set of FIR filter coefficients for the group of non-zero input pixel values that multiply respective non-zero input pixel values in the FIR filter; multiplying the group of input pixel values by the identified coefficients to form N products; calculating a value of the initial output pixel position as a sum of the N products, whereby the number of multiply operations in the filter is reduced to N rather than N*L; and repeating the selecting, identifying, multiplying, and calculating steps for subsequent output pixel positions so as to form a series of scaled output pixel values responsive to the series of input pixel values; wherein identifying a set of FIR filter coefficients includes calculating a FIR phase and using the FIR phase to select one of a plurality of predetermined sets of coefficients.
Claim 46
Dependent Claim
44 words
A method for rationally scaling a digital image according to claim 38 wherein identifying a set of FIR filter coefficients includes storing the FIR coefficients in a memory and addressing the memory using the calculated FIR phase to access the selected set of coefficients.
Claim 47
Dependent Claim
76 words
A method for rationally scaling a digital image according to claim 38 wherein calculating the FIR phase includes: defining a coefficient array as h(i) for i=0 to L*N−1; determining an integer output position by truncating a current output position plus 0.5; determining an integer input pixel start position by truncating the integer output position plus L minus one divided by L; and calculating the FIR phase as the input pixel start position*L minus the output position.
Claim 48
Dependent Claim
49 words
A method for rationally scaling a digital image according to claim 38 comprising normalizing each set of coefficients so that a sum of the coefficients for each set is equal to a predetermined constant whereby the FIR filter response to a constant input pixel value is a constant output.
Claim 49
Dependent Claim
23 words
A method for rationally scaling a digital image according to claim 38 including scaling the digital image to produce a scaled output image.
Claim 50
Dependent Claim
55 words
A method for rationally scaling a digital image according to claim 42 wherein scaling the digital image includes applying a keystone effect to the digital image by maintaining the down sample factor M constant within a line of the digital image and linearly varying the down sample factor M on a line by line basis.
Claim 51
Dependent Claim
51 words
A method for rationally scaling a digital image according to claim 42 wherein scaling the digital image includes converting an aspect ratio of the digital image to an aspect ratio of the output image, the aspect ratio of the digital image being different than the aspect ratio of the output image.
Claim 52
Dependent Claim
34 words
A method for rationally scaling a digital image according to claim 44 wherein converting the aspect ratio includes varying the down sample factor M of the digital image on a pixel by pixel basis.
References Cited (Backward Citations)
US4020332A
Cited
US4344149A
Cited
US4682301A
Cited
US4612625A
Cited
US5285192A
Cited
US5089893A
Cited
US5351087A
Cited
US5355328A
Cited
US5809182A
Cited
US5650955A
Cited
US5703806A
Cited
US5574572A
Cited
US6125155A
Cited
US5805233A
Cited
US5767916A
Cited
US5790096A
Cited
US5892694A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2005-01-14 | 2005-07-16 | 2006-01-15 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2009-01-14 | 2009-07-16 | 2010-01-15 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2013-01-14 | 2013-07-16 | 2014-01-15 | $7700.00 | Window Closed / Lapsed |