Patent US6804419B1 successfully refreshed from Google Patents.
← Back to Patent Explorer
US6804419B1 Expired / Lapsed US ⏱️ 0.0 years remaining

Image processing method and apparatus

Assignee: Canon Inc
•
Filing: 1999-11-08
•
Granted: 2004-10-12
•
Expires: 2019-11-08
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract There is disclosed a method for obtaining one high-resolution image from a plurality of low-resolution images having predetermined resolutions, comprising steps of detecting relative positions among the plurality of low-resolution images with a resolution less than a pixel pitch in the predetermined resolutions, and forming a new image having a high resolution as compared with the predetermined resolutions using the plurality of images in accordance with information indicating the relative positions, so that the high-resolution image is obtained without any disorder. Moreover, there is disclosed a method for detecting motion vectors among a plurality of frames with a higher resolution, comprising steps of using orthogonal transform coefficients of images in the plurality of frames in motion images to detect the motion vectors among the plurality of frames with the resolution less than the pixel pitch in the predetermined resolutions.

Inventors

  • 👤 Nobutaka Miyake

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 11:50
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/40; G06T3/4053; G06T3/4069

Claims Analysis

Total Claims: 34
Claim 1
Independent Claim 102 words
An image processing method, comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) forming a new image having a high resolution as compared with the predetermined resolutions by shifting and synthesizing an interpolation image, obtained from other images, with respect to a reference image as one of the plurality of images with a resolution less than a pixel pitch in the predetermined resolutions; and (c) detecting relative positions among the plurality of images, wherein a shift amount of the remaining images with respect to the reference image is determined in accordance with the relative position.
Claim 2
Dependent Claim 102 words
An image processing method, comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) forming a new image having a high resolution as compared with the predetermined resolutions by shifting and synthesizing an interpolation image, obtained from other images, with respect to a reference image as one of the plurality of images with a resolution less than a pixel pitch in the predetermined resolutions; and (c) detecting relative positions among the plurality of images, wherein a shift amount of the remaining images with respect to the reference image is determined in accordance with the relative position.
Claim 3
Dependent Claim 21 words
A method according to claim 1 , wherein the relative position is detected as a motion vector in said detecting step.
Claim 4
Dependent Claim 88 words
A method according to claim 2 , wherein said detecting step comprises the steps of: detecting a first motion vector between two frames of images apart from each other by at least two frames or more with the resolution corresponding to the pixel pitch in said predetermined resolutions; and dividing the first motion vector by the number of said frames apart from each other to obtain a second motion vector having the resolution less than the pixel pitch in said predetermined resolutions, and outputting the second motion vector.
Claim 5
Dependent Claim 43 words
A method according to claim 3 , wherein in said detecting step, the number of frames between the two frames which are objects for detecting said first motion vector can be switched in accordance with a size of said detected first motion vector.
Claim 6
Dependent Claim 33 words
A method according to claim 2 , wherein said detecting step comprises the step of detecting said motion vector using an orthogonal transform coefficient obtained by orthogonally transforming said two frames of images.
Claim 7
Dependent Claim 51 words
A method according to claim 5 , wherein said detecting step further comprises the steps of: performing template matching between said two frames of images to roughly detect said motion vector; and finely detecting said motion vector using the rough detection result and the orthogonal transform coefficient of said two frames.
Claim 8
Dependent Claim 31 words
A method according to claim 1 , wherein said reference image is selected from the plurality of images in accordance with edge strengths of the images in the plurality of images.
Claim 9
Dependent Claim 140 words
An image processing method, comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) detecting relative positions among the plurality of images with a resolution less than a pixel pitch in the predetermined resolutions; and (c) forming a new image having a high resolution as compared with the predetermined resolutions using said plurality of images in accordance with information indicating the relative positions obtained in the detecting step, wherein said forming step comprises the steps of: synthesizing an interpolation image, formed using other images, with respect to a reference image as one of the plurality of images to prepare the new image; and the interpolation image is obtained by synthesizing an orthogonal transform coefficient obtained from the reference image and orthogonal transform coefficients obtained from said other images in accordance with the relative positions.
Claim 10
Dependent Claim 140 words
An image processing method, comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) detecting relative positions among the plurality of images with a resolution less than a pixel pitch in the predetermined resolutions; and (c) forming a new image having a high resolution as compared with the predetermined resolutions using said plurality of images in accordance with information indicating the relative positions obtained in the detecting step, wherein said forming step comprises the steps of: synthesizing an interpolation image, formed using other images, with respect to a reference image as one of the plurality of images to prepare the new image; and the interpolation image is obtained by synthesizing an orthogonal transform coefficient obtained from the reference image and orthogonal transform coefficients obtained from said other images in accordance with the relative positions.
Claim 11
Dependent Claim 29 words
A method according to claim 8 , wherein said reference image is selected from said plurality of images in accordance with image edge strengths in said plurality of images.
Claim 12
Dependent Claim 29 words
A method according to claim 8 , wherein said reference image is selected from said plurality of images in accordance with an input order of said plurality of images.
Claim 13
Dependent Claim 108 words
An image processing method, comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) forming an interpolation image from the plurality of images; (c) forming a new image having a high resolution as compared with said predetermined resolutions by shifting and synthesizing the interpolation image with respect to a reference image as one of said plurality of images with a resolution less than a pixel pitch in said predetermined resolutions; and (d) detecting relative positions among the plurality of images, wherein a shift amount of said interpolation image with respect to said reference image is determined in accordance with the relative positions.
Claim 14
Dependent Claim 108 words
An image processing method, comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) forming an interpolation image from the plurality of images; (c) forming a new image having a high resolution as compared with said predetermined resolutions by shifting and synthesizing the interpolation image with respect to a reference image as one of said plurality of images with a resolution less than a pixel pitch in said predetermined resolutions; and (d) detecting relative positions among the plurality of images, wherein a shift amount of said interpolation image with respect to said reference image is determined in accordance with the relative positions.
Claim 15
Dependent Claim 31 words
A method according to claim 11 , wherein said step of forming the interpolation image comprises synthesizing orthogonal transform coefficients obtained from said plurality of images to obtain said interpolation image.
Claim 16
Dependent Claim 29 words
A method according to claim 12 , wherein the synthesizing of said orthogonal transform coefficients is performed with a ratio for a frequency area of each orthogonal transform coefficient.
Claim 17
Dependent Claim 40 words
A method according to claim 13 , wherein the synthesizing of said orthogonal transform coefficients is performed by selecting the orthogonal transform coefficients obtained from said plurality of images in accordance with the frequency area of each orthogonal transform coefficient.
Claim 18
Dependent Claim 108 words
An image processing apparatus, comprising: (a) input means for inputting a plurality of mutually different images having predetermined resolutions; (b) forming means for forming a new image having a high resolution as compared with the predetermined resolutions by shifting and synthesizing an interpolation image, obtained from other images, with respect to a reference image as one of the plurality of images with a resolution less than a pixel pitch in the predetermined resolutions; and (c) detecting means for detecting relative positions among the plurality of images, wherein a shift amount of the remaining images with respect to the reference image is determined in accordance with the relative position.
Claim 19
Dependent Claim 108 words
An image processing apparatus, comprising: (a) input means for inputting a plurality of mutually different images having predetermined resolutions; (b) forming means for forming a new image having a high resolution as compared with the predetermined resolutions by shifting and synthesizing an interpolation image, obtained from other images, with respect to a reference image as one of the plurality of images with a resolution less than a pixel pitch in the predetermined resolutions; and (c) detecting means for detecting relative positions among the plurality of images, wherein a shift amount of the remaining images with respect to the reference image is determined in accordance with the relative position.
Claim 20
Dependent Claim 27 words
An apparatus according to claim 15 , wherein said detecting means detects said motion vector using orthogonal transform coefficients obtained by orthogonally transforming two frames of images.
Claim 21
Dependent Claim 142 words
An image processing apparatus, comprising: (a) input means for inputting a plurality of mutually different images having predetermined resolutions; (b) detecting means for detecting relative positions among the plurality of images with a resolution less than a pixel pitch in the predetermined resolutions; and (c) forming means for forming a new image having a high resolution as compared with the predetermined resolutions using said plurality of images in accordance with information indicating the relative positions obtained by the detecting means, wherein said forming means synthesizes an interpolation image formed using other images with respect to a reference image as one of the plurality of images to prepare the new image, and the interpolation image is obtained by synthesizing an orthogonal transform coefficient obtained from the reference image and orthogonal transform coefficients obtained from said other images in accordance with the relative positions.
Claim 22
Dependent Claim 142 words
An image processing apparatus, comprising: (a) input means for inputting a plurality of mutually different images having predetermined resolutions; (b) detecting means for detecting relative positions among the plurality of images with a resolution less than a pixel pitch in the predetermined resolutions; and (c) forming means for forming a new image having a high resolution as compared with the predetermined resolutions using said plurality of images in accordance with information indicating the relative positions obtained by the detecting means, wherein said forming means synthesizes an interpolation image formed using other images with respect to a reference image as one of the plurality of images to prepare the new image, and the interpolation image is obtained by synthesizing an orthogonal transform coefficient obtained from the reference image and orthogonal transform coefficients obtained from said other images in accordance with the relative positions.
Claim 23
Dependent Claim 122 words
An image processing apparatus, comprising: (a) inputting means for inputting a plurality of mutually different images having predetermined resolutions; (b) first forming means for forming an interpolation image from the plurality of images; (c) second forming means for forming a new image having a high resolution as compared with said predetermined resolutions, by shifting and synthesizing the interpolation image with respect to a reference image as one of said plurality of images with a resolution less than a pixel pitch in said predetermined resolutions; and (d) detecting means for detecting relative positions among the plurality of images, wherein said second forming means determines a shift amount of said interpolation image with respect to said reference image in accordance with the relative positions.
Claim 24
Dependent Claim 122 words
An image processing apparatus, comprising: (a) inputting means for inputting a plurality of mutually different images having predetermined resolutions; (b) first forming means for forming an interpolation image from the plurality of images; (c) second forming means for forming a new image having a high resolution as compared with said predetermined resolutions, by shifting and synthesizing the interpolation image with respect to a reference image as one of said plurality of images with a resolution less than a pixel pitch in said predetermined resolutions; and (d) detecting means for detecting relative positions among the plurality of images, wherein said second forming means determines a shift amount of said interpolation image with respect to said reference image in accordance with the relative positions.
Claim 25
Dependent Claim 27 words
An apparatus according to claim 18 , wherein said first forming means synthesizes orthogonal transform coefficients obtained from said plurality of images to obtain said interpolation image.
Claim 26
Dependent Claim 115 words
A recording medium readable by a computer which stores a program for performing an image processing process comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) forming a new image having a high resolution as compared with the predetermined resolutions by shifting and synthesizing an interpolation image, obtained from other images, with respect to a reference image as one of the plurality of images with a resolution less than a pixel pitch in the predetermined resolutions; and (c) detecting relative positions among the plurality of images, wherein a shift amount of the remaining images with respect to the reference image is determined in accordance with the relative position.
Claim 27
Dependent Claim 115 words
A recording medium readable by a computer which stores a program for performing an image processing process comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) forming a new image having a high resolution as compared with the predetermined resolutions by shifting and synthesizing an interpolation image, obtained from other images, with respect to a reference image as one of the plurality of images with a resolution less than a pixel pitch in the predetermined resolutions; and (c) detecting relative positions among the plurality of images, wherein a shift amount of the remaining images with respect to the reference image is determined in accordance with the relative position.
Claim 28
Dependent Claim 121 words
A recording medium readable by a computer which stores a program for performing an image processing process comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) forming an interpolation image from the plurality of images; (c) forming a new image having a high resolution as compared with said predetermined resolutions by shifting and synthesizing the interpolation image with respect to a reference image as one of said plurality of images with a resolution less than a pixel pitch in said predetermined resolutions; and (d) detecting relative positions among the plurality of images, wherein a shift amount of said interpolation image with respect to said reference image is determined in accordance with the relative positions.
Claim 29
Dependent Claim 121 words
A recording medium readable by a computer which stores a program for performing an image processing process comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) forming an interpolation image from the plurality of images; (c) forming a new image having a high resolution as compared with said predetermined resolutions by shifting and synthesizing the interpolation image with respect to a reference image as one of said plurality of images with a resolution less than a pixel pitch in said predetermined resolutions; and (d) detecting relative positions among the plurality of images, wherein a shift amount of said interpolation image with respect to said reference image is determined in accordance with the relative positions.
Claim 30
Dependent Claim 107 words
A program product for performing an image processing process comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) forming a new image having a high resolution as compared with the predetermined resolutions by shifting and synthesizing an interpolation image, obtained from other images, with respect to a reference image as one of the plurality of images with a resolution less than a pixel pitch in the predetermined resolutions; and (c) detecting relative positions among the plurality of images, wherein a shift amount of the remaining images with respect to the reference image is determined in accordance with the relative position.
Claim 31
Dependent Claim 107 words
A program product for performing an image processing process comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) forming a new image having a high resolution as compared with the predetermined resolutions by shifting and synthesizing an interpolation image, obtained from other images, with respect to a reference image as one of the plurality of images with a resolution less than a pixel pitch in the predetermined resolutions; and (c) detecting relative positions among the plurality of images, wherein a shift amount of the remaining images with respect to the reference image is determined in accordance with the relative position.
Claim 32
Dependent Claim 113 words
A program product for performing an image processing process comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) forming an interpolation image from the plurality of images; (c) forming a new image having a high resolution as compared with said predetermined resolutions, by shifting and synthesizing the interpolation image with respect to a reference image as one of said plurality of images with a resolution less than a pixel pitch in said predetermined resolutions; and (d) detecting relative positions among the plurality of images, wherein a shift amount of said interpolation image with respect to said reference image is determined in accordance with the relative positions.
Claim 33
Dependent Claim 113 words
A program product for performing an image processing process comprising the steps of: (a) inputting a plurality of mutually different images having predetermined resolutions; (b) forming an interpolation image from the plurality of images; (c) forming a new image having a high resolution as compared with said predetermined resolutions, by shifting and synthesizing the interpolation image with respect to a reference image as one of said plurality of images with a resolution less than a pixel pitch in said predetermined resolutions; and (d) detecting relative positions among the plurality of images, wherein a shift amount of said interpolation image with respect to said reference image is determined in accordance with the relative positions.
Claim 34
Dependent Claim 29 words
A method according to claim 1 , wherein said reference image is selected from said plurality of images in accordance with an input order of said plurality of images.

References Cited (Backward Citations)

US5822462A Cited
JPH05260264A Cited
US5696848A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2007-10-12 2008-04-12 2008-10-12 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2011-10-12 2012-04-12 2012-10-12 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2015-10-12 2016-04-12 2016-10-12 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag