Patent US6704041B2 successfully refreshed from Google Patents.
US6704041B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Image processing method, apparatus and memory medium therefor
Assignee: Canon Inc
•
Filing: 1999-03-09
•
Granted: 2004-03-09
•
Expires: 2019-03-09
Abstract
Abstract There is provided an image combining apparatus comprising an image input unit for entering photographed images, an image memory for temporarily storing the entered images, a corresponding point extracting unit for extracting the corresponding point information between the images stored in the image memory, a photographing method discriminating unit for discriminating the photographing method at the photographing operation based on the extracted corresponding point information, a combination process unit for appropriately combining the images according to the discriminated photographing method, and a combined image memory for storing the combined image. The corresponding point extraction unit extracts the corresponding points between two images, and the photographing method discrimination unit discriminates whether the translational photographing method or the panning photographing method is used. The combination process unit executes combination of the images, based on the discriminated photographing method. The invention also provides an image processing method capable of automatically selecting the image combining method, solely from the images.
Inventors
- 👤 Tatsushi Katayama
- 👤 Hideo Takiguchi
- 👤 Kotaro Yano
- 👤 Kenji Hatori
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 17:26
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/40; G06T3/4038; H; H04; H04N; H04N23/00; H04N23/60; H04N23/698; H04N5/00; H04N5/222; H04N5/262; H04N5/2628
Claims Analysis
Total Claims: 38
Claim 1
Independent Claim
80 words
An image processing method comprising: an input step, of entering plural images; and a selection step, of selecting one of plural image combining methods including different respective mapping conversion surfaces, utilizing a relationship between the plural images, wherein said selection step includes an evaluation step, of evaluating image combination results based on the plural image combining methods, respectively, and said selection step includes selecting at least one of the plural image combining methods according to the result of the evaluation.
Claim 2
Dependent Claim
80 words
An image processing method comprising: an input step, of entering plural images; and a selection step, of selecting one of plural image combining methods including different respective mapping conversion surfaces, utilizing a relationship between the plural images, wherein said selection step includes an evaluation step, of evaluating image combination results based on the plural image combining methods, respectively, and said selection step includes selecting at least one of the plural image combining methods according to the result of the evaluation.
Claim 3
Dependent Claim
26 words
An image processing method according to claim 1 , further comprising: an extraction step, of extracting corresponding points on an overlapping area of the plural images.
Claim 4
Dependent Claim
49 words
An image processing method according to claim 2 , wherein said evaluation step includes calculating a combination error generated in case of image combination based on the corresponding points and wherein said selection step includes evaluating the image combining method by comparing the combination error with a predetermined value.
Claim 5
Dependent Claim
55 words
An image processing method according to claim 2 , wherein said evaluation step includes calculating combination errors generated in case of image combinations respectively by at least two image combining methods based on the corresponding points and wherein said selection step includes evaluating the image combining method by comparing the magnitude of the combination errors.
Claim 6
Dependent Claim
70 words
An image processing method according to claim 1 , wherein the plural image combining methods at least include those corresponding to a translation photographing method, in which images are taken with a change in the photographing position but without a change in the photographing direction, and a panning photographing method, in which images are taken with a change in the photographing direction but with a change in the photographing position.
Claim 7
Dependent Claim
49 words
An image processing method according to claim 5 , wherein the image combining method corresponding to the panning photographing method utilizes images obtained by coordinate conversion from the plural images onto a virtual cylindrical plane or a virtual spherical plane having a radius equal to the photographing focal length.
Claim 8
Dependent Claim
64 words
An image processing method according to claim 5 , wherein the image combining method corresponding to the panning photographing method includes a correction step, in which in a case of generating a 360° panoramic image, is corrected the image aberration generated in the 360° panoramic image generated by combining the both ends of the combined image, by distorting the entity of the combined image.
Claim 9
Dependent Claim
22 words
An image processing method according to claim 1 , wherein said selection step includes selecting whether or not to perform mapping conversion.
Claim 10
Dependent Claim
37 words
An image processing method according to claim 1 , wherein the different mapping conversion methods include at least projection conversion including mapping onto a virtual plane, find cylindrical mapping conversion including mapping onto a virtual cylindrical plane.
Claim 11
Dependent Claim
93 words
A recording medium storing a computer readable program for causing a computer to execute a process, said program comprising: code for an input step, of entering plural images; code for a selection step, of selecting one of plural image combining methods including different respective mapping conversion surfaces, utilizing a relationship between the plural images; and code for an evaluation step, of evaluating image combination results based on at least one of the plural image combining methods, wherein said selection step includes selecting the image combining method according to the result of the evaluation.
Claim 12
Dependent Claim
93 words
A recording medium storing a computer readable program for causing a computer to execute a process, said program comprising: code for an input step, of entering plural images; code for a selection step, of selecting one of plural image combining methods including different respective mapping conversion surfaces, utilizing a relationship between the plural images; and code for an evaluation step, of evaluating image combination results based on at least one of the plural image combining methods, wherein said selection step includes selecting the image combining method according to the result of the evaluation.
Claim 13
Dependent Claim
30 words
A recording medium according to claim 10 , wherein said program further comprises code for an extraction step, of extracting corresponding points on an overlapping area of the plural images.
Claim 14
Dependent Claim
48 words
A recording medium according to claim 11 , wherein said evaluation step includes calculating a combination error generated in case of image combination based on the corresponding points and wherein said selection step includes evaluating the image combining method by comparing the combination error with a predetermined value.
Claim 15
Dependent Claim
54 words
A recording medium according to claim 11 , wherein said evaluation step includes calculating combination errors generated in case of image combinations respectively by at least two image combining methods based on the corresponding points and wherein said selection step includes evaluating the image combining method by comparing the magnitude of the combination errors.
Claim 16
Dependent Claim
69 words
A recording medium according to claim 10 , wherein the plural image combining methods at least include those corresponding to a translation photographing method, in which images are taken with a change in the photographing position but without a change in the photographing direction, and a panning photographing method, in which images are taken with a change in the photographing direction but with a change in the photographing position.
Claim 17
Dependent Claim
48 words
A recording medium according to claim 14 , wherein the image combining method corresponding to the panning photographing method utilizes images obtained by coordinate conversion from the plural images onto a virtual cylindrical plane or a virtual spherical plane having a radius equal to the photographing focal length.
Claim 18
Dependent Claim
62 words
A recording medium according to claim 14 , wherein the image combining method corresponding to the panning photographing method includes a correction step, in which a case of generating a 360° panoramic image, is corrected the image aberration generated in the 360° panoramic image generated by combining the both ends of the combined image, by distorting the entity of the combined image.
Claim 19
Dependent Claim
21 words
A recording medium according to claim 10 , wherein said selection step includes selecting whether or not to perform mapping conversion.
Claim 20
Dependent Claim
36 words
A recording medium according to claim 10 , wherein the different mapping conversion methods include at least projection conversion including mapping onto a virtual plane, and cylindrical mapping conversion including mapping onto a virtual cylindrical plane.
Claim 21
Dependent Claim
69 words
An image processing apparatus comprising: input means for entering plural images; selection means for selecting one of plural image combining methods including different respective mapping conversion surfaces, utilizing a relationship between the plural images; and evaluation means for evaluating image combination results based on at least one of the plural image combining methods, wherein said selection means selects the image combining method according to the result of the evaluation.
Claim 22
Dependent Claim
69 words
An image processing apparatus comprising: input means for entering plural images; selection means for selecting one of plural image combining methods including different respective mapping conversion surfaces, utilizing a relationship between the plural images; and evaluation means for evaluating image combination results based on at least one of the plural image combining methods, wherein said selection means selects the image combining method according to the result of the evaluation.
Claim 23
Dependent Claim
25 words
An image processing apparatus according to claim 19 , further comprising: extraction means for extracting corresponding points on an overlapping area of the plural images.
Claim 24
Dependent Claim
53 words
An image processing apparatus according to claim 20 , wherein said evaluation means is adapted to calculate a combination error generated in case of image combination based on the corresponding points and wherein said selection means is adapted to evaluate the image combining method by comparing the combination error with a predetermined value.
Claim 25
Dependent Claim
59 words
An image processing apparatus according to claim 20 , wherein said evaluation means is adapted to calculate combination errors generated in case of image combinations respectively by at least two image combining methods based on the corresponding points and wherein said selection means is adapted to evaluate the image combining method by comparing the magnitude of the combination errors.
Claim 26
Dependent Claim
70 words
An image processing apparatus according to claim 19 , wherein the plural image combining methods at least include those corresponding to a translation photographing method, in which images are taken with a change in the photographing position but without a change in the photographing direction, and a panning photographing method, in which images are taken with a change in the photographing direction but with a change in the photographing position.
Claim 27
Dependent Claim
49 words
An image processing apparatus according to claim 23 , wherein the image combining method corresponding to the panning photographing method utilizes images obtained by coordinate conversion from the plural images onto a virtual cylindrical plane or a virtual spherical plane having a radius equal to the photographing focal length.
Claim 28
Dependent Claim
61 words
An image processing apparatus according to claim 23 , wherein the image combining method corresponding to the panning photographing method includes correction means adapted, in case of generating a 360° panoramic image, to correct the image aberration generated in the 360° panoramic image generated by combining the both ends of the combined image, by distorting the entity of the combined image.
Claim 29
Dependent Claim
21 words
An image processing apparatus according to claim 19 , wherein said selection means selects whether or not to perform mapping conversion.
Claim 30
Dependent Claim
37 words
An image processing apparatus according to claim 19 , wherein the different mapping conversion methods include at least projection conversion including mapping onto a virtual plane, and cylindrical mapping conversion including mapping onto a virtual cylindrical plane.
Claim 31
Dependent Claim
90 words
An image processing method comprising: an input step, of entering plural images; an extraction step, of extracting corresponding points in an overlapping area of the plural images; a selection step, of selecting one of a plurality of image combining method including different respective mapping conversion surfaces, on the basis of the corresponding points; and an evaluation step, of evaluating image combination results based on at least one of the plural image combining methods, wherein said selection step includes selecting the image combining method according to the result of the evaluation.
Claim 32
Dependent Claim
90 words
An image processing method comprising: an input step, of entering plural images; an extraction step, of extracting corresponding points in an overlapping area of the plural images; a selection step, of selecting one of a plurality of image combining method including different respective mapping conversion surfaces, on the basis of the corresponding points; and an evaluation step, of evaluating image combination results based on at least one of the plural image combining methods, wherein said selection step includes selecting the image combining method according to the result of the evaluation.
Claim 33
Dependent Claim
70 words
An image processing method according to claim 28 , wherein the plural image combining methods at least include those corresponding to a translation photographing method in which images are taken with a change in the photographing position but without a change in the photographing direction, and a panning photographing method in which images are taken with a change in the photographing direction but with a change in the photographing position.
Claim 34
Dependent Claim
24 words
An image processing method according to claim 28 , wherein said evaluation step includes evaluating based on cylindrical mapping conversion or spherical mapping conversion.
Claim 35
Dependent Claim
22 words
An image processing method according to claim 28 , wherein the image combining method utilizes an affine conversion or a projection conversion.
Claim 36
Dependent Claim
54 words
An image processing method according to claim 28 , further comprising a correction step, in which in a case of generating a 360° panoramic image, is corrected the image aberration generated in the 360° panoramic image generated by combining the both ends of the combined image, by distorting the entity of the combined image.
Claim 37
Dependent Claim
22 words
An image processing method according to claim 28 , wherein said selection step includes selecting whether or not to perform mapping conversion.
Claim 38
Dependent Claim
37 words
An image processing method according to claim 28 , wherein the different mapping conversion methods include at least projection conversion including mapping onto a virtual plane, and cylindrical mapping conversion including mapping onto a virtual cylindrical plane.
References Cited (Backward Citations)
US6204881B1
Cited
US5646679A
Cited
US5649032A
Cited
US6111667A
Cited
US5937081A
Cited
US6243103B1
Cited
US6282330B1
Cited
US6097854A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-03-09 | 2007-09-08 | 2008-03-09 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-03-09 | 2011-09-08 | 2012-03-09 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-03-09 | 2015-09-08 | 2016-03-09 | $7700.00 | Window Closed / Lapsed |