Patent US5602584A successfully refreshed from Google Patents.
US5602584A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Apparatus for producing a panoramic image using a plurality of optical systems
Assignee: Canon Inc
•
Filing: 1995-09-27
•
Granted: 1997-02-11
•
Expires: 2015-09-27
Abstract
Abstract It is disclosed that in order to form an image of which the continuity is not lost from the image information of an area in which a double image exists and the vicinity thereof and prevent the deterioration of the image, an image processing portion to which video signals from left and right image taking systems are input has an image input portion, an image conversion portion and a synthesized image memory. The image conversion portion has a corresponding point sampling unit for sampling pairs of corresponding points corresponding to the same portion of an object from the video signals, a double image area-dividing unit for effecting the area division of a double image on the basis of the information of the three-dimensional positions of the sampled pairs of corresponding points, a double image mode-discriminating judging unit for determining an image of greater probability with which each double image is connected to a double image non-generating area, and an either image of two systems and common images of two ones simultaneous-removal unit which uses as synthesized image forming data the image determined to be more probably connected to the double image non-generating area by the double image mode-discriminating judging unit, and removes the other image.
Inventors
- 👤 Hideaki Mitsutake
- 👤 Jun Tokumitsu
- 👤 Shigeyuki Suda
- 👤 Tatsushi Katayama
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 12:40
CPC Classifications
G; G06; G06T; G06T1/00; G06T1/0007; H; H04; H04N; H04N13/00; H04N13/20; H04N13/204; H04N13/239; H04N13/296; H04N13/30; H04N13/398; H04N2013/0074; H04N2013/0081; H04N2013/0088
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
259 words
A double-eye image pickup apparatus comprising: a plurality of imaging optical systems; a plurality of image pickup elements, wherein one of said plurality of image pickup elements changes an objective image formed by one of said plurality of imaging optical systems to an image signal and another one of said plurality of image pickup elements changes another objective image formed by another one of said plurality of imaging optical systems to another image signal; and an image processing means for generating a combined image by using image signals from said plurality of image pickup elements, wherein said image processing means executes the following steps of: (a) extracting a plurality of pairs of corresponding points in said objective image and said another objective image, (b) obtaining information as to a distance from each corresponding point of said pairs of corresponding points to a point on an object located in each image signal, (c) separating said pairs of corresponding points into at least two regions on the basis of said information as to the distance to the point from each of said corresponding points, and (d) regarding pairs of corresponding points in a region, using image data indicated by some of said corresponding points of said pairs of corresponding points for generation of a combined image and not using an image data indicated by other corresponding points of said pairs of corresponding points for generation of said combined image, a predetermined after-processing being applied to pixel portions of the image data which are not used for generation of said combined image.
Claim 2
Dependent Claim
259 words
A double-eye image pickup apparatus comprising: a plurality of imaging optical systems; a plurality of image pickup elements, wherein one of said plurality of image pickup elements changes an objective image formed by one of said plurality of imaging optical systems to an image signal and another one of said plurality of image pickup elements changes another objective image formed by another one of said plurality of imaging optical systems to another image signal; and an image processing means for generating a combined image by using image signals from said plurality of image pickup elements, wherein said image processing means executes the following steps of: (a) extracting a plurality of pairs of corresponding points in said objective image and said another objective image, (b) obtaining information as to a distance from each corresponding point of said pairs of corresponding points to a point on an object located in each image signal, (c) separating said pairs of corresponding points into at least two regions on the basis of said information as to the distance to the point from each of said corresponding points, and (d) regarding pairs of corresponding points in a region, using image data indicated by some of said corresponding points of said pairs of corresponding points for generation of a combined image and not using an image data indicated by other corresponding points of said pairs of corresponding points for generation of said combined image, a predetermined after-processing being applied to pixel portions of the image data which are not used for generation of said combined image.
Claim 3
Dependent Claim
26 words
A double-eye image pickup apparatus according to claim 1, wherein said combined image includes a panoramic synthesized image comprising said image signals juxtaposed and combined together.
Claim 4
Dependent Claim
74 words
A double-eye image pickup apparatus according to claim 2, wherein said image processing means, with regard to any pair of corresponding points of said pairs of corresponding points which belongs to an image connected to a double-image non-generating area image-picked up only by one image pickup element, uses as said combined image forming data the corresponding point of said pair of corresponding points which is most probably connected to said double image non-generating area.
Claim 5
Dependent Claim
66 words
A double-eye image pickup apparatus according to claim 2, wherein said image processing means, with regard to any pair of corresponding points of said pairs of corresponding points of which the distances from a double image non-generating area image-picked up only by one image pickup element differ, uses as said combined image forming data the corresponding point which is nearest to said double image non-generating area.
Claim 6
Dependent Claim
106 words
A double-eye image pickup apparatus according to claim 2, wherein said image processing means, with regard to any pair of corresponding points of said pairs of corresponding points which belongs to an image connected to a double image non-generating area image-picked up only by one image pickup element, uses the a corresponding point in said image as said combined image forming data, and with regard to a corresponding point belonging to another image connected to another double image non-generating area, moves the corresponding point in one of said images in the direction of juxtaposition of said images and uses it as said combined image forming data.
Claim 7
Dependent Claim
24 words
A double-eye image pickup apparatus according to claim 1, wherein said combined image is a highly minute image comprising said image signals combined together.
Claim 8
Dependent Claim
58 words
A double-eye image pickup apparatus according to claim 6, wherein said image processing means, with regard to a pair of corresponding points of said pairs of corresponding points in which the spacing between the corresponding points is smaller than a predetermined spacing, uses one corresponding point of said pair of corresponding points as said combined image forming data.
Claim 9
Dependent Claim
50 words
A double-eye image pickup apparatus according to claim 6, wherein said image processing means, with regard to at least some of said pairs of corresponding points which require a correction of distortion before the extraction of said corresponding points, uses one of said corresponding points as combined image forming data.
Claim 10
Dependent Claim
83 words
A double-eye image pickup apparatus according to claim 6, wherein said image processing means, with regard to at least some of said extracted pairs of corresponding points in which a degree of blur of image foreseen from the distance from an in-focus object plane of each of said image pickup elements and a numerical aperture of each of said imaging optical systems exceeds a predetermined threshold value, uses one corresponding point of said pairs of corresponding points as said combined image forming data.
Claim 11
Dependent Claim
74 words
A double-eye image pickup apparatus according to claim 6, wherein said image processing means, with regard to at least some of said pairs of corresponding points which appear at a predetermined spatial frequency or higher alternately with a pixel point in which corresponding points forming said pair are not found, after said pairs of corresponding points are sampled, uses one corresponding point of said pairs of corresponding points as said combined image forming data.
Claim 12
Dependent Claim
249 words
A double-eye image pickup apparatus comprising: a plurality of imaging optical systems; a plurality of image pickup elements, wherein one of said plurality of image pickup elements changes an objective image formed by one of said plurality of imaging optical systems to an image signal and another one of said plurality of image pickup elements changes another objective image formed by another one of said plurality of imaging optical systems to another image signal; an image processing means for generating a combined image by using the image signals from said plurality of image pickup elements, wherein said image processing means executes the following steps of: (a) defining an image indicated by one of said image signals as a base image and an image indicated by said other image signal as a supplemental image, (b) sampling a plurality of pairs of corresponding points in said base image and said supplemental image, (c) obtaining predetermined information as to each pair of corresponding points, and (d) from among said pairs of corresponding points on the basis of said predetermined information, using either image data indicated by said corresponding points at a side of said base image for generation of a combined image or image data indicated by said corresponding points at a side of said supplemental image for generation of said combined image, a predetermined after-processing being applied to pixel portions of the image data at said side of said supplemental image which are not used for generation of said combined image.
Claim 13
Dependent Claim
249 words
A double-eye image pickup apparatus comprising: a plurality of imaging optical systems; a plurality of image pickup elements, wherein one of said plurality of image pickup elements changes an objective image formed by one of said plurality of imaging optical systems to an image signal and another one of said plurality of image pickup elements changes another objective image formed by another one of said plurality of imaging optical systems to another image signal; an image processing means for generating a combined image by using the image signals from said plurality of image pickup elements, wherein said image processing means executes the following steps of: (a) defining an image indicated by one of said image signals as a base image and an image indicated by said other image signal as a supplemental image, (b) sampling a plurality of pairs of corresponding points in said base image and said supplemental image, (c) obtaining predetermined information as to each pair of corresponding points, and (d) from among said pairs of corresponding points on the basis of said predetermined information, using either image data indicated by said corresponding points at a side of said base image for generation of a combined image or image data indicated by said corresponding points at a side of said supplemental image for generation of said combined image, a predetermined after-processing being applied to pixel portions of the image data at said side of said supplemental image which are not used for generation of said combined image.
Claim 14
Dependent Claim
36 words
A double-eye image pickup apparatus according to claim 11, wherein said image pickup element outputting the image signal which provides said base image has an optical axis of its imaging optical system disposed toward said object.
Claim 15
Dependent Claim
84 words
An double-eye image pickup apparatus according to claim 11, wherein said combined image is a panoramic combined image comprising said image signals juxtaposed and combined together, and said image processing means, with regard to any pair of corresponding points of said pairs of corresponding points which belongs to an image connected to a double image non-generating area image-picked up only by one image pickup element, uses the image signal which is most probably connected to said double image non-generating area as a base image.
Claim 16
Dependent Claim
92 words
A double-eye image pickup apparatus according to claim 11, wherein said combined image is a highly minute image comprising said image signals combined together, and said image processing means, with regard to any pair of corresponding points of said pairs of corresponding points in which the spacing between the corresponding point in said supplemental image is smaller than a predetermined spacing, uses the corresponding point in said base image as said combined image forming data, and does not use the corresponding point in said supplemental image as said combined image forming data.
Claim 17
Dependent Claim
100 words
A double-eye image pickup apparatus according to claim 12, wherein said combined image is a highly minute image comprising said image signals combined together, and said image processing means, with regard to the pair of corresponding points of said pairs of corresponding points in which the spacing between the corresponding point in said base image and the corresponding point in said supplemental image is smaller than a predetermined spacing, uses the corresponding point in said base image as said combined image forming data, and does not use the corresponding point in said supplemental image as said combined image forming data.
Claim 18
Dependent Claim
85 words
A double-eye image pickup apparatus according to claim 11, wherein said combined image is a highly minute image comprising said image signals combined together, and said image processing means, with regard to at least some of said pairs of corresponding points which require a correction of distortion before the extraction of the corresponding points, uses the corresponding point in said base image as said combined image forming data, and does not use the corresponding point in said supplemental image as said combined image forming data.
Claim 19
Dependent Claim
85 words
A double-eye image pickup apparatus according to claim 12, wherein said combined image is a highly minute image comprising said image signals combined together, and said image processing means, with regard to at least some of said pairs of corresponding points which require a correction of distortion before the extraction of the corresponding points, uses the corresponding point in said base image as said combined image forming data, and does not use the corresponding point in said supplemental image as said combined image forming data.
Claim 20
Dependent Claim
112 words
A double-eye image pickup apparatus according to claim 11, wherein said combined image is a highly minute image comprising said image signals combined together, and said image processing means, with regard to at least some of said pairs of corresponding points in which a degree of blur of image foreseen from a distance from an in-focus object plane of each of said image pickup elements and a numerical aperture of each of said imaging optical systems exceeds a predetermined threshold value, uses the corresponding point in said base image as said combined image forming data, and does not use the corresponding point in said supplemental image as said combined image forming data.
Claim 21
Dependent Claim
113 words
A double-eye image pickup apparatus according to claim 12, wherein said combined image is a highly minute image comprising said image signals combined together, and said image processing means, with regard to at least some of said sampled pairs of corresponding points in which a degree of blur of image foreseen from a distance from an in-focus object plane of each of said image taking systems and a numerical aperture of each of said imaging optical systems exceeds a predetermined threshold value, uses the corresponding point in said base image as said combined image forming data, and does not use the corresponding point in said supplemental image as said combined image forming data.
Claim 22
Dependent Claim
111 words
A double-eye image pickup apparatus according to claim 11, wherein said combined image is a highly minute image comprising said image signals combined together, and said image processing means, with regard to at least some of said sampled pairs of corresponding points which appear at a predetermined spacial frequency or higher alternately with a pixel point in which corresponding points forming a pair are not found and an area in which the corresponding points forming said pair are not found, uses the corresponding point in said reference image as said combined image forming data, and does not use the corresponding points in said supplemental image as said combined image forming data.
Claim 23
Dependent Claim
112 words
An double-eye image pickup apparatus according to claim 12, wherein said combined image is a highly minute image comprising said image signals combined together, and said image processing means, with regard to at least some of said sampled pairs of corresponding points which appear at a predetermined spatial frequency or higher alternately with a pixel point in which corresponding points forming a pair are not found and an area in which the corresponding a points forming said pair are not found, uses the corresponding point in said base image as said combined image forming data, and does not use the corresponding points in said supplemental image as said combined image forming data.
References Cited (Backward Citations)
US4272756A
Cited
US4601053A
Cited
US4825393A
Cited
US4797942A
Cited
US4837616A
Cited
US4819064A
Cited
US5140415A
Cited
JPH05183790A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-02-11 | 2000-08-12 | 2001-02-11 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-02-11 | 2004-08-12 | 2005-02-11 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-02-11 | 2008-08-12 | 2009-02-11 | $7700.00 | Window Closed / Lapsed |