US6243103B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Panoramic image generation in digital photography
Assignee: Canon Inc
•
Filing: 1997-05-28
•
Granted: 2001-06-05
•
Expires: 2017-05-28
Abstract
Abstract An image synthesizing system comprising a digital camera and a personal computer. When a first image is picked up by the camera, the personal computer takes the image sensed by the camera and a reduced image of the picked-up image. While the camera is moving, the camera sequentially sends reduced images to the personal computer, and the personal computer inputs the reduced images. The personal computer determines whether an image which is currently sensed by the camera is suitable for being synthesized into a panoramic image or not on the basis of an overlapping area between the first reduced image and a current reduced image, and a determined result is notified to a user.
Inventors
- 👤 Hideo Takiguchi
- 👤 Kotaro Yano
- 👤 Tatsushi Katayama
- 👤 Kenji Hatori
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 12:00
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/40; G06T3/4038; H; H04; H04N; H04N23/00; H04N23/60; H04N23/698; H04N5/00; H04N5/222; H04N5/262; H04N5/2624
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
140 words
An image sensing apparatus comprising: image pick-up means for sensing an object and obtaining image signals; signal processing means for outputting image signals representing first and second picked-up images of the object sensed at different image view positions in response to a request signal from an image synthesizing device, and confirmation image signals obtained by reducing the first and second picked-up images, to the image synthesizing device; determination means for automatically determining an overlapping state of the confirmation image signals; and displaying means for simultaneously displaying, on a monitor screen, the confirmation image signals corresponding to the first and second images in such a manner that the overlapping state of the first and second images is expressed and an image generated by synthesizing the first and second picked-up images, wherein the second picked-up image is updated at a predetermined interval.
Claim 2
Dependent Claim
140 words
An image sensing apparatus comprising: image pick-up means for sensing an object and obtaining image signals; signal processing means for outputting image signals representing first and second picked-up images of the object sensed at different image view positions in response to a request signal from an image synthesizing device, and confirmation image signals obtained by reducing the first and second picked-up images, to the image synthesizing device; determination means for automatically determining an overlapping state of the confirmation image signals; and displaying means for simultaneously displaying, on a monitor screen, the confirmation image signals corresponding to the first and second images in such a manner that the overlapping state of the first and second images is expressed and an image generated by synthesizing the first and second picked-up images, wherein the second picked-up image is updated at a predetermined interval.
Claim 3
Dependent Claim
143 words
An image synthesizing apparatus comprising: reception means for receiving an image signal representing a picked-up image from an image pick-up device and receiving a confirmation image signal representing a reduced image of the picked-up image; determination means for automatically determining relative positions between first and second confirmation images received by said reception means; synthesizing means for synthesizing first and second images received corresponding to the first and second confirmation images, respectively, on the basis of the relative positions determined by said determination means; and displaying means for simultaneously displaying the first and second confirmation images and a synthesized image of the first and second images in such a manner that the relative positions of the first and second confirmation images are expressed and a synthesized image of the first and second images, wherein the second confirmation image is updated at a predetermined interval.
Claim 4
Dependent Claim
143 words
An image synthesizing apparatus comprising: reception means for receiving an image signal representing a picked-up image from an image pick-up device and receiving a confirmation image signal representing a reduced image of the picked-up image; determination means for automatically determining relative positions between first and second confirmation images received by said reception means; synthesizing means for synthesizing first and second images received corresponding to the first and second confirmation images, respectively, on the basis of the relative positions determined by said determination means; and displaying means for simultaneously displaying the first and second confirmation images and a synthesized image of the first and second images in such a manner that the relative positions of the first and second confirmation images are expressed and a synthesized image of the first and second images, wherein the second confirmation image is updated at a predetermined interval.
Claim 5
Dependent Claim
30 words
The image synthesizing apparatus according to claim 2 , wherein said determination means determines the relative positions by determining a first overlapping area between the first and second confirmation images.
Claim 6
Dependent Claim
52 words
The image synthesizing apparatus according to claim 3 , wherein said synthesizing means comprises: means for detecting a second overlapping area between the first and second images on the basis of the relative positions; and means for combining the first and second images on the basis of the detected second overlapping area.
Claim 7
Dependent Claim
23 words
The image synthesizing apparatus according to claim 3 further comprising judging means for judging whether or not the first overlapping area is appropriate.
Claim 8
Dependent Claim
23 words
The image synthesizing apparatus according to claim 4 further comprising judging means for judging whether or not the second overlapping area is appropriate.
Claim 9
Dependent Claim
24 words
The image synthesizing apparatus according to claim 6 further comprising notification means for notifying a user of a judged result by said judging means.
Claim 10
Dependent Claim
24 words
The image synthesizing apparatus according to claim 6 further comprising notification means for notifying a user of a judged result by said judging means.
Claim 11
Dependent Claim
96 words
The image synthesizing apparatus according to claim 4 , wherein said synthesizing means comprises: means for roughly obtaining the second overlapping area by magnifying the first overlapping area; means for extracting pixels which have an edge property as corresponding points in the roughly obtained second overlapping area; and means for obtaining mapping relationship between the first and second images on the basis of a set of extracted corresponding points, wherein said synthesizing means combines the first and second images by transforming either the first image or the second image on the basis of the mapping relationship.
Claim 12
Dependent Claim
86 words
The image synthesizing apparatus according to claim 3 , wherein said determination means for determining the first overlapping area comprises: means for identifying a first predetermined number of pixels in the first confirmation image; means for identifying a second predetermined number of pixels, corresponding to the first predetermined number, in the second confirmation image; and means for determining position relationship between the first and second confirmation images by comparing pixel values of the first predetermined number of pixels and of the second predetermined number of pixels.
Claim 13
Dependent Claim
72 words
The image synthesizing apparatus according to claim 10 further comprising: means for calculating an overlapping amount of overlapping pixels between the first and second confirmation images on the basis of the determined position relationship of the first and second reduced images; and means for judging whether the ratio of the overlapping amount to an area of either the first confirmation image or the second confirmation image is less than a first threshold.
Claim 14
Dependent Claim
37 words
The image synthesizing apparatus according to claim 10 further comprising notification means for notifying that the ratio is less than the first threshold to a user as a timing for picking up an image to be synthesized.
Claim 15
Dependent Claim
46 words
The image synthesizing apparatus according to claim 12 , wherein, when the overlapping amount is less than a second threshold which is smaller than the first threshold, said notification means notifies the user that it is inappropriate timing for picking up an image to be synthesized.
Claim 16
Dependent Claim
203 words
An image synthesizing system which synthesizes two images comprising: an image rearing apparatus having: image pick-up means for sensing an object and obtaining an image; and signal processing means for generating and outputting a reduced image obtained by reducing the image in response to a request signal, and outputting the original image, an image synthesizing apparatus having: reception means for receiving an image signal representing a reduced image of the picked-up image and receiving an image signal representing the picked-up image from the image sensing apparatus; determination means for automatically determining and storing relative positions between first and second reduced images received by said reception means; and synthesizing means for synthesizing first and second images, corresponding to the first and second reduced images, received by said reception means on the basis of the relative positions determined by and stored in said determination means; and displaying means for simultaneously displaying the first and second confirmation images and a synthesized image of the first and second images in such a manner that the relative positions between the first and second reduced images are expressed and a synthesized image of the first and second images, wherein the second reduced image is updated at a predetermined interval.
Claim 17
Dependent Claim
203 words
An image synthesizing system which synthesizes two images comprising: an image rearing apparatus having: image pick-up means for sensing an object and obtaining an image; and signal processing means for generating and outputting a reduced image obtained by reducing the image in response to a request signal, and outputting the original image, an image synthesizing apparatus having: reception means for receiving an image signal representing a reduced image of the picked-up image and receiving an image signal representing the picked-up image from the image sensing apparatus; determination means for automatically determining and storing relative positions between first and second reduced images received by said reception means; and synthesizing means for synthesizing first and second images, corresponding to the first and second reduced images, received by said reception means on the basis of the relative positions determined by and stored in said determination means; and displaying means for simultaneously displaying the first and second confirmation images and a synthesized image of the first and second images in such a manner that the relative positions between the first and second reduced images are expressed and a synthesized image of the first and second images, wherein the second reduced image is updated at a predetermined interval.
Claim 18
Dependent Claim
34 words
The image synthesizing system according to claim 14 , wherein the image sensing apparatus and the image synthesizing apparatus are connected via a general-use interface capable of transmitting an image at a high speed.
Claim 19
Dependent Claim
22 words
The image synthesizing system according to claim 15 , wherein said general-use interface is a bidirectional parallel interface or a SCSI interface.
Claim 20
Dependent Claim
151 words
An image synthesizing apparatus comprising: reception means for receiving an image signal of a picked-up image from an image pick-up device; generation means for generating first and second reduced images on the basis of first and second images received by said reception means; determination means for determining relative positions between the first and second reduced images on the basis of an overlapping region between the first and second images; displaying means for simultaneously displaying, on a monitor screen, the first and second reduced images in such a manner that the relative positions between the first and second reduced images are expressed on the basis of the relative positions determined by said determination means; and synthesizing means for, in response to the displaying means, synthesizing the first and second images on the basis of the relative positions determined by said determination means, wherein said second image is updated at a predetermined interval.
Claim 21
Dependent Claim
151 words
An image synthesizing apparatus comprising: reception means for receiving an image signal of a picked-up image from an image pick-up device; generation means for generating first and second reduced images on the basis of first and second images received by said reception means; determination means for determining relative positions between the first and second reduced images on the basis of an overlapping region between the first and second images; displaying means for simultaneously displaying, on a monitor screen, the first and second reduced images in such a manner that the relative positions between the first and second reduced images are expressed on the basis of the relative positions determined by said determination means; and synthesizing means for, in response to the displaying means, synthesizing the first and second images on the basis of the relative positions determined by said determination means, wherein said second image is updated at a predetermined interval.
Claim 22
Dependent Claim
118 words
An image synthesizing apparatus comprising: generation means for generating a reduced image of an image sensed by an image pick-up device; determination means for automatically determining relative positions between first and second reduced images generated by said generation means on the basis of an overlapping region between the first and second reduced images; judging means for judging whether an overlap condition for determining if it is appropriate to synthesize first and second images which are original images of the first and second reduced images is satisfied or not on the basis of the relative positions between the first and second reduced images determined by said determination means; and notification means for notifying a user of a judged result.
Claim 23
Dependent Claim
118 words
An image synthesizing apparatus comprising: generation means for generating a reduced image of an image sensed by an image pick-up device; determination means for automatically determining relative positions between first and second reduced images generated by said generation means on the basis of an overlapping region between the first and second reduced images; judging means for judging whether an overlap condition for determining if it is appropriate to synthesize first and second images which are original images of the first and second reduced images is satisfied or not on the basis of the relative positions between the first and second reduced images determined by said determination means; and notification means for notifying a user of a judged result.
References Cited (Backward Citations)
US5524071A
Cited
US4868642A
Cited
US5392388A
Cited
US5444478A
Cited
US5650814A
Cited
US5680150A
Cited
US5724579A
Cited
US5774754A
Cited
US5764236A
Cited
US5706419A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-06-04 | 2004-12-04 | 2005-06-05 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-06-04 | 2008-12-04 | 2009-06-05 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-06-04 | 2012-12-04 | 2013-06-05 | $7700.00 | Window Closed / Lapsed |