Patent US6532036B1 successfully refreshed from Google Patents.
← Back to Patent Explorer
US6532036B1 Expired / Lapsed US ⏱️ 0.0 years remaining

Generalized panoramic mosaic

Assignee: Yissum Research Development Co of Hebrew University of Jerusalem
•
Filing: 1998-01-20
•
Granted: 2003-03-11
•
Expires: 2018-01-20
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method for combining a sequence of two-dimensional images of a scene to construct a panoramic mosaic of the scene has a sequence of images acquired by a camera with relative motion to the scene. The relative motion gives rise to an optical flow between the images. The images are warped so that the optical flow becomes substantially parallel to a direction in which the mosaic is constructed and pasted so that the sequence of the images is continuous for the scene to construct the panoramic mosaic of the scene. For this, the images are projected onto a three-dimensional cylinder having a major axis that approximates the path of an optical center of the camera. The combination of the images is achieved by translating the projected two-dimensional images substantially along the cylindrical surface of the three-dimensional cylinder.

Inventors

  • 👤 Shmuel Peleg
  • 👤 Benny Rousso

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 17:28
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/40; G06T3/4038

Claims Analysis

Total Claims: 19
Claim 1
Independent Claim 168 words
A method of combining a sequence of two-dimensional images of a scene for obtaining a panoramic mosaic of said scene, said sequence of two-dimensional images being acquired by a moving camera in relative motion with respect to said scene, said camera motion giving rise to an optical flow between the images, the method comprising the steps of: (a) selecting for each image of said sequence of two-dimensional images at least one family of lines perpendicular to said optical flow and defining at least one strip having a front edge, through which said optical flow enters, and a back edge, through which said optical flow exits, so that each strip is substantially perpendicular to said optical flow; (b) warping said strips to create non-rectangular strips, so that said optical flow becomes substantially parallel to a direction in which said mosaic is constructed; and (c) pasting said non-rectangular strips so that said sequence of two-dimensional images are continuous for said scene, whereby said panoramic mosaic of the scene is constructed.
Claim 2
Independent Claim 168 words
A method of combining a sequence of two-dimensional images of a scene for obtaining a panoramic mosaic of said scene, said sequence of two-dimensional images being acquired by a moving camera in relative motion with respect to said scene, said camera motion giving rise to an optical flow between the images, the method comprising the steps of: (a) selecting for each image of said sequence of two-dimensional images at least one family of lines perpendicular to said optical flow and defining at least one strip having a front edge, through which said optical flow enters, and a back edge, through which said optical flow exits, so that each strip is substantially perpendicular to said optical flow; (b) warping said strips to create non-rectangular strips, so that said optical flow becomes substantially parallel to a direction in which said mosaic is constructed; and (c) pasting said non-rectangular strips so that said sequence of two-dimensional images are continuous for said scene, whereby said panoramic mosaic of the scene is constructed.
Claim 3
Dependent Claim 27 words
The method of claim 1 wherein step (b) of warping the strips includes transforming said strips into strips having straight edges before the strips are combined together.
Claim 4
Dependent Claim 21 words
The method according to claim 1 , wherein two-dimensional images are related by an affine transformation or by a planar-projective transformation.
Claim 5
Dependent Claim 46 words
The method of claim 1 wherein said images are projected onto a three-dimensional cylinder whose major axis approximates the path of camera optical center, the combination of the strips being achieved by translating the projected two-dimensional images substantially along the cylindrical surface of the three-dimensional cylinder.
Claim 6
Dependent Claim 36 words
The method of claim 4 wherein every two subsequent images define their own cylinder whose major axis substantially passes through the optical center of the camera, and the cylinders are concatenated substantially along the image sequence.
Claim 7
Dependent Claim 21 words
The method according to claim 1 , wherein a transformation is applied to the panoramic mosaic depending on a desired viewpoint.
Claim 8
Dependent Claim 41 words
The method according to claim 1 , wherein the sequence of images is augmented by sets of interpolated images intermediate to the images of the sequence of images, and wherein the strips are augmented with strips defined on the interpolated images.
Claim 9
Dependent Claim 20 words
A memory containing a file representing a panoramic mosaic of a scene generated by the method of claim 1 .
Claim 10
Dependent Claim 85 words
A computer program product comprising a computer useable medium having computer readable program code embodied therein of combining a sequence of two-dimensional images of a scene for obtaining a panoramic mosaic of the scene, said sequence of two-dimensional images being acquired by a moving camera in relative motion with respect to the scene, said camera motion giving rise to optical flow between the images, the computer program product comprising computer readable program code for causing the computer to perform method steps of claim 1 .
Claim 11
Dependent Claim 31 words
The method of claim 1 wherein step (b) of warping the strips includes transforming said strips into strips having their front and back edges fitting an edge of an adjacent strip.
Claim 12
Dependent Claim 35 words
The method of claim 1 wherein step (b) of warping the strips includes rescaling said strips to rectangular strips so that their front edge be substantially aligned with the back edge of an adjacent strip.
Claim 13
Dependent Claim 70 words
The method of claim 1 wherein at least one strip of said strips is a circular strip, the front edge of said circular strip being an arc of length l 1 having a radius r 1 , the back edge of said circular strip being an arc of length l 2 having a radius r 2 , and the rescaling includes multiplying l 1 by r 1 /r 2 .
Claim 14
Dependent Claim 54 words
The method of claim 1 wherein step (a) includes: determining a shape of said at least one strip; determining a size and a width of said at least one strip; defining a position of said at least one strip on a two-dimensional image; and cutting said at least one strip from the two-dimensional image.
Claim 15
Dependent Claim 33 words
Use of the method of claim 1 for handling at least one case from the group consisting of image parallax, camera zoom, forward camera motion, and general camera motion combining translation and rotation.
Claim 16
Dependent Claim 177 words
In a method for combining a sequence of two-dimensional images of a scene to construct a panoramic mosaic of said scene, said sequence of images being acquired by a camera for relative motion with respect to said scene, said relative motion giving rise to an optical flow between said images, the improvements comprising the steps of: (a) warping said images so that said optical flow becomes substantially parallel to a direction in which said mosaic is constructed; and (b) pasting said warped images so that said sequence of said images is continuous for said scene, whereby to construct said panoramic mosaic of said scene, wherein said images are projected onto a three-dimensional cylinder whose major axis approximates the path of camera optical center, the combination of the images being achieved by translating the projected two-dimensional images substantially along the cylindrical surface of the three-dimensional cylinder, and wherein every two subsequent images define their own cylinder whose major axis substantially passes through the optical center of the camera, and the cylinders are concatenated substantially along the image sequence.
Claim 17
Dependent Claim 177 words
In a method for combining a sequence of two-dimensional images of a scene to construct a panoramic mosaic of said scene, said sequence of images being acquired by a camera for relative motion with respect to said scene, said relative motion giving rise to an optical flow between said images, the improvements comprising the steps of: (a) warping said images so that said optical flow becomes substantially parallel to a direction in which said mosaic is constructed; and (b) pasting said warped images so that said sequence of said images is continuous for said scene, whereby to construct said panoramic mosaic of said scene, wherein said images are projected onto a three-dimensional cylinder whose major axis approximates the path of camera optical center, the combination of the images being achieved by translating the projected two-dimensional images substantially along the cylindrical surface of the three-dimensional cylinder, and wherein every two subsequent images define their own cylinder whose major axis substantially passes through the optical center of the camera, and the cylinders are concatenated substantially along the image sequence.
Claim 18
Independent Claim 173 words
A system for combining a sequence of two-dimensional images of a scene for obtaining a panoramic mosaic of said scene, said sequence of two-dimensional images being acquired by a moving camera in relative motion with respect to said scene, said camera motion giving rise to an optical flow between the images, the system comprising: (a) a selector for selecting each image of said sequence of two-dimensional images at least one family of lines perpendicular to said optical flow and defining at least one strip having a front edge, through which said optical flow enters, and a back edge, through which said optical flow exits, so that each strip is substantially perpendicular to said optical flow; (b) a warper for warping said strips to create non-rectangular strips, so that said optical flow becomes substantially parallel to a direction in which said mosaic is constructed; and (c) a paster for pasting said non-rectangular strips so that said sequence of two-dimensional images are continuous for said scene, whereby said panoramic mosaic of the scene is constructed.
Claim 19
Independent Claim 173 words
A system for combining a sequence of two-dimensional images of a scene for obtaining a panoramic mosaic of said scene, said sequence of two-dimensional images being acquired by a moving camera in relative motion with respect to said scene, said camera motion giving rise to an optical flow between the images, the system comprising: (a) a selector for selecting each image of said sequence of two-dimensional images at least one family of lines perpendicular to said optical flow and defining at least one strip having a front edge, through which said optical flow enters, and a back edge, through which said optical flow exits, so that each strip is substantially perpendicular to said optical flow; (b) a warper for warping said strips to create non-rectangular strips, so that said optical flow becomes substantially parallel to a direction in which said mosaic is constructed; and (c) a paster for pasting said non-rectangular strips so that said sequence of two-dimensional images are continuous for said scene, whereby said panoramic mosaic of the scene is constructed.

References Cited (Backward Citations)

US5130794A Cited
US5991444A Cited
US5862508A Cited
US5768447A Cited
US6078701A Cited
US5995095A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2006-03-10 2006-09-09 2007-03-11 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2010-03-10 2010-09-09 2011-03-11 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2014-03-10 2014-09-09 2015-03-11 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag