US6778207B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Fast digital pan tilt zoom video
Assignee: Koninklijke Philips NV
•
Filing: 2000-08-07
•
Granted: 2004-08-17
•
Expires: 2020-08-07
Abstract
Abstract A virtual PTZ camera is described which forms a virtual image using multiple cameras whose fields of view overlap. Images from the cameras are merged by transforming to a common surface and property-blending overlapping regions to smooth transitions due to differences in image formation of common portions of a scene. To achieve high speed, the images may be merged to a common planar surface or set of surfaces so that transforms can be linear. Image information alone may be used to calculate the transforms from common feature points located in the images so that there is no need for three-dimensional geometric information about the cameras.
Inventors
- 👤 Mi-Suen Lee
- 👤 Mircea Nicolescu
- 👤 Gerard Medioni
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 18:00
CPC Classifications
H; H04; H04N; H04N5/00; H04N5/222; H04N5/262; H04N5/2628; H04N23/00; H04N23/60; H04N23/698; H04N23/90
Claims Analysis
Total Claims: 16
Claim 1
Independent Claim
185 words
A method for generating an image from an arbitrary direction and with an arbitrary zoom from a scene by combining the images of first and second cameras, said method comprising the steps of: computing a transform that maps corresponding pairs of image subregions lying in overlapping portions of first and second images derivable from said first and second cameras, respectively, to a substantially identical subregion of a composite image; acquiring a first image from said first camera and a second image from said second camera; transforming and merging at least one of said first and second images to form composite image combining data from said first and second images; spatially blending at least one of intensity and color properties of said images to reduce abrupt transitions due to differences in said properties in said first and second images; and forming an image from a selected portion of said composite image, wherein said image forming step comprises: linearly transforming the selected portion of said composite image to a new plane coinciding with neither a plane of said first image and a plane of said second image.
Claim 2
Independent Claim
185 words
A method for generating an image from an arbitrary direction and with an arbitrary zoom from a scene by combining the images of first and second cameras, said method comprising the steps of: computing a transform that maps corresponding pairs of image subregions lying in overlapping portions of first and second images derivable from said first and second cameras, respectively, to a substantially identical subregion of a composite image; acquiring a first image from said first camera and a second image from said second camera; transforming and merging at least one of said first and second images to form composite image combining data from said first and second images; spatially blending at least one of intensity and color properties of said images to reduce abrupt transitions due to differences in said properties in said first and second images; and forming an image from a selected portion of said composite image, wherein said image forming step comprises: linearly transforming the selected portion of said composite image to a new plane coinciding with neither a plane of said first image and a plane of said second image.
Claim 3
Dependent Claim
13 words
The method as claimed in claim 1 , wherein said transform is linear.
Claim 4
Dependent Claim
27 words
The method as claimed in claim 1 , wherein said transform is a planar projection transform and said composite image is defined with respect to a plane.
Claim 5
Dependent Claim
47 words
The method as claimed in claim 1 , wherein said step of computing comprises: identifying feature points in said first and second images and computing said transform responsively to said feature points such that information about orientations of said cameras is not required to compute said transform.
Claim 6
Dependent Claim
36 words
The method as claimed in claim 1 , wherein said step of blending includes a weighted average, where a weight is computed responsively to a distance from a boundary line separating said first and second images.
Claim 7
Dependent Claim
35 words
The method as claimed in claim 1 , wherein said step of blending includes a weighted average, where a weight is proportional to a distance from a boundary line separating said first and second images.
Claim 8
Dependent Claim
25 words
The method as claimed in claim 1 , wherein said step of forming further comprises: interpolating property values of pixels to generate a zoom effect.
Claim 9
Independent Claim
243 words
A device for generating an image from an arbitrary direction and with an arbitrary zoom from a scene by combining the images of first and second cameras, comprising: an image processor connectable to receive image data from two cameras; said image processor having a memory; said image processor being programmed to compute a transform that maps corresponding pairs of image subregions lying in overlapping portions of first and second images derivable from said first and second cameras, respectively, to a substantially identical subregion of a composite image and storing a definition of said transform in said memory; said image processor being further programmed to receive first and second images from said first and second cameras, respectively, and transform and merge at least one of said first and second images to form composite image combining data from said first and second images; said image processor being further programmed to spatially blend at least one of intensity and color properties of said images to reduce abrupt transitions due to differences in said properties in said first and second images; and said image processor being still further programmed to generate a selected image from a selected portion of said composite images, wherein said image processor is programmed such that said selected image is generated from said composite image by transforming a portion of said composite image to a new plane coinciding with neither a plane of said first image and a plane of said second image.
Claim 10
Independent Claim
243 words
A device for generating an image from an arbitrary direction and with an arbitrary zoom from a scene by combining the images of first and second cameras, comprising: an image processor connectable to receive image data from two cameras; said image processor having a memory; said image processor being programmed to compute a transform that maps corresponding pairs of image subregions lying in overlapping portions of first and second images derivable from said first and second cameras, respectively, to a substantially identical subregion of a composite image and storing a definition of said transform in said memory; said image processor being further programmed to receive first and second images from said first and second cameras, respectively, and transform and merge at least one of said first and second images to form composite image combining data from said first and second images; said image processor being further programmed to spatially blend at least one of intensity and color properties of said images to reduce abrupt transitions due to differences in said properties in said first and second images; and said image processor being still further programmed to generate a selected image from a selected portion of said composite images, wherein said image processor is programmed such that said selected image is generated from said composite image by transforming a portion of said composite image to a new plane coinciding with neither a plane of said first image and a plane of said second image.
Claim 11
Dependent Claim
13 words
The device as claimed in claim 8 , wherein said transform is linear.
Claim 12
Dependent Claim
27 words
The device as claimed in claim 8 , wherein said transform is a planar projection transform and said composite image is defined with respect to a plane.
Claim 13
Dependent Claim
48 words
The device as claimed in claim 8 , wherein said transform is computed by first identifying feature points in said first and second images and computing said transform responsively to said feature points such that information about orientations of said cameras is not required to compute said transform.
Claim 14
Dependent Claim
36 words
The device as claimed in claim 8 , wherein said step of blending includes a weighted average, where a weight is computed responsively to a distance from a boundary line separating said first and second images.
Claim 15
Dependent Claim
42 words
The device as claimed in claim 8 , wherein said image processor is programmed to spatially blend by weighted averaging, where a weight of said weighted averaging is proportional to a distance from a boundary line separating said first and second images.
Claim 16
Dependent Claim
27 words
The device as claimed in claim 8 , wherein said selected image is generated, in part, by interpolating property values of pixels to generate a zoom effect.
References Cited (Backward Citations)
US5920657A
Cited
US5488674A
Cited
US5444478A
Cited
US6393163B1
Cited
US5703961A
Cited
US5850352A
Cited
US5657073A
Cited
US6389179B1
Cited
US6473118B1
Cited
WO1998047291A2
Cited
US6157747A
Cited
US6064399A
Cited
US6677981B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-08-17 | 2008-02-16 | 2008-08-17 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-08-17 | 2012-02-16 | 2012-08-17 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-08-17 | 2016-02-16 | 2016-08-17 | $7700.00 | Window Closed / Lapsed |