US6011558A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Intelligent stitcher for panoramic image-based virtual worlds
Assignee: Transpacific IP Ltd
•
Filing: 1997-09-23
•
Granted: 2000-01-04
•
Expires: 2017-09-23
Abstract
Abstract A pair of images are stitched together by warping the pair of images into an environment map representative of a panoramic image. A first edge and a corresponding second edge for each of the first and second images, respectively, are detected. A set of edge position coordinates along the edge of the first warped image is determined. A set of possible matched solutions from the edge position coordinates of the first and second edge are generated. An optimum matched offset from the set of possible matched solutions is determined. Because the set of possible matched solutions is small and compact, the optimum matched offset can be determined efficiently from the set of solutions.
Inventors
- 👤 Chun-Wei Hsieh
- 👤 Tse Cheng
- 👤 Cheng-Chin Chiang
- 👤 Shu-Cheng Huang
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:34
CPC Classifications
G; G06; G06T; G06T11/00
Claims Analysis
Total Claims: 15
Claim 1
Independent Claim
104 words
A method of stitching together a first and second image, the method comprising: warping the first and second images into an environment map representative of a panoramic image; detecting a first edge for the first warped image and a corresponding second edge of the second warped image; determining a set of edge position coordinates from each of the detected first and second edges; generating a set of possible matched solutions from the edge position coordinates of the detected first and second edges; and determining an optimum matched offset of the first image relative to the second image from the set of possible matched solutions.
Claim 2
Independent Claim
104 words
A method of stitching together a first and second image, the method comprising: warping the first and second images into an environment map representative of a panoramic image; detecting a first edge for the first warped image and a corresponding second edge of the second warped image; determining a set of edge position coordinates from each of the detected first and second edges; generating a set of possible matched solutions from the edge position coordinates of the detected first and second edges; and determining an optimum matched offset of the first image relative to the second image from the set of possible matched solutions.
Claim 3
Independent Claim
137 words
A method of stitching together a first and second image, the method comprising: warping the first and second images into an environment map representative of a panoramic image, the environment map being formed of a plurality of pixels representative of the panoramic image; detecting a first edge for the first warped image and a corresponding second edge of the second warped image; determining a set of edge position coordinates from each of the detected first and second edges; generating a set of possible matched solutions from the edge position coordinates of the detected first and second edges; determining an optimum matched offset of the first image relative to the second image from the set of possible matched solutions; and blending intensity values of pixels of the first warped image with corresponding pixels of the second warped image.
Claim 4
Independent Claim
137 words
A method of stitching together a first and second image, the method comprising: warping the first and second images into an environment map representative of a panoramic image, the environment map being formed of a plurality of pixels representative of the panoramic image; detecting a first edge for the first warped image and a corresponding second edge of the second warped image; determining a set of edge position coordinates from each of the detected first and second edges; generating a set of possible matched solutions from the edge position coordinates of the detected first and second edges; determining an optimum matched offset of the first image relative to the second image from the set of possible matched solutions; and blending intensity values of pixels of the first warped image with corresponding pixels of the second warped image.
Claim 5
Dependent Claim
77 words
The method of claim 1 wherein detecting the first and second edges for each of the first and second warped images comprises: detecting a vertical edge of one of the first and second images including: determining gradient intensity values along columns of pixels forming one of the first and second warped images; summing, for each column of pixels, gradient intensity values for all pixels along each column; and comparing the summed value with a preselected threshold value.
Claim 6
Dependent Claim
75 words
The method of claim 1 wherein detecting the first and second edges for each of the first and second images comprises: detecting a horizontal edge of one of the first and second images including: determining gradient intensity values along rows of pixels forming one of the first and second images; summing, for each row of pixels, gradient intensity values for all pixels along each row; and comparing the summed value with a preselected threshold value.
Claim 7
Independent Claim
277 words
A method of stitching together a first and second image, the method comprising: warping the first and second images into an environment map representative of a panoramic image; detecting a first edge for the first warped image and a corresponding second edge of the second warped image; determining a set of edge position coordinates from each of the detected first and second edges; generating a set of possible matched solutions from the edge position coordinates of the detected first and second edges, wherein generating a set of possible matched solutions includes: calculating an offset function according to the following equation: d(i,k)=min |P a (i)-k-P b (j)|. 1≦j≦N.sub.b where: P a represents edge position values associated with edge position coordinates of the first warped image; P b represents edge position values associated with edge position coordinates of the second warped image; N b is the number edge position values of Pb; k is a user selected variable; calculating a number N p representative of the number of edge position values whose value of d(i,k) is less than a threshold value T 0 ; determining an average value of d(i,k) for values of P a less than threshold value T 0 ; determining an average value of d(i,k) for elements of P a whose d(i,k) is less than a first threshold value T 0 ; and determining that a position k is a possible matched solution when the average value of d(i,k) is less than a second threshold value T 1 and the number N p is larger than a third threshold value T 2 ; and determining an optimum matched offset from the set of possible matched solutions.
Claim 8
Independent Claim
277 words
A method of stitching together a first and second image, the method comprising: warping the first and second images into an environment map representative of a panoramic image; detecting a first edge for the first warped image and a corresponding second edge of the second warped image; determining a set of edge position coordinates from each of the detected first and second edges; generating a set of possible matched solutions from the edge position coordinates of the detected first and second edges, wherein generating a set of possible matched solutions includes: calculating an offset function according to the following equation: d(i,k)=min |P a (i)-k-P b (j)|. 1≦j≦N.sub.b where: P a represents edge position values associated with edge position coordinates of the first warped image; P b represents edge position values associated with edge position coordinates of the second warped image; N b is the number edge position values of Pb; k is a user selected variable; calculating a number N p representative of the number of edge position values whose value of d(i,k) is less than a threshold value T 0 ; determining an average value of d(i,k) for values of P a less than threshold value T 0 ; determining an average value of d(i,k) for elements of P a whose d(i,k) is less than a first threshold value T 0 ; and determining that a position k is a possible matched solution when the average value of d(i,k) is less than a second threshold value T 1 and the number N p is larger than a third threshold value T 2 ; and determining an optimum matched offset from the set of possible matched solutions.
Claim 9
Dependent Claim
19 words
The method of claim 1 wherein determining the optimum matched offset includes applying a mean absolute error correlation technique.
Claim 10
Dependent Claim
18 words
The method of claim 1 wherein the determining the optimum matched offset includes applying a normalized cross-correlation technique.
Claim 11
Independent Claim
137 words
A system for stitching together a first and a second image of an environment map formed of a plurality of pixels representative of a panoramic image, the system comprising: an edge detector which detects a first edge of the first image and a corresponding second edge of the second image, the edge detector determining sets of edge position coordinates from each of the detected first and second edges; a memory which stores the sets of edge position coordinates from each of the detected first and second edges; a hypothesis generator which generates a set of possible matched solutions from the edge position coordinates of the detected first and second edges; and an optimal hypothesis selector which determines an optimum matched offset of the first image relative to the second image from the set of possible matched solutions.
Claim 12
Independent Claim
137 words
A system for stitching together a first and a second image of an environment map formed of a plurality of pixels representative of a panoramic image, the system comprising: an edge detector which detects a first edge of the first image and a corresponding second edge of the second image, the edge detector determining sets of edge position coordinates from each of the detected first and second edges; a memory which stores the sets of edge position coordinates from each of the detected first and second edges; a hypothesis generator which generates a set of possible matched solutions from the edge position coordinates of the detected first and second edges; and an optimal hypothesis selector which determines an optimum matched offset of the first image relative to the second image from the set of possible matched solutions.
Claim 13
Dependent Claim
47 words
The system of claim 8 wherein the memory stores pixels representative of edges of the first and second warped images and the system further comprises a blending engine for blending intensity values of pixels of the first warped image with corresponding pixels of the second warped image.
Claim 14
Dependent Claim
20 words
The system of claim 8 wherein a microprocessor includes the edge detector, the hypothesis generator, and the optimal hypothesis selector.
Claim 15
Dependent Claim
19 words
The system of claim 8 further comprising an external storage which stores the warped images of the environment map.
References Cited (Backward Citations)
US5185667A
Cited
US5313306A
Cited
US5359363A
Cited
US5384588A
Cited
US5446833A
Cited
US5561756A
Cited
US5396583A
Cited
US5845007A
Cited
US5848193A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-01-03 | 2003-07-05 | 2004-01-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-01-03 | 2007-07-05 | 2008-01-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-01-03 | 2011-07-05 | 2012-01-04 | $7700.00 | Window Closed / Lapsed |