US6754400B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
System and method for creation, processing and visualization of omni-directional images
Assignee: Tour Technology Software Inc
•
Filing: 2001-02-06
•
Granted: 2004-06-22
•
Expires: 2021-02-06
Abstract
Abstract A system and method for digitally rendering omni-directional images includes capturing images of a region 360 degrees about an origin point in a single plane, and assembling the images in a digital format to create a complete spherical image surrounding the origin point. The spherical image is projected onto faces of a cube surrounding the spherical image. Images which were projected on the faces of the cube may then be rendered to provide an omni-directional image.
Inventors
- 👤 Rusu Mihai Florin
- 👤 Sever Serban
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 23:52
CPC Classifications
G; G06; G06T; G06T15/00; G06T15/10; G06T15/20; G06T15/205
Claims Analysis
Total Claims: 43
Claim 1
Independent Claim
73 words
A method for digitally rendering omni-directional images comprising the steps of: capturing images surrounding an origin point in a at least two hemispheres surrounding the origin point; assembling the images in a digital format to create a complete spherical image surrounding the origin point; projecting the spherical image onto faces of a to cube surrounding the spherical image; and storing images projected on the faces of the cube to provide an omni-directional image.
Claim 2
Independent Claim
73 words
A method for digitally rendering omni-directional images comprising the steps of: capturing images surrounding an origin point in a at least two hemispheres surrounding the origin point; assembling the images in a digital format to create a complete spherical image surrounding the origin point; projecting the spherical image onto faces of a to cube surrounding the spherical image; and storing images projected on the faces of the cube to provide an omni-directional image.
Claim 3
Dependent Claim
39 words
The method as recited in claim 1 , wherein the step of assembling the images in a digital format includes the step of transferring two planar fish-eye images to hemispherical images while removing distortions in the planar fish-eye images.
Claim 4
Dependent Claim
47 words
The method as recited in claim 1 , wherein the step of assembling the images in the digital format includes the step of removing a demarcation line between the images in the digital format by averaging color and brightness characteristics between the images in the digital format.
Claim 5
Dependent Claim
44 words
The method as recited in claim 1 , wherein the step of assembling the images in the digital format includes the step of removing a demarcation line between the images in the digital format by employing an error function between pixels of the images.
Claim 6
Dependent Claim
37 words
The method as recited in claim 1 , wherein the images are taken with a fish-eye lens and further comprising the step of removing a demarcation line by removing pixels from the images in the digital format.
Claim 7
Dependent Claim
39 words
The method as recited in claim 1 , wherein the step of projecting the spherical image onto faces of a cube surrounding the spherical image includes the step of providing a uniform resolution on a whole surface the cube.
Claim 8
Dependent Claim
39 words
The method as recited in claim 1 , wherein the step of projecting the spherical image onto faces of a cube surrounding the spherical image includes the step of changing a resolution of the image projected on the cube.
Claim 9
Dependent Claim
23 words
The method as recited in claim 1 , further comprising the step of displaying a portion of the image projected on the cube.
Claim 10
Dependent Claim
40 words
The method as recited in claim 8 , wherein the step of displaying includes the step of resealing the image projected on the cube to provide a visualized image that creates a sensation of rectilinear movement in the visualized image.
Claim 11
Dependent Claim
29 words
The method as recited in claim 1 , further comprising the step of dynamically exploring at least portions of a complete image projected on the faces of the cube.
Claim 12
Dependent Claim
34 words
The method as recited in claim 10 , wherein the step of dynamically exploring includes providing rotations and translations in all degrees of freedom to permit exploring of the cube in a three-dimensional space.
Claim 13
Dependent Claim
20 words
The method as recited in claim 1 , further comprising the step of transferring from one omni-directional image to another.
Claim 14
Dependent Claim
39 words
The method as recited in claim 1 , wherein the images are captured by a fish-eye lens and further comprising the step of calibrating the fish-eye lens to determine radial distortion coefficients for determining specific distortions of the lens.
Claim 15
Dependent Claim
28 words
The method as recited in claim 1 , further comprising the step of providing a user interface to permit manipulation of a displayed portion of the omni-directional image.
Claim 16
Dependent Claim
23 words
The method as recited in claim 1 , further comprising the step of determining a center of the image to eliminate geometric distortions.
Claim 17
Dependent Claim
27 words
A program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps as recited in claim 1 .
Claim 18
Independent Claim
103 words
A method for digitally rendering omni-directional images comprising the steps of: capturing two fish-eye images, the fish-eye images being taken 180 degrees apart with respect to a plane from an origin point; converting the two fish-eye images to a digital format; assembling the two fish-eye images in the digital format to create a spherical image surrounding the origin point; projecting the spherical image onto faces of a cube surrounding the spherical image; storing images projected on the faces of the cube; and transferring a portion of the images projected on the faces of the cube to provide an omni-directional image to for visualization.
Claim 19
Independent Claim
103 words
A method for digitally rendering omni-directional images comprising the steps of: capturing two fish-eye images, the fish-eye images being taken 180 degrees apart with respect to a plane from an origin point; converting the two fish-eye images to a digital format; assembling the two fish-eye images in the digital format to create a spherical image surrounding the origin point; projecting the spherical image onto faces of a cube surrounding the spherical image; storing images projected on the faces of the cube; and transferring a portion of the images projected on the faces of the cube to provide an omni-directional image to for visualization.
Claim 20
Dependent Claim
36 words
The method as recited in claim 17 , wherein the step of converting the two fish-eye images to a digital format includes the step of transferring planar fish-eye images to a hemispherical image to remove distortions.
Claim 21
Dependent Claim
62 words
The method as recited in claim 17 , wherein the step of assembling the two fish-eye images in the digital format to create a spherical image surrounding the origin point includes the step of removing a demarcation line between the two fish-eye images in the digital format by averaging color and brightness characteristics between the two fish-eye images in the digital format.
Claim 22
Dependent Claim
29 words
The method as recited in claim 19 , wherein the step of removing a demarcation line includes removing halo regions from the two fish-eye images in the digital format.
Claim 23
Dependent Claim
39 words
The method as recited in claim 17 , wherein the step of projecting the spherical image onto faces of a cube surrounding the spherical image includes the step of providing a uniform resolution on a whole surface the cube.
Claim 24
Dependent Claim
24 words
The method as recited in claim 17 , further comprising the step of changing a resolution of the omni-directional image projected on the cube.
Claim 25
Dependent Claim
37 words
The method as recited in claim 17 , further comprising the step of resealing the omni-directional image projected on the cube to provide a visualized image that creates a sensation of rectilinear movement in the visualized image.
Claim 26
Dependent Claim
28 words
The method as recited in claim 17 , further comprising the step of dynamically exploring at least portions of the omni-directional image on the faces of the cube.
Claim 27
Dependent Claim
34 words
The method as recited in claim 24 , wherein the step of dynamically exploring includes providing rotations and translations in all degrees of freedom to permit exploring of the cube in a three-dimensional space.
Claim 28
Dependent Claim
29 words
The method as recited in claim 17 , wherein the step of transferring a portion of the images includes the step of transferring from one omni-directional image to another.
Claim 29
Dependent Claim
29 words
The method as recited in claim 17 , further comprising the step of calibrating the fish-eye lens to determine radial distortion coefficients for determining specific distortions of the lens.
Claim 30
Dependent Claim
42 words
The method as recited in claim 17 , wherein the step of assembling the two fish-eye images includes the step of removing a demarcation line between the images in the digital format by employing an error function between pixels of the images.
Claim 31
Dependent Claim
23 words
The method as recited in claim 17 , further comprising the step of determining a center of the image to eliminate geometric distortions.
Claim 32
Dependent Claim
27 words
A program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps as recited in claim 17 .
Claim 33
Independent Claim
109 words
A system for digitally rendering omni-directional images, comprising: a computer device which receives digital images of a spherical region about an origin point; the computer device including a program storage device readable by the computer device, tangibly embodying a program of instructions executable by the computer device to: assemble the images to create a complete spherical image surrounding the origin point; and project the spherical image onto faces of a cube which surrounds the spherical image; and a display coupled to the computer device for displaying an omni-directional image mapped on the faces of the cube such that an entire surface of the cube is capable of being explored.
Claim 34
Independent Claim
109 words
A system for digitally rendering omni-directional images, comprising: a computer device which receives digital images of a spherical region about an origin point; the computer device including a program storage device readable by the computer device, tangibly embodying a program of instructions executable by the computer device to: assemble the images to create a complete spherical image surrounding the origin point; and project the spherical image onto faces of a cube which surrounds the spherical image; and a display coupled to the computer device for displaying an omni-directional image mapped on the faces of the cube such that an entire surface of the cube is capable of being explored.
Claim 35
Dependent Claim
24 words
The system as recited in claim 31 , further comprising a user interface to permit manipulation of a displayed portion of the omni-directional image.
Claim 36
Dependent Claim
37 words
The system as recited in claim 32 , wherein the user interface permits resealing of the image projected on the cube to provide a visualized image that creates a sensation of rectilinear movement in the visualized image.
Claim 37
Dependent Claim
30 words
The system as recited in claim 32 , wherein the user interface permits dynamical exploration of at least portions of a complete image projected on the faces of the cube.
Claim 38
Dependent Claim
27 words
The system as recited in claim 31 , wherein the manipulation of a displayed portion of the omni-directional image includes rotation and rectilinear motion in all directions.
Claim 39
Dependent Claim
27 words
The system as recited in claim 31 , further comprising a camera including a fish-eye lens which captures two images encompassing a sphere surrounding the origin point.
Claim 40
Dependent Claim
22 words
The system as recited in claim 31 , wherein the program storage device stores color and brightness for points in the images.
Claim 41
Dependent Claim
24 words
The system as recited in claim 31 , wherein the faces of the cube include a uniform resolution on a whole surface the cube.
Claim 42
Dependent Claim
34 words
The system as recited in claim 31 , wherein the system permits rotations and translations of the displayed image in all degrees of freedom to permit exploring of the cube in a three-dimensional space.
Claim 43
Dependent Claim
20 words
The system as recited in claim 31 , wherein the system permits a transfer from one omni-directional image to another.
References Cited (Backward Citations)
US4515450A
Cited
US5582518A
Cited
US5185667A
Cited
US5877801A
Cited
US5687249A
Cited
US6320584B1
Cited
US6385349B1
Cited
US6434265B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-06-22 | 2007-12-22 | 2008-06-22 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-06-22 | 2011-12-22 | 2012-06-22 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-06-22 | 2015-12-22 | 2016-06-22 | $7700.00 | Window Closed / Lapsed |