Patent US6337683B1 successfully refreshed from Google Patents.
US6337683B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Panoramic movies which simulate movement through multidimensional space
Assignee: INFINITE PICTURES Inc
•
Filing: 1999-05-12
•
Granted: 2002-01-08
•
Expires: 2019-05-12
Abstract
Abstract Movement through multi-dimensional space is simulated using a series of panoramic images which are projected or displayed in sequence. The user's direction of view, that is the selected view window, is maintained as the series of images is projected or displayed. Motion in directions other than forward or reverse is simulated by utilizing “branch” points in the sequence. Each path from a branch point simulates motion in a different direction. Branch points are generally indicated to a viewer by visual indicators called “hot spots”; however, branch points may also be hidden and activated in response to the viewer's selected direction of view. If a branch point is indicated by a visual indicator, a user can select motion in a desired direction by clicking on a “hot spot”. In order to conserve storage space, the image representing each panorama can be stored in a compressed format. Only the portion of the panorama necessary to create a “view window” that is, the portion of the image displayed in response to the user's direction of view, is decompressed at view time. An index methodology is used to store the panoramic images. Use of the indexing methodology allows the images to be retrieved in both the forward and backward direction to simulate movement in either direction. Sound is provided in a special format, so that special effects can be provided based on the user's point of view and dependent upon the direction of motion selected by the user.
Inventors
- 👤 Scott Gilbert
- 👤 David J. Kaiman
- 👤 Michael C. Park
- 👤 G. David Ripley
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 19:31
CPC Classifications
H; H04; H04N; H04N5/00; H04N5/222; H04N5/262; H04N5/2628; H04N23/00; H04N23/60; H04N23/698; H04N5/76; H04N5/765; H04N5/77; H04N5/775; H04N9/00; H04N9/79; H04N9/80; H04N9/804; H04N9/8042; H04N9/8047; H04N9/806; H04N9/8063; H04N9/82; H04N9/8205
Claims Analysis
Total Claims: 39
Claim 1
Independent Claim
102 words
A system for simulating movement through multidimensional space comprising in combination, a multi-lens camera for simultaneously capturing a plurality of digital images that cover the entire spherical view field, compression units for individually compressing said images into compressed images, means for transferring said images to a computer, a program operated by said computer which seams said images into panoramas and which links said panoramas into a fixed sequence of panoramas, a viewer which selectively automatically displays at a frame rate that creates a simulation of motion a portion of each of said linked panoramas in said fixed sequence whereby movement is simulated.
Claim 2
Independent Claim
102 words
A system for simulating movement through multidimensional space comprising in combination, a multi-lens camera for simultaneously capturing a plurality of digital images that cover the entire spherical view field, compression units for individually compressing said images into compressed images, means for transferring said images to a computer, a program operated by said computer which seams said images into panoramas and which links said panoramas into a fixed sequence of panoramas, a viewer which selectively automatically displays at a frame rate that creates a simulation of motion a portion of each of said linked panoramas in said fixed sequence whereby movement is simulated.
Claim 3
Dependent Claim
20 words
The system recited in claim 1 wherein said camera has six lenses, one positioned on each side of a cube.
Claim 4
Dependent Claim
16 words
The system recited in claim 1 wherein said computer compresses said images after seaming the images.
Claim 5
Dependent Claim
17 words
The system recited in claim 3 wherein said compression is single frame compression with no inter-frame compression.
Claim 6
Dependent Claim
18 words
The system recited in claim 1 wherein said program adds at least one sound track to each panorama.
Claim 7
Dependent Claim
26 words
The system recited in claim 1 wherein said sequence of images includes break points where said sequence can continue in at least one of two directions.
Claim 8
Dependent Claim
41 words
The system recited in claim 1 wherein the portion of said linked images displayed is determined by the direction of view selected by a uses and wherein said direction of view remains constant at break points until changed by a user.
Claim 9
Independent Claim
115 words
A method of simulating movement through multidimensional space comprising the steps of: capturing a series of sets of individual images, each set of images covering at least a portion of a spherical view, individually compressing said images, transferring said images to a computer, decompressing said images, seaming the images in each set of images into a panorama, linking said panoramas into a fixed sequence of panoramas, compressing said panoramas without using any inter-frame compression, de-compressing at least a portion of each panorama which corresponds to a view window, and automatically displaying at a frame rate of at least 15 frames per second, said view windows in said fixed sequence of panoramas, whereby movement is simulated.
Claim 10
Independent Claim
115 words
A method of simulating movement through multidimensional space comprising the steps of: capturing a series of sets of individual images, each set of images covering at least a portion of a spherical view, individually compressing said images, transferring said images to a computer, decompressing said images, seaming the images in each set of images into a panorama, linking said panoramas into a fixed sequence of panoramas, compressing said panoramas without using any inter-frame compression, de-compressing at least a portion of each panorama which corresponds to a view window, and automatically displaying at a frame rate of at least 15 frames per second, said view windows in said fixed sequence of panoramas, whereby movement is simulated.
Claim 11
Dependent Claim
22 words
The method recited in claim 8 wherein each set of images comprises six images taken from the six sides of a cube.
Claim 12
Dependent Claim
26 words
The method recited in claim 8 where the portion of each panorama de-compressed for viewing is selected by an operator who indicates a direction of view.
Claim 13
Dependent Claim
23 words
The method recited in claim 8 wherein said sequence of images has break points which provide at least two alternative sequences of images.
Claim 14
Dependent Claim
26 words
The method recited in claim 8 wherein said the sequence of images displayed after a break point is selected in response to input from a user.
Claim 15
Dependent Claim
15 words
The method recited in claim 8 wherein sound is associated with each of said panoramas.
Claim 16
Dependent Claim
167 words
A three dimensional (3-D) panorama movie for enabling a user interactively to view movement through a three-dimensional space along a path through a series of viewpoints and to view in any viewing direction in the three-dimensional space, the 3-D panorama movie comprising: a computer storage medium for storage of machine readable image data; a file of machine readable image data stored on the storage medium, the image data including a plurality of panorama frames forming a fixed sequence of panoramic images of the three dimensional space in which each panoramic image in the sequence has a spatially different viewpoint; a panframe directory stored on the storage medium in association with the file of machine readable image data, containing a set of frame indexes, each frame index identifying a location in the file of one of the panorama frames, and automatically displaying in sequence at a frame rate of at least 15 frames per second, a portion of each panoramic image is said sequence whereby motion is simulated.
Claim 17
Dependent Claim
167 words
A three dimensional (3-D) panorama movie for enabling a user interactively to view movement through a three-dimensional space along a path through a series of viewpoints and to view in any viewing direction in the three-dimensional space, the 3-D panorama movie comprising: a computer storage medium for storage of machine readable image data; a file of machine readable image data stored on the storage medium, the image data including a plurality of panorama frames forming a fixed sequence of panoramic images of the three dimensional space in which each panoramic image in the sequence has a spatially different viewpoint; a panframe directory stored on the storage medium in association with the file of machine readable image data, containing a set of frame indexes, each frame index identifying a location in the file of one of the panorama frames, and automatically displaying in sequence at a frame rate of at least 15 frames per second, a portion of each panoramic image is said sequence whereby motion is simulated.
Claim 18
Dependent Claim
54 words
A panorama movie according to claim 14 which there exists a direction of ravel in three-dimensional space from each viewpoint, the direction of travel being stored in the panorama frame associated with each viewpoint as a predetermined point within the panorama frame to define a frame of reference for a viewing direction during playback.
Claim 19
Dependent Claim
19 words
A panorama movie according to claim 15 in which the predetermined point is a centerpoint of the panorama frame.
Claim 20
Dependent Claim
35 words
A panorama movie according to claim 14 in which the panorama frames are compressed using intraframe compression, defining a key frame, so that each frame can be decompressed during playback independently of each other frame.
Claim 21
Dependent Claim
39 words
A panorama movie according to claim 14 in which the file includes a hot spot associated with at least one of the frames, the hotspot being operable during playback to superimpose a function on the playback of that frame.
Claim 22
Dependent Claim
33 words
A panorama movie according to claim 18 in which the hotspot includes an image having a predetermined geometric shape to be superimposed over a feature in one or more of the panorama frames.
Claim 23
Dependent Claim
54 words
A panorama movie according to claim 18 in which the hotspot image is stored with an orientation in each panorama frame such that the superimposed image appears in each frame at playback with a position and shape that conforms to a perspective corrected shape and position of the feature over which it is superimposed.
Claim 24
Dependent Claim
68 words
A panorama movie according to claim 14 which includes two or more of said files, each forming a segment of the movie and having its own respective panframe directory which includes terminal file indices defining a firstfile index and a lastfile index for the respective terminal frames of each file, the movie further including a control file containing linking data for linking terminal indices to link segments together.
Claim 25
Dependent Claim
39 words
A panorama movie according to claim 21 in which the control file includes orientation information defining a new direction of travel to proceed from a terminal frame of first segment along a second segment linked to the first segment.
Claim 26
Dependent Claim
52 words
A panorama movie according to claim 22 in which a third segments is also linked to the terminal frame of first segment, the control file orientation information including an alternative new direction of travel selectable by the user during playback upon reaching the terminal frame of first segment, to branch the movie.
Claim 27
Dependent Claim
32 words
A panorama movie according to claim 22 in which the new direction of travel is selectable by the user selecting a viewing direction that approximately coincides with the new direction of travel.
Claim 28
Dependent Claim
160 words
A panorama movie method for simulating movement through multidimensional space comprising the steps of: capturing a plurality of images consisting of imagery taken from a plurality of spatial positions in multidimensional space; seaming said images into key-frame panoramas, storing said key-frame panoramas in a file in a storage medium; indexing said key-frame panoramas within a key-frame directory according to a position of each key-frame within the file and storing said key-frame directory on said storage medium; displaying a portion of a first key-frame panorama according to a user position and viewing direction within the multidimensional space; accessing said key-frame directory to determine a next key-frame image to be displayed according to a user travel speed and travel direction; and automatically displaying at a frame rate that is fast enough to simulate motion a portion of a second key-frame panorama subsequent to the display of said first key-frame panorama according to a user position and viewing direction whereby motion is simulated.
Claim 29
Dependent Claim
160 words
A panorama movie method for simulating movement through multidimensional space comprising the steps of: capturing a plurality of images consisting of imagery taken from a plurality of spatial positions in multidimensional space; seaming said images into key-frame panoramas, storing said key-frame panoramas in a file in a storage medium; indexing said key-frame panoramas within a key-frame directory according to a position of each key-frame within the file and storing said key-frame directory on said storage medium; displaying a portion of a first key-frame panorama according to a user position and viewing direction within the multidimensional space; accessing said key-frame directory to determine a next key-frame image to be displayed according to a user travel speed and travel direction; and automatically displaying at a frame rate that is fast enough to simulate motion a portion of a second key-frame panorama subsequent to the display of said first key-frame panorama according to a user position and viewing direction whereby motion is simulated.
Claim 30
Dependent Claim
18 words
The method of claim 25 wherein the step of capturing the plurality of key-frame images includes taking photographs.
Claim 31
Dependent Claim
23 words
The method of claim 25 wherein the step of capturing the plurality of key-frame images includes rendering the images within a computer system.
Claim 32
Dependent Claim
23 words
The method of claim 25 wherein a forward or reverse travel direction is determined by the order in which the keyframes are accessed.
Claim 33
Dependent Claim
22 words
The method of claim 25 wherein a travel speed is determined by accessing each nth key frame where n is an integer.
Claim 34
Dependent Claim
71 words
The method of claim 25 wherein a first segment of key-frame images is linked to a second segment of key-frame images by a control file stored in the storage medium, the control file including stored travel direction for the second segment which is selected by the user selecting a viewing direction at a terminal frame of the fist segment that approximately coincides with the stored travel direction for the second segment.
Claim 35
Dependent Claim
38 words
The method of claim 25 wherein the user actuates an input device to move from a first position through a series of subsequent positions, the method including display successive views of imagery from each of the successive positions.
Claim 36
Dependent Claim
14 words
The method of claim 25 including changing the viewing direction using the input device.
Claim 37
Dependent Claim
27 words
The method of claim 25 including superimposing objects into the display of multiple successive frames at a location that coincides with apparent movement in the 3-D space.
Claim 38
Dependent Claim
40 words
The method of claim 25 including compressing each panorama image using intraframe compression to form the key-frame images, and during playback selecting a portion of the key frame that includes the desired viewed selected by the user for local decompression.
Claim 39
Dependent Claim
17 words
The method of claim 25 including transforming the panorama images to a rectangular projection prior to compression.
References Cited (Backward Citations)
US3909121A
Cited
US4853764A
Cited
US5023725A
Cited
US5541773A
Cited
US5563649A
Cited
US5729471A
Cited
US5703604A
Cited
US5748121A
Cited
US5872575A
Cited
US5708469A
Cited
US6058397A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2005-01-07 | 2005-07-09 | 2006-01-08 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2009-01-07 | 2009-07-09 | 2010-01-08 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2013-01-07 | 2013-07-09 | 2014-01-08 | $7700.00 | Window Closed / Lapsed |