US5287437A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for head tracked display of precomputed stereo images
Assignee: Sun Microsystems Inc
•
Filing: 1992-06-02
•
Granted: 1994-02-15
•
Expires: 2012-06-02
Abstract
Abstract A method and apparatus for generating complex 3D stereo images in response to real time viewer head movement by dynamically accessing pairs of stereo images selected from among a precomputed set of images. The precomputed images correspond to a predetermined set of possible viewpoints, and are accessed based upon a prediction of viewer head movement. The arrangement of predetermined viewpoints may be along one, two, or three dimensions.
Inventors
- 👤 Michael Deering
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-28 12:59
CPC Classifications
G; G06; G06T; G06T15/00; G06T15/10; H; H04; H04N; H04N13/00; H04N13/20; H04N13/275; H04N13/279; H04N13/30; H04N13/302; H04N13/32; H04N13/366; H04N13/368; H04N13/373; H04N13/204; H04N13/243; H04N13/286; H04N13/289; H04N13/349; H04N13/376; H04N13/378; H04N13/38; H04N13/383
Claims Analysis
Total Claims: 19
Claim 1
Independent Claim
174 words
A method for generating a head tracked stereo image, comprising the steps of: (a) generating precomputed images corresponding to a set of predetermined viewpoints of a virtual object, such that the predetermined viewpoints and the virtual object are defined in a display plate coordinate space registered to a display screen of a display device; (b) determining a time index for displaying the precomputed images in stereo on the display device; (c) predicting an eye first nodal point for each eye of a viewer corresponding to the time index, such that the eye first nodal points are located in the display plate coordinate space; (d) determining the predetermined viewpoints having the closest proximity in the display plate coordinate space to the eye first nodal points; (e) accessing the precomputed images corresponding to the predetermined viewpoints having the closest proximity in the display plate coordinate space to the eye first nodal points, and transferring the precomputed images to a frame buffer; (f) displaying the precomputed images in the frame buffer in stereo on the display device.
Claim 2
Independent Claim
174 words
A method for generating a head tracked stereo image, comprising the steps of: (a) generating precomputed images corresponding to a set of predetermined viewpoints of a virtual object, such that the predetermined viewpoints and the virtual object are defined in a display plate coordinate space registered to a display screen of a display device; (b) determining a time index for displaying the precomputed images in stereo on the display device; (c) predicting an eye first nodal point for each eye of a viewer corresponding to the time index, such that the eye first nodal points are located in the display plate coordinate space; (d) determining the predetermined viewpoints having the closest proximity in the display plate coordinate space to the eye first nodal points; (e) accessing the precomputed images corresponding to the predetermined viewpoints having the closest proximity in the display plate coordinate space to the eye first nodal points, and transferring the precomputed images to a frame buffer; (f) displaying the precomputed images in the frame buffer in stereo on the display device.
Claim 3
Dependent Claim
63 words
The method of claim 1, wherein step (a) comprises the steps of: (g) selecting an arrangement in the display plate coordinate space for the predetermined viewpoints; (h) rendering the precomputed images corresponding to the predetermined viewpoints of the virtual object using a graphics rendering system; (i) storing the precomputed images, such that the precomputed images are accessed by specifying the corresponding predetermined viewpoint.
Claim 4
Dependent Claim
38 words
The method of claim 2, wherein step (b) comprises the step of generating the precomputed images corresponding to the predetermined viewpoints of the virtual object by image sampling a real object having the appearance of the virtual object.
Claim 5
Dependent Claim
25 words
The method of claim 2, further comprising the step of performing a data compression on the precomputed images after step (b) and before step (c).
Claim 6
Dependent Claim
138 words
The method of claim 1, wherein step (c) comprises the steps of: (g) sensing dynamic locations and orientations of the viewer in the display plate coordinate space; (h) determining a location and orientation of the viewer for a next frame of the display device by performing an interpolation of the dynamic locations and orientations of the viewer; (i) determining locations of the eyeballs of the viewer in the display plate coordinate space for the next frame, based upon the location and orientation of the viewer for the next frame of the display device, and a predetermined location of the eyeballs of the viewer relative to the location of the head of the viewer; (j) determining locations of the eye first nodal points of the viewer in the display plate coordinate space based upon the locations of the eyeballs.
Claim 7
Dependent Claim
41 words
The method of claim 5, wherein the interpolation in step (b) is reduced by a filter function at small velocities of the head of the viewer in order to reduce jitter of a stereo image when the viewer's head is still.
Claim 8
Dependent Claim
88 words
The method of claim 1, wherein step (e) comprises the steps of: (g) retrieving the precomputed images from a storage means, such that the precomputed images are in a compressed format; (h) decompressing the precomputed images retrieved from the storage means; (i) storing the decompressed precomputed images into the frame buffer, such that the frame buffer is double buffered and the decompressed precomputed images are transferred to a first buffer in the frame buffer while a second buffer in the frame buffer is accessed by the display device.
Claim 9
Independent Claim
156 words
A method for generating a head tracked stereo image, comprising the steps of: (a) predicting an eye first nodal point for each eye of a viewer, such that the eye first nodal points correspond to points in a display plate coordinate space registered to a display screen of a display device; (b) comparing the eye first nodal points to a set of predetermined viewpoints defined in the display plate coordinate space, each of the predetermined viewpoints corresponding to a viewpoint of a video camera generating a live video signal; (c) determining the predetermined viewpoints having the closest proximity in the display plate coordinate space to the eye first nodal points; (d) selectively coupling to the display device the video signals from the video cameras corresponding to the predetermined viewpoints having the closest proximity in the display plate coordinate space to the eye first nodal points; (e) displaying the video signals in stero on the display device.
Claim 10
Independent Claim
156 words
A method for generating a head tracked stereo image, comprising the steps of: (a) predicting an eye first nodal point for each eye of a viewer, such that the eye first nodal points correspond to points in a display plate coordinate space registered to a display screen of a display device; (b) comparing the eye first nodal points to a set of predetermined viewpoints defined in the display plate coordinate space, each of the predetermined viewpoints corresponding to a viewpoint of a video camera generating a live video signal; (c) determining the predetermined viewpoints having the closest proximity in the display plate coordinate space to the eye first nodal points; (d) selectively coupling to the display device the video signals from the video cameras corresponding to the predetermined viewpoints having the closest proximity in the display plate coordinate space to the eye first nodal points; (e) displaying the video signals in stero on the display device.
Claim 11
Independent Claim
177 words
An apparatus for generating a head tracked stereo image, comprising: means for generating precomputed images corresponding to a set of predetermined viewpoints of a virtual object, such that the predetermined viewpoints and the virtual object are defined in a display plate coordinate space registered to a display screen of a display device; means for determining a time index for displaying the precomputed images in stereo on the display device; means for predicting an eye first nodal point for each eye of a viewer corresponding to the time index, such that the eye first nodal points are located in the display plate coordinate space; means for determining the predetermined viewpoints having the closest proximity in the display plate coordinate space to the eye first nodal points; means for accessing the precomputed images corresponding to the predetermined viewpoints having the closest proximity in the display plate coordinate space to the eye first nodal points, and transferring the precomputed images to a frame buffer; means for displaying the precomputed images in the frame buffer in stereo on the display device.
Claim 12
Independent Claim
177 words
An apparatus for generating a head tracked stereo image, comprising: means for generating precomputed images corresponding to a set of predetermined viewpoints of a virtual object, such that the predetermined viewpoints and the virtual object are defined in a display plate coordinate space registered to a display screen of a display device; means for determining a time index for displaying the precomputed images in stereo on the display device; means for predicting an eye first nodal point for each eye of a viewer corresponding to the time index, such that the eye first nodal points are located in the display plate coordinate space; means for determining the predetermined viewpoints having the closest proximity in the display plate coordinate space to the eye first nodal points; means for accessing the precomputed images corresponding to the predetermined viewpoints having the closest proximity in the display plate coordinate space to the eye first nodal points, and transferring the precomputed images to a frame buffer; means for displaying the precomputed images in the frame buffer in stereo on the display device.
Claim 13
Dependent Claim
78 words
The apparatus of claim 9, wherein the means for generating precomputed images corresponding to a set of predetermined viewpoints of a virtual object comprises: means for selecting an arrangement in the display plate coordinate space for the predetermined viewpoints; graphics rendering means, the graphics rendering means generating the precomputed images corresponding to the predetermined viewpoints of the virtual object; means for storing the precomputed images, such that the precomputed images are accessed by specifying the corresponding predetermined viewpoint.
Claim 14
Dependent Claim
25 words
The apparatus of claim 10, wherein the graphics rendering means comprises means for image sampling a real object having the appearance of the virtual object.
Claim 15
Dependent Claim
17 words
The apparatus of claim 10, further comprising means for performing a data compression on the precomputed images.
Claim 16
Dependent Claim
155 words
The apparatus of claim 9, wherein the means for predicting an eye first nodal point for each eye of a viewer comprises: means for sensing dynamic locations and orientations of the viewer in the display plate coordinate space; means for determining a location and orientation of the viewer for a next frame of the display device by performing an interpolation of the dynamic locations and orientations of the viewer; means for determining locations of the eyeballs of the viewer in the display plate coordinate space for the next frame, based upon the location and orientation of the head of the viewer for the next frame of the display device, and a predetermined location of the eyeballs of the viewer relative to the location of the head of the viewer; means for determining locations of the eye first nodal points of the viewer in the display plate coordinate space based upon the locations of the eyeballs.
Claim 17
Dependent Claim
38 words
The apparatus of claim 13, wherein the interpolation is reduced by a filter function at small velocities of the head of the viewer in order to reduce jitter of a stereo image when the viewer's head is still.
Claim 18
Dependent Claim
40 words
The apparatus of claim 13, wherein interocular distance for the viewer is used in addition to the location and orientation of the head of the viewer for the next frame of the display device to accurately determine the eyeball locations.
Claim 19
Dependent Claim
93 words
The apparatus of claim 9, wherein the means for accessing the precomputed images comprises: means for retrieving the precomputed images from a storage means, such that the precomputed images are in a compressed format; means for decompressing the precomputed images retrieved from the storage means; means for storing the decompressed precomputed images into the frame buffer, such that the frame buffer is double buffered and the decompressed precomputed images are transferred to a first buffer in the frame buffer while a second buffer in the frame buffer is accessed by the display device.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1997-02-14 | 1997-08-16 | 1998-02-15 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2001-02-14 | 2001-08-16 | 2002-02-15 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2005-02-14 | 2005-08-16 | 2006-02-15 | $7700.00 | Window Closed / Lapsed |