Patent US6567085B1 successfully refreshed from Google Patents.
US6567085B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Display techniques for three-dimensional virtual reality
Assignee: Nokia of America Corp
•
Filing: 1999-12-22
•
Granted: 2003-05-20
•
Expires: 2019-12-22
Abstract
Abstract Although in my co-pending application, so-called "pyramidic panel structures" are employed to adjust the image's vanishing point(s) in accordance with the movement of the user, such structures have the disadvantage that they work primarily for so-called "corridor-like" two-dimensional images. I have recognized that, in accordance with the principles of the invention, viewpoint changes may be also dealt with by partitioning the two-dimensional image into polygon partitions, each corresponding to a surface being depicted in the image, and then coupling the vertices of the polygon partitions with the movement of the user so as to limit distortions. In this latter approach, two-dimensional images are not treated as a perspective, corridor-like image, thereby allowing a wider variety of two-dimensional images to be used with the present invention.
Inventors
- 👤 John T. Edmark
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 17:26
CPC Classifications
G; G06; G06T; G06T15/00; G06T15/10; G06T15/20
Claims Analysis
Total Claims: 28
Claim 1
Independent Claim
159 words
A method for use in processing a view of a three-dimensional world in which a first portion of said world is modeled as computer graphics and a second portion of said world is represented by a two-dimensional image, comprising the steps of: determining the user current viewpoint of the two-dimensional image; partitioning the two-dimensional image into polygon partitions, each corresponding to a desired surface of an object being depicted in the two-dimensional image; warping the polygon partitions in accordance with the movement of the user current viewpoint from the ideal viewing point of the two-dimensional image, such that image points located farther away from the view plane of the user are more closely coupled with the movement of the user's current view point than those points located closer to the view plane; and as the user moves within the three-dimensional world, repeating the above warping step so as to limit discontinuities between said two-dimensional image and the computer graphics.
Claim 2
Independent Claim
159 words
A method for use in processing a view of a three-dimensional world in which a first portion of said world is modeled as computer graphics and a second portion of said world is represented by a two-dimensional image, comprising the steps of: determining the user current viewpoint of the two-dimensional image; partitioning the two-dimensional image into polygon partitions, each corresponding to a desired surface of an object being depicted in the two-dimensional image; warping the polygon partitions in accordance with the movement of the user current viewpoint from the ideal viewing point of the two-dimensional image, such that image points located farther away from the view plane of the user are more closely coupled with the movement of the user's current view point than those points located closer to the view plane; and as the user moves within the three-dimensional world, repeating the above warping step so as to limit discontinuities between said two-dimensional image and the computer graphics.
Claim 3
Dependent Claim
28 words
The invention as defined in claim 1 further comprising the step of calibrating the two-dimensional image as a function of the dimensions of the surroundings within the world.
Claim 4
Dependent Claim
17 words
The invention as defined in claim 1 wherein said two-dimensional image is a not a “corridor-like” image.
Claim 5
Dependent Claim
30 words
The invention as defined in claim 1 further comprising the step of displaying the two-dimensional image merged with the first portion of said world that is modeled as computer graphics.
Claim 6
Dependent Claim
14 words
The invention of claim 1 wherein said two-dimensional image is a frame of video.
Claim 7
Dependent Claim
13 words
The invention of claim 1 wherein said two-dimensional image is a still picture.
Claim 8
Independent Claim
254 words
A method for use in processing a view of a three-dimensional world in which a first portion of said world is modeled as computer graphics and a second portion of said world is represented by a two-dimensional image projected on a view plane having a ideal viewing point (IVP), comprising the steps of: projecting a vector {overscore (C)} from the image's ideal viewing point (IVP) normal to the view plane of the two-dimensional image; partitioning the two-dimensional image into a first set of polygon partitions having vertices labeled Q 1 -Q i , each of said polygon partitions corresponding to a surface being depicted in the two dimensional image, where i is an integer number; projecting a vector {overscore (T)} from the image's ideal viewing point, IVP, to the current viewpoint, V; determining a coupling ratio α i for each vertex given by α i = D i - C _ D i , where D i is the orthogonal distance from the image's ideal viewing point (IVP) to the image plane in the three dimensional space (x,y,z) of the world containing the vertex Q i ; mapping the vertices Q 1 -Q i to Q 1 ′ -Q i ′ , respectively, in the three-dimensional space (x,y,z) of the world according with the following relationship, Q i ′ =Q i +α i {overscore (T)}, thereby defining a second set of polygon partitions; and mapping the corresponding image in said first set of polygon partitions into said second set of polygon partitions.
Claim 9
Independent Claim
254 words
A method for use in processing a view of a three-dimensional world in which a first portion of said world is modeled as computer graphics and a second portion of said world is represented by a two-dimensional image projected on a view plane having a ideal viewing point (IVP), comprising the steps of: projecting a vector {overscore (C)} from the image's ideal viewing point (IVP) normal to the view plane of the two-dimensional image; partitioning the two-dimensional image into a first set of polygon partitions having vertices labeled Q 1 -Q i , each of said polygon partitions corresponding to a surface being depicted in the two dimensional image, where i is an integer number; projecting a vector {overscore (T)} from the image's ideal viewing point, IVP, to the current viewpoint, V; determining a coupling ratio α i for each vertex given by α i = D i - C _ D i , where D i is the orthogonal distance from the image's ideal viewing point (IVP) to the image plane in the three dimensional space (x,y,z) of the world containing the vertex Q i ; mapping the vertices Q 1 -Q i to Q 1 ′ -Q i ′ , respectively, in the three-dimensional space (x,y,z) of the world according with the following relationship, Q i ′ =Q i +α i {overscore (T)}, thereby defining a second set of polygon partitions; and mapping the corresponding image in said first set of polygon partitions into said second set of polygon partitions.
Claim 10
Dependent Claim
28 words
The invention as defined in claim 7 further comprising the step of calibrating the two-dimensional image as a function oft he dimensions of the surroundings within the world.
Claim 11
Dependent Claim
17 words
The invention as defined in claim 7 wherein said two-dimensional image is a not a “corridor-like” image.
Claim 12
Dependent Claim
30 words
The invention as defined in claim 7 further comprising the step of displaying the two-dimensional image merged with the first portion of said world that is modeled as computer graphics.
Claim 13
Dependent Claim
14 words
The invention of claim 7 wherein said two-dimensional image is a frame of video.
Claim 14
Dependent Claim
13 words
The invention of claim 7 wherein said two-dimensional image is a still picture.
Claim 15
Independent Claim
160 words
An apparatus for use in processing a view of a three-dimensional world in which a first portion of said world is modeled as computer graphics and a second portion of said world is represented by a two-dimensional image, said apparatus comprising: means for determining the user current viewpoint of the two-dimensional image; means for partitioning the two-dimensional image into polygon partitions, each corresponding to a desired surface of an object being depicted in the two-dimensional image; and as the user moves within the three-dimensional world, means for repeatingly warping the polygon partitions in accordance with the movement of the user current viewpoint from the ideal viewing point of the two-dimensional image, such that image points located farther away from the view plane of the user are more closely coupled with the movement of the user's current view point than those points located closer to the view plane so as to limit discontinuities between said two-dimensional image and the computer graphics.
Claim 16
Independent Claim
160 words
An apparatus for use in processing a view of a three-dimensional world in which a first portion of said world is modeled as computer graphics and a second portion of said world is represented by a two-dimensional image, said apparatus comprising: means for determining the user current viewpoint of the two-dimensional image; means for partitioning the two-dimensional image into polygon partitions, each corresponding to a desired surface of an object being depicted in the two-dimensional image; and as the user moves within the three-dimensional world, means for repeatingly warping the polygon partitions in accordance with the movement of the user current viewpoint from the ideal viewing point of the two-dimensional image, such that image points located farther away from the view plane of the user are more closely coupled with the movement of the user's current view point than those points located closer to the view plane so as to limit discontinuities between said two-dimensional image and the computer graphics.
Claim 17
Dependent Claim
27 words
The invention as defined in claim 13 further comprising means for calibrating the two-dimensional image as a function of the dimensions of the surroundings within the world.
Claim 18
Dependent Claim
16 words
The invention as defined in claim 13 wherein said two-dimensional image is not a “corridor-like” image.
Claim 19
Dependent Claim
29 words
The invention as defined in claim 13 further comprising means for displaying the two-dimensional image merged with the first portion of said world that is modeled as computer graphics.
Claim 20
Dependent Claim
14 words
The invention of claim 13 wherein said two-dimensional image is a frame of video.
Claim 21
Dependent Claim
13 words
The invention of claim 13 wherein said two-dimensional image is a still picture.
Claim 22
Independent Claim
263 words
An apparatus for use in processing a view of a three-dimensional world in which a first portion of said world is modeled as computer graphics and a second portion of said world is represented by a two-dimensional image projected on a view plane having a ideal viewing point (IVP), said apparatus comprising: means for projecting a vector {overscore (C)} from the image's ideal viewing point (IVP) normal to the view plane of the two-dimensional image; means for partitioning the two-dimensional image into a first set of polygon partitions having vertices labeled Q 1 -Q i , each of said polygon partitions corresponding to a surface being depicted in the two dimensional image, where i is an integer number; means for projecting a vector {overscore (T)} from the image's ideal viewing point, IVP, to the current viewpoint, V; means for determining a coupling ratio α i for each vertex given by α i = D - C _ D , where D i is the orthogonal distance from the image's ideal viewing point (IVP) to the image plane in the three dimensional space (x,y,z) of the world containing the vertex Q i ; means for mapping the vertices Q 1 -Q i to Q 1 ′ -Q i ′ , respectively, in the three-dimensional space (x,y,z) of the world according with the following relationship, Q i ′ =Q i +α i {overscore (T)}, thereby defining a second set of polygon partitions; and means for mapping the corresponding image in said first set of polygon partitions into said second set of polygon partitions.
Claim 23
Independent Claim
263 words
An apparatus for use in processing a view of a three-dimensional world in which a first portion of said world is modeled as computer graphics and a second portion of said world is represented by a two-dimensional image projected on a view plane having a ideal viewing point (IVP), said apparatus comprising: means for projecting a vector {overscore (C)} from the image's ideal viewing point (IVP) normal to the view plane of the two-dimensional image; means for partitioning the two-dimensional image into a first set of polygon partitions having vertices labeled Q 1 -Q i , each of said polygon partitions corresponding to a surface being depicted in the two dimensional image, where i is an integer number; means for projecting a vector {overscore (T)} from the image's ideal viewing point, IVP, to the current viewpoint, V; means for determining a coupling ratio α i for each vertex given by α i = D - C _ D , where D i is the orthogonal distance from the image's ideal viewing point (IVP) to the image plane in the three dimensional space (x,y,z) of the world containing the vertex Q i ; means for mapping the vertices Q 1 -Q i to Q 1 ′ -Q i ′ , respectively, in the three-dimensional space (x,y,z) of the world according with the following relationship, Q i ′ =Q i +α i {overscore (T)}, thereby defining a second set of polygon partitions; and means for mapping the corresponding image in said first set of polygon partitions into said second set of polygon partitions.
Claim 24
Dependent Claim
27 words
The invention as defined in claim 19 further comprising means for calibrating the two-dimensional image as a function of the dimensions of the surroundings within the world.
Claim 25
Dependent Claim
16 words
The invention as defined in claim 19 wherein said two-dimensional image is not a “corridor-like” image.
Claim 26
Dependent Claim
29 words
The invention as defined in claim 19 further comprising means for displaying the two-dimensional image merged with the first portion of said world that is modeled as computer graphics.
Claim 27
Dependent Claim
14 words
The invention of claim 19 wherein said two-dimensional image is a frame of video.
Claim 28
Dependent Claim
13 words
The invention of claim 19 wherein said two-dimensional image is a still picture.
References Cited (Backward Citations)
US3577120A
Cited
US5893798A
Cited
US6016150A
Cited
US6151028A
Cited
US5990900A
Cited
US6236402B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-05-19 | 2006-11-18 | 2007-05-20 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-05-19 | 2010-11-18 | 2011-05-20 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-05-19 | 2014-11-18 | 2015-05-20 | $7700.00 | Window Closed / Lapsed |