Patent EP0125033A1 successfully refreshed from Google Patents.
Patent US7602404B1 successfully refreshed from Google Patents.
US7602404B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for image assisted modeling of three-dimensional scenes
Assignee: Adobe Inc
•
Filing: 2000-04-27
•
Granted: 2009-10-13
•
Expires: 2020-04-27
Abstract
Abstract A computer-assisted technique for constructing a three-dimensional model on top of one or more images (e.g., photographs) such that the model's parameters automatically match those of the real world object depicted in the photograph(s). Camera parameters such as focal length, position, and orientation in space may be determined from the images such that the projection of a three-dimensional model through the calculated camera parameters matches the projection of the real world object through the camera onto the image surface. Modeling is accomplished using primitives, such as boxes or pyramids, which may be intuitively manipulated to construct the three-dimensional model on a video display or other display screen of a computer system with a two-dimensional input controller (e.g., a mouse, joystick, etc.) such that the displayed three-dimensional object manipulation emulates physical three-dimensional object manipulation. Camera and primitive parameters are incrementally updated to provide visual feedback of the effect of additional constraints on the three-dimensional model, making apparent which user action may have been responsible for any failure to provide a modeling solution and, thus, allowing for rapid reversal and correction thereof. Surface properties (i.e., textures) may be extracted from the images for use in the three-dimensional model.
Inventors
- 👤 Tilman Reinhardt
- 👤 Robert Seidl
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-03 13:26
CPC Classifications
G; G06; G06T; G06T17/00; G01; G01C; G01C11/00; G06T7/00; G06T7/70; G06T7/73; G06T7/75; G06T7/80
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
141 words
A method, comprising: using a computer to implement: determining, from a single image obtained from a single real-world camera and as a result of manipulating one or more geometric primitives superimposed over the single image, one or more camera parameters of the single real-world camera from which the image was obtained such that a projection of a computer-generated three-dimensional model, which includes the one or more geometric primitives, through the determined camera parameters approximates the projection of a real-world object depicted in the image as seen through the real-world camera, wherein the one or more camera parameters include focal length, wherein the one or more camera parameters are refined based upon manipulating the one or more geometric primitives, wherein the one or more geometric primitives are three-dimensional objects, and wherein the single image is obtained from a scanner, or from memory.
Claim 2
Independent Claim
141 words
A method, comprising: using a computer to implement: determining, from a single image obtained from a single real-world camera and as a result of manipulating one or more geometric primitives superimposed over the single image, one or more camera parameters of the single real-world camera from which the image was obtained such that a projection of a computer-generated three-dimensional model, which includes the one or more geometric primitives, through the determined camera parameters approximates the projection of a real-world object depicted in the image as seen through the real-world camera, wherein the one or more camera parameters include focal length, wherein the one or more camera parameters are refined based upon manipulating the one or more geometric primitives, wherein the one or more geometric primitives are three-dimensional objects, and wherein the single image is obtained from a scanner, or from memory.
Claim 3
Dependent Claim
17 words
The method of claim 1 wherein the camera parameters comprise focal length, position or orientation in space.
Claim 4
Dependent Claim
32 words
The method of claim 1 , wherein the one or more camera parameters are further determined using one or more constraints to associate the one or more geometric primitives to the image.
Claim 5
Dependent Claim
72 words
The method of claim 3 , wherein determining the one or more camera parameters of the real-world camera from the image as a result of manipulating the primitives, comprises: setting the one or more camera parameters to respective default values; and incrementally updating the one or more camera parameters to new values for each additional geometric primitive used to generate the three-dimensional model that approximates the real-world object depicted in the image.
Claim 6
Dependent Claim
26 words
The method of claim 4 , wherein the one or more camera parameters are further incrementally updated to the new values for each additional constraint used.
Claim 7
Dependent Claim
19 words
The method of claim 4 , wherein the one or more camera parameters are made available after each update.
Claim 8
Dependent Claim
27 words
The method of claim 1 , wherein each geometric primitive corresponds to a wireframe rendering, and wherein the wireframe rendering is used to generate the three-dimensional model.
Claim 9
Dependent Claim
20 words
The method of claim 1 , wherein the image is obtained from a digital camera, or a video capture device.
Claim 10
Dependent Claim
138 words
A computer-readable storage medium storing a computer-based model, comprising one or more virtual cameras each having parameters determined as a result of manipulating one or more geometric primitives superimposed over a digital representation of a single respective image derived from a corresponding single real-world camera, wherein a projection of the computer-based model through the parameters of the one or more virtual cameras approximates the projection of one or more real-world objects depicted in the digital representation of the single image as seen through the single real-world camera, wherein the one or more camera parameters include focal length, wherein the one or more camera parameters are refined based upon manipulating the one or more geometric primitives, wherein the one or more geometric primitives are three-dimensional objects, and wherein the single image is obtained from a scanner, or from memory.
Claim 11
Dependent Claim
138 words
A computer-readable storage medium storing a computer-based model, comprising one or more virtual cameras each having parameters determined as a result of manipulating one or more geometric primitives superimposed over a digital representation of a single respective image derived from a corresponding single real-world camera, wherein a projection of the computer-based model through the parameters of the one or more virtual cameras approximates the projection of one or more real-world objects depicted in the digital representation of the single image as seen through the single real-world camera, wherein the one or more camera parameters include focal length, wherein the one or more camera parameters are refined based upon manipulating the one or more geometric primitives, wherein the one or more geometric primitives are three-dimensional objects, and wherein the single image is obtained from a scanner, or from memory.
Claim 12
Dependent Claim
27 words
The computer-readable storage medium of claim 9 , wherein the parameters of the virtual cameras are further determined using one or more constraints associated with the primitives.
Claim 13
Dependent Claim
21 words
The computer-readable storage medium of claim 9 , wherein the one or more geometric primitives include simple primitives and compound primitives.
Claim 14
Dependent Claim
26 words
The computer-readable storage medium of claim 11 , wherein the simple primitives include box primitives, pyramid primitives, cylinder primitives, linear extrusion primitives, and rotation symmetric primitives.
Claim 15
Dependent Claim
21 words
The computer-readable storage medium of claim 11 , wherein the each of the compound primitives include two or more simple primitives.
Claim 16
Dependent Claim
19 words
The computer-readable storage medium of claim 9 , wherein each of the primitives is represented as a wireframe rendering.
Claim 17
Dependent Claim
15 words
The computer-readable storage medium of claim 9 , wherein the camera parameters are determined incrementally.
Claim 18
Dependent Claim
25 words
The computer-readable storage medium of claim 9 , wherein the one or more images are obtained from a digital camera, or a video capture device.
Claim 19
Dependent Claim
134 words
A computer-readable storage medium, comprising program instructions computer-executable to: determine from a single image obtained from a single real-world camera and in response to manipulation of one or more geometric primitives superimposed over the single image, one or more camera parameters of the single real-world camera from which the image was obtained such that a projection of a computer-generated three-dimensional model through the determined camera parameters approximates a projection of a real-world object depicted in the image as seen through the real-world camera, wherein the one or more camera parameters include focal length, wherein the one or more camera parameters are refined based upon manipulating the one or more geometric primitives, wherein the one or more geometric primitives are three-dimensional objects, and wherein the single image is obtained from a scanner, or from memory.
Claim 20
Dependent Claim
134 words
A computer-readable storage medium, comprising program instructions computer-executable to: determine from a single image obtained from a single real-world camera and in response to manipulation of one or more geometric primitives superimposed over the single image, one or more camera parameters of the single real-world camera from which the image was obtained such that a projection of a computer-generated three-dimensional model through the determined camera parameters approximates a projection of a real-world object depicted in the image as seen through the real-world camera, wherein the one or more camera parameters include focal length, wherein the one or more camera parameters are refined based upon manipulating the one or more geometric primitives, wherein the one or more geometric primitives are three-dimensional objects, and wherein the single image is obtained from a scanner, or from memory.
Claim 21
Dependent Claim
37 words
The storage medium of claim 17 , wherein the program instructions are computer-executable to determine the one or more camera parameters using one or more constraints to associate the one or more geometric primitives to the image.
Claim 22
Dependent Claim
25 words
The storage medium of claim 17 , wherein the one or more camera parameters are incrementally determined with each additional geometric primitive or constraint used.
Claim 23
Dependent Claim
22 words
The storage medium of claim 17 , wherein the image is obtained from a digital camera, or from a video capture device.
References Cited (Backward Citations)
US5003498A
Cited
US5010502A
Cited
US4969036A
Cited
US5682505A
Cited
US5633995A
Cited
US5469536A
Cited
US5761401A
Cited
US5506949A
Cited
US5923336A
Cited
US5850352A
Cited
US5745126A
Cited
US5729471A
Cited
US5699444A
Cited
US5821943A
Cited
US5778169A
Cited
US5748199A
Cited
US6046745A
Cited
US20020059042A1
Cited
US6118474A
Cited
US5923573A
Cited
US20020027559A1
Cited
US6224222B1
Cited
US5986670A
Cited
US6009359A
Cited
US6097394A
Cited
US6333749B1
Cited
US6421049B1
Cited
US6281904B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2012-10-12 | 2013-04-13 | 2013-10-13 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2016-10-12 | 2017-04-13 | 2017-10-13 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2020-10-12 | 2021-04-13 | 2021-10-13 | $7700.00 | Window Closed / Lapsed |