US6031941A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Three-dimensional model data forming apparatus
Assignee: Canon Inc
•
Filing: 1996-12-20
•
Granted: 2000-02-29
•
Expires: 2016-12-20
Abstract
Abstract In a three-dimensional shape extraction apparatus, a distance distribution extraction unit (54) obtains the distance distribution of an object on the basis of a plurality of images which are sensed by a camera at different image sensing positions, so that the images of the object partially overlap each other, and the position information of the respective image sensing positions of the camera. A three-dimensional model forming unit (55) forms a three-dimensional model of the object by sequentially combining the sequentially calculated distance distributions and the sensed images using the position information. A 3D display image generation unit (56) generates and displays a two-dimensional image from the three-dimensional model.
Inventors
- 👤 Kotaro Yano
- 👤 Katsumi Iijima
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 18:52
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/50; G06T7/55; G06T7/571
Claims Analysis
Total Claims: 40
Claim 1
Independent Claim
231 words
A three-dimensional model data forming apparatus for forming three-dimensional model data of an object sensed by image sensing means, comprising: first detection means for detecting an image sensing position of said image sensing means; second detection means for detecting a lens position of said image sensing means; calculation means for calculating a parameter on the basis of outputs from said first and second detection means; distance distribution extraction means for extracting a distance distribution of the object on the basis of a plurality of images which are sensed by said image sensing means at a plurality of image sensing positions so that the respective images of the object partially overlap each other, and the parameter calculated by said calculation means; three-dimensional model data forming means for forming the three-dimensional model data of the object on the basis of the distance distribution extracted by said distance distribution extraction means, the plurality of images, and the parameter; two-dimensional image generation means for generating a two-dimensional image on the basis of the three-dimensional model data output from said three-dimensional model data forming means; and monitoring means for displaying the two-dimensional image and for designating the displayed two-dimensional image corresponding to a part shape of the object, so that it is possible to visually monitor a forming process for forming three-dimensional model data corresponding to a desired portion of the three-dimensional shape of the object.
Claim 2
Dependent Claim
231 words
A three-dimensional model data forming apparatus for forming three-dimensional model data of an object sensed by image sensing means, comprising: first detection means for detecting an image sensing position of said image sensing means; second detection means for detecting a lens position of said image sensing means; calculation means for calculating a parameter on the basis of outputs from said first and second detection means; distance distribution extraction means for extracting a distance distribution of the object on the basis of a plurality of images which are sensed by said image sensing means at a plurality of image sensing positions so that the respective images of the object partially overlap each other, and the parameter calculated by said calculation means; three-dimensional model data forming means for forming the three-dimensional model data of the object on the basis of the distance distribution extracted by said distance distribution extraction means, the plurality of images, and the parameter; two-dimensional image generation means for generating a two-dimensional image on the basis of the three-dimensional model data output from said three-dimensional model data forming means; and monitoring means for displaying the two-dimensional image and for designating the displayed two-dimensional image corresponding to a part shape of the object, so that it is possible to visually monitor a forming process for forming three-dimensional model data corresponding to a desired portion of the three-dimensional shape of the object.
Claim 3
Dependent Claim
50 words
The apparatus according to claim 1, wherein said three-dimensional model data forming means describes the three-dimensional model data using parameters of a pixel value and a radial component of a three-dimensional polar coordinate system with respect to an address designated by two angle parameters of the three-dimensional polar coordinate system.
Claim 4
Dependent Claim
87 words
The apparatus according to claim 2, wherein said two-dimensional image generation means describes the three-dimensional model data at an address designated by a two-dimensional model at an address designated by a two-dimensional orthogonal coordinate system by performing a viewing transformation on the basis of directions of coordinate axes of a coordinate system, a view point position, and a visual axis direction of a display image, which are set in advance, and the parameters of the pixel value and the radial component of the three-dimensional polar coordinate system.
Claim 5
Dependent Claim
38 words
The apparatus according to claim 1, wherein said calculation means calculates view point position data, view point moving amount data, and optical axis rotation amount data in accordance with the outputs from said first and second detection means.
Claim 6
Dependent Claim
40 words
The apparatus according to claim 4, wherein said calculation means calculates the view point moving amount data and the optical axis rotation amount data in accordance with the output from said first detection means and predetermined view point conversion data.
Claim 7
Dependent Claim
34 words
The apparatus according to claim 4, wherein said calculation means calculates the view point position data on the basis of the output from said second detection means and predetermined view point position correction data.
Claim 8
Dependent Claim
34 words
The apparatus according to claim 1, wherein said distance distribution extraction means extracts a predetermined object from each of the plurality of images, and extracts the distance distribution with respect to the extracted object.
Claim 9
Dependent Claim
27 words
The apparatus according to claim 1, wherein said monitoring means is also for displaying the image sensed by said image sensing means together with the two-dimensional image.
Claim 10
Dependent Claim
22 words
The apparatus according to claim 1, wherein said distance distribution extraction means performs matching processing of corresponding points between two image data.
Claim 11
Dependent Claim
35 words
The apparatus according to claim 9, wherein said distance distribution extraction means calculates a distance to the object on the basis of a pair of corresponding points obtained by the matching processing and the parameter.
Claim 12
Dependent Claim
35 words
The apparatus according to claim 1, wherein said distance distribution extraction means extracts a predetermined object from each of the plurality of images, and performs matching processing of corresponding points between the two extracted objects.
Claim 13
Dependent Claim
35 words
The apparatus according to claim 11, wherein said distance distribution extraction means calculates a distance to the object on the basis of a pair of corresponding points obtained by the matching processing and the parameter.
Claim 14
Dependent Claim
26 words
The apparatus according to claim 1, wherein said three-dimensional model data forming means converts the distance distribution into polar coordinates on the basis of the parameter.
Claim 15
Dependent Claim
26 words
The apparatus according to claim 13, further comprising storage means for storing the distance distribution using a coordinate value of the polar coordinates as an address.
Claim 16
Independent Claim
217 words
A method of forming three-dimensional model data of an object sensed by image sensing means, comprising the steps of: first detection step of detecting an image sensing position of said image sensing means; second detection step of detecting a lens position of said image sensing means; calculation step of calculating a parameter on the basis of outputs from said first and second detection steps; extraction step of extracting a distance distribution of the object on the basis of a plurality of images which are sensed by said images sensing means at a plurality of image sensing positions so that the respective images of the object partially overlap each other, and the parameter calculated by said calculation step; forming step of forming three-dimensional model data of the object on the basis of the distance distribution extracted by said extraction step, the plurality of images, and the parameter; generation step of generating a two-dimensional image of the basis of the three-dimensional model data formed in said forming step; and monitoring step of displaying the two-dimensional image and of designating the displayed two-dimensional image corresponding to a part shape of the object, so that it is possible to visually monitor a forming process for forming three-dimensional model data corresponding to a desired portion of the three-dimensional shape of the object.
Claim 17
Independent Claim
217 words
A method of forming three-dimensional model data of an object sensed by image sensing means, comprising the steps of: first detection step of detecting an image sensing position of said image sensing means; second detection step of detecting a lens position of said image sensing means; calculation step of calculating a parameter on the basis of outputs from said first and second detection steps; extraction step of extracting a distance distribution of the object on the basis of a plurality of images which are sensed by said images sensing means at a plurality of image sensing positions so that the respective images of the object partially overlap each other, and the parameter calculated by said calculation step; forming step of forming three-dimensional model data of the object on the basis of the distance distribution extracted by said extraction step, the plurality of images, and the parameter; generation step of generating a two-dimensional image of the basis of the three-dimensional model data formed in said forming step; and monitoring step of displaying the two-dimensional image and of designating the displayed two-dimensional image corresponding to a part shape of the object, so that it is possible to visually monitor a forming process for forming three-dimensional model data corresponding to a desired portion of the three-dimensional shape of the object.
Claim 18
Dependent Claim
47 words
The method according to claim 15, wherein said forming step describes the three-dimensional model data using parameters of a pixel value and a radial component of a three-dimensional polar coordinate system with respect to an address designated by two angle parameters of the three-dimensional polar coordinate system.
Claim 19
Dependent Claim
77 words
The method according to claim 16, wherein said generation step describes the three-dimensional model data at an address designated by a two-dimensional orthogonal coordinate system by performing a viewing transformation on the basis of directions of coordinate axes of a coordinate system, a view point position, and a visual axis direction of a display image, which are set in advance, and the parameters of the pixel value and the radial component of the three-dimensional polar coordinate system.
Claim 20
Dependent Claim
39 words
The method according to claim 15, wherein said calculation step calculates view point position data, view point moving amount data, and optical axis rotation amount data in accordance with the detected results in said first and second detection steps.
Claim 21
Dependent Claim
41 words
The method according to claim 18, wherein said calculation step calculates the view point moving amount data and the optical axis rotation amount data in accordance with the detected results in said first detection steps and predetermined view point conversion data.
Claim 22
Dependent Claim
35 words
The method according to claim 17, wherein said calculation step calculates the view point position data on the basis of the detected result in said second detection step and predetermined view point position correction data.
Claim 23
Dependent Claim
32 words
The method according to claim 15, wherein said extraction step extracts a predetermined object from each of the plurality of images, and extracts the distance distribution with respect to the extracted object.
Claim 24
Dependent Claim
25 words
The method according to claim 15, wherein said monitoring step also displays the image sensed by said image sensing means together with the two-dimensional image.
Claim 25
Dependent Claim
20 words
The method according to claim 15, wherein said extraction step performs matching processing of corresponding points between two image data.
Claim 26
Dependent Claim
33 words
The method according to claim 23, wherein said extraction step calculates a distance to the object on the basis of a pair of corresponding points obtained by the matching processing and the parameter.
Claim 27
Dependent Claim
33 words
The method according to claim 15, wherein said extraction means extracts a predetermined object from each of the plurality of images, and performs matching processing of corresponding points between the two extracted objects.
Claim 28
Dependent Claim
33 words
The method according to claim 25, wherein said extraction step calculates a distance to the object on the basis of a pair of corresponding points obtained by the matching processing and the parameter.
Claim 29
Dependent Claim
23 words
The method according to claim 15, wherein said forming step converts the distance distribution into polar coordinates on the basis of the parameter.
Claim 30
Dependent Claim
26 words
The method according to claim 27, further comprising storage step of storing the distance distribution using a coordinate value of the polar coordinates as an address.
Claim 31
Dependent Claim
229 words
A three-dimensional model data processing apparatus for processing three-dimensional model data of an object sensed by image sensing means, comprising; first input means for inputting an image sensing position of said image sensing means; second input means for inputting operating state information of said image sensing means; calculation means for calculating a parameter on the basis of outputs from said first and second detection means; distance distribution detecting means for detecting a distance distribution of the object on the basis of a plurality of images which are sensed by said image sensing means at a plurality of image sensing positions so that the respective images of the object partially overlap each other, the parameter calculated by said calculation means; three-dimensional model data forming means for forming a three-dimensional model data of the object on the basis of the distance distribution detected by said distance distribution detecting means, the plurality of images, and the parameter; two-dimensional image generation means for generating a two-dimensional image on the basis of the three-dimensional model data output from said three-dimensional model data forming means; and monitoring means for displaying the two-dimensional image and for designating the displayed two-dimensional image corresponding to a part shape of the object, so that it is possible to visually monitor a processing for forming three-dimensional model data corresponding to a desired portion of the three-dimensional shape of the object.
Claim 32
Dependent Claim
229 words
A three-dimensional model data processing apparatus for processing three-dimensional model data of an object sensed by image sensing means, comprising; first input means for inputting an image sensing position of said image sensing means; second input means for inputting operating state information of said image sensing means; calculation means for calculating a parameter on the basis of outputs from said first and second detection means; distance distribution detecting means for detecting a distance distribution of the object on the basis of a plurality of images which are sensed by said image sensing means at a plurality of image sensing positions so that the respective images of the object partially overlap each other, the parameter calculated by said calculation means; three-dimensional model data forming means for forming a three-dimensional model data of the object on the basis of the distance distribution detected by said distance distribution detecting means, the plurality of images, and the parameter; two-dimensional image generation means for generating a two-dimensional image on the basis of the three-dimensional model data output from said three-dimensional model data forming means; and monitoring means for displaying the two-dimensional image and for designating the displayed two-dimensional image corresponding to a part shape of the object, so that it is possible to visually monitor a processing for forming three-dimensional model data corresponding to a desired portion of the three-dimensional shape of the object.
Claim 33
Dependent Claim
50 words
The apparatus according to claim 29, wherein said three-dimensional model data forming means describes the three-dimensional model data using parameters of a pixel value and a radial component of a three-dimensional polar coordinate system with respect to an address designated by two angle parameters of the three-dimensional polar coordinate system.
Claim 34
Dependent Claim
79 words
The apparatus according to claim 30, wherein said two-dimensional image generation means describes the three-dimensional model data at an address designated by a two-dimensional orthogonal coordinate system by performing a viewing transformation on the basis of directions of coordinate axes of a coordinate system, a view point position, and a visual axis direction of a display image, which are set in advance, and the parameters of the pixel value and the radial component of the three-dimensional polar coordinate system.
Claim 35
Dependent Claim
38 words
The apparatus according to claim 29, wherein said calculation means calculates view point position data, view point moving amount data, and optical axis rotation amount data in accordance with the outputs from said first and second input means.
Claim 36
Dependent Claim
40 words
The apparatus according to claim 32, wherein said calculation means calculates the view point moving amount data and the optical axis rotation amount data in accordance with the output from said first input means and predetermined view point conversion data.
Claim 37
Dependent Claim
34 words
The apparatus according to claim 32, wherein said calculation means calculates the view point position data on the basis of the output from said second input means and predetermined view point position correction data.
Claim 38
Dependent Claim
27 words
The apparatus according to claim 29, wherein said monitoring means is also for displaying the image sensed by said image sensing means together with the two-dimensional image.
Claim 39
Dependent Claim
48 words
The apparatus according to claim 29, wherein said distance distribution detecting means performs matching processing of corresponding points or images between two image data and calculates a distance to the object on the basis of a pair of corresponding points obtained by the matching processing and the parameter.
Claim 40
Dependent Claim
26 words
The apparatus according to claim 29, wherein said three-dimensional model data processing means converts the distance distribution into polar coordinates on the basis of the parameter.
References Cited (Backward Citations)
US5247590A
Cited
US5185667A
Cited
US5559574A
Cited
US5592563A
Cited
US5410346A
Cited
US5647019A
Cited
US5598486A
Cited
US5668631A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-02-28 | 2003-08-30 | 2004-02-29 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-02-28 | 2007-08-30 | 2008-02-29 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-02-28 | 2011-08-30 | 2012-02-29 | $7700.00 | Window Closed / Lapsed |