Three-dimensional model making device and its method

Claim 2

An image processing apparatus implemented by a computer, comprising: an image data apparatus for supplying single picture frame data corresponding to a single frame picture image; a display displaying the single frame picture image corresponding to single picture frame data; a camera parameter apparatus for determining from one of the single picture frame data and the displayed single frame picture image, camera parameters of a camera used to image the single picture frame data; and a 3-D model extracting apparatus using the camera parameters with respect to the single frame picture image, for extracting 3-D model data for at least one object from one of the single picture frame data and the displayed single frame picture image; wherein the camera parameter apparatus comprises: a designating apparatus for designating with respect to one of the single picture frame data and the displayed single frame picture image, at least two parallel perspective lines and two orthogonal lines; and a calculating apparatus for calculating, using the at least two parallel perspective lines and the two orthogonal lines, the camera parameters including a camera position, a camera line of sight direction and a focus length.

Claim 3

An apparatus as claimed in claim 1, wherein the designating apparatus comprises a user input device including at least one of a computer mouse and computer keyboard, and the at least two parallel perspective lines and two orthogonal lines are interactively designated on the displayed single frame picture image by a user with the user input device.

Claim 4

An apparatus as claimed in claim 1, wherein the designating apparatus is arranged for automatic determining of the at least two parallel perspective lines and two orthogonal lines from computer processing of at least one of the single picture frame data and the displayed single frame picture image, and for allowing user acceptance of the at least two parallel perspective lines and two orthogonal lines.

Claim 5

An image processing apparatus implemented by a computer, comprising: an image data apparatus for supplying single picture frame data corresponding to a single frame picture image; a display displaying the single frame picture image corresponding to single picture frame data; a camera parameter apparatus for determining from one of the single picture frame data and the displayed single frame picture image, camera parameters of a camera used to image the single picture frame data; and a 3-D model extracting apparatus using the camera parameters with respect to the single frame picture image, for extracting 3-D model data for at least one object from one of the single picture frame data and the displayed single frame picture image; wherein the camera parameter apparatus comprises: a designating apparatus for designating with respect to one of the single picture frame data and the displayed single frame picture image, at least two parallel perspective lines and two orthogonal lines; and a calculating apparatus for calculating, using the at least two parallel perspective lines and the two orthogonal lines, the camera parameters including a camera position, a camera line of sight direction and a focus length, wherein the designating apparatus is arranged for automatically determining of candidate lines for the at least two parallel perspective lines and two orthogonal lines from computer processing of at least one of the single picture frame data and the displayed single frame picture image, and for allowing user acceptance of ones of the candidate lines for the at least two parallel perspective lines and two orthogonal lines.

Claim 6

An image processing apparatus implemented by a computer, comprising: an image data apparatus for supplying single picture frame data corresponding to a single frame picture image; a display displaying the single frame picture image corresponding to single picture frame data; a camera parameter apparatus for determining from one of the single picture frame data and the displayed single frame picture image, camera parameters of a camera used to image the single picture frame data; and a 3-D model extracting apparatus using the camera parameters with respect to the single frame picture image, for extracting 3-D model data for at least one object from one of the single picture frame data and the displayed single frame picture image; wherein the camera parameter apparatus comprises: a designating apparatus for designating with respect to one of the single picture frame data and the displayed single frame picture image, at least two parallel perspective lines and two orthogonal lines; and a calculating apparatus for calculating, using the at least two parallel perspective lines and the two orthogonal lines, the camera parameters including a camera position, a camera line of sight direction and a focus length, wherein the designating apparatus is arranged for automatically determining of candidate lines for the at least two parallel perspective lines and two orthogonal lines from computer processing of at least one of the single picture frame data and the displayed single frame picture image, and for allowing user acceptance of ones of the candidate lines for the at least two parallel perspective lines and two orthogonal lines.

Claim 7

An apparatus as claimed in claim 1, wherein the 3-D model extracting apparatus comprises: an extracting apparatus for extracting 3-D model data for at least one of point, line, plane and shape features of the at least one object from one of the single picture frame data and the displayed single frame picture image; and an overlay apparatus for calculating and overlaying, using the 3-D model data, an object model wire frame of the at least one object on the single frame picture image.

Claim 8

An apparatus as claimed in claim 5, wherein the extracting apparatus comprises a user input device including at least one of a computer mouse and computer keyboard, and the 3-D model data are interactively designated on the displayed single frame picture image by a user with the user input device .

Claim 9

An apparatus as claimed in claim 6, wherein the extracting apparatus further uses relating information input by a user with the user input device to extract the 3-D model data, such relating information defining a relationship between at least one of points, lines, planes and shapes of the at least one object.

Claim 10

An apparatus as claimed in claim 6, wherein the extracting apparatus further uses restricting information input by a user with the user input device to extract the 3-D model data, such restricting information restricting a location which can be interactively designated on the displayed single frame picture image by a user with the user input device.

Claim 11

An apparatus as claimed in claim 5, wherein the extracting apparatus is arranged for automatically determining of the 3-D model data from computer processing of the at least one of the single picture frame data and the displayed single frame picture image, and for allowing user acceptance of the 3-D model data.

Claim 12

An apparatus as claimed in claim 5, wherein the extracting apparatus is arranged for automatically determining of candidate lines for the 3-D model data from computer processing of the at least one of the single picture frame data and the displayed single frame picture image, and for allowing user acceptance of ones of the candidate lines for the 3-D model data.

Claim 13

An image processing method implemented by a computer, comprising the steps of: supplying single picture frame data corresponding to a single frame picture image; displaying the single frame picture image corresponding to single picture frame data; determining from one of the single picture frame data and the displayed single frame picture image, camera parameters of a camera used to image the single picture frame data; and extracting, using the camera parameters with respect to the single frame picture image, 3-D model data for at least one object from one of the single picture frame data and the displayed single frame picture image; wherein the determining step comprises the sub-steps of: designating with respect to one of the single picture frame data and the displayed single frame picture image, at least two parallel perspective lines and two orthogonal lines; and calculating, using the at least two parallel perspective lines and the two orthogonal lines, the camera parameters including a camera position, a camera line of sight direction and a focus length.

Claim 14

An image processing method implemented by a computer, comprising the steps of: supplying single picture frame data corresponding to a single frame picture image; displaying the single frame picture image corresponding to single picture frame data; determining from one of the single picture frame data and the displayed single frame picture image, camera parameters of a camera used to image the single picture frame data; and extracting, using the camera parameters with respect to the single frame picture image, 3-D model data for at least one object from one of the single picture frame data and the displayed single frame picture image; wherein the determining step comprises the sub-steps of: designating with respect to one of the single picture frame data and the displayed single frame picture image, at least two parallel perspective lines and two orthogonal lines; and calculating, using the at least two parallel perspective lines and the two orthogonal lines, the camera parameters including a camera position, a camera line of sight direction and a focus length.

Claim 15

A method as claimed in claim 11, wherein the designating step includes use of a user input device including at least one of a computer mouse and computer keyboard, and the at least two parallel perspective lines and two orthogonal lines are interactively designated on the displayed single frame picture image by a user with the user input device.

Claim 16

A method as claimed in claim 11, wherein the designating step includes the sub-steps of automatic determining the at least two parallel perspective lines and two orthogonal lines from computer processing of at least one of the single picture frame data and the displayed single frame picture image, and allowing user acceptance of the at least two parallel perspective lines and two orthogonal lines.

Claim 17

A method as claimed in claim 11, wherein the designating apparatus includes the sub-steps of automatically determining of candidate lines for the at least two parallel perspective lines and two orthogonal lines from computer processing of at least one of the single picture frame data and the displayed single frame picture image, and allowing user acceptance of ones of the candidate lines for the at least two parallel perspective lines and two orthogonal lines.

Claim 18

A method as claimed in claim 11, wherein the extracting step comprises the sub-steps of: sub-extracting 3-D model data for at least one of point, line, plane and shape features of the at least one object from one of the single picture frame data and the displayed single frame picture image; and calculating and overlaying, using the 3-D model data, an object model wire frame of the at least one object on the single frame picture image.

Claim 19

A method as claimed in claim 15, wherein extracting step includes use of a user input device including at least one of a computer mouse and computer keyboard, and the 3-D model data are interactively designated on the displayed single frame picture image by a user with the user input device.

Claim 20

A method as claimed in claim 16, wherein the extracting step includes use of relating information input by a user with the user input device to extract the 3-D model data, such relating information defining a relationship between at least one of points, lines, planes and shapes of the at least one object.

Claim 21

A method as claimed in claim 16, wherein the extracting step further uses restricting information input by a user with the user input device to extract the 3-D model data, such restricting information restricting a location which can be interactively designated on the displayed single frame picture image by a user with the user input device.

Claim 22

A method as claimed in claim 15, wherein the extracting step performs the sub-steps of automatically determining the 3-D model data from computer processing of the at least one of the single picture frame data and the displayed single frame picture image, and allowing user acceptance of the 3-D model data.

Claim 23

A method as claimed in claim 15, wherein the extracting step performs the sub-steps of automatically determining candidate lines for the 3-D model data from computer processing of the at least one of the single picture frame data and the displayed single frame picture image, and allowing user acceptance of ones of the candidate lines for the 3-D model data.