Three-dimensional model processing method, and apparatus therefor

Claim 2

An image processing method comprising: an input step of inputting a range image in which a value of each pixel describes a distance between respective points on an object surface and a reference plane; a normalization step of normalizing the range image along each of three coordinate axes in which a first one is orthogonal to the range image and a second one and a third one are parallel to the range image, by a conversion of the value of each pixel representing the distance along the first coordinate axis in order that unit length along the first coordinate axis should accord with unit length along the second and the third coordinate axes; an arithmetic step of calculating a value representing a property of the object surface described by the normalized range image; and a display step of displaying image information which represents the property of the object surface based upon the value calculated in said arithmetic step.

Claim 3

The method according to claim 1, wherein said arithmetic step includes a step of calculating a linear partial differential from the range image.

Claim 4

The method according to claim 2, wherein said arithmetic step includes a step of calculating a quadratic partial differential from the converted range image, and a step of calculating Guassian curvature of the object surface using the calculated linear and quadratic partial differentials.

Claim 5

The method according to claim 3, wherein said arithmetic step includes a step of discriminating the sign of the calculated Gaussian curvature.

Claim 6

The method according to claim 2, wherein said arithmetic step includes a step of calculating a quadratic partial differential from the converted range image, and a step of calculating mean curvature of the object surface using the calculated linear and quadratic partial differentials.

Claim 7

The method according to claim 5, wherein said arithmetic step includes a step of discriminating the sign of the calculated mean curvature.

Claim 8

The method according to claim 2, wherein said arithmetic step includes a step of calculating a quadratic partial differential from the converted range image, and a step of calculating normal curvature of the object surface using the calculated linear and quadratic partial differentials.

Claim 9

The method according to claim 2, wherein said arithmetic step includes a step of calculating a quadratic partial differential from the converted range image, and a step of calculating radius of curvature of the object surface using the calculated linear and quadratic partial differentials.

Claim 10

The method according to claim 2, wherein said arithmetic step includes a step of calculating a unit normal vector using the calculated linear partial differential.

Claim 11

The method according to claim 1, wherein said arithmetic step includes a step of approximating the range image as a local linear plane and calculating coefficients of an equation thereof.

Claim 12

The method according to claim 1, wherein said arithmetic step includes a step of approximating the range image as a local quadratic surface and calculating coefficients of an equation thereof.

Claim 13

An image processing method comprising: an input step of inputting a range image in which a value of each pixel describes a distance between respective points on an object surface and a reference plane; a normalization step of normalizing the range image along each of three coordinate axes in which a first one is orthogonal to the range image and a second one and a third one are parallel to the range image, by a conversion of the value of each pixel representing the distance along the first coordinate axis in order that unit length along the first coordinate axis should accord with unit length along the second and the third coordinate axes; an arithmetic step of calculating a value representing a property of the object surface described by the normalized range image; and a display step of displaying image information which represents the property of the object surface based upon the value calculated in said arithmetic step, wherein said arithmetic step includes a step of detecting a jump edge from the range image.

Claim 14

An image processing method comprising: an input step of inputting a range image in which a value of each pixel describes a distance between respective points on an object surface and a reference plane; a normalization step of normalizing the range image along each of three coordinate axes in which a first one is orthogonal to the range image and a second one and a third one are parallel to the range image, by a conversion of the value of each pixel representing the distance along the first coordinate axis in order that unit length along the first coordinate axis should accord with unit length along the second and the third coordinate axes; an arithmetic step of calculating a value representing a property of the object surface described by the normalized range image; and a display step of displaying image information which represents the property of the object surface based upon the value calculated in said arithmetic step, wherein said arithmetic step includes a step of detecting a jump edge from the range image.

Claim 15

An image processing method comprising: an input step of inputting a range image in which a value of each pixel describes a distance between respective points on an object surface and a reference plane; a normalization step of normalizing the range image along each of three coordinate axes in which a first one is orthogonal to the range image and a second one and a third one are parallel to the range image, by a conversion of the value of each pixel representing the distance along the first coordinate axis in order that unit length along the first coordinate axis should accord with unit length along the second and the third coordinate axes; an arithmetic step of calculating a value representing a property of the object surface described by the normalized range image; and a display step of displaying image information which represents the property of the object surface based upon the value calculated in said arithmetic step, wherein said arithmetic step includes a step of calculating a quadratic partial differential from the range image.

Claim 16

An image processing method comprising: an input step of inputting a range image in which a value of each pixel describes a distance between respective points on an object surface and a reference plane; a normalization step of normalizing the range image along each of three coordinate axes in which a first one is orthogonal to the range image and a second one and a third one are parallel to the range image, by a conversion of the value of each pixel representing the distance along the first coordinate axis in order that unit length along the first coordinate axis should accord with unit length along the second and the third coordinate axes; an arithmetic step of calculating a value representing a property of the object surface described by the normalized range image; and a display step of displaying image information which represents the property of the object surface based upon the value calculated in said arithmetic step, wherein said arithmetic step includes a step of calculating a quadratic partial differential from the range image.

Claim 17

An image processing method comprising: an input step of inputting a range image in which a value of each pixel describes a distance between respective points on an object surface and a reference plane; a normalization step of normalizing the range image along each of three coordinate axes in which a first one is orthogonal to the range image and a second one and a third one are parallel to the range image, by a conversion of the value of each pixel representing the distance along the first coordinate axis in order that unit length along the first coordinate axis should accord with unit length along the second and the third coordinate axes; an arithmetic step of calculating a value representing a property of the object surface described by the normalized range image; and a display step of displaying image information which represents the property of the object surface based upon the value calculated in said arithmetic step, wherein said arithmetic step includes a partial-differential calculating step of calculating linear and quadratic partial differentials form the range image, a curvature calculating step of calculating Gaussian curvature and mean curvature using the calculated linear and quadratic partial differentials, a sign discriminating step of discriminating the signs of the calculated Gaussian curvature and mean curvature, and a surface-category discriminating step of discriminating surface category by a combination of the discriminated sign of the Gaussian curvature and the discriminated sign of the mean curvature.

Claim 18

An image processing method comprising: an input step of inputting a range image in which a value of each pixel describes a distance between respective points on an object surface and a reference plane; a normalization step of normalizing the range image along each of three coordinate axes in which a first one is orthogonal to the range image and a second one and a third one are parallel to the range image, by a conversion of the value of each pixel representing the distance along the first coordinate axis in order that unit length along the first coordinate axis should accord with unit length along the second and the third coordinate axes; an arithmetic step of calculating a value representing a property of the object surface described by the normalized range image; and a display step of displaying image information which represents the property of the object surface based upon the value calculated in said arithmetic step, wherein said arithmetic step includes a partial-differential calculating step of calculating linear and quadratic partial differentials form the range image, a curvature calculating step of calculating Gaussian curvature and mean curvature using the calculated linear and quadratic partial differentials, a sign discriminating step of discriminating the signs of the calculated Gaussian curvature and mean curvature, and a surface-category discriminating step of discriminating surface category by a combination of the discriminated sign of the Gaussian curvature and the discriminated sign of the mean curvature.

Claim 19

An image processing method comprising: an input step of inputting a range image in which a value of each pixel describes a distance between respective points on an object surface and a reference plane; a normalization step of normalizing the range image along each of three coordinate axes in which a first one is orthogonal to the range image and a second one and a third one are parallel to the range image, by a conversion of the value of each pixel representing the distance along the first coordinate axis in order that unit length along the first coordinate axis should accord with unit length along the second and the third coordinate axes; an arithmetic step of calculating a value representing a property of the object surface described by the normalized range image; and a display step of displaying image information which represents the property of the object surface based upon the value calculated in said arithmetic step, wherein said arithmetic step includes a step of detecting a roof edge from the calculated unit normal vector.

Claim 20

An image processing method comprising: an input step of inputting a range image in which a value of each pixel describes a distance between respective points on an object surface and a reference plane; a normalization step of normalizing the range image along each of three coordinate axes in which a first one is orthogonal to the range image and a second one and a third one are parallel to the range image, by a conversion of the value of each pixel representing the distance along the first coordinate axis in order that unit length along the first coordinate axis should accord with unit length along the second and the third coordinate axes; an arithmetic step of calculating a value representing a property of the object surface described by the normalized range image; and a display step of displaying image information which represents the property of the object surface based upon the value calculated in said arithmetic step, wherein said arithmetic step includes a step of detecting a roof edge from the calculated unit normal vector.

Claim 23

The method according to claim 16, wherein said designating step further includes steps of: projecting the given range image upon three two-dimensional planes and displaying a three-surface view; and designating the axis of symmetry of the object using the three-surface view.

Claim 26

The apparatus according to claim 18, further comprising means for storing the constructed three-dimensional shape model in a data file external to the apparatus.

Claim 27

The apparatus according to claim 18, wherein said designating means designates the axis of symmetry of the object using a three-surface view.

Claim 28

The apparatus according to claim 18, further comprising display means for subjecting the obtained three-dimensional shape model to processing such as lighting, shading and projection transformation, and displaying results of the processing in a two-dimensional plane.

Claim 29

A range image processing method for creating a polygonal patch mode of an object with a group of polygonal patches which cover a surface of the object, said method comprising: an inputting step of inputting a range image representing the object surface; a calculating step of calculating a curvature at each pixel in the range image; a surface-category classifying step for classifying each pixel on the object surface, based upon the curvature at respective pixels, into surface categories each corresponding to different surface shapes; a pickup step of sequentially picking up areas in the object surface, wherein each of the areas consists of connected pixels classified into a same surface category; and a polygonal patch model creating step for obtaining appropriate polygonal patches which cover each of the picked up areas, wherein a size of the patches for each area is in conformity with the surface categories in which respective areas are classified and creating a polygonal patch model of the object.

Claim 30

A range image processing method for creating a polygonal patch mode of an object with a group of polygonal patches which cover a surface of the object, said method comprising: an inputting step of inputting a range image representing the object surface; a calculating step of calculating a curvature at each pixel in the range image; a surface-category classifying step for classifying each pixel on the object surface, based upon the curvature at respective pixels, into surface categories each corresponding to different surface shapes; a pickup step of sequentially picking up areas in the object surface, wherein each of the areas consists of connected pixels classified into a same surface category; and a polygonal patch model creating step for obtaining appropriate polygonal patches which cover each of the picked up areas, wherein a size of the patches for each area is in conformity with the surface categories in which respective areas are classified and creating a polygonal patch model of the object.

Claim 31

The method according to claim 22, wherein the larger an irregularity of classified surface category is, the smaller are the polygonal patches which are assigned to the surface.

Claim 32

The method according to claim 22, wherein the smaller an irregularity of a classified surface category is, the greater spacing of representative points for selecting polygonal patches is made.

Claim 33

A range image processing method for obtaining, from an inputted range image, a group of polygons which cover an object surface represented by said range image, comprising: a detecting step of detecting a point on the surface that is not covered by the group of polygons already obtained; a vertex-candidate selecting step of selecting, from other points on the surface, candidates for other vertices of a polygon having the point detected in said detecting step as one vertex; a determining step of determining whether each point selected is covered by the group of polygons already obtained; and a comparing step, of comparing in a case where all of the points are not covered by the group of polygons, a normal direction at the detected point with a normal direction at each selected point wherein, when differences in normal directions are all less than a predetermined amount in each result of comparison performed in said comparing step, points constituting a polygon covering each selected point are selected anew, from other points on the surface, as candidates for other vertices of a polygon having the detected point as one vertex.

Claim 34

A range image processing method for obtaining, from an inputted range image, a group of polygons which cover an object surface represented by said range image, comprising: a detecting step of detecting a point on the surface that is not covered by the group of polygons already obtained; a vertex-candidate selecting step of selecting, from other points on the surface, candidates for other vertices of a polygon having the point detected in said detecting step as one vertex; a determining step of determining whether each point selected is covered by the group of polygons already obtained; and a comparing step, of comparing in a case where all of the points are not covered by the group of polygons, a normal direction at the detected point with a normal direction at each selected point wherein, when differences in normal directions are all less than a predetermined amount in each result of comparison performed in said comparing step, points constituting a polygon covering each selected point are selected anew, from other points on the surface, as candidates for other vertices of a polygon having the detected point as one vertex.

Claim 35

The method according to claim 25, wherein when a difference in direction is greater than a predetermined amount in any result of comparison performed at said comparing step, a polygon one vertex of which is the detected point and the other vertices of which are the selected points is added to said group of polygons.

Claim 36

The method according to claim 26, wherein comparison of the normal directions is executed by comparing an internal product between normal vectors of two normal directions.

Claim 37

The method according to claim 25, wherein comparison of the normal directions is executed by comparing an internal product between normal vectors of two normal directions.

Claim 38

An image output method for outputting a two-dimensional image representing a three-dimensional shape, comprising the steps of: inputting a three-dimensional image; calculating a unit normal vector at each point on a surface of the three-dimensional image; outputting a two-dimensional image representing a projection of the three-dimensional image on a plane; projecting the unit normal vector, on the two-dimensional image, at each sampled point, wherein each sampled point is sampled using a predetermined sampling interval on the plane; magnifying each of the projected unit normal vectors by a value equal to predetermined sampling interval; and outputting a line segment with the same direction and length as each of the projected and magnified unit normal vectors, at the respective sampling points, on the two-dimensional image.

Claim 39

An image output method for outputting a two-dimensional image representing a three-dimensional shape, comprising the steps of: inputting a three-dimensional image; calculating a unit normal vector at each point on a surface of the three-dimensional image; outputting a two-dimensional image representing a projection of the three-dimensional image on a plane; projecting the unit normal vector, on the two-dimensional image, at each sampled point, wherein each sampled point is sampled using a predetermined sampling interval on the plane; magnifying each of the projected unit normal vectors by a value equal to predetermined sampling interval; and outputting a line segment with the same direction and length as each of the projected and magnified unit normal vectors, at the respective sampling points, on the two-dimensional image.

Claim 40

An image output method for outputting a two-dimensional image representing a three-dimensional shape, comprising the steps of: inputting a three-dimensional image; calculating a unit normal vector in polar coordinates at each point on a surface of the three-dimensional image; converting each of the unit normal vectors in the polar coordinates into a point in HLS color space coordinates by converting two angles of the unit normal vector into hue and saturation, respectively, and fixing luminance to a constant; and outputting a two-dimensional image representing a projection of the three-dimensional image on a plane with the color of each point corresponding to the value in the RGB color space coordinates converted from the unit normal vector at a respective point.

Claim 41

An image output method for outputting a two-dimensional image representing a three-dimensional shape, comprising the steps of: inputting a three-dimensional image; calculating a unit normal vector in polar coordinates at each point on a surface of the three-dimensional image; converting each of the unit normal vectors in the polar coordinates into a point in HLS color space coordinates by converting two angles of the unit normal vector into hue and saturation, respectively, and fixing luminance to a constant; and outputting a two-dimensional image representing a projection of the three-dimensional image on a plane with the color of each point corresponding to the value in the RGB color space coordinates converted from the unit normal vector at a respective point.

Claim 42

An image processing apparatus for outputting a two-dimensional image representing a three-dimensional shape, comprising: input means for inputting a three-dimensional image; calculation means for calculating a unit normal vector at each point on a surface of the three-dimensional image; means for outputting a two-dimensional image representing a projection of the three-dimensional image on a plane; vector projecting means for projecting the unit normal vector, on the two-dimensional image, at each sampled point, wherein each sampled point is sampled using a predetermined sampling interval on the plane; magnifying means for magnifying each of the projected unit normal vectors by a value equal to the predetermined sampling interval; and means for outputting a line segment with the same direction and length as each of the projected and magnified unit normal vectors, at the respective sampling points, on the two-dimensional image.

Claim 43

An image processing apparatus for outputting a two-dimensional image representing a three-dimensional shape, comprising: input means for inputting a three-dimensional image; calculation means for calculating a unit normal vector at each point on a surface of the three-dimensional image; means for outputting a two-dimensional image representing a projection of the three-dimensional image on a plane; vector projecting means for projecting the unit normal vector, on the two-dimensional image, at each sampled point, wherein each sampled point is sampled using a predetermined sampling interval on the plane; magnifying means for magnifying each of the projected unit normal vectors by a value equal to the predetermined sampling interval; and means for outputting a line segment with the same direction and length as each of the projected and magnified unit normal vectors, at the respective sampling points, on the two-dimensional image.

Claim 44

An image processing apparatus for outputting a two-dimensional image representing a three-dimensional shape, comprising: input means for inputting a three-dimensional image; calculation means for calculating a unit normal vector in polar coordinates at each point on a surface of the three-dimensional image; first conversion means for converting each of the unit normal vectors in the polar coordinates into a point in HLS color space coordinates by converting two angles of the unit normal vector into hue and saturation, respectively, and fixing luminance to a constant; second conversion means for converting each point in the HLS color space coordinates into a point in RGB color space coordinates; and output means for outputting a two-dimensional image representing a projection of the three-dimensional image on a plane with the color of each point corresponding to the value in the RGB color space coordinates converted from the unit normal vector at a respective point.

Claim 45

An image processing apparatus for outputting a two-dimensional image representing a three-dimensional shape, comprising: input means for inputting a three-dimensional image; calculation means for calculating a unit normal vector in polar coordinates at each point on a surface of the three-dimensional image; first conversion means for converting each of the unit normal vectors in the polar coordinates into a point in HLS color space coordinates by converting two angles of the unit normal vector into hue and saturation, respectively, and fixing luminance to a constant; second conversion means for converting each point in the HLS color space coordinates into a point in RGB color space coordinates; and output means for outputting a two-dimensional image representing a projection of the three-dimensional image on a plane with the color of each point corresponding to the value in the RGB color space coordinates converted from the unit normal vector at a respective point.

Claim 46

An image processing apparatus comprising: input means for inputting a range image in which a value of each pixel describes a distance between a respective point on an object surface and a reference plane; normalization means for normalizing the range image along each of three coordinate axes in which a first one is orthogonal to the range image and a second one and a third one are parallel to the range image, by a conversion of the value of each pixel representing the distance along the first coordinate axis in order that unit length along the first coordinate axis should accord with unit length along the second and the third coordinate axes; arithmetic means for calculating a value representing a property of the object surface described by the normalized range image; and display means for displaying image information which represents the property of the object surface based upon the value calculated by said arithmetic means.

Claim 47

An image processing apparatus comprising: input means for inputting a range image in which a value of each pixel describes a distance between a respective point on an object surface and a reference plane; normalization means for normalizing the range image along each of three coordinate axes in which a first one is orthogonal to the range image and a second one and a third one are parallel to the range image, by a conversion of the value of each pixel representing the distance along the first coordinate axis in order that unit length along the first coordinate axis should accord with unit length along the second and the third coordinate axes; arithmetic means for calculating a value representing a property of the object surface described by the normalized range image; and display means for displaying image information which represents the property of the object surface based upon the value calculated by said arithmetic means.

Claim 48

A range image processing apparatus for creating a polygonal patch mode of an object with a group of polygonal patches which cover a surface of the object, said apparatus comprising: input means for inputting a range image representing the object surface; calculation means for calculating a curvature at each pixel in the range image; surface-category classifying means for classifying each pixel on the object surface, based upon the curvature at respective pixels, into surface categories each corresponding to different surface shapes; pickup means for sequentially picking up areas in the object surface, wherein each of the areas consists of connected pixels classified into a same surface category; and polygonal patch creating means for selecting and assigning an appropriate size of polygonal patches which cover each of the picked up areas, wherein the size of the polygonal patches for each area is selected in conformity with the surface categories in which respective areas are classified for and creating a polygonal patch model of the object with the polygonal patches.

Claim 49

A range image processing apparatus for creating a polygonal patch mode of an object with a group of polygonal patches which cover a surface of the object, said apparatus comprising: input means for inputting a range image representing the object surface; calculation means for calculating a curvature at each pixel in the range image; surface-category classifying means for classifying each pixel on the object surface, based upon the curvature at respective pixels, into surface categories each corresponding to different surface shapes; pickup means for sequentially picking up areas in the object surface, wherein each of the areas consists of connected pixels classified into a same surface category; and polygonal patch creating means for selecting and assigning an appropriate size of polygonal patches which cover each of the picked up areas, wherein the size of the polygonal patches for each area is selected in conformity with the surface categories in which respective areas are classified for and creating a polygonal patch model of the object with the polygonal patches.

Claim 50

A range image processing apparatus for obtaining, from an inputted range image, a group of polygons which cover an object surface represented by said range image, comprising: detection means for detecting a point on the surface that is not covered by the group of polygons already obtained; vertex-candidate selecting means for selecting, from other points on the surface, candidates for other vertices of a polygon having the point detected by said detection means as on vertex; determination means for determining whether each point selected is covered by the group of polygons already obtained; and comparison means for comparing, in a case where all of the points are not covered by the group of polygons, a normal direction at the detected point with a normal direction at each selected point, wherein, when differences in normal directions are all less than a predetermined amount in each result of comparison performed by said comparison means, points constituting a polygon covering each selected point are selected anew, from other points on the surface, as candidates for other vertices of a polygon having the detected point as one vertex.

Claim 51

A range image processing apparatus for obtaining, from an inputted range image, a group of polygons which cover an object surface represented by said range image, comprising: detection means for detecting a point on the surface that is not covered by the group of polygons already obtained; vertex-candidate selecting means for selecting, from other points on the surface, candidates for other vertices of a polygon having the point detected by said detection means as on vertex; determination means for determining whether each point selected is covered by the group of polygons already obtained; and comparison means for comparing, in a case where all of the points are not covered by the group of polygons, a normal direction at the detected point with a normal direction at each selected point, wherein, when differences in normal directions are all less than a predetermined amount in each result of comparison performed by said comparison means, points constituting a polygon covering each selected point are selected anew, from other points on the surface, as candidates for other vertices of a polygon having the detected point as one vertex.