System and method for modeling three dimensional objects from a single image

Claim 1

A computer-implemented process for generating a three dimensional model of an object from a single image, comprising the process actions of: obtaining an image of an object; identifying at least one object to be modeled in the image, wherein the object modeled is an animal; determining features of the object in the image; and aligning the features of a generic model of the identified object with the features of the object in the image to obtain a tailored model.

Claim 10

A system for creating a face model from the input of a single image of a face, the system comprising: a general purpose computing device; and a computer program comprising program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to, input a single image of a face; use a face detector to find the face to be modeled in the image; determine features of the face to be modeled; align features of a generic face model to features of the face in the image to obtain a tailored face model, wherein the generic model of a face is represented as a linear combination of a neutral face, and some number of face metrics, wherein a face metric is a vector that can linearly deform the neutral face model in a certain way and wherein the generic model of a face is represented by a vector S=(ν 1 T , . . . , ν H T ) T where ν i =(X i ,Y i ,Z i ) T (i=1, . . . , n) are the vertices, and a metric is represented by a vector M=(δv 1 , . . . , δv n ) T where δv 1 =(δX i ,δY i ,Z i ) T , and wherein a neutral face S O =(ν 1 0T , . . . , ν H 0T ) T , and a set of m metrics M j =(δν 1 jT , . . . , δν n jT ) T , and wherein the linear space of face geometries spanned by these metrics is S = S 0 + ∑ j = 1 m ⁢ ⁢ c j ⁢ M j ⁢ ⁢ subject ⁢ ⁢ to ⁢ ⁢ c j ∈ [ l j , u j ] where the c j 's are the metric coefficients, and l j and u j are the valid range of c j ; and apply the texture of the face in the image to the tailored generic face model.

Claim 11

A system for creating a face model from the input of a single image of a face, the system comprising: a general purpose computing device; and a computer program comprising program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to, input a single image of a face; use a face detector to find the face to be modeled in the image; determine features of the face to be modeled; align features of a generic face model to features of the face in the image to obtain a tailored face model, wherein the generic model of a face is represented as a linear combination of a neutral face, and some number of face metrics, wherein a face metric is a vector that can linearly deform the neutral face model in a certain way and wherein the generic model of a face is represented by a vector S=(ν 1 T , . . . , ν H T ) T where ν i =(X i ,Y i ,Z i ) T (i=1, . . . , n) are the vertices, and a metric is represented by a vector M=(δv 1 , . . . , δv n ) T where δv 1 =(δX i ,δY i ,Z i ) T , and wherein a neutral face S O =(ν 1 0T , . . . , ν H 0T ) T , and a set of m metrics M j =(δν 1 jT , . . . , δν n jT ) T , and wherein the linear space of face geometries spanned by these metrics is S = S 0 + ∑ j = 1 m ⁢ ⁢ c j ⁢ M j ⁢ ⁢ subject ⁢ ⁢ to ⁢ ⁢ c j ∈ [ l j , u j ] where the c j 's are the metric coefficients, and l j and u j are the valid range of c j ; and apply the texture of the face in the image to the tailored generic face model.

Claim 15

A system for creating a face model from the input of a single image of a face, the system comprising: a general purpose computing device; and a computer program comprising program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to, input a single image of a face; use a face detector to find the face to be modeled in the image; determine features of the face to be modeled; align features of a generic face model to features of the face in the image to obtain a tailored face model, wherein the generic model of a face is represented as a linear combination of a neutral face, and some number of face metrics and wherein a face metric is a vector that can linearly deform the neutral face model in a certain way, and wherein using the features of the face to be modeled to align the features of a generic face model to the features of the face in the image comprises modifying the face metrics so that the generic face model matches the shape of the face in the image, and wherein modifying the metrics comprises: calculating the differences between the generic face model and the face in the image; and adjusting the generic face model to represent the face in the image by using said calculated differences to adjust the generic face model; and apply the texture of the face in the image to the tailored generic face model.

Claim 16

A system for creating a face model from the input of a single image of a face, the system comprising: a general purpose computing device; and a computer program comprising program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to, input a single image of a face; use a face detector to find the face to be modeled in the image; determine features of the face to be modeled; align features of a generic face model to features of the face in the image to obtain a tailored face model, wherein the generic model of a face is represented as a linear combination of a neutral face, and some number of face metrics and wherein a face metric is a vector that can linearly deform the neutral face model in a certain way, and wherein using the features of the face to be modeled to align the features of a generic face model to the features of the face in the image comprises modifying the face metrics so that the generic face model matches the shape of the face in the image, and wherein modifying the metrics comprises: calculating the differences between the generic face model and the face in the image; and adjusting the generic face model to represent the face in the image by using said calculated differences to adjust the generic face model; and apply the texture of the face in the image to the tailored generic face model.

Claim 17

A system for creating a face model from the input of a single image of a face, the system comprising: a general purpose computing device; and a computer program comprising program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to, input a single image of a face; use a face detector to find the face to be modeled in the image; determine features of the face to be modeled; align features of a generic face model to features of the face in the image to obtain a tailored face model, wherein the generic model of a face is represented as a linear combination of a neutral face, and some number of face metrics, wherein a face metric is a vector that can linearly deform the neutral face model in a certain way, and wherein the linear combination of a neutral face is represented by a mesh of vertices and triangles that represent the shape of the face; and apply the texture of the face in the image to the tailored generic face model, wherein the module for applying texture comprises: associating each vertex on the generic face model with its coordinates in the image; and using said associated coordinates of the vertices with the image to apply said texture of the original image.

Claim 18

A system for creating a face model from the input of a single image of a face, the system comprising: a general purpose computing device; and a computer program comprising program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to, input a single image of a face; use a face detector to find the face to be modeled in the image; determine features of the face to be modeled; align features of a generic face model to features of the face in the image to obtain a tailored face model, wherein the generic model of a face is represented as a linear combination of a neutral face, and some number of face metrics, wherein a face metric is a vector that can linearly deform the neutral face model in a certain way, and wherein the linear combination of a neutral face is represented by a mesh of vertices and triangles that represent the shape of the face; and apply the texture of the face in the image to the tailored generic face model, wherein the module for applying texture comprises: associating each vertex on the generic face model with its coordinates in the image; and using said associated coordinates of the vertices with the image to apply said texture of the original image.