Patent US7212656B2 successfully refreshed from Google Patents.
US7212656B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Rapid computer modeling of faces for animation
Assignee: Zhigu Holdings Ltd
•
Filing: 2006-01-26
•
Granted: 2007-05-01
•
Expires: 2026-01-26
Abstract
Abstract Described herein is a technique for creating a 3D face model using images obtained from an inexpensive camera associated with a general-purpose computer. Two still images of the user are captured, and two video sequences. The user is asked to identify five facial features, which are used to calculate a mask and to perform fitting operations. Based on a comparison of the still images, deformation vectors are applied to a neutral face model to create the 3D model. The video sequences are used to create a texture map. The process of creating the texture map references the previously obtained 3D model to determine poses of the sequential video images.
Inventors
- 👤 Zicheng Liu
- 👤 Zhengyou Zhang
- 👤 Charles E. Jacobs
- 👤 Michael F. Cohen
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:36
CPC Classifications
G; G06; G06T; G06T13/00; G06T13/20; G06T13/40; G06T15/00; G06T15/10; G06T15/20; G06T15/205; G06T17/00; G06T17/10; G06T17/20; G06T7/00; G06T7/20; G06T7/246; G06T7/251; G06T7/50; G06T7/55; G06T7/579; G06T7/70; G06T7/73; G06T7/74; G06V; G06V20/00; G06V20/60; G06V20/64; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06V40/165; G06V40/168; G06V40/171; H; H04; H04N; H04N19/00; H04N19/10; H04N19/134; H04N19/162; H04N19/50; H04N19/503; G06T2200/00; G06T2200/08; G06T2207/00; G06T2207/10; G06T2207/10004; G06T2207/10012; G06T2207/10016; G06T2207/10021; G06T2207/30; G06T2207/30196; G06T2207/30201; G06T9/00; G06T9/001
Claims Analysis
Total Claims: 12
Claim 1
Independent Claim
116 words
A system capable of determining the pose of an object in a given 2D image relative to a 3D model of the object, comprising: means for matching points of the object in the given image with corresponding points of a base image, wherein each matched point has a corresponding 3D position in the 3D model, the 3D positions being determined by the poses of the images, wherein the pose of the base image is known; and means for calculating the pose of the given 2D image such that projections of 3D positions of matched points of the base image onto the given 2D image coincide approximately with the corresponding matched points of the given 2D image.
Claim 2
Independent Claim
116 words
A system capable of determining the pose of an object in a given 2D image relative to a 3D model of the object, comprising: means for matching points of the object in the given image with corresponding points of a base image, wherein each matched point has a corresponding 3D position in the 3D model, the 3D positions being determined by the poses of the images, wherein the pose of the base image is known; and means for calculating the pose of the given 2D image such that projections of 3D positions of matched points of the base image onto the given 2D image coincide approximately with the corresponding matched points of the given 2D image.
Claim 3
Dependent Claim
47 words
A system as recited in claim 1 , wherein the calculating performed by the calculating means comprises minimizing differences between the projections of 3D positions of matched points of the base image onto the given 2D image and the corresponding matched points of the given 2D image.
Claim 4
Dependent Claim
25 words
A system as recited in claim 1 , wherein the matching performed by the matching means comprises detecting and matching corners of the 2D images.
Claim 5
Dependent Claim
120 words
One or more computer-readable media containing code that is executable by a computer to determine poses of an object in a succession of 2D images, relative to a 3D model of the object, the code comprising: code for matching points of the object in the current 2D image with corresponding points of a previous 2D image whose pose is already known, wherein the matched points of the previous 2D image has corresponding 3D positions in the 3D model; code for calculating a pose for the current 2D image such that the projections of 3D positions of matched points of the previous 2D image onto the current 2D image coincide approximately with the corresponding matched points of the current 2D image.
Claim 6
Dependent Claim
120 words
One or more computer-readable media containing code that is executable by a computer to determine poses of an object in a succession of 2D images, relative to a 3D model of the object, the code comprising: code for matching points of the object in the current 2D image with corresponding points of a previous 2D image whose pose is already known, wherein the matched points of the previous 2D image has corresponding 3D positions in the 3D model; code for calculating a pose for the current 2D image such that the projections of 3D positions of matched points of the previous 2D image onto the current 2D image coincide approximately with the corresponding matched points of the current 2D image.
Claim 7
Dependent Claim
23 words
One or more computer-readable media as recited in claim 4 , wherein the matching comprises detecting and matching corners of the 2D images.
Claim 8
Dependent Claim
46 words
One or more computer-readable media as recited in claim 4 , wherein the calculating comprises minimizing differences between the projections of 3D positions of matched points of the previous 2D image onto the current 2D image and the corresponding matched points of the current 2D image.
Claim 9
Dependent Claim
110 words
A user interface usable to determine poses of an object in a succession of 2D images, relative to a 3D model of the object, comprising: means for matching points of the object in the current 2 D image with corresponding points of a previous 2D image whose pose is already known, wherein the matched points of the previous 2D image has corresponding 3D positions in the 3D model; means for calculating a pose for the current 2D image such that the projections of 3D positions of matched points of the previous 2D image onto the current 2D image coincide approximately with the corresponding matched points of the current 2D image.
Claim 10
Dependent Claim
110 words
A user interface usable to determine poses of an object in a succession of 2D images, relative to a 3D model of the object, comprising: means for matching points of the object in the current 2 D image with corresponding points of a previous 2D image whose pose is already known, wherein the matched points of the previous 2D image has corresponding 3D positions in the 3D model; means for calculating a pose for the current 2D image such that the projections of 3D positions of matched points of the previous 2D image onto the current 2D image coincide approximately with the corresponding matched points of the current 2D image.
Claim 11
Dependent Claim
23 words
A user interface as recited in claim 7 , wherein the means for matching comprises detecting and matching corners of the 2D images.
Claim 12
Dependent Claim
46 words
A user interface as recited in claim 7 , wherein the means for calculating comprises minimizing differences between the projections of 3D positions of matched points of the previous 2D image onto the current 2D image and the corresponding matched points of the current 2D image.
References Cited (Backward Citations)
US5469512A
Cited
US5774591A
Cited
US5864630A
Cited
US6072903A
Cited
US6009210A
Cited
US5995119A
Cited
US6549200B1
Cited
US5990901A
Cited
US6188777B1
Cited
US6445810B2
Cited
US6047078A
Cited
US6118887A
Cited
JPH11161282A
Cited
US6173069B1
Cited
US6163322A
Cited
US6301370B1
Cited
US6714660B1
Cited
US6072496A
Cited
US6661907B2
Cited
US6154559A
Cited
US6532011B1
Cited
US6496594B1
Cited
US6556196B1
Cited
US6526161B1
Cited
US6504546B1
Cited
US6807290B2
Cited
US6580821B1
Cited
US6664956B1
Cited
US20020102010A1
Cited
US6747652B2
Cited
US6879709B2
Cited
US6771303B2
Cited
US6919892B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2010-04-30 | 2010-10-30 | 2011-05-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2014-04-30 | 2014-10-30 | 2015-05-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2018-04-30 | 2018-10-30 | 2019-05-01 | $7700.00 | Window Closed / Lapsed |