Patent US6580811B2 successfully refreshed from Google Patents.
US6580811B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Wavelet-based facial motion capture for avatar animation
Assignee: Google LLC
•
Filing: 2001-05-31
•
Granted: 2003-06-17
•
Expires: 2021-05-31
Abstract
Abstract The present invention is embodied in an apparatus, and related method, for sensing a person's facial movements, features and characteristics and the like to generate and animate an avatar image based on facial sensing. The avatar apparatus uses an image processing technique based on model graphs and bunch graphs that efficiently represent image features as jets. The jets are composed of wavelet transforms processed at node or landmark locations on an image corresponding to readily identifiable features. The nodes are acquired and tracked to animate an avatar image in accordance with the person's facial movements. Also, the facial sensing may use jet similarity to determine the person's facial features and characteristic thus allows tracking of a person's natural characteristics without any unnatural elements that may interfere or inhibit the person's natural characteristics.
Inventors
- 👤 Thomas Maurer
- 👤 Egor Valerievich Elagin
- 👤 Luciano Pasquale Agostino Nocera
- 👤 Johannes Bernhard Steffens
- 👤 Hartmut Neven
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 11:06
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/20; G06T7/246; G06T7/262; G06V; G06V10/00; G06V10/40; G06V10/42; G06V10/422; G06V10/426; G06V10/44; G06V10/443; G06V10/449; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06V40/165; G06T2207/00; G06T2207/20; G06T2207/20048; G06T2207/20064
Claims Analysis
Total Claims: 14
Claim 1
Independent Claim
293 words
A method for generating a head model specific to a person for use in animating a display image having the person's features, the method comprising the steps for: providing a frontal facial image of the person, the frontal facial image having an array of pixels; providing a profile facial image of the person, the profile facial image having an array of pixels; transforming the frontal facial image using wavelet transformations to generate a transformed frontal image having an array of pixels, each pixel of the transformed frontal image being associated with a respective pixel of the frontal facial image and being represented by a frontal transform jet associated with a predetermined number of wavelet component values; transforming the profile facial image using wavelet transformations to generate a transformed profile image having an array of pixels, each pixel of the transformed profile image being associated with a respective pixel of the profile facial image and being represented by a profile transform jet associated with a predetermined number of wavelet component values; locating predetermined facial features in the transformed frontal image based on a comparison between the frontal transform jets of the transformed frontal facial image and frontal graph jets at sensing nodes of a frontal graph; locating predetermined facial features in the transformed profile image based on a comparison between the profile transform jets of the transformed profile facial image and sensing nodes at profile graph jets of a profile graph; producing a three-dimensional model of the person's head using the frontal facial image and the profile facial image and based on the positions of the predetermined features located in the transformed frontal facial image and the predetermined features located in the transformed profile facial image; displaying the head model as a display image.
Claim 2
Independent Claim
293 words
A method for generating a head model specific to a person for use in animating a display image having the person's features, the method comprising the steps for: providing a frontal facial image of the person, the frontal facial image having an array of pixels; providing a profile facial image of the person, the profile facial image having an array of pixels; transforming the frontal facial image using wavelet transformations to generate a transformed frontal image having an array of pixels, each pixel of the transformed frontal image being associated with a respective pixel of the frontal facial image and being represented by a frontal transform jet associated with a predetermined number of wavelet component values; transforming the profile facial image using wavelet transformations to generate a transformed profile image having an array of pixels, each pixel of the transformed profile image being associated with a respective pixel of the profile facial image and being represented by a profile transform jet associated with a predetermined number of wavelet component values; locating predetermined facial features in the transformed frontal image based on a comparison between the frontal transform jets of the transformed frontal facial image and frontal graph jets at sensing nodes of a frontal graph; locating predetermined facial features in the transformed profile image based on a comparison between the profile transform jets of the transformed profile facial image and sensing nodes at profile graph jets of a profile graph; producing a three-dimensional model of the person's head using the frontal facial image and the profile facial image and based on the positions of the predetermined features located in the transformed frontal facial image and the predetermined features located in the transformed profile facial image; displaying the head model as a display image.
Claim 3
Dependent Claim
30 words
A method for generating a head model as defined in claim 1 , wherein the positions of the predetermined features are associated with respective nodes for animating the head model.
Claim 4
Dependent Claim
32 words
A method for generating a head model as defined in claim 1 , wherein the predetermined facial features associated with the frontal facial image include the person's eyes, nose, mouth, and chin.
Claim 5
Dependent Claim
32 words
A method for generating a head model as defined in claim 1 , wherein the predetermined facial features associated with the profile facial image include the person's eyes, nose, mouth, and chin.
Claim 6
Dependent Claim
20 words
A method for generating a head model as defined in claim 1 , wherein the wavelet transformations use Gabor wavelets.
Claim 7
Dependent Claim
31 words
A method for generating a head model as defined in claim 1 , wherein each wavelet component value is generated based on a Gabor wavelet having a particular orientation and frequency.
Claim 8
Independent Claim
277 words
A method for providing a display avatar having a specific person's features, the method comprising the steps for: providing a frontal facial image of the person, the frontal facial image having an array of pixels; providing a profile facial image of the person, the profile facial image having an array of pixels; transforming the frontal facial image using wavelet transformations to generate a transformed frontal image having an array of pixels, each pixel of the transformed frontal image being associated with a respective pixel of the frontal facial image and being represented by a frontal transform jet associated with a predetermined number of wavelet component values; transforming the profile facial image using wavelet transformations to generate a transformed profile image having an array of pixels, each pixel of the transformed profile image being associated with a respective pixel of the profile facial image and being represented by a profile transform jet associated with a predetermined number of wavelet component values; locating predetermined facial features in the transformed frontal facial image based on a comparison between the frontal transform jets of the transformed frontal facial image and frontal graph jets at sensing nodes of a frontal graph; locating predetermined facial features in the transformed profile facial image based on a comparison between the profile transform jets of the transformed profile facial image and sensing nodes at profile graph jets of a profile graph; producing the display avatar using the frontal facial image and the profile facial image and based on the positions of the predetermined features located in the transformed frontal facial image and the predetermined features located in the transformed profile facial image; displaying the display avatar.
Claim 9
Independent Claim
277 words
A method for providing a display avatar having a specific person's features, the method comprising the steps for: providing a frontal facial image of the person, the frontal facial image having an array of pixels; providing a profile facial image of the person, the profile facial image having an array of pixels; transforming the frontal facial image using wavelet transformations to generate a transformed frontal image having an array of pixels, each pixel of the transformed frontal image being associated with a respective pixel of the frontal facial image and being represented by a frontal transform jet associated with a predetermined number of wavelet component values; transforming the profile facial image using wavelet transformations to generate a transformed profile image having an array of pixels, each pixel of the transformed profile image being associated with a respective pixel of the profile facial image and being represented by a profile transform jet associated with a predetermined number of wavelet component values; locating predetermined facial features in the transformed frontal facial image based on a comparison between the frontal transform jets of the transformed frontal facial image and frontal graph jets at sensing nodes of a frontal graph; locating predetermined facial features in the transformed profile facial image based on a comparison between the profile transform jets of the transformed profile facial image and sensing nodes at profile graph jets of a profile graph; producing the display avatar using the frontal facial image and the profile facial image and based on the positions of the predetermined features located in the transformed frontal facial image and the predetermined features located in the transformed profile facial image; displaying the display avatar.
Claim 10
Dependent Claim
29 words
A method for providing a display avatar as defined in claim 7 , wherein the positions of the predetermined features are associated with respective nodes for animating the avatar.
Claim 11
Dependent Claim
32 words
A method for providing a display avatar as defined in claim 7 , wherein the predetermined facial features associated with the frontal facial image include the person's eyes, nose, mouth, and chin.
Claim 12
Dependent Claim
32 words
A method for providing a display avatar as defined in claim 7 , wherein the predetermined facial features associated with the profile facial image include the person's eyes, nose, mouth, and chin.
Claim 13
Dependent Claim
20 words
A method for providing a display avatar as defined in claim 7 , wherein the wavelet transformations use Gabor wavelets.
Claim 14
Dependent Claim
31 words
A method for providing a display avatar as defined in claim 7 , wherein each wavelet component value is generated based on a Gabor wavelet having a particular orientation and frequency.
References Cited (Backward Citations)
US4805224A
Cited
US4725824A
Cited
US4827413A
Cited
US5168529A
Cited
US5432712A
Cited
US5187574A
Cited
US5280530A
Cited
US5220441A
Cited
US5533177A
Cited
US5159647A
Cited
US5680487A
Cited
US5333165A
Cited
US5430809A
Cited
US5383013A
Cited
US5550928A
Cited
US5511153A
Cited
US5581625A
Cited
DE4406020C1
Cited
US5719954A
Cited
US5736982A
Cited
US5699449A
Cited
US5714997A
Cited
US5982853A
Cited
US5588033A
Cited
US5715325A
Cited
US5774591A
Cited
US5802220A
Cited
US5809171A
Cited
US5764803A
Cited
EP0807902A2
Cited
US5828769A
Cited
US6044168A
Cited
US5917937A
Cited
US6052123A
Cited
US5995119A
Cited
US6011562A
Cited
WO1999053443A1
Cited
US6301370B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-06-16 | 2006-12-16 | 2007-06-17 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-06-16 | 2010-12-16 | 2011-06-17 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-06-16 | 2014-12-16 | 2015-06-17 | $7700.00 | Window Closed / Lapsed |