US6580810B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method of image processing using three facial feature points in three-dimensional head motion tracking
Assignee: CyberLink Corp
•
Filing: 1999-06-10
•
Granted: 2003-06-17
•
Expires: 2019-06-10
Abstract
Abstract A method of image processing in three-dimensional (3-D) head motion tracking is disclosed. The method includes: providing a user's source image to a first processing device; capturing the user's first image and providing it to a second processing device; selecting three facial feature points of the first image from the second processing device to form a 3-D feature triangle; capturing user's consecutive video frames and providing them to the second processing device when the user proceeds with head motions; tracking the three facial feature points corresponding to the consecutive video frames to form a series of actual 2-D feature triangle; rotating and translating the 3-D feature triangle freely to form a plurality of geometric transformations, selecting one of the geometric transformations with acceptable error between the two consecutive 2-D feature triangles, repeating the step until the last frame of the consecutive video frames and geometric transformations corresponding to various consecutive video frames are formed; and providing the geometric transformations to the first processing device to generate a head motion corresponding to the user's source image.
Inventors
- 👤 Tzong-Jer Yang
- 👤 Fu-Che Wu
- 👤 Ming Ouhyoung
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 17:11
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06T; G06T9/00; G06T9/001; G06T7/00; G06T7/20; G06T7/246; G06T9/004
Claims Analysis
Total Claims: 16
Claim 1
Independent Claim
189 words
A method of image processing three-dimensional (3-D) head motion with three facial feature points comprising the following steps: (a) providing a user's source image to a first processing device; (b) capturing said user's first image and providing it to a second processing device; (c) selecting three facial feature points of said first image from said second processing device to form a 3-D feature triangle; (d) capturing user's consecutive video frames and providing them to the second processing device when said user proceeds with head motions; (e) tracking said three facial feature points corresponding to said consecutive video frames to form a series of actual 2-D feature triangle; (f) rotating and translating said 3-D feature triangle freely to form a plurality of geometric transformations; (g) selecting one of the geometric transformations with acceptable error between the two consecutive 2-D feature triangles; (h) repeating the step (f) and (g) until the last frame of said consecutive video frames and geometric transformations corresponding to various consecutive video frames are formed; and (i) providing said geometric transformations to said first processing device to generate a head motion corresponding to said user's source image.
Claim 2
Independent Claim
189 words
A method of image processing three-dimensional (3-D) head motion with three facial feature points comprising the following steps: (a) providing a user's source image to a first processing device; (b) capturing said user's first image and providing it to a second processing device; (c) selecting three facial feature points of said first image from said second processing device to form a 3-D feature triangle; (d) capturing user's consecutive video frames and providing them to the second processing device when said user proceeds with head motions; (e) tracking said three facial feature points corresponding to said consecutive video frames to form a series of actual 2-D feature triangle; (f) rotating and translating said 3-D feature triangle freely to form a plurality of geometric transformations; (g) selecting one of the geometric transformations with acceptable error between the two consecutive 2-D feature triangles; (h) repeating the step (f) and (g) until the last frame of said consecutive video frames and geometric transformations corresponding to various consecutive video frames are formed; and (i) providing said geometric transformations to said first processing device to generate a head motion corresponding to said user's source image.
Claim 3
Dependent Claim
14 words
The method of claim 1 , wherein said source image is an existing photograph.
Claim 4
Dependent Claim
25 words
The method of claim 1 , wherein in said Step (b) a camera captures user's first image and provides it to a second processing device.
Claim 5
Dependent Claim
36 words
The method of claim 1 , wherein in said Step (c) a 3-D feature triangle is formed by selecting with a positioning device three facial feature points of the first image from said second processing device.
Claim 6
Dependent Claim
35 words
The method of claim 1 , wherein in said Step (c) a 3-D feature triangle is formed by selecting with a mouse three facial feature points of the first image from said second processing device.
Claim 7
Dependent Claim
25 words
The method of claim 1 , wherein said geometric transformations include the coordinates and surface normal of the three points of the 3-D feature triangle.
Claim 8
Dependent Claim
23 words
The method of claim 1 , wherein said three feature points are selected points of the face considered largely as a rigid body.
Claim 9
Dependent Claim
27 words
The method of claim 1 , wherein said three feature points are selected points of the lateral canthus of the eyes and the nose on the face.
Claim 10
Dependent Claim
24 words
The method of claim 1 , wherein said three feature points are selected points of the ear-tips and the lower chin on the face.
Claim 11
Dependent Claim
21 words
The method of claim 1 , wherein in said step (f), said 3-D feature triangle is first rotated and then translated.
Claim 12
Dependent Claim
27 words
The method of claim 1 , wherein a pivot of said head motion is a point in center of an upper neck of said user's source image.
Claim 13
Dependent Claim
35 words
The method of claim 1 , wherein in said step (i), said geometric transformations are transmitted to said first processing device through a transmission medium for generating head motion corresponding to said user's source image.
Claim 14
Dependent Claim
18 words
The method of claim 12 , wherein in said step (i), said transmission medium includes network transmission medium.
Claim 15
Independent Claim
212 words
A method of image processing three-dimensional (3-D) head motion with three facial feature points comprising the following steps: (a) providing a user's source image to a first processing device; (b) capturing said user's first image and providing it to a second processing device; (c) selecting three facial feature points of said first image from said second processing device; (d) pre-building a 3-D feature triangle in accordance with the three facial feature points; (e) capturing user's consecutive video frames and providing them to the second processing device when said user proceeds with head motions; (f) tracking said three facial feature points corresponding to said consecutive video frames to form a series of actual 2-D feature triangle; (g) rotating and translating said pre-built 3-D feature triangle freely with steepest-descent iterative method to form a plurality of geometric transformations; (h) selecting one of the geometric transformations with acceptable error between said two consecutive actual 2-D feature triangles to form an estimated 3-D feature triangle; (i) replacing said pre-built 3-D feature triangle with said estimated 3-D feature triangle and repeating sequentially step (g) and (h) until the last frame of said consecutive video frames; and (j) providing said geometric transformations to said first processing device to generate a head motion corresponding to said user's source image.
Claim 16
Independent Claim
212 words
A method of image processing three-dimensional (3-D) head motion with three facial feature points comprising the following steps: (a) providing a user's source image to a first processing device; (b) capturing said user's first image and providing it to a second processing device; (c) selecting three facial feature points of said first image from said second processing device; (d) pre-building a 3-D feature triangle in accordance with the three facial feature points; (e) capturing user's consecutive video frames and providing them to the second processing device when said user proceeds with head motions; (f) tracking said three facial feature points corresponding to said consecutive video frames to form a series of actual 2-D feature triangle; (g) rotating and translating said pre-built 3-D feature triangle freely with steepest-descent iterative method to form a plurality of geometric transformations; (h) selecting one of the geometric transformations with acceptable error between said two consecutive actual 2-D feature triangles to form an estimated 3-D feature triangle; (i) replacing said pre-built 3-D feature triangle with said estimated 3-D feature triangle and repeating sequentially step (g) and (h) until the last frame of said consecutive video frames; and (j) providing said geometric transformations to said first processing device to generate a head motion corresponding to said user's source image.
References Cited (Backward Citations)
US5420638A
Cited
US5659625A
Cited
US5581276A
Cited
US6091836A
Cited
US6044168A
Cited
US6047078A
Cited
US6029173A
Cited
US6381346B1
Cited
US6332033B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-06-16 | 2006-12-16 | 2007-06-17 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-06-16 | 2010-12-16 | 2011-06-17 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-06-16 | 2014-12-16 | 2015-06-17 | $7700.00 | Window Closed / Lapsed |