US6697072B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and system for controlling an avatar using computer vision
Assignee: Intel Corp
•
Filing: 2001-03-26
•
Granted: 2004-02-24
•
Expires: 2021-03-26
Abstract
Abstract A method and system for controlling an avatar using computer vision is presented. A video stream representing a background and a foreground is received. A user in the foreground is segmented from the background and classified to produce effector information. An avatar may be controlled based on the effector information.
Inventors
- 👤 Ryan S. Russell
- 👤 John B. Zipperer
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:45
CPC Classifications
G; G06; G06T; G06T13/00; G06T13/20; G06T13/40; G06T7/00; G06T7/10; G06T7/11; G06T7/194; G06T2207/00; G06T2207/10; G06T2207/10016
Claims Analysis
Total Claims: 34
Claim 1
Independent Claim
65 words
A method for controlling an avatar using computer vision, said method comprising: receiving a video stream representing a background and a foreground; segmenting a user in said foreground from said background; tracking a head position of the user to produce effector information; performing coordinate conversion on the effector information; performing inverse kinematics on the effector inforamtion; and controlling said avatar based on said effector information.
Claim 2
Independent Claim
65 words
A method for controlling an avatar using computer vision, said method comprising: receiving a video stream representing a background and a foreground; segmenting a user in said foreground from said background; tracking a head position of the user to produce effector information; performing coordinate conversion on the effector information; performing inverse kinematics on the effector inforamtion; and controlling said avatar based on said effector information.
Claim 3
Dependent Claim
14 words
The method according to claim 1 , wherein said foreground includes a moving user.
Claim 4
Dependent Claim
22 words
The method according to claim 2 , wherein said effector information includes three-dimensional coordinates of the head position of said moving user.
Claim 5
Dependent Claim
20 words
The method according to claim 3 , wherein said segmenting said user includes segmenting the head of said moving user.
Claim 6
Dependent Claim
24 words
The method according to claim 2 , wherein said effector information includes three-dimensional coordinates of at least one hand position of said moving user.
Claim 7
Dependent Claim
22 words
The method according to claim 5 , wherein said segmenting said user includes segmenting at least one hand of said moving user.
Claim 8
Independent Claim
63 words
A method for controlling an avatar using computer vision, said method comprising: calibrating a video camera with respect to a background to produce a background reference image; receiving a video stream representing said background and a foreground; segmenting a user in said foreground from said background and classifying said user to produce effector information; and controlling said avatar based on said effector information.
Claim 9
Independent Claim
63 words
A method for controlling an avatar using computer vision, said method comprising: calibrating a video camera with respect to a background to produce a background reference image; receiving a video stream representing said background and a foreground; segmenting a user in said foreground from said background and classifying said user to produce effector information; and controlling said avatar based on said effector information.
Claim 10
Dependent Claim
50 words
The method according to claim 7 , wherein said segmenting said user comprises: separating, in said video stream, said user from said background; and tracking the head and at least one hand of said user to produce two-dimensional dimensional image coordinates of said head and said at least one hand.
Claim 11
Dependent Claim
28 words
The method according to claim 8 , wherein said separating said user from said background includes subtracting said background reference image from each frame of said video stream.
Claim 12
Dependent Claim
42 words
The method according to claim 8 , wherein said controlling further comprises: receiving said effector information; performing inverse kinematics based on said effector information to produce a movement of said avatar; and rendering said movement of said avatar on a display screen.
Claim 13
Dependent Claim
22 words
The method according to claim 10 , further comprising converting said two-dimensional image coordinates to three-dimensional coordinates before said performing inverse kinematics.
Claim 14
Dependent Claim
26 words
The method according to claim 11 , wherein said converting includes converting said two-dimensional image coordinates to said three-dimensional coordinates using a constant depth coordinate value.
Claim 15
Dependent Claim
40 words
The method according to claim 10 , wherein said effector information includes at least one of coordinates of the left hand of said user, coordinates of the right hand of said user, and coordinates of the head of said user.
Claim 16
Dependent Claim
27 words
The method according to claim 13 , wherein said movement of said avatar includes at least one of head movement, left arm movement, and right arm movement.
Claim 17
Dependent Claim
49 words
The method according to claim 14 , wherein said controlling further comprises: controlling said right arm movement of said avatar using said coordinates of the left hand of said user; and controlling said left arm movement of said avatar using said coordinates of the right hand of said user.
Claim 18
Dependent Claim
30 words
The method according to claim 10 , wherein bones of said avatar are effected, and wherein said performing includes performing kinematics for each of the effected bones of said avatar.
Claim 19
Dependent Claim
30 words
The method according to claim 10 , wherein joints of said avatar are effected, and wherein said performing includes performing kinematics for each of the effected joints of said avatar.
Claim 20
Independent Claim
74 words
A system for controlling an avatar using computer vision, said system comprising: a video segmentor configured to receive a video stream representing a background and a foreground and produce effector information, said video segmentor having a background/foreground classifier and a hand and head tracker a controller configured to control said avatar based on said effector information, said controller having a coordinate converter, a inverse kinematics engine, and a graphics rendering engine; and a display.
Claim 21
Independent Claim
74 words
A system for controlling an avatar using computer vision, said system comprising: a video segmentor configured to receive a video stream representing a background and a foreground and produce effector information, said video segmentor having a background/foreground classifier and a hand and head tracker a controller configured to control said avatar based on said effector information, said controller having a coordinate converter, a inverse kinematics engine, and a graphics rendering engine; and a display.
Claim 22
Independent Claim
84 words
A system for controlling an avatar using computer vision, said system comprising: a video camera calibrated with respect to a background to produce a background reference image, wherein a video stream is captured using said video camera; a video segmentor configured to receive the video stream representing the background and a foreground, and to segment a user in said foreground from said background and classify said user to produce effector information; and a controller configured to control said avatar based on said effector information.
Claim 23
Independent Claim
84 words
A system for controlling an avatar using computer vision, said system comprising: a video camera calibrated with respect to a background to produce a background reference image, wherein a video stream is captured using said video camera; a video segmentor configured to receive the video stream representing the background and a foreground, and to segment a user in said foreground from said background and classify said user to produce effector information; and a controller configured to control said avatar based on said effector information.
Claim 24
Dependent Claim
46 words
The system according to claim 19 , wherein said segmentor separates, in said video stream, said user from said background, and tracks the head and at least one hand of said user to produce two-dimensional image coordinates of said head and said at least one hand.
Claim 25
Dependent Claim
22 words
The system according to claim 20 , wherein said segmentor subtracts said background reference image from each frame of said video stream.
Claim 26
Dependent Claim
44 words
The system according to claim 20 , wherein said controller is further configured to receive said effector information, perform inverse kinematics based on said effector information to produce a movement of said avatar, and render said movement of said avatar on a display screen.
Claim 27
Dependent Claim
22 words
The system according to claim 22 , wherein said controller is further configured to convert said two-dimensional image coordinates to three-dimensional coordinates.
Claim 28
Dependent Claim
43 words
The system according to claim 23 , wherein said effector information includes at least one of three-dimensional coordinates of the left hand of said user, three-dimensional coordinates of the right hand of said user, and three-dimensional coordinates of the head of said user.
Claim 29
Dependent Claim
69 words
A computer-readable medium having encoded thereon a computer-readable program code which when executed causes a computer to: receive a video stream representing a background and a foreground; segment a user in said foreground from said background; and track a head position of the user to produce effector information; perform coordinate conversion on effector information; perform inverse kinematics on effector inforamtion; and control an avatar based on said effector information.
Claim 30
Dependent Claim
69 words
A computer-readable medium having encoded thereon a computer-readable program code which when executed causes a computer to: receive a video stream representing a background and a foreground; segment a user in said foreground from said background; and track a head position of the user to produce effector information; perform coordinate conversion on effector information; perform inverse kinematics on effector inforamtion; and control an avatar based on said effector information.
Claim 31
Dependent Claim
91 words
A computer-readable medium having encoded thereon a computer-readable program code which when executed causes a computer to: calibrate a video camera with respect to a background to produce a background reference image; capture a video stream with said video camera; receive the video stream representing said background and a foreground; segment a user in said foreground from said background; track a head position of the user to produce effector information; perform coordinate conversion on effector information; perform inverse kinematics on effector inforamtion; and control said avatar based on said effector information.
Claim 32
Dependent Claim
91 words
A computer-readable medium having encoded thereon a computer-readable program code which when executed causes a computer to: calibrate a video camera with respect to a background to produce a background reference image; capture a video stream with said video camera; receive the video stream representing said background and a foreground; segment a user in said foreground from said background; track a head position of the user to produce effector information; perform coordinate conversion on effector information; perform inverse kinematics on effector inforamtion; and control said avatar based on said effector information.
Claim 33
Dependent Claim
48 words
The computer-readable medium of claim 26 , wherein said segmenting said user comprises: separating, in said video stream, said user from said background; and tracking the head and at least one hands of said user to produce two-dimensional image coordinates of said head and at least one hands.
Claim 34
Dependent Claim
29 words
The computer-readable medium according to claim 27 , wherein said separating said user from said background includes subtracting said background reference image from each frame of said video stream.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-02-23 | 2007-08-25 | 2008-02-24 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-02-23 | 2011-08-25 | 2012-02-24 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-02-23 | 2015-08-25 | 2016-02-24 | $7700.00 | Window Closed / Lapsed |