Patent US5499303A successfully refreshed from Google Patents.
US5499303A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Correction of the gaze direction for a videophone
Assignee: Siemens AG
•
Filing: 1992-01-07
•
Granted: 1996-03-12
•
Expires: 2012-01-07
Abstract
Abstract A method for correcting the gaze direction of persons in a digital image where an angular error between the gaze direction and the camera axis is determined. The pupils of both eyes in the image are then segmented and displaced within the image plane. Areas which have become free are filled in using the color of the eyeball. Any interfering edges produced are attenuated in a subsequent processing step (e.g., by using a low-pass filter). The method is also applicable for a sequence of images over time.
Inventors
- 👤 Eckart Hundt
- 👤 Thomas Riegel
- 👤 Heinz Schwartzel
- 👤 Manfred Ziegler
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 09:32
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/18; G06T; G06T7/00; G06T7/10; G06T7/11; H; H04; H04N; H04N5/00; H04N5/222; H04N5/262; H04N5/272; H04N7/00; H04N7/14; H04N7/141; H04N7/142; H04N7/144; G06T2207/00; G06T2207/30; G06T2207/30196; G06T2207/30201
Claims Analysis
Total Claims: 9
Claim 1
Independent Claim
143 words
A method for computer based altering a gaze direction of a face represented in a digital image, of a video image sequence describing persons communicating with each other via display while the persons are gazing at a monitor and the video image sequence is taken by a camera and thus an angular viewing error occurs between a person's gaze direction and a camera axis, the method comprising the steps of: a) segmenting pupils and eyeballs of a depicted face by a computer; b) displacing resulting segments corresponding to said pupils in an image plane and thereby computationally freeing areas previously occupied by the displaced segments; c) filling in said areas which become free using color of said eyeballs to provide an image of a face having an altered gaze direction; and d) displaying said image of a face having an altered gaze direction.
Claim 2
Independent Claim
143 words
A method for computer based altering a gaze direction of a face represented in a digital image, of a video image sequence describing persons communicating with each other via display while the persons are gazing at a monitor and the video image sequence is taken by a camera and thus an angular viewing error occurs between a person's gaze direction and a camera axis, the method comprising the steps of: a) segmenting pupils and eyeballs of a depicted face by a computer; b) displacing resulting segments corresponding to said pupils in an image plane and thereby computationally freeing areas previously occupied by the displaced segments; c) filling in said areas which become free using color of said eyeballs to provide an image of a face having an altered gaze direction; and d) displaying said image of a face having an altered gaze direction.
Claim 3
Dependent Claim
54 words
A method as claimed in claim 1, wherein said segmenting comprises the steps of: i) determining gray-scale value progressions along straight lines in said image plane; ii) determining edges of said pupils using points of inflection of said gray-scale value progressions; iii) determining edges of said eyeball using minima of said gray-scale value progressions.
Claim 4
Dependent Claim
88 words
A method as claimed in claim 1, wherein displacement of said pupils in said image plane is represented by x which is a shift of the pupils as measured in pixels given by ##EQU2## where d denotes distance between a monitor and the center of said eyeball, P denotes distance between said monitor and a camera, L denotes the radius of said eyeball, f denotes the focal length of a lens of said camera and r denotes the resolution of said camera, measured in pixels per unit length.
Claim 5
Dependent Claim
21 words
A method as claimed in claim 1, further comprising a subsequent processing step of eliminating interfering edges using a low-pass filter.
Claim 6
Dependent Claim
24 words
The method as claimed in claim 1, wherein said step of displaying said image is further defined by displaying said image on a videophone.
Claim 7
Independent Claim
186 words
A method for computer based altering a gaze direction of a face represented in a digital image in a video image sequence over time describing persons communicating to each other via display while the persons are gazing at a monitor and the video image sequence is taken by a camera and thus an angular viewing error occurs between a person's gaze direction and a camera axis, the method comprising the steps of: a) tracking pupils and eyeballs of a depicted face with regard to a change over time of the position of said pupils and eyeballs in an image plane; b) determining an instantaneous position of said pupils and eyeballs in said image plane using predicted estimated values; c) computationally segmenting said pupils and eyeballs; d) displacing resulting segments corresponding to said pupils in said image plane and thereby freeing areas previously occupied by the displaced segments; e) computationally filling in said areas which become free using color of said eyeballs to provide an image of a face having an altered gaze direction; and f) displaying said image of a face having an altered gaze direction.
Claim 8
Independent Claim
186 words
A method for computer based altering a gaze direction of a face represented in a digital image in a video image sequence over time describing persons communicating to each other via display while the persons are gazing at a monitor and the video image sequence is taken by a camera and thus an angular viewing error occurs between a person's gaze direction and a camera axis, the method comprising the steps of: a) tracking pupils and eyeballs of a depicted face with regard to a change over time of the position of said pupils and eyeballs in an image plane; b) determining an instantaneous position of said pupils and eyeballs in said image plane using predicted estimated values; c) computationally segmenting said pupils and eyeballs; d) displacing resulting segments corresponding to said pupils in said image plane and thereby freeing areas previously occupied by the displaced segments; e) computationally filling in said areas which become free using color of said eyeballs to provide an image of a face having an altered gaze direction; and f) displaying said image of a face having an altered gaze direction.
Claim 9
Dependent Claim
24 words
The method as claimed in claim 6, wherein said step of displaying said image is further defined by displaying said image on a videophone.
References Cited (Backward Citations)
JPS6165683A
Cited
US4730260A
Cited
US4641349A
Cited
JPS61199178A
Cited
US4600281A
Cited
JPS6246384A
Cited
JPS63142986A
Cited
JPS63228890A
Cited
US5016282A
Cited
JPH0258484A
Cited
US4931865A
Cited
EP0385128A2
Cited
US5218387A
Cited
US5280530A
Cited
US5386258A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1999-03-12 | 1999-09-11 | 2000-03-12 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2003-03-12 | 2003-09-11 | 2004-03-12 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2007-03-12 | 2007-09-11 | 2008-03-12 | $7700.00 | Window Closed / Lapsed |