Patent EP0382580A2 successfully refreshed from Google Patents.
Patent US20030123027A1 successfully refreshed from Google Patents.
US20030123027A1
Expired / Lapsed
US
⏱️ 0.0 years remaining
System and method for eye gaze tracking using corneal image mapping
Assignee: Tobii AB
•
Filing: 2001-12-28
•
Granted: —
•
Expires: 2021-12-28
Abstract
Abstract A system and method for eye gaze tracking without calibrated cameras, direct measurements of specific users' eye geometries, or requiring the user to visually track a cursor traversing a known trajectory. The preferred embodiment includes two uncalibrated cameras imaging the user's eye and having on-axis lighting. The cameras capture images of a test pattern in real space as reflected from the user's cornea, which is essentially a convex spherical mirror. The invention then extracts parameters required to define a mathematical mapping between real space and image space, including spherical and perspective transformations. The invention processes subsequent images of objects reflected from the user's eye through the inverse of the mathematical mapping to determine a gaze vector and a point of regard. Alternately, a single calibrated camera may be employed with means for estimating the eye-to-camera distance. A head-mounted embodiment that may include a laser pointer is also described.
Inventors
- 👤 Arnon Amir
- 👤 Myron Flickner
- 👤 David Koons
- 👤 Carlos Morimoto
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 16:28
CPC Classifications
A; A61; A61B; A61B3/00; A61B3/10; A61B3/113; G; G06; G06V; G06V40/00; G06V40/10; G06V40/18; G06V40/19
Claims Analysis
Total Claims: 18
Claim 1
Independent Claim
96 words
1 . A method for eye gaze tracking, comprising the steps of: creating a set of reference points in a reference coordinate system; acquiring at least one image of at least one of a user's corneas, said image having image aspects in an image coordinate system and including reflections of said reference points; defining a mathematical relationship between said reference coordinate system and said image coordinate system; mapping said image aspects from said image coordinate system to said reference coordinate system using said mathematical relationship; and computing a point of regard from said mapped image aspects.
Claim 2
Dependent Claim
96 words
1 . A method for eye gaze tracking, comprising the steps of: creating a set of reference points in a reference coordinate system; acquiring at least one image of at least one of a user's corneas, said image having image aspects in an image coordinate system and including reflections of said reference points; defining a mathematical relationship between said reference coordinate system and said image coordinate system; mapping said image aspects from said image coordinate system to said reference coordinate system using said mathematical relationship; and computing a point of regard from said mapped image aspects.
Claim 3
Dependent Claim
61 words
2 . The method of claim 1 wherein said reference points include at least one of: a printed pattern around a screen, an unobtrusively interlaced pattern in said screen, a set of controlled light sources around said screen, a set of controlled light sources on said screen, content displayed in said screen, a set of controlled light sources behind said screen.
Claim 4
Dependent Claim
29 words
3 . The method of claim 2 wherein said screen includes at least one of: a computer monitor, a whiteboard, a desktop, a windshield, an advertisement, a television screen.
Claim 5
Dependent Claim
18 words
4 . The method of claim 1 wherein a laser pointer creates at least one new reference point.
Claim 6
Dependent Claim
31 words
5 . The method of claim 4 wherein said laser pointer creates said new reference point that reflects from said cornea at a pupil image center in said image coordinate system.
Claim 7
Dependent Claim
47 words
6 . The method of claim 1 wherein said acquiring step is performed by at least one camera focusing upon at least one of said user's corneas, each said camera having a focal center, an image plane defining said image coordinate system, and an on-axis light source.
Claim 8
Dependent Claim
29 words
7 . The method of claim 6 wherein said image aspects are identified by subtracting a number of said images acquired during different phases of display screen refresh cycles.
Claim 9
Dependent Claim
68 words
8 . The method of claim 6 comprising the further steps of: determining for each of said cameras an angle between said focal center, a user's pupil center, and a point on a predetermined target surface where a virtual light source would create a new image aspect at a pupil image center in said image coordinate system; and defining a gaze vector as the bisector of said angle.
Claim 10
Dependent Claim
22 words
9 . The method of claim 8 comprising the further step of correcting said gaze vector for a foveal axis offset angle.
Claim 11
Dependent Claim
16 words
10 . The method of claim 6 wherein at least one of said cameras is head-mounted.
Claim 12
Dependent Claim
22 words
11 . The method of claim 1 wherein said mathematical relationship includes at least one of: spherical transformations, perspective transformations, polynomial interpolation.
Claim 13
Dependent Claim
45 words
12 . The method of claim 1 wherein said computing step includes the further steps of: mapping a target coordinate system to said reference coordinate system; and bisecting a line segment spanning an on-axis glint and a pupil image center in said target coordinate system.
Claim 14
Dependent Claim
17 words
13 . The method of claim 12 wherein said target coordinate system is said reference coordinate system.
Claim 15
Dependent Claim
103 words
14 . A system for eye gaze tracking comprising: means for creating a set of reference points in a reference coordinate system; means for acquiring at least one image of at least one of a user's corneas, said image having image aspects in an image coordinate system and including reflections of said reference points; means for defining a mathematical relationship between said reference coordinate system and said image coordinate system; means for mapping said image aspects from said image coordinate system to said reference coordinate system using said mathematical relationship; and means for computing a point of regard from said mapped image aspects.
Claim 16
Dependent Claim
103 words
14 . A system for eye gaze tracking comprising: means for creating a set of reference points in a reference coordinate system; means for acquiring at least one image of at least one of a user's corneas, said image having image aspects in an image coordinate system and including reflections of said reference points; means for defining a mathematical relationship between said reference coordinate system and said image coordinate system; means for mapping said image aspects from said image coordinate system to said reference coordinate system using said mathematical relationship; and means for computing a point of regard from said mapped image aspects.
Claim 17
Dependent Claim
145 words
15 . A computer program product including a program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform method steps for eye gaze tracking, said program comprising: a first code means for creating a set of reference points in a reference coordinate system; a second code means for acquiring at least one image of at least one of a user's corneas, said image having image aspects in an image coordinate system and including reflections of said reference points; a third code means for defining a mathematical relationship between said reference coordinate system and said image coordinate system; a fourth code means for mapping said image aspects from said image coordinate system to said reference coordinate system using said mathematical relationship; and a fifth code means for computing a point of regard from said mapped image aspects.
Claim 18
Dependent Claim
145 words
15 . A computer program product including a program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform method steps for eye gaze tracking, said program comprising: a first code means for creating a set of reference points in a reference coordinate system; a second code means for acquiring at least one image of at least one of a user's corneas, said image having image aspects in an image coordinate system and including reflections of said reference points; a third code means for defining a mathematical relationship between said reference coordinate system and said image coordinate system; a fourth code means for mapping said image aspects from said image coordinate system to said reference coordinate system using said mathematical relationship; and a fifth code means for computing a point of regard from said mapped image aspects.
References Cited (Backward Citations)
No citation records indexed.
USPTO Annuity & Maintenance Windows
Maintenance schedule is calculated for granted US utility patents.