Patent US5543887A successfully refreshed from Google Patents.
US5543887A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Device for detecting line of sight
Assignee: Canon Inc
•
Filing: 1993-10-27
•
Granted: 1996-08-06
•
Expires: 2013-10-27
Abstract
Abstract A device is provided device for detecting the line of sight of an observer, based on the positions of the Purkinje's image and of the center of the pupil circle. The device is capable, in determining the pupil circle from the pupil edge data collected from the image sensor, of preventing erroneous estimation of the pupil circle resulting from false noise data, by partially excluding or adding the edge data in the estimation process of the pupil circle and evaluating the reliability of the obtained estimated circle.
Inventors
- 👤 Akira Akashi
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-07 11:56
CPC Classifications
G; G03; G03B; G03B13/00; G03B13/02; G03B2213/00; G03B2213/02; G03B2213/025
Claims Analysis
Total Claims: 81
Claim 1
Independent Claim
118 words
A device for detecting a shape of a region of an eyeball, said device comprising: a) detection means for detecting boundary position information for a boundary between a first region and a second region of the eyeball, said boundary divided into areas that each include plural boundary position information, wherein the boundary between the first and second regions is substantially circular; b) selection means for selecting at least one area among the plurality of areas of the boundary detected by said detection means based on a predetermined threshold; and c) calculation means for estimating an external shape of the first region by utilizing the boundary position information for the area of the boundary selected by said selection means.
Claim 2
Independent Claim
118 words
A device for detecting a shape of a region of an eyeball, said device comprising: a) detection means for detecting boundary position information for a boundary between a first region and a second region of the eyeball, said boundary divided into areas that each include plural boundary position information, wherein the boundary between the first and second regions is substantially circular; b) selection means for selecting at least one area among the plurality of areas of the boundary detected by said detection means based on a predetermined threshold; and c) calculation means for estimating an external shape of the first region by utilizing the boundary position information for the area of the boundary selected by said selection means.
Claim 3
Dependent Claim
20 words
A device according to claim 1, wherein said first organism is a pupil, and said second organism is an iris.
Claim 4
Dependent Claim
21 words
A device according to claim 1, wherein said detection means is adapted to detect said boundary in directionally different plural groups.
Claim 5
Dependent Claim
20 words
A device according to claim 3, wherein said first organism is a pupil, and said second organism is an iris.
Claim 6
Dependent Claim
46 words
A device according to claim 3, wherein said calculation means is adapted to estimate said external shape of said first organism, by preferentially employing, among said boundary position information of said plural groups detected by said detection means, the boundary position information of the horizontal direction.
Claim 7
Dependent Claim
45 words
A device according to claim 4, wherein said calculation means is adapted to estimate said external shape of said pupil, by preferentially employing, among said boundary position information of said plural groups detected by said detection means, the boundary position information of the horizontal direction.
Claim 8
Dependent Claim
22 words
A device according to claim 1, wherein said calculation means is adapted to estimate said external shape by the least square method.
Claim 9
Dependent Claim
22 words
A device according to claim 6, wherein said calculation means is adapted to estimate said external shape by the least square method.
Claim 10
Dependent Claim
44 words
A device according to claim 1, wherein said detection means includes light receiving means for receiving an eyeball image, and is adapted to detect said boundary between said first and second organisms in said plural groups, by the output of said light receiving means.
Claim 11
Dependent Claim
44 words
A device according to claim 4, wherein said detection means includes light receiving means for receiving an eyeball image, and is adapted to detect said boundary between said pupil and said iris in said plural groups, by the output of said light receiving means.
Claim 12
Dependent Claim
20 words
A device according to claim 1, wherein said calculation means is adapted to estimate the outline of said first organism.
Claim 13
Dependent Claim
19 words
A device according to claim 2, wherein said calculation means is adapted to estimate the outline of said pupil.
Claim 14
Dependent Claim
20 words
A device according to claim 5, wherein said calculation means is adapted to estimate the outline of said first organism.
Claim 15
Dependent Claim
19 words
A device according to claim 6, wherein said calculation means is adapted to estimate the outline of said pupil.
Claim 16
Dependent Claim
37 words
A device according to claim 1, further comprising: sight line detecting means for detecting the line of sight of said eyeball, based on the information on the external shape of said pupil, estimated by said calculation means.
Claim 17
Dependent Claim
37 words
A device according to claim 2, further comprising: sight line detecting means for detecting the line of sight of said eyeball, based on the information on the external shape of said pupil, estimated by said calculation means.
Claim 18
Dependent Claim
38 words
A device according to claim 5, further comprising: sight line detecting means for detecting the line of sight of said eyeball, based on the information on the external shape of said first organism, estimated by said calculation means.
Claim 19
Dependent Claim
37 words
A device according to claim 6, further comprising: sight line detecting means for detecting the line of sight of said eyeball, based on the information on the external shape of said pupil estimated by said calculation means.
Claim 20
Dependent Claim
24 words
A device according to claim 15, further comprising: display means controlled according to the sight line information obtained by said sight line detecting means.
Claim 21
Dependent Claim
24 words
A device according to claim 16, further comprising: display means controlled according to the sight line information obtained by said sight line detecting means.
Claim 22
Dependent Claim
28 words
A device according to claim 15, further comprising: electromechanical conversion means controlled according to the information on the line of sight, obtained by said sight line detecting means.
Claim 23
Dependent Claim
28 words
A device according to claim 17, further comprising: electromechanical conversion means controlled according to the information on the line of sight, obtained by said sight line detecting means.
Claim 24
Independent Claim
125 words
A device for detecting a shape of a region of an eyeball, said device comprising: a) detection means for detecting data indicative of a boundary between a first region and a second region of the eyeball, wherein the boundary is substantially circular; b) first calculation means for calculating a respective estimated error of each of said plurality of boundary data; c) determining means for determining which boundary data has the greatest effect on an overall estimated error associated with an estimated shape of the first region; and d) second calculation means for calculating an estimated external shape of the first region utilizing a portion of the boundary data excluding the boundary data having the greatest effect on the overall estimated error from said boundary data.
Claim 25
Independent Claim
125 words
A device for detecting a shape of a region of an eyeball, said device comprising: a) detection means for detecting data indicative of a boundary between a first region and a second region of the eyeball, wherein the boundary is substantially circular; b) first calculation means for calculating a respective estimated error of each of said plurality of boundary data; c) determining means for determining which boundary data has the greatest effect on an overall estimated error associated with an estimated shape of the first region; and d) second calculation means for calculating an estimated external shape of the first region utilizing a portion of the boundary data excluding the boundary data having the greatest effect on the overall estimated error from said boundary data.
Claim 26
Dependent Claim
77 words
A device according to claim 23, wherein said determining means comprises means for selectively excluding different portions of the boundary data to form respective subsets of boundary data, means for calculating a plurality of shape estimates of the first region respectively based on the subsets of boundary data, means for determining an estimated error for each shape estimate, and means for selecting a subset of boundary data corresponding to the shape estimate having the lowest estimated error.
Claim 27
Dependent Claim
43 words
A device according to claim 24, wherein said means for calculating a plurality of shape estimates comprises means for reducing the estimated error for shape estimates that are based on a subset of boundary data including data from predetermined regions of the boundary.
Claim 28
Dependent Claim
42 words
A device according to claim 24, wherein said means for excluding selected portions of boundary data comprises means for excluding a portion of boundary data corresponding to one of an upper region, lower region, left region, and right region of the boundary.
Claim 29
Dependent Claim
28 words
A device according to claim 24, wherein the first region of the eyeball is a pupil region and the second region of the eyeball is an iris region.
Claim 30
Dependent Claim
21 words
A device according to claim 24, wherein said means for calculating the plurality of shape estimates uses a least square method.
Claim 31
Dependent Claim
50 words
A device according to claim 24, wherein said determining means further comprises means for selecting an excluded portion of boundary data corresponding to the selected subset of boundary data and means for designating the selected excluded portion as the boundary data having the greatest effect on the overall estimated error.
Claim 32
Dependent Claim
74 words
A device according to claim 24, wherein said determining means further comprises means for selecting an excluded portion of boundary data corresponding to the selected subset of boundary data, means for determining whether each data value in the excluded portion of boundary data satisfies a predetermined condition, and means for designating the data values that fail to satisfy the predetermined condition as the boundary data having the greatest effect on the overall estimated error.
Claim 33
Dependent Claim
80 words
A device according to claim 30, wherein said determining means further comprises means for selecting a portion of the selected subset of boundary data, means for determining whether each data value in the selected portion of the selected subset satisfies a different predetermined condition, and means for designating the data values that satisfy the predetermined condition and the data values in the excluded portion of boundary data as the boundary data having the greatest effect on the overall estimated error.
Claim 34
Independent Claim
113 words
A device for detecting a line of sight of an eyeball, comprising: a) detection means for detecting data indicative of a boundary between a first region and a second region of the eyeball, wherein the boundary is substantially circular; b) first calculation means for calculating a respective estimated error of each of said plurality of boundary data; c) estimating means for estimating an external shape of the first region by selectively utilizing a portion of the boundary data so that an overall estimated error associated with the shape estimate is below a predetermined threshold; and d) second calculation means for calculating a line of sight using the shape estimated by said estimating means.
Claim 35
Independent Claim
113 words
A device for detecting a line of sight of an eyeball, comprising: a) detection means for detecting data indicative of a boundary between a first region and a second region of the eyeball, wherein the boundary is substantially circular; b) first calculation means for calculating a respective estimated error of each of said plurality of boundary data; c) estimating means for estimating an external shape of the first region by selectively utilizing a portion of the boundary data so that an overall estimated error associated with the shape estimate is below a predetermined threshold; and d) second calculation means for calculating a line of sight using the shape estimated by said estimating means.
Claim 36
Dependent Claim
51 words
A device according to claim 32, wherein said estimating means comprises determining means for determining the boundary data having the greatest effect on the overall estimated error and means for calculating a shape estimate utilizing the boundary data excluding the boundary data having the greatest effect on the overall estimated error.
Claim 37
Dependent Claim
77 words
A device according to claim 33, wherein said determining means comprises means for selectively excluding different portions of the boundary data to form respective subsets of boundary data, means for calculating a plurality of shape estimates of the first region respectively based on the subsets of boundary data, means for determining an estimated error for each shape estimate, and means for selecting a subset of boundary data corresponding to the shape estimate having the lowest estimated error.
Claim 38
Dependent Claim
40 words
A device according to claim 34, wherein said means for calculating a plurality of shape estimates comprises means for reducing the estimated error for shape estimates that are based on a subset of boundary data including predetermined portions of data.
Claim 39
Dependent Claim
42 words
A device according to claim 34, wherein said means for excluding selected portions of boundary data comprises means for excluding a portion of boundary data corresponding to one of an upper region, lower region, left region, and right region of the boundary.
Claim 40
Dependent Claim
28 words
A device according to claim 34, wherein the first region of the eyeball is a pupil region and the second region of the eyeball is an iris region.
Claim 41
Dependent Claim
22 words
A device according to claim 34, wherein said means for calculating the plurality of shape estimates uses a least square re method.
Claim 42
Dependent Claim
50 words
A device according to claim 34, wherein said determining means further comprises means for selecting an excluded portion of boundary data corresponding to the selected subset of boundary data and means for designating the selected excluded portion as the boundary data having the greatest effect on the overall estimated error.
Claim 43
Dependent Claim
74 words
A device according to claim 34, wherein said determining means further comprises means for selecting an excluded portion of boundary data corresponding to the selected subset of boundary data, means for determining whether each data value in the excluded portion of boundary data satisfies a predetermined condition, and means for designating the data values that fail to satisfy the predetermined condition as the boundary data having the greatest effect on the overall estimated error.
Claim 44
Dependent Claim
80 words
A device according to claim 40, wherein said determining means further comprises means for selecting a portion of the selected subset of boundary data, means for determining whether each data value in the selected portion of the selected subset satisfies a different predetermined condition, and means for designating the data values that satisfy the predetermined condition and the data values in the excluded portion of boundary data as the boundary data having the greatest effect on the overall estimated error.
Claim 45
Dependent Claim
49 words
A device according to claim 32, further comprising means for detecting a position of an image reflected from the eyeball, wherein said calculation means comprises means for calculating the line of sight based on the shape estimated by said estimating means and the detected position of the reflected image.
Claim 46
Dependent Claim
21 words
A device according to claim 32, wherein said means for detecting a reflected image comprises means for detecting a Purkinje's image.
Claim 47
Independent Claim
123 words
A device for detecting a shape of a region of an eyeball, comprising: a) detection means for detecting a plurality of boundary position information between a first region and a second region of the eyeball, wherein a boundary between the first region and the second region is substantially circular; b) grouping means for dividing the detected plural boundary position information into a plurality of groups, each group consisting of a plurality of boundary position information; c) selection means for selecting a group which satisfies a predetermined condition from among the plural groups; and d) calculation means for estimating an external shape of the first region only based on the plurality of boundary position information included in the group selected by said selection means.
Claim 48
Independent Claim
123 words
A device for detecting a shape of a region of an eyeball, comprising: a) detection means for detecting a plurality of boundary position information between a first region and a second region of the eyeball, wherein a boundary between the first region and the second region is substantially circular; b) grouping means for dividing the detected plural boundary position information into a plurality of groups, each group consisting of a plurality of boundary position information; c) selection means for selecting a group which satisfies a predetermined condition from among the plural groups; and d) calculation means for estimating an external shape of the first region only based on the plurality of boundary position information included in the group selected by said selection means.
Claim 49
Dependent Claim
28 words
A device according to claim 44, wherein the first region is a pupil portion of the eyeball and the second region is an iris portion of the eyeball.
Claim 50
Dependent Claim
33 words
A device according to claim 44, wherein said grouping means divides the boundary between the first region and the second region into a horizontal direction and a vertical direction, and performs group dividing.
Claim 51
Dependent Claim
33 words
A device according to claim 46, wherein the predetermined condition of said selection means is set in order to select by preferentially employing a group in the horizontal direction among the plural groups.
Claim 52
Dependent Claim
20 words
A device according to claim 44, wherein said calculation means estimates the external shape by utilizing a least square method.
Claim 53
Dependent Claim
42 words
A device according to claim 44, wherein said detection means have light receiving means for receiving an eyeball image and detects the boundary position information dividing the first region and the second region according to an output from the light receiving means.
Claim 54
Dependent Claim
20 words
A device according to claim 44, wherein said calculation means estimates an outline of a pupil portion of the eyeball.
Claim 55
Dependent Claim
17 words
A device according to claim 45, wherein said calculation means estimates an outline of the pupil portion.
Claim 56
Dependent Claim
37 words
A device according to claim 44, further comprising line of sight detection means for detecting line of sight of the eyeball based on information of the external shape of the first region estimated by said calculation means.
Claim 57
Dependent Claim
27 words
A device according to claim 52, further comprising display means to be controlled according to line of sight information obtained by said line of sight detection means.
Claim 58
Dependent Claim
28 words
A device according to claim 52, further comprising electro-mechanical energy conversion means to be controlled by line of sight information obtained by said line of sight detection means.
Claim 59
Independent Claim
177 words
A device for detecting a shape of a region of an eyeball, comprising: a) detection means for detecting plural boundary position information between a first region and a second region of the eyeball, wherein a boundary between the first region and the second region is substantially circular; b) grouping means for dividing the detected plural boundary position information into a plurality of groups, each group consisting of plural boundary position information; c) first calculation means for estimating an external shape of the first region by selectively excluding one of the groups among the plurality of groups, said first calculation means changing the group to be excluded and performing the calculation a plurality of times; and d) first evaluation means for evaluating a reliability of the respective external shape of the first region estimated by said first calculation means for each calculation; wherein a shape of the region of the eyeball is detected by utilizing at least the plural boundary position information included in the plural groups which said first evaluation means evaluates as having the highest reliability.
Claim 60
Independent Claim
177 words
A device for detecting a shape of a region of an eyeball, comprising: a) detection means for detecting plural boundary position information between a first region and a second region of the eyeball, wherein a boundary between the first region and the second region is substantially circular; b) grouping means for dividing the detected plural boundary position information into a plurality of groups, each group consisting of plural boundary position information; c) first calculation means for estimating an external shape of the first region by selectively excluding one of the groups among the plurality of groups, said first calculation means changing the group to be excluded and performing the calculation a plurality of times; and d) first evaluation means for evaluating a reliability of the respective external shape of the first region estimated by said first calculation means for each calculation; wherein a shape of the region of the eyeball is detected by utilizing at least the plural boundary position information included in the plural groups which said first evaluation means evaluates as having the highest reliability.
Claim 61
Dependent Claim
28 words
A device according to claim 55, wherein the first region is a pupil portion of the eyeball and the second region is an iris portion of the eyeball.
Claim 62
Dependent Claim
20 words
A device according to claim 55, wherein said calculation means estimates the external shape by utilizing a least square method.
Claim 63
Dependent Claim
20 words
A device according to claim 55, wherein said calculation means estimates an outline of a pupil portion of the eyeball.
Claim 64
Dependent Claim
17 words
A device according to claim 56, wherein said calculation means estimates an outline of the pupil portion.
Claim 65
Dependent Claim
42 words
A device according to claim 55, wherein said detection means have light receiving means for receiving an eyeball image and detects the boundary position information between the first region and the second region according to an output from the light receiving means.
Claim 66
Dependent Claim
96 words
A device according to claim 55, further comprising second evaluation means for evaluating again the reliability of the respective plural boundary position information included in the excluded group when said first evaluation means evaluates the highest reliability; and second calculation means for estimating again the external shape of the first region by utilizing the plural boundary position information of the plural groups of which said first evaluation means evaluates the highest reliability and by utilizing the boundary position information of the excluded groups of which said second evaluation means evaluates high reliability among the excluded groups.
Claim 67
Dependent Claim
36 words
A device according to claim 61, further comprising line of sight detection means for detecting line of sight of the eyeball based on the external shape of the first region estimated by said second calculation means.
Claim 68
Dependent Claim
27 words
A device according to claim 62, further comprising display means to be controlled according to line of sight information obtained by said line of sight detection means.
Claim 69
Dependent Claim
30 words
A device according to claim 62, further comprising electro-mechanical energy conversion means to be controlled according to the line of sight information obtained by said line of sight detection means.
Claim 70
Independent Claim
129 words
A device for detecting a shape of a region of an eyeball, comprising: a) detection means for detecting plural boundary position information between a first region and a second region of the eyeball, wherein a boundary between the first region and the second region is substantially circular; b) calculation means for estimating an external shape of the first region based on the plural boundary position information; c) determining means for determining a reliability of the plural boundary position information based on whether the respective boundary position information included in the plural boundary position information is located at the same circumference; and d) changing means for changing determination criterion of said determining means based on a size of the external shape of the first region estimated by said calculation means.
Claim 71
Independent Claim
129 words
A device for detecting a shape of a region of an eyeball, comprising: a) detection means for detecting plural boundary position information between a first region and a second region of the eyeball, wherein a boundary between the first region and the second region is substantially circular; b) calculation means for estimating an external shape of the first region based on the plural boundary position information; c) determining means for determining a reliability of the plural boundary position information based on whether the respective boundary position information included in the plural boundary position information is located at the same circumference; and d) changing means for changing determination criterion of said determining means based on a size of the external shape of the first region estimated by said calculation means.
Claim 72
Dependent Claim
22 words
A device according to claim 65, wherein the first region is a pupil portion and the second region is an iris portion.
Claim 73
Dependent Claim
20 words
A device according to claim 65, wherein said calculation means estimates the external shape by utilizing a least square method.
Claim 74
Dependent Claim
33 words
A device according to claim 65, wherein said detection means divide the plural boundary position information into plural groups and detects the information, and said determination means determines a reliability of each group.
Claim 75
Dependent Claim
34 words
A device according to claim 68, wherein said calculation means excludes the group of which reliability is determined as low by said determination means and estimates again the external shape of the first region.
Claim 76
Dependent Claim
42 words
A device according to claim 65, wherein said detection means have light receiving means for receiving an eyeball image and detects the boundary position information between the first region and the second region according to an output from the light receiving means.
Claim 77
Dependent Claim
21 words
A device according to claim 65, wherein said second calculation means estimates an outline of a pupil region of the eyeball.
Claim 78
Dependent Claim
18 words
A device according to claim 66, wherein said second calculation means estimates an outline of the pupil portion.
Claim 79
Dependent Claim
37 words
A device according to claim 65, further comprising line of sight detection means for detecting line of sight of the eyeball based on information of the external shape of the first region estimated by said calculation means.
Claim 80
Dependent Claim
27 words
A device according to claim 73, further comprising display means to be controlled according to line of sight information obtained by said line of sight detection means.
Claim 81
Dependent Claim
29 words
A device according to claim 73, further comprising electro-mechanical energy conversion means to be controlled according to line of sight information obtained by said line of sight detection means.
References Cited (Backward Citations)
US3712716A
Cited
US5327191A
Cited
US4973149A
Cited
JPH01241511A
Cited
US5036347A
Cited
US5182443A
Cited
US5280312A
Cited
JPH04347131A
Cited
JPH04347128A
Cited
US5335035A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1999-08-06 | 2000-02-05 | 2000-08-06 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2003-08-06 | 2004-02-05 | 2004-08-06 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2007-08-06 | 2008-02-05 | 2008-08-06 | $7700.00 | Window Closed / Lapsed |