US4748502A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Computer vision system based upon solid state image sensor
Assignee: Sentient Systems Technology Inc
•
Filing: 1986-08-18
•
Granted: 1988-05-31
•
Expires: 2006-08-18
Abstract
Abstract A system for computer vision in association with a computer comprises a solid state image sensor or optic ram, a lens, a clock circuit for sequentially addressing the image sensor, and an edge detect circuit for detecting edges in the output bit stream of the image sensor. The edge detect circuit generates an interrupt signal for application to the clock circuit to stop the clock from advancing the addresses and for application to the computer to signal it to read the column and row address currently generated by the clock circuit.
Inventors
- 👤 Mark B. Friedman
- 👤 Gary J. Kiliany
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-05 14:55
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/18; G06T; G06T7/00; G06T7/10; G06T7/12; G06T7/70; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/30; G06T2207/30196; G06T2207/30201
Claims Analysis
Total Claims: 28
Claim 1
Independent Claim
262 words
A system for computer vision based upon a solid state image sensor used in association with a host computer comprising: (a) a solid state image sensor analogous to a memory device, said sensor comprising a two-dimensional array of light sensitive memory cells arranged in a plurality of rows and columns, each cell being accessible for reading, refreshing, and writing to set each cell to an initial signal value, the signals on said cells decaying at a rate related to light intensity thereupon, the output upon reading any cell being a signal indicative of darker if the signal on the cell has not decayed to a preset threshold or a signal indicative of lighter if the signal at said cell has decayed to said threshold, (b) a lens for focussing a light image on said image sensor, (c) clock means for continuously generating column address signals and row address signal for each cell during sequential accessing of each cell, said clock means having row address and column address buffers that can be read to a computer data bus, and (d) edge detecting means for processing an output bit stream from said image sensor when each cell is being sequentially accessed for detecting a change in the value of the bits indicative of an edge between lighter and darker areas of the light image focussed on said array, said edge detecting means including means for generating an interrupt signal for application to the computer whereby the computer can read the column and row address of the edge by reading the column and row buffers.
Claim 2
Independent Claim
262 words
A system for computer vision based upon a solid state image sensor used in association with a host computer comprising: (a) a solid state image sensor analogous to a memory device, said sensor comprising a two-dimensional array of light sensitive memory cells arranged in a plurality of rows and columns, each cell being accessible for reading, refreshing, and writing to set each cell to an initial signal value, the signals on said cells decaying at a rate related to light intensity thereupon, the output upon reading any cell being a signal indicative of darker if the signal on the cell has not decayed to a preset threshold or a signal indicative of lighter if the signal at said cell has decayed to said threshold, (b) a lens for focussing a light image on said image sensor, (c) clock means for continuously generating column address signals and row address signal for each cell during sequential accessing of each cell, said clock means having row address and column address buffers that can be read to a computer data bus, and (d) edge detecting means for processing an output bit stream from said image sensor when each cell is being sequentially accessed for detecting a change in the value of the bits indicative of an edge between lighter and darker areas of the light image focussed on said array, said edge detecting means including means for generating an interrupt signal for application to the computer whereby the computer can read the column and row address of the edge by reading the column and row buffers.
Claim 3
Dependent Claim
130 words
A system according to claim 1 further comprising a control means for causing each row of said image sensor to be at one time in at least one of three modes comprising a "refresh mode" wherein the signal on each cell is continuously refreshed, a "read" mode wherein each cell is read by accessing in a substantially sequential manner with the output bit stream being passed to the edge detecting means and a "soak" mode wherein the signals on the cells are allowed to decay the "read" mode being selected for detecting edges and transferring row and column address signals to the computer, the "refresh" mode being selected for maintaining the signals on said cells, and the "soak" mode being selected for transferring the light image to the image sensor.
Claim 4
Dependent Claim
48 words
A system according to claim 2 wherein the control means includes means for in the refresh mode accessing one cell from each row to cause the refresh of the entire row and wherein the read mode each cell is restored to its initial signal value indicative of darker.
Claim 5
Dependent Claim
31 words
A system according to claim 1 wherein the clock means includes means for addressing the rows in interleaved sets such that each set can be treated as a different image sensor.
Claim 6
Dependent Claim
38 words
A system according to claim 2 wherein the clock means includes means for addressing the rows in interleaved sets such that the control means can place each set in a different mode than at least one other set.
Claim 7
Independent Claim
48 words
A system as in any of claims 1 to 5 wherein the edge detecting means includes means for outputting a signal indicative of whether the last bit in the bit stream was indicative of a darker or lighter condition of the bit stream just after each edge detection.
Claim 8
Dependent Claim
25 words
A system according to claim 2 wherein the clock means includes means to restart in response to an acknowledge signal generated by the control means.
Claim 9
Dependent Claim
33 words
A system according to claim 2 wherein the clock means includes means for providing an end of frame signal when a refresh or read has been completed for selected rows in said array.
Claim 10
Dependent Claim
34 words
A system according to claim 1 or 2 further comprising means for presetting the row count in the clock means by writing a row address to the clock means for the computer data bus.
Claim 11
Dependent Claim
41 words
The system according to claim 1 wherein the clock means comprises means for interrupting the generation of address signals in response to an interrupt signal and wherein the interrupt signal generated by the edge detector is applied to the clock means.
Claim 12
Independent Claim
501 words
A system for computer vision based upon a solid state image sensor used in association with a host computer comprising: (a) a solid state image sensor analogous to a memory device, said sensor comprising a two-dimensional array of light sensitive memory cells arranged in a plurality of rows and columns, each cell being accessible for reading, refreshing, and writing to set each cell to an initial signal value, the signals on said cells decaying during soak times at a rate related to light intensity thereupon, the output upon reading any cell being a signal indicative of darker if the signal on the cell has not decayed to a present threshold or a signal indicative of lighter if the signal at said cell has decayed to said threshold, (b) a lens for focussing the light image on said image sensor, (c) clock means for continuously generating column address signals and row address signals for each cell during sequential accessing of each cell in each row, said clock means having row address and column address buffers that can be read to a computer data bus, (d) edge detecting means for processing an output bit stream from said image sensor when each cell is being sequentially accessed for detecting a change in the value of the bits indicative of an edge between lighter and darker areas of the light image focussed on said array, said edge detecting means including means for generating an interrupt signal for application to the clock means to stop the clock and for application to the computer whereby the computer can read the column and row address of the edge by reading the column and row buffers, and (e) a control means for causing each row of said image sensor to be at one time in at least one of three modes comprising a "refresh mode" wherein the signal on each cell is continually refreshed, a "read" mode wherein each cell is read by accessing in a substantially sequential manner with the output bit stream being passed to the edge detecting means and a "soak" mode wherein the signals on the cells are allowed to decay, the "read" mode being selected for detecting edges and transferring row and column address signals to the computer, the "refresh" mode being selected for maintaining the signals on said cells, and the "soak" mode being selected for transferring the light image to the image sensor, and said host computer having a data and address bus, said computer being in communication with said clock means and control means at least via its data and address buses for programming the soak times and controlling the accessing of date in said row address and column address buffers and said host computer further having an associated main memory with a stored task for interactively controlling the clock and control means to enable the computer to read the data in said buffers and to build edge address tables in said memory and to interpret the data in said tables.
Claim 13
Independent Claim
501 words
A system for computer vision based upon a solid state image sensor used in association with a host computer comprising: (a) a solid state image sensor analogous to a memory device, said sensor comprising a two-dimensional array of light sensitive memory cells arranged in a plurality of rows and columns, each cell being accessible for reading, refreshing, and writing to set each cell to an initial signal value, the signals on said cells decaying during soak times at a rate related to light intensity thereupon, the output upon reading any cell being a signal indicative of darker if the signal on the cell has not decayed to a present threshold or a signal indicative of lighter if the signal at said cell has decayed to said threshold, (b) a lens for focussing the light image on said image sensor, (c) clock means for continuously generating column address signals and row address signals for each cell during sequential accessing of each cell in each row, said clock means having row address and column address buffers that can be read to a computer data bus, (d) edge detecting means for processing an output bit stream from said image sensor when each cell is being sequentially accessed for detecting a change in the value of the bits indicative of an edge between lighter and darker areas of the light image focussed on said array, said edge detecting means including means for generating an interrupt signal for application to the clock means to stop the clock and for application to the computer whereby the computer can read the column and row address of the edge by reading the column and row buffers, and (e) a control means for causing each row of said image sensor to be at one time in at least one of three modes comprising a "refresh mode" wherein the signal on each cell is continually refreshed, a "read" mode wherein each cell is read by accessing in a substantially sequential manner with the output bit stream being passed to the edge detecting means and a "soak" mode wherein the signals on the cells are allowed to decay, the "read" mode being selected for detecting edges and transferring row and column address signals to the computer, the "refresh" mode being selected for maintaining the signals on said cells, and the "soak" mode being selected for transferring the light image to the image sensor, and said host computer having a data and address bus, said computer being in communication with said clock means and control means at least via its data and address buses for programming the soak times and controlling the accessing of date in said row address and column address buffers and said host computer further having an associated main memory with a stored task for interactively controlling the clock and control means to enable the computer to read the data in said buffers and to build edge address tables in said memory and to interpret the data in said tables.
Claim 14
Dependent Claim
33 words
A system according to claim 11 wherein the main memory has a stored task for continuously changing the soak times and analyzing data in said tables until the desired soak times are achieved.
Claim 15
Dependent Claim
33 words
A system according to claim 12 wherein the main memory has a stored task for increasing the soak times between building tables in memory until the brightest spot on the array is detected.
Claim 16
Dependent Claim
33 words
A system according to claim 12 wherein the main memory has a stored task for decreasing the soak times between building tables in memory until the darkest area on the array is detected.
Claim 17
Dependent Claim
36 words
A system according to claim 11 wherein the clock means comprises means for addressing rows in interleaved sets and the control means can place each set in a different mode than at least one other set.
Claim 18
Dependent Claim
33 words
A system according to claim 15 wherein the main memory has a stored task for using the data from one interleaved set of rows only to detect the brightest spot on the array.
Claim 19
Dependent Claim
398 words
An eyetracker for detecting from the image of an eye focussed thereon the center of the pupil which is the darkest portion of the image and the center of the corneal reflection which is the brightest spot on the image comprising: (a) a display bearing indicia which may be selected with the user's eyes, (b) a light source, (c) a solid state image sensor analogous to a memory device, said sensor comprising a two-dimensional array of light sensitive memory cells, (d) a lens for focussing a light image on said image sensor, (e) clock means for continuously generating column address signals and row address signals for each cell during sequential accessing of said memory cells, (f) a host computer having address and data buses, (g) edge detecting means for processing an output bit stream from said image sensor, said edge detecting means including means for generating an interrupt signal for application to the computer whereby the computer can read the column and row address of a detected edge, (h) a control means for causing each row of said image sensor to be in at lest a "read" mode or a "soak" mode, the length of time in the soak mode determining the signal level detected, the "read" mode being selected for detecting edges and transferring row and column address signals to the host computer and the "soak" mode being selected for transferring the light image to the image sensor, said host computer being in communication with said clock means and control means at least via its data and address buses for controlling the accessing of data from the image sensor, said host computer further having an associated main memory with a stored task for interactively controlling the clock and control means to enable the computer to read the row and column address signals to build edge address tables in said memory including a subtask for finding the corneal reflection of an eye upon which the image sensor which is the brightest spot on the array and having a subtask for finding the pupil by detecting the border between the pupil and the iris and having a subtask for finding the center of the corneal reflection and the center of the pupil and establishing the the distance and direction from center to center and having a task for correlating the distance and direction with the indicia upon the display.
Claim 20
Dependent Claim
398 words
An eyetracker for detecting from the image of an eye focussed thereon the center of the pupil which is the darkest portion of the image and the center of the corneal reflection which is the brightest spot on the image comprising: (a) a display bearing indicia which may be selected with the user's eyes, (b) a light source, (c) a solid state image sensor analogous to a memory device, said sensor comprising a two-dimensional array of light sensitive memory cells, (d) a lens for focussing a light image on said image sensor, (e) clock means for continuously generating column address signals and row address signals for each cell during sequential accessing of said memory cells, (f) a host computer having address and data buses, (g) edge detecting means for processing an output bit stream from said image sensor, said edge detecting means including means for generating an interrupt signal for application to the computer whereby the computer can read the column and row address of a detected edge, (h) a control means for causing each row of said image sensor to be in at lest a "read" mode or a "soak" mode, the length of time in the soak mode determining the signal level detected, the "read" mode being selected for detecting edges and transferring row and column address signals to the host computer and the "soak" mode being selected for transferring the light image to the image sensor, said host computer being in communication with said clock means and control means at least via its data and address buses for controlling the accessing of data from the image sensor, said host computer further having an associated main memory with a stored task for interactively controlling the clock and control means to enable the computer to read the row and column address signals to build edge address tables in said memory including a subtask for finding the corneal reflection of an eye upon which the image sensor which is the brightest spot on the array and having a subtask for finding the pupil by detecting the border between the pupil and the iris and having a subtask for finding the center of the corneal reflection and the center of the pupil and establishing the the distance and direction from center to center and having a task for correlating the distance and direction with the indicia upon the display.
Claim 21
Dependent Claim
34 words
An eyetracker according to claim 17 wherein the clock means includes means for addressing rows in interleaved sets such that each set can be in a different mode than at least one other set.
Claim 22
Dependent Claim
38 words
An eyetracker according to claim 18 wherein the control means and host computer include means for using one of said sets of rows to detect the corneal reflection and another of said interleaved sets to detect the pupil.
Claim 23
Dependent Claim
37 words
An eyetracker according to claim 17 wherein the control means and host computer include means for establishing the soak periods of different durations for each set such that one set is read while another is still soaking.
Claim 24
Dependent Claim
51 words
An eyetracker according to claim 17 wherein the clock means includes means for presetting the row count by writing a row address to the clock means from the computer whereby once the corneal reflection has been located only that portion of the array likely to contain the pupil image is read.
Claim 25
Dependent Claim
52 words
An image sensor according to claim 1 wherein the image sensor comprises more than one array, each array being spaced from the next thus establishing at least one blind area between arrays and further comprising means for mechanically shifting the solid state image sensor to alter the location of the blind area.
Claim 26
Dependent Claim
30 words
An eyetracker according to claim 17 further comprising means for controlling the intensity of the light source such that during the search for the pupil the light intensity is increased.
Claim 27
Independent Claim
338 words
A system for computer vision based upon a solid state image sensor used in association with a host computer comprising: (a) a solid state image sensor analogous to a memory device, said sensor comprising a two-dimensional array of light sensitive memory cells arranged in a plurality of rows and columns, each cell being accessible for reading and writing to set each cell to an initial signal value, the signals on said cells decaying at a rate related to light intensity thereupon, the output upon reading any cell being a signal indicative of darker if the signal on the cell has not decayed to a preset threshold or a signal indicative of lighter if the signals at said cell has decayed to said threshold, (b) a lens for focussing a light image on said image sensor, (c) clock means for continuously generating column address signals and row address signals for each cell during sequential accessing of each, said clock means having row address and column address buffers that can be read to a computer data bus, (d) edge detecting means for processing an output bit stream from said image sensor when each cell is being sequentially accessed for detecting a change in the value of the bits indicative of an edge between lighter and darker areas of the light image focussed on said array, said edge detecting means including means for generating an interrupt signal for application to the computer whereby the computer can read the column and row address of the edge by reading the column and row buffers, and (e) a control means for causing said image sensor to be in a "read" mode wherein each cell is being accessed in a substantially sequential manner with the output bit stream being passed to the edge detecting means or a "soak" mode wherein the signals on the cells are allowed to decay, the "read" mode being selected for transferring data to the computer and the "soak" mode being selected for transferring the light image to the image sensor.
Claim 28
Independent Claim
338 words
A system for computer vision based upon a solid state image sensor used in association with a host computer comprising: (a) a solid state image sensor analogous to a memory device, said sensor comprising a two-dimensional array of light sensitive memory cells arranged in a plurality of rows and columns, each cell being accessible for reading and writing to set each cell to an initial signal value, the signals on said cells decaying at a rate related to light intensity thereupon, the output upon reading any cell being a signal indicative of darker if the signal on the cell has not decayed to a preset threshold or a signal indicative of lighter if the signals at said cell has decayed to said threshold, (b) a lens for focussing a light image on said image sensor, (c) clock means for continuously generating column address signals and row address signals for each cell during sequential accessing of each, said clock means having row address and column address buffers that can be read to a computer data bus, (d) edge detecting means for processing an output bit stream from said image sensor when each cell is being sequentially accessed for detecting a change in the value of the bits indicative of an edge between lighter and darker areas of the light image focussed on said array, said edge detecting means including means for generating an interrupt signal for application to the computer whereby the computer can read the column and row address of the edge by reading the column and row buffers, and (e) a control means for causing said image sensor to be in a "read" mode wherein each cell is being accessed in a substantially sequential manner with the output bit stream being passed to the edge detecting means or a "soak" mode wherein the signals on the cells are allowed to decay, the "read" mode being selected for transferring data to the computer and the "soak" mode being selected for transferring the light image to the image sensor.
References Cited (Backward Citations)
US4379308A
Cited
GB2102122A
Cited
US4441125A
Cited
US4454545A
Cited
US4454541A
Cited
US4648052A
Cited
US4575751A
Cited
US4605960A
Cited
US4625237A
Cited
US4639775A
Cited
US4675736A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1991-05-31 | 1991-11-30 | 1992-05-31 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1995-05-31 | 1995-11-30 | 1996-05-31 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 1999-05-31 | 1999-11-30 | 2000-05-31 | $7700.00 | Window Closed / Lapsed |