US4809347A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Computer vision architecture
Assignee: Raytheon Co
•
Filing: 1986-07-18
•
Granted: 1989-02-28
•
Expires: 2006-07-18
Abstract
Abstract A computer architecture is disclosed for analyzing automatic image understanding problems. The architecture is designed so that it can efficiently perform a wide spectrum of tasks ranging from low level or iconic processing to high level or symbolic processing tasks. A first level (12) of image processing elements is provided for operating on the image matrix on a pixel per processing element basis. A second level (14) of processing elements is provided for operating on a plurality of pixels associated with a given array of first level processing elements. A third level (16) of processing elements is designed to instruct the first and second level processing elements, as well as for operating on a larger segment of the matrix. A host computer (18) is provided that directly communicates with at least each third level processing element. A high degree of parallelism is provided so that information can be readily transferred within the architecture at high speeds.
Inventors
- 👤 James G. Nash
- 👤 David B. Shu
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-27 05:24
CPC Classifications
G; G06; G06F; G06F15/00; G06F15/76; G06F15/80; G06F15/8007; G06F15/8023; G06T; G06T1/00; G06T1/20
Claims Analysis
Total Claims: 38
Claim 1
Independent Claim
202 words
A computer architecture for an image understanding machine for performing operations on image data in the form of a matrix of pixels, said machine comprising: a first level of image processing elements having a first construction that enables neighboring processing elements on the first level to operate on different instructions simultaneously; a second level of processing elements having a different construction than the first level processing elements, said second level processing elements each including means therein enabling processing elements on the second level to operate on different instructions simultaneously, each second level processing element being associated with a group of first level processing elements and communicating therewith as well as with other second level processing elements; a third level of processing elements having a construction different than the first and second level of processing elements, each third level processing element being associated with a given number of second level processing elements and communicating therewith as well as with other third level processing elements; and a host computer communicating with at least the third level processing elements whereby different instructions can be transmitted to the processing elements of various levels to enable the computer to operate simultaneously on multiple instructions in each level.
Claim 2
Dependent Claim
202 words
A computer architecture for an image understanding machine for performing operations on image data in the form of a matrix of pixels, said machine comprising: a first level of image processing elements having a first construction that enables neighboring processing elements on the first level to operate on different instructions simultaneously; a second level of processing elements having a different construction than the first level processing elements, said second level processing elements each including means therein enabling processing elements on the second level to operate on different instructions simultaneously, each second level processing element being associated with a group of first level processing elements and communicating therewith as well as with other second level processing elements; a third level of processing elements having a construction different than the first and second level of processing elements, each third level processing element being associated with a given number of second level processing elements and communicating therewith as well as with other third level processing elements; and a host computer communicating with at least the third level processing elements whereby different instructions can be transmitted to the processing elements of various levels to enable the computer to operate simultaneously on multiple instructions in each level.
Claim 3
Dependent Claim
74 words
The machine of claim 1 wherein the system is constructed on a plurality of circuit boards communicating with the host computer, each board containing: at least one third level processing element; a first plurality of second processing elements a second larger plurality of first processing elements; and connector means on the circuit board for establishing communication between at least the third level processing element on the board and the host computer through a bus.
Claim 4
Dependent Claim
46 words
The machine of claim 2 wherein said bus includes a backplane into which the connectors of the circuit boards are inserted, with the backplane being used as part of a global bus between the third level processors on the individual circuit boards and the host computer.
Claim 5
Dependent Claim
43 words
The machine of claim 2 wherein said first plurality of second level processing elements is an N×N array, where N is greater than 1; and wherein said second plurality of first processing elements is an mN×mN array, where m is greater than 1.
Claim 6
Dependent Claim
9 words
The machine of claim 4 wherein m equals 8.
Claim 7
Dependent Claim
40 words
The machine of claim 1 wherein said first level processing element includes a bit-serial arithmetic logic unit communicating with a random access memory and means for mesh connecting each processing element to its neighboring processing elements of the first level.
Claim 8
Dependent Claim
17 words
The machine of claim 1 wherein said second level processing elements each comprise a multi-bit parallel processor.
Claim 9
Dependent Claim
17 words
The machine of claim 1 wherein said third level processing elements each comprise a general purpose microprocessor.
Claim 10
Dependent Claim
28 words
The machine of claim 1 wherein, an array of first level processing elements is fabricated together with one second level processing element on a single integrated circuit chip.
Claim 11
Dependent Claim
37 words
The machine of claim 9 wherein said chip includes at least one dual ported memory bank having input/output lines connected both to the first level processing elements and to processing elements of at least one other level.
Claim 12
Dependent Claim
27 words
The machine o f claim 10 wherein said memory bank includes a plurality of cells, each cell containing at least one transistor defining a random access memory.
Claim 13
Dependent Claim
85 words
The machine of claim 10 wherein said chip includes first microprogram store means for storing instructions and a first decoder for decoding the instructions for controlling the operation of selected first level processing elements, second microprogram store means for storing different instructions and a second decoder for decoding the different instructions for controlling the operation of the second level processing elements, and wherein the input/output lines of the memory bank are connected to said microprogram store as well as to said first level processing elements.
Claim 14
Dependent Claim
37 words
The machine of claim 9 wherein one second level processing element is located on said chip together with means on the chip connecting said second level processing element to an array of 64 first level processing elements.
Claim 15
Dependent Claim
71 words
The machine of claim 1 wherein the host communicates with each third level processing element by way of a backplane, each third level processing element communicates with its associated second level processing element by way of a bus provided on a circuit board, and wherein each second level processing element communicates with its associated group of first level processing elements by way of a bus provided on an integrated circuit chip.
Claim 16
Independent Claim
112 words
A method of analyzing an image represented by a matrix of pixels, said method comprising: loading the pixels into an image understanding machine having first, second and third levels of processing elements in which processing elements in each level have different constructions; simultaneously performing different operations on selected groups of the pixels with the first level processing elements, there being one first level processing element for each pixel in the matrix; using the second level processing elements to simultaneously perform other operations on a group of pixels associated with an array of first level processing elements; and using the third level processing elements to instruct the first and second level processing elements.
Claim 17
Independent Claim
112 words
A method of analyzing an image represented by a matrix of pixels, said method comprising: loading the pixels into an image understanding machine having first, second and third levels of processing elements in which processing elements in each level have different constructions; simultaneously performing different operations on selected groups of the pixels with the first level processing elements, there being one first level processing element for each pixel in the matrix; using the second level processing elements to simultaneously perform other operations on a group of pixels associated with an array of first level processing elements; and using the third level processing elements to instruct the first and second level processing elements.
Claim 18
Dependent Claim
23 words
The method of claim 15 which further comprises: providing parallel connections between processing elements of each level to thereby maximize communication rates therebetween.
Claim 19
Dependent Claim
54 words
The method of claim 16 wherein parallel connection between said first level processing elements is provided by a nearest neighbor mesh, wherein the connection for the second level processing elements is provided by a nearest neighbor mesh, and wherein parallel connections between the third level processing elements is provided by a bused cube connection.
Claim 20
Dependent Claim
22 words
The method of claim 17 which further comprises: establishing communication between a host computer and at least each third level processing element.
Claim 21
Dependent Claim
29 words
The method of claim 18 wherein said communication is established by a global bus defined in part by a backplane into which a plurality of circuit boards are inserted.
Claim 22
Dependent Claim
35 words
The method of claim 19 which further comprises: establishing communication between each third level processing element and an associated array of second level processing elements by way of a bus provided on a circuit board.
Claim 23
Dependent Claim
35 words
The method of claim 20 which further comprises: establishing communication between each second level processing element and a group of first level processing elements by way of a bus provided on an integrated circuit chip.
Claim 24
Dependent Claim
35 words
The method of claim 15 which further includes: representing an object in the image by three levels of binary mask representations, each mask corresponding to said first, second and third level of processing elements, respectively.
Claim 25
Dependent Claim
27 words
The method of claim 22 wherein each mask contains an array of binary bits, with each binary bit corresponding to a processing element in the given level.
Claim 26
Dependent Claim
28 words
The method of claim 15 which further comprises: fabricating an array of first level processing elements on an integrated circuit chip together with one second level processing element.
Claim 27
Dependent Claim
62 words
The method of claim 24 wherein each processing element consists of a module having a central processing unit and memory, and wherein the method further includes: constructing the memory on the chip with dual ports such that input/output lines thereof can be used to establish communication between the central processing unit of at least both the first and second level processing elements.
Claim 28
Dependent Claim
201 words
A machine for performing operations on image data in the form of a matrix of pixels, said machine comprising: a plurality of circuit boards having connector means thereon pluggable into a backplane of a cabinet; and N×N array of integrated circuit chips located on the board, wherein N is an integer, each chip including an mN×mN array of first level processing elements, wherein mN is an integer, said first level processing elements being mesh connected to neighboring processing elements; each chip further including a second level processing element connected to each of the first level processing elements and having a different construction therefrom, said chip further including individually addressable first means for controlling selected first level processing elements so that they can operate on different instructions simultaneously, and the chip also including an individually addressable second means for controlling said second level processing element; a third level processing element of still different construction located on the board and connected to each second level processing element on the board, said third level processing element also being coupled to said connector; and means including said backplane for defining a global bus connecting each of the third level processing elements with a host computer.
Claim 29
Dependent Claim
201 words
A machine for performing operations on image data in the form of a matrix of pixels, said machine comprising: a plurality of circuit boards having connector means thereon pluggable into a backplane of a cabinet; and N×N array of integrated circuit chips located on the board, wherein N is an integer, each chip including an mN×mN array of first level processing elements, wherein mN is an integer, said first level processing elements being mesh connected to neighboring processing elements; each chip further including a second level processing element connected to each of the first level processing elements and having a different construction therefrom, said chip further including individually addressable first means for controlling selected first level processing elements so that they can operate on different instructions simultaneously, and the chip also including an individually addressable second means for controlling said second level processing element; a third level processing element of still different construction located on the board and connected to each second level processing element on the board, said third level processing element also being coupled to said connector; and means including said backplane for defining a global bus connecting each of the third level processing elements with a host computer.
Claim 30
Dependent Claim
24 words
The machine of claim 26 wherein each first level processing element includes a bit serial arithmetic logic unit communicating with a random access memory.
Claim 31
Dependent Claim
17 words
The machine of claim 26 wherein said each second level processing element comprises a multi-bit parallel processor.
Claim 32
Dependent Claim
16 words
The machine of claim 26 wherein each third level processing element comprises a general purpose microprocessor.
Claim 33
Dependent Claim
20 words
The machine of claim 26 wherein said first level processing elements are adapted to perform iconic operations on the pixels.
Claim 34
Dependent Claim
22 words
The machine of claim 26 wherein said second level processing elements are adapted to perform intermediate level symbolic operations on the pixels.
Claim 35
Dependent Claim
25 words
The machine of claim 26 wherein said third level processing elements are adapted to instruct the operation of said first and second level processing elements.
Claim 36
Dependent Claim
34 words
The machine of claim 26 wherein each chip contains at least one memory bank having dual ports with input/output lines providing access to the memory by both the first and second level processing elements.
Claim 37
Dependent Claim
184 words
A machine for performing operations on image data in the form of a matrix of pixels, said machine comprising: a circuit board having connector means thereon pluggable into a back plane of a cabinet; N×N groups of integrated circuit devices located on the board, wherein N is an integer, each group including an mN×mN array of first level processing elements, wherein mN is an integer, said first level processing elements being mesh connected to neighboring first level processing elements; each group further including a second level processing element connected to each of the first level processing elements and having a different construction therefrom, each group further including individually addressable first means for controlling selected first level processing elements so that they can operate on different instructions simultaneously, and each group also including an individually addressable second means for controlling said second level processing element; said machine further including a third level processing element of still different construction which is connected to each second level processing element on the board, and means including said back plane for defining a bus connection to a host computer.
Claim 38
Dependent Claim
184 words
A machine for performing operations on image data in the form of a matrix of pixels, said machine comprising: a circuit board having connector means thereon pluggable into a back plane of a cabinet; N×N groups of integrated circuit devices located on the board, wherein N is an integer, each group including an mN×mN array of first level processing elements, wherein mN is an integer, said first level processing elements being mesh connected to neighboring first level processing elements; each group further including a second level processing element connected to each of the first level processing elements and having a different construction therefrom, each group further including individually addressable first means for controlling selected first level processing elements so that they can operate on different instructions simultaneously, and each group also including an individually addressable second means for controlling said second level processing element; said machine further including a third level processing element of still different construction which is connected to each second level processing element on the board, and means including said back plane for defining a bus connection to a host computer.
References Cited (Backward Citations)
US4015240A
Cited
US4309691A
Cited
US4215401A
Cited
US4351025A
Cited
US4447886A
Cited
US4524428A
Cited
US4484349A
Cited
US4622632A
Cited
US4665556A
Cited
US4556955A
Cited
US4601055A
Cited
US4611347A
Cited
US4653112A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1992-02-28 | 1992-08-29 | 1993-02-28 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1996-02-28 | 1996-08-29 | 1997-02-28 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2000-02-28 | 2000-08-29 | 2001-02-28 | $7700.00 | Window Closed / Lapsed |