US4493105A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for visual image processing
Assignee: General Electric Co
•
Filing: 1982-03-31
•
Granted: 1985-01-08
•
Expires: 2002-03-31
Abstract
Abstract Method and apparatus is disclosed for automatically processing visual images electronically so as to permit intelligent machine analysis of the image content. A special distributed logic system architecture facilitates rapid real time image analysis and the production of reaction control signals in a high speed production line environment, for example. Dedicated decision logic is employed to determine in but a single micro-instruction cycle whether a detected corner point of the image should be linked to another already linked chain of such corner points so as to define part of a closed edge contour of the image under examination. This ability to so rapidly classify encoded corner points as either belonging or not belonging to a given set of such corner points which describe a closed edge contour is quite useful in achieving rapid real time image analysis capability. Special dedicated data address indexing circuitry is also employed for most expeditiously retrieving successive address linked data words from a data memory in successive single micro-instruction cycles as required to take full advantage of the high speed dedicated corner point matching circuitry. The dedicated data memory indexing circuitry is provided in addition to the usual program instruction indexing circuitry employed in connection with the instruction register of the associated data processing system.
Inventors
- 👤 Donald L. Beall
- 👤 Harold W. Tomlinson, Jr.
- 👤 William G. Hart, Jr.
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-27 05:39
CPC Classifications
G; G06; G06T; G06T9/00; G06T9/20; G06V; G06V10/00; G06V10/40; G06V10/46; G06V10/469
Claims Analysis
Total Claims: 25
Claim 1
Independent Claim
351 words
A visual image processing system for digitally processing an electronic video image of an object within a pre-defined field of view so as to automatically identify closed edge contours of the object within such an image, said system comprising: electronic video camera means for converting a predetermined visual field of view to a sequence of digital electronic video signals each of which represents a corresponding elemental picture element of such a visual field of view and for providing a new frame of such video signals in response to an input electronic command signal; video processing means connected to said camera means and including an image plane memory means for temporarily storing video digital data produced in response to plural frames of said video signals and a first electronic control means for controlling said image plane memory means to accept said video digital data at a first data rate corresponding to the rate at which it is caused to occur by said camera means and to provide said video digital data at a second data rate, which may be different from said first data rate; image processing means connected to receive successive frames of said temporarily stored video digital data from the image plane memory means and including: (a) corner point encoding means for identifying all contour corner points included in a given frame of said video digital data and for generating digital data representative thereof, (b) feature extracting sorter means for automatically sorting said corner point digital data into separate closed linked sets, each set being representative of one closed edge contour of an object thus identified in said video image, and (c) a second electronic control means connected to control the operation of said corner point encoding means and said feature extracting sorter means; and third electronic control means connected to coordinate said first and second electronic control means so as to collect successive frames of said video digital data in said image plane memory means and to subsequently supply such collected data to said image processing means when it is next available for processing another frame of similar data.
Claim 2
Dependent Claim
351 words
A visual image processing system for digitally processing an electronic video image of an object within a pre-defined field of view so as to automatically identify closed edge contours of the object within such an image, said system comprising: electronic video camera means for converting a predetermined visual field of view to a sequence of digital electronic video signals each of which represents a corresponding elemental picture element of such a visual field of view and for providing a new frame of such video signals in response to an input electronic command signal; video processing means connected to said camera means and including an image plane memory means for temporarily storing video digital data produced in response to plural frames of said video signals and a first electronic control means for controlling said image plane memory means to accept said video digital data at a first data rate corresponding to the rate at which it is caused to occur by said camera means and to provide said video digital data at a second data rate, which may be different from said first data rate; image processing means connected to receive successive frames of said temporarily stored video digital data from the image plane memory means and including: (a) corner point encoding means for identifying all contour corner points included in a given frame of said video digital data and for generating digital data representative thereof, (b) feature extracting sorter means for automatically sorting said corner point digital data into separate closed linked sets, each set being representative of one closed edge contour of an object thus identified in said video image, and (c) a second electronic control means connected to control the operation of said corner point encoding means and said feature extracting sorter means; and third electronic control means connected to coordinate said first and second electronic control means so as to collect successive frames of said video digital data in said image plane memory means and to subsequently supply such collected data to said image processing means when it is next available for processing another frame of similar data.
Claim 3
Dependent Claim
39 words
A visual image processing system as in claim 1 wherein each of said first, second and third electronic control means comprise a programmed micro-processor connected to communicate digital electronic signals therebetween via a common bus system of electrical conductors.
Claim 4
Dependent Claim
133 words
A visual image processing system as in claim 1 or 2 further comprising a number N of said electronic video camera means and wherein: said image plane memory means comprises a number M of memory means for storing individual frames of digitized video signals, M being at least equal to N; and said first control means includes means for steering a frame of video signals emanating from any one of said camera means to any then available one of said M memory means and for maintaining accurate identifying digital data associated therewith identifying the camera and/or the relative sequence of the frame's occurrence so that any desired one of previously stored frames of such video data for any given camera may be accurately located and supplied to said image processing means when requested.
Claim 5
Dependent Claim
63 words
A visual image processing system as in claim 3 wherein said first control means includes means for steering a frame of video signals emanating from each one of said camera means to a predetermined respectively corresponding one of said memory means unless it is then already still storing a previously acquired frame of video signals not yet supplied to said image processing means.
Claim 6
Dependent Claim
48 words
A visual image processing system as in claim 3 wherein said image plane memory means comprises further memory means for storing individual overlay frames of predetermined digitized video signals which may be logically combined with the frames of digitized video signals stored in said image plane memory means.
Claim 7
Dependent Claim
45 words
A visual image processing system as in claim 1 or 2 wherein: said corner point encoding means includes FIFO memory means for storing the encoded corner point digital data generated by it until said feature extracting sorter means is next available for sorting such data.
Claim 8
Dependent Claim
76 words
A visual image processing system as in claim 1 or 2 wherein said feature extracting sorter means sequentially sorts individual corner point digital data into respectively associated closed linked sets to thus incrementally define each of the corresponding closed edge contours and further comprising atomic feature calculating means for calculating predetermined incremental geometric features of the closed edge contours then being incrementally defined each time another corner point is sorted into a given closed linked set.
Claim 9
Dependent Claim
54 words
A visual image processing system as in claim 1 or 2 wherein said third electronic control means includes user-program input means for adapting the third electronic control means to automatically analyze pre-determined geometric features of the identified contours and to generate corresponding accept/reject output signals based upon whether such features are within predetermined tolerances.
Claim 10
Dependent Claim
43 words
A visual image processing system as in claim 4 wherein: said corner point encoding means includes FIFO memory means for storing the encoded corner point digital data generated by it until said feature extracting sorter means is next available for sorting such data.
Claim 11
Dependent Claim
74 words
A visual image processing system as in claim 4 wherein said feature extracting sorter means sequentially sorts individual corner point digital data into respectively associated closed linked sets to thus incrementally define each of the corresponding closed edge contours and further comprising atomic feature calculating means for calculating predetermined incremental geometric features of the closed edge contours then being incrementally defined each time another corner point is sorted into a given closed linked set.
Claim 12
Dependent Claim
52 words
A visual image processing system as in claim 4 wherein said third electronic control means includes user-program input means for adapting the third electronic control means to automatically analyze pre-determined geometric features of the identified contours and to generate corresponding accept/reject output signals based upon whether such features are within predetermined tolerances.
Claim 13
Dependent Claim
74 words
A visual image processing system as in claim 9 wherein said feature extracting sorter means sequentially sorts individual corner point digital data into respectively associated closed linked sets to thus incrementally define each of the corresponding closed edge contours and further comprising atomic feature calculating means for calculating predetermined incremental geometric features of the closed edge contours then being incrementally defined each time another corner point is sorted into a given closed linked set.
Claim 14
Dependent Claim
52 words
A visual image processing system as in claim 9 wherein said third electronic control means includes user-program input means for adapting the third electronic control means to automatically analyze pre-determined geometric features of the identified contours and to generate corresponding accept/reject output signals based upon whether such features are within pre-determined tolerances.
Claim 15
Dependent Claim
52 words
A visual image processing system as in claim 12 wherein said third electronic control means includes user-program input means for adapting the third electronic control means to automatically analyze pre-determined geometric features of the identified contours and to generate corresponding accept/reject output signals based upon whether such features are within predetermined tolerances.
Claim 16
Dependent Claim
88 words
A visual image processing system as in claim 1 wherein said image processing means includes: random access memory means for storing sorted partially closed linked sets of digital data representing corner points, and data swap multiplex means connected to supply said stored data from the random access memory means while at the same time permitting selective alteration of the format of such data so as to facilitate the rapid automatic sorting of as yet unsorted corner point digital data therewith to form said separate completely closed link sets.
Claim 17
Dependent Claim
286 words
A visual image processing system comprising: a plurality of electronic video cameras, each providing a stream of digital video data representing successive pixel values of a visual image; plural input data registers, each being connected to synchronously receive and temporarily store at least one pixel of said digital video data from one of said cameras; plural digital data comparators, each being connected to receive said temporarily stored digital video data from one of said cameras, pixel-by-pixel to compare the relative value of such video data for each pixel with a predetermined digital threshold word and to produce, in response, a single bit binary-valued output for each corresponding pixel of the visual image; plural image plane memory means for simultaneously storing the single bit binary-valued outputs from each of said digital data comparators; data steering means connected to receive said single bit binary-valued outputs from each said digital data comparator and to selectively steer it to any desired one of said image plane memory means; encoding means connected to successively receive data from the image plane memory means representing the pixels of a given visual image and to detect and produce a list of encoded digital data representing the closed edge contour(s) of object(s) within said visual image; FIFO memory means connected to receive and temporarily store said list of encoded digital data; sorting means connected to receive said list of encoded digital data from said FIFO memory means and to sort same into plural ordered lists which individually represent the closed edge contour(s) of object(s) within said visual image; and a main CPU data processor connected to coordinate the functions of the aforesaid apparatus and to accept user-generated decision logic for analyzing said closed edge contour(s).
Claim 18
Dependent Claim
286 words
A visual image processing system comprising: a plurality of electronic video cameras, each providing a stream of digital video data representing successive pixel values of a visual image; plural input data registers, each being connected to synchronously receive and temporarily store at least one pixel of said digital video data from one of said cameras; plural digital data comparators, each being connected to receive said temporarily stored digital video data from one of said cameras, pixel-by-pixel to compare the relative value of such video data for each pixel with a predetermined digital threshold word and to produce, in response, a single bit binary-valued output for each corresponding pixel of the visual image; plural image plane memory means for simultaneously storing the single bit binary-valued outputs from each of said digital data comparators; data steering means connected to receive said single bit binary-valued outputs from each said digital data comparator and to selectively steer it to any desired one of said image plane memory means; encoding means connected to successively receive data from the image plane memory means representing the pixels of a given visual image and to detect and produce a list of encoded digital data representing the closed edge contour(s) of object(s) within said visual image; FIFO memory means connected to receive and temporarily store said list of encoded digital data; sorting means connected to receive said list of encoded digital data from said FIFO memory means and to sort same into plural ordered lists which individually represent the closed edge contour(s) of object(s) within said visual image; and a main CPU data processor connected to coordinate the functions of the aforesaid apparatus and to accept user-generated decision logic for analyzing said closed edge contour(s).
Claim 19
Dependent Claim
264 words
A visual image processing method for digitally processing an electronic video image of an object within a pre-defined field of view so as to automatically identify closed edge contours of the object within such an image, said method comprising: converting a predetermined visual field of view to a sequence of digital electronic video signals each of which represents a corresponding elemental picture element of such a visual field of view and providing a new frame of such video signals in response to an input electronic command signal; temporarily storing video digital data produced in response to plural frames of said video signals in an image plane memory means and controlling said image plane memory means to accept said video digital data at a first data rate corresponding to the rate at which it is caused to occur by said camera means and to provide said video digital data at a second data rate, which may be different from said first data rate; identifying all contour corner points included in a given frame of said video digital data and generating digital data representative thereof, automatically sorting said corner point digital data into separate closed linked sets, each set being representative of one closed edge contour of an object thus identified in said video image, and coordinating said storing, identifying and sorting steps so as to collect successive frames of said video digital data in the image plane memory means and to subsequently supply such collected data when it is next possible to process another frame of similar data by performing said identifying and sorting steps.
Claim 20
Dependent Claim
264 words
A visual image processing method for digitally processing an electronic video image of an object within a pre-defined field of view so as to automatically identify closed edge contours of the object within such an image, said method comprising: converting a predetermined visual field of view to a sequence of digital electronic video signals each of which represents a corresponding elemental picture element of such a visual field of view and providing a new frame of such video signals in response to an input electronic command signal; temporarily storing video digital data produced in response to plural frames of said video signals in an image plane memory means and controlling said image plane memory means to accept said video digital data at a first data rate corresponding to the rate at which it is caused to occur by said camera means and to provide said video digital data at a second data rate, which may be different from said first data rate; identifying all contour corner points included in a given frame of said video digital data and generating digital data representative thereof, automatically sorting said corner point digital data into separate closed linked sets, each set being representative of one closed edge contour of an object thus identified in said video image, and coordinating said storing, identifying and sorting steps so as to collect successive frames of said video digital data in the image plane memory means and to subsequently supply such collected data when it is next possible to process another frame of similar data by performing said identifying and sorting steps.
Claim 21
Dependent Claim
110 words
A visual image processing method as in claim 17 further comprising storing individual frames of digitized video signals from a number N of electronic video cameras in a number M of memory means, M being at least equal to N; and steering a frame of video signals emanating from any one of said cameras to any then available one of said memory means and maintaining accurate identifying digital data associated therewith identifying the camera and/or the relative sequence of the frame's occurrence so that any desired one of previously stored frames of such video data for any given camera may be accurately located and supplied for image processing when requested.
Claim 22
Dependent Claim
58 words
A visual image processing method as in claim 18 wherein said steering step includes steering a frame of video signals emanating from each one of said camera means to a predetermined respectively corresponding one of said memory means unless it is then already still storing a previously acquired frame of video signals not yet supplied for image processing.
Claim 23
Dependent Claim
43 words
A visual image processing method as in claim 18 wherein said temporarily storing step comprises storing individual overlay frames of predetermined digitized video signals which may be logically combined with the frames of digitized video signals stored in said image plane memory means.
Claim 24
Dependent Claim
37 words
A visual image processing method as in claim 17 wherein: said identifying step includes storing the identified corner point digital data generated by it in a FIFO memory until said automatically sorting step can next be performed.
Claim 25
Dependent Claim
69 words
A visual image processing method as in claim 17 wherein said automatically sorting step includes sequentially sorting individual corner point digital data into respectively associated closed linked sets to thus incrementally define each of the corresponding closed edge contours and further comprises calculating predetermined incremental geometric features of the closed edge contours then being incrementally defined each time another corner point is sorted into a given closed linked set.
References Cited (Backward Citations)
US4118730A
Cited
US3576980A
Cited
US3905018A
Cited
US3889234A
Cited
US3863218A
Cited
US3936800A
Cited
US3987412A
Cited
US4014000A
Cited
US4183013A
Cited
US4093941A
Cited
US4087788A
Cited
US4162482A
Cited
US4288779A
Cited
US4300122A
Cited
US4288782A
Cited
US4400728A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1988-01-08 | 1988-07-09 | 1989-01-08 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1992-01-08 | 1992-07-09 | 1993-01-08 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 1996-01-08 | 1996-07-09 | 1997-01-08 | $7700.00 | Window Closed / Lapsed |