← Back to Patent Explorer
US4958375A Expired / Lapsed US ⏱️ 0.0 years remaining

Parallel, multi-unit, adaptive pattern classification system using inter-unit correlations and an intra-unit class separator methodology

Assignee: Nestor Inc
•
Filing: 1988-02-17
•
Granted: 1990-09-18
•
Expires: 2008-02-17
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A system is disclosed for separating and identifying classes of patterns or events which are not necessarily linearly separable. The patterns are represented by an input signal S. The system comprises (1) a plurality of classification units, connected in parallel to receive the input signal S and (2) a class selection device, responsive to the output signals produced by the classification units, for producing a single output response R representing the class of each respective pattern. At least some of the pattern classification units include generalizer units having a memory for storing a number of generalizer "prototypes" and a comparator for comparing the vector location of an input pattern with each of the generalizer prototypes.

Inventors

  • 👤 Douglas L. Reilly
  • 👤 Christopher L. Scofield
  • 👤 Leon N. Cooper
  • 👤 Charles Elbaum

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-25 08:21
CPC Classifications
G; G06; G06F; G06F18/00; G06F18/20; G06F18/25; G06F18/254

Claims Analysis

Total Claims: 21
Claim 1
Independent Claim 550 words
In a system for classification and identification of patterns, each pattern being represented by an input signal S, said system comprising at least one classification unit U i including: (1) pattern feature encoding means, responsive to said signal S, for producing an intermediate signal F, comprised of signal components F 1 , F 2 . . . F i . . . F k , representative of features contained in the pattern represented by said signal S; and (2) pattern classification means, responsive to said intermediate signal F, for producing an output signal R i representative of a proposed respective class of said pattern represented by said signal S as identified by the features represented by said intermediate signal F; the improvement wherein said pattern classification means include: (a) generalizer means comprising: (i) memory means for storing a plurality of generalizer prototypes within a multi-dimensional pattern space, each generalizer prototype including, as prototype information stored in said memory means: a vector location in said pattern space; a scalar distance, in a given range between a minimum and maximum value, defining the size of a region of influence about said vector location of said generalizer prototype; and a particular class with which said generalizer prototype is associated; and (ii) means for comparing the vector location of an input pattern, represented by said intermediate signal F, with a plurality of said generalizer prototypes stored in said memory means to determine whether said input pattern location falls within a region of influence of at least one of said generalizer prototypes, and for producing a generalizer output classification response, indicative of the class associated with said at least one generalizer prototype, if said input pattern location falls within the region of influence thereof; (b) separator means comprising: (i) memory means for storing a plurality of separator prototypes within said pattern space, each separator prototype including, as prototype information stored in said memory means: a vector location in said pattern space; a scalar distance defining the size of a region of influence about said vector location of said separator prototype; a particular class with which said separator prototype is associated; the identity of a pair of generalizer prototypes with which said separator prototype is associated; and an index specifying a portion of the signal components F 1 , F 2 . . . . F i . . . F k of the pattern space holding the generalizer prototypes with which said separator prototype is associated; (ii) means for comparing the location of an input pattern, represented by the signal components of said intermediate signal F identified by the respective index of a separator prototype, with at least one of said separator prototypes stored in said memory means to determine whether said input pattern location falls within a region of influence of such separator prototype, and for producing a separator output classification response, indicative the class of said input pattern, if said input pattern location falls within the region of influence of such separator prototype; and (c) polling means, responsive to said generalizer means and said separator means, for producing a classification unit output signal R i , in dependence upon said generalizer and separator output classification responses; thereby to identify patterns which fall within the regions of influence of a plurality of generalizer prototypes.
Claim 2
Dependent Claim 550 words
In a system for classification and identification of patterns, each pattern being represented by an input signal S, said system comprising at least one classification unit U i including: (1) pattern feature encoding means, responsive to said signal S, for producing an intermediate signal F, comprised of signal components F 1 , F 2 . . . F i . . . F k , representative of features contained in the pattern represented by said signal S; and (2) pattern classification means, responsive to said intermediate signal F, for producing an output signal R i representative of a proposed respective class of said pattern represented by said signal S as identified by the features represented by said intermediate signal F; the improvement wherein said pattern classification means include: (a) generalizer means comprising: (i) memory means for storing a plurality of generalizer prototypes within a multi-dimensional pattern space, each generalizer prototype including, as prototype information stored in said memory means: a vector location in said pattern space; a scalar distance, in a given range between a minimum and maximum value, defining the size of a region of influence about said vector location of said generalizer prototype; and a particular class with which said generalizer prototype is associated; and (ii) means for comparing the vector location of an input pattern, represented by said intermediate signal F, with a plurality of said generalizer prototypes stored in said memory means to determine whether said input pattern location falls within a region of influence of at least one of said generalizer prototypes, and for producing a generalizer output classification response, indicative of the class associated with said at least one generalizer prototype, if said input pattern location falls within the region of influence thereof; (b) separator means comprising: (i) memory means for storing a plurality of separator prototypes within said pattern space, each separator prototype including, as prototype information stored in said memory means: a vector location in said pattern space; a scalar distance defining the size of a region of influence about said vector location of said separator prototype; a particular class with which said separator prototype is associated; the identity of a pair of generalizer prototypes with which said separator prototype is associated; and an index specifying a portion of the signal components F 1 , F 2 . . . . F i . . . F k of the pattern space holding the generalizer prototypes with which said separator prototype is associated; (ii) means for comparing the location of an input pattern, represented by the signal components of said intermediate signal F identified by the respective index of a separator prototype, with at least one of said separator prototypes stored in said memory means to determine whether said input pattern location falls within a region of influence of such separator prototype, and for producing a separator output classification response, indicative the class of said input pattern, if said input pattern location falls within the region of influence of such separator prototype; and (c) polling means, responsive to said generalizer means and said separator means, for producing a classification unit output signal R i , in dependence upon said generalizer and separator output classification responses; thereby to identify patterns which fall within the regions of influence of a plurality of generalizer prototypes.
Claim 3
Dependent Claim 42 words
The system defined in claim 1, wherein said generalizer means further include means for modifying said scalar distance defining the size of a region of influence of each generalizer prototype, within said given range, when said system is in a training mode.
Claim 4
Dependent Claim 30 words
The system defined in claim 1, wherein said maximum value defines a region of influence for the respective generalizer prototype of approximately five percent to fifty percent said pattern space.
Claim 5
Dependent Claim 127 words
The system defined in claim 1, wherein each generalizer prototype further includes, as prototype information stored in said generalizer memory means, a set of weighting factors (W 1 , W 2 . . . W i . . . W k ), one for each respective component (F 1 , F 2 . . . F i . . . F k ) of said intermediate signal F, and wherein said pattern classification means further include means for multiplying each intermediate signal component F i by the respective, associated weighting factor W i or means for performing a bit comparison between the input signal F i and the weighting factor W i , to produce a weighted signal component F' i for comparison by said comparing means.
Claim 6
Dependent Claim 33 words
The system defined in claim 1, further comprising means for adjusting said generalizer weighting factors, when in a training mode, to modify the output classification response R i of said pattern classification means.
Claim 7
Dependent Claim 38 words
The system defined in claim 1, wherein said separator means further include means for modifying said scalar distance defining the size of a region of influence of each separator prototype, when said system is in a training mode.
Claim 8
Dependent Claim 127 words
The system defined in claim 1, wherein each separator prototype further includes, as prototype information stored in said separator memory means, a set of weighting factors(W 1 , W 2 . . . W i . . . W k ), one for each respective component (F 1 , F 2 . . . F i . . . F k ) of said intermediate signal F, and wherein said pattern classification means further include means for multiplying each intermediate signal component F i by the respective, associated weighting factor W i , or means for performing a bit comparison between the input signal F i and the weighting factor W i , to produce a weighted signal component F' i for comparison by said comparing means.
Claim 9
Dependent Claim 33 words
The system defined in claim 7, further comprising means for adjusting said separator weighting factors, when in a training mode, to modify the output classification response R i of said pattern classification means.
Claim 10
Dependent Claim 33 words
The system defined in claim 1, wherein each pattern classification means which comprise generalizer means and separator means further include means for determining the pair of generalizer prototypes associated with each separator prototype.
Claim 11
Dependent Claim 100 words
The system defined in claim 1, wherein said system includes a plurality of said classification units U i , U 2 , . . . U i , . . . U k which produce output signals R 1 , R 2 , . . . R i . . . U k , respectively, and wherein paid system includes class selection means, responsive to all of said output signals R 1 , R 2 , . . . R i . . . R k , for producing a single output response R representing the class of said pattern.
Claim 12
Independent Claim 481 words
A method for classification and identification of patterns in a system comprising input means for receiving an input signal F comprised of signal components F 1 , F 2 . . . F i . . . F k representing each input pattern as a location in a multi-dimensional pattern space, memory means for storing information, and computer means connected to said input means and to said memory means, said method comprising the steps of: (a) storing in said memory means a plurality of generalizer prototypes within said multi-dimensional pattern space, each generalizer prototype including, as prototype information stored in said memory means: a vector location in said pattern space; a scalar distance, in a range between minimum and maximum value, defining the size of a region of influence about said vector location of said generalizer prototype; and a particular class with which said generalizer prototype is associated; (b) comparing the location of an input pattern, represented by said input signal F, with a plurality of said generalizer prototypes stored in said memory means to determine whether said input pattern location falls within a region of influence of at least one of said generalizer prototypes; (c) producing a generalizer output classification response, indicative of the class associated with said at least one generalizer prototype, if said input pattern location falls within the region of influence thereof; (d) storing in said memory means a plurality of separator prototypes within said pattern space, each separator prototype including, as prototype information stored in said separator memory means: a vector location in said pattern space; a scalar distance defining the size of a region of influence about said vector location of said separator prototype; a particular class with which said separator prototype is associated; the identity of a pair of generalizer prototypes with which said separator prototype is associated; and an index specifying a portion of the signal components F 1 , F 2 , . . . F i . . . F k of the pattern space holding the generalizer prototypes with which said separator prototype is associated; (e) comparing the location of an input pattern, represented by the signal components of said input signal F identified by the respective index of a separator prototype, with at least one of said separator prototypes stored in said memory means to determine whether said input pattern location falls within a region of influence of such separator prototype; (f) producing a separator output classification response, indicative of the pattern class, if said input pattern location falls within the region of influence such separator prototype; and (g) producing an output signal R i , indicative of the class of the input pattern represented by said input signal F i , in dependence upon said generalizer and separator output classification responses; thereby to identify patterns which fall within the regions of influence of a plurality of generalizer prototypes.
Claim 13
Independent Claim 481 words
A method for classification and identification of patterns in a system comprising input means for receiving an input signal F comprised of signal components F 1 , F 2 . . . F i . . . F k representing each input pattern as a location in a multi-dimensional pattern space, memory means for storing information, and computer means connected to said input means and to said memory means, said method comprising the steps of: (a) storing in said memory means a plurality of generalizer prototypes within said multi-dimensional pattern space, each generalizer prototype including, as prototype information stored in said memory means: a vector location in said pattern space; a scalar distance, in a range between minimum and maximum value, defining the size of a region of influence about said vector location of said generalizer prototype; and a particular class with which said generalizer prototype is associated; (b) comparing the location of an input pattern, represented by said input signal F, with a plurality of said generalizer prototypes stored in said memory means to determine whether said input pattern location falls within a region of influence of at least one of said generalizer prototypes; (c) producing a generalizer output classification response, indicative of the class associated with said at least one generalizer prototype, if said input pattern location falls within the region of influence thereof; (d) storing in said memory means a plurality of separator prototypes within said pattern space, each separator prototype including, as prototype information stored in said separator memory means: a vector location in said pattern space; a scalar distance defining the size of a region of influence about said vector location of said separator prototype; a particular class with which said separator prototype is associated; the identity of a pair of generalizer prototypes with which said separator prototype is associated; and an index specifying a portion of the signal components F 1 , F 2 , . . . F i . . . F k of the pattern space holding the generalizer prototypes with which said separator prototype is associated; (e) comparing the location of an input pattern, represented by the signal components of said input signal F identified by the respective index of a separator prototype, with at least one of said separator prototypes stored in said memory means to determine whether said input pattern location falls within a region of influence of such separator prototype; (f) producing a separator output classification response, indicative of the pattern class, if said input pattern location falls within the region of influence such separator prototype; and (g) producing an output signal R i , indicative of the class of the input pattern represented by said input signal F i , in dependence upon said generalizer and separator output classification responses; thereby to identify patterns which fall within the regions of influence of a plurality of generalizer prototypes.
Claim 14
Dependent Claim 36 words
The method defined in claim 11, further comprising the step of modifying said scalar distance defining the size of a region of influence of each generalizer prototype, within said given range, while in a training mode.
Claim 15
Dependent Claim 31 words
The method defined in claim 11, wherein said maximum value defines a region of influence for the respective generalizer prototype of approximately five percent to fifty percent of said pattern space.
Claim 16
Dependent Claim 124 words
The method defined in claim 11, wherein each generalizer prototype further includes, as prototype information stored in said memory means, a set of generalizer weighting factors (W 1 , W 2 . . . W i . . . W k ), one for each respective component (F 1 , F 2 . . . F i . . . F k ) of said input signal F, and wherein said method further comprises the step of multiplying each input signal F i by the respective, associated, generalizer weighting factor W i or of performing a bit comparison between the input signal F i and the weighting factor W i , to produce a weighted signal F' i for utilization in said comparing step.
Claim 17
Dependent Claim 21 words
The method defined in claim 14, further comprising the step of adjusting said generalizer weighting factors, when in a training mode.
Claim 18
Dependent Claim 31 words
The method defined in claim 11, further comprising the step of modifying said scalar distance defining the size and region of influence of each separator prototype, when in a training mode.
Claim 19
Dependent Claim 126 words
The method defined in claim 11, wherein each separator prototype further includes, as prototype information stored in said memory means, a set of separator weighting factors (W 1 , W 2 . . . W i . . . W k ), one for each respective component (F 1 , F 2 . . . F i . . . F k ) of said input signal F, and wherein said method further includes the step of multiplying each input signal component F i by the respective, associated, separator weighting factor W i or of performing a bit comparison between the input signal F i and the weighting factor W i , to produce a weighted signal component F' i for utilization in said comparing step.
Claim 20
Dependent Claim 21 words
The method defined in claim 17, further comprising the step of adjusting said separation weighting factors, when in a training mode.
Claim 21
Dependent Claim 22 words
The method defined in claim 11, further comprising the step of determining the pair of generalizer prototypes associated with each separator prototype.

References Cited (Backward Citations)

US3601802A Cited
US3950733A Cited
US4030068A Cited
US4044243A Cited
US4254474A Cited
US4326259A Cited
US4760604A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1993-09-17 1994-03-19 1994-09-18 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 1997-09-17 1998-03-19 1998-09-18 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2001-09-17 2002-03-19 2002-09-18 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag