US4326259A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Self organizing general pattern class separator and identifier
Assignee: Nestor Inc
•
Filing: 1980-03-27
•
Granted: 1982-04-20
•
Expires: 2000-03-27
Abstract
Abstract A system is provided for the separation into and the indentification of classes of events wherein each of the events is represented by a signal vector comprising the signals s, s z . . . , s j . . . , s N . The system comprises a plurality of assemblies, each of the assemblies including a matrix of junction elements for respectively receiving as inputs the different respective signals of a vector. The junction elements provide a transfer of information A ij s,; i.e., the product of the transfer function of the element and the signal input applied thereto. The information transferred by the junction elements is summed in each assembly. In the training mode of operation information summed in each assembly is applied to a scalar multiplier and the resulting information is in turn applied to a threshold stage which is actuated to produce an output if the input applied thereto attains a prescribed value. Concurrently, the summed outputs of the junction elements are fed back to these elements to modify their transfer functions. The outputs of the threshold stages are finally processed for identification of the classes of events.
Inventors
- 👤 Leon N. Cooper
- 👤 Charles Elbaum
- 👤 Douglas L. Reilly
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-01 23:53
CPC Classifications
G; G06; G06F; G06F18/00; G06F18/20; G06F18/24; G06F18/241; G06F18/2413; G06F18/24133; G06F18/24143
Claims Analysis
Total Claims: 29
Claim 1
Independent Claim
286 words
An information processing system for separating classes of non-linearly as well as linearly separable patterns, each of said patterns being represented by a plurality N of input signals s 1 , s 2 , . . . s j . . . s N , said system comprising, in combination: (a) a plurality N of input terminals, each terminal (j) adapted to receive one of the N input signals (s j ); (b) a plurality M of summing means, each summing means (i) having N inputs and an output and being operative to provide a signal (p' i ) at its output representing the sum of the signal representations applied to its inputs; (c) a plurality N×M of junction elements, each junction element (ij) coupling one of said input terminals (j) with one summing means (i) and providing a transfer of information from the respective input terminal j to the respective summing means i in dependence upon the signal (s j ) appearing at the input terminal and upon the element transfer function A ij ; (d) a plurality M of threshold means, each threshold means (i) coupled to the output of one of said summing means (i) and adapted to produce an output (p i ) whenever the output signal (p' i ) produced by the respective summing means exceeds a given threshold value (θ pi ), whereby the output P represented by the respective output signals p 1 , P 2 . . . p i . . . p M of said threshold means provide a separation of the patterns represented by said input signals s 1 , s 2 , . . . s j . . . s N into classes.
Claim 2
Dependent Claim
286 words
An information processing system for separating classes of non-linearly as well as linearly separable patterns, each of said patterns being represented by a plurality N of input signals s 1 , s 2 , . . . s j . . . s N , said system comprising, in combination: (a) a plurality N of input terminals, each terminal (j) adapted to receive one of the N input signals (s j ); (b) a plurality M of summing means, each summing means (i) having N inputs and an output and being operative to provide a signal (p' i ) at its output representing the sum of the signal representations applied to its inputs; (c) a plurality N×M of junction elements, each junction element (ij) coupling one of said input terminals (j) with one summing means (i) and providing a transfer of information from the respective input terminal j to the respective summing means i in dependence upon the signal (s j ) appearing at the input terminal and upon the element transfer function A ij ; (d) a plurality M of threshold means, each threshold means (i) coupled to the output of one of said summing means (i) and adapted to produce an output (p i ) whenever the output signal (p' i ) produced by the respective summing means exceeds a given threshold value (θ pi ), whereby the output P represented by the respective output signals p 1 , P 2 . . . p i . . . p M of said threshold means provide a separation of the patterns represented by said input signals s 1 , s 2 , . . . s j . . . s N into classes.
Claim 3
Dependent Claim
65 words
A system as defined in claim 1, further comprising a Nestor adaptive module connected to receive the output signals p 1 , p 2 , . . . p i . . . p M of said threshold means for producing an output R represented by respective output signals r i , r 2 . . . r l . . . r k .
Claim 4
Dependent Claim
53 words
A system as defined in claim 1, wherein each of said threshold means include means for modifying the respective output signal p' i of said summing means with a respective chosen factor, and means for comparing the modified output with said threshold value and producing said output (p i ) in response thereto.
Claim 5
Dependent Claim
34 words
A system as defined in claim 3, wherein each of said signal modifying means is a scalar multiplying means for multiplying said output signal p' i by a respective scalar factor λ i .
Claim 6
Dependent Claim
48 words
A system as defined in claim 4, further comprising means for selectively adjusting said scalar factor λ i , when in a training mode, in dependence upon whether an incoming pattern is correctly or incorrectly identified by production of the output p i of the associated threshold means.
Claim 7
Dependent Claim
45 words
A system as defined in claim 5, wherein said scalar factor adjusting means comprises means for reducing the scalar factor λ i when an incoming pattern is incorrectly identified with a prototype by the threshold means with which that particular factor λ i is associated.
Claim 8
Dependent Claim
29 words
A system as defined in claim 6, wherein said scalar factor reducing means decrements said scalar factor by a prescribed amount each time an incoming pattern is incorrectly identified.
Claim 9
Independent Claim
40 words
A system as defined in any one of claims 4-7, further comprising means for setting each scalar factor λ i to a maximum value λ° i , thereby to associate committed prototypes with the scalar factors at their maximum values.
Claim 10
Dependent Claim
50 words
A system as defined in claim 1, further comprising means for selectively adjusting the threshold value θ pi of a threshold means, when in a training mode, in dependence upon whether an incoming pattern is correctly or incorrectly identified by production of the output p i of that threshold means.
Claim 11
Dependent Claim
46 words
A system as defined in claim 9, wherein said threshold value adjusting means comprises means for increasing the threshold value θ pi when an incoming pattern is incorrectly identified with a prototype by the threshold means with which that particular threshold value θ pi is associated.
Claim 12
Independent Claim
37 words
A system as defined in either one of claims 9 and 10, further comprising means for setting each threshold value θ pi to a minimum value θ° pi , thereby to commence training with minimum threshold values.
Claim 13
Independent Claim
34 words
A system as defined in any one of claims 1-10, wherein said threshold means is a trigger circuit which is actuated in response to an input thereto of at least said given threshold value.
Claim 14
Independent Claim
79 words
A system as defined in any one of claims 1-10, further comprising class identifying means responsive to the output signals p 1 , p 2 , . . . p 1 . . . p M of said threshold means for producing an output R, represented by respective output signals r 1 , r 2 . . . r l . . . r k , indicative of the particular class of each particular pattern presented to the system.
Claim 15
Dependent Claim
74 words
A system as defined in claim 13, wherein said class identifying means comprises a plurality K of OR circuits, there being at least one OR circuit for each class to be identified, each OR circuit being connected to receive those output signals p i associated with a particular class so as to produce an output signal r l indicative of said class upon receipt of one or more said output signals p i .
Claim 16
Dependent Claim
80 words
A system as defined in claim 13, wherein said class identifying means comprises: (a) a plurality of class output means, each of said last-named means being selected to produce outputs indicating events of a single class; (b) means respectively associated with each of said class output means for selectively activating each of said class output means; and (c) means responsive to the concurrent activation of a selective activating means and outputs to be produced from the activated class output means.
Claim 17
Dependent Claim
18 words
A system as defined in claim 15, wherein each of said class output means is an OR circuit.
Claim 18
Dependent Claim
175 words
A system as defined in claim 15 wherein said class identifying means further includes: (d) means respectively associated with said class output means and actuated in response to the production of an output from said selected class output means for enabling the switching into activation of said class output means without the operation of its associated activating means, whereby said last named class output means can thereafter produce an output in the absence of activation of its associated activating means; (e) means responsive to the occurrence of outputs from said threshold means not intended as outputs from a currently activated class output means, and outputable from a class output means switchable into activation because of the prior actuation of the enabling means for producing an output from said class output means; and (f) means responsive to said output from said class output means for selectively feeding back said output to those modifying means whose associated threshold means had produced said not intended outputs to change the value of the modifying factor in those modifying means.
Claim 19
Dependent Claim
18 words
A system as defined in claim 17, wherein each of said class output means is an OR circuit.
Claim 20
Dependent Claim
80 words
A system as defined in claim 17, wherein said means for causing the outputs from an activated class output means includes a three-input AND circuit while enabled by the concurrent appearance of signals at two of its inputs, the selective activating means being applied to first of its inputs, the output of a threshold means being applied to a second of its inputs, the output of said AND circuit being applied as an input to a said class output means.
Claim 21
Dependent Claim
54 words
A system as defined in claim 19, wherein said switching enabling means includes a bistable circuit which is switched to its set state upon the enabling, i.e. the production of an output from said AND circuit, the set output of said circuit being applied to the third of the inputs of said AND circuit.
Claim 22
Dependent Claim
30 words
A system as defined in claim 1, wherein the output of a junction element equals the product of its transfer function A ij and the signal s j applied thereto.
Claim 23
Independent Claim
64 words
A system as defined in any one of claims 1, 10 and 21, further comprising means for modifying the transfer function A ij of at least one of said junction elements, when in a training mode, in dependence upon the incoming signal s j applied thereto and the output signal p' i of the summing means i with which said junction element is associated.
Claim 24
Dependent Claim
22 words
A system as defined in claim 22, wherein said transfer function modifying means is operative to modify all of said transfer functions.
Claim 25
Dependent Claim
65 words
A system as defined in claim 22, wherein said transfer function modifying means modifies the transfer function A ij in accordance with the formula: A.sub.ij (t)=γA.sub.ij (t-1)+ηs.sub.j p'.sub.i, where A ij (t) is the new transfer function, A ij (t-1) is the previous transfer function prior to this modification, γ is a decay constant in the range 0≦γ≦1, and η is an adjustable learning parameter.
Claim 26
Dependent Claim
35 words
A system as defined in claim 22, wherein said transfer function modifying means comprises means for feeding back the output p' i of each summing means to the junction elements associated with that summing means.
Claim 27
Dependent Claim
145 words
A system as defined in claim 22, further comprising an output bank R, including: (e) a plurality M of second input terminals, each such terminal (l) adapted to receive one of the M output signals (p i ); (f) a plurality K of summing means, each summing means (k) having M inputs and an output and being operative to provide a signal (r'k) at its output representing the sum of the signal representations applied to its inputs; and (g) a plurality M X K of junction elements, each junction element (kl) coupling one of said second input terminals (l) with one summing means (k) and providing a transfer of information from the respective second input terminal l to the respective summing means k in dependence upon the signal (p i ) appearing at the input terminal and upon the element transfer function B kl .
Claim 28
Dependent Claim
63 words
A system as defined in claim 26, further comprising means for modifying the transfer function B kl of at least one of the junction elements of the output bank R, when in a training mode, in dependence upon the incoming signal p i applied thereto and the output signal r k of the summing means k with which said junction element is associated.
Claim 29
Independent Claim
83 words
A system as defined in any one of claims 1, 10, 21 and 24, further comprising means for modifying the transfer function element A ij of at least one of said junction elements, when in the training mode, in dependence upon the incoming signal s j applied thereto and a unit vector of the prototype bank p i , where the j th component of p i , p j i , is ##EQU4## whereby δA ij =p j i s j .
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1985-04-19 | 1985-10-19 | 1986-04-20 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1989-04-19 | 1989-10-19 | 1990-04-20 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 1993-04-19 | 1993-10-19 | 1994-04-20 | $7700.00 | Window Closed / Lapsed |