Neural network pattern recognition learning method

Claim 1

A method of classifying a pattern in a neural network, the method comprising the steps of: inputting an input signal into an input layer of said network, said input layer having input cells in a plurality at least as great as a number of dimensions of an input vector represented by said input signal; transmitting said input signal to each cell in an intermediate layer, each said cell in said intermediate layer storing at least a partial dimensional space of said input vector; activating in varying degrees those of said intermediate cells having a predetermined partial dimensional space corresponding in said varying degrees to said input vector, thereby projecting said input signal to said predetermined partial dimensional spaces and setting an activation value for each said intermediate cell; and transmitting to each output cell in an output layer of said network each activation value weighted by a predetermined attribute vector defining coupling between each said intermediate cell and each said output cell, wherein a said input vector, I, is projected onto a said predetermined partial dimensioned space by an operator G 1 , such that an image projection I'=G 1 .I and said activation value R 1 for a first intermediate cell is: ##EQU4## and wherein W 1 is a coupling vector, and ξ l is a threshold.

Claim 2

A method of classifying a pattern in a neural network, the method comprising the steps of: inputting an input signal into an input layer of said network, said input layer having input cells in a plurality at least as great as a number of dimensions of an input vector represented by said input signal; transmitting said input signal to each cell in an intermediate layer, each said cell in said intermediate layer storing at least a partial dimensional space of said input vector; activating in varying degrees those of said intermediate cells having a predetermined partial dimensional space corresponding in said varying degrees to said input vector, thereby projecting said input signal to said predetermined partial dimensional spaces and setting an activation value for each said intermediate cell; and transmitting to each output cell in an output layer of said network each activation value weighted by a predetermined attribute vector defining coupling between each said intermediate cell and each said output cell, wherein a said input vector, I, is projected onto a said predetermined partial dimensioned space by an operator G 1 , such that an image projection I'=G 1 .I and said activation value R 1 for a first intermediate cell is: ##EQU4## and wherein W 1 is a coupling vector, and ξ l is a threshold.

Claim 3

A method of learning patterns in a neural network, the method comprising the steps of: routing an input vector signal to input cells in an input layer and routing said input signal to each intermediate cell in an intermediate layer; at each said intermediate cell applying a stored image projection operator for said intermediate cell to said input signal, thereby projecting said input signal to a partial dimensional space corresponding to said intermediate cell to arrive at an image projection of said input signal on each said intermediate cell; from each said image projection, determining an activation value for each intermediate cell for said input signal; activating each output cell in an output layer as an average of products of said activation value and an attribute vector defining coupling between each said intermediate cell and each said output cell to arrive at an output vector signal; comparing said output vector signal to a teacher vector signal to obtain an error signal having components; and if a component of said error signal is not within an error tolerance, E, then i) producing a new intermediate layer cell if no intermediate layer cell is activated by said input signal; and ii) if a said intermediate layer cell forming said error is activated, reducing a threshold so as not to activate said intermediate layer cell forming said error with said input signal.

Claim 4

A method of learning patterns in a neural network, the method comprising the steps of: routing an input vector signal to input cells in an input layer and routing said input signal to each intermediate cell in an intermediate layer; at each said intermediate cell applying a stored image projection operator for said intermediate cell to said input signal, thereby projecting said input signal to a partial dimensional space corresponding to said intermediate cell to arrive at an image projection of said input signal on each said intermediate cell; from each said image projection, determining an activation value for each intermediate cell for said input signal; activating each output cell in an output layer as an average of products of said activation value and an attribute vector defining coupling between each said intermediate cell and each said output cell to arrive at an output vector signal; comparing said output vector signal to a teacher vector signal to obtain an error signal having components; and if a component of said error signal is not within an error tolerance, E, then i) producing a new intermediate layer cell if no intermediate layer cell is activated by said input signal; and ii) if a said intermediate layer cell forming said error is activated, reducing a threshold so as not to activate said intermediate layer cell forming said error with said input signal.