Receptive field neural network with shift-invariant pattern recognition

Claim 1

A method for updating weights relating to previously learned information input into a neural network, the network having a database of learned information mapped onto an array, including the steps of: (1) mapping the input information onto the array; (2) isolating a predetermined subset of the array; (3) shifting the predetermined subset in at least one dimension; (4) comparing the predetermined subset in both unshifted and shifted positions with a corresponding subset of the learned information; and (5) based upon the comparison of step (4), determining an optimal shift for the input information; and (6) updating a weight relating to the learned information based upon the optimal shift.

Claim 2

A method for updating weights relating to previously learned information input into a neural network, the network having a database of learned information mapped onto an array, including the steps of: (1) mapping the input information onto the array; (2) isolating a predetermined subset of the array; (3) shifting the predetermined subset in at least one dimension; (4) comparing the predetermined subset in both unshifted and shifted positions with a corresponding subset of the learned information; and (5) based upon the comparison of step (4), determining an optimal shift for the input information; and (6) updating a weight relating to the learned information based upon the optimal shift.

Claim 6

A method for learning information input in a neural network, where the input information corresponds to a feature stored in the neural network, including the steps of: (1) mapping the information onto at least one receptive field in an unshifted position; (2) shifting the mapped information into a plurality of shifted positions; (3) determining which of the plurality of shifted positions matches the stored feature most closely; and (4) based upon closest matching shifted position, updating a weight relating to the stored feature.

Claim 7

A method for learning information input in a neural network, where the input information corresponds to a feature stored in the neural network, including the steps of: (1) mapping the information onto at least one receptive field in an unshifted position; (2) shifting the mapped information into a plurality of shifted positions; (3) determining which of the plurality of shifted positions matches the stored feature most closely; and (4) based upon closest matching shifted position, updating a weight relating to the stored feature.

Claim 8

An apparatus for updating weights relating to information which has been learned in a neural network, the network including a database of leaned information mapped onto an array, comprising: means for mapping the input information onto the array; means coupled to the mapping means for isolating a plurality of predetermined subarrays of the mapped input information; means in communication with the isolating means for shifting the isolated subarrays of information in at least one dimension; means for storing the shifted subarrays; means in communication with the storing means for determining a closest match between each of the respective shifted subarrays and learned information corresponding thereto; and means in communication with the determining means for updating weights for the learned information based upon the determined closest matches.

Claim 9

An apparatus for updating weights relating to information which has been learned in a neural network, the network including a database of leaned information mapped onto an array, comprising: means for mapping the input information onto the array; means coupled to the mapping means for isolating a plurality of predetermined subarrays of the mapped input information; means in communication with the isolating means for shifting the isolated subarrays of information in at least one dimension; means for storing the shifted subarrays; means in communication with the storing means for determining a closest match between each of the respective shifted subarrays and learned information corresponding thereto; and means in communication with the determining means for updating weights for the learned information based upon the determined closest matches.

Claim 13

An apparatus for learning input patterns in a neural network, wherein the patterns belong to classes of patterns, comprising: means for mapping at least one portion of each input pattern onto an input image area which is larger than the mapped portion; means in communication with the mapping means for shifting the portion of the pattern within the input image area to each one of a plurality of predetermined positions for comparison with prelearned portions of other patterns; and means in communication with the shifting means for generating weight vector outputs from the neural network based upon a best match between the shifted portion of the pattern at one of the predetermined positions and one of the prelearned portions of the other patterns.

Claim 14

An apparatus for learning input patterns in a neural network, wherein the patterns belong to classes of patterns, comprising: means for mapping at least one portion of each input pattern onto an input image area which is larger than the mapped portion; means in communication with the mapping means for shifting the portion of the pattern within the input image area to each one of a plurality of predetermined positions for comparison with prelearned portions of other patterns; and means in communication with the shifting means for generating weight vector outputs from the neural network based upon a best match between the shifted portion of the pattern at one of the predetermined positions and one of the prelearned portions of the other patterns.

Claim 17

A method for learning distinguishing characteristics of patterns input into a neural network, including the steps of: (1) mapping an input pattern onto an array, the array comprising a predetermined number of tiles; (2) generating values for weights relating to each of the tiles; (3) repeating steps 1 and 2 for each of a plurality of patterns; (4) generating contributive values from the weight values based upon a correlation of the weight values for each of the tiles with weight values of corresponding tiles of other patterns; (5) correlating the contributive values for determining which of the contributive values relate to regions of the array wherein patterns of the class differ most from one another; (6) generating a set of sums of contributive values from sets of tiles; (7) determining at least one subset of the set of sums which is higher than other sums; (8) mapping the determined subset onto the array for generating at least one receptive field for comparison among different ones of said patterns, the receptive field relating to a region representing features of the patterns which are distinct from one another; (9) defining an input image area which is larger than the generated receptive field; (10) shifting data of each input pattern within the input image area for determining a best correspondence of the shifted data and a previously learned weight relating to the receptive field; and (11) updating the weights based upon the shifted data.

Claim 18

A method for learning distinguishing characteristics of patterns input into a neural network, including the steps of: (1) mapping an input pattern onto an array, the array comprising a predetermined number of tiles; (2) generating values for weights relating to each of the tiles; (3) repeating steps 1 and 2 for each of a plurality of patterns; (4) generating contributive values from the weight values based upon a correlation of the weight values for each of the tiles with weight values of corresponding tiles of other patterns; (5) correlating the contributive values for determining which of the contributive values relate to regions of the array wherein patterns of the class differ most from one another; (6) generating a set of sums of contributive values from sets of tiles; (7) determining at least one subset of the set of sums which is higher than other sums; (8) mapping the determined subset onto the array for generating at least one receptive field for comparison among different ones of said patterns, the receptive field relating to a region representing features of the patterns which are distinct from one another; (9) defining an input image area which is larger than the generated receptive field; (10) shifting data of each input pattern within the input image area for determining a best correspondence of the shifted data and a previously learned weight relating to the receptive field; and (11) updating the weights based upon the shifted data.