US4914708A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System for self-organization of stable category recognition codes for analog input patterns
Assignee: Boston University
•
Filing: 1987-06-19
•
Granted: 1990-04-03
•
Expires: 2007-06-19
Abstract
Abstract A neural network includes a feature representation field which receives input patterns. Signals from the feature representation field select a category from a category representation field through a first adaptive filter. Based on the selected category, a template pattern is applied to the feature representation field, and a match between the template and the input is determined. If the angle between the template vector and a vector within the representation field is too great, the selected category is reset. Otherwise the category selection and template pattern are adapted to the input pattern as well as the previously stored template. A complex representation field includes signals normalized relative to signals across the field and feedback for pattern contrast enhancement.
Inventors
- 👤 Gail A. Carpenter
- 👤 Stephen Grossberg
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-26 08:22
CPC Classifications
G; G06; G06N; G06N3/00; G06N3/02; G06N3/04; G06N3/0409; G06V; G06V10/00; G06V10/40; G06V10/44; G06V10/443; G06V10/449; G06V10/451; G06V10/454
Claims Analysis
Total Claims: 82
Claim 1
Independent Claim
113 words
In a pattern recognition device comprising a short term feature representation field for receiving input signals defining an input pattern and template signals defining a long term memory template, means for selecting at least one category node based on a pattern from the short term field, means for generating the long term template based on the selected category and means for adapting category selection and the long term memory template to the input signals, a category selection being reset with an insufficient match between the input pattern and template, the improvement wherein the match is based on the closeness between a vector of the template and a vector of the short term field.
Claim 2
Dependent Claim
113 words
In a pattern recognition device comprising a short term feature representation field for receiving input signals defining an input pattern and template signals defining a long term memory template, means for selecting at least one category node based on a pattern from the short term field, means for generating the long term template based on the selected category and means for adapting category selection and the long term memory template to the input signals, a category selection being reset with an insufficient match between the input pattern and template, the improvement wherein the match is based on the closeness between a vector of the template and a vector of the short term field.
Claim 3
Dependent Claim
42 words
A device as claimed in claim 1 wherein the closeness of the two vectors is disregarded where the template is not based on previous input patterns such that the category selection is not reset where a category has not been previously selected.
Claim 4
Dependent Claim
35 words
A device as claimed in claim 2 wherein the match is based on a norm of weighted sums, each sum being of a short term signal of the short term field and a template signal.
Claim 5
Dependent Claim
25 words
A device as claimed in claim 3 wherein the summed short term signal is normalized relative to other like signals of the short term field.
Claim 6
Dependent Claim
23 words
A device as claimed in claim 4 further comprising means for enhancing higher level signals of the input relative to lower level signals.
Claim 7
Dependent Claim
18 words
A device as claimed in claim 5 further comprising feedback of enhanced signals within the short term field.
Claim 8
Dependent Claim
27 words
A device as claimed in claim 6 further comprising feedback of the weighted sum of the short term signal and template signal within the short term field.
Claim 9
Dependent Claim
62 words
A device as claimed in claim 7 wherein the short term field comprises matched signals of a matched pattern, each matched signal being the weighted sum of a short term signal in the field and a template signal, the category selection and long term memory template being adapted as dual functions of the difference between the template signal and the matched signal.
Claim 10
Dependent Claim
63 words
A device as claimed in claim 2 wherein the short term field comprises matched signals of a matched pattern, each matched signal being the weighted sum of a short term signal in the field and a template signal, the category selection and the long term memory template being adapted as dual functions of the difference between the template signal and the matched signal.
Claim 11
Dependent Claim
29 words
A device as claimed in claim 9 wherein the short term signal summed with the template signal is normalized relative to other like signals of the short term field.
Claim 12
Dependent Claim
23 words
A device as claimed in claim 2 further comprising means for enhancing higher level signals of the input relative to lower level signals.
Claim 13
Dependent Claim
18 words
A device as claimed in claim 11 further comprising feedback of enhanced signals within the short term field.
Claim 14
Dependent Claim
18 words
A device as claimed in claim 12 further comprising feedback of template signals within the short term field.
Claim 15
Dependent Claim
18 words
A device as claimed in claim 2 wherein the input pattern to the system is an analog pattern.
Claim 16
Dependent Claim
20 words
A device as claimed in claim 2 wherein closeness between the vectors is determined from the angle between the vectors.
Claim 17
Dependent Claim
101 words
In a pattern recognition device comprising a short term feature representation field for receiving input signals defining an input pattern and template signals defining a long term memory template, means for selecting at least one category node based on a pattern from the short term field, means for generating the long term template based on the selected category and means for adapting category selection and the long term memory template to the input signals, the improvement wherein the short term field comprises a plurality of subfields of short term signals and feedback of short term signals within the short term field.
Claim 18
Dependent Claim
101 words
In a pattern recognition device comprising a short term feature representation field for receiving input signals defining an input pattern and template signals defining a long term memory template, means for selecting at least one category node based on a pattern from the short term field, means for generating the long term template based on the selected category and means for adapting category selection and the long term memory template to the input signals, the improvement wherein the short term field comprises a plurality of subfields of short term signals and feedback of short term signals within the short term field.
Claim 19
Dependent Claim
23 words
A device as claimed in claim 16 further comprising means for enhancing higher level signals of the input relative to lower level signals.
Claim 20
Dependent Claim
18 words
A device as claimed in claim 17 further comprising feedback of enhanced signals within the short term field.
Claim 21
Dependent Claim
18 words
A device as claimed in claim 18 further comprising feedback of template signals within the short term field.
Claim 22
Dependent Claim
23 words
A device as claimed in claim 16 wherein a feedback signal is normalized relative to other like signals of the short term field.
Claim 23
Dependent Claim
132 words
A pattern recognition device comprising a short term feature representation field for receiving input signals defining an input pattern and template signals defining a long term memory template, means for selecting at least one category node based on a pattern from the short term field, means for generating the long term memory template based on the selected category and means for adapting category selection and a long term memory template to the input signals, the improvement wherein the short term field comprises matched signals of a matched pattern, each matched signal being the weighted sum of a short term signal in the field and a template signal, the category selection and the long term memory template being adapted as dual functions of the difference between a template signal and the matched signal.
Claim 24
Dependent Claim
132 words
A pattern recognition device comprising a short term feature representation field for receiving input signals defining an input pattern and template signals defining a long term memory template, means for selecting at least one category node based on a pattern from the short term field, means for generating the long term memory template based on the selected category and means for adapting category selection and a long term memory template to the input signals, the improvement wherein the short term field comprises matched signals of a matched pattern, each matched signal being the weighted sum of a short term signal in the field and a template signal, the category selection and the long term memory template being adapted as dual functions of the difference between a template signal and the matched signal.
Claim 25
Dependent Claim
25 words
A device as claimed in claim 21 wherein the summed short term signal is normalized relative to other like signals of the short term field.
Claim 26
Dependent Claim
53 words
A device as claimed in claim 21 wherein a category selection is reset with an insufficient match between the input pattern and template, the match being based on the closeness between the vector of the template and a vector of the short term field as indicated by an angle between the two vectors.
Claim 27
Dependent Claim
25 words
A device as claimed in claim 23 wherein the summed short term signal is normalized relative to other like signals of the short term field.
Claim 28
Dependent Claim
23 words
A device as claimed in claim 24 further comprising means for enhancing higher level signals of the input relative to lower level signals.
Claim 29
Dependent Claim
20 words
A device as claimed in claim 23 wherein closeness between the vectors is determined from the angle between the vectors.
Claim 30
Dependent Claim
125 words
In a pattern recognition device comprising a short term feature representation field for receiving input signals defining an input pattern and template signals defining a long term memory template, means for selecting at least one category based on a pattern from the short term field, means for generating the long term memory template based on the selected category, and means for adapting category selection and the long term memory template to the input signals, the improvement wherein the short term field comprises a plurality of subfields of short term signals, each of the short term signals of at least one subfield being based on an input signal specific to the short term signal and also on non-specific signals generated from across the short term field.
Claim 31
Dependent Claim
125 words
In a pattern recognition device comprising a short term feature representation field for receiving input signals defining an input pattern and template signals defining a long term memory template, means for selecting at least one category based on a pattern from the short term field, means for generating the long term memory template based on the selected category, and means for adapting category selection and the long term memory template to the input signals, the improvement wherein the short term field comprises a plurality of subfields of short term signals, each of the short term signals of at least one subfield being based on an input signal specific to the short term signal and also on non-specific signals generated from across the short term field.
Claim 32
Dependent Claim
24 words
A device as claimed in claim 27 wherein each short term signal of a subfield is normalized relative to other signals of the subfield.
Claim 33
Dependent Claim
25 words
A device as claimed in claim 28 wherein higher level signals of the normalized subfield are enhanced relative to lower level signals of the subfield.
Claim 34
Dependent Claim
24 words
A device as claimed in claim 29 further comprising feedback of an enhanced normalized input pattern to modify the input pattern to the system.
Claim 35
Dependent Claim
46 words
A device as claimed in claim 28 wherein a category selection is reset with an insufficient match between the input pattern and template, the match being based on a norm of weighted sums, each sum being of a normalized short term signal and a template signal.
Claim 36
Dependent Claim
21 words
A device as claimed in claim 31 further comprising feedback of the weighted sum to modify the normalized short term signal.
Claim 37
Dependent Claim
46 words
A device as claimed in claim 27 wherein a category selection is reset with an insufficient match between the input pattern and template, the match being based on a norm of weighted sums, each sum being of a normalized short term signal and a template signal.
Claim 38
Dependent Claim
24 words
A device as claimed in claim 33 wherein each short term signal of a subfield is normalized relative to other signals of the subfield.
Claim 39
Dependent Claim
90 words
A device as claimed in claim 27 having the ability to self-organize stable recognition categories at variable levels of vigilance in response to arbitrary temporal lists of analog or digital image patterns to learn invariant pattern recognition codes in response to noisy image data, the device having a preprocessor for generating the input pattern, the preprocessor comprising means for automatic separation of image figure of the image pattern from ground, means for sharpening and completing the resultant image boundaries, and means for processing the resultant image using an invariant filter.
Claim 40
Dependent Claim
19 words
A device as claimed in claim 35 wherein the means for sharpening and completing performs a boundary contour technique.
Claim 41
Dependent Claim
15 words
A device as claimed in claim 35 wherein the invariant filter is a Fourier-Mellon filter.
Claim 42
Dependent Claim
103 words
A pattern recognition method comprising: receiving in a short term feature representation field input signals defining an input pattern and template signals defining a long term memory template; selecting at least one category node based on a pattern from the short term field, category selection being reset with an insufficient match between the input pattern and template based on the closeness between a vector of the template and a vector of the short term field; generating the long term template based on the selected category which is not reset; and adapting category selection and the long term memory template to the input signals.
Claim 43
Dependent Claim
103 words
A pattern recognition method comprising: receiving in a short term feature representation field input signals defining an input pattern and template signals defining a long term memory template; selecting at least one category node based on a pattern from the short term field, category selection being reset with an insufficient match between the input pattern and template based on the closeness between a vector of the template and a vector of the short term field; generating the long term template based on the selected category which is not reset; and adapting category selection and the long term memory template to the input signals.
Claim 44
Dependent Claim
42 words
A method as claimed in claim 38 wherein the closeness of the two vectors is disregarded where the template is not based on previous input patterns such that the category selection is not reset where a category has not been previously selected.
Claim 45
Dependent Claim
35 words
A method as claimed in claim 39 wherein the match is based on a norm of weighted sums, each sum being of a short term signal of the short term field and a template signal.
Claim 46
Dependent Claim
25 words
A method as claimed in claim 40 wherein the summed short term signal is normalized relative to other like signals of the short term field.
Claim 47
Dependent Claim
21 words
A method as claimed in claim 41 further comprising enhancing higher level signals of the input relative to lower level signals.
Claim 48
Dependent Claim
18 words
A method as claimed in claim 42 further comprising feeding enhanced signals back within the short term field.
Claim 49
Dependent Claim
27 words
A method as claimed in claim 43 further comprising feeding the weighted sum of the short term signal and template signal back within the short term field.
Claim 50
Dependent Claim
62 words
A method as claimed in claim 44 wherein the short term field comprises matched signals of a matched pattern, each matched signal being the weighted sum of a short term signal in the field and a template signal, the category selection and long term memory template being adapted as dual functions of the difference between the template signal and the matched signal.
Claim 51
Dependent Claim
63 words
A method as claimed in claim 39 wherein the short term field comprises matched signals of a matched pattern, each matched signal being the weighted sum of a short term signal in the field and a template signal, the category selection and the long term memory template being adapted as dual functions of the difference between the template signal and the matched signal.
Claim 52
Dependent Claim
29 words
A method as claimed in claim 46 wherein the short term signal summed with the template signal is normalized relative to other like signals of the short term field.
Claim 53
Dependent Claim
21 words
A method as claimed in claim 39 further comprising enhancing higher level signals of the input relative to lower level signals.
Claim 54
Dependent Claim
18 words
A method as claimed in claim 48 further comprising feeding enhanced signals back within the short term field.
Claim 55
Dependent Claim
18 words
A method as claimed in claim 49 further comprising feeding template signals back within the short term field.
Claim 56
Dependent Claim
18 words
A method as claimed in claim 39 wherein the input pattern to the system is an analog pattern.
Claim 57
Dependent Claim
20 words
A method as claimed in claim 39 wherein closeness between the vectors is determined from the angle between the vectors.
Claim 58
Dependent Claim
98 words
A pattern recognition method comprising: receiving in a short term feature representation field comprising a plurality of subfields of short term signals input signals defining an input pattern and template signals defining a long term memory template and feeding short term signals back within the short term fields; selecting at least one category node based on a pattern from the short term field; generating the long term template based on the selected category; and adapting category selection and the long term memory template to the input signals and feedback of short term signals within the short term field.
Claim 59
Dependent Claim
98 words
A pattern recognition method comprising: receiving in a short term feature representation field comprising a plurality of subfields of short term signals input signals defining an input pattern and template signals defining a long term memory template and feeding short term signals back within the short term fields; selecting at least one category node based on a pattern from the short term field; generating the long term template based on the selected category; and adapting category selection and the long term memory template to the input signals and feedback of short term signals within the short term field.
Claim 60
Dependent Claim
21 words
A method as claimed in claim 53 further comprising enhancing higher level signals of the input relative to lower level signals.
Claim 61
Dependent Claim
18 words
A method as claimed in claim 54 further comprising feeding enhanced signals back within the short term field.
Claim 62
Dependent Claim
18 words
A method as claimed in claim 55 further comprising feeding template signals back within the short term field.
Claim 63
Dependent Claim
23 words
A method as claimed in claim 56 wherein a feedback signal is normalized relative to other like signals of the short term field.
Claim 64
Dependent Claim
105 words
A pattern recognition method comprising: receiving in a short term feature representation field input signals defining a long term memory template, the short term field comprising matched signals of a matched pattern, each matched signal being the weighted sum of a short term signal in the filed and a template signal; selecting at least one category node based on a pattern from the short term field; generating the long term memory template based on the selected category; and adapting category selection and a long term memory template to the input signals as dual functions of the difference between a template signal and the matched signal.
Claim 65
Dependent Claim
105 words
A pattern recognition method comprising: receiving in a short term feature representation field input signals defining a long term memory template, the short term field comprising matched signals of a matched pattern, each matched signal being the weighted sum of a short term signal in the filed and a template signal; selecting at least one category node based on a pattern from the short term field; generating the long term memory template based on the selected category; and adapting category selection and a long term memory template to the input signals as dual functions of the difference between a template signal and the matched signal.
Claim 66
Dependent Claim
25 words
A method as claimed in claim 58 wherein the summed short term signal is normalized relative to other like signals of the short term field.
Claim 67
Dependent Claim
53 words
A method as claimed in claim 58 wherein a category selection is reset with an insufficient match between the input pattern and template, the match being based on the closeness between the vector of the template and a vector of the short term field as indicated by an angle between the two vectors.
Claim 68
Dependent Claim
25 words
A method as claimed in claim 60 wherein the summed short term signal is normalized relative to other like signals of the short term field.
Claim 69
Dependent Claim
23 words
A method as claimed in claim 61 further comprising means for enhancing higher level signals of the input relative to lower level signals.
Claim 70
Dependent Claim
20 words
A method as claimed in claim 60 wherein closeness between the vectors is determined from the angle between the vectors.
Claim 71
Dependent Claim
115 words
A pattern recognition method comprising: receiving in a short term feature representation field input signals defining an input pattern and template signals defining a long term memory template, the short term field comprising a plurality of subfields of short term signals, each of the short term signals of at least one subfield being based on an input signal specific to the short term signal and also on non-specific signals generated from across the short term field; selecting at least one category based on a pattern from the short term field; generating the long term memory template based on the selected category; and adapting category selection and the long term memory template to the input signals.
Claim 72
Dependent Claim
115 words
A pattern recognition method comprising: receiving in a short term feature representation field input signals defining an input pattern and template signals defining a long term memory template, the short term field comprising a plurality of subfields of short term signals, each of the short term signals of at least one subfield being based on an input signal specific to the short term signal and also on non-specific signals generated from across the short term field; selecting at least one category based on a pattern from the short term field; generating the long term memory template based on the selected category; and adapting category selection and the long term memory template to the input signals.
Claim 73
Dependent Claim
24 words
A method as claimed in claim 64 wherein each short term signal of a subfield is normalized relative to other signals of the subfield.
Claim 74
Dependent Claim
25 words
A method as claimed in claim 65 wherein higher level signals of the normalized subfield are enhanced relative to lower level signals of the subfield.
Claim 75
Dependent Claim
24 words
A method as claimed in claim 66 further comprising feeding an enhanced normalized input pattern back to modify the input pattern to the system.
Claim 76
Dependent Claim
46 words
A method as claimed in claim 65 wherein a category selection is reset with an insufficient match between the input pattern and template, the match being based on a norm of weighted sums, each sum being of a normalized short term signal and a template signal.
Claim 77
Dependent Claim
21 words
A method as claimed in claim 68 further comprising feeding the weighted sum back to modify the normalized short term signal.
Claim 78
Dependent Claim
46 words
A method as claimed in claim 64 wherein a category selection is reset with an insufficient match between the input pattern and template, the match being based on a norm of weighted sums, each sum being of a normalized short term signal and a template signal.
Claim 79
Dependent Claim
24 words
A method as claimed in claim 70 wherein each short term signal of a subfield is normalized relative to other signals of the subfield.
Claim 80
Dependent Claim
44 words
A method as claimed in claim 64 comprising preprocessing a pattern to generate the input pattern, the preprocessing comprising separating image figure of the image pattern from ground, sharpening and completing the resultant image boundaries, and processing the resultant image using an invariant filter.
Claim 81
Dependent Claim
18 words
A method as claimed in claim 72 wherein the sharpening and completing is by a boundary contour technique.
Claim 82
Dependent Claim
15 words
A method as claimed in claim 72 wherein the invariant filter is a Fourier-Mellon filter.
References Cited (Backward Citations)
US3950733A
Cited
US4044243A
Cited
US4227177A
Cited
US4254474A
Cited
US4319331A
Cited
US4326259A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1993-04-02 | 1993-10-02 | 1994-04-03 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1997-04-02 | 1997-10-02 | 1998-04-03 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2001-04-02 | 2001-10-02 | 2002-04-03 | $7700.00 | Window Closed / Lapsed |