US5067164A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Hierarchical constrained automatic learning neural network for character recognition
Assignee: NCR Voyix Corp
•
Filing: 1989-11-30
•
Granted: 1991-11-19
•
Expires: 2009-11-30
Abstract
Abstract Highly accurate, reliable optical character recognition is afforded by a layered network having several layers of constrained feature detection wherein each layer of constrained feature detection includes a plurality of constrained feature maps and a corresponding plurality of feature reduction maps. Each feature reduction map is connected to only one constrained feature map in the same layer for undersampling that constrained feature map. Units in each constrained feature map of the first constrained feature detection layer respond as a function of a corresponding kernel and of different portions of the pixel image of the character captured in a receptive field associated with the unit. Units in each feature map of the second constrained feature detection layer respond as a function of a corresponding kernel and of different portions of an individual feature reduction map or a combination of several feature reduction maps in the first constrained feature detection layer as captured in a receptive field of the unit. The feature reduction maps of the second constrained feature detection layer are fully connected to each unit in the final character classification layer. Kernels are automatically learned by constrained back propagation during network initialization or training.
Inventors
- 👤 John S. Denker
- 👤 Richard E. Howard
- 👤 Lawrence D. Jackel
- 👤 Yann LeCun
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-29 17:06
CPC Classifications
G; G06; G06N; G06N3/00; G06N3/02; G06N3/04; G06N3/0464; G06N3/08; G06N3/09; G06V; G06V30/00; G06V30/10; G06V30/18; G06V30/1801; G06V30/18019; G06V30/18038; G06V30/18048; G06V30/18057
Claims Analysis
Total Claims: 7
Claim 1
Independent Claim
307 words
A massively parallel computation network for character recognition of an image map having a plurality of image units, said network comprising first and second feature detection layer means wherein each of said feature detection layer means includes a plurality of constrained feature maps and a corresponding plurality of feature reduction maps, each constrained feature map and each feature reduction map comprising a plurality of units and a corresponding plurality of computation elements for generating values for said units in said map, each of said feature reduction maps having fewer units than each of said constrained feature maps, said computation element having a weighting kernel associated therewith and being responsive to a plurality of substantially neighboring units from at least a predetermined other map for mapping a dot product of said associated weighting kernel with said predetermined plurality of substantially neighboring units into an output value in accordance with a selected nonlinear criterion, said computation element responsive to a different plurality of substantially neighboring units than each other computation element associated with the same map, said second feature detection layer means having fewer units than said first feature detection layer means, said constrained feature maps of said first feature detection layer means responsive to image units, each feature reduction map of said first feature detection layer means responsive to units from its corresponding constrained feature map, said constrained feature maps of said second feature detection layer means responsive to units from at least one feature reduction map in said first feature detection layer means, each feature reduction map of said second feature detection layer means responsive to units from its corresponding constrained feature map, said network further including a character classification layer fully connected to all feature reduction maps of said second feature detection layer means for generating an indication representative of the character recognized by the network.
Claim 2
Dependent Claim
307 words
A massively parallel computation network for character recognition of an image map having a plurality of image units, said network comprising first and second feature detection layer means wherein each of said feature detection layer means includes a plurality of constrained feature maps and a corresponding plurality of feature reduction maps, each constrained feature map and each feature reduction map comprising a plurality of units and a corresponding plurality of computation elements for generating values for said units in said map, each of said feature reduction maps having fewer units than each of said constrained feature maps, said computation element having a weighting kernel associated therewith and being responsive to a plurality of substantially neighboring units from at least a predetermined other map for mapping a dot product of said associated weighting kernel with said predetermined plurality of substantially neighboring units into an output value in accordance with a selected nonlinear criterion, said computation element responsive to a different plurality of substantially neighboring units than each other computation element associated with the same map, said second feature detection layer means having fewer units than said first feature detection layer means, said constrained feature maps of said first feature detection layer means responsive to image units, each feature reduction map of said first feature detection layer means responsive to units from its corresponding constrained feature map, said constrained feature maps of said second feature detection layer means responsive to units from at least one feature reduction map in said first feature detection layer means, each feature reduction map of said second feature detection layer means responsive to units from its corresponding constrained feature map, said network further including a character classification layer fully connected to all feature reduction maps of said second feature detection layer means for generating an indication representative of the character recognized by the network.
Claim 3
Dependent Claim
16 words
The computation network defined in claim 1 wherein the selected nonlinear criterion includes a sigmoidal function.
Claim 4
Dependent Claim
22 words
The computation network defined in claim 2 wherein said image map includes a substantially constant predetermined background surrounding an original character image.
Claim 5
Dependent Claim
119 words
A massively parallel computation network for character recognition of a character included in an image map, said network including a first constrained feature detection layer means for extracting features from said image map, a first feature reduction layer means connected to said first constrained feature detection layer means for undersampling features from said first constrained feature detection layer means, a second constrained feature detection layer means for extracting features from said first feature reduction layer means, a second feature reduction layer means for undersampling features from said second constrained feature detection layer means, and character classification layer means fully connected to said second feature reduction layer means for generating an indication representative of the character recognized by the network.
Claim 6
Dependent Claim
119 words
A massively parallel computation network for character recognition of a character included in an image map, said network including a first constrained feature detection layer means for extracting features from said image map, a first feature reduction layer means connected to said first constrained feature detection layer means for undersampling features from said first constrained feature detection layer means, a second constrained feature detection layer means for extracting features from said first feature reduction layer means, a second feature reduction layer means for undersampling features from said second constrained feature detection layer means, and character classification layer means fully connected to said second feature reduction layer means for generating an indication representative of the character recognized by the network.
Claim 7
Dependent Claim
22 words
The computation network defined in claim 4 wherein said image map includes a substantially constant predetermined background surrounding an original character image.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1994-11-18 | 1995-05-20 | 1995-11-19 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1998-11-18 | 1999-05-20 | 1999-11-19 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2002-11-18 | 2003-05-20 | 2003-11-19 | $7700.00 | Window Closed / Lapsed |