US4979126A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Neural network with non-linear transformations
Assignee: CA Inc
•
Filing: 1988-03-30
•
Granted: 1990-12-18
•
Expires: 2008-03-30
Abstract
Abstract A neural network system includes means for accomplishing artificial intelligence functions in three formerly divergent implementations. These functions include: supervised learning, unsupervised learning, and associative memory storage and retrieval. The subject neural network is created by addition of a non-linear layer to a more standard neural network architecture. The non-linear layer functions to expand a functional input space to a signal set including orthonormal elements, when the input signal is visualized as a vector representation. An input signal is selectively passed to a non-linear transform circuit, which outputs a transform signal therefrom. Both the input signal and the transform signal are placed in communication with a first layer of a plurality of processing nodes. An improved hardware implementation of the subject system includes a highly parallel, hybrid analog/digital circuitry. Included therein is a digitally addressed, random access memory means for storage and retrieval of an analog signal.
Inventors
- 👤 Yoh-Han Pao
- 👤 Farrokh Khatibi
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-31 16:16
CPC Classifications
G; G06; G06N; G06N3/00; G06N3/02; G06N3/04; G06N3/0495; G06N3/0499; G06N3/08; G06N3/082; G06N3/09
Claims Analysis
Total Claims: 18
Claim 1
Independent Claim
189 words
A neural network system comprising: a plurality of processing nodes arranged into at least first and second layers; input means adapted for receiving an input signal comprising data representative of an input pattern; first communication means for communicating at least a portion of the input signal to at least a first portion of the processing nodes of the first layer; transformation means for performing a non-linear transform on a signal input thereto to form a transformed signal as an output thereof; second communication means for communicating at least a portion of the input pattern to the transformation means; third communication means for communicating the transformed signal resultant from operation of the transform means to at least a second portion of the processing nodes of the first layer uniquely defined from the processing nodes of the first portion; fourth communication means for communicating the output of processing nodes of the first portion and of the second portion of the first layer to at least a first portion of the processing nodes of the second layer; and means for outputting the output signal from the processing nodes of the second layer.
Claim 2
Dependent Claim
189 words
A neural network system comprising: a plurality of processing nodes arranged into at least first and second layers; input means adapted for receiving an input signal comprising data representative of an input pattern; first communication means for communicating at least a portion of the input signal to at least a first portion of the processing nodes of the first layer; transformation means for performing a non-linear transform on a signal input thereto to form a transformed signal as an output thereof; second communication means for communicating at least a portion of the input pattern to the transformation means; third communication means for communicating the transformed signal resultant from operation of the transform means to at least a second portion of the processing nodes of the first layer uniquely defined from the processing nodes of the first portion; fourth communication means for communicating the output of processing nodes of the first portion and of the second portion of the first layer to at least a first portion of the processing nodes of the second layer; and means for outputting the output signal from the processing nodes of the second layer.
Claim 3
Dependent Claim
25 words
The neural network of claim 1 wherein the second communication means includes means for communicating all portions of the input signal to the transformation means.
Claim 4
Dependent Claim
31 words
The neural network of claim 2 wherein the input pattern data is representative of vector data, and wherein the transformation means includes means for performing vector operations on the input data.
Claim 5
Dependent Claim
27 words
The neural network of claim 3 wherein the means for performing vector operations includes means for calculating an outer product of data representative of an input pattern.
Claim 6
Dependent Claim
18 words
The neural network of claim 1 further comprising pruning means for selectively pruning outputs of the transform means.
Claim 7
Dependent Claim
47 words
The neural network of claim 5 further comprising: means for receiving data representative of a training set pattern; evaluating means for evaluating joint activations of nodes over a training set pattern; and means for controlling the pruning means in accordance with an output of the evaluating means.
Claim 8
Dependent Claim
48 words
The neural network of claim 1 wherein each processing node includes: means for receiving an analog signal; means for storing a digital value representative of a signal weighing value; and means for performing an analog processing of a signal communicated thereto in accordance with the signal weighing value.
Claim 9
Independent Claim
167 words
A method of neural processing comprising the steps of: receiving an input signal comprising data, representative of an input pattern, into a plurality of processing nodes arranged into at least first and second layers; communicating at least a portion of the input signal to at least a first portion of the processing nodes of the first layer; communicating at least a second portion of the input signal to a transformation means; performing, in the transform means, a non-linear transform on at least the second portion of the input signal to form a transform signal; communicating the transform signal to at least a second portion of the processing nodes of the first layer uniquely defined from the processing nodes of the first portion; communicating the output of processing nodes of the first portion and the second portion of the first layer to at least a first portion of the processing nodes of the second layer; and outputting an output signal from the processing nodes of the second layer.
Claim 10
Independent Claim
167 words
A method of neural processing comprising the steps of: receiving an input signal comprising data, representative of an input pattern, into a plurality of processing nodes arranged into at least first and second layers; communicating at least a portion of the input signal to at least a first portion of the processing nodes of the first layer; communicating at least a second portion of the input signal to a transformation means; performing, in the transform means, a non-linear transform on at least the second portion of the input signal to form a transform signal; communicating the transform signal to at least a second portion of the processing nodes of the first layer uniquely defined from the processing nodes of the first portion; communicating the output of processing nodes of the first portion and the second portion of the first layer to at least a first portion of the processing nodes of the second layer; and outputting an output signal from the processing nodes of the second layer.
Claim 11
Dependent Claim
21 words
The method of claim 8 further comprising the step of communicating all portions of the input signal to the transformation means.
Claim 12
Dependent Claim
28 words
The method of claim 9 wherein the input pattern data is representative of vector data, and further comprising the step of performing vector operations on the input data.
Claim 13
Dependent Claim
32 words
The method of claim 10 further comprising the step of calculating an outer product of data representative of an input pattern during the step of performing vector operations on the input data.
Claim 14
Dependent Claim
17 words
The method of claim 11 further comprising the step of pruning selected outputs of the transform means.
Claim 15
Dependent Claim
38 words
The method of claim 12 further comprising the steps of: receiving data representative of a training set pattern; evaluating joint activations of nodes over a training set pattern and; performing the pruning step in accordance with the evaluating.
Claim 16
Dependent Claim
183 words
A neural network system comprising: a plurality of processing nodes arranged into first and second layers; input means adapted for receiving an input signal comprising data representative of an input pattern; first communication means for communicating at least a portion of the input signal to a first subset of the processing nodes of the first layer; transformation means for performing a non-linear transform on a signal input thereto to form a transformed signal as an output thereof; second communication means for communicating at least a portion of the input pattern to the transformation means; third communication means for communicating the transformed signal resultant from operation of the transform means to at least a second subset of the processing nodes of the first layer, the second subset being uniquely defined from processing nodes of the first subset; fourth communication means for selectively communicating the output of processing nodes of the first subset and of the second subset of the first layer to selected processing nodes of the second layer; and means for outputting the output signal from the processing nodes of the second layer.
Claim 17
Dependent Claim
183 words
A neural network system comprising: a plurality of processing nodes arranged into first and second layers; input means adapted for receiving an input signal comprising data representative of an input pattern; first communication means for communicating at least a portion of the input signal to a first subset of the processing nodes of the first layer; transformation means for performing a non-linear transform on a signal input thereto to form a transformed signal as an output thereof; second communication means for communicating at least a portion of the input pattern to the transformation means; third communication means for communicating the transformed signal resultant from operation of the transform means to at least a second subset of the processing nodes of the first layer, the second subset being uniquely defined from processing nodes of the first subset; fourth communication means for selectively communicating the output of processing nodes of the first subset and of the second subset of the first layer to selected processing nodes of the second layer; and means for outputting the output signal from the processing nodes of the second layer.
Claim 18
Dependent Claim
48 words
The neural network of claim 14 wherein each processing node includes: means for receiving an analog signal; means for storing a digital value representative of a signal weighing value; and means for performing an analog processing of a signal communicated thereto in accordance with the signal weighing value.
References Cited (Backward Citations)
No citation records indexed.
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1993-12-17 | 1994-06-18 | 1994-12-18 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1997-12-17 | 1998-06-18 | 1998-12-18 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2001-12-17 | 2002-06-18 | 2002-12-18 | $7700.00 | Window Closed / Lapsed |