US5155801A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Clustered neural networks
Assignee: Raytheon Co
•
Filing: 1990-10-09
•
Granted: 1992-10-13
•
Expires: 2010-10-09
Abstract
Abstract A plurality of neural networks are coupled to an output neural network, or judge network, to form a clustered neural network. Each of the plurality of clustered networks comprises a supervised learning rule back-propagated neural network. Each of the clustered neural networks are trained to perform substantially the same mapping function before they are clustered. Following training, the clustered neural network computes its output by taking an "average" of the outputs of the individual neural networks that make up the cluster. The judge network combines the outputs of the plurality of individual neural networks to provide the output from the entire clustered network. In addition, the output of the judge network may be fed back to each of the individual neural networks and used as a training input thereto, in order to provide for continuous training. The use of the clustered network increases the speed of learning and results in better generalization. In addition, clustering multiple back-propagation networks provides for increased performance and fault tolerance when compared to a single unclustered network having substantially the same computational complexity. The present invention may be used in applications that are amenable to neural network solutions, including control and image processing applications. Clustering of the networks also permits the use of smaller networks and provides for improved performance. The clustering of multiple back-propagation networks provides for synergy that improves the properties of the clustered network over a comparably complex non-clustered network.
Inventors
- 👤 William P. Lincoln
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-25 12:00
CPC Classifications
G; G06; G06V; G06V10/00; G06V10/20; G06V10/255; G06F; G06F18/00; G06F18/20; G06F18/24; G06F18/243; G06F18/24317; G06F18/25; G06F18/254; G06N; G06N3/00; G06N3/02; G06N3/04; G06N3/045; G06N3/0499; G06N3/08; G06N3/0895; G06N3/09
Claims Analysis
Total Claims: 10
Claim 1
Independent Claim
159 words
A clustered neural network architecture comprising: (A) a plurality of individual neural networks, each neural network having an input and an output, wherein each of the inputs are connected in common, and each neural network comprising: (a) means for receiving initial weights that are different from initial weights of others of the plurality of neural networks; (b) means for training the neural network to implement a mapping function using the received initial weights, the mapping function being the same for all of the plurality of neural networks; and (c) means for performing the mapping function in a different way than the other networks of the plurality of neural networks; and (B) an output neural network having a plurality of inputs and a single output that provides an output of the clustered neural network, and wherein the respective outputs of the plurality of individual neural networks are individually coupled to the respective plurality of inputs of the output neural network.
Claim 2
Dependent Claim
159 words
A clustered neural network architecture comprising: (A) a plurality of individual neural networks, each neural network having an input and an output, wherein each of the inputs are connected in common, and each neural network comprising: (a) means for receiving initial weights that are different from initial weights of others of the plurality of neural networks; (b) means for training the neural network to implement a mapping function using the received initial weights, the mapping function being the same for all of the plurality of neural networks; and (c) means for performing the mapping function in a different way than the other networks of the plurality of neural networks; and (B) an output neural network having a plurality of inputs and a single output that provides an output of the clustered neural network, and wherein the respective outputs of the plurality of individual neural networks are individually coupled to the respective plurality of inputs of the output neural network.
Claim 3
Dependent Claim
24 words
The neural network architecture of claim 1 wherein each of the respective plurality of individual neural networks comprises a supervised, rule-based, back-propagation neural network.
Claim 4
Dependent Claim
26 words
The neural network architecture of claim 2 wherein the output of the output neural network is coupled to each of the respective plurality of neural networks.
Claim 5
Dependent Claim
26 words
The neural network architecture of claim 1 wherein the output of the output neural network is coupled to each of the respective plurality of neural networks.
Claim 6
Dependent Claim
312 words
A target detection system for use with a missile that incorporates an imaging system and a guidance system that are adapted to detect a target located in an image scene and guide the missile towards the target, said target detection system comprising: a segmentor adapted to receive image data from the imaging system for identifying regions of the image scene that contain possible targets, and for providing output signals indicative of possible target images; and a classifier adapted to process the output signals indicative of the possible targets provided by the segmentor to determine the presence of a target in the image scene and provide target location signals to the guidance system to direct the missile towards the target, said classifier comprising: (A) a plurality of individual neural networks, each neural network having an input and an output, wherein each of the inputs are connected in common and are coupled to receive the output signals from the segmentor, and each neural network comprising: (a) means for receiving initial weights that are different from initial weights of others of the plurality of neural networks; (b) means for training the neural network to implement a mapping function using the received initial weights, the mapping function being the same for all the plurality of neural networks; and (c) means for performing the mapping function in a different way that the other networks of the plurality of neural networks; and (B) an output neural network having a plurality of inputs and a single output that provides an output of the classifier, and wherein the respective outputs of the plurality of individual neural networks are individually coupled to the respective plurality of inputs of the output neural network; the classifier providing target location signals to the guidance system of the missile that are indicative of the location of the target to direct the missile towards the target.
Claim 7
Dependent Claim
312 words
A target detection system for use with a missile that incorporates an imaging system and a guidance system that are adapted to detect a target located in an image scene and guide the missile towards the target, said target detection system comprising: a segmentor adapted to receive image data from the imaging system for identifying regions of the image scene that contain possible targets, and for providing output signals indicative of possible target images; and a classifier adapted to process the output signals indicative of the possible targets provided by the segmentor to determine the presence of a target in the image scene and provide target location signals to the guidance system to direct the missile towards the target, said classifier comprising: (A) a plurality of individual neural networks, each neural network having an input and an output, wherein each of the inputs are connected in common and are coupled to receive the output signals from the segmentor, and each neural network comprising: (a) means for receiving initial weights that are different from initial weights of others of the plurality of neural networks; (b) means for training the neural network to implement a mapping function using the received initial weights, the mapping function being the same for all the plurality of neural networks; and (c) means for performing the mapping function in a different way that the other networks of the plurality of neural networks; and (B) an output neural network having a plurality of inputs and a single output that provides an output of the classifier, and wherein the respective outputs of the plurality of individual neural networks are individually coupled to the respective plurality of inputs of the output neural network; the classifier providing target location signals to the guidance system of the missile that are indicative of the location of the target to direct the missile towards the target.
Claim 8
Dependent Claim
24 words
The target detection system of claim 5 wherein each of the respective plurality of individual neural networks comprises a supervised, rule-based, back-propagation neural network.
Claim 9
Dependent Claim
26 words
The target detection system of claim 6 wherein the output of the output neural network is coupled to each of the respective plurality of neural networks.
Claim 10
Dependent Claim
26 words
The target detection system of claim 5 wherein the output of the output neural network is coupled to each of the respective plurality of neural networks.
References Cited (Backward Citations)
US4254474A
Cited
US4884194A
Cited
US4760604A
Cited
JPH01232464A
Cited
JPH01260379A
Cited
US4907232A
Cited
US4972473A
Cited
US4964126A
Cited
US4941122A
Cited
US4995040A
Cited
US5060278A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1995-10-13 | 1996-04-13 | 1996-10-13 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1999-10-13 | 2000-04-13 | 2000-10-13 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2003-10-13 | 2004-04-13 | 2004-10-13 | $7700.00 | Window Closed / Lapsed |