US4752906A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Temporal sequences with neural networks
Assignee: Nokia Bell Labs
•
Filing: 1986-12-16
•
Granted: 1988-06-21
•
Expires: 2006-12-16
Abstract
Abstract A sequence generator employing a neural network having its output coupled to at least one plurality of delay elements. The delayed outputs are fed back to an input interconnection network, wherein they contribute to the next state transition through an appropriate combination of interconnections.
Inventors
- 👤 David Kleinfeld
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 10:59
CPC Classifications
G; G06; G06N; G06N3/00; G06N3/02; G06N3/04; G06N3/049
Claims Analysis
Total Claims: 15
Claim 1
Independent Claim
155 words
A sequence generator comprising: a neural network responsive to input signals applied to a plurality of inputs that are internally connected to a cross-connect network, where said neural network develops a plurality of output signals responsive to said input signals and to interconnection values within said cross-connect network; a delay/averaging network responsive to said plurality of output signals of said neural network, for developing a delayed plurality of output signals that are related to said plurality of output signals of said neural network; and an input interconnection network responsive to said plurality of delayed output signals of said delay network for developing said plurality of input signals of said neural network; WHERE the interconnections within said cross-connect network develop specified local minima in the energy function describing the response of said neural network to said input signals, and said input interconnection network determines the sequence of neural network output signals developed by the sequence generator.
Claim 2
Dependent Claim
155 words
A sequence generator comprising: a neural network responsive to input signals applied to a plurality of inputs that are internally connected to a cross-connect network, where said neural network develops a plurality of output signals responsive to said input signals and to interconnection values within said cross-connect network; a delay/averaging network responsive to said plurality of output signals of said neural network, for developing a delayed plurality of output signals that are related to said plurality of output signals of said neural network; and an input interconnection network responsive to said plurality of delayed output signals of said delay network for developing said plurality of input signals of said neural network; WHERE the interconnections within said cross-connect network develop specified local minima in the energy function describing the response of said neural network to said input signals, and said input interconnection network determines the sequence of neural network output signals developed by the sequence generator.
Claim 3
Dependent Claim
30 words
The generator of claim 1, wherein each input signal in said plurality of input signals is related to said delayed output signals through a summing interconnection of preselected summing strengths.
Claim 4
Dependent Claim
111 words
The arrangement of claim 1 wherein each i th input signal of said plurality of input signals, where i is a number, is related to ##EQU7## where ##EQU8## is the j th delayed output signal of said plurality of delayed output signals and j is a number, D(x) is a preselected delay function characterizing said delay/averaging network as a function of the integration variable x, V j (t-x) is the j th output voltage at time (t-x), each Q ij is a preselected constant, and the summation is over all values of j from 1 to N where N is the number of delayed output signals in said plurality output signals.
Claim 5
Dependent Claim
53 words
The arrangement of claim 3 for developing a sequence M 1 , M 2 , . . . M.sup.μ, M.sup.μ+1, . . . M m , of said plurality of output signals, with each M.sup.μ representing said plurality of output signals at a point in time, wherein ##EQU9## for i≠j and 0 otherwise.
Claim 6
Dependent Claim
67 words
The arrangement of claim 3 for developing a cyclic sequence M 1 , M 2 , . . . M.sup.μ, M.sup.μ+1, . . . M m , M 1 , . . . , of said plurality of output signals, with each M.sup.μ representing said plurality of output signals at a point in time, wherein ##EQU10## for i≠j and 0 otherwise, and M m+1 =M 1 .
Claim 7
Dependent Claim
28 words
The arrangement of claim 1 further comprising a gating network interposed in the signal loop created by said neural network, said delay network and said input interconnection network.
Claim 8
Dependent Claim
28 words
The arrangement of claim 6 wherein said gating means, under influence of an applied control signal, either transmits its input signal to its output or inhibits said transmitting.
Claim 9
Dependent Claim
29 words
The arrangement of claim 6 wherein said gating means, under influence of an applied control signal, transmits to its output either its input signal or a preselected different signal.
Claim 10
Dependent Claim
20 words
The arrangement of claim 1 further comprising a gating network interposed between said delay network and said input interconnection network.
Claim 11
Dependent Claim
139 words
A sequence generator comprising: a neural network, developing a plurality of output signals in response to a plurality of input signals and characterized by an internal cross-connect network with interconnections that develop specified local minima in the energy function describing the response of said neural network to said input signals; a delay network responsive to said plurality of output signals of said neural network, developing K delayed pluralities of output signals with each delayed plurality of said K delayed pluralities having a different delay from said plurality of output signals of said neural network; and an input interconnection network responsive to said K pluralities of delayed output signals of said delay network for supplying a plurality of input signals to said neural network and for providing the connectivity that defines the sequence of signals generated by the sequence generator.
Claim 12
Dependent Claim
139 words
A sequence generator comprising: a neural network, developing a plurality of output signals in response to a plurality of input signals and characterized by an internal cross-connect network with interconnections that develop specified local minima in the energy function describing the response of said neural network to said input signals; a delay network responsive to said plurality of output signals of said neural network, developing K delayed pluralities of output signals with each delayed plurality of said K delayed pluralities having a different delay from said plurality of output signals of said neural network; and an input interconnection network responsive to said K pluralities of delayed output signals of said delay network for supplying a plurality of input signals to said neural network and for providing the connectivity that defines the sequence of signals generated by the sequence generator.
Claim 13
Dependent Claim
28 words
The arrangement of claim 10 further comprising a gating network interposed in the signal loop created by said neural network, said delay network and said input interconnection network.
Claim 14
Dependent Claim
122 words
A sequence generator comprising: a neural network, developing a plurality of output signals in response to a plurality of input signals and characterized by an internal cross-connect network with interconnections that develop specified local minima in the energy function describing the response of said neural network to said input signals; at least one delay/averaging network responsive to said plurality of output signals of said neural network, each developing a set of delayed plurality of output signals; and at least one input interconnection network each responsive to a set of said plurality of delayed output signals for supplying a plurality of input signals to said neural network and for providing the connectivity that defines the sequence of signals generated by the sequence generator.
Claim 15
Dependent Claim
122 words
A sequence generator comprising: a neural network, developing a plurality of output signals in response to a plurality of input signals and characterized by an internal cross-connect network with interconnections that develop specified local minima in the energy function describing the response of said neural network to said input signals; at least one delay/averaging network responsive to said plurality of output signals of said neural network, each developing a set of delayed plurality of output signals; and at least one input interconnection network each responsive to a set of said plurality of delayed output signals for supplying a plurality of input signals to said neural network and for providing the connectivity that defines the sequence of signals generated by the sequence generator.
References Cited (Backward Citations)
US4034156A
Cited
US3774019A
Cited
US4393272A
Cited
US4344150A
Cited
US4438504A
Cited
US4569030A
Cited
US4563681A
Cited
US4558454A
Cited
US4536844A
Cited
US4630299A
Cited
US4719591A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1991-06-21 | 1991-12-21 | 1992-06-21 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1995-06-21 | 1995-12-21 | 1996-06-21 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 1999-06-21 | 1999-12-21 | 2000-06-21 | $7700.00 | Window Closed / Lapsed |