US6429699B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Generator of neuron transfer function and its derivative
Assignee: Winbond Electronics Corp
•
Filing: 2000-12-19
•
Granted: 2002-08-06
•
Expires: 2020-12-19
Abstract
Abstract This invention relates to an artificial neural network (ANN), particularly to a neuron circuit and its activation function including the derivative. The neuron circuit capable of generating an adjustable sigmoid-like function and a good approximation of its derivative, comprises: a current generator for generating a current; a current-controlled transistor for changing an output voltage according to the current from the current generator; and at least one differential pair of transistors for generating the adjustable sigmoid-like function output and the good approximation of its derivative by the changed output voltage.
Inventors
- 👤 Bingxue Shi
- 👤 Chun Lu
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-10 00:57
CPC Classifications
G; G06; G06N; G06N3/00; G06N3/02; G06N3/04; G06N3/048
Claims Analysis
Total Claims: 19
Claim 1
Independent Claim
77 words
A neuron circuit, capable of generating an adjustable sigmoid-like function and a good approximation of its derivative, comprising: a current generator for generating a current by the different input voltages; a current-controlled transistor for changing an output voltage according to the current from the current generator; and at least one differential pair of transistors for generating the adjustable sigmoid-like function output and the good approximation of its derivative by the output voltage changed by the current-controlled transistor.
Claim 2
Dependent Claim
77 words
A neuron circuit, capable of generating an adjustable sigmoid-like function and a good approximation of its derivative, comprising: a current generator for generating a current by the different input voltages; a current-controlled transistor for changing an output voltage according to the current from the current generator; and at least one differential pair of transistors for generating the adjustable sigmoid-like function output and the good approximation of its derivative by the output voltage changed by the current-controlled transistor.
Claim 3
Dependent Claim
25 words
The neuron circuit of claim 1 , wherein the current generator is a complementary pair of transistors with different input voltages from the gate electrodes.
Claim 4
Dependent Claim
16 words
The neuron circuit of claim 1 , wherein the current-controlled transistor is a surface field-effect transistor.
Claim 5
Dependent Claim
27 words
The neuron circuit of claim 1 , wherein the differential pair of transistors are respectively connected to a load to form an identified side to each other.
Claim 6
Dependent Claim
14 words
The neuron circuit of claim 4 , wherein the load is any active device.
Claim 7
Dependent Claim
211 words
A neuron circuit, comprising: a pair of transistors having a first common terminal connected to a first input voltage, a second common terminal connected to a first output, a first gate connected to a second input voltage, and a second gate connected to a third input voltage; a surface field-effect transistor having a first terminal and a third gate connected together to the first output, which is connected to a first current source, and a second terminal connected to a second current source; a first differential pair of transistors, having a third common terminal connected to a third current source, a first gate connected to the first output, a second gate connected to a fourth input voltage, a first terminal connected to a first load to form a connecting point as a second output, and a second terminal connected to a second load; and a second differential pair of transistors, having a fourth common terminal connected to the third current source, a third gate connected to the first gate of the first differential pair of transistors output, a fourth gate connected to a fifth input voltage, a third terminal connected to a third load to form a connecting point as a third output, and a fourth terminal connected to fourth load.
Claim 8
Dependent Claim
211 words
A neuron circuit, comprising: a pair of transistors having a first common terminal connected to a first input voltage, a second common terminal connected to a first output, a first gate connected to a second input voltage, and a second gate connected to a third input voltage; a surface field-effect transistor having a first terminal and a third gate connected together to the first output, which is connected to a first current source, and a second terminal connected to a second current source; a first differential pair of transistors, having a third common terminal connected to a third current source, a first gate connected to the first output, a second gate connected to a fourth input voltage, a first terminal connected to a first load to form a connecting point as a second output, and a second terminal connected to a second load; and a second differential pair of transistors, having a fourth common terminal connected to the third current source, a third gate connected to the first gate of the first differential pair of transistors output, a fourth gate connected to a fifth input voltage, a third terminal connected to a third load to form a connecting point as a third output, and a fourth terminal connected to fourth load.
Claim 9
Dependent Claim
25 words
The neuron circuit of claim 6 , wherein the first differential pair of transistors and the second differential pair of transistors are identified in configuration.
Claim 10
Dependent Claim
28 words
The neuron circuit of claim 6 , wherein both of the fourth input voltage and the fifth input voltage are constant values and have a fixed voltage difference.
Claim 11
Dependent Claim
29 words
The neuron circuit of claim 6 , wherein the second output outputs a sigmoidal transfer function while the third output outputs an approximate derivative of the sigmoidal transfer function.
Claim 12
Dependent Claim
29 words
The neuron circuit of claim 6 , wherein the second output outputs an approximate derivative of a sigmoidal transfer function while the third output outputs the sigmoidal transfer function.
Claim 13
Dependent Claim
78 words
The neuron circuit of claim 6 , wherein all loads are identified and each comprises: a first transistor, having a first terminal connected to an power voltage, a second terminal, and a gate connected to the second terminal; and a second transistor, having a first terminal connected to the second terminal of the first transistor, a second terminal connected to the respective transistor of the corresponding differential pair of transistors, and a gate connected to the second terminal.
Claim 14
Dependent Claim
77 words
A neuron circuit for generating an adjustable sigmoid-like function and approximation of its derivative, comprising: a current generator, the current generator receiving different input voltages and generating a current; a current-controlled transistor, the current-controlled transistor receiving the current and adjusting an output voltage; and at least one differential pair of identical transistors, the at least one differential pair of identical transistors receiving the adjusted output voltage and generating the adjustable sigmoid-like function and approximation of its derivative.
Claim 15
Dependent Claim
77 words
A neuron circuit for generating an adjustable sigmoid-like function and approximation of its derivative, comprising: a current generator, the current generator receiving different input voltages and generating a current; a current-controlled transistor, the current-controlled transistor receiving the current and adjusting an output voltage; and at least one differential pair of identical transistors, the at least one differential pair of identical transistors receiving the adjusted output voltage and generating the adjustable sigmoid-like function and approximation of its derivative.
Claim 16
Dependent Claim
23 words
The apparatus of claim 12 , wherein the current generator is comprised of two transistors, the two transistors operating in their linear region.
Claim 17
Dependent Claim
20 words
The apparatus of claim 13 , wherein the two transistors have a first common terminal and a second common terminal.
Claim 18
Dependent Claim
22 words
The apparatus of claim 14 , wherein a linear resistor is formed between the first common terminal and the second common terminal.
Claim 19
Dependent Claim
17 words
The apparatus of claim 15 , wherein the linear resistor is controlled by the different input voltages.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2005-08-05 | 2006-02-04 | 2006-08-06 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2009-08-05 | 2010-02-04 | 2010-08-06 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2013-08-05 | 2014-02-04 | 2014-08-06 | $7700.00 | Window Closed / Lapsed |