US5673367A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method for neural network control of motion using real-time environmental feedback
Assignee: Individual
•
Filing: 1994-09-15
•
Granted: 1997-09-30
•
Expires: 2014-09-15
Abstract
Abstract A method of motion control for robotics and other automatically controlled machinery using a neural network controller with real-time environmental feedback. The method is illustrated with a two-finger robotic hand having proximity sensors and force sensors that provide environmental feedback signals. The neural network controller is taught to control the robotic hand through training sets using back- propagation methods. The training sets are created by recording the control signals and the feedback signal as the robotic hand or a simulation of the robotic hand is moved through a representative grasping motion. The data recorded is divided into discrete increments of time and the feedback data is shifted out of phase with the control signal data so that the feedback signal data lag one time increment behind the control signal data. The modified data is presented to the neural network controller as a training set. The time lag introduced into the data allows the neural network controller to account for the temporal component of the robotic motion. Thus trained, the neural network controlled robotic hand is able to grasp a wide variety of different objects by generalizing from the training sets.
Inventors
- 👤 Theresa M. Buckley
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-30 22:44
CPC Classifications
B; B25; B25J; B25J9/00; B25J9/16; B25J9/1612; G; G05; G05B; G05B2219/00; G05B2219/30; G05B2219/33; G05B2219/33037; G05B2219/39; G05B2219/39465
Claims Analysis
Total Claims: 21
Claim 1
Independent Claim
258 words
A method for neural network control of a time-varying process, said time-varying process having an input variable capable of affecting an operating state of said time-varying process and an output variable indicative of said operating state of said time-varying process, said method comprising the steps of: a) training a neural network controller by the steps of: i) simulating said time-varying process and recording said input variable as a function of time and recording said output variable as a function of time to create a data set, said data set including input variable data and output variable data as a function of time; ii) creating a training set from said data set by dividing said data set into increments of time and shifting the output variable data out of phase with the input variable data so that the output variable data lag at least one time increment behind the input variable data; and iii) presenting said training set to said neural network controller so that said neural network controller learns a correlating relationship between said output variable and said input variable based on said training set; b) subsequently controlling said time-varying process by the steps of: j) receiving said output variable from said time-varying process as a feedback signal in said neural network controller; jj) creating a control signal based on said feedback signal in accordance with said correlating relationship learned by said neural network controller from said training set; and jjj) receiving said control signal from said neural network controller as the input variable of said time-varying process.
Claim 2
Independent Claim
258 words
A method for neural network control of a time-varying process, said time-varying process having an input variable capable of affecting an operating state of said time-varying process and an output variable indicative of said operating state of said time-varying process, said method comprising the steps of: a) training a neural network controller by the steps of: i) simulating said time-varying process and recording said input variable as a function of time and recording said output variable as a function of time to create a data set, said data set including input variable data and output variable data as a function of time; ii) creating a training set from said data set by dividing said data set into increments of time and shifting the output variable data out of phase with the input variable data so that the output variable data lag at least one time increment behind the input variable data; and iii) presenting said training set to said neural network controller so that said neural network controller learns a correlating relationship between said output variable and said input variable based on said training set; b) subsequently controlling said time-varying process by the steps of: j) receiving said output variable from said time-varying process as a feedback signal in said neural network controller; jj) creating a control signal based on said feedback signal in accordance with said correlating relationship learned by said neural network controller from said training set; and jjj) receiving said control signal from said neural network controller as the input variable of said time-varying process.
Claim 3
Dependent Claim
165 words
The method of claim 1 further comprising the steps of: k) recording the input variable as a function of time and recording the output variable as a function of time during the operation of said time-varying process to create a supplemental data set, said supplemental data set including supplemental input variable data and supplemental output variable data as a function of time; kk) creating a supplemental training set from said supplemental data set by dividing said supplemental data set into increments of time and shifting the supplemental output variable data out of phase with the supplemental input variable data so that the supplemental output variable data lag at least one time increment behind the supplemental input variable data; and kkk) modifying said correlating relationship by presenting said supplemental training set to said neural network controller so that said neural network controller learns a modified correlating relationship between said output variable and said input variable based on said supplemental training set combined with said training set.
Claim 4
Dependent Claim
124 words
The method of claim 1, wherein: step i) comprises simulating a time-varying process representing an operation of a machine, said input variable being capable of affecting an operating state of said machine, said output variable being indicative of said operating state of said machine, and recording said input variable as a function of time and recording said output variable as a function of time to create a data set, said data set including input variable data and output variable data as a function of time; step j) comprises receiving said output variable from said machine as a feedback signal in said neural network controller; and step jjj) comprises receiving said control signal from said neural network controller as the input variable of said machine.
Claim 5
Dependent Claim
122 words
The method of claim 1, wherein: step i) comprises simulating a time-varying process representing a movement of a machine, said input variable being capable of affecting a position of said machine, said output variable being indicative of said position of said machine, and recording said input variable as a function of time and recording said output variable as a function of time to create a data set, said data set including input variable data and output variable data as a function of time; step j) comprises receiving said output variable from said machine as a feedback signal in said neural network controller; and step jjj) comprises receiving said control signal from said neural network controller as the input variable of said machine.
Claim 6
Dependent Claim
51 words
The method of claim 4 wherein step i) comprises simulating said movement of said machine by manually controlling said machine through said movement and recording said input variable as a function of time and recording said output variable as a function of time throughout said movement to create a data set.
Claim 7
Dependent Claim
70 words
The method of claim 1 wherein step i) includes the substep of simulating said time-varying process by operating a simulation means to produce simulated input variable data as a function of time to be recorded as said input variable data as a function of time and to produce simulated output variable data as a function of time to be recorded as said output variable data as a function of time.
Claim 8
Independent Claim
279 words
A method for neural network control of a time-varying process, said time-varying process having an input variable capable of affecting an operating state of said time-varying process and an output variable indicative of said operating state of said time-varying process, said method comprising the steps of: a) training a neural network controller by the steps of: i) simulating said time-varying process and recording said input variable as a function of time and recording said output variable as a function of time to create a data set, said data set including input variable data and output variable data as a function of time; ii) creating a training set from said data set by dividing said data set into increments of time and shifting the output variable data out of phase with the input variable data so that the output variable data lag at least one time increment behind the input variable data; and iii) presenting said training set to an input layer of said neural network controller so that a hidden layer of said neural network controller learns a correlating relationship between said output variable and said input variable based on said training set within; b) subsequently controlling said time-varying process by the steps of: j) receiving said output variable from said time-varying process as a feedback signal in said input layer of said neural network controller; jj) creating a control signal based on said feedback signal in accordance with said correlating relationship learned by said hidden layer of said neural network controller from said training set; and jjj) receiving said control signal from an output layer of said neural network controller as the input variable of said time-varying process.
Claim 9
Independent Claim
279 words
A method for neural network control of a time-varying process, said time-varying process having an input variable capable of affecting an operating state of said time-varying process and an output variable indicative of said operating state of said time-varying process, said method comprising the steps of: a) training a neural network controller by the steps of: i) simulating said time-varying process and recording said input variable as a function of time and recording said output variable as a function of time to create a data set, said data set including input variable data and output variable data as a function of time; ii) creating a training set from said data set by dividing said data set into increments of time and shifting the output variable data out of phase with the input variable data so that the output variable data lag at least one time increment behind the input variable data; and iii) presenting said training set to an input layer of said neural network controller so that a hidden layer of said neural network controller learns a correlating relationship between said output variable and said input variable based on said training set within; b) subsequently controlling said time-varying process by the steps of: j) receiving said output variable from said time-varying process as a feedback signal in said input layer of said neural network controller; jj) creating a control signal based on said feedback signal in accordance with said correlating relationship learned by said hidden layer of said neural network controller from said training set; and jjj) receiving said control signal from an output layer of said neural network controller as the input variable of said time-varying process.
Claim 10
Dependent Claim
58 words
The method of claim 7 wherein step iii) further includes the substep of assigning a value to each of a plurality of connections between said input layer and said hidden layer, and assigning a value to each of a plurality of connections between said hidden layer and said output layer through back-propagation methods based upon said training set.
Claim 11
Dependent Claim
124 words
The method of claim 7, wherein: step i) comprises simulating a time-varying process representing an operation of a machine, said input variable being capable of affecting an operating state of said machine, said output variable being indicative of said operating state of said machine, and recording said input variable as a function of time and recording said output variable as a function of time to create a data set, said data set including input variable data and output variable data as a function of time; step j) comprises receiving said output variable from said machine as a feedback signal in said neural network controller; and step jjj) comprises receiving said control signal from said neural network controller as the input variable of said machine.
Claim 12
Dependent Claim
122 words
The method of claim 7, wherein: step i) comprises simulating a time-varying process representing a movement of a machine, said input variable being capable of affecting a position of said machine, said output variable being indicative of said position of said machine, and recording said input variable as a function of time and recording said output variable as a function of time to create a data set, said data set including input variable data and output variable data as a function of time; step j) comprises receiving said output variable from said machine as a feedback signal in said neural network controller; and step jjj) comprises receiving said control signal from said neural network controller as the input variable of said machine.
Claim 13
Dependent Claim
51 words
The method of claim 10 wherein step i) comprises simulating said movement of said machine by manually controlling said machine through said movement and recording said input variable as a function of time and recording said output variable as a function of time throughout said movement to create a data set.
Claim 14
Dependent Claim
70 words
The method of claim 7 wherein step i) includes the substep of simulating said time-varying process by operating a simulation means to produce simulated input variable data as a function of time to be recorded as said input variable data as a function of time and to produce simulated output variable data as a function of time to be recorded as said output variable data as a function of time.
Claim 15
Independent Claim
272 words
A method for neural network motion control of a robotic end effector, said robotic end effector having an input variable capable of affecting a position of said robotic end effector and an output variable indicative of an operating state of said robotic end effector, said method comprising the steps of: a) training a neural network controller by the steps of: i) simulating a movement of said robotic end effector and recording said input variable as a function of time and recording said output variable as a function of time to create a data set, said data set including input variable data and output variable data as a function of time; ii) creating a training set from said data set by dividing said data set into increments of time and shifting the output variable data out of phase with the input variable data so that the output variable data lag at least one time increment behind the input variable data; and iii) presenting said training set to said neural network controller so that said neural network controller learns a correlating relationship between said output variable and said input variable based on said training set; b) subsequently controlling the motion of said robotic end effector by the steps of: j) receiving said output variable from said robotic end effector as a feedback signal in said neural network controller; jj) creating a control signal based on said feedback signal in accordance with said correlating relationship learned by said neural network controller from said training set; and jjj) receiving said control signal from said neural network controller as the input variable of said robotic end effector.
Claim 16
Independent Claim
272 words
A method for neural network motion control of a robotic end effector, said robotic end effector having an input variable capable of affecting a position of said robotic end effector and an output variable indicative of an operating state of said robotic end effector, said method comprising the steps of: a) training a neural network controller by the steps of: i) simulating a movement of said robotic end effector and recording said input variable as a function of time and recording said output variable as a function of time to create a data set, said data set including input variable data and output variable data as a function of time; ii) creating a training set from said data set by dividing said data set into increments of time and shifting the output variable data out of phase with the input variable data so that the output variable data lag at least one time increment behind the input variable data; and iii) presenting said training set to said neural network controller so that said neural network controller learns a correlating relationship between said output variable and said input variable based on said training set; b) subsequently controlling the motion of said robotic end effector by the steps of: j) receiving said output variable from said robotic end effector as a feedback signal in said neural network controller; jj) creating a control signal based on said feedback signal in accordance with said correlating relationship learned by said neural network controller from said training set; and jjj) receiving said control signal from said neural network controller as the input variable of said robotic end effector.
Claim 17
Dependent Claim
55 words
The method of claim 13 wherein step i) comprises simulating said movement of said robotic end effector by manually controlling said robotic end effector through said movement and recording said input variable as a function of time and recording said output variable as a function of time throughout said movement to create a data set.
Claim 18
Dependent Claim
74 words
The method of claim 13 wherein step i) includes the substep of simulating said movement of said robotic end effector by operating a simulation means to produce simulated input variable data as a function of time to be recorded as said input variable data as a function of time and to produce simulated output variable data as a function of time to be recorded as said output variable data as a function of time.
Claim 19
Independent Claim
256 words
A method for neural network control of a time-varying process, said time-varying process having an input variable capable of affecting an operating state of said time-varying process and a time indication variable, said method comprising the steps of: a) training a neural network controller by the steps of: i) simulating said time-varying process and recording said input variable as a function of time and recording said time indication variable as a function of time to create a data set, said data set including input variable data and time indication variable data as a function of time; ii) creating a training set from said data set by dividing said data set into increments of time and shifting the time indication variable data out of phase with the input variable data so that the time indication variable data lag at least one time increment behind the input variable data; and iii) presenting said training set to said neural network controller so that said neural network controller learns a correlating relationship between said time indication variable and said input variable based on said training set; b) subsequently controlling said time-varying process by the steps of: j) receiving said time indication variable from said time-varying process as a feedback signal in said neural network controller; jj) creating a control signal based on said feedback signal in accordance with said correlating relationship learned by said neural network controller from said training set; and jjj) receiving said control signal from said neural network controller as the input variable of said time-varying process.
Claim 20
Independent Claim
256 words
A method for neural network control of a time-varying process, said time-varying process having an input variable capable of affecting an operating state of said time-varying process and a time indication variable, said method comprising the steps of: a) training a neural network controller by the steps of: i) simulating said time-varying process and recording said input variable as a function of time and recording said time indication variable as a function of time to create a data set, said data set including input variable data and time indication variable data as a function of time; ii) creating a training set from said data set by dividing said data set into increments of time and shifting the time indication variable data out of phase with the input variable data so that the time indication variable data lag at least one time increment behind the input variable data; and iii) presenting said training set to said neural network controller so that said neural network controller learns a correlating relationship between said time indication variable and said input variable based on said training set; b) subsequently controlling said time-varying process by the steps of: j) receiving said time indication variable from said time-varying process as a feedback signal in said neural network controller; jj) creating a control signal based on said feedback signal in accordance with said correlating relationship learned by said neural network controller from said training set; and jjj) receiving said control signal from said neural network controller as the input variable of said time-varying process.
Claim 21
Dependent Claim
51 words
The method of claim 15, wherein: step i) comprises simulating a time-varying process representing a trajectory of a machine with said operating state representing a position of said machine; and step b) comprises controlling the trajectory of said machine in accordance with said correlating relationship learned by said neural network controller.
References Cited (Backward Citations)
US4541771A
Cited
US4730861A
Cited
US4766322A
Cited
US4682805A
Cited
US4852018A
Cited
US4850631A
Cited
US4884216A
Cited
US5063492A
Cited
US4990838A
Cited
US5136687A
Cited
US5420964A
Cited
US5124918A
Cited
US5113482A
Cited
US5259064A
Cited
US5253329A
Cited
US5355435A
Cited
US5371834A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-09-29 | 2001-03-31 | 2001-09-30 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-09-29 | 2005-03-31 | 2005-09-30 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-09-29 | 2009-03-31 | 2009-09-30 | $7700.00 | Window Closed / Lapsed |