US5826249A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Historical database training method for neural networks
Assignee: Rockwell Automation Technologies Inc
•
Filing: 1997-06-06
•
Granted: 1998-10-20
•
Expires: 2017-06-06
Abstract
Abstract An on-line training neural network for process control system and method trains by retrieving training sets from the stream of process data. The neural network detects the availability of new training data, and constructs a training set by retrieving the corresponding input data. The neural network is trained using the training set. Over time, many training sets are presented to the neural network. When multiple presentations are needed to effectively train, a buffer of training sets is filled-and updated as new training data becomes available. The size of the buffer is selected in accordance with the training needs of the neural network. Once the buffer is full, a new training set bumps the oldest training set off the top of the buffer stack. The training sets in the buffer stack can be presented one or more times each time a new training set is constructed. An historical database of timestamped data can be used to construct training sets when training input data has a time delay from sample time to availability for the neural network. The timestamps of the training input data are used to select the appropriate timestamp at which input data is retrieved for use in the training set. Using the historical database, the neural network can be trained retrospectively by searching the historical database and constructing training sets based on past data.
Inventors
- 👤 Richard D. Skeirik
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-27 19:42
CPC Classifications
G; G05; G05B; G05B13/00; G05B13/02; G05B13/0265; G05B13/027; Y; Y10; Y10S; Y10S706/00; Y10S706/902; Y10S706/903; Y10S706/906
Claims Analysis
Total Claims: 26
Claim 1
Independent Claim
111 words
A computer neural network process control method adapted for predicting output data provided to a controller used to control a process for producing a product property having at least one product property, the computer neural network process control method comprising the steps of: (1) training a neural network using a first training set based on first lab data; (2) training or retraining said neural network using a second training set based on second lab data, and using said first training set; and (3) training or retraining said neural network using a third training set based on third lab data, and using said second training set, without using said first training set.
Claim 2
Dependent Claim
111 words
A computer neural network process control method adapted for predicting output data provided to a controller used to control a process for producing a product property having at least one product property, the computer neural network process control method comprising the steps of: (1) training a neural network using a first training set based on first lab data; (2) training or retraining said neural network using a second training set based on second lab data, and using said first training set; and (3) training or retraining said neural network using a third training set based on third lab data, and using said second training set, without using said first training set.
Claim 3
Dependent Claim
38 words
The computer neural network process control method of claim 1, wherein steps (1), (2), and/or (3) comprise a step of retrieving said first training set, said second training set, or said third training set, respectively, from a database.
Claim 4
Dependent Claim
39 words
The computer neural network process control method of claim 1, wherein steps (1), (2), and/or (3) comprise a step of retrieving said first training set, said second training set, or said third training set, respectively, from an historical database.
Claim 5
Dependent Claim
35 words
The computer neural network process control method of claim 1, wherein steps (1), (2), and/or (3) comprise a step of constructing said first training set, said second training set, or said third training set, respectively.
Claim 6
Dependent Claim
18 words
The computer neural network process control method of claim 4, wherein said step of constructing operates in real-time.
Claim 7
Dependent Claim
57 words
The computer neural network process control method of claim 4, wherein said step of constructing comprises a step of using an associated timestamp(s) of said first lab data, said second lab data or said third lab data to indicate input data for constructing said first training set, said second training set, or said third training set, respectively.
Claim 8
Dependent Claim
48 words
The computer neural network process control method of claim 1, wherein: step (1) is preceded by a step of (a) analyzing a physical specimen from the process; and wherein step (1) further comprises a step of using data representative of said analyzing step (a) as said lab data.
Claim 9
Dependent Claim
169 words
A computer neural network process control method adapted for predicting output data provided to a controller used to control a process for producing a product having at least one product property, the computer neural network process control method comprising the steps of: (1) detecting first lab data; (2) training or retraining a neural network, when said first lab data is detected by step (1), by using a first training set based on said second lab data, and by using said first training set; (3) detecting second lab data; (4) training or retraining said neural network, when said second lab data is detected by step (3), by using a second training set based on second lab data, and by using said first training set; (5) detecting third lab data; (6) training or retraining said neural network, when said third lab data is detected by step (5), by using a third training set based on said third lab data, and using said second training set, without using said first training set.
Claim 10
Dependent Claim
169 words
A computer neural network process control method adapted for predicting output data provided to a controller used to control a process for producing a product having at least one product property, the computer neural network process control method comprising the steps of: (1) detecting first lab data; (2) training or retraining a neural network, when said first lab data is detected by step (1), by using a first training set based on said second lab data, and by using said first training set; (3) detecting second lab data; (4) training or retraining said neural network, when said second lab data is detected by step (3), by using a second training set based on second lab data, and by using said first training set; (5) detecting third lab data; (6) training or retraining said neural network, when said third lab data is detected by step (5), by using a third training set based on said third lab data, and using said second training set, without using said first training set.
Claim 11
Dependent Claim
33 words
The computer neural network process control method of claim 8, further comprising a step of retrieving said first training set, said second training set, and/or said third training set from a historical database.
Claim 12
Dependent Claim
25 words
The computer neural network process control method of claim 8, further comprising between steps (4) and (5) the step of discarding said first training set.
Claim 13
Dependent Claim
23 words
The computer neural network process control method of claim 8, further comprising after step (6) the step of discarding said second training set.
Claim 14
Dependent Claim
99 words
A computer neural network process control method adapted for predicting output data provided to a controller used to control a process for producing a product having at least one product property, the computer neural network process control method comprising the steps of: (1) constructing a stack containing at least two training sets; (2) training or retraining said neural network using said at least two training sets in said stack; (3) constructing a new training set and replacing an oldest training set in said stack with said new training set; and (4) repeating steps (2) and (3) at least once.
Claim 15
Dependent Claim
99 words
A computer neural network process control method adapted for predicting output data provided to a controller used to control a process for producing a product having at least one product property, the computer neural network process control method comprising the steps of: (1) constructing a stack containing at least two training sets; (2) training or retraining said neural network using said at least two training sets in said stack; (3) constructing a new training set and replacing an oldest training set in said stack with said new training set; and (4) repeating steps (2) and (3) at least once.
Claim 16
Dependent Claim
48 words
The computer neural network process control method of claim 12, wherein step (3) comprises the steps of: (a) monitoring in real time for the presence of new training input data; and (b) retrieving input data indicated by said new training input data to construct said new training set.
Claim 17
Dependent Claim
27 words
The computer neural network process control method of claim 12, wherein step (2) of training uses only once said at least two training sets of said stack.
Claim 18
Dependent Claim
28 words
The computer neural network process control method of claim 12, wherein step (2) of training uses at least twice said at least two training sets of said stack.
Claim 19
Dependent Claim
138 words
A computer neural network process control method adapted for predicting output data provided to a controller used to control a physical process for producing a product having at least one product property, the computer neural network process control method comprising the steps of: (1) operating the physical process and measuring the same to produce a first lab data, a second lab data, and a third lab data; (2) training a neural network using a first training set based on said first lab data; (3) training or retraining said neural network using a second training set based on said second lab data, and using said first training set; and (4) training or retraining said neural network using a third training set based on said third lab data, and using said second training set, without using said first training set.
Claim 20
Dependent Claim
138 words
A computer neural network process control method adapted for predicting output data provided to a controller used to control a physical process for producing a product having at least one product property, the computer neural network process control method comprising the steps of: (1) operating the physical process and measuring the same to produce a first lab data, a second lab data, and a third lab data; (2) training a neural network using a first training set based on said first lab data; (3) training or retraining said neural network using a second training set based on said second lab data, and using said first training set; and (4) training or retraining said neural network using a third training set based on said third lab data, and using said second training set, without using said first training set.
Claim 21
Dependent Claim
140 words
A computer neural network process control method adapted for predicting output data provided to a controller used to control a process for producing a product having at least one product property, the computer neural network process control method comprising the steps of: (1) training a neural network using a first training set based on first lab data; (2) training or retraining said neural network using a second training set based on second lab data, and using said first training set; (3) training or retraining said neural network using a third training set based on third lab data, and using said second training set, without using said first training set; (4) predicting, using said neural network, a first output data using a first input data; and (5) changing a physical state of an actuator in accordance with said first output data.
Claim 22
Dependent Claim
140 words
A computer neural network process control method adapted for predicting output data provided to a controller used to control a process for producing a product having at least one product property, the computer neural network process control method comprising the steps of: (1) training a neural network using a first training set based on first lab data; (2) training or retraining said neural network using a second training set based on second lab data, and using said first training set; (3) training or retraining said neural network using a third training set based on third lab data, and using said second training set, without using said first training set; (4) predicting, using said neural network, a first output data using a first input data; and (5) changing a physical state of an actuator in accordance with said first output data.
Claim 23
Dependent Claim
194 words
A computer neural network process control method adapted for predicting output data provided to a controller used to control a process for producing a product having at least one product property, the computer neural network process control method comprising the steps of: (1) detecting first lab data; (2) training or retraining a neural network, when said first lab data is detected by step (1), by using a first training set based on said first lab data; (3) detecting second lab data; (4) training or retraining said neural network, when said second lab data is detected by step (3), by using a second training set based on said second lab data and by using said first training set; (5) detecting third lab data; (6) training or retaining said neural network, when said third lab data is detected in step (5), by using a third training set based on said third lab data, and using said second training set, without using said first training set; (7) predicting, using said neural network, a first output data using a first input data; and (8) changing a physical state of an actuator in accordance with said first output data.
Claim 24
Dependent Claim
194 words
A computer neural network process control method adapted for predicting output data provided to a controller used to control a process for producing a product having at least one product property, the computer neural network process control method comprising the steps of: (1) detecting first lab data; (2) training or retraining a neural network, when said first lab data is detected by step (1), by using a first training set based on said first lab data; (3) detecting second lab data; (4) training or retraining said neural network, when said second lab data is detected by step (3), by using a second training set based on said second lab data and by using said first training set; (5) detecting third lab data; (6) training or retaining said neural network, when said third lab data is detected in step (5), by using a third training set based on said third lab data, and using said second training set, without using said first training set; (7) predicting, using said neural network, a first output data using a first input data; and (8) changing a physical state of an actuator in accordance with said first output data.
Claim 25
Dependent Claim
186 words
A computer network process control method adapted for predicting output data provided to a controller used to control a physical process for producing a product having at least one product property, the computer neural network process control method comprising the steps of: (1) operating the physical process and measuring the same to produce a first lab data, a second lab data, and a third lab data; (2) detecting first lab data; (3) training or retraining a neural network, when said first lab data is detected by step (2), by using a first training based on said first lab data; (4) detecting second lab data; (5) training or retraining a neural network, when said second lab data is detected by step (4), by using a second training set based on said lab data and by using said first training set; (6) detecting third lab data; and (7) training or retraining said neural network, when said third lab data is detected in step (6), by using a third training set based on said third lab data, and using said second training set, without using said first training set.
Claim 26
Dependent Claim
186 words
A computer network process control method adapted for predicting output data provided to a controller used to control a physical process for producing a product having at least one product property, the computer neural network process control method comprising the steps of: (1) operating the physical process and measuring the same to produce a first lab data, a second lab data, and a third lab data; (2) detecting first lab data; (3) training or retraining a neural network, when said first lab data is detected by step (2), by using a first training based on said first lab data; (4) detecting second lab data; (5) training or retraining a neural network, when said second lab data is detected by step (4), by using a second training set based on said lab data and by using said first training set; (6) detecting third lab data; and (7) training or retraining said neural network, when said third lab data is detected in step (6), by using a third training set based on said third lab data, and using said second training set, without using said first training set.
References Cited (Backward Citations)
WO1989003092A1
Cited
US4975961A
Cited
JPH01224804A
Cited
EP0384689A2
Cited
US4954963A
Cited
US5140523A
Cited
US5111531A
Cited
US5052043A
Cited
US5398300A
Cited
US5408586A
Cited
US5214715A
Cited
US5586033A
Cited
US5477444A
Cited
US5461699A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-10-19 | 2002-04-20 | 2002-10-20 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-10-19 | 2006-04-20 | 2006-10-20 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-10-19 | 2010-04-20 | 2010-10-20 | $7700.00 | Window Closed / Lapsed |