Patent US5164912A successfully refreshed from Google Patents.
US5164912A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Expert system tester
Assignee: Siemens Energy Inc
•
Filing: 1991-09-10
•
Granted: 1992-11-17
•
Expires: 2011-09-10
Abstract
Abstract The present invention is an expert system test system which has the capability of exercising all combinations of data input types using specialized data test sets. The specialized data test sets include a set of sensor values for each level of an operating system. All levels of diagnosis can be tested without testing every possible sensor value and combination of sensor values. The test sets can be combined to produce various orders of testing allowing complex relationships between sensors and rules to be tested. The system includes a test plan which is used by the testing system to iteratively apply the normal and specialized test data to the expert system. Changing the sensor values produces outputs for each iteration which are compared to expected results or to a baseline. Each test produces a log file which can be examined by the knowledge engineer. If exceptions are produced, the system produces an exception report which allows the knowledge engineer to determine whether the exception is abnormal or unexpected. An output log is also stored as historical data and used with future tests to obtain a complete test regression comparison using conventional database comparison tools. The system includes a test language which allows the user to formulate a test plan without the need for complicated programming associated therewith by designating the rulebase to be used, and by defining the order of the test and the tests performed therein, along with exceptions which include exceptions which include simple, set and sufficiency type exceptions.
Inventors
- 👤 Robert L. Osborne
- 👤 Karl E. Harper
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-30 15:25
CPC Classifications
G; G06; G06F; G06F11/00; G06F11/22; G06F11/2257
Claims Analysis
Total Claims: 19
Claim 1
Independent Claim
120 words
A test system for testing an expert system having rules, said test system comprising: test storage means for storing a complete normal test set, separate from the rules, for testing the rules and a complete specialized test set, separate from the rules, for testing the rules, the normal test set comprising data values inside a diagnostic level which will not cause the expert system to perform a diagnosis and the specialized test set comprising data values which will cause the expert system to perform the diagnosis; and testing means for testing all the expert system rules to automatically detect malfunctioning rules using the complete normal test set and the complete specialized test set to produce a complete output data set.
Claim 2
Dependent Claim
120 words
A test system for testing an expert system having rules, said test system comprising: test storage means for storing a complete normal test set, separate from the rules, for testing the rules and a complete specialized test set, separate from the rules, for testing the rules, the normal test set comprising data values inside a diagnostic level which will not cause the expert system to perform a diagnosis and the specialized test set comprising data values which will cause the expert system to perform the diagnosis; and testing means for testing all the expert system rules to automatically detect malfunctioning rules using the complete normal test set and the complete specialized test set to produce a complete output data set.
Claim 3
Dependent Claim
34 words
A system as recited in claim 1, wherein said testing means comprises exception means for comparing expert system outputs responsive to the specialized test set with an exception condition and reporting when coincidence exists.
Claim 4
Dependent Claim
27 words
A system as recited in claim 1, wherein said testing means performs testing responsive to a test plan designating a test set order, test type and exceptions.
Claim 5
Dependent Claim
22 words
A system as recited in claim 3, further comprising test language means for converting test plan input statements into the test plan.
Claim 6
Dependent Claim
24 words
A system as recite din claim 1, wherein said test means produces a log including test parameters, a test plan and a test case.
Claim 7
Dependent Claim
42 words
A system as recited in claim 1, wherein said testing means cyclically applies the normal test set to the expert system followed by applying, to the expert system, the normal test set with one value changed to a specialized test data value.
Claim 8
Dependent Claim
21 words
A system as recited in claim 1, wherein said testing means performs an nth order test where n is an integer.
Claim 9
Dependent Claim
38 words
A system as recited in claim 1, further comprising: result storage means for storing results of tests before and after rule changes; and comparison means for comparing the results before and after the rule changes and indicating differences.
Claim 10
Dependent Claim
250 words
A test system for testing an expert system for a power plant, the expert system having rules and said test system comprising: test storage means for storing an array of test sets for testing the rules, the test sets including a complete normal sensor value set, separate from the rules, and complete specialized sensor value sets separate from the rules and including sensor failure, predictive and diagnostic values, the normal sensor value set comprising data values inside a diagnostic level which will normally not cause the expert system to perform a diagnosis and the specialized sensor value sets comprising data values which will normally cause the expert system to perform the diagnosis; testing means for testing all the expert system rules cyclically to automatically detect malfunctioning rules using the normal sensor value set and the specialized sensor value set while iteratively applying the specialized sensor value sets to produce a complete output data set, said testing means including: reading means for reading a test input in a test plan language and converting the test inputs into a test plan, the test plan specifying an order of the test and exceptions to be tested; exception means for comparing expert system outputs with the expected results and reporting when a match occurs; logging means for logging sensors tested, sensor data, malfunctions indicated, malfunction descriptions, the test plan and the test cases comprising the specialized sensor value sets; and comparison means for comparing logs before and after changes to the expert system rules.
Claim 11
Dependent Claim
250 words
A test system for testing an expert system for a power plant, the expert system having rules and said test system comprising: test storage means for storing an array of test sets for testing the rules, the test sets including a complete normal sensor value set, separate from the rules, and complete specialized sensor value sets separate from the rules and including sensor failure, predictive and diagnostic values, the normal sensor value set comprising data values inside a diagnostic level which will normally not cause the expert system to perform a diagnosis and the specialized sensor value sets comprising data values which will normally cause the expert system to perform the diagnosis; testing means for testing all the expert system rules cyclically to automatically detect malfunctioning rules using the normal sensor value set and the specialized sensor value set while iteratively applying the specialized sensor value sets to produce a complete output data set, said testing means including: reading means for reading a test input in a test plan language and converting the test inputs into a test plan, the test plan specifying an order of the test and exceptions to be tested; exception means for comparing expert system outputs with the expected results and reporting when a match occurs; logging means for logging sensors tested, sensor data, malfunctions indicated, malfunction descriptions, the test plan and the test cases comprising the specialized sensor value sets; and comparison means for comparing logs before and after changes to the expert system rules.
Claim 12
Independent Claim
120 words
A method, initiated by a user, of testing an expert system having rules, comprising the steps of: (a) applying, by the computer, a complete normal test set to the rules of the expert system, the normal test set being separate from the rules and comprising normal data values inside a diagnostic level which will normally not cause the expert system to perform a diagnosis and; (b) applying, by the computer, a complete specialized test set to the rules of the expert system, the specialized test set being separate from the rules and comprising test data values which normally will cause the expert system to perform the diagnosis; and (c) recording, by the computer, abnormal rule executions produced during step (b).
Claim 13
Independent Claim
120 words
A method, initiated by a user, of testing an expert system having rules, comprising the steps of: (a) applying, by the computer, a complete normal test set to the rules of the expert system, the normal test set being separate from the rules and comprising normal data values inside a diagnostic level which will normally not cause the expert system to perform a diagnosis and; (b) applying, by the computer, a complete specialized test set to the rules of the expert system, the specialized test set being separate from the rules and comprising test data values which normally will cause the expert system to perform the diagnosis; and (c) recording, by the computer, abnormal rule executions produced during step (b).
Claim 14
Dependent Claim
122 words
A method of testing an expert system as recited in claim 10, wherein step (a) comprises steps of: (a1) setting all input values to the normal data values; and (a2) firing rules of the expert system; wherein step (b) comprises the steps of: (b1) setting one of the input values to one of the test data values; and (b`) firing the rules of the expert system; wherein step (c) comprises the steps of: (c1) comparing outputs of the expert system with exceptions; and (c2) producing an exception indication when a match occurs; and wherein said method comprises repeating steps (a1)-(c2) while iteratively selecting different ones of the input values in step (b1) to set to another one of the test data values.
Claim 15
Dependent Claim
34 words
A method as recited in claim 11, further comprising reading testing requirements input by a user and producing a test plan and wherein step (b) applies a test set responsive to the test plan.
Claim 16
Dependent Claim
23 words
A method as recited in claim 11, wherein step (b1) sets a pair of input values to a pair of test data values.
Claim 17
Dependent Claim
31 words
A method as recited in claim 11, further comprising: (d) performing steps (a-c) with rulebase changes in the expert system; and (e) comparing test outputs before and after the rulebase changes.
Claim 18
Independent Claim
240 words
A method, initiated by a user, of testing an expert system for a power plant, comprising the steps of: (a) reading, by the computer, test requirements input by a user specifying test type, test order and test exceptions; (b) converting, by the computer, the test requirements into a test plan; (c) initializing, by the computer, the expert system; (d) setting, by the computer, all sensor input values to normal values test values being separate from the rules and comprising data values inside a diagnostic level which will normally not cause the expert system to perform a diagnosis; (e) updating and firing rules of the expert system; (f) setting, by the computer, sensor values to test values responsive to the test plan, the test values being separate from the rules and comprising data values which will normally cause the expert system to perform the diagnosis; (g) updating and firing the rules of the expert system; (h) logging, by the computer, all outputs of the expert system; (i) comparing, by the computer, the outputs of the expert system to the test exceptions; (j) producing, by the computer, an exception report when a match occurs; (k) repeating steps (d)-(j) in accordance with the test plan for all test values; (l) performing steps (a)-(k) after the user makes changes to the rules in the expert system; and (m) comparing, by the computer, the logging outputs produced before and after the changes to the rules.
Claim 19
Independent Claim
240 words
A method, initiated by a user, of testing an expert system for a power plant, comprising the steps of: (a) reading, by the computer, test requirements input by a user specifying test type, test order and test exceptions; (b) converting, by the computer, the test requirements into a test plan; (c) initializing, by the computer, the expert system; (d) setting, by the computer, all sensor input values to normal values test values being separate from the rules and comprising data values inside a diagnostic level which will normally not cause the expert system to perform a diagnosis; (e) updating and firing rules of the expert system; (f) setting, by the computer, sensor values to test values responsive to the test plan, the test values being separate from the rules and comprising data values which will normally cause the expert system to perform the diagnosis; (g) updating and firing the rules of the expert system; (h) logging, by the computer, all outputs of the expert system; (i) comparing, by the computer, the outputs of the expert system to the test exceptions; (j) producing, by the computer, an exception report when a match occurs; (k) repeating steps (d)-(j) in accordance with the test plan for all test values; (l) performing steps (a)-(k) after the user makes changes to the rules in the expert system; and (m) comparing, by the computer, the logging outputs produced before and after the changes to the rules.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1995-11-17 | 1996-05-18 | 1996-11-17 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1999-11-17 | 2000-05-18 | 2000-11-17 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2003-11-17 | 2004-05-18 | 2004-11-17 | $7700.00 | Window Closed / Lapsed |