← Back to Patent Explorer
US5812436A Expired / Lapsed US ⏱️ 0.0 years remaining

Method and apparatus for testing and analyzing the conformance of a proposed set of requirements for a proposed network management application

Assignee: Hewlett Packard Development Co LP
•
Filing: 1994-10-20
•
Granted: 1998-09-22
•
Expires: 2014-10-20
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method and system for preparing a suite of test scripts for testing a proposed network management application. The proposed network management application, termed a subsystem control facility (SCF), is first defined as a set of requirements with the aid of a developmental tool incorporating a subsystem knowledgebase and a test generation knowledgebase. The subsystem knowledgebase contains the rules governing the operation of a given network and a library of permitted commands, objects, attributes, modifiers and other data. The test generation knowledgebase includes information relating to those commands and object specific to the proposed subsystem control facility set of requirements. A user interface coupled to the knowledgebases permits the selection of types of tests and specific commands and objects to be tested. Once test selection has been specified, test scripts corresponding to the selected tests are generated from the first and second knowledgebases for use in testing the proposed set of requirements for the SCF prior to coding the SCF. The suite of test scripts can be used to test the proposed SCF set of requirements, detect nonconformance with the rules and permit modification of the proposed set of SCF requirements. If necessary, additional testing may be performed using the same test scripts or a subset thereof, until the test results indicate no errors and a minimum number of warnings. Thereafter, the SCF product module can be coded. Errors in the developmental stage can be thus corrected early in the developmental cycle.

Inventors

  • 👤 Marc Desgrousilliers
  • 👤 Gregory H. Henderson
  • 👤 Jane S. Prugsanapan

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-08 02:30
CPC Classifications
G; G06; G06F; G06F11/00; G06F11/36; G06F11/3668; G06F11/3672; G06F11/3692; G06F11/22; G06F11/2257

Claims Analysis

Total Claims: 34
Claim 1
Independent Claim 176 words
A method of testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said method comprising the steps of: (a) providing a knowledgebase containing a predetermined set of subsystem requirements; (b) preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; (c) providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements, said test scripts implementing positive tests for testing the ability of the proposed subsystem control facility set of requirements to process valid commands and objects and negative tests for testing the ability of said proposed set of requirements to process invalid commands or objects; (d) applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and (e) analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 2
Independent Claim 176 words
A method of testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said method comprising the steps of: (a) providing a knowledgebase containing a predetermined set of subsystem requirements; (b) preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; (c) providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements, said test scripts implementing positive tests for testing the ability of the proposed subsystem control facility set of requirements to process valid commands and objects and negative tests for testing the ability of said proposed set of requirements to process invalid commands or objects; (d) applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and (e) analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 3
Dependent Claim 28 words
The method of claim 1, wherein said step (e) of analyzing includes the step of reporting any failure to conform with the positive tests or the negative tests.
Claim 4
Dependent Claim 75 words
The method of claim 1 wherein said predetermined set of subsystem requirements includes rules governing the operation of a subject network and a library of permitted commands and objects; said proposed set of requirements includes paired selections of commands and objects from said library; and wherein said step (e) of analyzing includes the steps of comparing the test results obtained using said paired selections of commands and objects with the rules and specifying violations thereof.
Claim 5
Dependent Claim 60 words
The method of claim 3 wherein said library includes object modifiers and attributes; said proposed set of requirements includes selected modifiers and attributes paired to objects; and wherein said step (e) of analyzing includes the steps of comparing the test results obtained using said selected modifiers and attributes paired to objects with the rules and specifying violations of the rules.
Claim 6
Dependent Claim 21 words
The method of claim 1 wherein said step (e) of analyzing includes the step of specifying the nature of any nonconformance.
Claim 7
Dependent Claim 21 words
The method of claim 5 wherein said step of specifying includes the step of indicating the correction required to establish conformance.
Claim 8
Dependent Claim 24 words
The method of claim 5 wherein said step of specifying includes the step of relating the nonconformance to said predetermined set of subsystem requirements.
Claim 9
Independent Claim 202 words
A method of testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said method comprising the steps of: (a) providing a first knowledgebase containing a predetermined set of subsystem requirements; (b) preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; (c) providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements, said step of providing a suite of test scripts including the steps of providing a second knowledgebase containing set generation information relating to those commands and objects specific to the proposed subsystem control facility set of requirements, providing a user interface permitting selection of types of tests and specific commands and objects to be tested, and using the first and second knowledgebases to generate the suite of test scripts; (d) applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and (e) analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 10
Independent Claim 202 words
A method of testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said method comprising the steps of: (a) providing a first knowledgebase containing a predetermined set of subsystem requirements; (b) preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; (c) providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements, said step of providing a suite of test scripts including the steps of providing a second knowledgebase containing set generation information relating to those commands and objects specific to the proposed subsystem control facility set of requirements, providing a user interface permitting selection of types of tests and specific commands and objects to be tested, and using the first and second knowledgebases to generate the suite of test scripts; (d) applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and (e) analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 11
Dependent Claim 42 words
The method of claim 8 wherein said step of providing a second knowledgebase includes the step of furnishing test generation information including a common and minimal set of test techniques to be applied to the proposed subsystem control facility set of requirements.
Claim 12
Dependent Claim 55 words
The method of claim 9 wherein said common and minimal set of test techniques includes positive tests for testing the ability of the proposed subsystem control facility set of requirements to process valid commands and objects and negative tests for testing the ability of said proposed set of requirements to process invalid commands or objects.
Claim 13
Independent Claim 158 words
A method of testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said method comprising the steps of: (a) providing a knowledgebase containing a predetermined set of subsystem requirements, said step of providing a knowledgebase including the step of furnishing a global set of object types, object names, permitted object attributes and permitted object values; (b) preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; (c) providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements; (d) applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and (e) analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 14
Independent Claim 158 words
A method of testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said method comprising the steps of: (a) providing a knowledgebase containing a predetermined set of subsystem requirements, said step of providing a knowledgebase including the step of furnishing a global set of object types, object names, permitted object attributes and permitted object values; (b) preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; (c) providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements; (d) applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and (e) analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 15
Independent Claim 156 words
A method of testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said method comprising the steps of: (a) providing a knowledgebase containing a predetermined set of subsystem requirements; (b) preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; (c) providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements, said step of providing a suite of test scripts including the step of generating a plurality of test scripts files and corresponding template files; (d) applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and (e) analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 16
Independent Claim 156 words
A method of testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said method comprising the steps of: (a) providing a knowledgebase containing a predetermined set of subsystem requirements; (b) preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; (c) providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements, said step of providing a suite of test scripts including the step of generating a plurality of test scripts files and corresponding template files; (d) applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and (e) analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 17
Independent Claim 178 words
A system for testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said system comprising: means for providing a knowledgebase containing a predetermined set of subsystem requirements; means for preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; means for providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements, said test scripts implementing positive tests for testing the ability of the proposed subsystem control facility set of requirements to process valid commands and objects and negative tests for testing the ability of said proposed set of requirements to process invalid commands or objects; means for applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and means for analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 18
Independent Claim 178 words
A system for testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said system comprising: means for providing a knowledgebase containing a predetermined set of subsystem requirements; means for preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; means for providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements, said test scripts implementing positive tests for testing the ability of the proposed subsystem control facility set of requirements to process valid commands and objects and negative tests for testing the ability of said proposed set of requirements to process invalid commands or objects; means for applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and means for analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 19
Dependent Claim 25 words
The system claim 13, wherein said means for analyzing includes means for reporting any failure to conform with the positive tests or the negative tests.
Claim 20
Dependent Claim 73 words
The system of claim 13 wherein said predetermined set of subsystem requirements includes rules governing the operation of a subject network and a library of permitted commands and objects; said proposed set of requirements includes paired selections of commands and objects from said library; and wherein said means for analyzing includes means for comparing the test results obtained using said paired selections of commands and objects with the rules and specifying violations thereof.
Claim 21
Dependent Claim 58 words
The system of claim 15 wherein said library includes object modifiers and attributes; said proposed set of requirements includes selected modifiers and attributes paired to objects; and wherein said means for analyzing includes means for comparing the test results obtained using said selected modifiers and attributes paired to objects with the rules and specifying violations of the rules.
Claim 22
Dependent Claim 19 words
The system of claim 13 wherein said means for analyzing includes means for specifying the nature of any nonconformance.
Claim 23
Dependent Claim 20 words
The system of claim 17 wherein said means for specifying includes means for indicating the correction required to establish conformance.
Claim 24
Dependent Claim 23 words
The system of claim 17 wherein said means for specifying includes means for relating the nonconformance to said predetermined set of subsystem requirements.
Claim 25
Independent Claim 207 words
A system for testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said system comprising: means for providing a first knowledgebase containing a predetermined set of subsystem requirements; means for preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; means for providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements, said means for providing a suite of test scripts including means for providing a second knowledgebase containing test generation information relating to those commands and objects specific to the proposed subsystem control facility set of requirements, means for providing a user interface permitting selection of types of tests and specific commands and objects to be tested, and means for using the first and second knowledgebases to generate the suite of test scripts; means for applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and means for analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 26
Independent Claim 207 words
A system for testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said system comprising: means for providing a first knowledgebase containing a predetermined set of subsystem requirements; means for preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; means for providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements, said means for providing a suite of test scripts including means for providing a second knowledgebase containing test generation information relating to those commands and objects specific to the proposed subsystem control facility set of requirements, means for providing a user interface permitting selection of types of tests and specific commands and objects to be tested, and means for using the first and second knowledgebases to generate the suite of test scripts; means for applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and means for analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 27
Dependent Claim 41 words
The system of claim 20 wherein said means for providing a second knowledgebase includes means for furnishing test generation information including a common and minimal set of test techniques to be applied to the proposed subsystem control facility set of requirements.
Claim 28
Dependent Claim 54 words
The system of claim 21 wherein said common and minimal set of test techniques includes positive tests for testing the ability of the proposed subsystem control facility set of requirements to process valid commands and objects and negative tests for testing the ability of said set of requirements to process invalid commands or objects.
Claim 29
Independent Claim 159 words
A system for testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said system comprising: means for providing a knowledgebase containing a predetermined set of subsystem requirements, said means for providing a knowledgebase including means for furnishing a global set of object types, object names, permitted object attributes and permitted object values; means for preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; means for providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements; means for applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and means for analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 30
Independent Claim 159 words
A system for testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said system comprising: means for providing a knowledgebase containing a predetermined set of subsystem requirements, said means for providing a knowledgebase including means for furnishing a global set of object types, object names, permitted object attributes and permitted object values; means for preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; means for providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements; means for applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and means for analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 31
Independent Claim 157 words
A system for testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said system comprising: means for providing a knowledgebase containing a predetermined set of subsystem requirements; means for preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; means for providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements, said means for providing a suite of test scripts including means for generating a plurality of test scripts files and corresponding template files; means for applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and means for analyzing the test result using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 32
Independent Claim 157 words
A system for testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed systems network, said system comprising: means for providing a knowledgebase containing a predetermined set of subsystem requirements; means for preparing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form; means for providing a suite of test scripts for testing the proposed set of requirements against the predetermined set of subsystem requirements, said means for providing a suite of test scripts including means for generating a plurality of test scripts files and corresponding template files; means for applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and means for analyzing the test result using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 33
Dependent Claim 206 words
A computer program product comprising: a computer usable medium having computer readable code embodied therein for testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed system network, the computer program product comprising: computer readable program code devices configured to cause a computer to effect providing a suite of test scripts for testing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form against a predetermined set of subsystem requirements from a knowledgebase, said test scripts implementing positive tests for testing the ability of the proposed subsystem control facility set of requirements to process valid commands and objects and negative tests for testing the ability of said proposed set of requirements to process invalid commands or objects; computer readable program code devices configured to cause a computer to effect applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and computer readable program code devices configured to cause a computer to effect analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.
Claim 34
Dependent Claim 206 words
A computer program product comprising: a computer usable medium having computer readable code embodied therein for testing and analyzing the conformance of a proposed set of requirements for a proposed subsystem control facility for a distributed system network, the computer program product comprising: computer readable program code devices configured to cause a computer to effect providing a suite of test scripts for testing a proposed set of requirements for a proposed subsystem control facility expressed in binary table form against a predetermined set of subsystem requirements from a knowledgebase, said test scripts implementing positive tests for testing the ability of the proposed subsystem control facility set of requirements to process valid commands and objects and negative tests for testing the ability of said proposed set of requirements to process invalid commands or objects; computer readable program code devices configured to cause a computer to effect applying the binary table and the suite of test scripts to a test subsystem control facility to generate test results; and computer readable program code devices configured to cause a computer to effect analyzing the test results using the predetermined set of subsystem requirements to measure the conformance of the proposed set of requirements to the predetermined set of subsystem requirements.

References Cited (Backward Citations)

US5269014A Cited
US5159687A Cited
US5337320A Cited
US5526522A Cited
US5475843A Cited
US5490249A Cited
US5418793A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2001-09-21 2002-03-23 2002-09-22 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2005-09-21 2006-03-23 2006-09-22 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2009-09-21 2010-03-23 2010-09-22 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag