US5701471A — System and method for testing multiple database m…

Claim 1

Independent Claim 234 words

A database management system (DBMS) benchmark testing system for testing performance of a plurality of DBMS's, comprising: computer memory for storing said plurality of DBMS's; DBMS specific files stored in said computer memory, said DBMS specific files including: performance statistics collection procedures for each said DBMS, task performance procedures for each said DBMS for executing database query operations and other DBMS operations, and environmental parameter definition files for each DBMS for specifying DBMS environmental parameters that control the configuration and operation of said each DBMS; DBMS independent test scripts stored in said computer memory, each test script specifying operations to be performed by specified ones of said DBMS's so as to test performance of said ones of said DBMS's, and specifying performance statistics to be collected by said performance statistics collection procedures while said DBMS performs said specified operations; test result files, stored in said computer memory, for storing benchmark test results, said benchmark test results including said specified performance statistics for each benchmark test executed by said system under the control of one of said test scripts, as well as information denoting the DBMS tested, the test script used to perform the benchmark test and the operations performed by the DBMS tested, and said DBMS environmental parameters for the DBMS tested; and DBMS independent post test analysis procedures, stored in said computer memory, for analyzing the information stored in said test result files.

Claim 2

Dependent Claim 234 words

A database management system (DBMS) benchmark testing system for testing performance of a plurality of DBMS's, comprising: computer memory for storing said plurality of DBMS's; DBMS specific files stored in said computer memory, said DBMS specific files including: performance statistics collection procedures for each said DBMS, task performance procedures for each said DBMS for executing database query operations and other DBMS operations, and environmental parameter definition files for each DBMS for specifying DBMS environmental parameters that control the configuration and operation of said each DBMS; DBMS independent test scripts stored in said computer memory, each test script specifying operations to be performed by specified ones of said DBMS's so as to test performance of said ones of said DBMS's, and specifying performance statistics to be collected by said performance statistics collection procedures while said DBMS performs said specified operations; test result files, stored in said computer memory, for storing benchmark test results, said benchmark test results including said specified performance statistics for each benchmark test executed by said system under the control of one of said test scripts, as well as information denoting the DBMS tested, the test script used to perform the benchmark test and the operations performed by the DBMS tested, and said DBMS environmental parameters for the DBMS tested; and DBMS independent post test analysis procedures, stored in said computer memory, for analyzing the information stored in said test result files.

Claim 3

Dependent Claim 59 words

The database management system (DBMS) benchmark testing system of claim 1, wherein at least a plurality of said DBMS independent test scripts are each executable against a plurality of said DBMS's; and said test result files include benchmark test results resulting from execution of a single one of said DBMS independent test scripts against a plurality of said DBMS's.

Claim 4

Dependent Claim 47 words

The database management system (DBMS) benchmark testing system of claim 2, said DBMS independent post test analysis procedures including procedures for comparing the information stored in said test result files resulting from said execution of said one DBMS independent test script against said plurality of said DBMS's.

Claim 5

Independent Claim 228 words

A method of benchmark testing database management systems (DBMS's), comprising the steps of: storing in a computer memory DBMS specific files, including: performance statistics collection procedures for each said DBMS, task performance procedures for each said DBMS for executing database query operations and other DBMS operations, and environmental parameter definition files for each DBMS for specifying DBMS environmental parameters that control the configuration and operation of said each DBMS; storing in said computer memory DBMS independent test scripts, each test script specifying operations to be performed by specified ones of said DBMS's so as to test performance of said ones of said DBMS's, and specifying performance statistics to be collected by said performance statistics collection procedures while said DBMS performs said specified operations; executing user selected ones of said DBMS independent test scripts against user selected ones of said DBMS's and storing resulting benchmark test results in test result files, said benchmark test results including said specified performance statistics for each benchmark test executed by said system under the control of one of said test scripts, as well as information denoting the DBMS's tested, the test script used to perform the benchmark test and the operations performed by the DBMS tested, and said DBMS environmental parameters for the DBMS's tested; and executing DBMS independent post test analysis procedures for analyzing the information stored in said test result files.

Claim 6

Independent Claim 228 words

A method of benchmark testing database management systems (DBMS's), comprising the steps of: storing in a computer memory DBMS specific files, including: performance statistics collection procedures for each said DBMS, task performance procedures for each said DBMS for executing database query operations and other DBMS operations, and environmental parameter definition files for each DBMS for specifying DBMS environmental parameters that control the configuration and operation of said each DBMS; storing in said computer memory DBMS independent test scripts, each test script specifying operations to be performed by specified ones of said DBMS's so as to test performance of said ones of said DBMS's, and specifying performance statistics to be collected by said performance statistics collection procedures while said DBMS performs said specified operations; executing user selected ones of said DBMS independent test scripts against user selected ones of said DBMS's and storing resulting benchmark test results in test result files, said benchmark test results including said specified performance statistics for each benchmark test executed by said system under the control of one of said test scripts, as well as information denoting the DBMS's tested, the test script used to perform the benchmark test and the operations performed by the DBMS tested, and said DBMS environmental parameters for the DBMS's tested; and executing DBMS independent post test analysis procedures for analyzing the information stored in said test result files.

Claim 7

Dependent Claim 59 words

The method of claim 4, wherein at least a plurality of said DBMS independent test scripts are each executable against a plurality of said DBMS's; said test script executing step including executing a single one of said DBMS independent test scripts against a plurality of said DBMS's and storing the resulting benchmark test results in said test result files.

Claim 8

Dependent Claim 59 words

The method of claim 4, further including: adding a new test script to said system by storing in said computer memory: a new DBMS independent test script; and a test parameter template file corresponding to said new test script, said test parameter template file denoting test parameters to be specified prior to execution performance of said new test script.

Claim 9

Dependent Claim 126 words

The method of claim 4, further including: adding a new test script to said system by storing in said computer memory: a new DBMS independent test script; a test parameter template file corresponding to said new test script, said test parameter template file denoting test parameters to be specified prior to execution performance of said new test script; DBMS specific task performance procedures for each said DBMS for executing any operations required by said new test script but not supported by said DBMS specific procedures previously stored in said computer memory; and DBMS independent post test analysis procedures for performing any test result analyses associated with said new test script but not supported by said DBMS post test analysis procedures previously stored in said computer memory.

Annuity Stage	Window Opens	Payment Deadline	Surcharge Period Until	Estimated Fee	Status
3.5 Years (Year 4)	2000-12-22	2001-06-23	2001-12-23	$2000.00	Window Closed / Lapsed
7.5 Years (Year 8)	2004-12-22	2005-06-23	2005-12-23	$3760.00	Window Closed / Lapsed
11.5 Years (Year 12)	2008-12-22	2009-06-23	2009-12-23	$7700.00	Window Closed / Lapsed

System and method for testing multiple database management systems

Abstract

Inventors

Bibliographic Details

Claims Analysis

References Cited (Backward Citations)

USPTO Annuity & Maintenance Windows

Assigned Categories & Tags

Assign Category Tag