Patent US5701471A successfully refreshed from Google Patents.
US5701471A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System and method for testing multiple database management systems
Assignee: Oracle America Inc
•
Filing: 1995-07-05
•
Granted: 1997-12-23
•
Expires: 2015-07-05
Abstract
Abstract A database management system (DBMS) benchmark testing system for testing performance of a plurality of DBMS's stores both DBMS independent and DBMS specific files in a computer memory. The DBMS specific files include performance statistics collection procedures for each said DBMS, procedures for performing various DBMS operations for each DBMS, and environmental parameter definition files for each DBMS for specifying DBMS environmental parameters that control the configuration and operation of each DBMS. DBMS independent test scripts specify operations to be performed by specified ones of the DBMS's so as to test performance of the DBMS's, and specify performance statistics to be collected by the performance statistics collection procedures while the DBMS performs the specified operations. Test result files store benchmark test results, which include performance statistics for each benchmark test executed by the system under the control of one of the test scripts, as well as information denoting the DBMS tested, the test script used to perform the benchmark test, the operations performed by the DBMS tested, the DBMS environmental parameters for the DBMS tested. DBMS independent post test analysis procedures are used to analyze the information stored in the test result files. The system is modular and extendable, allowing the addition of new benchmark tests and/or the addition of DBMS's that utilize the DBMS independent facilities of the system.
Inventors
- 👤 Shanti Subramanyam
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-08 17:43
CPC Classifications
G; G06; G06F; G06F11/00; G06F11/30; G06F11/34; G06F11/3409; G06F11/3428; G06F16/00; Y; Y10; Y10S; Y10S707/00; Y10S707/99931
Claims Analysis
Total Claims: 9
Claim 1
Independent Claim
234 words
A database management system (DBMS) benchmark testing system for testing performance of a plurality of DBMS's, comprising: computer memory for storing said plurality of DBMS's; DBMS specific files stored in said computer memory, said DBMS specific files including: performance statistics collection procedures for each said DBMS, task performance procedures for each said DBMS for executing database query operations and other DBMS operations, and environmental parameter definition files for each DBMS for specifying DBMS environmental parameters that control the configuration and operation of said each DBMS; DBMS independent test scripts stored in said computer memory, each test script specifying operations to be performed by specified ones of said DBMS's so as to test performance of said ones of said DBMS's, and specifying performance statistics to be collected by said performance statistics collection procedures while said DBMS performs said specified operations; test result files, stored in said computer memory, for storing benchmark test results, said benchmark test results including said specified performance statistics for each benchmark test executed by said system under the control of one of said test scripts, as well as information denoting the DBMS tested, the test script used to perform the benchmark test and the operations performed by the DBMS tested, and said DBMS environmental parameters for the DBMS tested; and DBMS independent post test analysis procedures, stored in said computer memory, for analyzing the information stored in said test result files.
Claim 2
Dependent Claim
234 words
A database management system (DBMS) benchmark testing system for testing performance of a plurality of DBMS's, comprising: computer memory for storing said plurality of DBMS's; DBMS specific files stored in said computer memory, said DBMS specific files including: performance statistics collection procedures for each said DBMS, task performance procedures for each said DBMS for executing database query operations and other DBMS operations, and environmental parameter definition files for each DBMS for specifying DBMS environmental parameters that control the configuration and operation of said each DBMS; DBMS independent test scripts stored in said computer memory, each test script specifying operations to be performed by specified ones of said DBMS's so as to test performance of said ones of said DBMS's, and specifying performance statistics to be collected by said performance statistics collection procedures while said DBMS performs said specified operations; test result files, stored in said computer memory, for storing benchmark test results, said benchmark test results including said specified performance statistics for each benchmark test executed by said system under the control of one of said test scripts, as well as information denoting the DBMS tested, the test script used to perform the benchmark test and the operations performed by the DBMS tested, and said DBMS environmental parameters for the DBMS tested; and DBMS independent post test analysis procedures, stored in said computer memory, for analyzing the information stored in said test result files.
Claim 3
Dependent Claim
59 words
The database management system (DBMS) benchmark testing system of claim 1, wherein at least a plurality of said DBMS independent test scripts are each executable against a plurality of said DBMS's; and said test result files include benchmark test results resulting from execution of a single one of said DBMS independent test scripts against a plurality of said DBMS's.
Claim 4
Dependent Claim
47 words
The database management system (DBMS) benchmark testing system of claim 2, said DBMS independent post test analysis procedures including procedures for comparing the information stored in said test result files resulting from said execution of said one DBMS independent test script against said plurality of said DBMS's.
Claim 5
Independent Claim
228 words
A method of benchmark testing database management systems (DBMS's), comprising the steps of: storing in a computer memory DBMS specific files, including: performance statistics collection procedures for each said DBMS, task performance procedures for each said DBMS for executing database query operations and other DBMS operations, and environmental parameter definition files for each DBMS for specifying DBMS environmental parameters that control the configuration and operation of said each DBMS; storing in said computer memory DBMS independent test scripts, each test script specifying operations to be performed by specified ones of said DBMS's so as to test performance of said ones of said DBMS's, and specifying performance statistics to be collected by said performance statistics collection procedures while said DBMS performs said specified operations; executing user selected ones of said DBMS independent test scripts against user selected ones of said DBMS's and storing resulting benchmark test results in test result files, said benchmark test results including said specified performance statistics for each benchmark test executed by said system under the control of one of said test scripts, as well as information denoting the DBMS's tested, the test script used to perform the benchmark test and the operations performed by the DBMS tested, and said DBMS environmental parameters for the DBMS's tested; and executing DBMS independent post test analysis procedures for analyzing the information stored in said test result files.
Claim 6
Independent Claim
228 words
A method of benchmark testing database management systems (DBMS's), comprising the steps of: storing in a computer memory DBMS specific files, including: performance statistics collection procedures for each said DBMS, task performance procedures for each said DBMS for executing database query operations and other DBMS operations, and environmental parameter definition files for each DBMS for specifying DBMS environmental parameters that control the configuration and operation of said each DBMS; storing in said computer memory DBMS independent test scripts, each test script specifying operations to be performed by specified ones of said DBMS's so as to test performance of said ones of said DBMS's, and specifying performance statistics to be collected by said performance statistics collection procedures while said DBMS performs said specified operations; executing user selected ones of said DBMS independent test scripts against user selected ones of said DBMS's and storing resulting benchmark test results in test result files, said benchmark test results including said specified performance statistics for each benchmark test executed by said system under the control of one of said test scripts, as well as information denoting the DBMS's tested, the test script used to perform the benchmark test and the operations performed by the DBMS tested, and said DBMS environmental parameters for the DBMS's tested; and executing DBMS independent post test analysis procedures for analyzing the information stored in said test result files.
Claim 7
Dependent Claim
59 words
The method of claim 4, wherein at least a plurality of said DBMS independent test scripts are each executable against a plurality of said DBMS's; said test script executing step including executing a single one of said DBMS independent test scripts against a plurality of said DBMS's and storing the resulting benchmark test results in said test result files.
Claim 8
Dependent Claim
59 words
The method of claim 4, further including: adding a new test script to said system by storing in said computer memory: a new DBMS independent test script; and a test parameter template file corresponding to said new test script, said test parameter template file denoting test parameters to be specified prior to execution performance of said new test script.
Claim 9
Dependent Claim
126 words
The method of claim 4, further including: adding a new test script to said system by storing in said computer memory: a new DBMS independent test script; a test parameter template file corresponding to said new test script, said test parameter template file denoting test parameters to be specified prior to execution performance of said new test script; DBMS specific task performance procedures for each said DBMS for executing any operations required by said new test script but not supported by said DBMS specific procedures previously stored in said computer memory; and DBMS independent post test analysis procedures for performing any test result analyses associated with said new test script but not supported by said DBMS post test analysis procedures previously stored in said computer memory.
References Cited (Backward Citations)
US5471629A
Cited
US5257366A
Cited
US5604899A
Cited
US5379422A
Cited
US5412806A
Cited
US5566333A
Cited
US5561798A
Cited
US5548775A
Cited
US5561763A
Cited
US5640555A
Cited
US5511190A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-12-22 | 2001-06-23 | 2001-12-23 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-12-22 | 2005-06-23 | 2005-12-23 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-12-22 | 2009-06-23 | 2009-12-23 | $7700.00 | Window Closed / Lapsed |