US5675731A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Scatter load for system test
Assignee: Sun Microsystems Inc
•
Filing: 1995-09-22
•
Granted: 1997-10-07
•
Expires: 2015-09-22
Abstract
Abstract Software systems such as file systems in a computer are tested by scatter load testing. Scatter load testing is accomplished by the computer system applying randomly selected operative test situations to the software system. The operative test situations are randomized by the computer randomly selecting a geometry, or configuration, for the software system under test and randomly selecting a workload on the selected software system configuration. The randomization of workload selection can be further enhanced by expanding the workload to one or more tasks and randomly selecting objects, actions and parameters that make up each workload task to be performed during the test. As the random operative situation is run on the system, operation test results are output from the computer to indicate the performance of the software system being tested. Choice constraints may be placed on the random selection of the various test elements of the operative test situation. Each choice of software system configuration, workload, and operations and parameters within a workload task may be compared against constraints for these test elements. Thus, the testing may be constrained to randomly select only operative test situations that are useful and effective test situations within a test sub-domain of a larger test domain containing all possible operative test situations.
Inventors
- 👤 Billy J. Fuller
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 08:00
CPC Classifications
G; G06; G06F; G06F11/00; G06F11/36; G06F11/3668; G06F11/3672; G06F11/3688; G06F11/3684
Claims Analysis
Total Claims: 39
Claim 1
Independent Claim
143 words
In a computer having a software system, a method for scatter load testing the software system in test subdomains inside a test domain containing all possible configurations and operative test situations for the software system, said method comprising the computer implemented steps of: (A) generating a random geometry for the software system to produce a software system configuration for testing; (B) generating a random workload for the software system configuration, said random workload and said software system configuration together defining an operative test situation; (C) running the random workload on the software system configuration and providing a test result output for each operative test situation; (D) detecting whether the operative test situation is within test constraints defining a test subdomain with the test domain; and (E) repeating step (B) if step (D) detects the operative test situation is not within the test constraints.
Claim 2
Dependent Claim
143 words
In a computer having a software system, a method for scatter load testing the software system in test subdomains inside a test domain containing all possible configurations and operative test situations for the software system, said method comprising the computer implemented steps of: (A) generating a random geometry for the software system to produce a software system configuration for testing; (B) generating a random workload for the software system configuration, said random workload and said software system configuration together defining an operative test situation; (C) running the random workload on the software system configuration and providing a test result output for each operative test situation; (D) detecting whether the operative test situation is within test constraints defining a test subdomain with the test domain; and (E) repeating step (B) if step (D) detects the operative test situation is not within the test constraints.
Claim 3
Dependent Claim
50 words
The method of claim 1 and in addition the steps of: (F) detecting whether the software system configuration is within configuration test constraints further defining the test subdomain within the test domain; (G) repeating step (A) if step (F) detects the software system configuration is not within configuration test constraints.
Claim 4
Dependent Claim
25 words
The method of claim 1 wherein step (B) further comprises the step of: (H) selecting a random set of workload operations as the random workload.
Claim 5
Dependent Claim
49 words
The method of claim 2 and in addition the steps of: (I) detecting whether the random workload is within operative test constraints further defining the test subdomain within the test domain; (J) repeating step (B) if step (I) detects the random workload is not within the operative test constraints.
Claim 6
Dependent Claim
128 words
In a computer having a software system, a method for scatter load testing the software system, said method comprising the computer implemented steps of: (A) generating a random geometry for the software system to produce a software system configuration for testing; (B) generating a random workload for the software system configuration, said random workload and said software system configuration together defining an operative test situation; (C) running the random workload on the software system configuration and providing a test result output for each operative test situation; (D) choosing a random number "m" of tasks to be performed by the selected software system configuration; (E) choosing a random number "n" of operations to be performed per task; and (F) selecting a random set of "n" operations for each task.
Claim 7
Dependent Claim
128 words
In a computer having a software system, a method for scatter load testing the software system, said method comprising the computer implemented steps of: (A) generating a random geometry for the software system to produce a software system configuration for testing; (B) generating a random workload for the software system configuration, said random workload and said software system configuration together defining an operative test situation; (C) running the random workload on the software system configuration and providing a test result output for each operative test situation; (D) choosing a random number "m" of tasks to be performed by the selected software system configuration; (E) choosing a random number "n" of operations to be performed per task; and (F) selecting a random set of "n" operations for each task.
Claim 8
Dependent Claim
45 words
The method of claim 5 wherein step (F) comprises the steps of: (G) selecting a random operation to be performed by the selected software system configuration; (H) executing the random operation; and (I) repeating steps (G) and (H) until step (H) has run "n" operations.
Claim 9
Dependent Claim
58 words
The method of claim 6 wherein step (G) comprises the steps of: (J) selecting a file system object; (K) selecting an action to be performed on the file system object; (L) selecting action parameters for the action to be performed on the file system object to complete selection of a random operation; and (M) issuing the random operation.
Claim 10
Dependent Claim
48 words
The method of claim 7 and in addition the steps of: (N) prior to step (M), detecting whether the random operation is within predetermined test constraints; (O) repeating said steps (J), (K) and (L) until said detecting step detects the workload operation is within the predetermined test constraints.
Claim 11
Dependent Claim
176 words
In a computer having a software system, a method for scatter load testing the software system, said method comprising the computer implemented steps of: (A) generating a random geometry for the software system to produce a software system configuration for testing; (B) generating a random workload for the software system configuration, said random workload and said software system configuration together defining an operative test situation; (C) running the random workload on the software system configuration and providing a test result output for each operative test situation; and said step (A) comprises the steps of: (D) setting parameters for the software system configuration to a random set of parameters; (E) detecting whether the random set of parameters is within test constraints; (F) building the software system configuration from the random set of parameters if step (E) detects the disk parameters are within test constraints; (G) if step (E) detects the random set of parameters is not within test constraints, repeating steps (D) and (E) until step (E) detects a random set of parameters is within test constraints.
Claim 12
Dependent Claim
176 words
In a computer having a software system, a method for scatter load testing the software system, said method comprising the computer implemented steps of: (A) generating a random geometry for the software system to produce a software system configuration for testing; (B) generating a random workload for the software system configuration, said random workload and said software system configuration together defining an operative test situation; (C) running the random workload on the software system configuration and providing a test result output for each operative test situation; and said step (A) comprises the steps of: (D) setting parameters for the software system configuration to a random set of parameters; (E) detecting whether the random set of parameters is within test constraints; (F) building the software system configuration from the random set of parameters if step (E) detects the disk parameters are within test constraints; (G) if step (E) detects the random set of parameters is not within test constraints, repeating steps (D) and (E) until step (E) detects a random set of parameters is within test constraints.
Claim 13
Dependent Claim
172 words
Apparatus for scatter load testing a file system in a computer with random workloads, the computer having a processor, a keyboard, and a plurality of data storage devices, said file system operating the processor and controlling the plurality of data storage devices, said processor having a central processing unit, memory and input/output control, said input/output control connected to the keyboard and data storage devices, said apparatus comprising: random test generating module for randomly generating a file system configuration and a plurality of operative tasks for the file system configuration as a test workload for the file system; test run module for running the plurality of operative tasks in parallel on the file system configuration as the test workload for the file system; said random test generating module repeatedly generating test workloads and said test run module running the test workloads as they are generated in order to scatter load the file system with a random distribution of test workloads over a test domain of all possible test workloads for the file system.
Claim 14
Dependent Claim
172 words
Apparatus for scatter load testing a file system in a computer with random workloads, the computer having a processor, a keyboard, and a plurality of data storage devices, said file system operating the processor and controlling the plurality of data storage devices, said processor having a central processing unit, memory and input/output control, said input/output control connected to the keyboard and data storage devices, said apparatus comprising: random test generating module for randomly generating a file system configuration and a plurality of operative tasks for the file system configuration as a test workload for the file system; test run module for running the plurality of operative tasks in parallel on the file system configuration as the test workload for the file system; said random test generating module repeatedly generating test workloads and said test run module running the test workloads as they are generated in order to scatter load the file system with a random distribution of test workloads over a test domain of all possible test workloads for the file system.
Claim 15
Dependent Claim
79 words
The apparatus of claim 10 and in addition: a detector for detecting whether each operative task generated by said random test generating module is within predetermined test constraints; said random test generating module responsive to said detector for generating a replacement operative task for each operative task that said detector detects is not within test constraints whereby the test workloads are distributed over test sub-domains including only a predetermined portion of all possible test workloads for the file system.
Claim 16
Dependent Claim
57 words
The apparatus of claim 10 said random test generating module further comprises: a configuration detector for detecting whether the file system configuration is within predetermined test constraints; a configuration generating module responsive to said detector for generating a replacement file system configuration for each file system configuration that said configuration detector detects is not within test constraints.
Claim 17
Dependent Claim
36 words
The apparatus of claim 12 wherein said random test generating module further comprises: a set selector module for selecting a random set of operative tasks to run on the file system configuration as the test workload.
Claim 18
Dependent Claim
60 words
The apparatus of claim 13 and in addition: operative task detector for detecting whether the random set is within test constraints and providing a set failure indicator if said operative task detector detects the random set is not within test constraints; said set selector module responsive to said set failure indicator for selecting a new random set of operative tasks.
Claim 19
Dependent Claim
49 words
The apparatus of claim 10 wherein said random test generating module further comprises: a task selector for choosing a random number "m" of tasks to be performed by the file system configuration; and a operation selector for choosing a random number "n" of operations to be performed per task.
Claim 20
Dependent Claim
84 words
The apparatus of claim 15 wherein said test run module further comprises: "m" action selector modules, each action selector module for selecting "n" random actions to be performed on the file system configuration; "m" execution modules, an execution module cooperating with each action selector module for running "n" random actions on the file system configuration as one task; and test workload detector for detecting when all "m" execution modules have completed running each of the "n" random actions and thereafter indicating test workload complete.
Claim 21
Dependent Claim
183 words
A computer program storage medium readable by a computing system and encoding a program of instructions for executing a computer process for scatter load testing in a computer a software system, said scatter load testing being performed in test subdomains inside a test domain containing all possible configurations and operative test situations for the software system, said computer process comprising the steps of: randomly generating a configuration for the software system to produce a software system configuration for testing; randomly choosing a workload for the software system configuration, the workload and the software system configuration together defining an operative test situation; detecting whether the operative test situation is within predetermined test constraints defining the test subdomain within the test domain; repeating at least one from the group of steps comprising said randomly generating step and said randomly choosing step until said detecting step detects the operative test situation is within the predetermined test constraints defining the test subdomain; and running the operative test situation when said detecting step detects the operative test situation is within the predetermined test constraints defining the test subdomain.
Claim 22
Dependent Claim
183 words
A computer program storage medium readable by a computing system and encoding a program of instructions for executing a computer process for scatter load testing in a computer a software system, said scatter load testing being performed in test subdomains inside a test domain containing all possible configurations and operative test situations for the software system, said computer process comprising the steps of: randomly generating a configuration for the software system to produce a software system configuration for testing; randomly choosing a workload for the software system configuration, the workload and the software system configuration together defining an operative test situation; detecting whether the operative test situation is within predetermined test constraints defining the test subdomain within the test domain; repeating at least one from the group of steps comprising said randomly generating step and said randomly choosing step until said detecting step detects the operative test situation is within the predetermined test constraints defining the test subdomain; and running the operative test situation when said detecting step detects the operative test situation is within the predetermined test constraints defining the test subdomain.
Claim 23
Dependent Claim
75 words
The computer program storage medium of claim 17 wherein said computer process further comprises the steps of: randomly selecting a plurality of workload operations as the workload in the operative test situation; and repeating at least one from the group of steps comprising said randomly generating step, said randomly choosing step and said randomly selecting step, until said detecting step detects the operative test situation is within the predetermined test constraints defining the test subdomain.
Claim 24
Dependent Claim
146 words
A computer program storage medium readable by a computing system and encoding a program of instructions for executing a computer process for scatter load testing a software system in a computer, said computer process comprising the steps of: randomly generating a configuration for the software system to produce a software system configuration for testing; randomly choosing a workload for the software system configuration, the workload and the software system configuration together defining an operative test situation; randomly selecting a plurality of workload operations as the workload; running each workload operation on the software system configuration after each workload operation is selected by said selecting step; and said step of randomly choosing a workload comprises the steps of: first choosing a random number of tasks to be performed by the selected software system configuration; and second choosing a random number of operations to be performed per task.
Claim 25
Dependent Claim
146 words
A computer program storage medium readable by a computing system and encoding a program of instructions for executing a computer process for scatter load testing a software system in a computer, said computer process comprising the steps of: randomly generating a configuration for the software system to produce a software system configuration for testing; randomly choosing a workload for the software system configuration, the workload and the software system configuration together defining an operative test situation; randomly selecting a plurality of workload operations as the workload; running each workload operation on the software system configuration after each workload operation is selected by said selecting step; and said step of randomly choosing a workload comprises the steps of: first choosing a random number of tasks to be performed by the selected software system configuration; and second choosing a random number of operations to be performed per task.
Claim 26
Dependent Claim
51 words
The computer program storage medium of claim 19 wherein said computer process further comprises the steps of: detecting whether the workload is within predetermined test constraints; repeating said first choosing step and said second choosing step until said detecting step detects the operative test situation is within the predetermined test constraints.
Claim 27
Dependent Claim
194 words
A computer program storage medium readable by a computing system and encoding a program of instructions for executing a computer process for scatter load testing a software system in a computer, said computer process comprising the steps of: randomly generating a configuration for the software system to produce a software system configuration for testing; randomly choosing a workload for the software system configuration, the workload and the software system configuration together defining an operative test situation; randomly selecting a plurality of workload operations as the workload; running each workload operation on the software system configuration after each workload operation is selected by said selecting step; and said step of randomly generating a software system configuration comprises the steps of: setting parameters for the software system configuration to a random set of parameters; detecting whether the random set of parameters is within test constraints; building the software system configuration from the random set of parameters if said detecting step detects the parameters are within test constraints; if said detecting step detects the random set of parameters is not within test constraints, repeating said setting step until the random set of parameters is within test constraints.
Claim 28
Dependent Claim
194 words
A computer program storage medium readable by a computing system and encoding a program of instructions for executing a computer process for scatter load testing a software system in a computer, said computer process comprising the steps of: randomly generating a configuration for the software system to produce a software system configuration for testing; randomly choosing a workload for the software system configuration, the workload and the software system configuration together defining an operative test situation; randomly selecting a plurality of workload operations as the workload; running each workload operation on the software system configuration after each workload operation is selected by said selecting step; and said step of randomly generating a software system configuration comprises the steps of: setting parameters for the software system configuration to a random set of parameters; detecting whether the random set of parameters is within test constraints; building the software system configuration from the random set of parameters if said detecting step detects the parameters are within test constraints; if said detecting step detects the random set of parameters is not within test constraints, repeating said setting step until the random set of parameters is within test constraints.
Claim 29
Dependent Claim
184 words
A computer program storage medium readable by a computing system and encoding a program of instructions for executing a computer process for scatter load testing a software system in a computer, said computer process comprising the steps of: randomly generating a configuration for the software system to produce a software system configuration for testing; randomly choosing a workload for the software system configuration, the workload and the software system configuration together defining an operative test situation; randomly selecting a plurality of workload operations as the workload; running each workload operation on the software system configuration after each workload operation is selected by said selecting step; and said step of randomly selecting a plurality of workload operations comprises the steps of: first selecting a software system object; second selecting an action to be performed on the software system object; third selecting action parameters for the action to be performed on the software system object to complete selection of a workload operation; issuing the workload operation; and repeating said first, second and third selecting steps and said issuing step to issue a plurality of workload operations.
Claim 30
Dependent Claim
184 words
A computer program storage medium readable by a computing system and encoding a program of instructions for executing a computer process for scatter load testing a software system in a computer, said computer process comprising the steps of: randomly generating a configuration for the software system to produce a software system configuration for testing; randomly choosing a workload for the software system configuration, the workload and the software system configuration together defining an operative test situation; randomly selecting a plurality of workload operations as the workload; running each workload operation on the software system configuration after each workload operation is selected by said selecting step; and said step of randomly selecting a plurality of workload operations comprises the steps of: first selecting a software system object; second selecting an action to be performed on the software system object; third selecting action parameters for the action to be performed on the software system object to complete selection of a workload operation; issuing the workload operation; and repeating said first, second and third selecting steps and said issuing step to issue a plurality of workload operations.
Claim 31
Dependent Claim
60 words
The computer program storage medium of claim 22 wherein said computer process further comprises the steps of: prior to said issuing step, detecting whether the workload operation is within predetermined test constraints; repeating said first selecting step, said second selecting step and said third selecting step until said detecting step detects the workload operation is within the predetermined test constraints.
Claim 32
Independent Claim
169 words
A method for scatter load testing a file system in a computer with random workloads, the computer having a processor, a keyboard, and a plurality of data storage devices, said file system operating the processor and controlling the plurality of data storage devices, said processor having a central processing unit, memory and input/output control, said input/output control connected to the keyboard and data storage devices, said method comprising the computer implemented steps of: randomly generating a file system configuration and a plurality of operative tasks for the file system configuration as a test workload for the file system; test running the plurality of operative tasks in parallel on the file system configuration as the test workload for the file system; said randomly generating step repeatedly generating test workloads and said test running step running the test workloads as they are generated in order to scatter load the file system with a random distribution of test workloads over a test domain of all possible test workloads for the file system.
Claim 33
Independent Claim
169 words
A method for scatter load testing a file system in a computer with random workloads, the computer having a processor, a keyboard, and a plurality of data storage devices, said file system operating the processor and controlling the plurality of data storage devices, said processor having a central processing unit, memory and input/output control, said input/output control connected to the keyboard and data storage devices, said method comprising the computer implemented steps of: randomly generating a file system configuration and a plurality of operative tasks for the file system configuration as a test workload for the file system; test running the plurality of operative tasks in parallel on the file system configuration as the test workload for the file system; said randomly generating step repeatedly generating test workloads and said test running step running the test workloads as they are generated in order to scatter load the file system with a random distribution of test workloads over a test domain of all possible test workloads for the file system.
Claim 34
Dependent Claim
78 words
The method of claim 24 further comprising the steps of: detecting whether each operative task generated by said randomly generating step is within predetermined test constraints; said randomly generating step responsive to said detecting step and generating a replacement operative task for each operative task that said detecting step detects is not within test constraints whereby the test workloads are distributed over test sub-domains including only a predetermined portion of all possible test workloads for the file system.
Claim 35
Dependent Claim
60 words
The method of claim 24 wherein said randomly generating step further comprises: a configuration detecting step detecting whether the file system configuration is within predetermined test constraints; a configuration generating step responsive to said configuration detecting step for generating a replacement file system configuration for each file system configuration that said configuration detecting step detects is not within test constraints.
Claim 36
Dependent Claim
30 words
The method of claim 26 wherein said randomly generating step further comprises: selecting a random set of operative tasks to run on the file system configuration as the test workload.
Claim 37
Dependent Claim
63 words
The method of claim 27 further comprising the steps of: an operative task detecting step detecting whether the random set is within test constraints and providing a set failure indicator if said operative task detecting step detects the random set is not within test constraints; said selecting step responsive to said set failure indicator for selecting a new random set of operative tasks.
Claim 38
Dependent Claim
51 words
The method of claim 24 wherein said randomly generating step further comprises the steps of: a task selecting step choosing a random number "m" of tasks to be performed by the file system configuration; and an operation selecting step choosing a random number "n" of operations to be performed per task.
Claim 39
Dependent Claim
88 words
The method of claim 29 wherein said test running step further comprises the steps of: "m" action selecting steps, each action selecting step selecting "n" random actions to be performed on the file system configuration; "m" executing steps, an executing step cooperating with each action selecting step for running "n" random actions on the file system configuration as one task; and a test workload detecting step for detecting when all "m" executing steps have completed running each of the "n" random actions and thereafter indicating test workload complete.
References Cited (Backward Citations)
US5485610A
Cited
US5440697A
Cited
US5513315A
Cited
US5390325A
Cited
US5414836A
Cited
US5500941A
Cited
US5542043A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-10-06 | 2001-04-07 | 2001-10-07 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-10-06 | 2005-04-07 | 2005-10-07 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-10-06 | 2009-04-07 | 2009-10-07 | $7700.00 | Window Closed / Lapsed |