Claims Analysis
Total Claims: 42
Claim 1
Independent Claim
85 words
An apparatus for performing a test on software in a computer system, wherein said computer system has an initial environment, the apparatus comprising: a storage device containing a test base, wherein the test base includes a plurality of directories connected to form a hierarchical directory structure, the plurality of directories including a test directory corresponding to said test; a processor coupled to said storage device; a test engine executing on said processor; and a plurality of environment configuration files stored in said plurality of directories.
Claim 2
Independent Claim
85 words
An apparatus for performing a test on software in a computer system, wherein said computer system has an initial environment, the apparatus comprising: a storage device containing a test base, wherein the test base includes a plurality of directories connected to form a hierarchical directory structure, the plurality of directories including a test directory corresponding to said test; a processor coupled to said storage device; a test engine executing on said processor; and a plurality of environment configuration files stored in said plurality of directories.
Claim 3
Dependent Claim
40 words
The apparatus of claim 1 wherein said test engine determines which environment configuration files of said plurality of environment configuration files are applicable environment configuration files, wherein applicable environment configuration files are environment configuration files that apply to said test.
Claim 4
Dependent Claim
36 words
The apparatus of claim 2 wherein said test engine determines said applicable environment configuration files based on where said plurality of environment configuration files are stored in said plurality of directories relative to said test directory.
Claim 5
Dependent Claim
25 words
The apparatus of claim 2 wherein said test engine modifies said initial environment to create a modified environment based on said applicable environment configuration files.
Claim 6
Dependent Claim
19 words
The apparatus of claim 4 wherein said test engine causes said software to be tested in said modified environment.
Claim 7
Dependent Claim
23 words
The apparatus of claim 4 wherein: said software is defined in source code; and said source code is located in said test directory.
Claim 8
Dependent Claim
43 words
The apparatus of claim 6 wherein: said applicable environment configuration files specify compile options for compiling said source code; and said test engine causes said source code to be compiled according to said compile options prior to causing said software to be tested.
Claim 9
Dependent Claim
31 words
The apparatus of claim 4 wherein said test engine modifies said initial environment based on an environment file prior to modifying said initial environment based on said applicable environment configuration files.
Claim 10
Dependent Claim
41 words
The apparatus of claim 2 wherein said test engine determines any environment configuration files located in said test directory and in directories of said plurality of directories that are ancestors of said test directory to be said applicable environment configuration files.
Claim 11
Dependent Claim
120 words
The apparatus of claim 2 wherein: said applicable environment configuration files include a first environment configuration file located in a first directory of said plurality of directories and a second environment configuration file located in a second directory of said plurality of directories; said first environment configuration file specifies a first value for an environment variable; said second environment configuration file specifies a second value for said environment variable; said test engine causes said environment variable to be set to said first value if said first directory is a descendent of said second directory; and said test engine causes said environment variable to be set to said second value if said second directory is a descendent of said first directory.
Claim 12
Independent Claim
129 words
A method for performing a test on software in a specified environment in a computer system, the computer system including a storage device containing a test base, the test base including a plurality of directories connected to form a hierarchical directory structure, wherein a first directory of said plurality of directories corresponds to said test, wherein a plurality of environment configuration files are stored in said plurality of directories, the method comprising the steps of: determining which of said plurality of environment configuration files are applicable environment configuration files based on where said plurality of environment configuration files are located in said hierarchical directory structure relative to said first directory; creating said specified environment based on said applicable environment configuration files; and testing said software in said specified environment.
Claim 13
Independent Claim
129 words
A method for performing a test on software in a specified environment in a computer system, the computer system including a storage device containing a test base, the test base including a plurality of directories connected to form a hierarchical directory structure, wherein a first directory of said plurality of directories corresponds to said test, wherein a plurality of environment configuration files are stored in said plurality of directories, the method comprising the steps of: determining which of said plurality of environment configuration files are applicable environment configuration files based on where said plurality of environment configuration files are located in said hierarchical directory structure relative to said first directory; creating said specified environment based on said applicable environment configuration files; and testing said software in said specified environment.
Claim 14
Dependent Claim
47 words
The method of claim 11 wherein: source code defining said software is stored in said first directory; said applicable environment configuration files specify compile parameters for compiling said source code; and said step of testing said software includes compiling said source code according to said compile parameters.
Claim 15
Dependent Claim
41 words
The method of claim 11 further comprising the step of modifying an initial environment of said computer system according to a specified environment file prior to performing said step of creating said specified environment based on said applicable environment configuration files.
Claim 16
Dependent Claim
144 words
The method of claim 11 wherein said plurality of directories includes a second directory corresponding to a second test, wherein said second directory is neither an ancestor of nor a descendent of said first directory, wherein the method further comprises performing the following steps prior to performing said steps of determining, creating and testing: storing said applicable environment configuration files that apply to both said test and said second test in one or more common ancestor directories, wherein said one or more common ancestor directories are directories of said plurality of directories that are ancestors of both said first directory and said second directory; and storing said applicable environment configuration files that apply to said test but not to said second test in either said first directory or in an ancestor of said first directory that is not an ancestor of said second directory.
Claim 17
Dependent Claim
35 words
The method of claim 14 further comprising the steps of: storing source code defining said software in said first directory; storing source code defining a second software for said second test in said second directory.
Claim 18
Dependent Claim
48 words
The method of claim 14 further comprising the step of storing an environment configuration file that applies to said second test but not said first test in either said second directory or in an ancestor of said second directory that is not an ancestor of said first directory.
Claim 19
Independent Claim
202 words
A method for performing a test on software using a test base on a computer-readable storage device, the method comprising the computer-implemented steps of: creating a plurality of directories on said computer-readable storage device, wherein said plurality of directories are connected to form a hierarchical directory structure, wherein a first directory of said plurality of directories corresponds to a first test and a second directory of said plurality of directories corresponds to a second test; storing a plurality of environment configuration files in said plurality of directories, wherein said environment configuration files include a first set of environment configuration files that apply to said first test but not said second test, a second set of environment configuration files that apply to said second test but not said first test, and a third set of environment configuration files that apply to both said first test and said second test; and performing a test on software using said plurality of directories and said plurality of environment configuration files, said performing step further including a step of determining which of said plurality of environment configuration files are applicable to said test based on a location of said environment configuration files in said plurality of directories.
Claim 20
Independent Claim
202 words
A method for performing a test on software using a test base on a computer-readable storage device, the method comprising the computer-implemented steps of: creating a plurality of directories on said computer-readable storage device, wherein said plurality of directories are connected to form a hierarchical directory structure, wherein a first directory of said plurality of directories corresponds to a first test and a second directory of said plurality of directories corresponds to a second test; storing a plurality of environment configuration files in said plurality of directories, wherein said environment configuration files include a first set of environment configuration files that apply to said first test but not said second test, a second set of environment configuration files that apply to said second test but not said first test, and a third set of environment configuration files that apply to both said first test and said second test; and performing a test on software using said plurality of directories and said plurality of environment configuration files, said performing step further including a step of determining which of said plurality of environment configuration files are applicable to said test based on a location of said environment configuration files in said plurality of directories.
Claim 21
Dependent Claim
133 words
The method of claim 17 wherein said step of storing said plurality of environment configuration files includes the steps of: storing the environment configuration files of said first set of environment configuration files in either said first directory or in directories of said plurality of directories that are ancestors of said first directory but not ancestors of said second directory; storing the environment configuration files of said second set of environment configuration files in either said second directory or in directories of said plurality of directories that are ancestors of said second directory but not ancestors of said first directory; and storing the environment configuration files of said third set of environment configuration files in directories of said plurality of directories that are ancestors of both said first directory and said second directory.
Claim 22
Dependent Claim
57 words
The method of claim 18 wherein said first test includes testing a first software program, wherein said second test includes testing a second software program, the method further comprising the steps of: storing source code defining said first software program in said first directory; and storing source code defining said second software program in said second directory.
Claim 23
Dependent Claim
97 words
The method of claim 19 further comprising the steps of: storing in said first directory a file containing input to be sent to said first software program during said first test; storing in said first directory a file containing expected output to be generated by said first software program during said first test; storing in said second directory a file containing input to be sent to said second software program during said second test; and storing in said second directory a file containing expected output to be generated by said second software program during said second test.
Claim 24
Dependent Claim
43 words
The method of claim 18 further comprising the step of storing environment files in said plurality of directories, wherein said environment files are stored in one or more directories that are neither ancestors nor descendants of said first directory or said second directory.
Claim 25
Independent Claim
227 words
A method for performing a second series of tests on a plurality of software programs based on results of a first series of tests performed on said plurality of software programs, the method comprising the computer implemented steps of: performing said first series of tests, wherein each test of said first series of tests is performed on a specified software/environment combination, wherein each software/environment combination includes a specified software program of said plurality of software programs and a specified environment of a plurality of predefined environments; storing on a storage device result data indicating results of said first series of tests, said result data including data indicating whether a most recent performance of each test of said first series of tests was successful; reading said result data from said storage device; generating a test list based on said result data, wherein said test list includes an ordered list of entries, wherein each entry of said test list represents a test performed in said first series of tests, wherein each entry in said list of entries is ordered based on the outcome of the test represented by said entry during said first series of tests; and performing said second series of tests based on said test list, wherein the tests represented in said test list are performed in the order of their corresponding entries in the test list.
Claim 26
Independent Claim
227 words
A method for performing a second series of tests on a plurality of software programs based on results of a first series of tests performed on said plurality of software programs, the method comprising the computer implemented steps of: performing said first series of tests, wherein each test of said first series of tests is performed on a specified software/environment combination, wherein each software/environment combination includes a specified software program of said plurality of software programs and a specified environment of a plurality of predefined environments; storing on a storage device result data indicating results of said first series of tests, said result data including data indicating whether a most recent performance of each test of said first series of tests was successful; reading said result data from said storage device; generating a test list based on said result data, wherein said test list includes an ordered list of entries, wherein each entry of said test list represents a test performed in said first series of tests, wherein each entry in said list of entries is ordered based on the outcome of the test represented by said entry during said first series of tests; and performing said second series of tests based on said test list, wherein the tests represented in said test list are performed in the order of their corresponding entries in the test list.
Claim 27
Dependent Claim
23 words
The method of claim 22 further comprising the step of updating said result data to reflect results of said second series of tests.
Claim 28
Dependent Claim
51 words
The method of claim 22 wherein said step of storing on said storage device result data includes the step of, for each test of said first series of tests, storing data indicating how many consecutive performances of said test were successful if said most recent performance of said test was successful.
Claim 29
Dependent Claim
67 words
The method of claim 24 wherein said step of performing said second series of tests includes performing the step of: for each entry in said list of entries assigning values to a plurality of environment variables according to the specified environment corresponding to said entry; and executing routines corresponding to one or more test blocks identified in a particular environment variable of said plurality of environment variables.
Claim 30
Dependent Claim
62 words
The method of claim 22 wherein said step of generating said test list includes the step of placing entries for a first set of tests before entries for a second set of tests, wherein said first set of tests are tests whose most recent performance was not successful, wherein said second set of tests are tests whose most recent performance was successful.
Claim 31
Dependent Claim
22 words
The method of claim 22 wherein said step of performing said second series of tests includes spawning a plurality of test processes.
Claim 32
Dependent Claim
27 words
The method of claim 27 wherein said step of performing said second series of tests includes distributing said plurality of test processes to a plurality of processors.
Claim 33
Dependent Claim
35 words
The method of claim 28 wherein said step of distributing said plurality of test processes to said plurality of processors includes distributing said plurality of test processes to processors identified in a particular environment variable.
Claim 34
Independent Claim
221 words
A method for selecting a subset of tests to run on software programs, wherein said subset of tests are a subset of a plurality of tests, the method comprising the steps of: A) establishing a mapping between said plurality of tests and a plurality of directories within a hierarchical directory structure on a storage device, wherein each test of said plurality of tests is mapped to at least one of said plurality of directories; B) for each given directory within said hierarchical directory that is mapped to one or more of said plurality of tests, performing the steps of: B1) generating attribute data that specifies attributes associated with said one or more of said plurality of tests; B2) storing said attribute data in said given directory; C) receiving input indicating a selected directory of said plurality of directories and a selected attribute; D) determining whether any tests mapped to said selected directory are associated with said selected attribute; E) including any tests mapped to said selected directory that are associated with said selected attribute in said subset of tests to run; F) determining whether any tests mapped to said child directories are associated with said selected attribute; and G) including any tests mapped to said child directories that are associated with said selected attribute in said subset of tests to run.
Claim 35
Independent Claim
221 words
A method for selecting a subset of tests to run on software programs, wherein said subset of tests are a subset of a plurality of tests, the method comprising the steps of: A) establishing a mapping between said plurality of tests and a plurality of directories within a hierarchical directory structure on a storage device, wherein each test of said plurality of tests is mapped to at least one of said plurality of directories; B) for each given directory within said hierarchical directory that is mapped to one or more of said plurality of tests, performing the steps of: B1) generating attribute data that specifies attributes associated with said one or more of said plurality of tests; B2) storing said attribute data in said given directory; C) receiving input indicating a selected directory of said plurality of directories and a selected attribute; D) determining whether any tests mapped to said selected directory are associated with said selected attribute; E) including any tests mapped to said selected directory that are associated with said selected attribute in said subset of tests to run; F) determining whether any tests mapped to said child directories are associated with said selected attribute; and G) including any tests mapped to said child directories that are associated with said selected attribute in said subset of tests to run.
Claim 36
Dependent Claim
69 words
The method of claim 30 further comprising the steps of: for each given directory within said hierarchical directory that is mapped to one or more of said plurality of tests, performing the steps of: a) generating pointer data that specifies any directories that correspond to any of said plurality of tests and that are children of said given directory; and b) storing said pointer data in said given directory.
Claim 37
Dependent Claim
32 words
The apparatus of claim 31, wherein environment configuration files in one or more directories of said plurality of directories are neither ancestors nor descendants of said first directory or said second directory.
Claim 38
Independent Claim
202 words
An apparatus for performing a test on software in a computer system having a processor, wherein said computer system has an initial environment, the apparatus comprising: a test base including a plurality of directories connected to form a hierarchical directory structure, wherein a first directory of said plurality of directories corresponds to a first test and a second directory of said plurality of directories corresponds to a second test, said test base further including a plurality of environment configuration files in said plurality of directories, said plurality of environment configuration files including a first set of environment configuration files that apply to said first test but not to said second test, said plurality of environment configuration files including a second set of environment configuration files that apply to said second test but not to said first test, said plurality of environment configuration files including a third set of environment configuration files that apply to both said first test and said second test; and a test engine executed by said processor, wherein said test engine determines which of said plurality of environment configuration files are applicable to said test based on a location of said environment configuration files in said plurality of directories.
Claim 39
Independent Claim
202 words
An apparatus for performing a test on software in a computer system having a processor, wherein said computer system has an initial environment, the apparatus comprising: a test base including a plurality of directories connected to form a hierarchical directory structure, wherein a first directory of said plurality of directories corresponds to a first test and a second directory of said plurality of directories corresponds to a second test, said test base further including a plurality of environment configuration files in said plurality of directories, said plurality of environment configuration files including a first set of environment configuration files that apply to said first test but not to said second test, said plurality of environment configuration files including a second set of environment configuration files that apply to said second test but not to said first test, said plurality of environment configuration files including a third set of environment configuration files that apply to both said first test and said second test; and a test engine executed by said processor, wherein said test engine determines which of said plurality of environment configuration files are applicable to said test based on a location of said environment configuration files in said plurality of directories.
Claim 40
Dependent Claim
26 words
The apparatus of claim 33, wherein said first set of environment configuration files are ancestors of said first directory but not ancestors of said second directory.
Claim 41
Dependent Claim
26 words
The apparatus of claim 33, wherein said second set of environment configuration files are ancestors of said second directory but not ancestors of said first directory.
Claim 42
Dependent Claim
24 words
The apparatus of claim 33, wherein said third set of environment configuration files are ancestors of both said first directory and said second directory.