A system stored on a computer-readable storage medium for testing computer software, including: a plurality of heterogeneous test tools; a testing application that provides an interface that enables a user to collectively access each of said plurality of heterogeneous test tools; and a plurality of modules that interact with the testing application for creating and modifying, via said interface, a test that is implemented with said plurality of test tools, including: a tool manager module for selecting one or more tools, from among said plurality of test tools, to be employed in a test; a case manager module for selecting test cases, each comprising an elemental executable test, that are performed by selected tools, for inclusion in the test; and a suite manager module for creating, modifying and selecting test suites, each comprising at least one group of selected test cases, to be executed during the test.