System, method and computer product for incremental improvement of algorithm performance during algorithm development. In one aspect of this disclosure, there is a system, method and computer readable medium that stores instructions for instructing a computer system, to assess the performance of an algorithm during development. In this embodiment, a design of experiments component establishes an acceptable number of experiments for analyzing incremental improvements of the algorithm. An experiment performance component runs the established number of experiments for the algorithm. A simulation component simulates the behavior of the algorithm using results from the experiment performance component.