An improved apparatus and method for debugging computer programs is disclosed for enabling a programmer to step backwards through instructions by checking for exceptions, remembering which instruction generates an exception, and for providing an interface that allows the programmer to easily step back through the instructions in order to isolate the cause of the exception, without the undue repetition.