In performing a pattern search algorithm to find an optimal solution for an optimization, using a set of positive basis vectors that is non-maximal like a set of minimal positive basis vectors as search directions can sometimes causes the algorithm to converge at a non-optimal solution, like a horse saddle. The present invention provides a method to overcome this deficiency by rotating the vectors and hence increase the number of search directions.