Backtracking Adaptive Search: Distribution of Number of Iterations to Convergence

Abstract

Backtracking adaptive search is a simplified stochastic optimiza-tion procedure which permits the acceptance of worsening objective function values. It generalizes the hesitant adaptive search, which in turn is a gener-alization of the pure adaptive search. In this paper, we use ideas from the theory of stochastic processes to determine the full distribution of the number of iterations to convergence for the backtracking adaptive search.