Quasi-Newton algorithms: Approaches and motivations

Abstract

This paper surveys some of the unifying approaches used to derive formulae for updating the inverse Hessian approximations in quasi-Newton algorithms and presents a new approach of this kind based on geometric considerations. The paper discusses the intuitive motivations for these approaches and their potential in providing explanations for observed behavior of such algorithms.