On the Generalized Lanczos Trust-Region Method

Abstract

The so-called trust-region subproblem gets its name in the trust-region method in optimization and also plays a vital role in various other applications. Several numerical algorithms have been proposed in the literature for solving small-to-medium size dense problems as well as for large-scale sparse problems. The generalized Lanczos trust-region (GLTR) method proposed by [N. I. M. Gould, S. Lucidi, M. Roma and P. L. Toint, SIAM J. Optim., 9 (1999), pp. 561--580] is a natural extension of the classical Lanczos method for the linear system to the trust-region subproblem. In this paper, we first analyze the convergence of GLTR to reveal its convergence behavior in theory and then propose new stopping criteria that can be integrated into GLTR for better numerical performance. Specifically, we develop a priori upper bounds for the convergence to both the optimal objective value as well as the optimal solution and argue that these bounds can be efficiently estimated numerically and serve as stopping criteria f...