Convergence of the block Lanczos method for the trust‐region subproblem in the hard case

Abstract

SummaryThe trust‐region subproblem (TRS) plays a vital role in numerical optimization, numerical linear algebra, and many other applications. It is known that the TRS may have multiple optimal solutions in the hard case. In [Carmon and Duchi, SIAM Rev., 62 (2020), pp. 395–436], a block Lanczos method was proposed to solve the TRS in the hard case, and the convergence of the optimal objective value was established. However, the convergence of the KKT error as well as that of the approximate solution are still unknown for this method. In this paper, we give a more detailed convergence analysis on the block Lanczos method for the TRS in the hard case. First, we improve the convergence speed of the approximate objective value. Second, we derive the speed of the KKT error tends to zero. Third, we establish the convergence of the approximation solution, and show theoretically that the projected TRS obtained from the block Lanczos method will be close to the hard case more and more as the block Lanczos process proceeds. Numerical experiments illustrate the effectiveness of our theoretical results.