Alternated and multi-step inertial approximation methods for solving convex bilevel optimization problems

Abstract

In this paper, we propose three kinds of inertial approximation methods based on the proximal gradient algorithm to accelerate the convergence of the algorithm for solving convex bilevel optimization problems. Under reasonable parameters, we prove that our algorithms converge strongly to some solution of the problem, which is the unique solution of a variational inequality problem. Firstly, two alternated inertial methods are presented. Secondly, a multi-step inertial method is proposed to accelerate the convergence of the algorithm. Thirdly, an alternated multi-step inertial method is further introduced. In addition, we also consider that the inertial parameters can be chosen as positive or negative parameters, and we get better results. Our numerical results illustrate the performances of our algorithms and present some comparisons with related algorithms. Our results improve and extend the corresponding results reported by some authors recently.