Nonmonotone Alternative Direction Method Based on Simple Conic Model for Unconstrained Optimization

Abstract

In this paper, we propose a nonmonotone Alternative Direction Method (ADM) based on simple conic model for unconstrained optimization. Unlike traditional trust region method, the subproblem in our method is a simple conic model, where the Hessian of the objective function is replaced by a scalar approximation, the trust region subproblem is solved by ADM which was first proposed by Zhu and Ni. When the trial point isn’t accepted by trust region, line search technique is used to find an acceptable point instead of resolving the trust region subproblem. The new method needs less memory capacitance and computational complexity. The global convergence of the algorithm is established under some mild conditions. Numerical results on a series of standard test problems are reported to show the new method is effective and robust.