Abstract

In this paper, three new hybrid nonlinear conjugate gradient methods are presented, which produce suf?cient descent search direction at every iteration. This property is independent of any line search or the convexity of the objective function used. Under suitable conditions, we prove that the proposed methods converge globally for general nonconvex functions. The numerical results show that all these three new hybrid methods are efficient for the given test problems.

Highlights

  • IntroductionWe consider the unconstrained optimization problem: min f x , x Rn (1.1)

  • In this paper, we consider the unconstrained optimization problem: min f x, x Rn (1.1)where f : Rn R is continuously differentiable and the gradient of f at x is denoted by g x .Due to its simplicity and its very low memory requirement, the conjugate gradient (CG) method plays a very important role for solving (1.1)

  • Powell [12] gave a counter example which showed that there exist nonconvex functions such that the PRP method may cycle and does not approach any stationary point even with exact line search. one would be satisfied with its global convergence, the FR method performs much worse than the PRP (HS, LS) method in real computations

Read more

Summary

Introduction

We consider the unconstrained optimization problem: min f x , x Rn (1.1). In the convergence analysis of conjugate gradient methods, one hopes the inexact line search such as the. Powell [12] gave a counter example which showed that there exist nonconvex functions such that the PRP method may cycle and does not approach any stationary point even with exact line search. one would be satisfied with its global convergence, the FR method performs much worse than the PRP (HS, LS) method in real computations. Combining the good numerical performance of the PRP and HS methods and the nice global convergence properties of the FR and DY methods, recently, [13] and [14] proposed some hybrid methods which we call the H1 method and the H2 method, respectively, that is, H1 k max.

Algorithm
The Global Convergence
The Global Convergence of the H3 Method
The Global Convergence of the MCD Method
The Global Convergence of the NH3 Method
Numerical Experiments
Conclusions
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.