Exact Augmented Lagrangian Function Research Articles

Exact augmented Lagrangian functions for nonlinear semidefinite programming

In this paper, we study augmented Lagrangian functions for nonlinear semidefinite programming (NSDP) problems with exactness properties. The term exact is used in the sense that the penalty parameter can be taken appropriately, so a single minimization of the augmented Lagrangian recovers a solution of the original problem. This leads to reformulations of NSDP problems into unconstrained nonlinear programming ones. Here, we first establish a unified framework for constructing these exact functions, generalizing Di Pillo and Lucidi's work from 1996, that was aimed at solving nonlinear programming problems. Then, through our framework, we propose a practical augmented Lagrangian function for NSDP, proving that it is continuously differentiable and exact under the so-called nondegeneracy condition. We also present some preliminary numerical experiments.

Augmented Lagrangian functions for cone constrained optimization: the existence of global saddle points and exact penalty property

In the article we present a general theory of augmented Lagrangian functions for cone constrained optimization problems that allows one to study almost all known augmented Lagrangians for cone constrained programs within a unified framework. We develop a new general method for proving the existence of global saddle points of augmented Lagrangian functions, called the localization principle. The localization principle unifies, generalizes and sharpens most of the known results on existence of global saddle points, and, in essence, reduces the problem of the existence of saddle points to a local analysis of optimality conditions. With the use of the localization principle we obtain first necessary and sufficient conditions for the existence of a global saddle point of an augmented Lagrangian for cone constrained minimax problems via both second and first order optimality conditions. In the second part of the paper, we present a general approach to the construction of globally exact augmented Lagrangian functions. The general approach developed in this paper allowed us not only to sharpen most of the existing results on globally exact augmented Lagrangians, but also to construct first globally exact augmented Lagrangian functions for equality constrained optimization problems, for nonlinear second order cone programs and for nonlinear semidefinite programs. These globally exact augmented Lagrangians can be utilized in order to design new superlinearly (or even quadratically) convergent optimization methods for cone constrained optimization problems.

Some Results on Augmented Lagrangians in Constrained Global Optimization via Image Space Analysis

The aim of this paper is to present some results for the augmented Lagrangian function in the context of constrained global optimization by means of the image space analysis. It is first shown that a saddle point condition for the augmented Lagrangian function is equivalent to the existence of a regular nonlinear separation in the image space. Local and global sufficient optimality conditions for the exact augmented Lagrangian function are then investigated by means of second-order analysis in the image space. Local optimality result for this function is established under second-order sufficiency conditions in the image space. Global optimality result is further obtained under additional assumptions. Finally, it is proved that the exact augmented Lagrangian method converges to a global solution–Lagrange multiplier pair of the original problem under mild conditions.

A truncated Newton method in an augmented Lagrangian framework for nonlinear programming

In this paper we propose a primal-dual algorithm for the solution of general nonlinear programming problems. The core of the method is a local algorithm which relies on a truncated procedure for the computation of a search direction, and is thus suitable for large scale problems. The truncated direction produces a sequence of points which locally converges to a KKT pair with superlinear convergence rate. The local algorithm is globalized by means of a suitable merit function which is able to measure and to enforce progress of the iterates towards a KKT pair, without deteriorating the local efficiency. In particular, we adopt the exact augmented Lagrangian function introduced in Pillo and Lucidi (SIAM J. Optim. 12:376---406, 2001), which allows us to guarantee the boundedness of the sequence produced by the algorithm and which has strong connections with the above mentioned truncated direction. The resulting overall algorithm is globally and superlinearly convergent under mild assumptions.

Exact augmented lagrangian function for nonlinear programming problems with inequality constraints

An exact augmented Lagrangian function for the nonlinear nonconvex programming problems with inequality constraints was discussed. Under suitable hypotheses, the relationship was established between the local unconstrained minimizers of the augmented Lagrangian function on the space of problem variables and the local minimizers of the original constrained problem. Furthermore, under some assumptions, the relationship was also established between the global solutions of the augmented Lagrangian function on some compact subset of the space of problem variables and the global solutions of the constrained problem. Therefore, from the theoretical point of view, a solution of the inequality constrained problem and the corresponding values of the Lagrange multipliers can be found by the well-known method of multipliers which resort to the unconstrained minimization of the augmented Lagrangian function presented.

Convergence to Second-Order Stationary Points of a Primal-Dual Algorithm Model for Nonlinear Programming

We define a primal-dual algorithm model (second-order Lagrangian algorithm, SOLA) for inequality constrained optimization problems that generates a sequence converging to points satisfying the second-order necessary conditions for optimality. This property can be enforced by combining the equivalence between the original constrained problem and the unconstrained minimization of an exact augmented Lagrangian function and the use of a curvilinear line search technique that exploits information on the nonconvexity of the augmented Lagrangian function.

An Exact Augmented Lagrangian Function for Nonlinear Programming with Two-Sided Constraints

This paper is aimed toward the definition of a new exact augmented Lagrangian function for two-sided inequality constrained problems. The distinguishing feature of this augmented Lagrangian function is that it employs only one multiplier for each two-sided constraint. We prove that stationary points, local minimizers and global minimizers of the exact augmented Lagrangian function correspond exactly to KKT pairs, local solutions and global solutions of the constrained problem.

An Augmented Lagrangian Function with Improved Exactness Properties

In this paper we introduce a new exact augmented Lagrangian function for the solution of general nonlinear programming problems. For this Lagrangian function a complete equivalence between its unconstrained minimization on an open set and the solution of the original constrained problem can be established under mild assumptions and without requiring the boundedness of the feasible set of the constrained problem. Moreover we describe an unconstrained algorithmic model which is globally convergent toward KKT pairs of the original constrained problem. The algorithmic model can be endowed with a superlinear rate of convergence by a proper choice of the search direction in the unconstrained minimization, without requiring strict complementarity.

Recursive quadratic programming algorithm that uses an exact augmented Lagrangian function

An algorithm for nonlinear programming problems with equality constraints is presented which is globally and superlinearly convergent. The algorithm employs a recursive quadratic programming scheme to obtain a search direction and uses a differentiable exact augmented Lagrangian as line search function to determine the steplength along this direction. It incorporates an automatic adjustment rule for the selection of the penalty parameter and avoids the need to evaluate second-order derivatives of the problem functions. Some numerical results are reported.

An Exact Augmented Lagrangian Approach to Multilevel Optimization

An approach based on the exact augmented Lagrangian function is developed for the optimization of large scale systems constituted by interconnected units. The decomposition and coordination strategies are examined and various schemes of upper level coordination are proposed, all of which are formulated as unconstrained quadratic minimization problems. Convergence analysis is performed exploiting a parallel with minimization by relaxation methods. A numerical example is included.

Exact augmented lagrangian approach to multilevel optimization of large-scale systems

An approach based on the exact augmented lagrangian function is developed for the optimization of large-scale systems composed of interconnected units. The decomposition and coordination strategies are examined and various schemes of upper-level coordination are proposed, all of which are formulated as unconstrained quadratic minimization problems. Convergence analysis is performed exploiting an analogy with minimization by relaxation methods. Numerical examples are reported.