Trust Region Radius Research Articles

A New Nonmonotone Adaptive Retrospective Trust Region Method for Unconstrained Optimization Problems

In this paper, we propose a new nonmonotone adaptive retrospective Trust Region (TR) method for solving unconstrained optimization problems. Inspired by the retrospective ratio proposed in Bastin et al. (Math Program Ser A 123:395---418, 2010), a new nonmonotone TR ratio is introduced based on a convex combination of the nonmonotone classical and retrospective ratios. Due to the value of the new ratio, the TR radius is updated adaptively by a variant of the rule as proposed in Shi and Guo (J Comput Appl Math 213:509---520, 2008). Global convergence property of the new algorithm, as well as its superlinear convergence rate, is established under some standard assumptions. Numerical results on some test problems show the efficiency and effectiveness of the new method in practice, too.

A Nonmonotone Weighting Self-Adaptive Trust Region Algorithm for Unconstrained Nonconvex Optimization

A new trust region method is presented, which combines nonmonotone line search technique, a self-adaptive update rule for the trust region radius, and the weighting technique for the ratio between the actual reduction and the predicted reduction. Under reasonable assumptions, the global convergence of the method is established for unconstrained nonconvex optimization. Numerical results show that the new method is efficient and robust for solving unconstrained optimization problems.

TRUST-REGION-BASED METHODS FOR NONLINEAR PROGRAMMING: RECENT ADVANCES AND PERSPECTIVES

The aim of this text is to highlight recent advances of trust-region-based methods for nonlinear programming and to put them into perspective. An algorithmic framework provides a ground with the main ideas of these methods and the related notation. Specific approaches concerned with handling the trust-region subproblem are recalled, particularly for the large scale setting. Recent contributions encompassing the trust-region globalization technique for nonlinear programming are reviewed, including nonmonotone acceptance criteria for unconstrained minimization; the adaptive adjustment of the trust-region radius; the merging of the trust-region step into a line search scheme, and the usage of the trust-region elements within derivative-free optimization algorithms.

A filter method for nonlinear semidefinite programming with global convergence

In this study, a new filter algorithm is presented for solving the nonlinear semidefinite programming. This algorithm is inspired by the classical sequential quadratic programming method. Unlike the traditional filter methods, the sufficient descent is ensured by changing the step size instead of the trust region radius. Under some suitable conditions, the global convergence is obtained. In the end, some numerical experiments are given to show that the algorithm is effective.

A globally convergent trust-region algorithm for unconstrained derivative-free optimization

In this work we propose a derivative-free trust-region algorithm for unconstrained optimization. The algorithm is based on the ideas of Powell (Comput Optim Appl 53:527–555, 2012). We turn his general ideas into a step-form algorithm that avoids unnecessary reductions of the trust-region radius. The results related to the global convergence of the algorithm are presented in detail. We prove that, under reasonable hypotheses, any accumulation point of the sequence generated by the algorithm is stationary.

Nonmonotone adaptive trust region method based on simple conic model for unconstrained optimization

We propose a nonmonotone adaptive trust region method based on simple conic model for unconstrained optimization. Unlike traditional trust region methods, the subproblem in our method is a simple conic model, where the Hessian of the objective function is approximated by a scalar matrix. The trust region radius is adjusted with a new self-adaptive adjustment strategy which makes use of the information of the previous iteration and current iteration. The new method needs less memory and computational efforts. The global convergence and Q-superlinear convergence of the algorithm are established under the mild conditions. Numerical results on a series of standard test problems are reported to show that the new method is effective and attractive for large scale unconstrained optimization problems.

A Nonmonotone Adaptive Trust Region Method Based on Conic Model for Unconstrained Optimization

We propose a nonmonotone adaptive trust region method for unconstrained optimization problems which combines a conic model and a new update rule for adjusting the trust region radius. Unlike the traditional adaptive trust region methods, the subproblem of the new method is the conic minimization subproblem. Moreover, at each iteration, we use the last and the current iterative information to define a suitable initial trust region radius. The global and superlinear convergence properties of the proposed method are established under reasonable conditions. Numerical results show that the new method is efficient and attractive for unconstrained optimization problems.

A Novel Self-Adaptive Trust Region Algorithm for Unconstrained Optimization

A new self-adaptive rule of trust region radius is introduced, which is given by a piecewise function on the ratio between the actual and predicted reductions of the objective function. A self-adaptive trust region method for unconstrained optimization problems is presented. The convergence properties of the method are established under reasonable assumptions. Preliminary numerical results show that the new method is significant and robust for solving unconstrained optimization problems.

A new adaptive trust-region method for system of nonlinear equations

This study presents a new trust-region procedure to solve a system of nonlinear equations in several variables. The proposed approach combines an effective adaptive trust-region radius with a nonmonotone strategy, because it is believed that this combination can improve the efficiency and robustness of the trust-region framework. Indeed, it decreases the computational cost of the algorithm by decreasing the required number of subproblems to be solved. The global and the quadratic convergence of the proposed approach is proved without any nondegeneracy assumption of the exact Jacobian. Preliminary numerical results indicate the promising behavior of the new procedure to solve systems of nonlinear equations.

A new nonmonotone trust region method for unconstrained optimization equipped by an efficient adaptive radius

In this paper, we present a new nonmonotone trust region method with adaptive radius which is equipped by a nonmonotone line search technique for solving unconstrained optimization problems. The proposed method combines a modified version of the Li and Fukushima's nonmonotone technique in D.H. Li and M. Fukushima [A derivative-free line search and global convergence of Broyden like method for nonlinear equations, Optim. Methods Softw.13 (2000), pp. 181–201] for solving nonlinear systems with a new variant of Shi and Guo's adaptive strategy in Z.J. Shi and J.H. Guo [A new trust region methods for unconstrained optimization, J. Comput. Appl. Math. 213 (2008), pp. 509–520] for updating the trust region radius. The method performs a nonmonotone Armijo-type line search whenever the trial step is rejected. Under some standard assumptions, we provide the global convergence property as well as the superlinear and quadratic convergence rates for the new method. Numerical results show the efficiency and effectiveness of the new proposed method in practice.

A hybrid of adjustable trust-region and nonmonotone algorithms for unconstrained optimization

This study devotes to incorporating a nonmonotone strategy with an automatically adjusted trust-region radius to propose a more efficient hybrid of trust-region approaches for unconstrained optimization. The primary objective of the paper is to introduce a more relaxed trust-region approach based on a novel extension in trust-region ratio and radius. The next aim is to employ stronger nonmonotone strategies, i.e. bigger trust-region ratios, far from the optimizer and weaker nonmonotone strategies, i.e. smaller trust-region ratios, close to the optimizer. The global convergence to first-order stationary points as well as the local superlinear and quadratic convergence rates are also proved under some reasonable conditions. Some preliminary numerical results and comparisons are also reported.

A trust region method for constructing triangle-mesh approximations of parametric minimal surfaces

Given a function f0 defined on the unit square Ω with values in R3, we construct a piecewise linear function f on a triangulation of Ω such that f agrees with f0 on the boundary nodes, and the image of f has minimal surface area. The problem is formulated as that of minimizing a discretization of a least squares functional whose critical points are uniformly parameterized minimal surfaces. The nonlinear least squares problem is treated by a trust region method in which the trust region radius is defined by a stepwise-variable Sobolev metric. Test results demonstrate the effectiveness of the method.

A trust region method based on a new affine scaling technique for simple bounded optimization

In this paper, we propose a new trust region affine scaling method for nonlinear programming with simple bounds. Our new method is an interior-point trust region method with a new scaling technique. The scaling matrix depends on the distances of the current iterate to the boundaries, the gradient of the objective function and the trust region radius. This scaling technique is different from the existing ones. It is motivated by our analysis of the linear programming case. The trial step is obtained by minimizing the quadratic approximation to the objective function in the scaled trust region. It is proved that our algorithm guarantees that at least one accumulation point of the iterates is a stationary point. Preliminary numerical experience on problems with simple bounds from the CUTEr collection is also reported. The numerical performance reveals that our method is effective and competitive with the famous algorithm LANCELOT. It also indicates that the new scaling technique is very effective and might be a good alternative to that used in the subroutine fmincon from Matlab optimization toolbox.

An effective trust-region-based approach for symmetric nonlinear systems

This paper presents a new trust-region procedure for solving symmetric nonlinear systems of equations having several variables. The proposed approach takes advantage of the combination of both an effective adaptive trust-region radius and a non-monotone strategy. It is believed that the selection of an appropriate adaptive radius and the application of a suitable non-monotone strategy can improve the efficiency and robustness of the trust-region framework as well as decrease the computational costs of the algorithm by decreasing the required number of subproblems to be solved. The global convergence and the quadratic convergence of the proposed approach are proved without the non-degeneracy assumption of the exact Jacobian. The preliminary numerical results of the proposed algorithm indicating the promising behaviour of the new procedure for solving nonlinear systems are also reported.

A Sobolev gradient method for treating the steady-state incompressible Navier-Stokes equations

Abstract The velocity-vorticity-pressure formulation of the steady-state incompressible Navier-Stokes equations in two dimensions is cast as a nonlinear least squares problem in which the functional is a weighted sum of squared residuals. A finite element discretization of the functional is minimized by a trust-region method in which the trustregion radius is defined by a Sobolev norm and the trust-region subproblems are solved by a dogleg method. Numerical test results show the method to be effective.

Minimization of the Ginzburg–Landau energy functional by a Sobolev gradient trust-region method

We describe a generalized Levenberg–Marquardt method for computing critical points of the Ginzburg–Landau energy functional which models superconductivity. The algorithm is a blend of a Newton iteration with a Sobolev gradient descent method, and is equivalent to a trust-region method in which the trust-region radius is defined by a Sobolev metric. Numerical test results demonstrate the method to be remarkably effective.

A non-monotone retrospective trust-region method for unconstrained optimization

In this paper, a new non-monotone trust-region algorithm is proposed for solving unconstrained nonlinear optimization problems. We modify the retrospective ratio which is introduced by Bastin et al. [Math. Program., Ser. A (2010) 123: 395-418] to form a convex combination ratio for updating the trust-region radius. Then we combine the non-monotone technique with this new framework of trust-region algorithm. The new algorithm is shown to be globally convergent to a first-order criticalpoint. Numerical experiments on CUTEr problems indicate that it is competitive with both the original retrospective trust-region algorithm and the classical trust-region algorithms.

A trust region affine scaling method for bound constrained optimization

We study a new trust region affine scaling method for general bound constrained optimization problems. At each iteration, we compute two trial steps. We compute one along some direction obtained by solving an appropriate quadratic model in an ellipsoidal region. This region is defined by an affine scaling technique. It depends on both the distances of current iterate to boundaries and the trust region radius. For convergence and avoiding iterations trapped around nonstationary points, an auxiliary step is defined along some newly defined approximate projected gradient. By choosing the one which achieves more reduction of the quadratic model from the two above steps as the trial step to generate next iterate, we prove that the iterates generated by the new algorithm are not bounded away from stationary points. And also assuming that the second-order sufficient condition holds at some nondegenerate stationary point, we prove the Q-linear convergence of the objective function values. Preliminary numerical experience for problems with bound constraints from the CUTEr collection is also reported.

A new trust region method with adaptive radius for unconstrained optimization

In this paper, we propose a new adaptive trust region method for unconstrained optimization problems. In the new method, we use the previous and the current iterative information and a new update rule to define the trust region radius at each iterate. The global and superlinear convergence properties of the method are established under reasonable assumptions. Preliminary numerical results show that the new method is efficient and attractive for unconstrained optimization problems.

An improved trust region method for unconstrained optimization

In this paper, a new trust region method for unconstrained optimization is proposed. In the new method, the trust radius adjusts itself adaptively. In our algorithm, we use the convex combination of the Hessian matrix at a previous iteration and current iteration to define a suitable trust region radius at each iteration. The global, superlinear and quadratic convergence results of the algorithm are established under reasonable assumptions. Finally, some numerical results are given.