Nonmonotone Adaptive Trust Region Research Articles

A nonmonotone adaptive trust region technique with a forgetting factor

Nonmonotonicity has been considered to be essentially influential on the efficiency of the iterative procedures of nonlinear optimization. A review of the literature shows that the objective function values available from recent iterations provide worthier information in the nonmonotone schemes. So, with the aim of enhancing probability of applying more recent available function values, a nonmonotone trust region ratio is suggested using a forgetting factor. Meanwhile, modification of a recent adaptive formula for the trust region radius is devised by a nonmonotone reflection as well. Then, based on the two mentioned modifications, an adaptive nonmonotone trust region algorithm is given. In addition, convergence of the method is analysed under classic assumptions. To provide support for our theoretical arguments, computational merits of the given algorithm on a set of CUTEr test functions are depicted.

Integrated fire/flight control coupler design for armed helicopters based on improved non-monotone adaptive trust region algorithm with distributionally robust optimization

Aiming at enhancing the extent of military automatization and the effectiveness of armed helicopters in complex battlefield environment, integrated fire/flight control (IFFC) coupler connects the fire control system and the flight control system which is used to generate the optimal flight command signals. However, it is difficult to obtain satisfactory flight command signals within a certain firing accuracy due to the unavoidable uncertain information in battlefield environment. In this paper, a new IFFC scheme is proposed for armed helicopters against complex combat by using the idea of distributionally robust optimization combined with the framework of trust region. Initially, a vector equation and coordinate transformation are employed to acquire the relative motion model of the IFFC coupler problem in complex battlefield environment. Moreover, an improved performance index is designed according to the constraints, and the original non-convex problem is handled by the Taylor formula combined with an improved BFGS (Broyden–Fletcher–Goldfard–Shanno) algorithm. Considering the uncertain parameters during optimization, the non-linear distributionally robust optimization is transformed into a linear matrix inequality optimization problem based on the worst-case conditional value-at-risk (WC-CVaR) approximation. Then, an algorithmic framework with a non-monotone adaptive trust region algorithm is given to obtain the optimal flight command signals. Finally, a simulation example is given to illustrate the effectiveness of the proposed approach.

English

We propose a new and efficient nonmonotone adaptive trust region algorithm to solve unconstrained optimization problems. This algorithm incorporates two novelties: it benefits from a radius dependent shrinkage parameter for adjusting the trust region radius that avoids undesirable directions and exploits a new strategy to prevent sudden increments of objective function values in nonmonotone trust region techniques. Global convergence of this algorithm is investigated under some mild conditions. Numerical experiments demonstrate the efficiency and robustness of the proposed algorithm in solving a collection of unconstrained optimization problems from the CUTEst package.

A New Nonmonotone Adaptive Trust Region Method

The trust region method plays an important role in solving optimization problems. In this paper, we propose a new nonmonotone adaptive trust region method for solving unconstrained optimization problems. Actually, we combine a popular nonmonotone technique with an adaptive trust region algorithm. The new ratio to adjusting the next trust region radius is different from the ratio in the traditional trust region methods. Under some appropriate conditions, we show that the new algorithm has good global convergence and superlinear convergence.

A Filter and Nonmonotone Adaptive Trust Region Line Search Method for Unconstrained Optimization

In this paper, a new nonmonotone adaptive trust region algorithm is proposed for unconstrained optimization by combining a multidimensional filter and the Goldstein-type line search technique. A modified trust region ratio is presented which results in more reasonable consistency between the accurate model and the approximate model. When a trial step is rejected, we use a multidimensional filter to increase the likelihood that the trial step is accepted. If the trial step is still not successful with the filter, a nonmonotone Goldstein-type line search is used in the direction of the rejected trial step. The approximation of the Hessian matrix is updated by the modified Quasi-Newton formula (CBFGS). Under appropriate conditions, the proposed algorithm is globally convergent and superlinearly convergent. The new algorithm shows better performance in terms of the Dolan–Moré performance profile. Numerical results demonstrate the efficiency and robustness of the proposed algorithm for solving unconstrained optimization problems.

A new nonmonotone adaptive trust region line search method for unconstrained optimization

This paper proposes a new nonmonotone adaptive trust region line search method for solving unconstrained optimization problems, and presents a modified trust region ratio, which obtained more reasonable consistency between the accurate model and the approximate model. The approximation of Hessian matrix is updated by the modified BFGS formula. Trust region radius adopts a new adaptive strategy to overcome additional computational costs at each iteration. The global convergence and superlinear convergence of the method are preserved under suitable conditions. Finally, the numerical results show that the proposed method is very efficient.

A New Filter Nonmonotone Adaptive Trust Region Method for Unconstrained Optimization

In this paper, a new filter nonmonotone adaptive trust region with fixed step length for unconstrained optimization is proposed. The trust region radius adopts a new adaptive strategy to overcome additional computational costs at each iteration. A new nonmonotone trust region ratio is introduced. When a trial step is not successful, a multidimensional filter is employed to increase the possibility of the trial step being accepted. If the trial step is still not accepted by the filter set, it is possible to find a new iteration point along the trial step and the step length is computed by a fixed formula. The positive definite symmetric matrix of the approximate Hessian matrix is updated using the MBFGS method. The global convergence and superlinear convergence of the proposed algorithm is proven by some classical assumptions. The efficiency of the algorithm is tested by numerical results.

A randomized nonmonotone adaptive trust region method based on the simulated annealing strategy for unconstrained optimization

PurposeThe purpose of this paper is to employ stochastic techniques to increase efficiency of the classical algorithms for solving nonlinear optimization problems.Design/methodology/approachThe well-known simulated annealing strategy is employed to search successive neighborhoods of the classical trust region (TR) algorithm.FindingsAn adaptive formula for computing the TR radius is suggested based on an eigenvalue analysis conducted on the memoryless Broyden-Fletcher-Goldfarb-Shanno updating formula. Also, a (heuristic) randomized adaptive TR algorithm is developed for solving unconstrained optimization problems. Results of computational experiments on a set of CUTEr test problems show that the proposed randomization scheme can enhance efficiency of the TR methods.Practical implicationsThe algorithm can be effectively used for solving the optimization problems which appear in engineering, economics, management, industry and other areas.Originality/valueThe proposed randomization scheme improves computational costs of the classical TR algorithm. Especially, the suggested algorithm avoids resolving the TR subproblems for many times.

English

Trust region methods are a class of effective iterative schemes in numerical optimization. In this paper, a new improved nonmonotone adaptive trust region method for solving unconstrained optimization problems is proposed. We construct an approximate model where the approximation to Hessian matrix is updated by the scaled memoryless BFGS update formula, and incorporate a nonmonotone technique with the new proposed adaptive trust region radius. The new ratio to adjusting the next trust region radius is different from the ratio in the traditional trust region methods. Under some suitable and standard assumptions, it is shown that the proposed algorithm possesses global convergence and superlinear convergence. Numerical results demonstrate that the proposed method is very promising.

Two accelerated nonmonotone adaptive trust region line search methods

Hybridizing monotone and nonmonotone approaches, we employ a modified trust region ratio in which more information is provided about the agreement between the exact and the approximate models. Also, we use an adaptive trust region radius as well as two accelerated Armijo-type line search strategies to avoid resolving the trust region subproblem whenever a trial step is rejected. We show that the proposed algorithm is globally and locally superlinearly convergent. Comparative numerical experiments show practical efficiency of the proposed accelerated adaptive trust region algorithm.

A new class of nonmonotone adaptive trust-region methods for nonlinear equations with box constraints

A nonmonotone trust-region method for the solution of nonlinear systems of equations with box constraints is considered. The method differs from existing trust-region methods both in using a new nonmonotonicity strategy in order to accept the current step and a new updating technique for the trust-region-radius. The overall method is shown to be globally convergent. Moreover, when combined with suitable Newton-type search directions, the method preserves the local fast convergence. Numerical results indicate that the new approach is more effective than existing trust-region algorithms.

A New Nonmonotone Adaptive Retrospective Trust Region Method for Unconstrained Optimization Problems

In this paper, we propose a new nonmonotone adaptive retrospective Trust Region (TR) method for solving unconstrained optimization problems. Inspired by the retrospective ratio proposed in Bastin et al. (Math Program Ser A 123:395---418, 2010), a new nonmonotone TR ratio is introduced based on a convex combination of the nonmonotone classical and retrospective ratios. Due to the value of the new ratio, the TR radius is updated adaptively by a variant of the rule as proposed in Shi and Guo (J Comput Appl Math 213:509---520, 2008). Global convergence property of the new algorithm, as well as its superlinear convergence rate, is established under some standard assumptions. Numerical results on some test problems show the efficiency and effectiveness of the new method in practice, too.

A relaxed nonmonotone adaptive trust region method for solving unconstrained optimization problems

In this paper, we present a new relaxed nonmonotone trust region method with adaptive radius for solving unconstrained optimization problems. The proposed method combines a relaxed nonmonotone technique with a modified version of the adaptive trust region strategy proposed by Shi and Guo (J Comput Appl Math 213:509---520, 2008). Under some suitable and standard assumptions, we establish the global convergence property as well as the superlinear convergence rate for the new method. Numerical results on some test problems show the efficiency and effectiveness of the new proposed method in practice.

Nonmonotone adaptive trust region method with line search based on new diagonal updating

In this paper, a new nonmonotone adaptive trust region method with line search for solving unconstrained nonlinear optimization problems is introduced. The computation of the Hessian approximation is based on the usage of the weak secant equation by a diagonal definite matrix. Under some reasonable conditions, the global convergence of the proposed algorithm is established. The numerical results show the new method is effective and attractive for large scale optimization problems.

Nonmonotone adaptive trust region method based on simple conic model for unconstrained optimization

We propose a nonmonotone adaptive trust region method based on simple conic model for unconstrained optimization. Unlike traditional trust region methods, the subproblem in our method is a simple conic model, where the Hessian of the objective function is approximated by a scalar matrix. The trust region radius is adjusted with a new self-adaptive adjustment strategy which makes use of the information of the previous iteration and current iteration. The new method needs less memory and computational efforts. The global convergence and Q-superlinear convergence of the algorithm are established under the mild conditions. Numerical results on a series of standard test problems are reported to show that the new method is effective and attractive for large scale unconstrained optimization problems.

A Nonmonotone Adaptive Trust Region Method Based on Conic Model for Unconstrained Optimization

We propose a nonmonotone adaptive trust region method for unconstrained optimization problems which combines a conic model and a new update rule for adjusting the trust region radius. Unlike the traditional adaptive trust region methods, the subproblem of the new method is the conic minimization subproblem. Moreover, at each iteration, we use the last and the current iterative information to define a suitable initial trust region radius. The global and superlinear convergence properties of the proposed method are established under reasonable conditions. Numerical results show that the new method is efficient and attractive for unconstrained optimization problems.

A new nonmonotone adaptive trust region method based on simple quadratic models

Based on simple quadratic models of the trust region subproblem, we combine the trust region method with the nonmonotone and adaptive techniques to propose a new nonmonotone adaptive trust region algorithm for unconstrained optimization. Unlike traditional trust region method, our trust region subproblem is very simple by using a new scale approximation of the minimizing function’s Hessian. The new method needs less memory capacitance and computational complexity. The convergence results of the method are proved under certain conditions. Numerical results show that the new method is effective and attractive for large scale unconstrained problems.

A new modified nonmonotone adaptive trust region method for unconstrained optimization

In this paper, we present an adaptive trust region method for solving unconstrained optimization problems which combines nonmonotone technique with a new update rule for the trust region radius. At each iteration, our method can adjust the trust region radius of related subproblem. We construct a new ratio to adjust the next trust region radius which is different from the ratio in the traditional trust region methods. The global and superlinear convergence results of the method are established under reasonable assumptions. Numerical results show that the new method is efficient for unconstrained optimization problems.

Nonmonotone adaptive trust region method

In this paper, we propose a nonmonotone adaptive trust region method for unconstrained optimization problems. This method can produce an adaptive trust region radius automatically at each iteration and allow the functional value of iterates to increase within finite iterations and finally decrease after such finite iterations. This nonmonotone approach and adaptive trust region radius can reduce the number of solving trust region subproblems when reaching the same precision. The global convergence and convergence rate of this method are analyzed under some mild conditions. Numerical results show that the proposed method is effective in practical computation.

A nonmonotone adaptive trust region method for unconstrained optimization based on conic model

In this paper, we present a nonmonotone adaptive trust region method for unconstrained optimization based on conic model. The new method combines nonmonotone technique and a new way to determine trust region radius at each iteration. The local and global convergence properties are proved under reasonable assumptions. Numerical experiments show that our algorithm is effective.