On the first-order estimation of multipliers from Kuhn–Tucker systems

Abstract

The minimization of a nonlinear function with linear and nonlinear constraints and simple bounds can be performed by minimizing an augmented Lagrangian function that includes only the nonlinear constraints subject to the linear constraints and simple bounds. It is then necessary to estimate the multipliers of the nonlinear constraints and variable reduction techniques can be used to carry out the successive minimizations. The viability of estimating the multipliers of the nonlinear constraints from the Kuhn–Tucker system is analyzed and an acceptability test on the residual of the estimation is put forward. The computational performance of the procedure is compared with that of the inexpensive Hestenes–Powell multiplier update. Scope and purpose It is possible to minimize a nonlinear function with linear and nonlinear constraints and simple bounds through the successive minimization of an augmented Lagrangian function including only the nonlinear constraints subject to the linear constraints and simple bounds. This method is particularly interesting when the linear constraints are flow conservation equations, as there are efficient techniques for solving nonlinear network problems. Regarding the successive estimation of the multipliers of the nonlinear constraints there is some doubt as to whether using the Kuhn–Tucker system could improve upon the inexpensive Hestenes–Powell update, especially considering that the Kuhn–Tucker system with partial augmented Lagrangians may not always lead to an acceptable multiplier estimation. Clarifying the computational efficiency of the multiplier update when there are linear or nonlinear side constraints is also a necessary previous step regarding the comparison between partial augmented Lagrangian techniques and either primal partitioning techniques for linear side constraints or projected Lagrangian methods in the case of nonlinear side constraints.