Optimal control: Nonlocal conditions, computational methods, and the variational principle of maximum

Abstract

This paper surveys theoretical results on the Pontryagin maximum principle (together with its conversion) and nonlocal optimality conditions based on the use of the Lyapunov-type functions (solutions to the Hamilton-Jacobi inequalities). We pay special attention to the conversion of the maximum principle to a sufficient condition for the global and strong minimum without assumptions of the linear convexity, normality, or controllability. We give the survey of computational methods for solving classical optimal control problems and describe nonstandard procedures of nonlocal improvement of admissible processes in linear and quadratic problems. Furthermore, we cite some recent results on the variational principle of maximum in hyperbolic control systems. This principle is the strongest first order necessary optimality condition; it implies the classical maximum principle as a consequence.