Robust stochastic maximum principle for multi-model worst case optimization

Abstract

This paper develops a version of the robust maximum principle applied to the minimax Mayer problem formulated for stochastic differential equations with a control-dependent diffusion term. The parametric families of first and second order adjoint stochastic processes are introduced to construct the corresponding Hamiltonian formalism. The Hamiltonian function used for the construction of the robust optimal control is shown to be equal to the sum of the standard stochastic Hamiltonians corresponding to each possible value of the parameter. The cost function is defined on a finite horizon and contains the mathematical expectation of a terminal term. A terminal condition, given by a vector function, is also considered. The optimal control strategies, adapted for available information, for the wide class of multi-model systems given by a stochastic differential equation with parameters from a given finite set are constructed. This problem belongs to the class of minimax stochastic optimization problems. The proof is based on the recent results obtained for deterministic minimax Mayer problem by Boltyanski and Poznyak as well as on the results of Zhou and of Yong and Zhou, obtained for stochastic maximum principle for non-linear stochastic systems with a single-valued parameter. Two illustrative examples, dealing with production planning and reinsurance-dividend management, conclude this study.