First-order and second-order necessary optimality conditions for discrete-time stochastic systems with delay

Abstract

Abstract This paper is concerned with the first-order and second-order necessary optimality conditions for discrete-time stochastic systems with delay under weak assumptions. Based on a characteristic method and a discrete-time backward stochastic equation, we establish the linearized discrete-time stochastic maximum principle and Euler-type necessary optimality condition. Moreover, by a new discrete-time backward stochastic matrix equation, we also obtain the necessary optimality condition of quasi-singular control and the pointwise second-order optimality condition.