Finite and infinite horizon indefinite linear quadratic optimal control for discrete-time singular Markov jump systems

Abstract

This paper concerns the indefinite linear quadratic (LQ) optimal control problem for discrete-time singular Markov jump systems (MJSs) with finite and infinite horizon, where the weight matrices for state and control of cost function are all indefinite. Firstly, the indefinite LQ problem for singular MJSs is equivalently transformed into indefinite LQ problem for MJSs under a series of equivalent transformations. Then, the sufficient and necessary condition is proposed for the solvability of finite horizon case, the optimal control and optimal cost value are given, and the resulting optimal closed-loop system is regular, casual. Next, some sufficient and necessary conditions are obtained to ensure the transformed equivalent LQ problem for MJSs to be definite one, which can guarantee the generalized algebraic Riccati equation with Markov jump has a unique semi-positive definite solution. Meanwhile, the optimal control and nonnegative optimal cost value in infinite horizon are acquired, and the resulting optimal closed-loop system is stochastically admissible. Finally, three examples are presented to illustrate the theoretical results.