Optimal linear quadratic Gaussian control for discrete time‐varying system with simultaneous input delay and state/control‐dependent noises

Abstract

SummaryThis article focuses on the problem of linear quadratic Gaussian (LQG) control for discrete time‐varying system with input delay and state/control‐dependent noises. When the state variables can be exactly observed, first, we obtain the maximum principle by applying the method of variation. Second, a nonhomogeneous relationship between the state and the costate is developed in virtue of the obtained maximum principle and the mathematical induction. It is noted that the nonhomogeneous relationship is the solution to the forward and backward stochastic difference equations (FBSDEs). Finally, based on the solution to the FBSDEs, a necessary and sufficient condition for the optimal LQG control is derived in terms of coupled Riccati equations. Moreover, the analytical expression of the optimal controller is presented. The derived results are applied in networked control systems with packet dropout. Numerical examples are shown to illustrate the effectiveness of the proposed algorithm.