Two iterative algorithms for stochastic algebraic Riccati matrix equations

Abstract

In this paper, two iterative algorithms are proposed to solve stochastic algebraic Riccati matrix equations arising in the linear quadratic optimal control problem of linear stochastic systems with state-dependent noise. In the first algorithm, a standard Riccati matrix equation needs to be solved at each iteration step, and in the second algorithm a standard Lyapunov matrix equation needs to be solved at each iteration step. In the proposed algorithms, a weighted average of the estimates in the last and the previous steps is used to update the estimate of the unknown variable at each iteration step. Some properties of the sequences generated by these algorithms under appropriate initial conditions are presented, and the convergence properties of the proposed algorithms are analyzed. Finally, two numerical examples are employed to show the effectiveness of the proposed algorithms.