Feedback Stackelberg strategies for the discrete-time mean-field stochastic systems in infinite horizon

Abstract

This paper deals with the feedback Stackelberg strategies for the discrete-time mean-field stochastic systems in infinite horizon. The optimal control problem of the follower is first studied. Employing the discrete-time linear quadratic (LQ) mean-field stochastic optimal control theory, the sufficient conditions for the solvability of the optimization of the follower are presented and the optimal control is obtained based on the stabilizing solutions of two coupled generalized algebraic Riccati equations (GAREs). Then, the optimization of the leader is transformed into a constrained optimal control problem. Applying the Karush-Kuhn-Tucker (KKT) conditions, the necessary conditions for the existence and uniqueness of the Stackelberg strategies are derived and the Stackelberg strategies are expressed as linear feedback forms involving the state and its mean based on the solutions (Ki,K^i),i=1,2 of a set of cross-coupled stochastic algebraic equations (CSAEs). An iterative algorithm is put forward to calculate efficiently the solutions of the CSAEs. Finally, an example is solved to show the effectiveness of the proposed algorithm.