Adaptive optimal tracking control of networked linear systems under two-channel stochastic dropouts

Abstract

This work investigates the adaptive optimal tracking control problem for networked discrete-time linear systems by directly using the data transmitted via communication networks. It is shown that the concerned problem can be addressed by solving two sub-problems: an adaptive optimal control one and an adaptive output regulation one. Two novel online reinforcement learning based policy iteration and value iteration algorithms are developed, which constitute an integrated framework to learn the optimal feedback control gain and the solutions to regulator equations by directly using the data transmitted via communication networks. Furthermore, it is shown that the tracking error of the closed-loop control system is mean square asymptotically stable even in the case of network packet stochastic dropouts. Simulation results demonstrate the efficacy of the proposed approaches.