Optimal output synchronization of heterogeneous multi-agent systems using measured input-output data

Abstract

In this paper, the optimal output synchronization of heterogeneous multi-agent systems is studied. To overcome the shortcoming of previous methods that require system model, a data-based optimal control policy is proposed for the output synchronization problem. Besides, the intrinsic equivalence relationship between model-based optimal solution and the proposed data-based optimal solution is proved. To solve the proposed control policy, a reinforcement learning algorithm based on measured input-output data is presented, which is different from existing model-free algorithms based on internal state. According to the algorithm, the optimal output synchronization problem of heterogeneous multi-agent systems can be solved when the full-state vector is unavailable. Finally, the effectiveness of proposed algorithm is verified by simulation examples.