Hybrid online learning control in networked multiagent systems: A survey

Abstract

SummaryThis survey paper studies deterministic control systems that integrate three of the most active research areas during the last years: (1) online learning control systems, (2) distributed control of networked multiagent systems, and (3) hybrid dynamical systems (HDSs). The interest for these types of systems has been motivated mainly by two reasons: First, the development of cheap massive computational power and advanced communication technologies, which allows to carry out large computations in complex networked systems, and second, the recent development of a comprehensive theory for HDSs that allows to integrate continuous‐time dynamical systems and discrete‐time dynamical systems in a unified manner, thus providing a unifying modeling language for complex learning‐based control systems. In this paper, we aim to give a comprehensive survey of the current state of the art in the area of online learning control in multiagent systems, presenting an overview of the different types of problems that can be addressed, as well as the most representative control architectures found in the literature. These control architectures are modeled as HDSs, which include as special subsets continuous‐time dynamical systems and discrete‐time dynamical systems. We highlight the different advantages and limitations of the existing results as well as some interesting potential future directions and open problems.