Abstract
AbstractFor a long time, the formation control problem has been one of the core problems in the field of multi-agent collaboration. It’s goal is to make multiple agents form a formation in the tasks and move to a designated target point. In this paper, the reinforcement learning method is used to deal with a special formation problem, and the mean field theory is applied to Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm to make it effective in large-scale multi-agent formation problems. The algorithm is compared with MADDPG and Deep Deterministic Policy Gradient (DDPG) algorithm. In the simulation experiment, a team of UAVs are initialized at random positions in the two-dimensional space. The goal is to make the UAVs form an equilateral triangle with the shortest total displacement. We model the formation problem. In our algorithm, a reward function is designed based on the goal of making equilateral triangle formation and requirement of the shortest total displacement; Moreover, we define the equilateral triangle criterion and use it to evaluate the formation effect of multi-agent reinforcement learning. The results show that, compared with DDPG and MADDPG algorithms, MADDPG algorithm using the mean field method has obvious advantages over MADDPG and DDPG in terms of convergence speed and success rate in the formation problem.KeywordsMulti-agent reinforcement learningFormation controlMean-field theory
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.