Multi-agent Systems Research Research Articles

Suppressing defection by increasing temptation: The impact of smart cooperators on a social dilemma situation

In a social dilemma situation, where individual and collective interests are in conflict, it sounds a reasonable assumption that the presence of super or smart players, who simultaneously punish defection and reward cooperation without allowing exploitation, could solve the basic problem. The behavior of such a multi-strategy system, however, is more subtle than it is firstly anticipated. When exploring the complete parameter space we find that the emergence of cyclic dominance among strategies is rather common, which results in several counter-intuitive phenomena. For example, the defection level can be lowered at higher temptation, or weaker punishment provides better conditions for smart players. Our study indicates that smart cooperators can unexpectedly thrive under high temptation, emphasizing the complexity of strategic interactions. This study suggests that the principles governing these interactions can be applied to other moral behaviors, such as truth-telling and honesty, providing valuable insights for future research in multi-agent systems.

Formal Modelling and Verification of Probabilistic Resource Bounded Agents

Many problems in Multi-Agent Systems (MASs) research are formulated in terms of the abilities of a coalition of agents. Existing approaches to reasoning about coalitional ability are usually focused on games or transition systems, which are described in terms of states and actions. Such approaches however often neglect a key feature of multi-agent systems, namely that the actions of the agents require resources. In this paper, we describe a logic for reasoning about coalitional ability under resource constraints in the probabilistic setting. We extend Resource-bounded Alternating-time Temporal Logic (RB-ATL) with probabilistic reasoning and provide a standard algorithm for the model-checking problem of the resulting logic Probabilistic resource-bounded ATL (pRB-ATL). We implement model-checking algorithms and present experimental results using simple multi-agent model-checking problems of increasing complexity.

Advances in Multi-agent Systems Research: EUMAS 2021 Extended Selected Papers

Advances in Multi-agent Systems Research: EUMAS 2021 Extended Selected Papers

Robotic Park: Multi-Agent Platform for Teaching Control and Robotics

Multi-agent system research is a hot topic in different application domains. In robotics, multi-agent robot systems (MRS) can realize complex tasks even if the behavior of each individual agent seems simple thanks to the cooperation between them. Although many control algorithms for MRS are proposed, few experimental results are validated on real data, being essential to building new testbeds to conduct MRS research and teaching. Moreover, most existing platforms for experimentation do not offer an overall solution allowing software and hardware design tools. This paper describes the design and operation of Robotic Park, a new indoor experimental platform for research in multi-agent systems. The heterogeneity and flexibility of its configuration are two of its main features. It supports control strategies design and validation of MRS algorithms. Experiences can be carried out in a virtual environment, in a physical environment, or under a hybrid scheme, as digital twins have been developed in Gazebo and Webots. Currently, two types of aerial vehicles, the Crazyflie 2.X and the DJI Tello, are available. It also includes two types of differential mobile robots, the Turtlebot3 and the Khepera IV. Both internal and external positioning systems using different technologies such as Motion Capture or Ultra-WideBand are also available for experiences. All components are connected through ROS2 (Robot Operating System 2) which enables experiences under a centralized, distributed, or hybrid scheme, and different communication strategies can be implemented. A mixed reality experience that addresses the problem of formation control using event-based control illustrates the platform usage.

Structural Optimization of Architectural Environmental Art Design Based on Multiagent Simulation System

Underthe background of the new era, the architectural environment design is constantly changing. Architectural environment design is to beautify the environment and provide people with a pleasant architectural environment. No matter what time, beauty is the eternal theme and the pursuit of people. Structural bionic design is based on the natural prototype, which is transformed into understandable digital or technical models by extracting relevant structural and behavioral features as design elements. The application of this design technique in architectural devices not only has strong structural logic but also artistic beauty, and can form novel spatial form and structural form of architectural devices. By analyzing the present situation and existing problems of theoretical research and simulation experiment of multiagent system, the necessity of designing a multiagent system planning algorithm and developing distributed real-time simulation experiment system is pointed out. A good environmental art design scheme can be designed in many different styles, and the performance of the design renderings will also appear in different pictures. The really chosen design scheme depends on the designer’s conception theme and then look at the performance of the renderings. In recent years, the emergence of multiagent has had a great impact on building environment design. Multiagent technology is a comprehensive information technology that integrates artificial intelligence, network, digital, and other technologies.

From intelligent agents to trustworthy human-centred multiagent systems

The Agents, Interaction and Complexity research group at the University of Southampton has a long track record of research in multiagent systems (MAS). We have made substantial scientific contributions across learning in MAS, game-theoretic techniques for coordinating agent systems, and formal methods for representation and reasoning. We highlight key results achieved by the group and elaborate on recent work and open research challenges in developing trustworthy autonomous systems and deploying human-centred AI systems that aim to support societal good.

Multi-agent systems research in the United Kingdom

Multi-agent systems research in the United Kingdom

Emergent behaviours in multi-agent systems with Evolutionary Game Theory

The mechanisms of emergence and evolution of collective behaviours in dynamical Multi-Agent Systems (MAS) of multiple interacting agents, with diverse behavioral strategies in co-presence, have been undergoing mathematical study via Evolutionary Game Theory (EGT). Their systematic study also resorts to agent-based modelling and simulation (ABM) techniques, thus enabling the study of aforesaid mechanisms under a variety of conditions, parameters, and alternative virtual games. This paper summarises some main research directions and challenges tackled in our group, using methods from EGT and ABM. These range from the introduction of cognitive and emotional mechanisms into agents’ implementation in an evolving MAS, to the cost-efficient interference for promoting prosocial behaviours in complex networks, to the regulation and governance of AI safety development ecology, and to the equilibrium analysis of random evolutionary multi-player games. This brief aims to sensitize the reader to EGT based issues, results and prospects, which are accruing in importance for the modeling of minds with machines and the engineering of prosocial behaviours in dynamical MAS, with impact on our understanding of the emergence and stability of collective behaviours. In all cases, important open problems in MAS research as viewed or prioritised by the group are described.

Agent-based modelling for Urban Analytics: State of the art and challenges

Agent-based modelling (ABM) is a facet of wider Multi-Agent Systems (MAS) research that explores the collective behaviour of individual ‘agents’, and the implications that their behaviour and interactions have for wider systemic behaviour. The method has been shown to hold considerable value in exploring and understanding human societies, but is still largely confined to use in academia. This is particularly evident in the field of Urban Analytics; one that is characterised by the use of new forms of data in combination with computational approaches to gain insight into urban processes. In Urban Analytics, ABM is gaining popularity as a valuable method for understanding the low-level interactions that ultimately drive cities, but as yet is rarely used by stakeholders (planners, governments, etc.) to address real policy problems. This paper presents the state-of-the-art in the application of ABM at the interface of MAS and Urban Analytics by a group of ABM researchers who are affiliated with the Urban Analytics programme of the Alan Turing Institute in London (UK). It addresses issues around modelling behaviour, the use of new forms of data, the calibration of models under high uncertainty, real-time modelling, the use of AI techniques, large-scale models, and the implications for modelling policy. The discussion also contextualises current research in wider debates around Data Science, Artificial Intelligence, and MAS more broadly.

Multi-Agent Team Learning in Virtualized Open Radio Access Networks (O-RAN).

Starting from the concept of the Cloud Radio Access Network (C-RAN), continuing with the virtual Radio Access Network (vRAN) and most recently with the Open RAN (O-RAN) initiative, Radio Access Network (RAN) architectures have significantly evolved in the past decade. In the last few years, the wireless industry has witnessed a strong trend towards disaggregated, virtualized and open RANs, with numerous tests and deployments worldwide. One unique aspect that motivates this paper is the availability of new opportunities that arise from using machine learning, more specifically multi-agent team learning (MATL), to optimize the RAN in a closed-loop where the complexity of disaggregation and virtualization makes well-known Self-Organized Networking (SON) solutions inadequate. In our view, Multi-Agent Systems (MASs) with MATL can play an essential role in the orchestration of O-RAN controllers, i.e., near-real-time and non-real-time RAN Intelligent Controllers (RIC). In this article, we first provide an overview of the landscape in RAN disaggregation, virtualization and O-RAN, then we present the state-of-the-art research in multi-agent systems and team learning as well as their application to O-RAN. We present a case study for team learning where agents are two distinct xApps: power allocation and radio resource allocation. We demonstrate how team learning can enhance network performance when team learning is used instead of individual learning agents. Finally, we identify challenges and open issues to provide a roadmap for researchers in the area of MATL based O-RAN optimization.

Evolution of Combined Arms Tactics in Heterogeneous Multi-Agent Teams

Multi-agent systems research is concerned with the emergence of system-level behaviors from relatively simple agent interactions. Multi-agent systems research to date is primarily concerned with systems of homogeneous agents, with member agents both physically and behaviorally identical. Systems of heterogeneous agents with differing physical or behavioral characteristics may be able to accomplish tasks more efficiently than homogeneous teams, via cooperation between mutually complementary agent types. In this article, we compare the performance of homogeneous and heterogeneous teams in combined arms situations. Combined arms theory proposes that the application of heterogeneous forces, en masse, can generate effects far greater than outcomes achieved by homogeneous forces or the serial use of individual arms. Results from experiments show that combined arms tactics can emerge from simple agent interactions.

Multi-Agent Systems: Technical & Ethical Challenges of Functioning in a Mixed Group

Abstract In today's highly interconnected, open-networked computing world, artificial intelligence computer agents increasingly interact in groups with each other and with people both virtually and in the physical world. AI's current core challenges concern determining ways to build AI systems that function effectively and safely for people and the societies in which they live. To incorporate reasoning about people, research in multi-agent systems has engendered paradigmatic shifts in computer-agent design, models, and methods, as well as the development of new representations of information about agents and their environments. These changes have raised technical as well as ethical and societal challenges. This essay describes technical advances in computer-agent representations, decision-making, reasoning, and learning methods and highlights some paramount ethical challenges.

The Research of RoboCup2D Player Shooting Technique Based on Fuzzy Control

Multi-agent collaboration is the core task of multi-agent system (MAS) research. In order to explore a kind of multi-agent collaboration way with dynamic environment, this paper proposes a method based on fuzzy learning and applies it to RoboCup2D. In the RoboCup2D simulation competition, eleven players need to cooperate to win, so score becomes extremely critical. Therefore, this paper focus on shooting technique based on fuzzy control. In order to increase the scoring rate, We speculate through observation and testing that finding the correct shooting position and angle is the key. For solving the problem, this paper firstly design fuzzy controller for selecting the shooting path; and then, this paper purpose fuzzy neural network for optimizing shooting time; At last, this paper do lots of experiments to verify its effectiveness and find it does work on increasing the scoring rate. After optimization on the fuzzy control, we are fortunate to have won the national second prize in 2021 RoboCup China Open, and the goal accuracy has increased by 21.36%.

Delivering the Smart Grid: Challenges for Autonomous Agents and Multi-Agent Systems Research

Restructuring electricity grids to meet the increased demand caused by the electrification of transport and heating, while making greater use of intermittent renewable energy sources, represents one of the greatest engineering challenges of our day. This modern electricity grid, in which both electricity and information flow in two directions between large numbers of widely distributed suppliers and generators — commonly termed the ‘smart grid’ — represents a radical reengineering of infrastructure which has changed little over the last hundred years. However, the autonomous behaviour expected of the smart grid, its distributed nature, and the existence of multiple stakeholders each with their own incentives and interests, challenges existing engineering approaches. In this challenge paper, we describe why we believe that artificial intelligence, and particularly, the fields of autonomous agents and multi-agent systems are essential for delivering the smart grid as it is envisioned. We present some recent work in this area and describe many of the challenges that still remain.

Advances in Multi-agent Systems Research: EUMAS 2020 Extended Selected Papers

Advances in Multi-agent Systems Research: EUMAS 2020 Extended Selected Papers

Gist Trace-based Learning: Efficient Convention Emergence from Multilateral Interactions

The concept of conventions has attracted much attention in the multi-agent system research. In this article, we study the emergence of conventions from repeated n -player coordination games. Distributed agents learn their policies independently and are capable of observing their neighbours in a network topology. We distinguish two types of information representation about the observations: gist trace and verbatim trace. We conjecture that learning based on the gist trace, which overlooks the details and focuses only on the general choice of action of a neighbourhood, should achieve efficient convention emergence. To this end, a novel learning method that makes use of the gist trace is proposed. The experimental results confirm that the proposed method establishes conventions much faster than the state-of-the-art learning methods across diverse settings of multi-agent systems. In particular, the use of gist trace derived at a low level of abstraction further improves the efficiency of convention emergence.

A Heuristic Lowest Unknown-Degree Target Search Strategy Under Non-Structured Environment for Multi-Agent Systems

Multi-target searching is a hotspot and foundation topic in multi-agent systems research. However, most of the research is based on simple environment or known environment, which greatly limits the application of target search. In the non-structured environment, the searching result can be greatly affected by the complex terrain constraints and detectability of targets especially when we have no prior knowledge about the environment. In the paper, a novel search strategy combining maximum visibility and particle swarm optimization is proposed for the target search problem in a completely unknown and non-structural environment. The strategy utilizes the concept of visibility to describe how well the agent detects the map, and guides the agent to perform online path planning to complete the search task. In addition, considering the limited communication distance and communication bandwidth, the strategy introduces a cooperative mechanism for each agent to improve the search efficiency. Finally, in the experimental part, the search strategy is compared with the commonly used search strategies. Compared with the methods combining advantages, the proposed strategy can still achieve similar results, which proves the feasibility and efficiency of the strategy.

Artificial Intelligence for Social Impact: Learning and Planning in the Data‐to‐Deployment Pipeline

With the maturing of artificial intelligence (AI) and multiagent systems research, we have a tremendous opportunity to direct these advances toward addressing complex societal problems. In pursuit of this goal of AI for social impact, we as AI researchers must go beyond improvements in computational methodology; it is important to step out in the field to demonstrate social impact. To this end, we focus on the problems of public safety and security, wildlife conservation, and public health in low‐resource communities, and present research advances in multiagent systems to address one key cross‐cutting challenge: how to effectively deploy our limited intervention resources in these problem domains. We present case studies from our deployments around the world as well as lessons learned that we hope are of use to researchers who are interested in AI for social impact. In pushing this research agenda, we believe AI can indeed play an important role in fighting social injustice and improving society.

Research on Intelligent Control Based on Multi-Agent Technology and Its Application in Robot Field

Firstly, the definition and characteristics of multi-agent technology are described. By analyzing the application research literature of multi-agent technology at home and abroad, the basic research of multi-agent system is analyzed and the technological development in the direction of multi-agent consistency and control is combed. Then the technical methods of intelligent control are analyzed, and the application of intelligent control in robot field is analyzed and explored. It is pointed out that the advantages of intelligent control are open, hierarchical and distributed structure, strong comprehensive information processing ability, and good at handling uncertain, highly nonlinear and complex control tasks of the model. Its shortcomings are that the theoretical basis is still in the development stage, the control accuracy is not high, and the real-time performance is poor. Finally, the development direction of intelligent control is expounded in combination with the above contents, hoping to create conditions for the overall improvement of Chinese intelligent control technology.

Distributed observer-based control law with better dynamic performance based on distributed high-gain observer

ABSTRACTThe design of distributed observers is a hot topic in the research of multi-agent system. It can estimate the whole states of the plant with only portion of output information and the information communicated in the network. This paper introduces the high-gain matrix into the classical distributed observers to improve its convergence speed. In this scene, the performance of distributed observers-based control law can be improved. Since high-gain matrix change the structure of classical distributed observers, a group of sufficient conditions for the stability of the distributed high-gain observers are proved. Moreover, we prove the distributed high-gain observers-based control law satisfies certainty equivalency principle and the designed observer has performance recovery capability. A numerical simulation demonstrates the correction and superior property of our method.