Team Of Robots Research Articles

Self-organizing nervous systems for robot swarms

We present the self-organizing nervous system (SoNS), a robot swarm architecture based on self-organized hierarchy. The SoNS approach enables robots to autonomously establish, maintain, and reconfigure dynamic multilevel system architectures. For example, a robot swarm consisting of n independent robots could transform into a single n –robot SoNS and then into several independent smaller SoNSs, where each SoNS uses a temporary and dynamic hierarchy. Leveraging the SoNS approach, we showed that sensing, actuation, and decision-making can be coordinated in a locally centralized way without sacrificing the benefits of scalability, flexibility, and fault tolerance, for which swarm robotics is usually studied. In several proof-of-concept robot missions—including binary decision-making and search and rescue—we demonstrated that the capabilities of the SoNS approach greatly advance the state of the art in swarm robotics. The missions were conducted with a real heterogeneous aerial-ground robot swarm, using a custom-developed quadrotor platform. We also demonstrated the scalability of the SoNS approach in swarms of up to 250 robots in a physics-based simulator and demonstrated several types of system fault tolerance in simulation and reality.

Adversarial imitation learning with deep attention network for swarm systems

AbstractSwarm systems consist of a large number of interacting individuals, which exhibit complex behavior despite having simple interaction rules. However, crafting individual motion policies that can manifest desired collective behaviors poses a significant challenge due to the intricate relationship between individual policies and swarm dynamics. This paper addresses this issue by proposing an imitation learning method, which derives individual policies from collective behavior data. The approach leverages an adversarial imitation learning framework, with a deep attention network serving as the individual policy network. Our method successfully imitates three distinct collective behaviors. Utilizing the ease of analysis provided by the deep attention network, we have verified that the individual policies underlying a certain collective behavior are not unique. Additionally, we have analyzed the different individual policies discovered. Lastly, we validate the applicability of the proposed method in designing policies for swarm robots through practical implementation on swarm robots.

Emergent Dynamic Formation through Optical Interactions in a Robot Swarm

Self‐organized formation is a key direction in swarm robotics. It is still challenging to design local interactions toward desired global formations and even more challenging for dynamic formations in a physical robot swarm system. Herein, a self‐organized method for emergent dynamic circling formation in a robot swarm through optical interactions is proposed. First, this method is quantitatively modeled based on the geometrical relations among robots. This model is further adjusted according to the characteristics of the robot swarm system. To demonstrate the effectiveness of this model, the effects of three key parameters of this model are tested on the size and disorder level of the emergent dynamic circling formation. The experimental results are consistent with the model predictions. Overall, a robot swarm system, in the physical environment, is quantitatively controlled to emerge a dynamic circling formation in this article. This work advances the swarm robotics for quantitatively designing local interactions among robots to reliably emerge dynamic global patterns.

A novel memetic algorithm for distributed shape formation of swarm robots with both acceleration and velocity constraints

A novel memetic algorithm for distributed shape formation of swarm robots with both acceleration and velocity constraints

Bioinspired cooperation in a heterogeneous robot swarm using ferrofluid artificial pheromones for uncontrolled environments

This article presents a novel bioinspired technology for the cooperation and coordination of heterogeneous robot swarms in uncontrolled environments, utilizing an artificial pheromone composed of magnetized ferrofluids. Communication between different types of robots is achieved indirectly through stigmergy, where messages are inherently associated with specific locations. This approach is advantageous for swarm experimentation outside controlled laboratory spaces, where localization is typically managed through centralized camera systems (e.g. infrared, RGB). Applying pheromone principles has also proven beneficial for various swarm behaviors. We introduce a detection methodology for the artificial ferrofluid pheromone using low-cost magnetic sensors, along with signal processing and parameter characterization. Experiments involved a heterogeneous swarm consisting of two types of robots: one equipped with camera and image processing capabilities and the other with basic sensor technologies. Validation in multiple uncontrolled environments (with varying floor surfaces, wind, and light conditions) demonstrated successful cooperation among robots with differing technological complexities using the proposed technology.

Drone Swarming and its Use in Minefield Laying Using Mathematical Methods

Drone Swarming and its Use in Minefield Laying Using Mathematical Methods

A high-effective swarm intelligence-based multi-robot cooperation method for target searching in unknown hazardous environments

To solve target searching problems for multi-robot cooperation with inaccurate target distance perception in unknown hazardous environments, a hybrid adaptive robotic particle swarm optimizer (RPSO) and grey wolf optimizer (GWO) based algorithm with continuous virtual target guidance is proposed for high effective path planning in the searching. In the initial searching stages, both the wolf behavior-generated position and the gbest position and the pbesti positions from RPSO are employed to guide the motions of robots. With the information provided by these initial robot movement paths, a geometric model is established to generate potential targets. The K-means cluster algorithm is introduced to estimate a virtual target position online from potential targets, with new robot-presenting route information to update the history path information. Then the virtual position is employed as one of the direction components to help the robots approach the actual target. In addition, to avoid mobile robots falling into local convergence, a heuristic moving direction determination scheme is utilized to make robots circumvent obstacles in swarm motions, as well as a mutual repulsion algorithm to keep them in a scattering state. Simulation experiments on different types of unknown environments with varied robot numbers and adaptability testing for a dynamic target are carried out to verify the feasibility of the proposed target searching method with comparisons to the other three famous target searching algorithms. It is verified from the results that the presented method can not only contribute a 100% success rate in all runs of searching for a stochastic dynamic target under a limited maximal velocity, but also produce both the shortest path length and minimum iterations in terms of statistical metrics over the comparative methods.

Simulation of a Bio-Inspired Flocking-Based Aggregation Behaviour in Swarm Robotics

Simulation of a Bio-Inspired Flocking-Based Aggregation Behaviour in Swarm Robotics

Emergence of Collective Behaviors for the Swarm Robotics Through Visual Attention-Based Selective Interaction

Emergence of Collective Behaviors for the Swarm Robotics Through Visual Attention-Based Selective Interaction

Parking problem by oblivious mobile robots in infinite grids

In this paper, the parking problem of a swarm of mobile robots has been studied. The robots are deployed at the nodes of an infinite grid, which has a subset of prefixed nodes marked as parking nodes. A parking node pi has a capacity of ki, which is given as an input and represents the number of robots it is capable of accommodating. As a solution to the parking problem, in the final configuration, robots need to partition themselves into groups so that each parking node contains a number of robots that are equal to the capacity of the node. It is assumed that the number of robots in the initial configuration equals the sum of the capacities of the parking nodes. The robots are assumed to be autonomous, anonymous, homogeneous, identical and oblivious. They operate under an asynchronous scheduler. They do not have any agreement on the coordinate axes, nor do they agree on a common chirality. All the initial configurations for which the problem is unsolvable have been identified. A deterministic distributed algorithm has been proposed for the remaining configurations, ensuring the solvability of the problem.

Reinforcement learning-based framework for whale rendezvous via autonomous sensing robots.

Rendezvous with sperm whales for biological observations is made challenging by their prolonged dive patterns. Here, we propose an algorithmic framework that codevelops multiagent reinforcement learning-based routing (autonomy module) and synthetic aperture radar-based very high frequency (VHF) signal-based bearing estimation (sensing module) for maximizing rendezvous opportunities of autonomous robots with sperm whales. The sensing module is compatible with low-energy VHF tags commonly used for tracking wildlife. The autonomy module leverages in situ noisy bearing measurements of whale vocalizations, VHF tags, and whale dive behaviors to enable time-critical rendezvous of a robot team with multiple whales in simulation. We conducted experiments at sea in the native habitat of sperm whales using an "engineered whale"-a speedboat equipped with a VHF-emitting tag, emulating five distinct whale tracks, with different whale motions. The sensing module shows a median bearing error of 10.55° to the tag. Using bearing measurements to the engineered whale from an acoustic sensor and our sensing module, our autonomy module gives an aggregate rendezvous success rate of 81.31% for a 500-meter rendezvous distance using three robots in postprocessing. A second class of fielded experiments that used acoustic-only bearing measurements to three untagged sperm whales showed an aggregate rendezvous success rate of 68.68% for a 1000-meter rendezvous distance using two robots in postprocessing. We further validated these algorithms with several ablation studies using a sperm whale visual encounter dataset collected by marine biologists.

Application of derivative and integral terminal sliding modes in leader-follower type systems"

Subject matter: The study focuses on the control methods for dr20 type robot swarms, specifically on the derivative and integral terminal sliding mode control combined with a nonlinear disturbance observer. The problem of effective swarm control is highly relevant in the current conditions of automation and robotics, especially in the context of performing complex tasks in limited space and in the presence of disturbances. Goal: The development and analysis of a simulation model for the movement of a robot swarm using advanced control methods to ensure system accuracy and stability. The research aims to improve the control methods for robot swarms, enhancing their efficiency and reliability in various operational conditions. Tasks: 1) Develop a simulation model of a robot swarm in the CoppeliaSimEDU environment, considering all necessary parameters for modeling real operating conditions. 2) Implement control algorithms for the leader and followers to maintain the swarm structure and avoid collisions. 3) Conduct a series of experiments to test the effectiveness of the proposed methods, analyzing the results in terms of stability and control accuracy. Methods: Modeling in CoppeliaSimEDU, implementing control algorithms based on derivative and integral terminal sliding mode control, applying a nonlinear disturbance observer to improve system stability. The applied methods allow for the consideration of various disturbances and ensure high control accuracy. Results: he proposed control model allows achieving high following accuracy and collision avoidance even in complex conditions. Experiments have shown that the control methods ensure the stability and accuracy of the robot swarm's movement, reducing the response time to external disturbances. The research results demonstrate that the use of derivative and integral terminal sliding mode control combined with a nonlinear disturbance observer significantly enhances the efficiency of multi-robot systems. Conclusions: The use of advanced control methods significantly improves the efficiency of multi-robot systems, ensuring their reliability and accuracy in real operating conditions. The proposed methods can be applied in various fields where the coordination of a large number of robots is required, including logistics, rescue operations, and environmental monitoring.

Integrated Optimization of Simultaneous Target Assignment and Path Planning for Aerial Robot Swarm

Integrated Optimization of Simultaneous Target Assignment and Path Planning for Aerial Robot Swarm

Robot learning on the job: Human-in-the-loop autonomy and learning during deployment

With the rapid growth of computing powers and recent advances in deep learning, we have witnessed impressive demonstrations of novel robot capabilities in research settings. Nonetheless, these learning systems exhibit brittle generalization and require excessive training data for practical tasks. To harness the capabilities of state-of-the-art robot learning models while embracing their imperfections, we present Sirius, a principled framework for humans and robots to collaborate through a division of work. In this framework, partially autonomous robots are tasked with handling a major portion of decision-making where they work reliably; meanwhile, human operators monitor the process and intervene in challenging situations. Such a human–robot team ensures safe deployments in complex tasks. Further, we introduce a new learning algorithm to improve the policy’s performance on the data collected from the task executions. The core idea is re-weighing training samples with approximated human trust and optimizing the policies with weighted behavioral cloning. We evaluate Sirius in simulation and on real hardware, showing that Sirius consistently outperforms baselines over a collection of contact-rich manipulation tasks, achieving an 8% boost in simulation and 27% on real hardware than the state-of-the-art methods in policy success rate, with twice faster convergence and 85% memory size reduction. Videos and more details are available at https://ut-austin-rpl.github.io/sirius/ .

Special Issue on Robotics and Mechatronics Technology for Aerial Robots

Aerial robot technologies, such as drones and unmanned aerial vehicles, are rapidly advancing in various domains. These robots now possess enhanced autonomous flying abilities and use sensor technology, Global Navigation Satellite System (GNSS), Light Detection and Ranging (LiDAR) system, and cameras to avoid obstacles, automatically land, and track flights. Evolving technologies in airspace management and route optimization ensure that flights are efficient and safe. Aerial robots have a wide range of applications, such as agriculture, disaster response, environmental monitoring, and inspection. These devices excel at precise data collection thanks to their high-resolution cameras and high-precision sensors. Swarm robotics, which allows collaboration between multiple aerial and ground robots, is also progressing. This enables quick coverage of large areas, which benefits disaster relief and land management. In addition, research and development of flying robots modeled after flying animals is underway. The evolution of aerial robots results in their efficient use in a variety of fields and new applications. This special issue includes the latest research papers and development reports on aerial robotic technology from the aforementioned perspectives. We hope that this special issue will pique researchers’ and engineers’ interest in aerial robots, thereby encouraging additional research and development. Finally, we would like to express our gratitude to all authors, all reviewers, the editorial board of the Journal of Robotics and Mechatronics, and Fuji Technology Press Ltd.

Body orientation change of neighbors leads to scale-free correlation in collective motion

Collective motion, such as milling, flocking, and collective turning, is a common and captivating phenomenon in nature, which arises in a group of many self-propelled individuals using local interaction mechanisms. Recently, vision-based mechanisms, which establish the relationship between visual inputs and motion decisions, have been applied to model and better understand the emergence of collective motion. However, previous studies often characterize the visual input as a transient Boolean-like sensory stream, which makes it challenging to capture the salient movements of neighbors. This further hinders the onset of the collective response in vision-based mechanisms and increases demands on visual sensing devices in robotic swarms. An explicit and context-related visual cue serving as the sensory input for decision-making in vision-based mechanisms is still lacking. Here, we hypothesize that body orientation change (BOC) is a significant visual cue characterizing the motion salience of neighbors, facilitating the emergence of the collective response. To test our hypothesis, we reveal the significant role of BOC during collective U-turn behaviors in fish schools by reconstructing scenes from the view of individual fish. We find that an individual with the larger BOC often takes on the leading role during U-turns. To further explore this empirical finding, we build a pairwise interaction mechanism on the basis of the BOC. Then, we conduct experiments of collective spin and collective turn with a real-time physics simulator to investigate the dynamics of information transfer in BOC-based interaction and further validate its effectiveness on 50 real miniature swarm robots. The experimental results show that BOC-based interaction not only facilitates the directional information transfer within the group but also leads to scale-free correlation within the swarm. Our study highlights the practicability of interaction governed by the neighbor’s body orientation change in swarm robotics and the effect of scale-free correlation in enhancing collective response.

Automatic Design of Robot Swarms under Concurrent Design Criteria: A Study Based on Iterated F‐Race

Automatic design is an appealing approach to realizing robot swarms. In this approach, a designer specifies a mission that the swarm must perform, and an optimization algorithm searches for the control software that enables the robots to perform the given mission. Traditionally, research in automatic design has focused on missions specified by a single design criterion, adopting methods based on single‐objective optimization algorithms. In this study, we investigate whether existing methods can be adapted to address missions specified by concurrent design criteria. We focus on the bi‐criteria case. We conduct experiments with a swarm of e‐puck robots that must perform sequences of two missions: each mission in the sequence is an independent design criterion that the automatic method must handle during the optimization process. We consider modular and neuroevolutionary methods that aggregate concurrent criteria via the weighted sum, hypervolume, or ‐norm. We compare their performance with that of Mandarina, an original automatic modular design method. Mandarina integrates Iterated F‐race as an optimization algorithm to conduct the design process without aggregating the design criteria. Results from realistic simulations and demonstrations with physical robots show that the best results are obtained with modular methods and when the design criteria are not aggregated.

Robo-Matter towards reconfigurable multifunctional smart materials

Maximizing materials utilization efficiency via enhancing their reconfigurability and multifunctionality offers a promising avenue in addressing the global challenges in sustainability. To this end, significant efforts have been made in developing reconfigurable multifunctional smart materials, which can exhibit remarkable behaviors such as morphing and self-healing. However, the difficulty in efficiently manipulating and controlling matter at the building block level with manageable cost and complexity, which is crucial to achieving superior responsiveness to environmental clues and stimuli, has significantly hindered the further development of such smart materials. Here we introduce a concept of Robo-Matter, which can be activated and controlled through external information exchange at the building block level, to enable a high-level of controllability, mutability and versatility for reconfigurable multifunctional smart materials. Using specially designed micro-robot building blocks with symmetry-breaking active motion modes, tunable anisotropic interactions, and interactive coupling with a programmable spatial-temporal dynamic light field, we demonstrate an emergent Robot-Matter duality, which enables a spectrum of desirable behaviors spanning from matter-like properties such as ultra-fast self-assembly and adaptivity, to robot-like properties including active force output, smart healing, smart morphing and infiltration. Our work demonstrates a promising direction for designing next-generation smart materials and large-scale robotic swarms.

Robust Optimization Models for Planning Drone Swarm Missions

This article presents methods of planning unmanned aerial vehicle (UAV) missions in which individual platforms work together during the reconnaissance of objects located within a terrain. The planning problem concerns determining the flight routes of a swarm, where each UAV has the ability to recognize an object using a specific type of sensor. The experiments described in this article were carried out for drone formation; one drone works as a swarm information hub and exchanges information with the ground control station (GCS). Numerical models for mission planning are presented, which take into account the important constraints, simplifying the description of the mission without too much risk of losing the platforms. Several types of objective functions were used to optimize swarm flight paths. The mission models are presented in the form of mixed integer linear programming problems (MILPs). The experiments were carried out on a terrain model built on the basis of graph and network theory. The method of building a network on which the route plan of a drone swarm is determined is precisely presented. Particular attention was paid to the description of ways to minimize the size of the network on which the swarm mission is planned. The presented methods for building a terrain model allow for solving the optimization problem using integer programming tasks.

Evaluating Swarm Robotics for Mining Environments: Insights into Model Performance and Application

The mining industry is experiencing a transformative shift with the integration of automation, particularly through autonomous haul truck systems, and further advancements are anticipated with the application of swarm robotics. This study evaluates the performance of four swarm robot models, namely baseline, ant, firefly, and honeybee, in optimizing key mining operations such as ore detection, extraction, and transportation. Simulations replicating real-world mining environments were conducted to assess improvements in operational efficiency, scalability, reliability, selectivity, and energy consumption. The results demonstrate that these models can significantly enhance the precision and productivity of mining activities, especially in complex and dynamic settings. A case study of the Pilbara iron ore mine in Australia is presented to illustrate the practical applicability of these models in an actual mining context. The study also highlights specific enhancements in each model, including role specialization in the ant model, advanced communication in the firefly model, and improved localization combined with hybrid control in the honeybee model. While the honeybee model showed superior performance in high-precision tasks, its reliability was limited under high-error conditions, and it faced a computational resources bottleneck in large-scale operations, highlighting the need for further development. By evaluating these models against performance criteria, the study identifies the most suitable swarm models for various mining conditions, offering insights into achieving more sustainable, scalable, and efficient mining operations.