Single Unmanned Aerial Vehicles Research Articles

Prototype for Multi-UAV Monitoring–Control System Using WebRTC

Most unmanned aerial vehicle (UAV) ground control station (GCS) solutions today are either web-based or native applications, primarily designed to support a single UAV. In this paper, our research aims to provide an open, universal framework intended for rapid prototyping, addressing these objectives by developing a Web Real-Time Communication (WebRTC)-based multi-UAV monitoring and control system for applications such as automated power line inspection (APOLI). The APOLI project focuses on identifying damage and faults in power line insulators through real-time image processing, video streaming, and flight data monitoring. The implementation is divided into three main parts. First, we configure UAVs for hardware-accelerated streaming using the GStreamer framework on the NVIDIA Jetson Nano companion board. Second, we develop the server-side application to receive hardware-encoded video feeds from the UAVs by utilizing a WebRTC media server. Lastly, we develop a web application that facilitates communication between clients and the server, allowing users with different authorization levels to access video feeds and control the UAVs. The system supports three user types: pilot/admin, inspector, and customer. Our research aims to leverage the WebRTC media server framework to develop a web-based GCS solution capable of managing multiple UAVs with low latency. The proposed solution enables real-time video streaming and flight data collection from multiple UAVs to a server, which is displayed in a web application interface hosted on the GCS. This approach ensures efficient inspection for applications like APOLI while prioritizing UAV safety during critical scenarios. Another advantage of the solution is its integration compatibility with platforms such as cloud services and native applications, as well as the modularity of the plugin-based architecture offered by the Janus WebRTC server for future development.

A Review of Multi-UAV Task Allocation Algorithms for a Search and Rescue Scenario

Unmanned aerial vehicles (UAVs) play a crucial role in enhancing search and rescue (SAR) operations by accessing inaccessible areas, accomplishing challenging tasks, and providing real-time monitoring and modeling in situations where human presence is unsafe. Multi-UAVs can collaborate more efficiently and cost-effectively than a single large UAV for performing SAR operations. In multi-UAV systems, task allocation (TA) is a critical and complex process involving cooperative decision making and control to minimize the time and energy consumption of UAVs for task completion. This paper offers an exhaustive review of both static and dynamic TA algorithms, confidently assessing their strengths, weaknesses, and limitations. It provides valuable insights into addressing research questions related to specific UAV operations in SAR. The paper rigorously discusses outstanding issues and challenges and confidently presents potential directions for the future development of task assignment algorithms. Finally, it confidently highlights the challenges of multi-UAV dynamic TA methods for SAR. This work is crucial for gaining a comprehensive understanding of multi-UAV dynamic TA algorithms and confidently emphasizes critical open issues and research gaps for future SAR research and development, ensuring that readers feel informed and knowledgeable.

Research on a Distributed Cooperative Guidance Law for Obstacle Avoidance and Synchronized Arrival in UAV Swarms

In response to the issue where the original synchronization time becomes inapplicable for UAV swarms after temporal consistency convergence due to obstacle avoidance, a new distributed consultative temporal consistency guidance law that takes into account threat avoidance has been proposed. Firstly, a six-degree-of-freedom dynamic model and a guidance control model for unmanned aerial vehicles (UAVs) are established, and the guidance commands are decomposed into control signals for the pitch and yaw planes. Secondly, based on the theory of dynamic inversion control, a temporal consistency guidance law for a single UAV is constructed. On the other hand, an improved artificial potential field theory is used and integrated with a predictive correction network to generate guidance commands for threat avoidance. A threshold smoothing method is employed to integrate the two guidance systems, and a cluster consultation mechanism is introduced to design a two-layer temporal synchronization architecture, which negotiates to change the synchronization time of the swarm to achieve the convergence of consistency once again. Finally, in typical application scenarios, simulation verification demonstrates the effectiveness of the control method proposed in this paper. The proposed control method achieves the guidance of UAV formations to synchronize their arrival at the target location under complex threat conditions.

Aerodynamic Analysis of Fixed-Wing Unmanned Aerial Vehicles Moving in Swarm

This paper presents a close-formation flight of two unmanned aerial vehicles (UAVs) and the aim of the study is to improve the understanding of the vortex effects between fixed-wing UAVs in a swarm using computational fluid dynamics (CFD) tools. To validate the numerical method, results of a variable-density wind tunnel test from the literature were used. This numerical CFD analysis was used to determine the lift coefficient (CL) and the drag coefficient (CD) values for a single UAV at various angles of attack. When examining the aerodynamic impact areas behind the UAV, the longitudinal distance between the two UAVs is not particularly effective for close flight. Therefore, CFD analyses were carried out on the two UAVs for both vertical and lateral distances. The optimum position for close-formation flight was identified using CL/CD ratios. The results of the analysis indicate that the most effective flights, across all lateral positions, occur when the two UAVs are vertically at the same height. In terms of aerodynamic efficiency, the most effective points for close-formation flight for wingspan b are at lateral distances of 0.875 b and 1 b. At these positions, flight efficiency can be increased by approximately 11.5%.

CT-YoloTrad: fast and accurate recognition of point-distributed coded targets for UAV images incorporating CT-YOLOv7

Artificial point-distributed coded targets owns unique coded sequence numbers that can be recognized automatically. To address the issue of decreasing recognition accuracy and efficiency of existing recognition methods in complicated circumstances, an improved object detection model for coded target acquisition from unmanned aerial vehicle (UAV) images, CT-YOLOv7, is proposed. This improved model is based on the original YOLOv7 model, replacing several Conv with partial convolution (PConv), while introducing the bi-level routing attention mechanism, and designing the CBS-R structure and CBS-PR structure. In addition, the loss function is replaced with WIOU loss function to further improve the model’s performance. Based on the above, the new recognition method of point-distributed coded targets for UAV images is organized as follows. Firstly, CT-YOLOv7 is embedded into the front-end of the classical coded targets recognition process (that is, the coded targets are first extracted). Then, the extraction results are fed into the classical recognition algorithm for recognition. Lastly, the recognition results are inverse-calculated back to the original image. The new method aims to focus the processing on the region of interest to achieve fast and accurate coded targets recognition for UAV images. The experimental results show that CT-YOLOv7’s detection accuracy is 90.83%, which improves the accuracy by 8.46% and reduces the computation by 11.54% compared to the original YOLOv7. By incorporating the CT-YOLOv7 model, the time consumption for coded target recognition of a single UAV image is 150–350ms, which improves the average efficiency by 3–5 times compared with the classical method. Furthermore, the proposed method can correctly recognize regions with shadows and noise, and the recognition accuracy is improved by 15%–40%. With the method proposed in this paper, the coded targets are expected to be applied into UAV photogrammetry or remote sensing to realize accurate and quasi-real-time recognition.

A Deep Reinforcement Learning Algorithm for Trajectory Planning of Swarm UAV Fulfilling Wildfire Reconnaissance

Wildfires have long been one of the critical environmental disasters that require a careful monitoring system. An intelligent system has the potential to both prevent/extinguish the fire and deliver urgent requirements postfire. In recent years, unmanned aerial vehicles (UAVs), with the ability to detect missions in high-risk areas, have been gaining increasing interest, particularly in forest fire monitoring. Taking a large-scale area involved in a fire into consideration, a single UAV is often insufficient to accomplish the task of covering the whole disaster zone. This poses the challenge of multi-UAVs optimum path planning with a key focus on limitations such as energy constraints and connectivity. To narrow down this issue, this paper proposes a deep reinforcement learning-based trajectory planning approach for multi-UAVs that permits UAVs to extract the required information within the disaster area on time. A target area is partitioned into several identical subareas in terms of size to enable UAVs to perform their patrol duties over the subareas. This subarea-based arrangement converts the issue of trajectory planning into allowing UAVs to frequently visit each subarea. Each subarea is initiated with a risk level by creating a fire risk map optimizing the UAV patrol route more precisely. Through a set of simulations conducted with a real trace of the dataset, the performance outcomes confirmed the superiority of the proposed idea.

Collaborative computation offloading and wireless charging scheduling in multi-UAV-assisted MEC networks: A TD3-based approach

Computation offloading, resource allocation, and endurance issues in unmanned aerial vehicle (UAV)-aided mobile edge computing (MEC) networks have always been a research focus. UAV-aided MEC allows mobile users’ (MUs’) tasks to be offloaded to drones for processing in special scenarios, such as natural disasters or military attacks. However, as the number and size of offloaded tasks continuously increase, it is difficult for a single UAV to meet all computational demands, result in the decline of QoS. In order to address this issue, this paper presents a collaborative computation offloading scheme where multiple UAVs can cooperate to handle massive tasks. Firstly, considering that battery-limited UAVs cannot complete all tasks and sustain flight without recharging, we incorporate charging stations (CS) into multi-UAV-assisted MEC networks. Subsequently, we design a price-based incentive mechanism to encourage the adjacent UAVs with unused computation resources to cooperate with busy UAVs, so as to maximize the total revenue obtained from UAVs’ collaborative computation. Then, we formulate the joint optimization problem of computation offloading, resource allocation and charging scheduling as a Markov Decision Process (MDP), and propose a Twin Delayed Deep Deterministic policy gradient (TD3) algorithm to find optimal strategies. Finally, extensive simulations demonstrate that the proposed TD3 algorithm outperforms other benchmark methods, achieving the maximum overall system utility under different scenarios.

Multi-UAV Cooperative Coverage Search for Various Regions Based on Differential Evolution Algorithm.

In recent years, remotely controlling an unmanned aerial vehicle (UAV) to perform coverage search missions has become increasingly popular due to the advantages of the UAV, such as small size, high maneuverability, and low cost. However, due to the distance limitations of the remote control and endurance of a UAV, a single UAV cannot effectively perform a search mission in various and complex regions. Thus, using a group of UAVs to deal with coverage search missions has become a research hotspot in the last decade. In this paper, a differential evolution (DE)-based multi-UAV cooperative coverage algorithm is proposed to deal with the coverage tasks in different regions. In the proposed algorithm, named DECSMU, the entire coverage process is divided into many coverage stages. Before each coverage stage, every UAV automatically plans its flight path based on DE. To obtain a promising flight trajectory for a UAV, a dynamic reward function is designed to evaluate the quality of the planned path in terms of the coverage rate and the energy consumption of the UAV. In each coverage stage, an information interaction between different UAVs is carried out through a communication network, and a distributed model predictive control is used to realize the collaborative coverage of multiple UAVs. The experimental results show that the strategy can achieve high coverage and a low energy consumption index under the constraints of collision avoidance. The favorable performance in DECSMU on different regions also demonstrate that it has outstanding stability and generality.

Energy-Aware Microservice-Based Application Deployment in UAV-Based Networks for Rural Scenarios

Yearly, the rates of Internet penetration are on the rise, surpassing 80% in developed nations. Despite this progress, over two billion individuals in rural and low-income regions face a complete absence of Internet access. This lack of connectivity hinders the implementation of vital services like remote healthcare, emergency assistance, distance learning, and personal communications. To bridge this gap and bring essential services to rural populations, this paper leverages Unmanned Aerial Vehicles (UAVs). The proposal introduces a UAV-based network architecture and an energy-efficient algorithm to deploy Internet of Things (IoT) applications. These applications are broken down into microservices, strategically distributed among a subset of UAVs. This approach addresses the limitations associated with running an entire IoT application on a single UAV, which could lead to suboptimal outcomes due to battery and computational constraints. Simulation results conducted in a realistic scenario underscore the effectiveness of the proposed solution. The evaluation includes assessing the percentage of IoT requests successfully served to users in the designated area and reducing the energy consumption required by UAVs during the handling of such requests.

Enhanced Multi-UAV Path Planning in Complex Environments With Voronoi-Based Obstacle Modelling and Q-Learning

To tackle the challenge of obstacle avoidance path planning for multiple unmanned aerial vehicles (UAVs) in intricate environments, this study introduces a Voronoi graph–based model to represent the obstacle-laden environment and employs a Markov decision process (MDP) for single UAV path planning. The traditional Q-learning algorithm is enhanced by adjusting the initial state of the Q-table and fine-tuning the reward and penalty values, enabling the acquisition of efficient obstacle avoidance paths for individual UAVs in complex settings. Leveraging the improved Q-learning algorithm for single UAVs, the Q-table is iteratively refined for a fleet of UAVs, with dynamic modifications based on the waypoints chosen by each UAV. This approach ensures the generation of collision-free paths for multiple UAVs, as validated by simulation results that showcase the algorithm’s effectiveness in learning from past training data. The proposed method offers a robust framework for practical UAV trajectory generation in complex environments.

Air-borne stereo observation of ocean wave height using two independent cameras from a single unmanned aerial vehicle

Air-borne stereo observation of ocean wave height using two independent cameras from a single unmanned aerial vehicle

Formation Control of Quadrotor UAVs

In recent years, the rapid development of quadrotor unmanned aerial vehicles (UAVs) has resulted in their widespread applications across various scenarios. However, single UAVs encounter multiple challenges during mission execution. Consequently, an increasing number of tasks are being conducted in the form of UAV formations. This paper focuses on quadrotor UAVs and proposes a formation control scheme that can be validated through simulation and experimentation. The research begins with the dynamic modeling of quadrotor UAVs and the design of an experimental platform for UAVs. The formation structure of UAVs is then developed based on the Leader-Follower theory, and a multi-type PID controller is employed to design the formation control algorithm.

Enhancing air pollution mapping with autonomous UAV networks for extended coverage and consistency

In the context of today's pressing air pollution challenges, accurate and consistent air pollution mapping plays a pivotal role in understanding pollutant distribution and identifying pollution sources. While current technologies, including sensors and unmanned aerial vehicles (UAVs), have begun to address this issue, the full potential of UAV-based solutions remains largely untapped. This pioneering numerical study demonstrates the effective feasibility of precise and consistent air pollution mapping in local areas that exceed the coverage capacity of a single UAV. The approach involves employing multiple UAVs, which requires rigorous mission planning encompassing various complex stages. These stages include subdividing the mapping area into manageable sub-areas, evaluating the technical capabilities of each UAV, assigning specific tasks to UAVs, and conducting individual mapping operations. By endowing UAVs with full autonomy, horizontal air pollution maps are generated across different layers within the designated area. This method's distinct advantage is its simultaneous acquisition of vertical profiles at all points within the study region, eliminating the need for additional efforts. Through strategic technical analysis, it was revealed that each UAV's mission coverage area could be expanded by over 30%, leading to more consistent air pollution mapping. Furthermore, this finding suggests a reduction of up to 25% in the total number of UAVs required for studies covering significantly larger areas.

An aerial framework for Multi-View grape bunch detection and route Optimization using ACO

Typically, commercial orchards and vineyards consist of large fields that encounter similar development phases at once. Thus, it becomes necessary to efficiently fly over all fields to detect fruit and identify their status in a very limited timeframe. For this purpose, Unmanned Aerial Vehicles (UAVs) path planning plays a pivotal role in agriculture as it enables optimal coverage of agricultural fields, leading to enhanced data acquisition and improved precision agriculture practices, for instance, disease assessment and pesticide application. In addition, deep learning techniques offer precise image analysis. On the one hand, object detection has been applied to agricultural fields to carry out a wide range of operations, such as detecting apples and predicting yield in vineyards, with higher detection accuracy when the fruits are fully visible. On the other hand, when crops present leaf-occlusion, the algorithms face difficulties and are unable to adapt to the specific characteristics of the field. Therefore, this study seeks to address this issue by developing a novel framework to enhance UAV path planning for data collection in vineyards, considering the current biophysical environment. To this end, the proposed framework requires two flights: i) a first flight (survey) to acquire insights on the crop structure and environment, and ii) a second flight using the Ant Colony Optimization Max-Min Ant System (ACO-MMAS) algorithm to enhance image acquisition by considering multiple angles to overcome partial leaf-occlusion. Further, the optimisation algorithm can potentially boost the acquisition of datasets for fruit detection by considering single and multiple UAVs flying synchronously while ensuring a safe distance between platforms and efficient coverage. The method was tested in two vineyards with different environmental characteristics, increasing levels of difficulty and acquired during two different growing seasons. It improved the length of the computed paths by up to 24%, compared to a base algorithm that considers only the closest point without any optimisation, improving the decision-making processes and resource allocation in crop management.

Energy-efficient UAV communication: A NOMA scheme with resource allocation and trajectory optimization.

This work investigates a downlink nonorthogonal multiple access (NOMA) scheme with unmanned aerial vehicle (UAV) aided wireless communication, where a single UAV was regarded as an air base station (ABS) to communicate with multiple ground users. Considering the constraints of velocity and maneuverability, a UAV energy efficiency (EE) model was proposed via collaborative design resource allocation and trajectory optimization. Based on this, an EE maximization problem was formulated to jointly optimize the transmit power of ground users and the trajectory of the UAV. To obtain the optimal solutions, this nonconvex problem was transformed into an equivalent convex optimization problem on the basis of three user clustering algorithms. After several alternating iterations, our proposed algorithms converged quickly. The simulation results show an enhancement in EE with NOMA because our proposed algorithm is nearly 99.6% superior to other OMA schemes.

Distributed formation control for leader‐follower quadrotor unmanned aerial vehicles system based on practical sliding mode and event‐triggered mechanisms

AbstractThis article investigates the distributed formation trajectory tracking problem of a homogeneous quadrotor unmanned aerial vehicles (UAVs) system using a leader‐follower consensus protocol in three‐dimensional space. To enable the follower UAVs in the swarm to track a single leader UAV and form a desired formation under undirected topology, a six‐degree‐of‐freedom dynamic model with bounded time‐varying disturbances is established, which is divided into a tracking subsystem and a stabilizing subsystem. A practical sliding mode control (PSMC) based event‐triggered algorithm is proposed to achieve distributed formation control for a leader‐follower quadrotor UAVs system and reduce the network transmission resources. To address the potential issue of inter‐UAVs collisions during formation, an artificial potential field (APF) method is introduced in the tracking subsystem, and an disturbance observer is introduced in the stabilizing subsystem to estimate the unknown external disturbances. The boundedness of signals in the closed‐loop system is demonstrated using Lyapunov stability theory, and the exclusion of Zeno behavior can be ensured by having a positive lower bound on the inter‐event time between two consecutive triggering events. Finally, the effectiveness of the proposed event‐triggered algorithm is validated through simulation examples.

UAV-Enabled Integrated Sensing and Communication: Opportunities and Challenges

Unmanned aerial vehicle (UAV)-enabled integrated sensing and communication (ISAC) has attracted growing research interests in the context of sixth-generation (6G) wireless networks, in which UAVs will be exploited as aerial wireless platforms to provide better coverage and enhanced sensing and communication (S&C) services. However, due to the size, weight, and power (SWAP) constraints of UAVs, their controllable mobility, and the line-of-sight (LoS) air-ground channels, UAVenabled ISAC introduces new opportunities and challenges. This article provides an overview of UAV-enabled ISAC and proposes various solutions for optimizing the S&C performance. In particular, we first introduce UAV-enabled joint S&C and discuss UAV motion control, wireless resource allocation, and interference management for ISAC systems employing single and multiple UAVs. Then, we present two application scenarios for exploiting the synergy between S&C, namely sensing-assisted UAV communication and communication-assisted UAV sensing. Finally, we highlight several interesting research directions to guide and motivate future work.

See farther and more: a master-slave UAVs based synthetic optical aperture imaging system with wide and dynamic baseline.

An open challenge remained in designing an optical system to capture the aerial image with a wide field of view (FoV) and high resolution. The optical system of one camera from a single unmanned aerial vehicle (UAV) can hardly promise the FoV and resolution. The conventional swarm UAVs can form the camera array with a short or fixed baseline. They can capture the images with a wide FoV and high resolution, but the cost is the requirement of many UAVs. We aim to design a camera array with a wide and dynamic baseline to reduce the demand for UAVs to organize a synthetic optical aperture. In this thought, we propose a master-slave UAVs-based synthetic optical aperture imaging system with a wide and dynamic baseline. The system consists of one master UAV and multiple slave UAVs. Master and slave UAVs provide the global and local FoVs, respectively, and improve the efficiency of image acquisition. In such a system, fusing UAV images becomes a new challenge due to two factors: (i) the small FoV overlap of slave UAVs and (ii) the gap in resolution scale from slave to master UAV images. To deal with it, a coarse-to-fine stitching method is proposed to stitch up the multi-view images into one to obtain a wide FoV with high resolution. A video stabilization method has also been designed for the proposed imaging system. Challenges caused by wide and dynamic baselines can thus be solved by the above methods. Actual data experiments demonstrate that the proposed imaging system achieves high-quality imaging results.

Unmanned Aerial Vehicle-Based Structural Health Monitoring and Computer Vision-Aided Procedure for Seismic Safety Measures of Linear Infrastructures.

Computer vision in the structural health monitoring (SHM) field has become popular, especially for processing unmanned aerial vehicle (UAV) data, but still has limitations both in experimental testing and in practical applications. Prior works have focused on UAV challenges and opportunities for the vibration-based SHM of buildings or bridges, but practical and methodological gaps exist specifically for linear infrastructure systems such as pipelines. Since they are critical for the transportation of products and the transmission of energy, a feasibility study of UAV-based SHM for linear infrastructures is essential to ensuring their service continuity through an advanced SHM system. Thus, this study proposes a single UAV for the seismic monitoring and safety assessment of linear infrastructures along with their computer vision-aided procedures. The proposed procedures were implemented in a full-scale shake-table test of a natural gas pipeline assembly. The objectives were to explore the UAV potential for the seismic vibration monitoring of linear infrastructures with the aid of several computer vision algorithms and to investigate the impact of parameter selection for each algorithm on the matching accuracy. The procedure starts by adopting the Maximally Stable Extremal Region (MSER) method to extract covariant regions that remain similar through a certain threshold of image series. The feature of interest is then detected, extracted, and matched using the Speeded-Up Robust Features (SURF) and K-nearest Neighbor (KNN) algorithms. The Maximum Sample Consensus (MSAC) algorithm is applied for model fitting by maximizing the likelihood of the solution. The output of each algorithm is examined for correctness in matching pairs and accuracy, which is a highlight of this procedure, as no studies have ever investigated these properties. The raw data are corrected and scaled to generate displacement data. Finally, a structural safety assessment was performed using several system identification models. These procedures were first validated using an aluminum bar placed on an actuator and tested in three harmonic tests, and then an implementation case study on the pipeline shake-table tests was analyzed. The validation tests show good agreement between the UAV data and reference data. The shake-table test results also generate reasonable seismic performance and assess the pipeline seismic safety, demonstrating the feasibility of the proposed procedure and the prospect of UAV-based SHM for linear infrastructure monitoring.

Co-Operatively Increasing Smoothing and Mapping Based on Switching Function

Collaborative localization is a technique that utilizes the exchange of information between multiple sensors or devices to improve localization accuracy and robustness. It has a wide range of applications in autonomous driving and unmanned aerial vehicles (UAVs). In the field of UAVs, collaborative localization can help UAVs perform autonomous navigation and mission execution in complex environments. However, when GNSS is not available, it becomes challenging to position the UAV swarm relative to each other. This is because the swarm loses its perception and constraint of the position relationship between each member. Consequently, the swarm faces the problem of the serious drift of relative accuracy for an extended period. Furthermore, when the environment is faced with complex obstruction challenges or a camera with low texture scenes, noise can make it more difficult to solve the relative position relationship between drones, and a single UAV may lose positioning capability. To solve these specific problems, this paper studies a swarm co-operative localization method in a GNSS-denied environment with loud noise interference. In this paper, we proposed a method that utilizes a distributed scheme based on an incremental smoothing and mapping (iSAM) algorithm for state estimation. It incorporates new anchor-free topological constraints to prevent positioning failures and significantly improve the system’s robustness. Additionally, a new switching function is applied in front of each factor of the loss function, which adjusts the switches in real time in response to the input information to improve observably the accuracy of the system. A novel co-operative incremental smoothing and mapping (CI-SAM) method is proposed and the method does not require a complete relative position measurement, which reduces the need for vehicle measurement equipment configuration. The effectiveness of the method is verified by simulation.