Operation Of Unmanned Aerial Vehicles Research Articles

An iterative up-sampling convolutional neural network for glass curtain crack detection using unmanned aerial vehicles

It is inefficient, subjective, and potentially life-threatening for both inspectors and pedestrians to manually inspect glass curtain cracks of high-rise buildings. Due to the development of image instance segmentation techniques for deep learning and the operation of compact unmanned aerial vehicles (UAVs), automatic, accurate, and safe glass curtain crack inspection can be achieved. A novel approach proposes to segment glass curtain cracks efficiently and accurately, combining a convolutional neural network (CNN), the region of interest alignment (RoIAlign), and an iterative up-sampling method. The approach proposed achieves excellent performance with an accuracy=99.89%, precision=91.1%, recall=72.1%, F1-score=79.7%, and mIoU=78.7%. Comparative studies have been conducted to examine the performance of the proposed approach relative to Solo, Swin, Mask RCNN, and ConvNext V2. The results show that the proposed network outperforms the networks used for comparison and that it can more accurately detect and segment a variety of crack types in complex reflective environments of glass curtains.

Joint Design of Transmit Waveform and Altitude for Unmanned Aerial Vehicle-Enabled Integrated Sensing and Wireless Power Transfer Systems

Recently, unmanned aerial vehicle (UAV)-enabled wireless power transfer (WPT) has received great attention as a promising technology for providing stable power to energy-constrained devices by navigating three-dimensional (3D) space, particularly in challenging environments such as maritime networks and smart cities. Additionally, UAV-enabled radar sensing has gained significant attention as a key technology for future 6G networks, as it enables high-accuracy sensing for various applications, such as target detection and tracking, surveillance, and environmental monitoring, as well as autonomous UAV operation. In this regard, we investigated UAV-enabled integrated sensing and wireless power transfer (ISWPT) systems that combine radar sensing and WPT operations on a unified hardware platform, sharing the same spectrum of resources. In order to accurately sense multiple targets and efficiently transfer power to multiple devices at the same time, we propose a method for jointly designing the transmit waveform and UAV altitude, taking into account the fundamental trade-off between radar sensing performance with the desired beam pattern and WPT performance with the desired harvested power of the devices. We first developed an effective method to obtain the optimal waveform and altitude by solving a challenging non-convex optimization problem. Based on this, we developed another efficient, low-complexity method by exploring a novel transmit waveform and optimizing its parameters to reduce computational complexity and thereby lower power consumption in UAVs. The numerical results verify that the proposed method significantly improves both radar sensing and WPT performance, as well as substantially reduces computational complexity.

Hybrid Machine Learning and Reinforcement Learning Framework for Adaptive UAV Obstacle Avoidance

This review explores the integration of machine learning (ML) and reinforcement learning (RL) techniques in enhancing the navigation and obstacle avoidance capabilities of Unmanned Aerial Vehicles (UAVs). Various RL algorithms are assessed for their effectiveness in teaching UAVs autonomous navigation, with a focus on state representation from UAV sensors and real-time environmental interaction. The review identifies the strengths and limitations of current methodologies and highlights gaps in the literature, proposing future research directions to advance UAV technology. Interdisciplinary approaches combining robotics, AI, and aeronautics are suggested to improve UAV performance in complex environments.

Optimal trajectories for UAV three-dimensional path planning using a hybrid ABC-RRT* algorithm

Path planning is critical to the effective operation of unmanned aerial vehicles (UAVs) in complex environments. It is crucial to quickly determine the best path for UAV navigation. In this paper, a novel approach for unmanned aerial vehicle (UAV) path planning is presented by combining the robust artificial bee colony (ABC) algorithm with the flexible rapidly exploring random tree star (RRT*) algorithm. The main objective of this approach is to ensure effective obstacle avoidance. The proposed hybrid algorithm, ABC-RRT*, is compared with several current approaches, namely Improved ABC (IABC), ABC, Particle Swarm Optimization (PSO), ABC-PSO and RRT. ABC-RRT* combines the exploration capabilities of ABC with the route optimization capabilities of RRT* to efficiently determine the best trajectories for UAVs by balancing exploration and exploitation. ABC integration increases the effectiveness of exploration, while RRT* excels at identifying shorter paths and adapting to different conditions. ABC-RRT* has been shown to outperform other methods in terms of path length and flexibility when traversing complicated terrain with many obstacles. This was proven by extensive simulations in various situations. The results demonstrate the effectiveness, fast convergence and robustness of ABC-RRT* and make it a viable solution for obstacle avoidance of UAVs in practice. The fusion of ABC and RRT* for obstacle avoidance shows great potential for UAV route planning and offers remarkable advantages compared to conventional approaches.

Extremum Seeking-Based Radio Signal Strength Optimization Algorithm for Hoverable UAV Path Planning

For the safe autonomous operations of unmanned aerial vehicles (UAVs) and ground control stations (GCS), including autonomous battery replacement, wireless power transfer, and more, the precise landing of UAVs on GCS is essential. Accurate landing is only possible when the link capacity strength exceeds a certain threshold, but this is often disturbed due to complex terrain. To address this, we developed an extremum seeking (ES)-based radio signal strength optimization (RSSO) algorithm, ES-RSSO, designed to find the optimal positions of the UAV using radio communication signals. This ensures energy-efficient path planning while guaranteeing the minimum received signal strength indication (RSSI) capacity. This algorithm is particularly useful in obstacle-rich environments, where UAVs are limited in power resources. Simulation results demonstrate a 2.37% decrease in the mean, a 62.08% improvement in variance, and a 3.72% decrease in the integration strength of the link capacity when ES-RSSO is applied. These results confirm that the RADIO.rssi maintenance ability remains above a critical boundary level, supporting robust communication links and energy-efficient path planning. Throughout the study, we showed how, in many cases, simply moving the UAV a few meters can significantly improve the communication link.

Event-triggered finite-time adaptive neural network control for quadrotor UAV with input saturation and tracking error constraints

In this article, an event-triggered finite-time adaptive neural network control tracking strategy is proposed for quadrotor unmanned aerial vehicle (UAV) with input saturation and error constraints. Firstly, the radial basis function neural networks (RBFNNs) are adopted to identify the unknown uncertainty of quadrotor UAV model from the installation errors, gyroscope errors and so on. An auxiliary equation is constructed to deal with input physical saturation from the actuator motors. Additionally, by combining the performance function and error transformation, the issue of error constraint is solved. Based on the Lyapunov stability theory and event-triggered mechanisms, a finite-time adaptive neural network scheme is developed to ensure that the closed-loop quadrotor UAV system is semi-globally practically finite-time stable, and save the computation, resources, and transmission load. Finally, the simulation results illustrate the good tracking performance of quadrotor UAV by using the proposed control strategy.

Multi-Agent DRL for Air-to-Ground Communication Planning in UAV-Enabled IoT Networks.

In this paper, we present a novel method to enhance the sum-rate effectiveness in full-duplex unmanned aerial vehicle (UAV)-assisted communication networks. Existing approaches often couple uplink and downlink associations, resulting in suboptimal performance, particularly in dynamic environments where user demands and network conditions are unpredictable. To overcome these limitations, we propose a decoupling of uplink and downlink associations for ground-based users (GBUs), significantly improving network efficiency. We formulate a comprehensive optimization problem that integrates UAV trajectory design and user association, aiming to maximize the overall sum-rate efficiency of the network. Due to the problem's non-convexity, we reformulate it as a Partially Observable Markov Decision Process (POMDP), enabling UAVs to make real-time decisions based on local observations without requiring complete global information. Our framework employs multi-agent deep reinforcement learning (MADRL), specifically the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm, which balances centralized training with distributed execution. This allows UAVs to efficiently learn optimal user associations and trajectory controls while dynamically adapting to local conditions. The proposed solution is particularly suited for critical applications such as disaster response and search and rescue missions, highlighting the practical significance of utilizing UAVs for rapid network deployment in emergencies. By addressing the limitations of existing centralized and distributed solutions, our hybrid model combines the benefits of centralized training with the adaptability of distributed inference, ensuring optimal UAV operations in real-time scenarios.

A Low-Cost and Lightweight Real-Time Object-Detection Method Based on UAV Remote Sensing in Transportation Systems

Accurate detection of transportation objects is pivotal for enhancing driving safety and operational efficiency. In the rapidly evolving domain of transportation systems, the utilization of unmanned aerial vehicles (UAVs) for low-altitude detection, leveraging remotely-sensed images and videos, has become increasingly vital. Addressing the growing demands for robust, real-time object-detection capabilities, this study introduces a lightweight, memory-efficient model specifically engineered for the constrained computational and power resources of UAV-embedded platforms. Incorporating the FasterNet-16 backbone, the model significantly enhances feature-processing efficiency, which is essential for real-time applications across diverse UAV operations. A novel multi-scale feature-fusion technique is employed to improve feature utilization while maintaining a compact architecture through passive integration methods. Extensive performance evaluations across various embedded platforms have demonstrated the model’s superior capabilities and robustness in real-time operations, thereby markedly advancing UAV deployment in crucial remote-sensing tasks and improving productivity and safety across multiple domains.

Neural Signature and Decoding of Unmanned Aerial Vehicle Operators in Emergency Scenarios Using Electroencephalography.

Brain-computer interface (BCI) offers a novel means of communication and control for individuals with disabilities and can also enhance the interactions between humans and machines for the broader population. This paper explores the brain neural signatures of unmanned aerial vehicle (UAV) operators in emergencies and develops an operator's electroencephalography (EEG) signals-based detection method for UAV emergencies. We found regularity characteristics similar to classic event-related potential (ERP) components like visual mismatch negativity (vMMN) and contingent negative variation (CNV). Source analysis revealed a sequential activation of the occipital, temporal, and frontal lobes following the onset of emergencies, corresponding to the processing of attention, emotion, and motor intention triggered by visual stimuli. Furthermore, an online detection system was implemented and tested. Experimental results showed that the system achieved an average accuracy of over 88% in detecting emergencies with a detection latency of 431.95 ms from the emergency onset. This work lays a foundation for understanding the brain activities of operators in emergencies and developing an EEG-based detection method for emergencies to assist UAV operations.

Adaptive quadrotor control using online dynamic mode decomposition

Precision control of Unmanned Aerial Vehicles (UAVs) is essential for deployment in a wide range of applications. However, real-world flight conditions often deviate from ideal operating scenarios, presenting uncertainties such as external disturbances and unmodeled dynamics. These can dramatically impact tracking accuracy and stability. This study proposes a novel adaptive control technique for quadrotors based on Windowed Dynamic Mode Decomposition (DMDc) techniques. This techniques efficiently identifies dynamic models directly from data, and updates this model in real-time, allowing the controller to compensate for changing conditions. To facilitate realistic validation, the proposed system is integrated within a Hardware-in-the-Loop (HiL) framework. In a series of simulated experiments, the adaptive controller demonstrates improvement in trajectory tracking under disturbances when compared to a conventional inverse dynamics approach. This research underscores the promise of DMDc-based techniques combined with adaptive control to enhance UAV operation, enabling safer and more robust performance in demanding scenarios.

Detecting Denial of Service Attacks (DoS) over the Internet of Drones (IoD) Based on Machine Learning

The use of Unmanned Aerial Vehicles (UAVs) or drones has increased lately. This phenomenon is due to UAVs’ wide range of applications in fields such as agriculture, delivery, security and surveillance, and construction. In this context, the security and the continuity of UAV operations becomes a crucial issue. Spoofing, jamming, hijacking, and Denial of Service (DoS) attacks are just a few categories of attacks that threaten drones. The present paper is focused on the security of UAVs against DoS attacks. It illustrates the pros and cons of existing methods and resulting challenges. From here, we develop a novel method to detect DoS attacks in UAV environments. DoS attacks themselves have many sub-categories and can be executed using many techniques. Consequently, there is a need for robust protection and mitigation systems to shield UAVs from DoS attacks. One promising security solution is intrusion detection systems (IDSs). IDs paired with machine learning (ML) techniques provide the ability to greatly reduce the risk, as attacks can be detected before they happen. ML plays an important part in improving the performance of IDSs. The many existing ML models that detect DoS attacks on UAVs each carry their own strengths and limitations.

Online Trajectory Replanning for Avoiding Moving Obstacles Using Fusion Prediction and Gradient-Based Optimization

In this study, we introduce a novel method for an online trajectory replanning approach for fixed-wing Unmanned Aerial Vehicles (UAVs). Our method integrates moving obstacle predictions within a gradient-based optimization framework. The trajectory is represented by uniformly discretized waypoints, which serve as the optimization variables within the cost function. This cost function incorporates multiple objectives, including obstacle avoidance, kinematic and dynamic feasibility, similarity to the reference trajectory, and trajectory smoothness. To enhance prediction accuracy, we combine physics-based and pattern-based methods for predicting obstacle movements. These predicted movements are then integrated into the online trajectory replanning framework, significantly enhancing the system’s safety. Our approach provides a robust solution for navigating dynamic environments, ensuring both optimal and secure UAV operation.

Optimising Drone-Assisted Logistics for Urban Last-Mile Delivery: An Overview of Applications, Methodologies, and Emerging Trends

The rapid evolution of drone-assisted logistics for urban last-mile (ULM) delivery has garnered significant interest from both academia and industry. This article presents a comprehensive review of the state-of-the-art research and practical implementations of ULM systems, focusing on the use of unmanned aerial vehicles (UAVs) for the final stage of goods and parcel delivery in urban environments. The applicability of UAV-based logistics across various contexts, including urban and rural areas, is examined, with real-world case studies highlighted to demonstrate practical uses. Key methodologies and models employed in optimising UAV routing and operations are discussed, particularly those that enhance the efficiency and reliability of ULM. The critical advantages and limitations of drone-assisted last-mile logistics are analysed, providing insights into the operational, regulatory, and technological challenges. The discussion is further expanded by addressing emerging trends in UAV technology, as well as innovations in drone deployment strategies and the evolving regulatory landscape. In conclusion, potential theoretical advancements and future applications of ULM systems are outlined, with an emphasis on integrating drones into broader logistics networks and smart city frameworks. The insights offered aim to guide future research and practical developments in this rapidly advancing field.

Utilization of Unmanned Aerial Vehicle for Monitoring and Surveillance of Aquaculture Farms: A Proposed Framework

Abstract: In this paper, unmanned aerial vehicles (UAVs) for monitoring and surveillance within aquaculture farms situated in Iloilo, Philippines are investigated. The principal aim is to create a framework that can provide guidance on how to use UAVs for effective monitoring, data collection, and regulatory control within the aquaculture sector under the supervision of BFAR – Department of Agriculture. The study examines the performance of UAVs in real-time surveillance mapping as well as geotagging and geo-referencing that would help in observing fish behavior and environmental settings. The research assesses the precision of UAVs in executing these assignments and compares various models based on their effectiveness in monitoring perimeters environmental data collecting and following changes in fish behavior. Findings reveal that UAVs especially those with high detection precision levels and advanced mapping capabilities may be good tools for improving management practices on aquaculture farms. The paper suggests some ways we may adopt UAV technology within aquaculture emphasizing its potential to minimize operational costs while at the same time increasing productivity. With the help of these findings, it is possible to develop initial guidelines for UAV use in the aquaculture industry that will serve as a basis for a regulatory framework ensuring the sustainable and efficient functioning of aquaculture farms. This framework seeks to support local government initiatives in enhancing farm monitoring, protecting the environment and managing resources by using advanced UAV technology.

A New Precise Point Positioning with Ambiguity Resolution (PPP-AR) Approach for Ground Control Point Positioning for Photogrammetric Generation with Unmanned Aerial Vehicles

Unmanned aerial vehicles (UAVs) are now widely preferred systems that are capable of rapid mapping and generating topographic models with relatively high positional accuracy. Since the integrated GNSS receivers of UAVs do not allow for sufficiently accurate outcomes either horizontally or vertically, a conventional method is to use ground control points (GCPs) to perform bundle block adjustment (BBA) of the outcomes. Since the number of GCPs to be installed limits the process in UAV operations, there is an important research question whether the precise point positioning (PPP) method can be an alternative when the real-time kinematic (RTK), network RTK, and post-process kinematic (PPK) techniques cannot be used to measure GCPs. This study introduces a novel approach using precise point positioning with ambiguity resolution (PPP-AR) for ground control point (GCP) positioning in UAV photogrammetry. For this purpose, the results are evaluated by comparing the horizontal and vertical coordinates obtained from the 24 h GNSS sessions of six calibration pillars in the field and the horizontal length differences obtained by electronic distance measurement (EDM). Bartlett’s test is applied to statistically determine the accuracy of the results. The results indicate that the coordinates obtained from a two-hour PPP-AR session show no significant difference from those acquired in a 30 min session, demonstrating PPP-AR to be a viable alternative for GCP positioning. Therefore, the PPP technique can be used for the BBA of GCPs to be established for UAVs in large-scale map generation. However, the number of GCPs to be selected should be four or more, which should be homogeneously distributed over the study area.

Distributed decision making for unmanned aerial vehicle inspection with limited energy constraint

The unsatisfactory energy density of the state-of-art batteries imposes constraints on the practical application of unmanned aerial vehicles (UAVs). Establishing a UAV airport network that integrates energy supply and information exchange functionalities represents an ideal solution for enabling synergistic UAV operations. However, devising efficient distribution protocols for these airports remains a challenge. By leveraging modeling and analysis of the energy density of existing UAV batteries, we can forecast the flight range and distances achievable by UAVs. Here, we propose a distribution protocol for UAV airport platforms aimed at enhancing distribution accuracy by the use of AI principles. Furthermore, considering the possibility of emergency UAV stop, we introduce an emergency stop system in conjunction with standard stopping procedures to optimize distribution efficiency and enhance UAV inspection safety. Moreover, existing UAV airports usually provide energy to UAVs without harnessing UAVs to facilitate interconnection and interoperability among different airports. This inefficiency leads to significant resource wastage in energy distribution. To address this, we introduce a shared energy network that allows different companies to operate according to energy distribution needs. This network not only supplies energy to UAVs but also employs UAVs for energy collection and transportation, facilitating energy trading, business collaboration, and data transmission among diverse organizations. By enabling ubiquitous energy trading, this study provides us an ideal strategy for the future construction of energy network with interconnection and interoperability, which can be extended to other applications calling for energy distribution.

A Review of Multi-UAV Task Allocation Algorithms for a Search and Rescue Scenario

Unmanned aerial vehicles (UAVs) play a crucial role in enhancing search and rescue (SAR) operations by accessing inaccessible areas, accomplishing challenging tasks, and providing real-time monitoring and modeling in situations where human presence is unsafe. Multi-UAVs can collaborate more efficiently and cost-effectively than a single large UAV for performing SAR operations. In multi-UAV systems, task allocation (TA) is a critical and complex process involving cooperative decision making and control to minimize the time and energy consumption of UAVs for task completion. This paper offers an exhaustive review of both static and dynamic TA algorithms, confidently assessing their strengths, weaknesses, and limitations. It provides valuable insights into addressing research questions related to specific UAV operations in SAR. The paper rigorously discusses outstanding issues and challenges and confidently presents potential directions for the future development of task assignment algorithms. Finally, it confidently highlights the challenges of multi-UAV dynamic TA methods for SAR. This work is crucial for gaining a comprehensive understanding of multi-UAV dynamic TA algorithms and confidently emphasizes critical open issues and research gaps for future SAR research and development, ensuring that readers feel informed and knowledgeable.

Enhancing UAV Crew Performance and Safety: A Technology and Innovation Management Perspective

The integration of Unmanned aerial vehicles (UAVs) into various sectors underscores the importance of optimizing human factors to ensure operational efficiency, safety, and mission success. This study presents a comprehensive bibliometric analysis of the literature on human factors in UAV operations, focusing on cognitive workload, situational awareness, decision-making, ergonomic design, and human-machine interaction. The analysis was conducted using the WoS, covering publications from 2000 to 2023. Key findings include a significant increase in research output over the last decade, highlighting the growing interest and investment in UAV technology and human factors. Influential authors such as Rosenstein (2006), Patterson (2010), Reason (1990), Wiegmann (2001), and Shappell (2007), along with institutions like Beijing University of Posts and Telecommunications, Southeast University China, Xidian University, and Nanjing University of Aeronautics and Astronautics, have emerged as leaders in this field, contributing to advancements in ergonomic design and decision-making processes. Notably, there is a lack of comprehensive studies addressing the long-term cognitive workload effects on UAV operators and the development of standardized ergonomic guidelines tailored specifically for UAV operation environments. The integration of advanced human-machine interaction technologies remains underexplored, indicating a need for further research in this area. By highlighting these gaps, the analysis provides a nuanced understanding of current research dynamics, offering valuable implications for UAV operators, regulators, and policymakers. These findings are pivotal for advancing the field and guiding future research initiatives aimed at enhancing crew performance and safety in UAV operations.

Fixed-Wing UAV Pose Estimation Using a Self-Organizing Map and Deep Learning

In many Unmanned Aerial Vehicle (UAV) operations, accurately estimating the UAV’s position and orientation over time is crucial for controlling its trajectory. This is especially important when considering the landing maneuver, where a ground-based camera system can estimate the UAV’s 3D position and orientation. A Red, Green, and Blue (RGB) ground-based monocular approach can be used for this purpose, allowing for more complex algorithms and higher processing power. The proposed method uses a hybrid Artificial Neural Network (ANN) model, incorporating a Kohonen Neural Network (KNN) or Self-Organizing Map (SOM) to identify feature points representing a cluster obtained from a binary image containing the UAV. A Deep Neural Network (DNN) architecture is then used to estimate the actual UAV pose based on a single frame, including translation and orientation. Utilizing the UAV Computer-Aided Design (CAD) model, the network structure can be easily trained using a synthetic dataset, and then fine-tuning can be done to perform transfer learning to deal with real data. The experimental results demonstrate that the system achieves high accuracy, characterized by low errors in UAV pose estimation. This implementation paves the way for automating operational tasks like autonomous landing, which is especially hazardous and prone to failure.

Diagnostics of unmanned aerial vehicle with recurrence based approach of piezo-element voltage signals

This work experimentally addresses damage calibration of an unmanned aerial vehicle in operational condition. A wide range of damage level and types are simulated and controlled by an electric motor via pulse width modulation in this regard. The measurement is carried out via established protocols of using a piezo-patch on one of the 8 arms, utilising the vibration sensitivity and flexibility of the arms, demonstrating repeatability of such protocol. Subsequently, recurrence analysis on the voltage time series data is performed for detection of damage. Quantifiers of damage extent are then created for the full range of damage conditions, including the extreme case of complete loss of power. Experimental baseline condition for no damage condition is also established in this regard. Both diagonal-line and vertical-line based indicators from recurrence analysis are sensitive to the quantitative estimates of damage levels and a statistical test of significance analysis confirms that it is possible to automate distinguishing the levels of damage. The damage quantifiers proposed in this paper are useful for rapid monitoring of unmanned aerial vehicle operations of connection.