Autonomous Underwater Vehicle Research Articles

Adaptive Event-Triggered Consensus Control of Nonlinear Multi-Agent Systems via Output Feedback Methodology: An Application to Energy Efficient Consensus of AUVs

For dealing with the energy consumption in multi-agent systems (MASs), an event-triggered (ET) methodology is promising, which relies on the activation of communication devices only when communication of data is needed. This paper explores the leaderless consensus for nonlinear MASs using an adaptive ET approach via an output feedback methodology. This adaptive ET scheme is preferred as it can adapt to the environment through setting a communication threshold. The proposed approach renders the observed states of agents by use of nonlinear observers in an output feedback control dilemma, making it more practical. Simple Luenberger observers are developed to avoid the problem of always measuring agents’ states. The strategy of adaptive ET-based control is employed to minimize resource use and information transmission. Design conditions for the observer-based adaptive ET consensus control of nonlinear MASs have been derived via a Lyapunov function, containing state estimation error, consensus error, adaptation term, and nonlinearity bounds. In contrast to the existing methods, the present approach applies a more practical output feedback schema, uses adaptive ET proficiency, and deals with nonlinear agents. An example of a formation of autonomous underwater vehicles achieving the basic consensus realization between displacement and velocity is included to illustrate the viability of the resultant approach.

Event-Triggered Two-Part Separation Control of Multiple Autonomous Underwater Vehicles Based on Extended Observer

In this paper, we investigate the formation isolation regulation issue regarding multiple Autonomous Underwater Vehicles (AUVs) characterized by a “leader–follower” framework. Considering the cooperative–competitive relationship among the follower AUVs and the impact of unknown external disturbances, an extended state observer is designed based on backstepping to mitigate these disturbances, and an event-triggered control scheme is designed to realize the two-part consensus control within the multi-AUV system. Through rigorous theoretical analysis, it is shown that the system achieves asymptotic steadiness and is free from Zeno behavior under the proposed event-triggered control scheme. Finally, numerical simulations confirm the efficiency of the regulation strategy in achieving formation separation within the multi-AUV, where the trajectory tracking errors of individual AUVs gather in a compact vicinity close to the source, and the structure convergence is achieved, with the absence of Zeno behavior also demonstrated.

High-Efficiency Clustering Routing Protocol in AUV-Assisted Underwater Sensor Networks.

Currently, underwater sensor networks are extensively applied for environmental monitoring, disaster prediction, etc. Nevertheless, owing to the complicacy of the underwater environment, the limited energy of underwater sensor nodes, and the high latency of hydroacoustic channels, the energy-efficient operation of underwater sensor networks has become an important challenge. In this paper, a high-efficiency clustering routing protocol in AUV-assisted underwater sensor networks (HECRA) is proposed to address the energy limitations and low data transmission reliability in underwater sensor networks. The protocol optimizes the cluster head selection strategy of the traditional low-energy adaptive clustering hierarchy (LEACH) protocol by introducing the residual energy and node degree in the cluster head selection phase and performs some optimizations in the cluster formation and data transmission phases, including selecting clusters for joining by ordinary nodes based on the residual energy of the cluster head nodes and weight computation based on the depth and residual energy of the cluster head nodes to select the optimal message forwarding nodes. In addition, this paper introduces an autonomous underwater vehicle (AUV) as a dynamic relay node to improve network transmission efficiency. According to the simulation results, compared with the existing LEACH, the energy efficient routing protocol based on layers and unequal clusters in underwater wireless sensor networks (EERBLC) and energy-efficient clustering multi-hop routing protocol in a UWSN (EECMR), the HECRA significantly improves network lifetime, the residual node energy, and the number of successfully transmitted packets, which can effectively prolong network lifetime and ensure efficient data transmission.

Noisy Dueling Double Deep Q-Network algorithm for autonomous underwater vehicle path planning.

How to improve the success rate of autonomous underwater vehicle (AUV) path planning and reduce travel time as much as possible is a very challenging and crucial problem in the practical applications of AUV in the complex ocean current environment. Traditional reinforcement learning algorithms lack exploration of the environment, and the strategies learned by the agent may not generalize well to other different environments. To address these challenges, we propose a novel AUV path planning algorithm named the Noisy Dueling Double Deep Q-Network (ND3QN) algorithm by modifying the reward function and introducing a noisy network, which generalizes the traditional D3QN algorithm. Compared with the classical algorithm [e.g., Rapidly-exploring Random Trees Star (RRT*), DQN, and D3QN], with simulation experiments conducted in realistic terrain and ocean currents, the proposed ND3QN algorithm demonstrates the outstanding characteristics of a higher success rate of AUV path planning, shorter travel time, and smoother paths.

A Method for Tracking an Underwater Pipeline from Stereo Images Using an Autonomous Underwater Vehicle

The problem of tracking an underwater pipeline (UP) is considered in the context of an inspection mission. It is assumed that the diameter of the cylindrical pipe is known. To solve this problem, a tracking method is proposed, based on searching and calculating the center line of the UP, and determining the relative position of the autonomous underwater robot (AUV) and UP in the coordinate system of the AUV camera. Unlike well-known analogues, in which the solution is based on recognizing and constructing the boundaries of the UP in images, the proposed method searches for the true position of the center line of the UP on a set of possible options by checking their veracity. Possible options for the spatial position of the search centerline of the current UP section are generated by varying the direction of the beam in the horizontal and vertical plane. The starting point of the ray is the end point of the centerline of the previous section. The veracity criterion is to check that the 3D point features constructed in the scene belong to the cylindrical surface of the UP. The generation and matching of pointfeatures in images of a stereo pair is carried out using the SURF detector. The choice of the correct direction of the center line of the current UP section is ultimately made by voting. The end point of the center line of the current section is determined taking into account the calculated common visibility area with the previous section of the UP. To evaluate the effectiveness of the method, computational experiments were carried out on virtual scenes. The effectiveness was assessed by the accuracy of UP localization (in the AUV coordinate system) and by the speed of calculations in comparison with: a) the first version of this method, based on the use of a vectorized form of images; b) analogues using the Canny and Hough Transform detectors. The stability of the method to the accumulation of navigation accuracy errors during long-term tracking of UPs was also assessed.

Adaptive hierarchical interval type-2 fuzzy control for trajectory tracking of an underactuated AUV with uncertain dynamics

In this study, an adaptive hierarchical interval type-2 fuzzy control (AHIT2FC) scheme is presented for three-dimensional (3D) trajectory tracking control of an underactuated autonomous underwater vehicle (AUV), which has only three independent control inputs and is subject to partially parametric uncertainty and unknown external disturbances. To decrease reliance on hydrodynamic parameters, an interval type-2 fuzzy logic system (IT2FLS) is utilized, which exhibits superior capabilities in handling high levels of uncertainties prevalent in the underwater environment as compared to a type-1 fuzzy logic system. However, the traditional fuzzy system structure encounters the “curse of dimensionality” issue, which results in high computational complexity and imposes a significant burden on the limited computing resources underwater. The proposed AHIT2FC framework, based on a hierarchical structure, can substantially enhance computational speed while ensuring excellent control performance. Subsequently, Lyapunov’s theory is adopted to guarantee that all the tracking errors in the closed-loop system are semiglobally uniformly bounded (SGUB). Finally, comparative simulation results demonstrate the effectiveness and superiority of the proposed AHIT2FC scheme.

Arbitrary 6-DOF large-angle tracking control for autonomous underwater vehicles via stochastic contraction stability and rotation matrix-based attitude representation

Arbitrary 6-DOF large-angle tracking control for autonomous underwater vehicles via stochastic contraction stability and rotation matrix-based attitude representation

Research on Autonomous Underwater Vehicle Path Optimization Using a Field Theory-Guided A* Algorithm

Autonomous Underwater Vehicles (AUVs) have become indispensable tools in the fields of ocean exploration, resource exploitation, and environmental monitoring. Path planning and obstacle avoidance are crucial to improve the operational capabilities of AUVs. However, most algorithms focus only on macro-global or micro-local path planning and rarely address both problems simultaneously. This study extends the classical A* algorithm by integrating field theory principles. The resulting Field Theory Augmented A* (FT-A*) algorithm combines the constraints in the AUV’s dynamics and the threats posed by obstacles to ensure a safe navigation distance. The paths planned by the FT-A* algorithm were subsequently re-optimised in conjunction with Dubins curves, taking into account path smoothness and redundant node problems. Simulation experiments confirm that the improved algorithm can effectively help AUVs navigate safely around obstacles, which greatly improves navigation safety and increases the arithmetic power and navigation efficiency. The proposed FT-A* algorithm provides a robust solution for underwater path planning and demonstrates great practical value for AUV operation in complex marine environments.

Quaternion-based fixed-time tracking control for an autonomous underwater vehicle with consideration of measurement bias

This article investigates trajectory and attitude tracking control problem of a 6-degree of freedom (DOF) autonomous underwater vehicle (AUV) subject to measurement bias and external disturbance. First, the model dynamics of rotational channels are established by unit-quaternion, which possesses simplicity and broader applicability compared to the Euler angle such that the maneuver signal could be uniquely determined. Meanwhile, by introducing constraint of the logarithm function and initial value, the unwinding phenomenon existing in rotation motion can be avoided tactfully. Considering the high requirement for sensor accuracy, the resulting measurement bias in position and velocity channels, making AUV into a mismatched system and bring the uncertain term in the process of controller design. Therefore, the echo state network (ESN) with online updates performance is applicable to approximate uncertain term simultaneously generated by measurement bias and unknown external disturbance. Then, by incorporating composite hyperbolic tangent function, the quasi-fast terminal sliding mode (QTSM) surface is constructed to realize the fixed-time convergence peculiarity of the AUV tracking system. Compared with the existing methods, the proposed algorithm can regulate artificially the stable schedule of the AUV tracking system and possess the capacity of bias tolerance and anti-disturbance. Finally, simulation results verify the validity and feasibility of the developed control algorithm.

Dynamic Docking Anti‐Disturbance Control of Overactuated AUV: System, Method, and Lake Trails

ABSTRACTDynamic docking control technology is crucial for autonomous underwater vehicles (AUV) to perform tasks underwater. To enhance the docking success rate of AUVs during dynamic docking, this paper presents a robust anti‐disturbance control algorithm specifically designed for overactuated AUV dynamic docking scenarios. During a dynamic docking mission, the AUV's depth control is adversely affected by the complex flow field generated by the underwater recovery device. To address this issue, this research proposes an AUV control scheme that combines an extended state observer (ESO) with a combined disturbance rejection method of the elevator‐vertical tunnel controller. First, an ESO is constructed to estimate and compensate for complicated disturbances such as model uncertainty and environmental disturbances. These estimations are then incorporated into the control law to mitigate the effects of the complicated flow field interference experienced during the AUV's dynamic docking process. Second, as turbulence intensifies at the end of the docking stage, the vertical thrust allocation is achieved using a hyperbolic tangent transition function. This ensures the stability of the AUV's attitude and depth, thereby enabling precise docking. Finally, the effectiveness of the proposed control algorithm is verified through lake trials and compared against the classic proportional‐integral‐differential (PID) and active disturbance rejection control (ADRC) methods. The trial results indicate that the proposed control algorithm significantly reduces the pitch and depth errors of the AUV, resulting in a remarkable 91% success rate for dynamic docking (based on 45 tests). The lake trials demonstrate that the proposed control algorithm is highly precise and robust.

Investigating the vibration characteristics of vector thrusters under complex inclination angle variations

ABSTRACT As autonomous underwater vehicles advance, the study of design and dynamic characteristics of vector thrusters is of significant engineering importance. In this paper, the mechanical model based on a vector thruster with a universal joint is established, followed by the analysis of its vertical torsional coupled vibration across different modes of inclination angle variations. Then, a simulated calculation of dynamic characteristics is carried out by the Newmark method. Finally, following the introduction of several structure parameters, the characteristics of vertical and torsional vibrations of the driven shaft under impact load are studied. The results show that the increase in the stiffness ratio can reduce not only the amplitude of angular displacement but also the stability time of vibration. The combinations of inclination angles should be selected preferentially, and the action value of actuators must be reasonably adjusted to ensure the inclination angle ratio remains as small as possible in the thruster control.

Motion control of autonomous underwater vehicle based on physics-informed offline reinforcement learning

Online reinforcement learning (RL) methods for autonomous underwater vehicles (AUV) are time-consuming and unsafe due to the need for real-world interaction. Offline RL methods can improve efficiency and safety by training with dynamic models, but an accurate model for AUV is difficult to obtain due to its highly nonlinear dynamics. These limit the application of RL methods in AUV control. To solve this issue, we propose physics-informed model-based conservative offline policy optimization (PICOPO). It offers the advantages of small dataset, strong generalizability and high safety by combining the physics-informed dynamic modelling method and the offline RL technique. First, the PICOPO constructs a physics-informed model based on a small offline dataset to serve as the digital twins (DT) of the actual AUV. This DT can forecast the long-term motion states of AUV with high-precision. The RL-based controller is then trained offline within this DT, eliminating the need for real-world interaction and allowing direct deployment to the AUV without fine-tuning. In this paper, simulations and field tests are carried out to evaluate the proposed method. Our results demonstrate that PICOPO achieves accurate motion control with just 2000 samples and enables zero-shot sim-to-real transfer, showcasing strong generalizability across various motion control tasks.

Autonomous Underwater Vehicle Navigation Enhancement by Optimized Side-Scan Sonar Registration and Improved Post-Processing Model Based on Factor Graph Optimization

Autonomous Underwater Vehicles (AUVs) equipped with Side-Scan Sonar (SSS) play a critical role in seabed mapping, where precise navigation data are essential for mosaicking sonar images to delineate the seafloor’s topography and feature locations. However, the accuracy of AUV navigation, based on Strapdown Inertial Navigation System (SINS)/Doppler Velocity Log (DVL) systems, tends to degrade over long-term mapping, which compromises the quality of sonar image mosaics. This study addresses the challenge by introducing a post-processing navigation method for AUV SSS surveys, utilizing Factor Graph Optimization (FGO). Specifically, the method utilizes an improved Fourier-based image registration algorithm to generate more robust relative position measurements. Then, through the integration of these measurements with data from SINS, DVL, and surface Global Navigation Satellite System (GNSS) within the FGO framework, the approach notably enhances the accuracy of the complete trajectory for AUV missions. Finally, the proposed method has been validated through both the simulation and AUV marine experiments.

A Novel Energy-Aware Path Planning by Autonomous Underwater Vehicle in Underwater Wireless Sensor Networks

Wireless sensor networks can monitor the environment to detect anomalies and reduce the risk of maritime traffic. Energy is necessary for low-power conditions where wireless sensor networks are used. Ensuring the lifespan of energy constraints and providing continuous environmental observation, data collecting, and communication requires management. Battery replacement and energy consumption issues can be resolved with path planning and energy-efficient autonomous underwater vehicle charging for sensor nodes. The nearest neighbour technique is used in this study to solve the energy-aware path planning problem of an autonomous underwater vehicle. Path planning simulations show that the nearest neighbour strategy converges faster and produces a better result than the genetic algorithm. We develop robust and energy-efficient path-planning algorithms that efficiently acquire sensor data while consuming less energy, allowing the monitoring system to respond to anomalies more rapidly. Increased sensor connectivity lowers energy usage and increases network longevity. This study also considers the situation when it is recommended to avoid taking direct travel paths between particular node pairs for a variety of reasons. This recommendation is considered in this study. We present a strategy based on a modified Nearest Neighbour-based Approach from the Nearest Neighbour method to address this more challenging scenario. The direct pathways between such nodes are constrained within the context of this technique. The modified version of Nearest Neighbor-based approach performs well even in that particular situation.

Research on multi-source information fusion based on sliding window-factor graph for autonomous underwater vehicle

Research on multi-source information fusion based on sliding window-factor graph for autonomous underwater vehicle

A path planning method based on deep reinforcement learning for AUV in complex marine environment

The potential of autonomous underwater vehicle (AUV) on future applications is significant due to advancements in autonomy and intelligence. Path planning is a critical technology for AUV to perform operational missions in complex marine environments. To this end, this paper proposes a path planning method for AUV based on deep reinforcement learning. Initially, considering actual requirements, a complex marine environment model containing underwater terrain, sonobuoy detection, and ocean currents is established. Subsequently, the corresponding state space, action space, and reward function are formulated. Furthermore, to address the inherent limitations of existing deep reinforcement learning algorithms in terms of training efficiency, a mixed experience replay (MER) strategy is proposed. This strategy aims to enhance the efficiency of sample learning by integrating prior knowledge and exploration experience. Lastly, a novel HMER-SAC algorithm for AUV path planning is proposed by integrating the Soft Actor–Critic (SAC) algorithm with the hierarchical reinforcement learning strategy and the MER strategy. The results of the simulation and experiment demonstrate that the method is capable of efficiently planning executable paths in complex marine environments and exhibits superior training efficiency, stability, and performance.

The Effects of Depth and Altitude on Image-Based Shark Size Measurements Using UAV Surveillance

Drones are an ecological tool used increasingly in shark research over the past decade. Due to their high-resolution camera and GPS systems, they have been used to estimate the sizes of animals using drone-based photogrammetry. Previous studies have used drone altitude to measure the target size accuracy of objects at the surface; however, target depth and its interaction with altitude have not been studied. We used DJI Mavic 3 video (3960 × 2160 pixel) and images (5280 × 3960 pixel) to measure an autonomous underwater vehicle of known size traveling at six progressively deeper depths to assess how sizing accuracy from a drone at 10 m to 80 m altitude is affected. Drone altitudes below 40 m and target depths below 2 m led to an underestimation of size of 76%. We provide evidence that accounting for the drone’s altitude and the target depth can significantly increase accuracy to 5% underestimation or less. Methods described in this study can be used to measure free-swimming, submerged shark size with accuracy that rivals hand-measuring methods.

Prediction-Based Submarine Cable-Tracking Strategy for Autonomous Underwater Vehicles with Side-Scan Sonar

This study investigates the tracking of underwater cables using autonomous underwater vehicles (AUVs) equipped with side-scan sonar (SSS). AUV motion stability is crucial for effective SSS imaging, which is essential for continuous cable tracking. Traditional methods that derive AUV guidance rates directly from measured cable states often cause unnecessary jitter when imaging, complicating accurate detection. To address this, we propose a non-myopic receding-horizon optimization (RHO) strategy designed to maximize cable imaging quality while considering AUV maneuvering constraints. This strategy identifies the optimal heading decision sequence over a future horizon, ensuring stable and efficient cable tracking. We also employ a long short-term memory (LSTM) network to predict future cable states, further minimizing AUV motion instability during abrupt path changes. Given the computational limitations of AUVs, we have developed an efficient decision-making framework that can execute resource-intensive algorithms in real time. Finally, the robustness and effectiveness of the proposed algorithm were validated through comparative experiments. The results demonstrate that the proposed method outperforms existing methods in key metrics such as cable-tracking accuracy and AUV motion stability. This ensures that the AUV can acquire high-quality acoustic images of the submarine cable in an optimal state, enhancing the continuity and reliability of cable-tracking tasks.

Lidar-Based Obstacle Detection and Path Prediction for Unmanned Surface Vehicles

Abstract Unmanned Surface Vehicles (USVs) represent an advanced technology with a wide range of applications in maritime contexts, and they offer a promising alternative to manned systems, particularly for the provision of services such as riverbed mapping. Furthermore, the use of USVs in combination with other robotic systems, such as flying drones, remotely operated underwater vehicles (ROVs) and autonomous underwater vehicles (AUVs), opens up innovative ways to inspect and monitor maritime infrastructure. However, the use of these systems in dynamic environments, such as ports or shipping lanes, requires a high degree of adaptability and precision in navigation to manoeuvre safely between other traffic participants and obstacles to prevent collisions. To address this problem, USVs require sophisticated perception systems for the precise detection and classification of nearby objects. Leveraging Light Detection and Ranging (LiDAR) technology, which is renowned for its efficacy in obstacle avoidance in robotics, this paper outlines the adaptation of a LiDAR sensor for USVs. The proposed pipeline enables the detection of other moving vessels and the accurate determination of their positions and trajectories up to 150 m from the USV. This paper introduces an obstacle detection system and validates it within a port setting. A methodical approach to LiDAR data preprocessing, clustering, and point cloud extraction will be outlined. Furthermore, it explores the application of an Unscented Kalman Filter (UKF) for the projection of motion paths of identified entities. This advanced form of data analysis provides the ability to predict the future position and path of potential obstacles, optimize decision-making for autonomous navigation algorithms and significantly improve the safety of USV operations. The pipeline is tested experimentally in sea trials by enacting five different scenarios that USV may encounter in a port setting. The results of the pipeline’s tracking capabilities are compared to the ground truth data collected by the tracked vessel and plotted to visualize the error.

A Greedy Depth-Seeking Behavior for Energy-Efficient Transits by an Autonomous Underwater Vehicle

A Greedy Depth-Seeking Behavior for Energy-Efficient Transits by an Autonomous Underwater Vehicle