Autonomous Underwater Vehicle Navigation Research Articles

Research on obstacle avoidance of underactuated autonomous underwater vehicle based on offline reinforcement learning

Abstract The autonomous navigation and obstacle avoidance capabilities of autonomous underwater vehicles (AUVs) are essential for ensuring their safe navigation and long-term, efficient operation. However, the complexity of the marine environment poses significant challenges to safe and effective obstacle avoidance. To address this issue, this study proposes an AUV obstacle avoidance control algorithm based on offline reinforcement learning. This method adopts the Conservative Q-learning (CQL) algorithm, which is based on the Soft Actor-Critic (SAC) framework. It learns from obtained historical obstacle avoidance data and ultimately achieves a favorable obstacle avoidance control strategy. In this method, PID and SAC control algorithms are utilized to generate expert obstacle avoidance data to construct a diversified offline database. Additionally, based on the line-of-sight (LOS) guidance method and artificial potential field (APF) method, information regarding the distance and orientation of targets and obstacles is incorporated into the state space, and heading and obstacle avoidance reward terms are integrated into the reward function design. The algorithm successfully guides the AUV in autonomous navigation and dynamic obstacle avoidance in three-dimensional space. Furthermore, the algorithm exhibits a certain degree of anti-interference capability against uncertain disturbances and ocean currents, enhancing the safety and robustness of the AUV system. Simulation results fully demonstrate the feasibility and effectiveness of the intelligent obstacle avoidance method based on offline reinforcement learning. This study highlights the profound significance of offline reinforcement learning in enabling robust and reliable control systems for AUVs, paving the way for enhanced operational capabilities in challenging marine environments.

Autonomous Underwater Vehicle Navigation Enhancement by Optimized Side-Scan Sonar Registration and Improved Post-Processing Model Based on Factor Graph Optimization

Autonomous Underwater Vehicles (AUVs) equipped with Side-Scan Sonar (SSS) play a critical role in seabed mapping, where precise navigation data are essential for mosaicking sonar images to delineate the seafloor’s topography and feature locations. However, the accuracy of AUV navigation, based on Strapdown Inertial Navigation System (SINS)/Doppler Velocity Log (DVL) systems, tends to degrade over long-term mapping, which compromises the quality of sonar image mosaics. This study addresses the challenge by introducing a post-processing navigation method for AUV SSS surveys, utilizing Factor Graph Optimization (FGO). Specifically, the method utilizes an improved Fourier-based image registration algorithm to generate more robust relative position measurements. Then, through the integration of these measurements with data from SINS, DVL, and surface Global Navigation Satellite System (GNSS) within the FGO framework, the approach notably enhances the accuracy of the complete trajectory for AUV missions. Finally, the proposed method has been validated through both the simulation and AUV marine experiments.

Global integrated navigation position correction algorithm and virtual polar region technology based on normal vector

To achieve the inherent uniformity of all-earth navigation for autonomous underwater vehicles (AUV), a global integrated navigation position correction algorithm based on the normal vector (n-vector) is proposed. First, a four-element vector comprising the non-singular n-vector and height represents the carrier’s position in the Earth-centered Earth-fixed (ECEF) frame. The integrated navigation systems are designed with the strapdown inertial navigation system (SINS), Doppler velocity log (DVL), and other equipment. Secondly, the reverse navigation algorithm in the ECEF mechanization is derived, and the results of forward and reverse navigation are fused to correct the AUV’s underwater position. Additionally, a virtual polar region technology based on the ECEF attitude, velocity, and height invariant method (E-AVHIM) is proposed to convert the actual test data obtained at low and middle latitudes into high latitudes for more convincing polar region algorithm verification. Simulations and lake trial demonstrated the excellence and efficiency of the proposed algorithm.

In-motion fine alignment algorithm for AUV based on improved extended state observer and Kalman filter

Abstract Achieving fast initial alignment has always been a major challenge for autonomous underwater vehicle navigation, especially in motion. During the fine alignment process, traditional algorithms often face the slow convergence of the azimuth misalignment angle. To solve this problem, this paper proposes a fast alignment algorithm based on the improved extended state observer (ESO) and Kalman filter. Specifically, since the application potential of ESO in fine alignment has not been fully explored by previous studies, this paper introduces the improved ESO through the in-depth research of traditional ESO. The obtained improved ESO is then combined with Kalman filter to constitute the proposed fast alignment algorithm. The algorithm first uses Kalman filter to estimate the two horizontal misalignment angles. Once the horizontal angles estimation of Kalman filter tends to be stable, the improved ESO is used to estimate the azimuth misalignment angle. Simulation and lake test show the proposed algorithm has excellent performance of in-motion alignment. The comparative analysis shows that the algorithm significantly improves the convergence speed of azimuth alignment angle.

A hybrid RVO-MPPI approach for efficient collision avoidance for multiple autonomous underwater vehicles

Collision-avoidance path planning for Autonomous Underwater Vehicles (AUVs) in complex underwater environments presents a significant challenge, particularly considering the maneuverability limitations of fin-rudder-controlled AUVs. This study proposes a novel navigation approach that combines the strengths of Reciprocal Velocity Obstacle (RVO) principles and Model Predictive Path Integral (MPPI) control to enhance autonomous obstacle avoidance for multiple AUVs. The key innovation lies in leveraging RVO-based obstacle avoidance velocities to enhance both action sampling and cost function optimization in MPPI framework. Specifically, a neural network trained through supervised learning is utilized to convert the RVO-provided avoidance velocities into desired actions for MPPI. Additionally, these velocities are incorporated into the MPPI cost function, thereby enhancing the optimization process and facilitating convergence towards optimal, collision-free navigation solutions. Simulation experiments validated the method's capability to provide effective obstacle avoidance behavior across various complex scenarios. Results indicate that this approach successfully integrates MPPI's predictive capabilities with RVO's velocity avoidance logic, enabling AUVs to navigate efficiently through complex underwater environments while ensuring mission safety and effectiveness. This approach offers a promising new solution for autonomous navigation of AUVs, with potential applications in ocean exploration, underwater search and rescue, and other maritime operations. Future research will explore the performance of this approach in real-world underwater environments and consider the impact of additional dynamic factors.

A Method for Recognition and Coordinate Reference of Autonomous Underwater Vehicles to Inspected Objects of Industrial Subsea Structures Using Stereo Images

To date, the development of unmanned technologies using autonomous underwater vehicles (AUVs) has become an urgent demand for solving the problem of inspecting industrial subsea structures. A key issue here is the precise localization of AUVs relative to underwater objects. However, the impossibility of using GPS and the presence of various interferences associated with the dynamics of the underwater environment do not allow high-precision navigation based solely on a standard suite of AUV navigation tools (sonars, etc.). An alternative technology involves the processing of optical images that, at short distances, can provide higher accuracy of AUV navigation compared to the technology of acoustic measurement processing. Although there have been results in this direction, further development of methods for extracting spatial information about objects from images recorded by a camera is necessary in the task of calculating the exact mutual position of the AUV and the object. In this study, in the context of the problem of subsea production system inspection, we propose a technology to recognize underwater objects and provide coordinate references to the AUV based on stereo-image processing. Its distinctive features are the use of a non-standard technique to generate a geometric model of an object from its views (foreshortening) taken from positions of a pre-made overview trajectory, the use of various characteristic geometric elements when recognizing objects, and the original algorithms for comparing visual data of the inspection trajectory with an a priori model of the object. The results of experiments on virtual scenes and with real data showed the effectiveness of the proposed technology.

An Integrated Navigation Method Aided by Position Correction Model and Velocity Model for AUVs.

When autonomous underwater vehicles (AUVs) perform underwater tasks, the absence of GPS position assistance can lead to a decrease in the accuracy of traditional navigation systems, such as the extended Kalman filter (EKF), due to the accumulation of errors. To enhance the navigation accuracy of AUVs in the absence of position assistance, this paper proposes an innovative navigation method that integrates a position correction model and a velocity model. Specifically, a velocity model is developed using a dynamic model and the Optimal Pruning Extreme Learning Machine (OP-ELM) method. This velocity model is trained online to provide velocity outputs during the intervals when the Doppler Velocity Log (DVL) is not updating, ensuring more consistent and reliable velocity estimation. Additionally, a position correction model (PCM) is constructed, based on a hybrid gated recurrent neural network (HGRNN). This model is specifically designed to correct the AUV's navigation position when GPS data are unavailable underwater. The HGRNN utilizes historical navigation data and patterns learned during training to predict and adjust the AUV's estimated position, thereby reducing the drift caused by the lack of real-time position updates. Experimental results demonstrate that the proposed VM-PCM-EKF algorithm can significantly improve the positioning accuracy of the navigation system, with a maximum accuracy improvement of 87.2% compared to conventional EKF algorithms. This method not only improves the reliability and accuracy of AUV missions but also opens up new possibilities for more complex and extended underwater operations.

Bio-inspired machine-learning aided geo-magnetic field based AUV navigation system

The navigational accuracy of sea animals and trans-ocean birds provides inspiration in using geo-magnetic field (GMF) for realizing strategic truly autonomous underwater vehicles (AUV) capable of determining their absolute position on earth, without the aid of ship-referenced acoustic baseline systems. Supervised Machine Learning algorithms are applied on the GMF intensity data obtained from NOAA World Magnetic Model for a 900 km2 within the Indian mineral exploratory area in the Central Indian Ocean, with a resolution of 50 m, considering the sensitivity of commercially available magnetometers. It is identified that, for AUVs equipped with magnetometers with a detection sensitivity of 0.1 nT, the supervisory random forest regression and decision tree algorithm trained with priori GMF data, could provide trajectory guidance to AUVs with an absolute mean position accuracy in 2D plane, with reference to the last known position from Integrated Navigation system aided initially with GPS and with acoustic positioning in underwater. Circular Error Probable (CEP 50) of 53 m and 56 m, respectively. The scalar GMF anomaly navigation demonstrated to be a viable GPS-alternative navigation system could be extended to larger areas with inclination and declination vectors, as unique identifiers.

Cruise Speed Model Based on Self-Attention Mechanism for Autonomous Underwater Vehicle Navigation

This study proposes a cruise speed model based on the Self-Attention mechanism for speed estimation in Autonomous Underwater Vehicle (AUV) navigation systems. By utilizing variables such as acceleration, angle, angular velocity, and propeller speed as inputs, the Self-Attention mechanism is constructed using Long Short-Term Memory (LSTM) for handling the above information, enhancing the model’s accuracy during persistent bottom-track velocity failures. Additionally, this study introduces the water-track velocity information to enhance the generalization capability of the network and improve its speed estimation accuracy. The sea trial experiment results indicate that compared to traditional methods, this model demonstrates higher accuracy and reliability with both position error and velocity error analysis when the used Pathfinder DVL fails, providing an effective solution for AUV combined navigation systems.

Improving Autonomous Underwater Vehicle Navigation: Hybrid Swarm Intelligence for Dynamic Marine Environment Path-finding

Underwater research and monitoring operations rely significantly on Autonomous Underwater Vehicles (AUVs) for scientific investigations, resource management, and monitoring, and underwater infrastructure is provided maintenance levels amid other applications. Efficient navigation and preventative methods are only a couple of the numerous challenges that Path-Finding (PF) in rapidly changing and sophisticated Underwater Environments (UE) requires overcoming. Dynamic environments and real-time improvements are problems for traditional models. In order to provide superior solutions for navigating uncertain UE, this work suggests a hybrid optimization technique that combines Ant Colony Optimization (ACO) for local path selection with Particle Swarm Optimization (PSO) for global path scheduling. Runtime efficiency, accuracy, and distance focused on decrease are three metrics that demonstrate how the PSO-ACO hybrid method outperforms conventional algorithms, proving its significance for improving AUV navigation. The improvement of AUV functions in fields such as underwater research, along with others, is supported by the current research, which further assists with the invention of Autonomous Underwater Navigation Systems (AUNS). The PSO+ACO hybrid method is superior to the PSO, ACO, and GA algorithms in pathfinding with a 6.43-second execution time and 93.5% accuracy—the ACO model completed in 12.53 seconds, superior to the proposed system.

Breakthrough Underwater Physical Environment Limitations on Optical Information Representations: An Overview and Suggestions

Underwater optics have seen a notable surge of interest in recent years, emerging as a critical medium for conveying information crucial to underwater resource exploration, autonomous underwater vehicle navigation, etc. The intricate dynamics of underwater optical transmission, influenced by factors such as the absorption by the water and scattering by multiple particles, present considerable challenges. One of the most critical issues is that the optical information representation methods fail to take into account the impact of the underwater physical environment. We conducted a comprehensive review and analysis of recent advancements in underwater optical transmission laws and models. We summarized and analyzed relevant research on the effects of underwater particles and turbulence on light and analyzed the polarization effects in various environments. Then, the roles of various types of underwater optical propagation models were analyzed. Although optical models in complex environments are still mostly based on Monte Carlo methods, many underwater optical propagation mechanisms have been revealed and can promote the impacts of optical information expression. We delved into the cutting-edge research findings across three key domains: the enhancement of underwater optical image quality, the 3D reconstruction from monocular images, and the underwater wireless optical communication, examining the pivotal role played by light transmission laws and models in these areas. Drawing upon our extensive experience in underwater optics, including underwater optical sensor development and experiments, we identified and underscored future directions in this field. We advocate for the necessity of further advancements in the comprehension of underwater optical laws and physical models, emphasizing the importance of their expanded application in underwater optical information representations. Deeper exploration into these areas is not only warranted but essential for pushing the boundaries of current underwater optical technologies and unlocking new potential for their application in underwater optical sensor developments, underwater exploration, environmental monitoring, and beyond.

High frame rate acoustic navigation of AUV based on range ambiguity suppression

Underwater acoustic navigation is extensively utilized across many industries due to its exceptional dependability and continuous real-time functionality. Due to the swift advancement of technology in recent years, the velocity of autonomous underwater vehicles (AUVs) has progressively increased. A high frame rate is required for the underwater acoustic navigation system in order to precisely obtain the trajectory of the AUV. Nevertheless, the discrepancy lies in the fact that the high frame rate and the unambiguous measurement could be seen as contradictory. Higher frame rates greatly raise the probability of range ambiguity, leading to various potential pseudo solutions that exacerbate the difficulty of accurate positioning and noticeably impact navigation performance. To address the aforementioned issue, a high frame rate acoustic navigation technique that relies on the suppression of range ambiguity has been studied in this paper. Initially, the relationship between measurements were investigated, specifically the time delay and Doppler shift, and the confusing periodic leap. Subsequently, the coupling model was employed to develop a high-precision acoustic navigation model, taking into account the statistical characteristics of measurements. We also examined a high-precision solving approach. Ultimately, the proposed method was validated through both simulation analysis and field testing to confirm its practicality and efficiency. The results demonstrate that it can attain a high level of accuracy in resolving the ambiguous problem and achieve high-precise acoustic navigation.

Cooperative motion planning and control of a group of autonomous underwater vehicles using twin-delayed deep deterministic policy gradient

The cooperative execution of complex tasks can lead to desirable outcomes and increase the likelihood of mission success. Nevertheless, coordinating the movements of multiple autonomous underwater vehicles (AUVs) in a collaborative manner is challenging due to nonlinear dynamics and environmental disturbances. The paper presents a decentralized deep reinforcement learning algorithm for AUVs that enables cooperative motion planning and obstacle avoidance. The goal is to formulate control policies for AUVs, empowering each vehicle to create its optimal collision-free path through adjustments in speed and heading. To ensure safe navigation of multiple AUVs, COLlision AVoidance (COLAV) plays a crucial role. Therefore, the implementation of a multi-layer region control strategy enhances the AUVs’ responsiveness to nearby obstacles, leading to improved COLAV. Furthermore, a reward function is formulated to consider four criteria: path planning, obstacle- and self-COLAV, as well as feasible control signals, with the aim of strengthening the proposed strategy. Notably, the devised scheme demonstrates robustness against disturbances A comparative study is conducted with the well-established Artificial Potential Field (APF) planning method. The simulation results indicate that the proposed system effectively and safely guides the AUVs to their goals and exhibits desirable generalizability.

A novel multi-source navigation algorithm based on factor graph in complex underwater environments of polar regions

Autonomous underwater vehicle (AUV) is an unmanned, cableless, self-propelled, autonomous navigation and control vehicle that maneuvers under unmanned or minimally monitored and intervened conditions. To solve the problem of increasing navigation accuracy error caused by time-varying measurement noise of AUV auxiliary sensors in complex underwater environments of polar regions, a multi-source navigation algorithm for AUV based on improved factor graph is proposed. The algorithm first adds a confidence function to the standard factor graph algorithm, which is used to adjust the covariance matrix of the navigation sensor to suppress the problem of time-varying measurement noise. Then, a sliding window is added to the factor graph algorithm and only nodes within the sliding window are optimized to ensure real-time performance. Finally, considering that inertial navigation has high accuracy in a short period of time, inertial navigation iterations are performed on nodes that are about to be marginalized within the sliding window to improve navigation accuracy. The analyses of the simulation experiment results show that the algorithm can effectively cope with the time-varying problem of measurement noise and ensure the accuracy and robustness of the AUV navigation system in the complex marine environment.

Improved ant colony optimization for safe path planning of AUV

In order to address the autonomous underwater vehicle navigation challenge for dam inspections, with the goal of enabling safe inspections and reliable obstacle avoidance, an improved smooth Ant Colony Optimization algorithm is proposed for path planning. This improved algorithm would optimize the smoothness of the path besides the robustness, avoidance of local optima, and fast computation speed. To achieve the goal of reducing turning time and improving the directional effect of path selection, a corner-turning heuristic function is introduced. Experimental simulation results show that the improved algorithm performs best than other algorithms in terms of path smoothness and iteration stability in path planning.

Waveguide invariant navigation of an AUV with a towed line array

Passive acoustics navigation of an autonomous underwater vehicle (AUV) can reduce localization errors while being relatively low-cost. A promising approach for navigation in shallow water is to exploit the waveguide invariant, which makes it possible to estimate the range between an acoustic source with a known position and an acoustic receiver on the AUV. This range estimate can then be fused in a sequential Bayes framework to improve the navigation information of the AUV. While previously proposed methods consider a range-independent environment with a single acoustic source and a single receiver, we investigate a more realistic scenario with multiple sources in a potentially range-dependent environment. In particular, a shallow water environment with a constant slope and sound speed is considered. To resolve multiple sources, it is assumed that the AUV tows an acoustic line array. Simulated acoustic data provided by a normal mode program are used to study the feasibility of the AUV navigation in shallow water by exploiting the waveguide invariant in this setting.

A convolutional neural network machine learning based navigation of underwater vehicles under limited communication

This paper proposes navigation of multiple autonomous underwater vehicles (AUVs) by employing machine learning approach for wide area surveys in underwater environment. Wide area survey in underwater environment is affected by low data rate.We consider two AUVs moving in formation through clustering followed by selection of optimal path that is affected by low data rate and limited acoustical underwater communication. A state compression approach using machine learning based acoustical localization and communication (ML-ALOC) is proposed to overcome the low data rate issue in which AUV states are approximated by Hierarchical clustering followed by an optimal selection approach using Convolutional Neural Network (CNN). The performance of the proposed state compression algorithm is compared with particle state compression algorithm based on K-Means clustering at each iteration followed by Akaike information criterion (AIC) pursuing extensive simulations, in which two AUVs navigate through trajectory. It is observed from the simulations that the proposed ML-ALOC system provides better estimates when compared with acoustical localization and communication (ALOC) system using particle clustering for state compression scheme.

Underwater terrain-matching algorithm based on improved iterative closest contour point algorithm

Although an autonomous underwater vehicle (AUV) is noted for its good autonomy, concealment and anti-interference ability, errors in its inertial navigation system (INS) inevitably increase over time, leading to positional failure during long-term voyages. Terrain-assisted navigation can help the INS to correct its position. The traditional iterative closest contour point (ICCP) achieves high matching accuracy when the initial position error of the INS is small, but is prone to mismatching when the initial error is large. This study combines ICCP with particle swarm optimization (PSO) to overcome this problem. First, the global optimization ability of PSO is improved by changing the acceleration factor and introducing an artificial bee colony (ABC) onlooker bee greedy search (ABC- ωAPSO). Second, the Euclidean distance of ICCP is replaced by the Mahalanobis distance to abate the influence of system error on the matching accuracy. Finally, the initial position error is reduced by rough matching using the ABC- ωAPSO, which has global optimization capability. Next, fine matching is performed by ICCP. This two-step process resolves the sensitivity problem of ICCP to the initial position error. The experimental results revealed a good matching effect after the double-matching procedure. When the initial INS errors were 0.55′ to the east and 0.55′ to the north, the matching error was reduced to 89.3 m, suggesting that the approach can realize autonomous passive navigation of AUVs.

Optimizing AUV Navigation Using Factor Graphs with Side-Scan Sonar Integration

For seabed mapping, the prevalence of autonomous underwater vehicles (AUVs) employing side-scan sonar (SSS) necessitates robust navigation solutions. However, the positioning errors of traditional strapdown inertial navigation system (SINS) and Doppler velocity log (DVL) systems accumulated significantly, further exacerbated by DVL’s susceptibility to failure in complex underwater conditions. This research proposes an integrated navigation approach that utilizes factor graph optimization (FGO) along with an improved pre-integration technique integrating SSS-derived position measurements. Firstly, the reliability of SSS image registration in the presence of strong noise and feature-poor environments is improved by replacing the feature-based methods with a Fourier-based method. Moreover, the high-precision inertial measurement unit (IMU) pre-integration method could correct the heading errors of SINS significantly by considering the Earth’s rotation. Finally, the AUV’s marine experimental results demonstrated that the proposed integration method not only offers improved SSS image registration and corrects initial heading discrepancies but also delivers greater system stability, particularly in instances of DVL data loss.

Ultrasound-Powered Wireless Underwater Acoustic Identification Tags for Backscatter Communication.

Autonomous underwater vehicle (AUV) operations are limited by currently achievable underwater localization and navigation solutions; hence, the development of low-cost and passive (i.e., operable without an active power supply) acoustic underwater markers (or tags) can provide accurate localization information to AUVs improving their situational awareness, especially when operating in small scales or confined missions. This work presents an acoustic identification (AID) tag that can be powered wirelessly with ultrasonic power transfer from a remote acoustic source (e.g., mounted on an interrogating AUV) and provide localization information using backscatter communication. The AID tag harvests energy from the acoustic signal generated from the AUV and communicates by modulating the reflected signals from an embedded piezoelectric transducer. A scaled broadband AID tag prototype that achieves concurrent acoustic energy harvesting (tuned around 1.3 MHz) and backscatter communication (in wider frequency band 600 and 800 kHz) using frequency-domain multiplexing is implemented using a custom broadband impedance matching-based transducer design approach. During concurrent power and data operation, this prototype AID tag achieves data rates up to 200 kb/s using amplitude- and frequency-based modulation communication. The use of broadband schemes to achieve robust communications in low SNR (tested here down to -6 dB) is also demonstrated using linear frequency-modulated data carriers. Finally, the extension to full-scale devices of this AID tag concept and potential applications for short-range AUV routing and navigation such as homing and docking are discussed.