AUV Dynamic Obstacle Avoidance Method Based on Improved PPO Algorithm

Abstract

A reasonable obstacle avoidance method for AUV 3D path planning is difficult. Existing obstacle avoidance methods have certain drawbacks. For example, they are only applicable to 2D planar applications and cannot effectively handle dynamic obstacles. To address these problems, this study designs an obstacle collision prediction model (CPM). Based on the results of the simulation operation of the obstacle inertial motion, the safety of the AUV navigation is evaluated to improve the sensitivity of the model to dynamic obstacles. Then, the learning ability of the sequence sample data is enhanced by combining it with the long short-term memory (LSTM) network, and the training efficiency and effect of the algorithm are improved. The trained proximal policy optimization (PPO) network can output reasonable actions to control the AUV to avoid obstacles, forming an AUV 3D dynamic obstacle avoidance strategy based on CPM-LSTM-PPO algorithm. The simulation results show that the proposed algorithm has good generalization in uncertain environments, and successfully realizes dynamic obstacle avoidance of AUV in different three-dimensional unknown environments, providing theoretical and technical support for real path planning.