UAV path planning and collision avoidance in 3D environments based on POMPD and improved grey wolf optimizer

Abstract

Due to the complexity and uncertain factors of the environment, a 3D path planning algorithm is urgently needed. This paper presents a 3D optimal feasible flight path generation and collision avoidance algorithms based on partially observable Markov decision process (POMDP) and improved grey wolf optimizer (GWO) for an unmanned aerial vehicle (UAV). Firstly, a novel algorithm based on the GWO is proposed to deal with constrained optimization problem (COP) and utilized to plan a flyable path. The designed variant is called improved GWO with level comparison (GWOLC), which combines the communication mechanism and the ε-level comparison method at the same time. Secondly, aircraft collision avoidance is modeled as a Partially Observable Markov Decision Process (POMDP) and the Monte-Carlo tree search (MCTS) algorithm is used to solve it. We introduce a novel algorithm, Information Particle Filter Tree (IPFT), to solve the problem of belief update in continuous domain. Thirdly, simulation experiments are conducted in 3D environment, and numerical results showed the proposed algorithm offers good performance as measured by effectiveness, robustness, convergence, and constraint handling capabilities.