Dynamic Window Approach with path-following for Unmanned Surface Vehicle based on Reinforcement Learning

Abstract

Recently, autonomous navigation technology is actively being developed due to the increasing demand of an unmanned surface vehicle(USV). Local planning is essential for the USV to safely reach its destination along paths. the dynamic window approach(DWA) algorithm is a well-known navigation scheme as a local path planning. However, the existing DWA algorithm does not consider path line tracking, and the fixed weight coefficient of the evaluation function, which is a core part, cannot provide flexible path planning for all situations. Therefore, in this paper, we propose a new DWA algorithm that can follow path lines in all situations. Fixed weight coefficients were trained using reinforcement learning(RL) which has been actively studied recently. We implemented the simulation and compared the existing DWA algorithm with the DWA algorithm proposed in this paper. As a result, we confirmed the effectiveness of the proposed algorithm. Keywords: ë™ì  ì°½ ì ‘ê·¼, 경로 ì¶”ì¢ , 지역 경로, ë¬´ì¸ìˆ˜ìƒì •, 강화학습 Keywords: Dynamic Window Approach, Path-following, Local Planning, Unmanned Surface Vehicle, Reinforcement Learning