Decision making for highway complex scenario by improved safety field with learning process

Abstract

To improve the agility and efficiency of the highway decision-making system and overcome the local optimal dilemma of the existing safety field, this paper builds an improved safety field to reflect the advantage of the reachable states and the learning process is further employed to make the decision long-term optimal. Firstly, the improved safety field is prepared by the kinematic model-based prediction of surrounding vehicles and the boundary is determined elaborately to ensure real-time performance. Then, the field is constructed by three individual fields. One is the kinematic field, which is built based the safe-distance model to measure the colliding risk of both moving or no-moving objects accurately. Another is the road field that reflects the lane-marker constraint. The last is the efficiency field, which is introduced creatively to improve efficiency. Furthermore, the learning algorithm is adopted to learn the long-term optimal state-action sequence in the safety field. Finally, the simulations are conducted in Prescan platform to validate the feasibility of the improved safety field in complex scenarios. The results show that the proposed decision algorithm can always drive autonomous vehicle to the state with a long-term optimal payoff and can improve the overall performance compared to the existing pure safety field and the interaction-aware method.