A model predictive control trajectory tracking lateral controller for autonomous vehicles combined with deep deterministic policy gradient

Abstract

To solve the problem of trajectory tracking lateral control in autonomous driving technology, a model predictive control (MPC) controller trajectory tracking lateral control method combined with a deep deterministic policy gradient algorithm (DDPG) is proposed in this paper. This method inputs the real-time state of the vehicle into DDPG to achieve real-time automatic optimization of the prediction time domain and control time domain parameters of the MPC controller, and then affects the specific performance of the MPC controller in trajectory tracking lateral control. Specifically, the state space, action space, and reward function of DDPG are defined, and the automatic driving trajectory tracking lateral controller is designed in combination with the vehicle dynamics model. To reduce the exploration space of DDPG and improve the training efficiency of the entire model, the technique of advantage-disadvantage experience separation and extraction is introduced. Finally, the proposed method was trained and verified in various scenarios, and compared with two other lateral control methods for autonomous driving. The results showed that the learning and training time of the trajectory tracking lateral control method based on DDPG-MPC was shorter than that of the DDPG-based method, and the evaluation indicators in the trajectory tracking control process were better than those of the DDPG-based method and original MPC-based method.