Combining Decision Making and Trajectory Planning for Lane Changing Using Deep Reinforcement Learning

Abstract

In the context of Automated Vehicles, the Automated Lane Change system, is fundamentally based upon the separate constructs of Perception, Decision making, Trajectory Planning, and Execution. However, in existing works there are many simplistic and unplausible assumptions in applying these constructs that severely restrict their operational effectiveness in realistic and complex driving scenarios. For instance, there are rigid assumptions about the disposition of vehicles and that lane-changing maneuvers can occur instantaneously, but that highly desirable features such as the ability for real-time trajectory re-planning are lacking. In this paper, we address these limitations through an integrated methodology for lane-change decision making and trajectory planning, in which a deep Reinforcement Learning algorithm with a safe action set technique is employed in decision making that is effectively coupled to a specially devised trajectory planning model. The proposed new methodology is computationally efficient, supporting real-time implementation, and provides for lane-changing maneuvers that can be made simultaneously with other vehicles and can be dynamically re-planned; thus, enabling flexible, robust, and safe lane-changing maneuvers under the guidance of a new decision-making module. Finally, the veracity of the proposed methodology in guiding a vehicle to improve travel times and accomplish high-level driving behaviors such as overtaking and desired-speed maintenance in a range of road traffic scenarios is demonstrated in a number of numerical experiments.