Deep Reinforcement Learning for Integration of Train Trajectory Optimization and Timetable Rescheduling Under Disturbances.

Abstract

High-speed trains are susceptible to unexpected events such as strong winds and equipment failures, which can result in deviations from the scheduled timetable. As the density of traffic increases, these delays can quickly spread to other trains, eventually leading to conflicts in the timetable. To ensure the efficiency of high-speed railways, quickly resolving potential conflicts and generating appropriate rescheduling schemes are essential. The existing hierarchical structure of train control and online rescheduling tends to be inefficient in terms of information communication and can even lead to unfeasible rescheduled timetables and trajectories. To address these issues, an integrated structure of timetable rescheduling and train trajectory optimization is proposed by introducing the train minimum running time into the process of timetable rescheduling and using the adjusted running time as the objective of trajectory optimization. The integration model is formulated by considering the constraints of timetable rescheduling such as the maximum number of trains overtaking trains, platforms at stations, and the priority of the train, as well as the constraints of trajectory optimization. A deep reinforcement learning (DRL)-based approach is proposed to solve the problem. Numerical experiments are conducted on a segment of the Beijing-Shanghai high-speed railway line, using adapted data to demonstrate the effectiveness of the proposed method in rescheduling timetables and optimizing train trajectories. The results show that the integrated rescheduled timetable and the optimized train trajectory can be generated simultaneously and the computation time exhibits a linear increase with respect to the size of the problem.