A Robust Adaptive Traffic Signal Control Algorithm Using Q-Learning under Mixed Traffic Flow

Abstract

The operational and safety performance of intersections is the key to ensuring the efficient operation of urban traffic. With the development of automated driving technologies, the ability of adaptive traffic signal control has been improved according to data detected by connected and automated vehicles (CAVs). In this paper, an adaptive traffic signal control was proposed to optimize the operational and safety performance of the intersection. The proposed algorithm based on Q-learning considers the data detected by loop detectors and CAVs. Furthermore, a comprehensive analysis was conducted to verify the performance of the proposed algorithm. The results show that the average delay and conflict rate have been significantly optimized compared with fixed timing and traffic actuated control. In addition, the performance of the proposed algorithm is good in the test of the irregular intersection. The algorithm provides a new idea for the intelligent management of isolated intersections under the condition of mixed traffic flow. It provides a research basis for the collaborative control of multiple intersections.