Cycle-based signal timing with traffic flow prediction for dynamic environment

Abstract

This article studies adaptive traffic signal control problem of single intersection in dynamic environment. A novel cycle-based signal timing method with traffic flow prediction (CycleRL) is proposed to improve the traffic efficiency under dynamic traffic flow. Firstly, the empirical mode decomposition is applied to denoise the flow data. Then a data-model hybrid driven traffic flow prediction strategy is designed to predict the traffic flow, which combines a model-based Kalman filter and an LSTM network-based predictor and adopts another Kalman filter to fuse both prediction results to improve the prediction precision. Besides, a robust signal cycle timing strategy based on human-machine collaboration is developed to deal with dynamic traffic flow, which firstly designs a rule-based signal cycle scheme according to the predicted flow data as the preliminary scheme, and then finetunes the preliminary scheme based on Soft Actor-Critic (SAC) algorithm according to the real-time traffic dynamics. The experiments in both synthetic scenario and real-world scenario show that the proposed data-model hybrid driven traffic flow prediction algorithm has better prediction performance and the proposed CycleRL method outperforms rule-based methods, flow-based allocation methods and traditional reinforcement learning method. Moreover, it is also shown that the proposed CycleRL method has better transferability to bridge the discrepancy across domains.