Q value-based Dynamic Programming with SARSA Learning for real time route guidance in large scale road networks

Abstract

In this paper, a distributed dynamic traffic management model has been proposed to guide the vehicles, in order to minimize the computation time, make full use of real time traffic information and consequently improve the efficiency of the traffic system. For making the model work, we proposed a new dynamic route determination method, in which Q value-based Dynamic Programming and Sarsa Learning are combined to calculate the approximate optimal traveling time from each section to the destinations in the road networks. The proposed traffic management model is applied to the large scale microscopic simulator SOUND/4U based on the real world road network of Kurosaki, Kitakyushu in Japan. The simulation results show that the proposed method could reduce the traffic congestion and improve the efficiency of the traffic system effectively compared with the conventional method in the real world road network.