Coordinated Control of Distributed Traffic Signal Based on Multiagent Cooperative Game

Zhenghua Zhang,Chongxin Fang,Jin Qian,Guoshu Liu,Quan Su,Zhipeng Cai

doi:10.1155/2021/6693636

Zhenghua Zhang, Chongxin Fang + Show 4 more

Open Access

https://doi.org/10.1155/2021/6693636

Copy DOI

Abstract

In the adaptive traffic signal control (ATSC), reinforcement learning (RL) is a frontier research hotspot, combined with deep neural networks to further enhance its learning ability. The distributed multiagent RL (MARL) can avoid this kind of problem by observing some areas of each local RL in the complex plane traffic area. However, due to the limited communication capabilities between each agent, the environment becomes partially visible. This paper proposes multiagent reinforcement learning based on cooperative game (CG-MARL) to design the intersection as an agent structure. The method considers not only the communication and coordination between agents but also the game between agents. Each agent observes its own area to learn the RL strategy and value function, then concentrates the Q function from different agents through a hybrid network, and finally forms its own final Q function in the entire large-scale transportation network. The results show that the proposed method is superior to the traditional control method.

Highlights

With the continuous growth of modern urban road traffic volume and road network density, traffic congestion has become a global common problem
With the passage of time, the congestion of intersection may gradually spread to several intersections in the surrounding area or even all intersections in the whole area
On the premise of not changing the road network structure, the traffic signal adaptive control strategy can improve the traffic efficiency of the intersection and effectively reduce the emission pollution caused by vehicle starting and braking

Summary

Introduction

With the continuous growth of modern urban road traffic volume and road network density, traffic congestion has become a global common problem. With the passage of time, the congestion of intersection may gradually spread to several intersections in the surrounding area or even all intersections in the whole area. Due to the limitation of urban space, it is difficult to realize the connection by expanding the road [1]. On the premise of not changing the road network structure, the traffic signal adaptive control strategy can improve the traffic efficiency of the intersection and effectively reduce the emission pollution caused by vehicle starting and braking

Objectives

Results

Conclusion