Abstract

Recent studies have made dozens of attempts to apply multi-agent deep reinforcement learning (MARL) for large-scale traffic signal control. However, most related studies have ignored how to master arterial traffic signal control. We cannot easily extract useful information and search solution space because the arterial traffic control problem has large state-action spaces. Here we tackle these issues by proposing a multi-agent attention-base soft actor-critic (MASAC) model to master arterial traffic control. Specifically, we implement the attention mechanism in the actor and critic network to enhance traffic information extraction ability. More importantly, we are the first to apply the soft actor-critic (SAC) algorithm to train the arterial traffic control model to search more solution spaces. Testing results indicate that the MASAC method significantly outperforms existing MARL algorithms and the multiband-based method. These findings can help researchers to design better model structures for other MARL problems.

Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.