IMTRAC: Image-Based Modeling for Transformative Traffic Control via Foundation Models

Abstract

This paper introduces the Image-based Modeling for Transformative Traffic Control (IMTRAC) framework, which revolutionizes urban traffic management by integrating image-based representations, foundation models, and dynamic signaling. It transitions from textual to visual data analysis, transforming complex traffic scenes into quantifiable insights. The image-based representation is then analyzed by foundation models to infer refined and effective traffic control policies. Our experimental results show marked improvements in traffic flow and reductions in waiting times, highlighting IMTRAC’s ability to outperform traditional control methods. The proposed IMTRAC promises a significant leap towards smarter, efficient urban traffic systems, leveraging the synergy of advanced imaging techniques and multi-modal foundation models to enhance control decisions.