This paper introduces a novel approach, Visible Light Communication (VLC), to optimize urban intersections by integrating VLC localization services with learning-based traffic signal control. The system enhances communication between connected vehicles and infrastructure using headlights, streetlights, and traffic signals to transmit information. Through Vehicle-to-Vehicle (V2V) and Infrastructure-to-Vehicle (I2V) interactions, joint data transmission and collection occur via mobile optical receivers. The goal is to reduce waiting times for pedestrians and vehicles, enhancing overall traffic safety by employing flexible and adaptive measures accommodating diverse traffic movements. VLC cooperative mechanisms, transmission range, relative pose concepts, and queue/request/response interactions help balance traffic flow and improve road network performance. Evaluation in the SUMO urban mobility simulator demonstrates advantages, reducing waiting and travel times for both vehicles and pedestrians. The system employs a reinforcement learning scheme for effective traffic signal scheduling, utilizing VLC-ready vehicles to communicate positions, destinations, and routes. Agents at intersections calculate optimal strategies, communicating to optimize overall traffic flow. The proposed decentralized and scalable approach, especially suitable for multi-intersection scenarios, showcases the feasibility of applying reinforcement learning in real-world traffic scenarios.