Toward Attack-Resistant Route Mutation for VANETs: An Online and Adaptive Multiagent Reinforcement Learning Approach

Abstract

Vehicular Ad hoc Networks (VANETs) are prone to packet drop attacks because of their inherent distributed architecture and dynamic topology. Existing security schemes mainly focus on multi-path and trust-based routing. Unfortunately, the former causes high energy consumption and the latter requires trust assessment, which is not easy to implement in practice. Route mutation (RM) is emerging as an active defense technology that changes routes periodically. Traditional RM is conceived for fixed network topologies, and needs a centralized controller, so that it cannot be applied to VANETs. Therefore, the present contribution investigates RM in VANETs by proposing a Grid-based extended Joint Action Learning approach (Grid-eJAL). To the best of our knowledge, this is the first contribution that designs an online and adaptive multi-agent reinforcement learning (MARL) for RM to mitigate attacks in VANETs. Differently from existing MARL schemes, Grid-eJAL allows vehicles to share parameters to accelerate the convergence speed of learning. In Grid-eJAL, the area of interest is split in equally sized grids and, when a vehicle transmits packets, the next hop with the minimum angle of mobility is selected within the grid considered as optimal by the learning policy. The convergence of Grid-eJAL is proved theoretically. Finally, extensive simulation results highlight the effectiveness of Grid-eJAL compared to representative state-of-the-art solutions.