A Deep Reinforcement Learning Based Switch Controller Mapping Strategy in Software Defined Network

Abstract

Software defined network (SDN) is a promising technology which can reduce network management complexity through the decoupling of the control plane and data plane. Due to large number of switches in the data plane, distributed and multiple controllers are necessary in the control plane for managing the switches. The switch controller mapping strategy for identifying the mapping relationships between the switch and controller is crucial in order to optimize the network performance. Considering the dynamics of the network behavior, it is quite important and challenging to develop models to reflect the network topology dynamics and to propose method for solving the long-term network performance optimization. Inspired by the recent advances in Artificial Intelligence (AI), in this paper, we propose a Deep Reinforcement Learning (DRL) based strategy for solving the switch controller mapping problem. A DRL based mapping strategy is proposed, in which Markov Decision Process (MDP) formulation is devised and Deep $Q$ -network (DQN) is proposed to achieve the maximization of long-term system performance by leveraging network latency, load balancing and system stability. Extensive simulations show that the DQN based algorithm can achieve the best system stability results while maintaining moderate switch controller latency and system equilibrium performance comparing with the optimization which only considers current system performance for switch controller mapping decision, and the optimization approaches which generate mapping decisions purely based on latency or load balancing separately.