Mobility-Aware Service Migration for Seamless Provision: A Reinforcement Learning Approach

Abstract

Mobile Edge Computing (MEC) is a promising paradigm to support high-quality time-sensitive applications. In this paper, we investigate the service migration (i.e., whether, when, and where to migrate the services) to seamlessly serve mobile users in small-cell MEC systems. The service migration is formulated as an optimization problem to minimize the long-term system average delay that consists of queuing, communication, and migration delays. Considering the dynamic user mobility and network conditions, the formulated problem is non-convex and difficult to solve in real time. To this end, we propose a Mobility-aware Service Migration scheme, named MSM, to make real-time decisions on service migrations by utilizing reinforcement learning (RL) approaches. Specifically, we first design a user classification mechanism based on users’ mobility patterns to reduce the complexity of decision-making. We then formulate the service migration as a Markov decision process and devise an RL-based framework to make service migration decisions in real time in the dynamic MEC environment. Extensive data-driven experiments demonstrate the efficacy of MSM in reducing the system average delay.