Dynamic Pricing Scheme for Edge Computing Services: A Two-layer Reinforcement Learning Approach

Abstract

Edge computing servers (ECSs) have been widely deployed in large-scale mobile edge computing (MEC) systems, which can provide nearby computing services by charging users a price. Service pricing schemes can regulate user task offloading and affect the total revenue of service providers. Investigating how to maximize the revenue of service provider and improve the utilization of edge computing resources becomes crucial while is challenging, considering the users mobility and the uncertainty of users service requests. In this paper, we model the dynamic pricing process of ECS as a Markov decision process and propose a dynamic pricing approach based on Dueling Double Deep Q Network (D3QN) by using the current load conditions and user characteristics, the goal of which is to maximize the revenue of service provider. In addition, considering more ECSs in the MEC system, with the dynamic variations of ECSs loads and the different arrival rate of user tasks, we propose a joint scheduling approach based on D3QN (called RLJS) to collectively improve the total service revenue of service providers. Specifically, we first use a data-driven method to group the ECSs and then devise a D3QN-based task scheduling scheme to distribute tasks among ECS groups by considering the load and price conditions in real time. Simulation results demonstrate the efficacy of RLJS in improving the total revenue of the system provider and reducing the user delays.