A Reinforcement Learning-Based Reverse Auction Enforcing Smart Pricing Policies towards B5G Offloading Strategies

Abstract

In this paper, we present our work on developing a Smart Pricing Policies module specifically designed for individual users and Mobile Network Operators (MNOs). Our framework will operate in a multi-MNO blockchain radio access network (B-RAN) and is tasked with determining prices for resource sharing among users and MNOs. Our sophisticated adaptive pricing system can adjust to situations where User Equipment (UE) shifts out of the coverage area of their MNO by immediately sealing a contract with a different MNO to cover the users’ needs. This way, we aim to provide financial incentives to MNOs while ensuring continuous network optimization for all parties involved. Our system accomplishes that by utilizing deep reinforcement learning (DLR) to implement a reverse auction model. In our reinforcement learning scenario, the MNOs, acting as agents, enter a competition and try to bid the most appealing price based on the user’s request, and based on the reward system, agents that do not win in the current round will adjust their strategies in an attempt to secure a win in subsequent rounds. The findings indicated that combining DRL with reverse auction theory offers a more appropriate method for addressing the pricing and bid challenges, and additionally, administrators can utilize this strategy to gain a notable edge by dynamically selecting and adjusting their methods according to the individual network conditions and requirements.