Distributed Learning in Noisy-Potential Games for Resource Allocation in D2D Networks

Abstract

We propose a distributed learning algorithm for the resource allocation problem in Device-to-Device (D2D) wireless networks that takes into account the throughput estimation noise. We first formulate a stochastic optimization problem with the objective of maximizing the generalized alpha-fair function of the network. In order to solve it distributively, we then define and use the framework of noisy-potential games. In this context, we propose a Binary Log-linear Learning Algorithm (BLLA), which is distributed across cells and converges to a Nash equilibrium of the resource allocation game. This equilibrium is also an optimal for the resource allocation optimization problem. A key enabler for the analysis of the convergence are the proposed rules for computation of resistance of trees of perturbed Markov chains. The convergence of BLLA is proved for bounded and unbounded noise, with fixed and decreasing temperature parameter. A sufficient number of estimation samples is also provided that guarantees the convergence to an optimal state in a single cell scenario and close to an optimal state in a multi-cell scenario. We assess the performance of BLLA by extensive simulations by considering both bounded and unbounded noise cases and show that BLLA achieves higher sum data rate compared to the state-of-the-art.