Parallel and Memory-Efficient Distributed Edge Learning in B5G IoT Networks

Abstract

Nowadays we are witnessing rapid development of the Internet of Things (IoT), machine learning, and cellular network technologies. They are key components to promote wireless networks beyond 5G (B5G). The plenty of data generated from numerous IoT devices, such as smart sensors and mobile devices, can be utilised to train intelligent models. But it still remains a challenge to efficiently utilise IoT networks and edge in B5G to conduct model training. In this paper, we propose a parallel training method which uses operators as scheduling units during training task assignment. Besides, we discuss a pebble-game-based memory-efficient optimisation in training. Experiments based on various real world network architectures show the flexibility of our proposed method and good performance compared with state of the art.