Mobile-Edge-Computing-Based Hierarchical Machine Learning Tasks Distribution for IIoT

Abstract

In this article, we propose a novel framework of mobile edge computing (MEC)-based hierarchical machine learning (ML) tasks distribution for the Industrial Internet of Things. It is assumed that a batch of ML tasks, such as anomaly detection, need to be executed timely in an MEC setting, where the devices have limited computing capability while the MEC server (MES) has rich computing resources. Thus, a small ML model for the device and a deep ML model for the MES are pretrained offline using historical data, and then they are deployed accordingly. However, offloading tasks to the MES introduces communications delay. Thus, each device must decide the portion of the tasks to offload to minimize the processing delay. Since the delay and the error of data processing are incurred by communications and ML computing, a joint optimization problem is formulated to minimize the total delay subject to the ML model complexity and inference error rate, data quality, computing capability at the device and MES, and communications bandwidth. A closed-form solution is derived analytically and an optimal offloading strategy selection algorithm is proposed. Insights are provided to understand the tradeoff between communications and ML computing in offloading decisions, and the effects of key parameters in the proposed algorithm are investigated. The numerical results demonstrate the effectiveness of the proposed algorithm.