Joint DNN Partition and Resource Allocation for Task Offloading in Edge–Cloud-Assisted IoT Environments

Abstract

Multi-access Edge Computing (MEC) is a promising approach to enhancing IoT devices running AI-based services. Especially, the edge-cloud architecture acts as a strong supporter of the resource-limited IoT devices. How to optimize the system resources efficiently to improve the service performance is the key issue in this scenario. Motivated by this, in this paper, we focus on a multi-Base Station (BS) and multi-service edge-cloud-assisted IoT environment, where both the BSs (with edge servers deployed) and the cloud can assist the IoT devices to process multi-type Deep Learning (DL) tasks via task offloading. DNN partition mechanism and both the communication and computing resources allocation are utilized to enable a collaborative optimization to minimize the processing delay of all the DL tasks in the system. Due to the Mixed Integer NonLinear Programming (MINLP) characteristic of our optimization problem, we propose an algorithm that decomposes the original problem into two sub-problems, solves them separately, and then obtains the near optimal solution efficiently. Extensive simulations are conducted by varying 5 different crucial parameters. The superiority of our scheme is demonstrated in comparisons with several other schemes proposed by existing works. Our scheme can achieve a notable 28.3% delay reduction on average.