Fine-grained Cloud Edge Collaborative Dynamic Task Scheduling Based on DNN Layer-Partitioning

Abstract

Edge computing provides an opportunity to improve the quality of service (QoS) of Artificial Intelligence (AI) apps for the Internet of Things (IoTs) scenarios. It is an important way to improve the QoS of intelligent apps by deploying Deep Neural Network (DNN) models on edge nodes. Though the DNN execution time affects the QoS of apps significantly. Due to the limited and dynamic edge resources, and sudden load to edge nodes, it is hard to guarantee the DNN execution efficiency. In this paper, we conduct fine-grained decomposition of DNN tasks and propose a Cloud Edge Collaborative Dynamic Task Scheduling mechanism based on DNN layer-partitioning technique. The approach can realize the collaborative computing of DNN models between cloud and edge, and improve the execution efficiency of DNN models, which guarantees the QoS of AI apps. Through simulation experiments, compared with the existing task scheduling mechanism and AI app deployment mode, we show that the proposed cloud edge collaborative dynamic task scheduling mechanism can effectively reduce the average service response time in the edge intelligent system, so as to improve the apps' overall QoS of the system. Meanwhile, the task scheduling mechanism designed in this paper makes it possible for more complex intelligent models to run in a resource-constrained edge environment.