A Grouping Design for Cascaded Coded Distributed Computing

Abstract

In order to reduce the communication load in general distributed computing frameworks such as MapReduce Li et al. introduced coded distributed computing (CDC). The authors in [1] proposed a scheme for cascaded coded distributed computing on general networks. Although the numbers of input files and output functions in [1] are much less than those in [2], large numbers of input files and output functions are still required. In this paper, we present a new CDC scheme which 1) designs the assignments of input file and output function; 2) requires less number of input files and output functions compared with those in the scheme derived by [1]. Meanwhile, the ratio of communication load to that of the scheme in [1] is less than <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{the}\frac{4}{3}$</tex> .