Scheduling in an unstructured peer‐to‐peer‐based high performance computing system

Abstract

PurposePeer‐to‐peer (P2P) communities have the capability to construct a powerful virtual supercomputer by assembling idle internet cycles. The purpose of this paper is to present the scheduling issues in an unstructured P2P‐based high performance computing (HPC) system to achieve high performance for applications.Design/methodology/approachA new application model is proposed for the system, where applications are parallelized in the program level. To address high performance for these applications, the system resources are controlled in a semi‐centralized 3‐layer network, where volunteers form many autonomous unstructured P2P domains. Furthermore, based on such a resource management policy, a job scheduling strategy is adopted, which is collaborated by global and domain scheduling. The global scheduling is responsible for the balance among domains, while the domain scheduling resolve workpiles' execution in a domain.FindingsTheoretical analysis and a benchmark experiment show that the scheduling provides scalable and enormous computing capability in the P2P‐based HPC system.Originality/valueThe paper shows that scheduling helps P2HP (an unstructured P2P‐based HPC system) provide scalable and enormous computing capability for HPC applications.