Efficient HPC and Energy-Aware Proactive Dynamic VM Consolidation in Cloud Computing

Abstract

The adoption of High-Performance Computing (HPC) applications has gained an extensive interest in the Cloud computing. Current cloud vendors utilize separate management tools for HPC and non-HPC applications, missing out on the consolidation benefits of virtualization. Non-HPC applications executed in the cloud may interfere with resource-hungry HPC applications, which is a key performance challenge. Furthermore, correlations between application major performance indicators, such as response time and throughput, with resource capacities reveal that conventional placement strategies are impacting virtual machine efficiency, resulting in poor resource optimization, increased operating expenses, and longer wait times. Since applications often underutilized the hardware, smart execution of HPC and Non-HPC applications on the same node can boost system and energy efficiency. This research incorporates proactive dynamic VM consolidation to enhance the resource usage and performance while maintaining energy efficiency. The proposed algorithm generates a workload-aware fine-grained classification by employing machine learning techniques to generate complimentary profiles that alleviate cross-application interference by intelligently co-locating non-HPC and HPC applications. The research used CloudSim to simulate real HPC workloads. The results verified that the proposed algorithm outperforms all heuristic methods with respect to the metrics in key areas.