Abstract
Over recent years we have seen a constant evolution of High-Performance Computing moving into commodity servers cluster types of systems. At the same time we have seen Cloud Computing being a proven, stable and reliable IT paradigm, utilising virtualized clusters of commodity servers as key components. This paper presents a face-to-face native-to-virtual HPC MPI application performance analysis on a range of general-use HPC applications by virtualizing InfiniBand via IPoIB at the guest virtual machine level on VMware ESXi as well as KVM hypervisor with production ready live migration support. Applications running on various small and medium HPC clusters are targeted to address users, considering full IT infrastructure virtualization by merging general purpose with HPC IT infrastructure. Live migration is a key component within a virtualized environment as it enables dynamic virtual IT infrastructure, therefore live migration performance impact is evaluated through a pluggable multi-platform architecture on a proactive fault-tolerance use case.
Highlights
The diversities of HPC applications range from shared-memory, distributed memory, PGAS (Partitioned Global Address Space) and other architecture-dependent and architecture-independent types of applications
General HPC virtualization studies, e.g. [7] cover general benefits and pitfalls related to High-Performance Cloud Computing outlining, many still open up questions such as scalability issues and performance variations depending on a particular application
This paper presented MPI application performance analysis within a virtualized environment using paravirtualized IPoIB InfiniBand network
Summary
This paper discusses the technological details behind IPoIB virtualization and presents performance analysis with results that should answer the question whether running MPI applications on a virtualized system with IPoIB virtualization yields an acceptable performance This would enable seamless transformation of HPC clusters into virtualized environments, merging general purpose with HPC IT infrastructure and would help users to decide whether cloud solutions, based on IPoIB virtualization would be appropriate for running MPI applications. This feature is used as the evaluation of live migration impact.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.