Abstract

The High Performance Computing (HPC) domain aims to optimize code to use the latest multicore and parallel technologies including specific processor instructions. In this computing framework, portability and reproducibility are key concepts. A way to handle these requirements is to use Linux containers. These "light virtual machines" allow users to encapsulate applications within its environment in processes. Containers have been recently highlighted because they provide multi-infrastructure environnement for both developers and system administrators. Furthermore, they offer reproducibility due to image building files. Two container solutions are emerging: Docker for micro-services and Singularity for computing applications. We present here the Com-puteOps project which investigates the container benefits for HPC applications.

Highlights

  • The ComputeOps1 project, started in 2018, targets container technologies for the High Performance Computing (HPC) domain

  • The first year of the project has been dedicated to selection of container technology allowing to run container applications on HPC infrastructures

  • The project members have selected several use cases as pilot applications. These pilot applications will demonstrate the interest of encapsulating environment in containers in the HPC domain

Read more

Summary

Introduction

The ComputeOps project, started in 2018, targets container technologies for the High Performance Computing (HPC) domain. The first year of the project has been dedicated to selection of container technology allowing to run container applications on HPC infrastructures. The project members have selected several use cases as pilot applications. These pilot applications will demonstrate the interest of encapsulating environment in containers in the HPC domain. The project has started to provide tools for the research community: a private Singularity Hub has been settled and connected to the GitLab platform

Partners
Pilot applications
Solution description
Singularity
Shifter
CharlieCloud
Achievements
Singularity Hub
The ComputeOps image collection
A Comprehensive Software Archive Network
CI with Singularity
Tutorials
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.