Abstract

The dCache project provides open-source software deployed internationally to satisfy ever more demanding storage requirements. Its multifaceted approach provides an integrated way of supporting different use-cases with the same storage, from high throughput data ingest, data sharing over wide area networks, efficient access from HPC clusters and long term data persistence on a tertiary storage. Though it was originally developed for the HEP experiments, today it is used by various scientific communities, including astrophysics, biomed, life science, which have their specific requirements. In this paper we describe some of the new requirements as well as demonstrate how dCache developers are addressing them.

Highlights

  • The dCache project started in 2000 as a collaboration between Deutsches ElektronSynchrotron (DESY) and Fermilab National Accelerator Laboratory

  • A POSIX compliant namespace and the clean separation between that namespace and the location of the file's data meant that various operator interventions were possible without requiring a downtime, and that the failure of some storage node resulted in the unavailability of only data stored exclusively on that node

  • WLCG is a collection of research institutes and universities across the world that collaborate to provide the storage and computing resources necessary to analyze the data coming from the four LHC experiments

Read more

Summary

INTRODUCTION

The dCache project started in 2000 as a collaboration between Deutsches ElektronSynchrotron (DESY) and Fermilab National Accelerator Laboratory. WLCG is a collection of research institutes and universities across the world that collaborate to provide the storage and computing resources necessary to analyze the data coming from the four LHC experiments. Various laboratories and universities have deployed dCache Combined, they provide some 50% of the overall WLCG storage capacity. They provide some 50% of the overall WLCG storage capacity These resources have proved critical to the recent discovery of the Higgs boson[1]. Sites are using dCache to support communities that have different requirements from WLCG; for example, DESY facilities and services support photon sciences, biology, future accelerators, R&D and others. From its earliest versions forward, dCache has responded to the challenges presented by new user communities and new ways of working, developing and adopting innovative solutions aimed at satisfying the demands for increased productivity [3]

Federated systems
Quality of Service
Non HEP Analysis
Tape interface
Storage Events
Summary and Outlook

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.