Abstract
The CERN IT Storage Group ensures the symbiotic development and operations of storage and data transfer services for all CERN physics data, in particular the data generated by the four LHC experiments (ALICE, ATLAS, CMS and LHCb). In order to accomplish the objectives of the next run of the LHC (Run-3), the Storage Group has undertaken a thorough analysis of the experiments’ requirements, matching them to the appropriate storage and data transfer solutions, and undergoing a rigorous programme of testing to identify and solve any issues before the start of Run-3. In this paper, we present the main challenges presented by each of the four LHC experiments. We describe their workflows, in particular how they communicate with and use the key components provided by the Storage Group: the EOS disk storage system; its archival back-end, the CERN Tape Archive (CTA); and the File Transfer Service (FTS). We also describe the validation and commissioning tests that have been undertaken and challenges overcome: the ATLAS stress tests to push their DAQ system to its limits; the CMS migration from PhEDEx to Rucio, followed by large-scale tests between EOS and CTA with the new FTS “archive monitoring” feature; the LHCb Tier-0 to Tier-1 staging tests and XRootD Third Party Copy (TPC) validation; and the erasure coding performance in ALICE.
Highlights
The CERN IT Storage group (IT–ST) provides many services to the physics community
We will describe the three key components used by the four Large Hadron Collider (LHC) experiments: the EOS disk storage system [1], its archival back-end, the CERN Tape Archive (CTA) [2], and the File Transfer Service (FTS) [3], which are essential for LHC data taking, data processing, data distribution, and analysis
According to the experiments’ needs, EOS has expanded its offer with a wide variety of authentication methods, such as Krb5, X.509, OIDC, JWT, and proprietary token authorization. It became a common integrator in the CERN storage solutions by providing different functionalities for other CERN services, for example the Sync & Share functionalities for the CERNBox front-end, to offer easy collaborations between CERN users; and its buffer capabilities for the CERN Tape Archive (CTA) software
Summary
The CERN IT Storage group (IT–ST) provides many services to the physics community. In this introduction, we will describe the three key components used by the four LHC experiments: the EOS disk storage system [1], its archival back-end, the CERN Tape Archive (CTA) [2], and the File Transfer Service (FTS) [3], which are essential for LHC data taking, data processing, data distribution, and analysis.
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
