Abstract

In November 2018, the KISTI Tier-1 centre started a project to design, develop and deploy a disk-based custodial storage with error rate and reliability compatible with a tape-based storage. This project has been conducted in collaboration with KISTI and CERN; especially the initial design was laid out from the intensive discussion with CERN IT and ALICE. The system design of the disk-based custodial storage consisted of high density JBOD enclosures and erasure coding data protection, implemented in EOS, the open-source storage management developed at CERN. In order to balance the system reliability, data security and I/O performance, we investigated the possible SAS connections of JBOD enclosures to the front-end node managed by EOS and the technology constraints of interconnections in terms of throughput to accommodate large number of disks foreseen in the storage. This project will be completed and enter production before the start of LHC Run3 in 2021. In this paper we present the detailed description on the initial system design, the brief results of test equipment for the procurement, the deployment of the system, and the further plans for the project.

Highlights

  • The Worldwide LHC Computing Grid (WLCG) is a global cyber-infrastructure formed to store and process large-scale data produced from the experiments at the Large Hadron Collider (LHC), the world’s largest accelerator at the European Organisation for Nuclear Research (CERN)

  • Like Tier-0 at CERN, providing custodial storage is the one of the requirements for all WLCG Tier-1 sites in order to securely preserve a portion of raw data generated and distributed from CERN

  • The recent releases of EOS implemented erasure coding that enables to configure Redundant Array of Independent Nodes (RAIN) [8]. This feature provides a high level of reliability in terms of data protection with the combination of many data nodes and a few parity nodes analogous to the Redundant Array of Independent Disks (RAID)

Read more

Summary

Introduction

The Worldwide LHC Computing Grid (WLCG) is a global cyber-infrastructure formed to store and process large-scale data produced from the experiments at the Large Hadron Collider (LHC), the world’s largest accelerator at the European Organisation for Nuclear Research (CERN). The WLCG consists of a number of research institutes, universities and computing centres around the world They are classified into three tiers – Tier-0, Tier-1 and Tier-2 – depending on their roles such as raw data preservation and processing, simulation, organised/unorganised analyses, etc. The two remaining companies have had patent dispute in the first half of 2019 which led to the suspension of entire LTO-8 tape cartridge supply throughout the year [5, 6]. These events have raised the community’s concerns about the exclusive control of tape supply since 2017

Alternative to Tape Archive Storage Project
High Density JBOD Products
Demo Equipment Test
Multipath Mode
Power Consumption
Findings
Conclusions
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.