Abstract

Since 2018 several FAIR Phase 0 beamtimes have been operated at GSI, Darmstadt. Here the new challenging technologies for the upcoming FAIR facility shall be tested while various physics experiments are performed with the existing GSI accelerators. One of these challenges concerns the performance, reliability, and scalability of the experiment data storage. Raw data as collected by event building software of large scale detector data acquisition has to be safely written to a mass storage system like a magnetic tape library. Besides this long term archive, it is often required to process this data as soon as possible on a high performance compute farm. The C library LTSM (“Lightweight Tivoli Storage Management”) has been developed at the GSI IT department based on the IBM TSM software. It provides a file API that allows for writing raw listmode data files via TCP/IP sockets directly to an IBM TSM storage server. Moreover, the LTSM library offers Lustre HSM (“Hierarchical Storage Management”) capabilities for seamlessly archiving and retrieving data stored on Lustre file system and TSM server. In spring 2019 LTSM has been employed at the FAIR Phase 0 beamtimes at GSI. For the HADES experiment LTSM was implemented into the DABC (“Data Acquisition Backbone Core”) event building software. During the 4 weeks of Ag+Ag@1.58 AGeV beam, the HADES event builders have transferred about 400 TB of data via 8 parallel 10 GbE sockets, both to the TSM archive and to the “GSI green cube” HPC farm. For other FAIR Phase 0 experiments using the vintage MBS (“Multi Branch System”) event builders, an LTSM gateway application has been developed to connect the legacy RFIO (“Remote File I/O”) protocol of these DAQ systems with the new storage interface.

Highlights

  • The storage of raw data produced by a high data rate detector is a key component of an experimental facility

  • In March 2019 LTSM has been used during four weeks of beamtime at FAIR Phase 0 for production data storage of the HADES experiment [4]

  • Since 2014 DABC has been used at GSI as the production event builder system of the HADES experiment [4]

Read more

Summary

Introduction

The storage of raw data produced by a high data rate detector is a key component of an experimental facility. For the upcoming accelerator FAIR (Facility for Antiproton and Ion Research) in Darmstadt, a new experimental storage system is currently being developed. As a backend, this will use the Tivoli Storage Management (TSM) for magnetic tape libraries by IBM [1]. In March 2019 LTSM has been used during four weeks of beamtime at FAIR Phase 0 for production data storage of the HADES experiment [4]. This application delivered valuable experiences for the further development and deployment of LTSM

DAQ storage use cases
The LTSM software
Plug-in for DABC data acquisition
10 GbE IP
Gateway for MBS data acquisition
LTSM for HADES experiment at FAIR Phase 0
Findings
Outlook: the FSD server
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call