Abstract

Storage capacity at CMS Tier-1 and Tier-2 sites reached over 100 Petabytes in 2014, and will be substantially increased during Run 2 data taking. The allocation of storage for the individual users analysis data, which is not accounted as a centrally managed storage space, will be increased to up to 40%. For comprehensive tracking and monitoring of the storage utilization across all participating sites, CMS developed a space monitoring system, which provides a central view of the geographically dispersed heterogeneous storage systems. The first prototype was deployed at pilot sites in summer 2014, and has been substantially reworked since then. In this paper we discuss the functionality and our experience of system deployment and operation on the full CMS scale.

Highlights

  • CMS experiment computing [1] infrastructure spans over more than a hundred of geographically distributed sites that provide both computational and data storage resources

  • Data stored at the sites are coming from a variety of sources and include i) centrally managed data sets such as real detector data and simulated data samples at various stages of reprocessing, software release validation samples; ii) files created by individual users or members of physics analysis groups stored at the associated institute sites; iii) temporary unmerged files generated as part of the data processing workflows; iiii) load test and backfill data used for availability and scalability testing [2]

  • In concluding sections we present project’s current status and our experience of SpaceMon deployment at CMS sites

Read more

Summary

Comprehensive Monitoring for Heterogeneous Geographically Distributed Storage

This content has been downloaded from IOPscience. Please scroll down to see the full text. Ser. 664 042055 (http://iopscience.iop.org/1742-6596/664/4/042055) View the table of contents for this issue, or go to the journal homepage for more. Download details: IP Address: 137.138.93.202 This content was downloaded on 09/03/2016 at 08:34 Please note that terms and conditions apply. 21st International Conference on Computing in High Energy and Nuclear Physics (CHEP2015) IOP Publishing. Journal of Physics: Conference Series 664 (2015) 042055 doi:10.1088/1742-6596/664/4/042055

Introduction
Published under licence by IOP Publishing Ltd
Findings
Accounting Schema
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call