Abstract

The DPM (Disk Pool Manager) system is a multiprotocol scalable technology for Grid storage that supports about 130 sites for a total of about 90 Petabytes online. The system has recently completed the development phase that had been announced in the past years, which consolidates its core component (DOME: Disk Operations Management Engine) as a full-featured high performance engine that can also be operated with standardWeb clients and uses a fully documented REST-based protocol. Together with a general improvement on performance and with a comprehensive administration command-line interface, this milestone also brings back features like the automatic disk server status detection and the volatile pools for deploying experimental disk caches. In this contribution we also discuss the end of support for the historical DPM components (that also include a dependency on the Globus toolkit), whose deployment is now only linked to the usage of the SRM protocols, hence can be uninstalled when these are not needed any more by the site.

Highlights

  • The Disk Pool Manager (DPM) is a lightweight solution for grid-enabled disk storage management

  • The system has recently completed the development phase that had been announced in the past years, which consolidates its core component (DOME: Disk Operations Management Engine) as a full-featured high performance engine that can be operated with standard Web clients and uses a fully documented REST-based protocol

  • DOME’s adoption aims at augmenting the Disk Pool Manager (DPM) system so that its core coordination functions and inter-cluster communication paths are implemented through open protocols, and following contemporary development approaches targeting performance, scalability and maintainability

Read more

Summary

Introduction

The Disk Pool Manager (DPM) is a lightweight solution for grid-enabled disk storage management. DPM provides an easy way to manage and configure disk pools, and exposes multiple data access interfaces (xrootd [2], GridFTP and HTTP/WebDAV). The dmlite framework and its associated plugins enabled support for the more recent data access protocols used by HEP (HTTP with multi-range requests and xrootd). DOME communicates using HTTP and JSON with other parts of the system through the XrdHTTP plugin of the Xrootd framework. DOME’s adoption aims at augmenting the Disk Pool Manager (DPM) system so that its core coordination functions and inter-cluster communication paths are implemented through open protocols, and following contemporary development approaches targeting performance, scalability and maintainability

From spacetokens to quota tokens
DOME Architecture
Storage Resource Reporting
Caching with volatile pools
Admin interface: dmlite-shell
Drain via HTTP
Configuration tool
Transitioning steps
End of support for legacy components
10 Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call