Abstract
The Production Operations Management System (POMS) software allows production teams and analysis groups across multiple Fermilab experiments to launch, modify and monitor large scale campaigns of related Monte Carlo or data processing jobs, and currently manages the majority of production computing of experiments at Fermilab. POMS provides a web service interface that enables automated job submission on distributed resources according to customers’ requests, as well as subsequent monitoring of those submissions as well as recovery of failed submissions, debugging and record keeping. POMS interfaces with existing HEP data access, processing, movement and monitoring tools at Fermilab, including Jobsub (for job submission), SAM (for data management), and Landscape (for monitoring), and in combination with them handles the creation of intermediate datasets of files for multistage campaigns. POMS visualizes these campaigns with an interactive GUI interface. An important feature of POMS is a one-to-one connection between the GUI campaign visualizer and a text based representation of the complete campaign configuration. An extensible library of template campaign configurations is available. The templates are user modifiable and map cleanly to and from the GUI description of the campaign. This paper will discuss the current usage, history, and some technical details of POMS, as well as planned future extensions, particularly interfacing with Rucio as well as SAM for file movement.
Highlights
Production Operations Management System (POMS) is a service to assist experiments in their MonteCarlo production and data processing, both for production and analysis
POMS consists of a web service interface, which enables
In the last calendar year, POMS launched over 250,000 production submissions, a large proportion of them automatically, either via cron-style scheduling, or as later stages in a multistage workflow
Summary
POMS is a service to assist experiments in their MonteCarlo production and data processing, both for production and analysis. As the quantity of data originated by the experiments running at Fermilab continues to increase greatly, approaches to simplify and organize the steps. POMS managed approximately two thirds of the production computing of Fermilab experiments in the last year. Automated job submission on distributed resources according to customers requests and. Record keeping and is accessible to users directly via a web browser, or from command line tools
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
