Abstract
We explore how the function as a service paradigm can be used to address the computing challenges in experimental high-energy physics at CERN. As a case study, we use funcX—a high-performance function as a service platform that enables intuitive, flexible, efficient, and scalable remote function execution on existing infrastructure—to parallelize an analysis operating on columnar data to aggregate histograms of analysis products of interest in real-time. We demonstrate efficient execution of such analyses on heterogeneous resources.
Highlights
High-energy physics (HEP) research using accelerators such as the Large Hadron Collider (LHC) requires the processing of massive sets of data recorded from particle collisions
While funcX can be employed in any domain, in this paper we explore its use in experimental HEP
To evaluate the performance of the funcX backend, we carried out scalability tests using a Columnar Object Framework For Effective Analysis (Coffea) analysis processor3 that was developed for an analysis of events recorded by the Compact Muon Solenoid (CMS) experiment at the LHC
Summary
High-energy physics (HEP) research using accelerators such as the Large Hadron Collider (LHC) requires the processing of massive sets of data recorded from particle collisions. The user must prepare and submit a batch script, authenticate separately on each resource, set up software and data, run the processing task, and pool results. The manager starts a set of worker processes (optionally within a user-specified container), each of which executes one task at a time and returns the resulting data. All interactions with funcX are carried out via the funcX client, which wraps the funcX service’s REST API This interface is used for registering functions, endpoints, and containers. Users may optionally specify a container in which the function will be executed In this case, the manager will either deploy a worker running within the requested container, or if such a worker is already available, assign the task to an existing worker.
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
