Abstract
HEPSPEC-06(HS06) is a decade old suite used to benchmark CPU resources for WLCG. Its adoption spans from hardware vendors, to site managers, funding agencies and software experts. Although it is stable, reproducible and accurate, it is reaching the end of its life. Initial hints of lack of correlations with HEP applications have been collected. Looking for suitable alternatives the HEPiX Benchmarking Working Group has evaluated SPEC CPU 2017 with a number of fast benchmarks. The studies that have been done so far do not show any major advantage in adopting SPEC CPU 2017 with respect to HS06.A suite based on workloads that HEP experiments run can be an alternative to industrial standard benchmarks. The adoption by LHC experiments of modern software development techniques simplifies the ability to package, distribute and maintain a field-specific benchmark suite. The HEPiX Benchmarking Working Group is actively working to make this possible.This report summarises the progress of the HEPiX Benchmarking Working Group in building a benchmarking suite based on HEP workloads. Comparisons of results with SPEC CPU 2017 and HS06 will be discussed.
Highlights
Since its foundation in 1991, the HEPiX forum brings togethers worldwide IT professionals from the HEP laboratories and institutes [1], with the purpose of sharing experience on their common computing challenges
In 2006 a dedicated working group, the HEPiX Benchmarking Working Group, was established to cover the CPU benchmarking topic and, in particular, to address the identified discrepancies between the performance of the HEP applications and SI2K [2], the standard benchmark used at the time to measure the CPU performance
In 2009 the BWG suggested the adoption of a new HEP specific benchmark suite, HEP-SPEC06 (HS06) [3], based on a subset of the industry standard benchmark SPEC CPU2006 [4]
Summary
Since its foundation in 1991, the HEPiX forum brings togethers worldwide IT professionals from the HEP laboratories and institutes [1], with the purpose of sharing experience on their common computing challenges. In 2006 a dedicated working group, the HEPiX Benchmarking Working Group (here BWG), was established to cover the CPU benchmarking topic and, in particular, to address the identified discrepancies between the performance of the HEP applications and SI2K [2], the standard benchmark used at the time to measure the CPU performance. In addition the adoption of public and private cloud resources generated interest in a family of benchmarks that could run much faster than HS06 while keeping adequate correlation with the HEP workloads. This situation revived the activity of the BWG. The sections describe the state of the art of the BWG’s activities, the achieved results, and the future plans
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
