1. HPC resources LHC experiments are using (as seen from ATLAS - CMS lens)
erhtjhtyhy
Doug Benjamin
Argonne National Lab

2. Thanks and apologies Talk is seen through ATLAS – CMS lens
Thanks : based on feed back and information from
Andrej Filipcic (ATLAS)
Dirk Hufnagel (CMS)
Alexei Klimentov (ATLAS)
Daniele Spiga (CMS)
Apologies to ALICE and LHCb.
ALICE successful in using several HPC centers for a while
NERSC and OLCF for example.
LHCb – HPC talk from 2018.

3. ATLAS HPC Sites/ PanDA queues

4. CMS HPC sites

5. ALOCATION Process

6. European HPC’s (non – pledged)
Typically negotiations directly with HPC center
Centers allocate most of their time through the local allocation process
HPC’s provide a fraction of resources to PRACE for HPC scientific communities, and the approval procedure is much more complicated and stricter
when a project is approved, the PRACE assigns the allocation to the HPC center which best fits the requirements of the application.
For the LHC experiments this would create additional technical issues.

7. US DOE LCF process
Source: Talk given by Katherine Riley – ALCF science director. In
ATLAS ALCC:
80M hrs OLCF
80M hrs ALCF
CMS: startup allocation at ALCF

8. US DOE – NERSC allocation program
Most time comes through DOE production
DOE Production time – managed through DOE program managers-
Total ATLAS CMS time essentially constant
2018 ATLAS: 175 M MPP hours CMS: 25M MPP hours Total: 200 M hrs.
2019 ATLAS: 120 M MPP hours CMS: 82M MPP hours Total: 202 M hrs.

9. National Science Foundation (NSF) XSEDE allocation program
CMS’ success
Q – Q1 2020
PSC/Bridges M hours
TACC/Stampede (node) hours
SDSC/Comet M hours

10. Going forward
Next few months - LHC experiments should think if ALCF – ADSP program would really help us in short term.
As more HPC’s with accelerators come on-line – challenge will be to get time if our needs are predominantly CPU only

11. Acknowledgement Policy -
CSCS
NERSC
Acknowledgements
Users must quote and acknowledge the use of CSCS resources in all publications related to their production and development projects as follows: "This work was supported by a grant from the Swiss National Supercomputing Centre (CSCS) under project ID ###"

12. Conclusions ATLAS and CMS both use a variety of HPC sites
CMS has done a lot of work to cvmfs available at sites they use.
ATLAS should make use of all CMS’ hard work
Should come up with common criteria for cvmfs where possible
use containers a places that can not or will not use cvmfs.
We will discuss the Operational model evolution later in this meeting.
Need to keep applying for yearly allocations through various programs.
Need multi-year allocations.
NERSC ATLAS allocation (175 M MPP hrs) to 2109 (120 M MPP hrs)
Notified just before the yearly allocation started.
If HPC’s are to be come part of the pledged resources then we need have multi-year allocations.
This is a discussion that should happen at the Funding Agency levels.