1. Introduction Rob Kutschke Mu2e Computing Review March 5, 2015 Mu2e-doc-5220-v1

2. Mu2e Speakers Rob Kutschke (FNAL) Bertrand Echenard (Caltech) Dave Brown (Louisville) Bob Bernstein (FNAL) Dave Brown (LBL) Andrei Gaponenko (FNAL) Ralf Ehrlich (UVa) Zhengyun You (UC Irvine) Pasha Murat (FNAL) Yuri Oksuzian (UVa) Ray Culbertson (FNAL) 2/6/15Kutschke | Introduction2

3. Some Advice Some figures render beautifully on your Retina Display –Not so well on the 20 th century era projector in this room You might wish to follow along on your laptop 2/6/15Kutschke | Introduction3

4. Overview of Talks (1) Talks to provide context and define language –IntroductionIntroduction –The Physics of Mu2eThe Physics of Mu2e –The Mu2e ApparatusThe Mu2e Apparatus –Background OverviewBackground Overview What were are doing now: –Software, Tools and Environment (1)Software, Tools and Environment –Project 1: Simulation of Proton Microbunch Events (1,2)Project 1: Simulation of Proton Microbunch Events –Project 2: Cosmic Ray Studies (1, 2)Project 2: Cosmic Ray Studies –Project 3: Beam Induced Hits in the CRV(1, 2)Project 3: Beam Induced Hits in the CRV 2/6/15Kutschke | Introduction4 (Charge Question(s) Addressed)

5. Overview of Talks (2) What do we plan going forward: –Resource Needs (2)Resource Needs –Analysis Model (1, 2, 3)Analysis Model –Roadmap to Operations (3)Roadmap to Operations Summary –Summary (1, 2, 3)Summary 2/6/15Kutschke | Introduction5

6. Three Main Software Packages G4beamline –First out of the gate –Used for studies of the muon beamline and shielding –Future support uncertain (Muons Inc) Mu2e Offline –Based on art; our G4 model runs within Mu2e Offline. –Sim/Reco/Analysis/Trigger code developed in this environment –The primary tool for detector studies –Expect it eventually to replace G4beamline for most purposes MARS –The tool of choice for thermal neutrons –Critical calculations done in both Geant4 and MARS 2/6/15Kutschke | Introduction6

7. Three Main Software Packages Computing and workflow issues are similar for all three –All run on the grid using Mu2e written scripts that live on top of jobsub and use SCD supplied tools ( eg ifdhc ) The examples in this review will mostly use Mu2e Offline jobs because they have the most complex workflows –There will be one example of a G4beamline job with a multi- step workflow. Code development: –G4beamline: we are not developers –Mu2e Offline: our main code development effort is here. –MARS: development of end-user code only 2/6/15Kutschke | Introduction7

8. What we will not cover in this review Jobs done by Accelerator Division using their own tools –Simulation of beam to the Delivery Ring –Simulation of the slow extraction –Simulation of the transport lines –Simulation of the Extinction RF dipole Internals of Mu2e Offline –Algorithms, data product design … Details of our use of G4beamline or MARS 2/6/15Kutschke | Introduction8

9. People (1) 2/6/15Kutschke | Introduction9 to CD2/3aTo nowTo CD3cInstituteMain Project Bob Bernstein0.2 0.4FNALSeniorSTM Steve Boi0.20.3 NUIStudentNTF Dave Brown0.5 LBLSeniorTracking Dave Brown0.040.140.28LouisvilleSeniorGeometry Rick Coleman0.4 FNALSeniorNTF Ray Culbertson0.10.8 FNALSeniorInfrastructure Bertrand Echenard0.3 CaltechPostdocCalorimeter Ralf Ehrlich0.50.90.7UvaPostdocCRV Dave Hendin0.3 NIUSeniorNTF Andrei Gaponenko0.90.050.8FNALWilson FellowMany Krzysztof Genser0.75 0.4FNALStaffG4 Vladimir Khalatian0.600NIUNTF Kyle Knoepfel0.80.050FNALPostdocMany Rob Kutschke0.50.10.6FNALSeniorMany Tony LevelingFNALSeniorMARS Vanya Logashenko0.0800NovosibirskSeniorTrapped particles Anna Mazzancanne0.50.250FNALStaffMARS Nikolia Mokhov0.150.1 FNALSeniorMARS James Mott0.2 0.05BUPostdocpi+ calib STM: Stopping Target MonitorNTF: Neutron Task Force

10. People (2) 2/6/15Kutschke | Introduction10 to CD2/3aTo nowTo CD3cInstituteMain Project Pasha Murat0.8FNALSeniorCalorimeter Yuri Oksuzian0.3 0.4UvaPostdocNTF Anthony Palladino0.050.70.4BUPostdocSTM Giani Pezzullo0.9 0.6PisaStudentCalorimeter Vitaly Pronskihk0.85 0.75FNALSeniorMARS Igor RakhnoFNALSeniorMARS Markus Roehrken0.5 CaltechPostdocStop Tgt Opt Zafar UsbovDubnaCal standalone Costas Vellidis0.10.20.8Athens/FNALSeniorBeta source study Chiho Wang000.4DukeSeniorWire Stabiltiy Mike Wang0.400.1FNALStaffTrk Trigger Zhengyun You0.9 0.6UCIPostdocp-bar Background Totals:11.0210.4910.48 Stop Tgt Opt: Optimization of Stopping Target Total 31 people: but many at very low duty cycle

11. People Working With/On Mu2e Offline, >= 0.4 to CD3c 2/6/15Kutschke | Introduction11 To CD3cInstituteMain Project Bob Bernstein0.4FNALSeniorSTM Dave Brown0.5LBLSeniorTracking Ray Culbertson0.8FNALSeniorInfrastructure Ralf Ehrlich0.7UvaPostdocCRV Andrei Gaponenko0.8FNALWFMany Krzysztof Genser0.4FNALStaffG4 Rob Kutschke0.6FNALSeniorMany Pasha Murat0.8FNALSeniorCalorimeter Yuri Oksuzian0.4UvaPostdocNTF Anthony Palladino0.4BUPostdocSTM Giani Pezzullo0.6PisaStudentCalorimeter Markus Roehrken0.5CaltechPostdocStop Tgt Opt Costas Vellidis0.8AthensSeniorBeta study Chiho Wang0.4DukeSeniorWire Stabiltiy Zhengyun You0.6UCIPostdocp-bar Background 15 people; most plan to do science, not infrastructure Understaffed for infrastructure development.

12. New People 2/6/15Kutschke | Introduction12 To CD3cInstituteMain Project Sarah Demers0.25YaleSeniorCal Trigger Merril JenkinsAlabama Lotte Thomsen0.1YalePostdocCal Trigger Shilo Xia0.5YaleStudentCal Trigger

13. Management Structure Head of Software and Simulations –Rob Kutschke Background Coordinator –Andrei Gaponenko Geometry Czar –Dave Brown (Louisville) Calibration Coordinator –Dave Brown (LBL) Co-Chairs of the Neutron Working Group –Yuri Oksuzian –Dave Hedin All report to the spokespersons 2/6/15Kutschke | Introduction13

14. Management Structure Elaborate on the roles mentioned on the previous slide 2 or 3 pages. Links to charges 2/6/15Kutschke | Introduction14

15. Meeting Structure Weekly Meetings of Software and Simulation Group Bi-Weekly meetings of the Neutron Working Group As needed meetings of the calibration and background groups. 2/6/15Kutschke | Introduction15

16. Schedule 2/6/15Kutschke | Introduction16 FY15 FY16 FY17 FY18 FY19 FY20 FY21 FY22 CD-2/3b Project Complete Detector Construction Accelerator and Beamline Construction Solenoid Infrastructure KPPs Satisfied PS Fabrication and QA PS/DS Final Design Accelerator Commissioning (off Project) CD-3c Fabricate and QA Superconductor Detector Hall Construction Cosmic Ray System Test 24 months of schedule float PO issued for TS Module Fabrication Fabricate and QA TS Modules, Assemble TS DS Fabrication and QA PS Installation TS Installation DS Installation Critical Path Solenoid power/cryo hookup Solenoid Commissioning Today

17. Important Dates March 2016: –DOE CD3b Review –Complete calculations and figures by Dec 1, 2015 Q4 FY20: –Commissioning with cosmic rays; detector outside the magnet. Mid to late FY21 –Commissioning with beam and with the detector in the magnet. The last talk, the Roadmap to Operations, will fill in the details. 2/6/15Kutschke | Introduction17

18. What does Mu2e Need from SCD? 1)Support for running Offsite Progress has been steady but slow; reliability issues. Request SCD make it a priority get us in production by April 1 Request SCD let remote sites know that we are a lab priority Can a liaison help? 2)Request support from a graphics expert who can help us improve and integrate our event displays Understanding, validating, debugging, explaining algorithms Explaining Mu2e to reviewers Onboarding new users 3)Production operators have been valuable. We would like them to assist in running our large MC production that will start ~April 1. 4)The future of Muons Inc is uncertain. If G4beamline becomes orphaned, we request that SCD commit to building G4beamline against future versions of G4. 2/6/15Kutschke | Introduction18

19. Summary Thank you very much for agreeing to take part in this review We hope you learn something and don’t go too crazy! 2/6/15Kutschke | Introduction19

20. Backup Sides 2/6/15Kutschke | Introduction20

21. G4beamline A wrapper on top of G4 –No C++ or G4 knowledge needed –You only need to know its geometry language; easy to learn. Started at FNAL taken over by Muons Inc –Future support uncertain. First work on Mu2e was to simulate the muon beamline –Compute stopped muons per POT –Study non-muons entering the DS –G4beamline was the fast out of the gate option Does not have the hooks for detailed detector modelling Until recently it did not support all G4Solids –Booleans, Extruded solids 2/6/15Kutschke | Introduction21