1. A. Mohapatra, HEPiX 2013 Ann Arbor1 UW Madison CMS T2 site report D. Bradley, T. Sarangi, S. Dasu, A. Mohapatra HEP Computing Group Outline  Infrastructure  Resources  Management & Operation  Contributions to CMS  Summary

2. A. Mohapatra, HEPiX 2013 Ann Arbor2 EvolutionEvolution Started out as a grid3 site Played a key role in the formation of the Grid laboratory of Wisconsin (GLOW) HEP/CS (Condor team) collaboration Designed standalone MC production system, adapted CMS software, and run it robustly in non-dedicated environments (UW grid & beyond) Selected as one of the 7 CMS Tier2 site in the US. Became a member of WLCG and subsequently OSG. Serving all OSG supported VOs besides CMS

3. A. Mohapatra, HEPiX 2013 Ann Arbor3 InfrastructureInfrastructure 3 machine rooms, 16 racks Power supply – 650 KW Cooling – Chilled water based air coolers and POD based hot aisles

4. A. Mohapatra, HEPiX 2013 Ann Arbor4 Compute / Storage Resources Compute (SL6) T2 HEP Pool – 4200 cores Dedicated to CMS CHTC and GLOW Pool – 3200 cores Opportunistic Storage (Hadoop) Migrated from dCache to Hadoop 3 years ago. 3PBs distributed across 350 nodes Will add 1B soon.

5. A. Mohapatra, HEPiX 2013 Ann Arbor5 Network Configuration Internet2 NLR ESNET Chicago Purdue FNAL Nebraska UW Campus T2 LAN Server Switch 100G New 3x10G 10G 1G 4x10G Perfsonar (Latency & Bandwidth) nodes are used to debug LAN and WAN (+ USCMS matrix) issues

6. A. Mohapatra, HEPiX 2013 Ann Arbor6 Network Configuration (2) Strong support from compus network team (DoIT) Good rate for CMS data transfer from T1/T2 sites

7. A. Mohapatra, HEPiX 2013 Ann Arbor7 Software and Services File systems AFS, NFS, CVMFS, ext4 Job batch systems Condor OSG software Globus, GUMS, glexec Storage Hadoop (hdfs), BestMan2(srm), gridFtp, Xrootd Cluster management Local yum repo, Puppet Cluster monitoring Nagios, Ganglia, and tons of home grown scripts

8. A. Mohapatra, HEPiX 2013 Ann Arbor8 Cluster Software Management Cfengine usage until fall of 2012 Migration to puppet Translation and successful validation of individual cfengine based modules

9. A. Mohapatra, HEPiX 2013 Ann Arbor9 Cluster Health Monitoring Nagios Hardware, disks etc. Ganglia Services, memory, cpu/disk usage, network, storage OSG tools RSV CMS specific SAM, Hammer Cloud Miscellaneous Scripts Cron’ed

10. A. Mohapatra, HEPiX 2013 Ann Arbor10 CMS Usage (production/analysis)

11. A. Mohapatra, HEPiX 2013 Ann Arbor11 Contributions to CMS HTCondor and Glidein technology

12. A. Mohapatra, HEPiX 2013 Ann Arbor12 Any data, Anytime, Anywhere

13. A. Mohapatra, HEPiX 2013 Ann Arbor13 Experience with Amazon EC2

14. A. Mohapatra, HEPiX 2013 Ann Arbor14 SummarySummary Our Tier-2 site has been running well