Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow UK-T0 Meeting 21 st Oct 2015 GridPP

Slide Outline Overview of GridPP Past and future growth GridPP5 Key messages David Britton, University of Glasgow UK-T0 Meeting 2

Slide GridPP is ~10% of WLCG 18 sites; 57k CPU; 32 PB Disk; 14 PB Tape GridPP in 2015 David Britton, University of Glasgow UK-T0 Meeting 3 WLCG: 170+ sites in 42 countries 515K CPU; 290PB Disk;150PB Tape

Slide Evolving Architecture David Britton, University of Glasgow UK-T0 Meeting 4 Evolution of computing models Hierarchy Mesh Network capabilities and data access technologies have significantly improved our ability to use resources independent of location. Jobs to data but Jobs can fall-back to remote data access if local copies not available. Tier-1 and Tier-2 still offer different capabilities and levels of service.

Slide GridPP Hardware Based mostly on off-the-shelf hardware –Compute: typically X86_64 Intel Xeon Architecture - minimum 2GB per core; 30-50GB scratch per core; 1 or 10 Gbps networking. –Storage: 2/4 TB disks in raid-6 configuration; 10 Gbps networking. Dedicated Tape Storage facility at the RAL Tier-1. ~12 PB disk at Tier-1 and ~20PB at the Tier-2 sites ~16k logical CPU at Tier-1 and ~40k at the Tier-2 sites Tier-1 has dedicated (redundant) 2x10G optical link to CERN (OPN) and 2*30G links to JANET. Tier-2 sites typically 10G connections to JANET. David Britton, University of Glasgow UK-T0 Meeting 5

Slide RAL Tier-1 Resource Growth David Britton, University of Glasgow UK-T0 Meeting 6 LHC turn-on Higgs Discovery Shutdown Scale Tests Similar growth in storage.

Slide Scale of Global Operation (ATLAS Experiment) David Britton, University of Glasgow UK-T0 Meeting 7

Slide LHC and More David Britton, University of Glasgow UK-T0 Meeting 8 9% of Tier-2 CPU and 4% of Tier-1 CPU was delivered to 32 non-LHC VOs between Jan 2012 and Dec 2014

Slide Looking Ahead David Britton, University of Glasgow UK-T0 Meeting 9  Data Volume

Slide Complexity David Britton, University of Glasgow UK-T0 Meeting 10 Z   decay with 25 vertices (April 15th 2012) Simulated Event Display at 140 PU (102 Vertices)

Slide Our Challenge David Britton, University of Glasgow UK-T0 Meeting 11 Volume: >200 PB at present (on disk for ATLAS alone) will grow by factor of >10x by Run-4. Complexity: Pile up increasing from 23 to 140 by Run-4 increases computational problem super- linearly.

Slide Service Decomposition GridPP’s value is the support and provision of a service layer that lays between the hardware and the software and enables the LHC computing models. The majority of GridPP effort is not is not used to run hardware. GridPP staff effort does not write experiment software. David Britton, University of Glasgow UK-T0 Meeting 12 (AiBM)

Slide EGI Services David Britton, University of Glasgow UK-T0 Meeting 13 Services required by WLCG that are provided via the EGI project. The UK leads two of these, co-leads a third, and makes contributions to two more.

Slide David Britton, University of Glasgow UK-T0 Meeting 14 WLCG services not provided via EGI: The UK contributes to 13 services and co-leads two. Most WLCG partners contribute to most of these shared international tasks. WLCG Services

Slide David Britton, University of Glasgow UK-T0 Meeting 15 UK Services: These are services that every country needs to perform for the benefit of their own infrastructure. These 14 tasks that are core business for GridPP. Some of these services do (and increasingly can) benefit other UK infrastructures. UK Services

Slide 16 Federate d HTC Clusters Federate d HTC Clusters Federate d Data Storage Note: this does NOT mean centralised Virtual platform Services: Monitoring Accountin g Incident reporting Services: Monitoring Accountin g Incident reporting AAAI VO tools AAAI VO tools Tape Archive LHC VO Management Reconstruction Data Manag. Analysis LHC VO Management Reconstruction Data Manag. Analysis LSST SKA Share in common where it makes sense to do so

Slide GridPP5 David Britton, University of Glasgow UK-T0 Meeting 17 GridPP5 proposal has just been funded (April 2016; 4-years). We presented ambitious plans to evolve our Tier-2 infrastructure to a sustainable model based on 5 large sites, complemented by smaller sites that can be run with little (0.5 FTE) manpower. We recognised the opportunity, particularly at the Tier-1, to optimise productivity by sharing the e-Infrastructure to improve cost efficiency and reduce duplication. We believe there are mutually beneficial opportunities in engaging with existing and emerging groups that require “e- infrastructure” under the UK-T0 and EU-T0 monikers.

Slide Key Messages -1 GridPP runs an HTC grid infrastructure primarily for LHC data but the HW is sufficiently generic that can be widely of use; middleware is getting less bespoke! There is a lot of knowledge/skills within GridPP, particularly around handling large volumes of data (transporting; metadata; processing). There is a lot of experience within the LHC Experiments in running global-scale complex infrastructures. We don’t suggest that others should necessarily do things our way; but we do have expert knowledge in some, but not all, areas that might be exploited. David Britton, University of Glasgow UK-T0 Meeting 18

Slide Key Messages -2 We have some limited hardware capacity that you can use for free to develop/test/scale-test things. We have some (very) limited manpower that can work with you to get you going. We are keen to explore economies of scale by aligning our infrastructure with yours where it makes mutual sense to do so. We are keen to enter peer-relationships with other groups, particularly STFC funded projects, under the auspices of UK-T0, to show a return on investment in GridPP (aka "Impact") that goes beyond the production of our headline science. David Britton, University of Glasgow UK-T0 Meeting 19