Slide 1 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 GridPP Steve Lloyd Queen Mary, University of London Grid Brokering Meeting December 2006

Slide 2 Steve Lloyd Grid Brokering Meeting - 4 Dec UK Universities, CERN and CCLRC (RAL & Daresbury) Funded by PPARC: GridPP From Web to Grid GridPP From Prototype to Production GridPP (proposed) From Production to Exploitation Who are GridPP? Developed a working, highly functional Grid

Slide 3 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 Why? - The CERN Large Hadron Collider - LHC 4 Large Experiments The worlds most powerful particle accelerator – Starting 2007/8 ~100,000,000 electronic channels 800,000,000 proton-proton interactions per second Higgs per second 10 PBytes of data a year (10 Million GBytes = 14 Million CDs)

Slide 4 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 International Context LHC Computing Grid (LCG) Grid Deployment Project for the Large Hadron Collider (LHC) EU Enabling Grids for E-SciencE (EGEE) Grid Deployment Project for all disciplines GridPP LCG EGEE GridPP is part of EGEE and LCG (currently the largest Grid in the world) UK National Grid Service UKs core production computational and data Grid Open Science Grid (USA) Science applications from HEP to biochemistry Nordugrid (Scandinavia) Grid Research and Development collaboration UK part of LCG PP part of EGEE

Slide 5 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 What is (gLite) Middleware? MIDDLEWARE CPU Disks, CPU etc PROGRAMS OPERATING SYSTEM Word/Excel /Web Your Program Games CPU Cluster User Interface Machine CPU Cluster CPU Cluster Resource Broker Information Service Single PC Grid Disk Server Your Program Middleware is the Operating System of a distributed computing system Replica Catalogue Bookkeeping Service

Slide 6 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 GridPP Middleware Development Workload Management Storage Interfaces Network Monitoring SecurityInformation Services Grid Data Management

Slide 7 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 The EGEE Grid Status Worldwide 207 Sites 48 Countries 32,823 CPUs 13.1 PB Disk 6,946 Years of CPU time UK 21 Sites 6306 CPUs 131 TB Disk 1,996 Years of CPU time

Slide 8 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 UK Tier-1 and Tier-2 Sites Mostly funded by HEFCE Tier-1 CPU (KSI2K)Disk (TB) Brunel Imperial QMUL RHUL UCL Lancaster Liverpool Manchester Sheffield Durham994.0 Edinburgh Glasgow471.6 Birmingham Bristol123.8 Cambridge404.4 Oxford RAL PPD London NorthGrid ScotGrid SouthGrid Total Tier Tier Normally most recent gLite versions. Still running the LCG RB and CE (not gLite). SEs being upgraded to SRM 2.2.

Slide 9 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 What you need to use the Grid 1. Get a digital certificate (UK Certificate Authority) 2. Join a Virtual Organisation (VO) 3. Get access to a local User Interface Machine (UI) and copy your files and certificate there Authentication – who you are Authorisation – what you are allowed to do 4. Write some Job Description Language (JDL) and scripts to wrap your programs ############# HelloWorld.jdl ################# Executable = "/bin/echo"; Arguments = "Hello welcome to the Grid "; StdOutput = "hello.out"; StdError = "hello.err"; OutputSandbox = {"hello.out","hello.err"}; #########################################

Slide 10 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 How it works Job Description UI Machine Resource Broker Input Sandbox Script you want to run Other files (Job Options, Source...) Storage Element Compute Element Storage Element Grid Proxy Certificate Output Sandbox Output files (Plots, Logs...) Input Data Output Data Job Output Sandbox

Slide 11 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 What is it good for? Problems that are highly parallelizable Problem Grid Solution Input data is independent e.g. Images: A=2 B=3 A=3 B=3 A=2 B=4 Simulation using different parameters: Not so good for closely coupled problems These pieces may be independent These pieces will have to interact

Slide 12 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 GridPP Outreach Current GridPP Outreach Team: 0.5 FTE Dissemination Officer 1.0 FTE Events Officer Proposed GridPP Outreach Team (GridPP3): 1.0 FTE Dissemination Officer 0.5 FTE Industrial Liaison Officer 0.5 FTE (User) Documentation GridPP Website Events and Demonstrations Press Releases and News Items Dissemination Awards (e.g. Schools) Posters, Brochures, Papers Expand Industrial Liaison Technology Transfer Steering Group Improved User Documentation Training e.g. Use of Portal

Slide 13 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 GridPP and Industry Use of our Grid Access to the Certificate Authority Security tools GridSite Secure Web Toolkit R-GMA Information System APEL Accounting tools Help getting PPARC funding What We Have to Offer: Current Involvement: GridPP has a collaboration with IBM through ScotGrid and R-GMA. Specific sites also have close relationships with various industrial suppliers. One PPARC MiniPPIPS with a startup company.

Slide 14 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 Cost Recovery Survey GridPP attitudes to allowing commercial access to resources BirminghamKeen to share if not too time consuming Cambridge Concerned about organisational issues but happy for limited access GlasgowWill allow access for limited time OxfordConcerned about organisational issues Queen Mary Prefer to offer full technical and research support rather than dumb access Royal HollowayConcerned about diversion of effort Generally positive as long as not too time consuming and (University) bureaucracy can be overcome

Slide 15 Steve Lloyd Grid Brokering Meeting - 4 Dec 2006 Further Information … RSS News feed