GGF-16 Athens Production Grid Computing in the UK Neil Geddes CCLRC Director, e-Science

Neil Geddes CCLRC e-Science Outline A little bit of History Where we are today –GridPP, EGEE and NGS Issues and Challenges The future

Neil Geddes CCLRC e-Science Grid Computing in the UK National initiatives began in 2001 ‘e-Science is about global collaboration in key areas of science, and the next generation of infrastructure that will enable it.’ John Taylor Director General of Research Councils Office of Science and Technology UK e-Science programme –Application focused/led developments –Varying degree of “infrastructure” …

Ken Peach e-Minerals simulations performed on molecular length and time scales to address environmental issues: adsorption of pollutants crystal growth and dissolution radiation damage diffusion of pollutant atoms

climateprediction.net and GENIE Largest climate model ensemble >45,000 users, >1,000,000 model years 10K 2K Response of Atlantic circulation to freshwater forcing

UK Grid for Particle Physics (2003) GridPP LHCb ATLAS CMS

CERN/LHC Community Europe: 267 institutes, 4603 users Elsewhere: 208 institutes, 1632 users

Neil Geddes CCLRC e-Science UK e-Science Grid Cambridge Newcastle Edinburgh Oxford Glasgow Manchester Cardiff Southampton London Belfast DL RAL Hinxton Application independent

Neil Geddes CCLRC e-Science National Grid Service Interfaces OGSI::Lite

Neil Geddes CCLRC e-Science NGS Overview: User view Resources –4 Core clusters –UK’s National HPC services –A range of partner contributions clusters, shared mem. portals, data … Partners and affiliates Access –Support UK academic researchers –All partners support common user base + whoever they want –Free at the point of use –Light weight peer review for limited “free” resources Partners can provide larger commitments as required Central help desk –

Neil Geddes CCLRC e-Science NGS Overview: Oganisational view Management –GOSC Board Strategic direction –Technical Board Technical coordination and policy Grid Operations Support Centre –Manages the NGS –Operates the UK CA + over 30 RA’s –Operates central helpdesk –Minimum software stack Level-0, level-1 … –Policies and procedures –Manage and monitor partners

NGS Use Files stored Users by institution CPU time by user Users by discipline biology Large facilities Eng. + Phys. Sci Env. Sci PP + Astronomy Medicine HumanitiesSociology Over 320 users

Applications: 1 Text mining Lattice Boltzmann Molecular Dynamics substrate complex product complex ADP ATP

Applications: 2 Systems Biology Neutron Scattering Climate modelling Econometric analysis

Applications: 3 Many, but not all, applications cover traditional computational sciences –Both user and pre-installed software Several data focused activites Common features are –Distributed data and/or collaborators Not just pre-existing large collaborations – Explicitly encourage new users – Common infrastructure/interfaces Other Applications: nano-particles protein folding ab-initio protein structure prediction radiation transport (radiotherapy) IXI (medical imaging) Biological membranes Micromagnetics Archeology Text mining Lattice QCD (analysis) Astronomy (VO services)

Neil Geddes CCLRC e-Science GridPP/LCG/EGEE Continues T0 to T1 streaming at 2Gb T1 to T2 streaming at 200Mb High performance services

Neil Geddes CCLRC e-Science Issues & Challenges What generic infrastructure/services exist ? –Moving tools form project -> infrastructure Difference community views of what is critical Authorisation User/VO management across shared infrastructures Bringing infrastructures together –Now Common NGS/GridPP/EGEE helpdesk, security, authentication Overlapping local teams Working on VO management and brokering –Future Depends on standardisation + commitment from projects Shibboleth...

Neil Geddes CCLRC e-Science NGS Development Core Node refresh Expand partnership –HPC –Campus Grids –Data Centres –Digital Repositories –Experimental Facilities Baseline services –Aim to map user requirements onto standard solutions –Support convergence/interoperability Move further towards project (VO) support –Support collaborative projects Mixed economy –Core resources –Shared resources –Project/project/contract specific resources Baseline Services Storage Element Basic File Transfer Reliable File Transfer Catalogue Services Data Management tools Compute Element Workload Management VO specific services VO Membership Services DataBase Services Posix-like I/O Application Software Installation Tools Job Monitoring Reliable Messaging Information System