Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement ScotGrid Procurement … a future news item 25 June 2006: ScotGrid's 4th birthday June 25th marks the fourth anniversary of ScotGrid deployment. After four years, the system has provided more than 2 million CPU hours and 200,000 completed jobs. The system is fully integrated with the LCG Grid, the basic Grid system for the EU Enabling Grids for E-Science in Europe (EGEE) project, and the Grid for UK Particle Physics (GridPP) testbed as part of the National Grid Service. Locally, the user service supports 12 Groups (ATLAS, BaBar, Bioinformatics, CDF, Device Modelling, Grid Data Management, Information Retrieval, LHCb, Medipix, MICE, UKQCD and ZEUS) with approximately 100 individual users. Many external Grid Virtual Organisations are also being supported. The hardware is currently being upgraded and will be available for users in Q3 2006….

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement Grid Overview Aim: by 2008 (full years data taking) -CPU ~100MSi2k (100,000 CPUs) -Storage ~80PB - Involving >100 institutes worldwide -Build on complex middleware being developed in advanced Grid technology projects, both in Europe (Glite) and in the USA (VDT) 1.Prototype went live in September 2003 in 12 countries 2.Extensively tested by the LHC experiments in September sites, 13,797 CPUs, 5PB storage in September 2005

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement 1.Large UK-wide Project (20 Institutes, £33m over six years [Sep Aug 07]) 2.A team that built a working prototype Grid of significant scale UK (worldwide) > 2,000 (10,000) CPUs > 1,000 (5,000) TB of storage > 1,000 (6,000) simultaneous jobs 3.A complex project where 88% of the milestones were completed in the first phase What is GridPP?

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement 1.Glasgow/Edinburgh/Durham/ (Dundee) Project 2.Compute-intensive jobs performed at Glasgow and Durham 3.Data-intensive jobs performed at Edinburgh 4.First applications using the Grid. Meeting real requirements of Grid applications: currently Particle Physics, Bioinformatics, Computing Science, Electrical Engineering 5.Glasgow leading R&D in Grid Data Management and Security 6.Edinburgh leading co-ordination and R&D in Networking and Storage 7.Management part of a worldwide Grid infrastructure through GridPP and EGEE What is?

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement What are the Grid challenges? Data Management, Security and Sharing 1. Software process 2. Software efficiency 3. Deployment planning 4. Link centres 5. Share data 6. Manage data7. Install software 8. Analyse data9. Accounting 10. Policies

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement Tier Structure Tier 0 Tier 1 National centres Tier 2 Regional groups Tier 3 Institutes Tier 4 Workstations Offline farm Online system CERN computer centre RAL,UK ScotGridNorthGridSouthGridLondon FranceItalyGermanyUSA GlasgowEdinburghDurham Dundee

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement Timescales Service Challenges – UK deployment plans End point April 07 Context: first real (cosmics) data 05

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement Middleware Requirement Storage Element Basic File Transfer Reliable File Transfer Catalogue Services Data Management tools Compute Element Workload Management VO Agents VO Membership Services DataBase Services Posix-like I/O Application Software Installation Tools Job Monitoring Reliable Messaging Information System 15 Baseline Services for a functional Grid Scottish (and National) Grid Service will rely upon gLite components This middleware builds upon VDT (Globus and Condor) and meets the requirements of all the basic scientific use cases: 1.Green (amber) areas are (almost) agreed as part of the shared generic middleware stack by each of the application areas 2.Red are areas where generic middleware competes with application-specific software.

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement Middleware Requirement OMIIVDT/GTgLiteOtherComment Storage Element YesSRM via dCache, DPM or CASTOR LCG includes Storage Resource Management capability Basic File Transfer YesGridFTPYesLCG includes GridFTP Reliable File Transfer RFTFile Transfer ServiceFTS is built on top of GridFTP Catalogue Services RLSLCG File Catalogue, gLite FireMan Central catalogues adequate, high throughput needed Data Management tools OMII Data Service (upload / download) File Placement ServicegLite File Placement Service under development Compute Element OMII Job ServiceGatekeeperYesgLite uses Globus 2 with mods Workload Management Manual resource allocation & job submission Condor-GResource BrokerRB builds on Globus, Condor-G VO Agents Perform localised activities on behalf of VO VO Membership Services Tools for account management (no GridMapFile equivalent) CASVOMSCAS does not provide all the needed functionality DataBase Services MySQL, PostgreSQL, ORACLE client Off–the-shelf offerings are adequate Posix-like I/O GFAL, gLite I/OXrootd Application Software Installation Tools YesTools already exist in LCG-2 e.g. PACMAN Job Monitoring Monalisa, Netlogger Logging service R-GMA Reliable Messaging Tools such as Jabber are used by experiments Information System MDS (GLUE) YesBDIILCG based on BDII and GLUE schema

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement A series of gLite releases have been produced (1.1, 1.2, 1.3, and 1.4) –Driven by application and deployment needs –Focus on defect fixing gLite deployed on a Pre-Production Service and made available for application use –Independent evaluation by NGS –gLite components also available via VDT (US) gLite components deployed on the infrastructure –More scheduled by the end of the year Emphasis is now on release of gLite 1.5 –Will continue… –EGEE phase 2 starts in April 2006 Middleware Re-engineering

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement Metrics and Quality Assurance TargetCurrent status Q Target values Number of Users ~ Number of sites Number of CPU ~ at month 15 Number of Disciplines 6 5 Multinational countries

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement More than 20 applications from 7 domains –High Energy Physics 4 LHC experiments (ALICE, ATLAS, CMS, LHCb) BaBar, CDF, DØ, ZEUS –Biomedicine Bioinformatics (Drug Discovery, Xmipp_MLrefine, etc.) Medical imaging (GATE, CDSS, gPTM3D, SiMRI 3D, etc.) –Earth Sciences Earth Observation, Solid Earth Physics, Hydrology, Climate –Computational Chemistry –Astronomy MAGIC Planck –Geo-Physics EGEODE –Financial Simulation E-GRID Another 8 applications from 4 domains are in evaluation stage Wider Application Support

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement Example: UK contributes to EGEE's battle with malaria BioMed Successes/Day 1107 Success % 77% WISDOM (Wide In Silico Docking On Malaria) The first biomedical data challenge for drug discovery, which ran on the EGEE grid production service from 11 July 2005 until 19 August GridPP resources in the UK contributed ~100,000 kSI2k-hours from 9 sites Number of Biomedical jobs processed by country Normalised CPU hours contributed to the biomedical VO for UK sites, July-August 2005

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement Accounting

Tony Doyle - University of Glasgow 30 November 2005ScotGrid Phase 2 Procurement Summary ScotGrid is part of an evolving National and International Grid Deployment, middleware and application support status provide a context for Grid procurements here and elsewhere External developments and timelines place constraints on the hardware being procured for ScotGrid Phase 2