1. GridPP: Executive Summary Tony Doyle

2. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Outline Exec 2 Summary Grid status High level view 2006 Outturn Performance Monitoring Outlook for 2007 Beyond GridPP2 2007

3. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Exec 2 Summary 2006 was the second full year for the UK Production Grid More than 5,000 CPUs and more than 1/2 Petabyte of disk storage The UK is the largest CPU provider on the EGEE Grid, with total CPU used of 15 GSI2k-hours in 2006 The GridPP2 project has met 69% of its original targets with 92% of the metrics within specification The initial LCG Grid Service is now starting and will run for the first 6 months of 2007 The aim is to continue to improve reliability and performance ready for startup of the full Grid service on 1st July 2007 The GridPP2 project has been extended by 7 months to April 2008 The outcome of the GridPP3 proposal to PPARC is awaited We anticipate a challenging period from Sept. 2007 onwards

4. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Grid Overview Aim: by 2008 (full year’s data taking) -CPU ~100MSI2k (100,000 CPUs) -Storage ~80PB - Involving >100 institutes worldwide -Build on complex middleware being developed in advanced Grid technology projects, both in Europe (Glite) and in the USA (VDT) 1.Prototype went live in September 2003 in 12 countries 2.Extensively tested by the LHC experiments in September 2004 3.February 2006 25,547 CPUs, 4398 TB storage Status in February 2007: 177 sites, 32,412 CPUs, 13,282 TB storage Monitoring via Grid Operations Centre

5. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 http://www3.egee.cesga.es/gridsite/accounting/CESGA/tree_egee.php Resources 2006 CPU Usage by Region Via APEL accounting

6. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 2006 Outturn Definitions: "Promised" is the total that was planned at the Tier-1/A (in the March 2005 planning) and Tier-2s (in the October 2004 Tier-2 MoU) for CPU and storage "Delivered" is the total that was physically installed for use by GridPP, including LCG and SAMGrid at Tier-2 and LCG and BaBar at Tier-1/A "Available" is available for LCG Grid use, i.e. declared via the EGEE mechanisms with storage via an SRM interface "Used" is as accounted for by the Grid Operations Centre

7. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Resources Delivered CPU KSI2KStorage TB PromisedDeliveredRatioPromisedDeliveredRatio Brunel155480310%216.330% Imperial116580769%93.360.365% QMUL9171209132%58.51831% RHUL20416380%23.28.838% UCL60121202%0.71.1149% Lancaster51048495%86.77283% Liverpool60559298%80.32.83% Manchester13051840141%372.614539% Sheffield183 100%3267% Durham8699115%5479% Edinburgh711152%70.52028% Glasgow246800325%14.840270% Birmingham196223114%9.3 100% Bristol391231%1.93.8200% Cambridge3340123%4.4 101% Oxford41415036%24.527110% RAL PPD199320161%17.466.1381% London25012780111%196.794.448% NorthGrid26023099119%542.6221.841% ScotGrid340910268%90.36471% SouthGrid88074585%57.5110.6192% Total63227534119%887.1490.855% Tier-11604103464%149571248% Tier-1 and Tier-2 total delivery is impressive and usage is improved Available CPU: 8.5 MSI2k Storage: 1.7 PB Disk: 0.54 PB Delivery of Tier-1 disk Used CPU:15 GSI2k-hours Disk: 0.26 PB Usage of Tier-2 CPU, disk Request: PPARC acceptance of the 2006 outturn

8. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Available (KSI2K)Used (KSI2K Hours)Ratio 1Q062Q063Q064Q061Q062Q063Q064Q061Q062Q063Q064Q06 Brunel116 48012,811105,014159,082643,8060.70%41.30%62.60%61.20% Imperial203 64216,82883,62782,593557,9432.20%18.80%18.60%39.70% QMUL2811209 214,335612,564459,4271,259,44613.70%23.10%17.40%47.60% RHUL163 25,08521,940176,046147,36017.20%6.10%49.30%41.30% UCL121 42,21751,10673,763156,57616.00%19.30%27.80%59.10% Lancaster485476473 248,463402,774210,432297,55014.90%38.60%20.30%28.70% Liverpool572592 56,218455,72740,551164,22211.80%35.20%3.10%12.70% Manchester48072011521840380,8571,042,154248,704370,5670.30%66.10%9.90%9.20% Sheffield240183 38,41159,86078,795127,0392.00%15.00%19.70%31.80% Durham7280 36,69958,18533,67159,1234.30%33.20%19.20%33.70% Edinburgh666614,8294,6373,6414,91834.40%35.30%27.70%37.40% Glasgow104 4780075,77450,46272,105155,9866.30%22.20%70.10%8.90% Birmingham6223 38,47331,79528,29953,93013.20%62.00%55.20%105.20% Bristol17778427,2088,9826,59315.10%45.70%57.00%41.80% Cambridge4038 6542,2282,4421,8110.00%2.70%2.90%2.20% Oxford6765 94,09392,84182,28463,95934.30%65.40%58.00%45.10% RAL PPD73 320 106,919132,046143,648235,17259.90%82.10%20.50%33.60% London8841812 2615311,276874,251950,9112,765,13110.30%22.00%24.00%48.30% NorthGrid1777197123993087723,9491,960,515578,482959,37810.10%45.40%11.00%14.20% ScotGrid182190133886127,302113,284109,417220,0276.40%27.20%37.60%11.30% SouthGrid243207453 240,981266,118265,655361,46531.00%58.80%26.80%36.40% Total Tier-230864179479770411,403,5083,214,1681,904,4654,306,00112.20%35.10%18.10%27.90% Tier-1415620651848624,6361,089,9171,393,022992,10668.70%80.20%97.60%53.40% LCG CPU Usage

9. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 (measured by UK Tier-1 for all VOs) ~90% CPU efficiency due to i/o bottlenecks is OK Concern that this is currently ~75% Efficiency Each experiment needs to work to improve their system/deployment practice anticipating e.g. hanging gridftp connections during batch work target

10. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 (Tier-1 CPUs brought online on Jan 10) Tier-1 CPU fully utilised throughout 2006 (Grid & non-Grid) Added 64 Intel twin dual-core Woodcrests on Jan 10 Busy with Grid jobs within 30 minutes Utilisation

11. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 (Estimated utilisation based on gstat job slots/usage) UKI mirrors overall EGEE utilisation Average Utilisation for Q306: 66% Compared to target of ~70% CPU utilisation was a major T2 issue, but now improving.. Utilisation

12. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 CPU by experiment Used at Tier-2 (KSI2K Hours)Used at Tier-1 (KSI2K Hours) 1Q062Q063Q064Q061Q062Q063Q064Q06 ALICE 04321879031171223013936757 ATLAS8520141131060569879800194156114323195256979253869 CMS12579423640948912236842777025176198407072170784 LHCb1643391237858718268107283821210404707634341396417 BaBar41854729329159314542547756163615853501 CDF 1517 D0933731026024054122106995963530912243327515 H13851440182301384603058170831845980 ZEUS496523170414060736690620953135319815 Other115407232299486711341548159326384478 LHC11421472605327177770122416462633809212221328531857827 Total140159730803491859426257472362463010899171393013906216

13. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 2006 CPU Usage by experiment UK Resources

14. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 LCG Disk Usage Available (TB)Used (TB)Ratio 1Q062Q063Q064Q061Q062Q063Q064Q061Q062Q063Q064Q06 Brunel 1.51.14.7 0.10.24.3 6.70%18.10%91.10% Imperial0.33.25.635.40.32.22.925.588.80%69.40%51.70%72.00% QMUL18.215.918.2 14.33.63.44.878.40%22.60%18.40%26.40% RHUL2.7 5.52.50.30.21.590.50%10.60%7.70%27.30% UCL1.10120.900.31.482.60%54.30%32.60%70.00% Lancaster63.453.147.76029.913.126.912.847.10%24.70%56.30%21.30% Liverpool 2.80.62.8000.11.4 0.80%16.30%50.00% Manchester 66.967.6176.801.93.95.4 2.80%5.80%3.10% Sheffield4.53.92.32.24.41.20.30.195.80%32.10%12.40%4.50% Durham1.9 3.5 0.61.30.91.230.90%68.10%25.40%34.30% Edinburgh3130292016.613.52.83.953.60%45.10%9.50%19.50% Glasgow4.3 1.6343.80.61.14.189.90%15.00%70.80%12.10% Birmingham1.8 1.91.81.30.60.81.373.30%31.80%41.60%72.20% Bristol0.2 2.11.80.200.30.489.60%12.00%16.00%22.20% Cambridge3.2 33.1 00.82.194.70%0.60%26.30%67.70% Oxford3.21.63.2 2.5000.580.10%1.10%0.00%15.60% RAL PPD6.8 6.416.66.40.60.313.593.50%9.40%4.20%81.30% London22.423.428.765.817.96.2737.580.30%26.60%24.40%57.00% NorthGrid67.9126.7118.2241.834.216.231.219.750.40%12.80%26.40%8.10% ScotGrid37.136.234.157.52115.54.89.256.60%42.80%14.00%16.00% SouthGrid15.213.616.626.513.41.32.217.888.60%9.30%13.20%67.20% Total Tier-2142.5199.8197.5391.686.639.245.184.260.70%19.60%22.80%21.50% Tier-1121.1114.4123.1145.356.4107.2149.4177.746.60%93.70%121.40%122.30%

15. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 (individual rates) Aim: to maintain data transfers at a sustainable level as part of experiment service challenges http://www.gridpp.ac.uk/wiki/Service_Challenge_Transfer_Test_Summary File Transfers Current goals:goals >250Mb/s inbound-only >250Mb/s outbound-only >200Mb/s inbound and outbound

16. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Approval for new (shared) machine room – ETA Summer 2008. Space for 300 racks. Procurement –March 06: 52 AMD 270 units, 21 disk servers (168TB data capacity) –FY 06/07: 47 disk servers (282TB disk capacity), 64 twin dual-core Intel Woodcrest 5130 units (550kSI2K) –FY 06/07 upcoming: further 210 TB disk capacity plus high-availability systems (redundant PSUs, hot-swappable paired HDDs) Storage commissioning saga –Ongoing problems with March kit. Firmware updates have now solved problem. (Disks on Areca 1170 in raid 6 experienced multiple dropouts during testing of WD drives) Move to CASTOR –Very support heavy but made available for CSA06 and performing well General - Air-con problems with high-temperatures triggering high pressure cut-outs in refrigerator gas circuits - July security incident - 10Gb CERN line in place. Second 10Gb line scheduled in 07Q1 Tier-1 Resource

17. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 e.g. Glasgow: UKI-SCOTGRID-GLASGOW 800 kSI2k 100 TB DPM Needed for LHC s t a rt- u p August 28 September 1 October 13 October 23 T2 Resources IC-HEP 440 KSI2K 52 TB dCache Brunel 260 KSI2K 5 TB DPM

18. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 GridPP Middleware incorporates.. Security Network Monitoring Information Services Grid Data Management Storage Interfaces Workload Management Middleware

19. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 MSN Outlook The results of the GridPP2+ project extension proposal to PPARC were made known to GridPP in November 2006 The effects on MSN are significant and particularly damaging with the overall effort reduced by more than a third from 13 to 8.3 FTEs WMS testing and contributions to EGEE SA3 will reduce GridPP work on metadata will cease and UK leadership will be lost, but this is known to be an area the experiments are keen to see tackled The reduction in Information and Monitoring effort will severely impact re- engineering work and support for R-GMA and compromises UK obligations in fulfilling the EGEE contract GridPP has recognised the importance of finishing the R-GMA re- engineering, thus meeting the R-GMA deliverables to EGEE and has therefore agreed (in consultation with PPARC) to meet the costs of maintaining the current staffing levels to the end of EGEE-II from within existing allocations The reduction in networking activities is likely to impact GridPP’s ability to optimise its use of the underlying JANET network Staff whose contracts will not be extended beyond the end of August 2007 have been informed

20. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 e.g. ATLAS Tier-2 Testing Most of the experiments are now well advanced in highly pragmatic deployment issues, particularly in advance of the LHC data at the end of 2007

21. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Applications Outlook Products developed by GridPP are in mainstream use, and will form a vital component of the computing system of each LHC experiment for first data-taking and analysis However, almost all explicit funding for the further development and support of such products will terminate in September 2007, since it is now clear that this area will be supported neither via GridPP3 (as planned) nor the Rolling Grants round (as requested) This is a matter of concern both for the UK collaborations and the experiments as a whole Recovery plans are being prepared within each experiment, attempting to use non-specialist RA effort in tension with physics and hardware support, but there will be profound negative consequences for the continuation and maintenance of these projects

22. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Dissemination Outlook Dissemination was one of the areas not fully funded in GridPP2+ The Dissemination Officer post was funded at 0.5 FTE (as at present), but the PPRP did not allocate funds to continue the Events Officer position Due to a large number of events and activities planned for the end of 2007, we aim to fund this position for some months out of the current dissemination budget

23. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Hardware Outlook Planning for 2007.. A profiled ramp-up of resources is planned throughout 2007 to meet the UK requirements of the LHC and other experiments The results are available for the Tier-1 and Tier-2sTier-1Tier-2s The Tier-1/A Board reviewed UK input to International MoU negotiations for the LHC experiments as well as providing input to the International Finance Committee for BaBar An impasse was reached in planning for 2007 No new investment in the BaBar Tier A analysis facility hardware is planned For LCG, the 2007 commitment for disk and CPU capacity can be met out of existing hardware already delivered

24. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Timeline Proposal WritingProposal Defence Apr MayJunJulAugSepOct 31 st March – PPARC Call 16 th June – GridPP16 at QMUL 6 th September – 1 st PPRP review 1 st November – GridPP17 8 th November PPRP “visiting panel” 30 th November GridPP2+ outcome ~February GridPP3 outcome 13 th July – Bid Submitted CBOCCB Future? ~10 month process to propose/defend/define future programme http://www.gridpp.ac.uk/docs/gridpp3/

25. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Scenario Planning – Resource Requirements [TB, kSI2k] GridPP requested a fair share of global requirements, according to experiment requirements Changes in the LHC schedule prompted a(nother) round of resource planning - presented to CRRB on Oct 24 th New UK resource requirements have been derived and incorporated in the scenario planning e.g. Tier-1

26. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Input to Scenario Planning – Hardware Costing Empirical extrapolations with extrapolated (large) uncertainties Hardware prices have been re-examined following recent Tier-1 purchase CPU (woodcrest) was cheaper than expected based on extrapolation of previous 4 years of data

27. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Scenario Planning An example 70% “minimum viable level” scenario [£m]

28. Tony Doyle - University of Glasgow Oversight Committee 8 February 2007 Beyond GridPP2 The separation between GridPP2+ and GridPP3 was primarily designed to ensure an early decision could be made on the extension in order to retain key staff Approval for the extension was received in late November but included major cuts in the middleware support area This is problematic in two ways: –EU-CCLRC contractual obligation –crucial 7 month ramp-up period - the worst time to cut back Problems are severely compounded by the outcome of the Rolling Grant round where much of the Applications support work will be lost during this same critical period We currently await the outcome of the GridPP3 bid in order to be able to assess the whole picture We anticipate a highly challenging period from September 2007 onwards