Quarterly report ScotGrid Quarter 02 2005 Fraser Speirs.

Slides:



Advertisements
Similar presentations
London Tier2 Status O.van der Aa. Slide 2 LT 2 21/03/2007 London Tier2 Status Current Resource Status 7 GOC Sites using sge, pbs, pbspro –UCL: Central,
Advertisements

Deployment metrics and planning (aka Potentially the most boring talk this week) GridPP16 Jeremy Coles 27 th June 2006.
Applications Area Issues RWL Jones GridPP13 – 5 th June 2005.
Storage Workshop Summary Wahid Bhimji University Of Edinburgh On behalf all of the participants…
User Board - Supporting Other Experiments Stephen Burke, RAL pp Glenn Patrick.
NorthGrid status Alessandra Forti Gridpp12 Brunel, 1 February 2005.
Quarterly report ScotGrid Quarter Fraser Speirs.
LCG-France Project Status Fabio Hernandez Frédérique Chollet Fairouz Malek Réunion Sites LCG-France Annecy, May
Southgrid Status Pete Gronbech: 27th June 2006 GridPP 16 QMUL.
London Tier 2 Status Report GridPP 13, Durham, 4 th July 2005 Owen Maroney, David Colling.
UKI-SouthGrid Overview Face-2-Face Meeting Pete Gronbech SouthGrid Technical Coordinator Oxford June 2013.
London Tier 2 Status Report GridPP 12, Brunel, 1 st February 2005 Owen Maroney.
Southgrid Status Report Pete Gronbech: February 2005 GridPP 12 - Brunel.
ScotGrid: a Prototype Tier-2 Centre – Steve Thorn, Edinburgh University SCOTGRID: A PROTOTYPE TIER-2 CENTRE Steve Thorn Authors: A. Earl, P. Clark, S.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
Quarterly report SouthernTier-2 Quarter P.D. Gronbech.
D. Britton GridPP Status - ProjectMap 22/Feb/06. D. Britton22/Feb/2006GridPP Status GridPP2 ProjectMap.
RAL PPD Site Update and other odds and ends Chris Brew.
Southgrid Technical Meeting Pete Gronbech: 16 th March 2006 Birmingham.
Status of the DESY Grid Centre Volker Guelzow for the Grid Team DESY IT Hamburg, October 25th, 2011.
BINP/GCF Status Report BINP LCG Site Registration Oct 2009
SouthGrid Status Pete Gronbech: 2 nd April 2009 GridPP22 UCL.
GridKa SC4 Tier2 Workshop – Sep , Warsaw Tier2 Site.
SRM 2.2: status of the implementations and GSSD 6 th March 2007 Flavia Donno, Maarten Litmaath INFN and IT/GD, CERN.
12th November 2003LHCb Software Week1 UK Computing Glenn Patrick Rutherford Appleton Laboratory.
Oxford Update HEPix Pete Gronbech GridPP Project Manager October 2014.
LCG Service Challenge Phase 4: Piano di attività e impatto sulla infrastruttura di rete 1 Service Challenge Phase 4: Piano di attività e impatto sulla.
INDIACMS-TIFR Tier 2 Grid Status Report I IndiaCMS Meeting, April 05-06, 2007.
Organisation Management and Policy Group (MPG): Responsible for setting and policy decisions and resolving any issues concerning fractional usage, acceptable.
GridPP3 Project Management GridPP20 Sarah Pearce 11 March 2008.
Project Management Sarah Pearce 3 September GridPP21.
Tony Doyle - University of Glasgow 1 July 2005Oversight Committee GridPP: Executive Summary Tony Doyle.
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
Southgrid Technical Meeting Pete Gronbech: 26 th August 2005 Oxford.
GridPP Deployment Status GridPP14 Jeremy Coles 6 th September 2005.
Steve Traylen PPD Rutherford Lab Grid Operations PPD Christmas Lectures Steve Traylen RAL Tier1 Grid Deployment
Testing the UK Tier 2 Data Storage and Transfer Infrastructure C. Brew (RAL) Y. Coppens (Birmingham), G. Cowen (Edinburgh) & J. Ferguson (Glasgow) 9-13.
CSCS Status Peter Kunszt Manager Swiss Grid Initiative CHIPP, 21 April, 2006.
GridPP Deployment Status GridPP15 Jeremy Coles 11 th January 2006.
London Tier 2 Status Report GridPP 11, Liverpool, 15 September 2004 Ben Waugh on behalf of Owen Maroney.
Tony Doyle - University of Glasgow 8 July 2005Collaboration Board Meeting GridPP Report Tony Doyle.
CERN-IT Oracle Database Physics Services Maria Girone, IT-DB 13 December 2004.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
LCG Storage Accounting John Gordon CCLRC – RAL LCG Grid Deployment Board September 2006.
UK Tier 1 Centre Glenn Patrick LHCb Software Week, 28 April 2006.
Rutherford Appleton Lab, UK VOBox Considerations from GridPP. GridPP DTeam Meeting. Wed Sep 13 th 2005.
April 26, Executive Director Report Executive Board 4/26/07 Things under control Things out of control.
Plans for Service Challenge 3 Ian Bird LHCC Referees Meeting 27 th June 2005.
Report from GSSD Storage Workshop Flavia Donno CERN WLCG GDB 4 July 2007.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Deliverable DSA1.4 Jules Wolfrat ARM-9 –
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
IAG – Israel Academic Grid, EGEE and HEP in Israel Prof. David Horn Tel Aviv University.
BaBar Cluster Had been unstable mainly because of failing disks Very few (
Accounting in LCG/EGEE Can We Gauge Grid Usage via RBs? Dave Kant CCLRC, e-Science Centre.
Scientific Computing in PPD and other odds and ends Chris Brew.
SL5 Site Status GDB, September 2009 John Gordon. LCG SL5 Site Status ASGC T1 - will be finished before mid September. Actually the OS migration process.
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
Data transfers and storage Kilian Schwarz GSI. GSI – current storage capacities vobox LCG RB/CE GSI batchfarm: ALICE cluster (67 nodes/480 cores for batch.
The Grid Storage System Deployment Working Group 6 th February 2007 Flavia Donno IT/GD, CERN.
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
Status of gLite-3.0 deployment and uptake Ian Bird CERN IT LCG-LHCC Referees Meeting 29 th January 2007.
J Jensen/J Gordon RAL Storage Storage at RAL Service Challenge Meeting 27 Jan 2005.
The RAL PPD Tier 2/3 Current Status and Future Plans or “Are we ready for next year?” Chris Brew PPD Christmas Lectures th December 2007.
Status of GSDC, KISTI Sang-Un Ahn, for the GSDC Tier-1 Team
A Computing Tier 2 Node Eric Fede – LAPP/IN2P3. 2 Eric Fede – 1st Chinese-French Workshop Plan What is a Tier 2 –Context and definition To be a Tier 2.
London Tier-2 Quarter Owen Maroney
LCG Service Challenge: Planning and Milestones
Update on Plan for KISTI-GSDC
Collaboration Board Meeting
Presentation transcript:

Quarterly report ScotGrid Quarter Fraser Speirs

2005 Q1Quarterly report: ScotGrid Current site status data SiteService nodes Worker nodes Local network connectivity Site connectivity SRMDays SFT failed Days in scheduled maintenance Security incidents this quarter which impact on Grid DurhamSL3 LCG2.4.0 SL3 LCG Mb/s1Gb/sNo870 EdinburghSL3 LCG2.5.0 SL3 LCG Gb/s dCache (not fully deployed ) 3460 GlasgowSL3 LCG2.4.0 SL3 LCG Gb/s No )Local network connectivity is that to the site SE 2)It is understood that SFT failures do not always result from site problems, but it is the best measure currently available.

2005 Q1Quarterly report: ScotGrid All GridPP Resources SitePromisedActual Average kSI2K available in this quarter CPU (kSI2K) Storage (TB) Average kSI2K available in this quarter CPUStorage (TB) Durham Edinburgh Glasgow Total )The GridPP-Tier-2 MoUs made reference to integrated CPU over the 3 years of GridPP2. Under the “Promised – integrated kSI2K hours until this quarter” an estimate is provided of what the Tier-2 would have expected to provide to this quarter on the basis of planned installations. “Static kSI2K” shows what would currently be expected if all purchases planned to this quarter had been made and implemented. The actual columns show what has been delivered.

2005 Q1Quarterly report: ScotGrid LCG resources SiteEstimated for LCGCurrently delivering to LCG Total job slots CPU (kSI2K) Storage (TB) Total jobs slots CPU (kSI2K) Storage (TB) Durham Edinburgh Glasgow Total ) The estimated figures are those that were projected for LCG planning purposes: 2) Current total job slots are those reported by EGEE/LCG gstat page.

2005 Q1Quarterly report: ScotGrid VOs supported by site SiteALICEATLASBiome d CMSSixtdTeamZeusLHCbTotal Durham Edinburgh Glasgow Total => not supported 1 => supported

2005 Q1Quarterly report: ScotGrid CPU used per VO over quarter (KSI2K hours) SiteALICEATLASBABARCMSLHCBZEUSabcTotal Durham 33 Edinburgh Glasgow Total 1)Information currently available from APEL - please note these pages are still under development! Nb. This could be automated with an SQL/R-GMA query

2005 Q1Quarterly report: ScotGrid Usage by VO for Tier-2 Jobs Apr 2005May 2005Jun 2005 alice atlas cms2120 dteam lhcb abc CPU (KSI2K hours) Apr 2005May 2005Jun 2005 alice atlas cms3 dteam lhcb abc

2005 Q1Quarterly report: ScotGrid Usage by VO (jobs) Nb: This can be extracted from APEL

2005 Q1Quarterly report: ScotGrid Storage resources in use per VO (TB) Site StorageALICEATLASCMSdTea m LhcbSixtZeusTotal Durham Edinburgh Glasgow Total Difficult to provide this for the period but we can at least show *current* usage. If we can get the information average and maximum per VO over the period would be useful parameters to record.

2005 Q1Quarterly report: ScotGrid CPU Usage by VO (KSI2K hours) Nb: This can be extracted from APEL –

2005 Q1Quarterly report: ScotGrid Progress over last quarter SiteSuccessesProblems/Issues DurhamUpgrade to LCG2.4 Significant reliability improvement Documentation Late release of LCG 2.6 meant problems EdinburghUpgrade to LCG2.5 Participation in SC3 Deployment of dCache SRM Trials of DPM Documentation Lots of difficulty with dCache - mostly solved but v. Time consuming GlasgowDeployment of all CPU resources Pre-production deployment of DPM SRM Documentation Availability of staff to troubleshoot Late release of 2.6 caused problems

2005 Q1Quarterly report: ScotGrid Tier-2 risks General risks Lack of documentation for middleware threatens meeting MoU commitments. Concern over migration strategy from Classic SE to dCache Feel that scheduled LCG release plan has been abandoned Possible resistance to Scientific Linux for future shared cluster at Glasgow Mitigating actions Using GOC Wiki entries as substitute Writing ‘experience’ documentation None known. Tool support and migration strategy is required. Inevitably lowers priority of doing upgrades - can’t just drop everything and upgrade. Virtualisation? Institute specific risks Some concern over reinvestment at Durham Mitigating actions Attempts to secure further funding are ongoing.

2005 Q1Quarterly report: ScotGrid Tier-2 planning for next quarter Maintaining presence on grid Complete DPM SRM deployment at Glasgow, Durham Reliability/metrics a focus Focus on team communication and coordination at Glasgow (see: Better internal monitoring of cluster performance and uptime (Ganglia/Nagios)

2005 Q1Quarterly report: ScotGrid Objectives and deliverables for last quarter Objective/deliverableDue dateStatus All sites to 2.4.0April 1st (or release date) + 3 weeks Done dCache deployed at GlasgowApril 1st + 3 weeksNot done - choosing DPM dCache deployed at EdinburghApril 1st + 3 weeksDone, although dCache issues delayed Increase disk space at GlasgowEnd Q2Not done - awaiting SRM deployment Refurbishment of server room at GlasgowEnd Q2Done dCache deployed at DurhamNone setNot done - waiting on results of Glasgow DPM evaluation Continue planning for network upgrades in respect of service challences None setOngoing. Using experience of SC3 at Edinburgh to guide.

2005 Q1Quarterly report: ScotGrid Objectives and deliverables for next quarter Objective/deliverableDue dateMetric/output All sites to 2.6.0Set by ROC DPM deployed at GlasgowEnd Q2 SRM deployed at DurhamEnd Q2 Full Ganglia implementation across T2End August Continue planning for network upgrades in respect of service challences None setSC4-capable network connectivity

2005 Q1Quarterly report: ScotGrid Meetings, papers & effort Tier-2 coordinator effortComments 3.0 AreaDescription TalksScotgrid status - GridPP13 ConferencesGridPP13 LCG Ops Workshop - Bologna EGEE 3 - Athens Publications For Tier-2 coordinator:

2005 Q1Quarterly report: ScotGrid Summary & outlook Good progress this quarter on resource deployment, especially Glasgow CPU and Edinburgh disk. Progress on SRM deployment promising, although we still need a story about migration from Classic SE. Improvement in team coordination at Glasgow Outlook is good for hardware refresh at Glasgow, Edinburgh Lack of enthusiasm for Scientific Linux across Glasgow’s local userbase leads us to believe that there is a pressing need to research and solve the problem of LCG co-existence inside a shared cluster. (Portability/Xen?) Need to find ways to make SFT results match reality. Currently, they make the situation look worse than it is because of full queues.