GridPP DB 12 th July 2007 Enabling Grids for E-sciencE Grid-Ireland Status John Walsh Date: 12 th July 2007Imperial College London

Enabling Grids for E-sciencE GridPP DB 12 th July 2007 Location: Imperial College London 2 TCD (partner 15): Overview TCD hosts Grid-Ireland OpsCentre (Irish ROC) TCD also runs 4 EGEE site + 14 others Grid-Ireland OpsCentre Management –Brian Coghlan –John Walsh –Stephen Childs Other OpsCentre Staff [  not in PPT] –Eamonn Kenny –Kathryn Cassidy –David O’Callaghan  –Geoff Quigley  –John Ryan  –Stuart Kenny  Website: Successes –  30 TCD papers thus far since 2006 –  OpsCentre developing adaptive e-Learning (XeL) –  Integrated architecture, centrally managed virtualised CE/SE/UI, transactional rollout –  Fully virtualised certification, experimental, porting & eLearning Testbeds –  Grid-Ireland monitoring (Irish SFTs/I4C/GIDS/trust-eval) plus central Irish AccessGrid service –  OpsCentre supports grid MPI (Chair TCG WG, app support, courses, workshop with int.eu.grid, etc) –  White Paper and subsequent proposal for a sustainable Irish eInfrastructure (e-INIS) –  Grid-Ireland has been confirmed as the defacto Irish NGI –  K.Cassidy is Secretary OGF Ed.Training WG, ICEAGE member & ISGCC07 programme committee –  JRA1: Stuart Kenny is writing the R-GMA Authorisation code  additional regional effort

Enabling Grids for E-sciencE GridPP DB 12 th July 2007 OpsCentre –Irish ROC Management –Local Support for Ireland –Middleware certification –Grid-Ireland central services  –EGEE plus additional services –Deploy/Manage 18 grid gateways  –Irish Service Monitoring (I4C)  –Accounting: EGEE and Irish  –Authentication: policy + Irish CA –Authorisation: policy + Irish VOs  –Security: monitoring, vulnerability –All Grid-Ireland operations  Location: Imperial College London 3 TCD (partner 15): Overview TCD –csTCDie site: 64 CPUs –strongly supports BIOMED VO DIAS –cpDIASie site: 32 CPUs UCD –mpUCDie site: 256 CPUs –  OpsCentre had to develop remotePBS jobmanager –no non-national VO enabled yet ICHEC –giHECie site: 952 CPUs –  head-node-only model requires OpsCentre to develop proxy software –WNs not able to talk to RB/LFC yet UCC,NUIG,DCU,NUIM,UL,RCSI,QUB, ARM,DIT,AIT,WIT,ITC,ITTA,ITTR –no shared resources (yet) –nonetheless, all ready for WNs ,500  additional regional effort

Enabling Grids for E-sciencE GridPP DB 12 th July 2007 Location: Imperial College London 4 TCD (partner 15): Activity = being done Activity

Enabling Grids for E-sciencE GridPP DB 12 th July 2007 Major Site Upgrade –All Grid-Ireland sites undergoing major upgrades  Completion date expected by end of july  Adding extra memory  OS upgrade + Xen upgrade  HiRes GPS timers at each site  All sites moved to DPM MPI integration RemotePBS development and deployment –Grid access to PBS servers not in administrative domain –Deployed at 3 sites (cpDIASie, giHECie, mpUCDie) –Several issues –Expect to integrate resources at other sites soon Condor Integration Location: Imperial College London 5 Current Activities

Enabling Grids for E-sciencE GridPP DB 12 th July 2007 Grid-Ireland MPI Support Location: Imperial College London 6 S. Childs chairs TCG working group (which collaborates with int.eu.grid project) −Led the development of standards for configuring sites −Helped to develop YAIM configuration function −Developed SAM sensor to verify MPI functionality Recent work with Matthew Viljoen to provide EGEE- compatible MPI on the NGS GridPP could help with YAIM testing/certification – the main MPI working group sites use Quattor! Would be great if more GridPP sites could adopt MPI configuration (IC have made a start)

Enabling Grids for E-sciencE GridPP DB 12 th July 2007 Experimental Condor Work at TCD started late 2006 –Integrating Lab nodes into Grid accessible condor pool –Nodes will be used off-peak + during idle –S. Childs developed Condor dynamic info provider  Extra patches supplied by others –Not yet expected to allow standard EGEE LHC VOs  Some technical and access policy issues –Initial successful deployment to 20 nodes –Site BDII had some difficulties, info loss due to high load  Solved with HW upgrade + process priorities –Expanding to 150 nodes Location: Imperial College London 7 Condor at TCD

Enabling Grids for E-sciencE GridPP DB 12 th July 2007 Location: Imperial College London 8 Porting History: –  TCD started parallel porting, auto build & test Oct03 –  Good progress Dec04: –  Based on edg-build –  Built porting Testbed  SGI for Irix  Apple G5 for MacOS-X  Sun for Solaris  IBM Power5 for AIX  X86 for Linux variants –EGEE SA3 started Apr06 –7PM funded from Sep07 –  Eamonn Kenny contributing voluntarily since Apr06 –  Otherwise SA3 porting would be 2.5-3yrs behind where it is now  additional regional effort

Enabling Grids for E-sciencE GridPP DB 12 th July 2007 Location: Imperial College London 9 Porting Achievements Fixes and direct contributions to ETICS: –  external dependencies repository updated –  Changes to external dependencies: log4cxx, boost –  Changes to org.glite: org.glite.security.voms –  ETICS client running on: SuSE 9.3, CentOS 4.4 (x86_64), Mac OS X (Panther/Tiger), (SuSE fixed Integration Meeting Feb 2007) –  Implemented patches: cvs proxy, HTTP/HTTPS proxy support –  Solved: RPM BuildArch translation issue, relating to Bug #24178 –  Created alternative to webreactor in ETICS giving HTML reports which is now adopted (posted after Integration Meeting Feb 2007) –  Got to 100% building in February for SL3 and CentOS, back to this in May 2007 –  Test bed: Condor, Xen, Quattor based setup  additional regional effort

Enabling Grids for E-sciencE GridPP DB 12 th July 2007 Location: Imperial College London 10 Current Porting Tools All written in Python: –  Build configuration comparison scripts –  Site dependent local building and synchronization modules –  Automated porting table creation (fine grained) –  Hypergraph creation tool to analyse dependency structure –  Heterogeneous Condor installer (Mac OS X, Linux, AIX) Bash scripts: –  ETICS patching scripts (ZSI patching, to integrate soon) –  Local build management scripts –  Deployment dashboard comparison scripts  additional regional effort

Enabling Grids for E-sciencE GridPP DB 12 th July 2007 Location: Imperial College London 11 Future Porting Platforms?  additional regional effort ●  SuSE 9.3 (x86_64) is TCD top priority ●  CentOS 4.4 is almost as important ●  Liase more with PSNC on their Debian work ●Need better feedback to the TCG & the TCG needs more exposure ●Must find a component level sustainable solution ●VDT must be in the loop for all OSes ●Policies must be enforced or agreed upon ●Must test WNs using standalone SAM