INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org Irish ROC - Report John Walsh Stephen Childs Eamonn Kenny Kathryn Cassidy Brian Coghlan.

Slides:



Advertisements
Similar presentations
Grid-Ireland:The National Computational Grid for Ireland Grid use in Ireland Infrastructure and OpsCentre EGEE/LCG2 direction MiniGateway Rollout MiniGateway.
Advertisements

HEAnet Conference 2006 John Walsh Grid-Ireland Grid Manager Trinity College Dublin The Grid Computing Infrastructure in Ireland and Abroad.
Luke Drury, Dublin Institute for Advanced Studies, on behalf of the Irish Grid Community Irish eInfrastructure and Grid initiatives.
INFSO-RI Enabling Grids for E-sciencE Operational Security OSCT JSPG March 2006 Ian Neilson, CERN.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE-III Program of Work Erwin Laure EGEE-II / EGEE-III Transition Meeting CERN,
EGI: A European Distributed Computing Infrastructure Steven Newhouse Interim EGI.eu Director.
The National Computational Grid for Ireland OpsCentre Infrastructure Staff TestGrid Porting Current Issues Future Plans Grid-Ireland OpsCentre.
Enabling Grids for E-sciencE Introduction to developing Grid applications March Grid-Ireland Brian Coghlan, John Walsh and Stephen Childs.
EGEE-II INFSO-RI Enabling Grids for E-sciencE AP ROC Min-Hong Tsai ASGC SA1 Transition Meeting May 8 th, 2008
Combining a Virtual Grid Testbed and eLearning Courseware Kathryn Cassidy, Jason McCandless, Stephen Childs, John Walsh, Brian Coghlan, Declan Dagger Department.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks PoW for the second year Transition to EGI.
INFSO-RI Enabling Grids for E-sciencE Status of LCG-2 porting Stephen Childs, Brian Coghlan and Eamonn Kenny Grid-Ireland/EGEE October.
EGI: SA1 Operations John Gordon EGEE09 Barcelona September 2009.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
GridPP DB 12 th July 2007 Enabling Grids for E-sciencE Grid-Ireland Status John Walsh Date: 12 th July 2007Imperial College London.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse EGEE’s plans for transition.
1 st EGEE Conference – April UK and Ireland Partner Dave Kant Deputy ROC Manager.
Security Area in GridPP2 4 Mar 2004 Security Area in GridPP2 “Proforma-2 posts” overview Deliverables – Local Access – Local Usage.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ?? Athens, May 5-6th 2009 Community Support.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks G. Quigley, B. Coghlan, J. Ryan (TCD). A.
Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager
INFSO-RI Enabling Grids for E-sciencE SA1 and gLite: Test, Certification and Pre-production Nick Thackray SA1, CERN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Multi-level monitoring - an overview James.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-EGI Grid Operations Transition Maite.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks A GSI-secured job manager for connecting.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The GILDA training infrastructure.
INFSO-RI Enabling Grids for E-sciencE External Projects Integration Summary – Trigger for Open Discussion Fotis Karayannis, Joanne.
Tony Doyle - University of Glasgow 8 July 2005Collaboration Board Meeting GridPP Report Tony Doyle.
EGEE is a project funded by the European Union under contract IST EGEE Services Ian Bird SA1 Manager Cork Meeting, April
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA1: Grid Operations Maite Barroso (CERN)
INFSO-RI Enabling Grids for E-sciencE EGEE SA1 in EGEE-II – Overview Ian Bird IT Department CERN, Switzerland EGEE.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-III Proposal Draft Summary of activity.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Fergusson, Emidio Giorgio, Gergely.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Gergely Sipos Activity Deputy Manager MTA.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse Technical Director CERN.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGI Operations Tiziana Ferrari EGEE User.
EGI-InSPIRE Steven Newhouse Interim EGI.eu Director EGI-InSPIRE Project Director Technical Director EGEE-III 1GDB - December 2009.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks South-West Federation Gabriel Amorós (CSIC)
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Robin McConnell NA3 Activity Manager 02.
INFSO-RI Enabling Grids for E-sciencE An overview of EGEE operations & support procedures Jules Wolfrat SARA.
PIC port d’informació científica EGEE – EGI Transition for WLCG in Spain M. Delfino, G. Merino, PIC Spanish Tier-1 WLCG CB 13-Nov-2009.
AEGIS Academic and Educational Grid Initiative of Serbia Antun Balaz (NGI_AEGIS Technical Manager) Dusan Vudragovic (NGI_AEGIS Deputy.
EGEE is a project funded by the European Union under contract IST Roles & Responsibilities Ian Bird SA1 Manager Cork Meeting, April 2004.
IAG – Israel Academic Grid, EGEE and HEP in Israel Prof. David Horn Tel Aviv University.
The National Grid Service Mike Mineter.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team Kickoff Meeting.
Grid testing using virtual machines Stephen Childs*, Brian Coghlan, David O'Callaghan, Geoff Quigley, John Walsh Department of Computer Science Trinity.
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
TCD Site Report Stuart Kenny*, Stephen Childs, Brian Coghlan, Geoff Quigley.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA5: Policy and International Cooperation.
INFSO-RI Enabling Grids for E-sciencE An introduction to EGEE Mike Mineter NeSC Edinburgh
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Technical Overview EGEE-II’s achievements.
INFSO-RI Enabling Grids for E-sciencE Joint Security Policy Group David Kelsey, CCLRC/RAL, UK 3 rd EGEE Project.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Training in EGEE-II Mike Mineter (Some slides from Brendan Hamill)
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse Technical Director CERN.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks What all NGIs need to do: Helpdesk / User.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operational Procedures (Contacts, procedures,
UK Grid Operations Support Centre All slides stolen by P.Clarke from a talk given by: Dr Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations.
EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number GGUS Service Provider GGUS –
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA5: Policy and International Cooperation.
NGI_TR Emrah Akkoyun TR-Grid Operational Center EGI-InSPIRE – SA1 Kickoff Meeting1.
Setting up NGI operations Ron Trompert EGI-InSPIRE – ROD teams workshop1.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA5: Policy and International Cooperation.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Robin McConnell Activity Manager UEDIN (NeSC)
INFSO-RI Enabling Grids for E-sciencE EGEE general project update Fotis Karayannis EGEE South East Europe Project Management Board.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks IT ROC: Vision for EGEE III Tiziana Ferrari.
Bob Jones EGEE Technical Director
Regional Operations Centres Core infrastructure Centres
Stephen Childs Trinity College Dublin
Transactional Grid Deployment
Presentation transcript:

INFSO-RI Enabling Grids for E-sciencE Irish ROC - Report John Walsh Stephen Childs Eamonn Kenny Kathryn Cassidy Brian Coghlan

Enabling Grids for E-sciencE INFSO-RI UKI ROC, CERN - Thursday 26 April 2007 Partner Review, CERN 2 TCD (partner 15): Overview TCD hosts Grid-Ireland OpsCentre (Irish ROC) TCD also runs a grid site (csTCDie) Grid-Ireland OpsCentre Management –Brian Coghlan –John Walsh –Stephen Childs Other OpsCentre Staff [  not in PPT] –Eamonn Kenny –Kathryn Cassidy –David O’Callaghan  –Geoff Quigley  –John Ryan  –Stuart Kenny  Website: Successes –  30 TCD papers thus far since 2006 –  OpsCentre developing adaptive e-Learning (XeL) –  Integrated architecture, centrally managed virtualised CE/SE/UI, transactional rollout –  Fully virtualised certification, experimental, porting & eLearning Testbeds –  Grid-Ireland monitoring (Irish SFTs/I4C/GIDS/trust-eval) plus central Irish AccessGrid service –  OpsCentre supports grid MPI (Chair TCG WG, app support, courses, workshop with int.eu.grid, etc) –  White Paper and subsequent proposal for a sustainable Irish eInfrastructure (e-INIS) –  Grid-Ireland has been confirmed as the defacto Irish NGI –  K.Cassidy is Secretary OGF Ed.Training WG, ICEAGE member & ISGCC07 programme committee –  JRA1: Stuart Kenny is writing the R-GMA Authorisation code  additional regional effort

Enabling Grids for E-sciencE INFSO-RI UKI ROC, CERN - Thursday 26 April 2007 Partner Review, CERN 3 TCD (partner 15): Overview OpsCentre –Irish ROC Management –Local Support for Ireland –Middleware certification –Grid-Ireland central services  –EGEE plus additional services –Deploy/Manage 18 grid gateways  –Irish Service Monitoring (I4C)  –Accounting: EGEE and Irish  –Authentication: policy + Irish CA –Authorisation: policy + Irish VOs  –Security: monitoring, vulnerability –All Grid-Ireland operations  TCD –csTCDie site: 64 CPUs –strongly supports BIOMED VO DIAS –cpDIASie site: 32 CPUs UCD –mpUCDie site: 256 CPUs –  OpsCentre had to develop remotePBS jobmanager –no non-national VO enabled yet ICHEC –giHECie site: 952 CPUs –  head-node-only model requires OpsCentre to develop proxy software –WNs not able to talk to RB/LFC yet UCC,NUIG,DCU,NUIM,UL,RCSI,QUB, ARM,DIT,AIT,WIT,ITC,ITTA,ITTR –no shared resources (yet) –nonetheless, all ready for WNs ,500  additional regional effort

Enabling Grids for E-sciencE INFSO-RI UKI ROC, CERN - Thursday 26 April 2007 Partner Review, CERN 4 TCD (partner 15): Activity = being done Activity

Enabling Grids for E-sciencE INFSO-RI UKI ROC, CERN - Thursday 26 April 2007 Partner Review, CERN 5 TCD (partner 15): Activity Activity –TSA1.1.1: ROC Management  Grid-Ireland Production Service, 4 Irish sites EGEE-registered. 18 Irish sites Total  Excellent TCD/RAL working relationship –TSA1.2.1: Coordination and support for m/w deployment  Grid-Ireland coordination task simplified to LRMS & WN by integrated deployment architecture  centrally managed with CE/SE/UI/MON virtualised  transactional rollout of RPMs & profiles from central repository to site Quattor instances  support to deploy on heterogeneous site WNs  deployment of remotePBS and customised site information providers –TSA1.2.2: Regional certification of middleware releases  OpsCentre does regional certification of software releases  Certification Testbed (SA1/SA3) - virtualised replica of Grid-Ireland  OpsCentre manages Porting Testbed (SA3)  OpsCentre manages Experimental TestGrid (research)  OpsCentre manages eLgrid (eLearning) infrastructure –TSA1.3.1: 1st line support for ops problems in region   RT  Appropriate Grid-Ireland tickets go through RAL’s footprints to GGUS  Bugs go to Savannah –TSA1.3.2: Oversight and management of ops problems  Grid-Ireland Grid Manager (John Walsh) and Deputy Grid Manager (Stephen Childs) –TSA1.3.3: Run essential regional grid services  OpsCentre provides EGEE services plus Grid-Ireland central services (RB/BDII/etc)   additional regional effort

Enabling Grids for E-sciencE INFSO-RI UKI ROC, CERN - Thursday 26 April 2007 Partner Review, CERN 6 TCD (partner 15): Activity –TSA1.3.4: Weekly operator on duty support   OpsCentre op-on-duty rota –TSA1.3.5: Grid services for infrastructure or VOs   Grid-Ireland monitoring (Irish SFTs/I4C/GIDS) plus central Irish AccessGrid services –TSA1.4.1: Grid incident response coord in region  OpsCentre (TCD’s John Walsh, David O’Callaghan, Stuart Kenny) and –TSA1.4.2: Security vulnerability and risk analysis  Security vulnerability (TCD’s John Walsh, SA1/SA3)  Grid-wide Intrusion Detection System (GIDS) developed by TCD  Prototype trust evaluation service developed by TCD –TSA1.4.3: CA management  Grid-Ireland CA (TCD) plus RAs (UCD, NUIG) –TSA1.5.2: helpdesk for ROC  Via RT –TSA1.5.3: VO support, integration support  EGEE VOs supported: alice,atlas,cms,lhcb,fusion(int.eu.grid),biomed,egode,planck,dteam,ops  Grid-Ireland VOs supported: cosmo,eirevo,gene,webcom,solovo,gitest  Central VO Admin support:   OpsCentre must develop s/w to suit non-EGEE site model for VOs like LHCb   OpsCentre specifically supports MPI users –TSA1.5.4: User training in region  Hands-on Irish courses, e.g. Grid MPI Course (with NeSC)   OpsCentre developing adaptive e-Learning (XeL)  additional regional effort

Enabling Grids for E-sciencE INFSO-RI UKI ROC, CERN - Thursday 26 April 2007 Partner Review, CERN 7 TCD (partner 15): Activity –TSA1.5.5: Site admin training in region  Specific Irish Grid admin and VO admin courses –TSA1.6.2: Accounting coordination in region  Irish accounting records published to Grid-Ireland R-GMA Irish records for EGEE-registered sites republished to EGEE R-GMA Irish national VO records very infrequently republished –TSA1.7.1: National and regional grid projects  Existing Irish WebCom-G, CosmoGrid, MarineGrid projects   In Jul-06, a White Paper proposed a sustainable Irish eInfrastructure, e-INIS  A proposal was submitted in Mar-07 for funding e-INIS  A proposed e-PSI Physical Sciences Initiative coupled to e-INIS –TSA1.7.2: International grid projects   TCD’s Stephen Childs is Chair TCG Working Group on MPI Ran the joint EGEE/int.eu.grid MPI Workshop in Dec-06  TCD has been instrumental in establishing strong working relations between EGEE and int.eu.grid to enhance MPI submission MPI is very important to Irish computational scientists   Grid-Ireland has been confirmed as the defacto Irish NGI  TCD’s Brian Coghlan represents Ireland regarding EGI –TSA1.8.1: ROC management of resources/SLAs  Slow evolution, will be a focus of e-INIS organisation –TSA1.9.1: ROC representation in coordination  All Irish coordination issues involve OpsCentre Task simplified by integrated deployment architecture  additional regional effort

Enabling Grids for E-sciencE INFSO-RI UKI ROC, CERN - Thursday 26 April 2007 Partner Review, CERN 8 TCD (partner 15): Activity –TSA1.A.3: EGEE conferences (preparation & attendance)  TCD delegates at all EGEE conferences, and have made presentations as well –TSA1.A.5: Participation to Standardisation bodies (GGF)   Kathryn Cassidy is Secretary of OGF Ed.Training WG –TSA1.A.7: Dissemination   30 TCD papers thus far since 2006  See also: –TSA1.A.8: EGEE training (as a trainee)   Kathryn Cassidy attended EGEE Summer School –TSA1.A.9: EGEE training (as a trainer)   Kathryn Cassidy is informal NA3 member And is ICEAGE member and on ISGCC07 programme committee –TSA1.A.10: Partner related tasks (administration, …)  TCD does cost claims, ICC, PPT, etc. –Non-SA1 activities   Stephen Childs is an active member of LCG Quattor Working Group Ran the Quattor Workshop in Mar-07  GridPP Deployment Board: John Walsh  EUGridPMA: Brian Coghlan & David O’Callaghan   JRA1: Stuart Kenny is writing the R-GMA Authorisation code  SA3: Eamonn Kenny – coordinator for porting, heterogeneity, works intensively with ETICS  SA3: John Walsh - vulnerability, certification (R-GMA)  additional regional effort

Enabling Grids for E-sciencE INFSO-RI UKI ROC, CERN - Thursday 26 April 2007 Partner Review, CERN 9 TCD (partner 15): Activity –Grid-Ireland has also developed useful additional middleware  Service monitoring  I4C service monitoring, see:  GIDS grid-wide intrusion detection system, see:  Prototype trust evaluation service  Jobmanagers  RemotePBS jobmanager that allows loosely connected batch systems to be connected to the EGEE & Grid-Ireland infrastructures (these batch systems are typically in separate administrative domains)  GIP dynamic scheduler plugin for Condor LRMS  Virtual Machine support  pypxeboot PXE boot loader for Xen  GridBuilder, see:  Grid Filesystem  gridFS, see: Notable Successes –Grid-Ireland deploys 5 complete Grids using Quattor  Production, certification , porting , experimental  and eLearning    All five Grids are heavily reliant on Virtual Machines Irish ROC Future –Will increase number of sites and number sharing resources –Will be a partner in EGEE-III and the Irish NGI member of EGI –Will move towards sustainability  additional regional effort

Enabling Grids for E-sciencE INFSO-RI UKI ROC, CERN - Thursday 26 April 2007 Partner Review, CERN 10 Grid-Ireland Accounting

Enabling Grids for E-sciencE INFSO-RI UKI ROC, CERN - Thursday 26 April 2007 Partner Review, CERN 11 Grid-Ireland Accounting

Enabling Grids for E-sciencE INFSO-RI UKI ROC, CERN - Thursday 26 April 2007 Partner Review, CERN 12 Grid-Ireland Accounting

Enabling Grids for E-sciencE INFSO-RI UKI ROC, CERN - Thursday 26 April 2007 Partner Review, CERN 13 Grid-Ireland Accounting