EGI-InSPIRE Project Overview1 EGI-InSPIRE Overview Activities and operations boards Tiziana Ferrari, EGI.eu Operations Unit Tiziana.Ferrari at egi.eu 1
EGI-InSPIRE Project Overview2 Outline Overview of all activities SA1: Operations
EGI-InSPIRE Project Overview3 Overview 48 month project, 53 partners objectives –transition to a sustainable pan-European e-Infrastructure –high-performance and high-throughput computing and integration of new Distributed Computing Infrastructures (DCIs) – high performance, clouds, desktop grids –collect requirements and provide user-support for the current and new (e.g. ESFRI) users –define, verify and integrate within the Unified Middleware Distribution (UMD), the middleware from external providers; staged rollout of UMD into the infrastructure –The operational tools will be maintained and extended t to support a national operational deployment model to include new DCI technologies in the production infrastructure to extend accounting to support new EGI business models
EGI-InSPIRE Project Overview4 Work packages, effort and duration EGI.eu CERN INFN
EGI-InSPIRE Project Overview5 NA1 Activity Management TNA1.1: Activity Management TNA1.2: Project and Consortium Management TNA1.3 Technical Management TNA1.4: Quality Assurance
EGI-InSPIRE Project Overview6 NA2 - External Relations TNA2.1 Activity Management TNA2.2 Dissemination TNA2.3 Policy Development: policy groups for developing and approving policies relating to operations, software quality, security, user communities and general governance Security Policy Group (SPG) (EGEE/WLCG JSPG) Software Security Group (SSG) Security Coordination Group (SCG) International Grid Trust Federation (IGTF) and EUGridPMA User Services Advisory Group (USAG) User Services Advisory Group (USAG) : to provide feedback on the user-facing tools and services Operational Tools Advisory Group (OTAG) Operational Tools Advisory Group (OTAG) : to manage the development and evolution of operational tools Infrastructure Policy Group (IPG): has representation from major production e- Infrastructures from around the world – currently EGEE, OSG, DEISA, Naregi and TeraGrid European E-Infrastructure Forum (EEF) TNA2.4: Event Management
EGI-InSPIRE Project Overview7 NA3: User Community Coordination TNA3.1: Activity Management TNA3.2: User and Community Support Team TNA3.3: NGI User Support Teams (training, engagement with new communities, application porting) TNA3.4: Technical Services –database of registered trainers –application database –The basic technical services needed by VOs within the –infrastructure (e.g. VOMS, VO database, registration, portals, and dashboards, etc.) are delivered through the operations teams and the NGIs
EGI-InSPIRE Project Overview8 SA2 Provisioning the Software Infrastructure TSA2.1: Activity Management TSA2.2: Definition of the UMD quality criteria TSA2.3: Verification of conformance criteria TSA2.4: Provision of a software repository and support tools TSA2.5: Deployed Middleware Support Unit
EGI-InSPIRE Project Overview9 SA3 - Services for the Heavy User Communities TSA3.1: Activity Management TSA3.2: Shared services and tools (dashboards, GANGA, DIANE, HYDRA, GReLC etc.) TSA3.3: Services for High Energy Physics (HEP) TSA3.4: Services for Life Sciences (LS) TSA3.5: Services for Astronomy and Astrophysics (A&A) TSA3.6: Services for Earth Sciences (ES)
EGI-InSPIRE Project Overview10 JRA1 Operational Tools TJRA1.1 Activity management TJRA1.2 Maintenance and development of the deployed operational tools –operations portal –EGI helpdesk (GGUS) –Grid configuration repository (GOCDB) –APEL accounting repository –Accounting and metrics portal, and –Service Availability Monitoring framework TJRA1.3 Supporting National Deployment models TJRA1.4 Accounting for usage of different resource types TJRA1.5 Integrated Operations Portal
EGI-InSPIRE Project Overview11 EGI-InSPIRE SA1 Operations
EGI-InSPIRE Project Overview12 SA1 Operations TSA1.2 Secure infrastructure –STFC, Mingchao Ma TSA1.3 Service Deployment - validation –LIP, Mario David TSA1.4 Infrastructure for Grid Management –TBC TSA1.5 Accounting –STFC, J.Gordon TSA1.6 Helpdesk –KIT, T.Antoni TSA1.7 Support Teams –NL, R.Trompert TSA1.8 Providing a reliable grid Infrastructure –GR, C. Kanellopoulos
EGI-InSPIRE Project Overview13 SA1: Operations NGI tasks: operational activities run by individual tasks (O-N-*) EGI global tasks (O-E-*) –Distributed across many NGIs –Run under the technical responsibility of the selected NGIs –Coordinated by EGI.eu The ensable of the EGI global tasks constitutes the EGI Operations Unit
EGI-InSPIRE Project Overview14 NGI and EGI tasks 1/2 TSA1.2 Secure infrastructure (STFC, Mingchao Ma) O-E-16 Security response UK (0.7 FTE, NL 0.3 FTE) O-N-9a NGI operational security TSA1.3 Service Deployment - validation (LIP, Mario David) O-E-9 Middleware rollout (0.9 FTE Spain) O-E-11 Interoperability (0.5 FTE Sweeden) O-N-9b rollout O-N-9d interoperability in the region TSA1.4 Infrastructure for Grid Management (TBC) O-E-1 GOCDB 0.5 FTE, UK O-E-3 Monitoring infrastructure 0.25 CERN, 0.25 GRNET, O-E-4 Operations portal and dashboard 0.25 FTE FR O-E-12 Tools for network troubleshooting and monitoring 0.25 FTE IT O-N-1 Grid topology database O-N-3 Grid repositories (for operational tools) O-N-4 operations portal and dashboard TSA1.5 Accounting (STFC, J.Gordon) O-E-2 Central accounting repository and portal 0.25 UK, 0.25 Spain O-N-2 NGI accounting infrastructure
EGI-InSPIRE Project Overview15 TSA1.6 Helpdesk (KIT, T.Antoni) O-E-6 Helpdesk 1.0 FTE DE O-E-8 User requirements (0.5 NA3, EGI.eu) O-N-6 NGI helpdesk system TSA1.7 Support Teams (NL, R.Trompert) O-E-5 Grid operations oversight (COD) 0.5 NL, 0.5 PL FTE O-E-7 1st line support (TPM) 0.5 DE, 0.5 IT O-E-12 Coordination of network support 0.25 IT O-E-10 Resource allocation 0 FTE O-N-5 Oversight (NGI 1st line, ROD) O-N-7 NGI support team O-N-9c Resource allocation TSA1.8 Providing a reliable grid Infrastructure (GR, C. Kanellopoulos) O-E-14 Core grid services (1.0 GR) O-E-13 Best practices and procedures (0.5 FI) O-N-8 Grid core services This activity includes the revision of the existing Operational Service Agreements (OLAs) defined in EGEE-III NGI and EGI tasks 2/2
EGI-InSPIRE Project Overview16 Milestones and deliverables (Y1) TSA1.2 Secure infrastructure –MS405 Operational Security Procedures (CNRS France) PM3 TSA1.3 Service deployment –MS402 Deploying Software into the EGI production infrastructure (CSIC Spain) PM4 –MS406 Deployment plan for the distribution of operational tools to the NGIs/EIROs (CSIC Spain) PM4 in collaboration with TSA1.4 –MS407 Integrating Resources into the EGI Production Infrastructure (SNIC Sweden) PM4 TSA1.4 Infrastructure for Grid management –MS401 Operational Tools regionalisation status (INFN) PM1 in collaboration with TSA1.5 –Contribution to MSA406 (see TSA1.3) –Contribution to MSA404 (see TSA1.8) TSA1.5 Accounting –Contribution to MSA401 (see TSA1.4) TSA1.6 Helpdesk –MS403 EGI Helpdesk and the NGI Support Units (KIT) PM2, requires collaboration with TSA1.7 and SA2 TSA1.7 Support teams –Contribution to MSA403 (see TSA1.6) TSA1.8 Providing a reliable grid infrastructure –MS404 Operational Level Agreements (OLAs) within the EGI production infrastructure (GRNET) PM2 –MS408 EGI Operational Procedures (NCF The Neth.) PM6
EGI-InSPIRE Project Overview17 Medium/Long term objectives EGEE well established procedures, models, policies and tools are the fundation of EGI operations EGI-InSPIRE aims to further extending this framework through innovation to face the many challenges ahead: –EGEE-III to EGI-InSPIRE transition: from regions to NGIs –Integration of nascent NGIs and new EIROs New requirements Revision and streamlining of existing procedures to ensure scalability Flexible Operational Level Agreements –Integration of NGIs deploying different middleware stacks Ensure interoperation and adapt according to the middleware harmonization efforts supported by the European Commission (EMI) –Integration with new DCIs Extensions of existing procedures and of the monitoring and accounting frameworks
EGI-InSPIRE Project Overview18 Boards and meetings relevant to ROD/COD JRA1 SA1 ROD/COD NGI rep. Product Teams Operations tools advisory group SA2 (EGI Middleware Unit) ROD/COD TSA1.3 Service Deployment Validation TSA2.2: Def. UMD quality criteria TSA2.3: Verification of conformance criteria Fortnightly ops meetings