EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Operational Architecture of PL-Grid project M.Radecki,

Slides:



Advertisements
Similar presentations
Polish Infrastructure for Supporting Computational Science in the European Research Space EUROPEAN UNION Services and Operations in Polish NGI M. Radecki,
Advertisements

EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Ab initio grid chemical software ports – transferring.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Towards scalable, semantic-based virtualized storage.
Polish Infrastructure for Supporting Computational Science in the European Research Space EUROPEAN UNION Operations in PL-Grid M. Radecki, T. Szepieniec,
08/11/908 WP2 e-NMR Grid deployment and operations Technical Review in Brussels, 8 th of December 2008 Marco Verlato.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks From ROCs to NGIs The pole1 and pole 2 people.
Enabling Grids for E-sciencE COD 19 meeting, Bologna Nordic ROD experiences Michaela Lechner COD-19, Bologna.
CILogon OSG CA Mine Altunay Jim Basney TAGPMA Meeting Pittsburgh May 27, 2015.
EMI SA2: Quality Assurance (EMI-SA2 Work Package) Alberto Aimar (CERN) WP Leader.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Romanian SA1 report Alexandru Stanciu ICI.
Łukasz Skitał 2, Renata Słota 1, Maciej Janusz 1 and Jacek Kitowski 1,2 1 Institute of Computer Science AGH University of Science and Technology, Mickiewicza.
EGI: SA1 Operations John Gordon EGEE09 Barcelona September 2009.
The EGI Blueprint: Grid Operations and Security Migration to the next grid operations era Tiziana Ferrari (Istituto Nazionale di Fisica Nucleare)
Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager
The ILC And the Grid Andreas Gellrich DESY LCWS2007 DESY, Hamburg, Germany
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Kelsey RAL/STFC,
EGEE is a project funded by the European Union under contract IST User support in EGEE Alistair Mills Torsten Antoni EGEE-3 Conference 20 April.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Bazaar Vision Ideas of RC/VO coordination,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE EGEE training community.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Multi-level monitoring - an overview James.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Performance Improvements to BDII - Grid Information.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-EGI Grid Operations Transition Maite.
CERN IT Department CH-1211 Geneva 23 Switzerland t GDB CERN, 4 th March 2008 James Casey A Strategy for WLCG Monitoring.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA1: Grid Operations Maite Barroso (CERN)
INFSO-RI Enabling Grids for E-sciencE EGEE SA1 in EGEE-II – Overview Ian Bird IT Department CERN, Switzerland EGEE.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The EGEE User Support Infrastructure Torsten.
EGEE is a project funded by the European Union under contract IST Support in EGEE Ron Trompert SARA NEROC Meeting, 28 October
Cracow Grid Workshop, October 15-17, 2007 Polish Grid Polish NGI Contribution to EGI Resource Provisioning Function Automatized Direct Communication Tomasz.
Last update 31/01/ :41 LCG 1 Maria Dimou Procedures for introducing new Virtual Organisations to EGEE NA4 Open Meeting Catania.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Resource Allocation in EGEEIII Overview &
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Communication tools between Grid Virtual.
INFSO-RI Enabling Grids for E-sciencE NRENs & Grids Workshop Relations between EGEE & NRENs Mathieu Goutelle (CNRS UREC) EGEE-SA2.
EGEE is a project funded by the European Union under contract IST Roles & Responsibilities Ian Bird SA1 Manager Cork Meeting, April 2004.
Kati Lassila-Perini EGEE User Support Workshop Outline: – CMS collaboration – User Support clients – User Support task definition – passive support:
INFSO-RI SA2 ETICS2 first Review Valerio Venturi INFN Bruxelles, 3 April 2009 Infrastructure Support.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team Kickoff Meeting.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Grid Oversight in Service Level Agreement environment Małgorzata Krakowian,
E-GRANT: EGI Resource Allocation Tool Current status and development roadmap Roksana Różańska, Tomasz Szepieniec ACC Cyfronet AGH, Poland EGI CF 2014,
Operations model Maite Barroso, CERN On behalf of EGEE operations WLCG Service Workshop 11/02/2006.
Opensciencegrid.org Operations Interfaces and Interactions Rob Quick, Indiana University July 21, 2005.
EGEE is a project funded by the European Union under contract IST New VO Integration Fabio Hernandez ROC Managers Workshop,
Resource Provisioning EGI_DS WP3 consolidation workshop, CERN Fotis Karayannis, GRNET.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks What all NGIs need to do: Helpdesk / User.
EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number GGUS Service Provider GGUS –
II EGEE conference Den Haag November, ROC-CIC status in Italy
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid is a Bazaar of Resource Providers and.
Operation team at Ccin2p3 Suzanne Poulat –
EGI Process Assessment and Improvement Plan – EGI core services – Tiziana Ferrari FedSM project 1EGI Process Assessment and Improvement Plan (Core Services)
EGI-InSPIRE Project Overview1 EGI-InSPIRE Overview Activities and operations boards Tiziana Ferrari, EGI.eu Operations Unit Tiziana.Ferrari at egi.eu 1.
Setting up NGI operations Ron Trompert EGI-InSPIRE – ROD teams workshop1.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Resource allocation Małgorzata Krakowian 1.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Dashboard for Operations Cyril L’Orphelin.
Grid Deployment Technical Working Groups: Middleware selection AAA,security Resource scheduling Operations User Support GDB Grid Deployment Resource planning,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CYFRONET site report Marcin Radecki CYFRONET.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Resource allocation brainstorming space
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations automation team presentazione.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
Scuola Grid - Martina Franca, Thursday 08 November Il Sistema di Supporto INFNGrid & GGUS ( Global Grid User.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks IT ROC: Vision for EGEE III Tiziana Ferrari.
Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.
1 The Life-Science Grid Community Tristan Glatard 1 1 Creatis, CNRS, INSERM, Université de Lyon, France The Spanish Network for e-Science 2/12/2010.
Polish Infrastructure for Supporting Computational Science in the European Research Space EUROPEAN UNION Grid Resource Bazaar Platform for resource allocation.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI COD activity in EGI-InSPIRE Marcin Radecki CYFRONET, Poland & COD Team 9/29/2016.
Piotr Bała, Marcin Radecki, Krzysztof Benedyczak
Bob Jones EGEE Technical Director
Regional Operations Centres Core infrastructure Centres
Operations Interfaces and Interactions
Nordic ROC Organization
Leigh Grundhoefer Indiana University
Presentation transcript:

EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Operational Architecture of PL-Grid project M.Radecki, T.Szepieniec, M.Krakowian, M.Tomanek and W.Ziajka ACC CYFRONET AGH Cracow Grid Workshop Cracow,

2 Outline Customers in Grid and issues to be solved VO manager Resource Provider VO user Site Administrator PL-Grid approach to resource sharing Bazaar tool Other operational consequences Information & monitoring system improvements Solving operational issues in PL-Grid

3 Grid Customers and Issues Virtual Organization Manager how could I obtain (more) resources for my VO? does QoS for provided resources satisfiy me? VO User I want to use the right resources – i.e. these which are well configured and supported Resource Provider Are all VOs satisfied with resources they get? Site Administrator ooops, something failed in grid middleware at my site, how to fix it quickly?

4 Linking Customer with Provider Well-defined procedure for VO Managers and Resource Providers for making an agreement on sharing resources is indispensable

5 Resource-related SLA and Bazaar tool PL-Grid will use Bazaar tool for implementing process of resource negotiation between VO manager and Resouce Provider Example contract parameters: time boundaries of the contract number of CPUs, disk space with the Quality of Service (guaranteed, best effort etc.) availablity/reliability of resources average acknowledge/response time to trouble tickets

6 Profits from having resource-related SLAs Communication channel between parties established Agreement can be monitored need accounting data monitoring: availability/reliability of services trouble ticket ack/response time First step towards business model in grid Impact on operations verification (certification) of resources for particular contract only certified resources accessible for VO users

7 Infrastructure Monitoring Typically one dedicated VO for monitoring all resources in Grid (e.g. “ops VO” in EGEE) requirement on sites to support this VO for monitoring purposes configured as high-priority VO not always reflects the status of the site according to other VOs PL-Grid uses regular VOs for monitoring special role configured within VO high priority for jobs executed with this role requires subscription of a technican's certificate as VO member reflects the VO status at a site site's service availability/reliability measured within real VOs

8 Grid Information System Improvements Use VO-level Information Systems instead of the global instance VO-scope makes sense for user better scalability: no longer global grid service easier to manage can be handled by the VO as other VO-services: VO Membership Service, File Catalogue, Resource Broker, etc. big VOs may take an effort to establish a high-availability cluster for information service, smaller ones will not require that reduces the network traffic by localizing it Include information only about sites which have an active contract with the VO and resources were verified (certified) Require a separate instance of Information System including all sites for testing/certification purposes

9 Solving Grid Operations Problems Site Administrator's perspective many sources of data: wiki pages, GGUS knowledge base many of them outdated, not providing working recipe Customers (VOs) are pressing on availability/reliability of resources need for quick problem solving need for interactive support – not always efficient PL-Grid support structures Actors Site Administrators 1 st line support Team Regional Operator on Duty (aka “ROD”)

10 Use case: Operations Problem Handling Site Monday, 7 P.M. Regional Dashboard 1 st line support Tuesday, 8 A.M. request for help Tuesday, 9 A.M. Tuesday, 7 P.M. 24h passed Wednesday, 8 A.M. Trouble ticket Problem assistance via instant messages Knowledge Base ROD

11 Summary Identified need for new operational tool for Resource Allocation fill a gap between VO Managers and Resource Providers Improvements to Information System related to RA and VO-scope to provide VO User with list of reliable, well-configured and supported resources Infrastructure monitoring should be realized within the real, existing VOs Procedures for fixing problems can be more efficient with: knowledge base to find if somebody else encountered the problem before st line support team to get interactive contact with the expert Polish NGI got assigned share in EGI global tasks related to: Coordination of resource allocation (O-E-10) - Poland Grid Operation and oversight (O-E-5) - Netherlands and Poland

12 PL-Grid news: (tentative) user registration open!