Enabling Grids for E-sciencE GRIDCC testing EGEE II’ SLA framework through GEANT infrastructure Mary Grammatikou –

Slides:



Advertisements
Similar presentations
Gaetano Maron, Information Event, Brussel May GRIDCC A realtime interactive GRID to integrate instruments, computational and information resources.
Advertisements

Connect. Communicate. Collaborate I-SHARe Anand Patil, DANTE NML-WG, Open Grid Forum 22, Cambridge (MA), 26 February 2008.
Connect. Communicate. Collaborate NTUA/GRNET Interdomain SLAs Enforcement Framework in Real QoS-Enabled Networks C. Marinos, A. Polyrakis, V. Pouli, M.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Network in EGEE Building end-to-end network.
1 ITC242 – Introduction to Data Communications Week 12 Topic 18 Chapter 19 Network Management.
Connect. Communicate. Collaborate The Technological Landscape of GÉANT2 Roberto Sabatino, DANTE
Connect. Communicate. Collaborate Place your organisation logo in this area End-to-End Coordination Unit Toby Rodwell, Network Engineer, DANTE TNLC, 28.
GN2 Performance Monitoring & Management : AA Needs – Nicolas Simar - 2 nd AA Workshop Nov 2003 Malaga, Spain GN2 Performance Monitoring & Management.
DORII Joint Research Activities DORII Joint Research Activities Status and Progress 4 th All-Hands-Meeting (AHM) Alexey Cheptsov on.
Gaetano Maron, ANW, Halifax, November GRIDCC A realtime interactive GRID to integrate instruments, computational and information resources widely.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE II - Network Service Level Agreement (SLA) Establishment EGEE’07 Mary Grammatikou.
EMI SA2: Quality Assurance (EMI-SA2 Work Package) Alberto Aimar (CERN) WP Leader.
F. Lelli, Advanced Training Workshop on Instruments and Sensors on the Grid,Trieste, April 25, 2007 Instrument Elements at Work Imperial Brunel Elettra.
TeraPaths TeraPaths: establishing end-to-end QoS paths - the user perspective Presented by Presented by Dimitrios Katramatos, BNL Dimitrios Katramatos,
INFSO-RI Enabling Grids for E-sciencE Federated Network Performance Monitoring for the Grid K. Kavoussanakis, EPCC, The University.
EMI SA2: Quality Assurance (EMI-SA2 Work Package) Alberto Aimar (CERN) WP Leader.
INFSO-RI Enabling Grids for E-sciencE SA2 and JRA4: Network Services K. Kavoussanakis, EPCC, The University of Edinburgh J-P. Gautier,
Performance Monitoring - Internet2 Member Meeting -- Nicolas Simar Performance Monitoring Internet2 Member Meeting, Indianapolis.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
Instruments and Sensors on the Grid Gaetano Maron Istituto Nazionale di Fisica Nucleare – Laboratori di Legnaro Legnaro (PD),
The GRIDCC Instrument Element: from prototypes to production environments Roberto Pugliese On Behalf of the GRIDCC Collaboration EU FP6 Project.
Connect. Communicate. Collaborate Implementing Multi-Domain Monitoring Services for European Research Networks Szymon Trocha, PSNC A. Hanemann, L. Kudarimoti,
INFSO-RI Enabling Grids for E-sciencE GRID sites connectivity database design Anthony Teslyuk, RRC KI JRA4, SA2 Meeting 4 th EGEE.
Practical Distributed Authorization for GARA Andy Adamson and Olga Kornievskaia Center for Information Technology Integration University of Michigan, USA.
Connect. Communicate. Collaborate perfSONAR MDM Service for LHC OPN Loukik Kudarimoti DANTE.
BalticGrid-II Project BalticGrid-II Kick-off meeting, May 2008, Vilnius SA2 - Network Provisioning Katrina Sataki, IMCS UL.
Grid Operations Centre LCG SLAs and Site Audits Trevor Daniels, John Gordon GDB 8 Mar 2004.
INFSO-RI Enabling Grids for E-sciencE EGEE is a project funded by the European Union under contract INFSO-RI Grid Accounting.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-III Network activity overall Xavier.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Etienne Dublé - CNRS/UREC EGEE SA2 Xavier.
EGEE is a project funded by the European Union under contract IST Network Resources Provision Jean-Paul Gautier SA2 manager Cork meeting,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGI Operations Tiziana Ferrari EGEE User.
Diego R. Lopez, RedIRIS JRES2005, Marseille On eduGAIN and the Coming GÉANT Middleware Infrastructure.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Vassiliki Pouli
Enabling Grids for E-sciencE EGEE-II Meeting EGEE-II SA2 activity Tziouvaras Chrysostomos, MSc NTUA, 14 th March 2006.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Update on Network Performance Monitoring.
SLA/SLS Fundamental concepts SLAs/SLSs are the essential mechanisms for agreeing, configuring, delivering, guaranteeing and evaluating the obtained QoS.
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ENOC - Status and plans Guillaume Cessieux.
EGEE-II INFSO-RI Enabling Grids for E-sciencE End-to-End Service Level Agreement Provisioning and Monitoring for End-to-End QoS.
State of Georgia Release Management Training
First EELA Conference, Santiago(Cile), 4th September, GridCC: Real-time Instrumentations Grids.
INFSO-RI Enabling Grids for E-sciencE NRENs & Grids Workshop Relations between EGEE & NRENs Mathieu Goutelle (CNRS UREC) EGEE-SA2.
INFSO-RI Enabling Grids for E-sciencE Institution of SLAs TNLC Meeting ― Athens, Afrodite Sevasti (SA2, GRNET)
SA2 : Network Resource Provision All Activity Meeting – 17 March SA2 Execution Plan for the first year Jean-Paul Gautier SA2 Manager CNRS/UREC.
Connect. Communicate. Collaborate GN2 Activities and the LOBSTER Project Nicolas Simar, DANTE TNC 2005, Poznan, June 2005.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team Kickoff Meeting.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA2 Networking support for EGEE III Xavier.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA1 & SA2-ENOC Interactions status and plans.
G. Maron, EGEE06 Conference,CERN, September, 2006 Instruments and Sensors on the Grid The GridCC Project Gaetano Maron Istituto Nazionale di Fisica.
EGEE is a project funded by the European Union under contract IST JRA4 Overview Javier Orellana JRA4 Coordinator EGEE Kick Off Meeting SA2.
All Activities Meeting – 13/14 Jan SA2 Execution Plan for the first year Franck Bonnassieux CNRS/UREC EGEE is proposed as a project funded by.
David Foster, CERN GDB Meeting April 2008 GDB Meeting April 2008 LHCOPN Status and Plans A lot more detail at:
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks LHCOPN Operational model: Roles and functions.
INFSO-RI Enabling Grids for E-sciencE Network Services Development Network Resource Provision 3 rd EGEE Conference, Athens, 20 th.
Collaborative environment and workflow decomposition for remote instrumentation Roberto Pugliese ELETTRA - Sincrotrone Trieste SCpA On Behalf of the GRIDCC.
1 Network related topics Bartosz Belter, Wojbor Bogacki, Marcin Garstka, Maciej Głowiak, Radosław Krzywania, Roman Łapacz FABRIC meeting Poznań, 25 September.
LHCOPN operational model Guillaume Cessieux (CNRS/FR-CCIN2P3, EGEE SA2) On behalf of the LHCOPN Ops WG GDB CERN – November 12 th, 2008.
Javier Orellana EGEE-JRA4 Coordinator CERN March 2004 EGEE is proposed as a project funded by the European Union under contract IST Network.
Connect. Communicate. Collaborate Place your organisation logo in this area End-to-End Coordination Unit Marian Garcia, Operations Manager, DANTE LHC Meeting,
Enabling Grids for E-sciencE Claudio Cherubino INFN DGAS (Distributed Grid Accounting System)
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operating an Optical Private Network: the.
This project is supported under EU FP6 Contract Istituto Nazionale di Fisica Nucleare, Legnaro, Italy Brunel University, Uxbridge, UK IBM, Haifa,
The GRIDCC project Luke Dickens Imperial College / LeSC On behalf of the GRIDCC collaboration.
INFSO-RI Enabling Grids for E-sciencE TNC 2005 Networking activities in EGEE Mathieu Goutelle (CNRS UREC, France) EGEE-SA2 activity.
GRIDCC Project at Industry
Bob Jones EGEE Technical Director
EGEE SA2 / TERENA NRENs & Grids joint workshop
SLR, SLS and SLA issues Afrodite Sevasti SA2 participant
Presentation transcript:

Enabling Grids for E-sciencE GRIDCC testing EGEE II’ SLA framework through GEANT infrastructure Mary Grammatikou – EGEE II, GRnet/NTUA 21 st of February, 2007 CERN, SWITZERLAND

Enabling Grids for E-sciencE 2 Topics A briefly reminding on SLA structure (EGEE II - SA2) AMPS ( Advance Multi-domain Provisioning System ) preparation at each collaborative domain A briefly introduction to GRIDCC project Simple Scenario describing SLA testing

Enabling Grids for E-sciencE 3 SLA description on EGEE II (SA2) Whenever an amount of traffic is transferred from one EGEE RC (Resource Centre) to another, a Network Service Instance (NSI) is established. For every NSI an end-to-end SLA in IP layer is defined providing the technical and administrative details to perform –Maintenance –Monitoring –Troubleshooting Synthesis of end-to-end SLA based on individual domain SLAs

Enabling Grids for E-sciencE 4 SLA PARTS ALO (Administrative Level Object) –Contacts –Duration –Availability –Response times –Fault handling procedures SLO (Service Level Object) –Service instance scope –Flow description –Performance guarantees –Policy profile –Excess traffic treatment –Monitoring infrastructure –Reliability guarantees: time to repair (TTR)

Enabling Grids for E-sciencE 5 Preliminary agreement 1.ENOC asks from every participating domain and RC to formulate an agreement 2.Each domain NOC provides –the ALO (Administrative Level Object) –max bandwidth allocated for EGEE Each RC –provides administrative and technical details –signs Acceptable Use Policy (AUP)  Provisioned network resources used only for EGEE purposes 3.ENOC stores the received information to the NOD (Network Operational Database)

Enabling Grids for E-sciencE 6 Service Reservation and Activation In the Service Reservation (SR) stage –PIP reservation in extended QoS network –border-to-border SLA (GEANT/NRENs SLAs) In the Service Activation (SA) stage : –Configuration of the routers in the last mile network –end-to-end SLA (b2b SLA + NREN client domains’ SLAs)

Enabling Grids for E-sciencE 7 Stage 1: Service Reservation (SR) case 1: automatic reservation Reservation via AMPS (Advanced Multi-domain Provisioning System) servers of hosting NRENs and GEANT AMPS system: –In testing stage by the GEANT project –Management of the whole PIP provisioning process from user request through to the configuration of the appropriate network elements ENOC identifies involved GEANT/NREN domains GEANT/NRENs provide individual SLAs Synthesis of b2b SLA: performed by ENOC based on reported GEANT/NRENs SLAs

Enabling Grids for E-sciencE 8 Stage 2: Service Activation (SA) ENOC retrieves from NOD (Network Operational Database) the reservation information in the extended QoS domain ENOC verifies the reservation is still effective Checks if NREN client domains (MAN/campus/institution) can support the request NREN client domains provide their SLAs ENOC produces e2e SLA based on: –reported NREN client domains’ SLAs –b2b SLA from stage 1

Enabling Grids for E-sciencE 9 Monitoring of SLAs ENOC queries NPM DT (Network Performance Monitoring Diagnostic Tool) NPM DT provides measurement data from perfSONAR (GEANT/NRENs) and e2emonit (RC-to-RC) monitoring frameworks Fault Identification/Notification –Case 2 (including AMPS): ENOC (not able to isolate the problem) informs GEANT PERT (Performance Enhancement Response Team) Reaction-Repair according to SLAs ENOC checks SLA compliance

Enabling Grids for E-sciencE 10 SLA monitoring requirements for the testing e2e Metrics: –OWD (One Way Delay) –RTT (Round Trip Time) –Available bandwidth –Achievable bandwidth –TTR (Time To Repair) From trouble ticket issue to recovery, per violation –MDT (Maximum DownTime) Maximum total TTRs for all violations in a given period Performance metrics Reliability metrics

Enabling Grids for E-sciencE 11 Preparation of AMPS servers –Installed the latest version of AMPS –Populated NIS (at least routers & links in the path) –Policies for the request (a default policy that allows everything is preinstalled) –AMPS firewalls should allow EGEE ENOC

Enabling Grids for E-sciencE 12 GRID ENABLED REMOTE INSTRUMENTATION WITH DISTRIBUTED CONTROL AND COMPUTATION - GRIDCC GRIDCC is a FP6 project ending August 2007 It is showing how Instruments and Sensors can be not only remotely controlled and monitored, but even fully integrated in the European GRID, enabling in this way a perfect integration between control, data acquisition and grid based data storage and data processing Human interaction with Grids via Virtual Control Room (collaborative environment) Enactment of complex workflows GRIDCC Pilot Applications have been deployed in test bed environments, and even in production ones GRIDCC middleware is ready to be deployed in real and production infrastructure

Enabling Grids for E-sciencE 13 Participants Participant nameCountry Istituto Nazionale di Fisica NucleareItaly Institute Of Accelerating Systems and Applications/ IASA/NTUA Greece Brunel UniversityUK Consorzio Interuniversitario per TelecomunicazioniItaly Sincrotrone Trieste S.C.P.AItaly IBM (Haifa Research Lab)Israel Imperial College of Science, Technology & MedicineUK Istituto di Metodologie per l’Analisi ambientale – Consiglio Nazionale delle Ricerche Italy Universita degli Studi di UdineItaly Greek Research and Technology Network S.A.Greece

Enabling Grids for E-sciencE 14 Architecture: New “instruments grid” Component NameDescription Instrument Element (IE) This is a unique concept to GRIDCC. It consists of a coherent collection of services which provide all the functionalities to configure, partition and control the physical instruments Information & Monitor Service (IMS) It gathers from GRIDCC resources information and monitor data to be disseminated through a publish / subscribe systems or to be stored in persistent repositories. Problem Solver (PS) It offers automated problem solving in a Grid environment at two levels. A local PS, within a given Instrument Element, allows to solve local problems related to functionalities of a given instrument. A global PS, allows to solve system-wide problems. Virtual Control Room (VCR) It provides a common set of collaboration tools and allows users to build complex workflows, which are then submitted to the Execution Services, and to directly monitor and control remote instruments in real-time. Execution Services (ES) They control the execution of the workflows defined by the user in the VCR, maintaining the status of the tasks that make up the workflow. They also support the advance reservation of resources. Security Services (SS) GRIDCC uses a split security system. When interacting with components of other Grids the GSI security will be used and the users identified by their X.509 proxy certificate. When interacting with the IE the user will be identified by a Kerberos ticket.

Enabling Grids for E-sciencE 15 Execution ServicesCollaborative Environment GRIDCC: Architecture Instruments Grid Computational Grid IE CE SE Instrument Element Information & Monitoring System Problem Solver DATA ES VCR Workflow

Enabling Grids for E-sciencE 16 GRIDCC Pilot Applications The main objectives from the applications are: (1) to offer good ground for stress-testing the GridCC middleware and (2) to offer different “use cases” or “user requirements” to the real time grid and used as “proof-of principle” of the applicability and completeness of the GridCC middleware. The applications are: – “ Run Control” (high number of instruments and users, high-rate of incoming data) – “Far remote operation of an accelerator facility” (high number of instruments/sensors, smaller-rate of incoming data) – “Power Grid” (tests the benefit of computing Grid) – “Intrusion Detection System” (an anomaly-based IDS) – “Meteorology” (the need for high performance computing and the continuous update of output result)

Enabling Grids for E-sciencE 17 GRIDCC pilot applications Power Grid High Energy Physics CMS Particle Accelerator Device Farm Geohazard Monitoring Meteorology

Enabling Grids for E-sciencE 18 Status of the collaboration GridCC and SA2 activity from EGEE II have started communication GridCC has been informed about the EGEE SLA implementation and agreed on testing one or two of their main applications –They can examine the performance metrics (where AMPS is installed)  OWD (One Way Delay)  RTT (Round Trip Time)  Available bandwidth  Achievable bandwidth  TTR (Time To Repair)  From trouble ticket issue to recovery, per violation They discussed during their last software integration meeting the possible scenarios for these tests EGEE provides the SLA forms and AMPS preparation is needed for the full tests of the SLA AMPS preparation has been started in two (DANTE, GRNET) of the three main domains

Enabling Grids for E-sciencE 19 A first (simple) scenario between GRIDCC & EGEE II through AMPS Transfer data from the Instrument Element INFN (ITALY) to Storage Element - IASA (GREECE) Remote Control to these data Examine the performance parameters for this transfer to the specific path Examine the SLA through the parameters given for the test (capacity, delay) Using Monitoring Tools (if needed) The request starts from the ENOC (Italy) and after that AMPS cooperating GARR  GARR  DANTE  GRNET (GREECE) The SLA is providing from ENOC (Italy) to end user which in this case is GRIDCC (Italy), so ENOC (ITALY)