Robert Szuman – Poznań Supercomputing and Networking Center, Poland

Slides:



Advertisements
Similar presentations
Dominik Stokłosa Pozna ń Supercomputing and Networking Center, Supercomputing Department INGRID 2008 Lacco Ameno, Island of Ischia, ITALY, April 9-11 Workflow.
Advertisements

Circuit Monitoring July 16 th 2011, OGF 32: NMC-WG Jason Zurawski, Internet2 Research Liaison.
Key Multi-domain GÉANT Network Services June 2011.
Connect. Communicate. Collaborate Place your organisation logo in this area GN2 Multidomain Monitoring Service: Serving IP NOCs Nicolas Simar, DANTE APM.
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
Connect. Communicate. Collaborate 1 QUATIC 2007 Lisbon New University (Portugal), September 12-14, 2007 Quality Assurance in perfSONAR Release Management.
Connect. Communicate. Collaborate WI5 – tools implementation Stephan Kraft October 2007, Sevilla.
Connect. Communicate. Collaborate GÉANT2 JRA1 & perfSONAR Loukik Kudarimoti, DANTE 28 th May, 2006 RNP Workshop, Curitiba.
Grids and Grid Technologies for Wide-Area Distributed Computing Mark Baker, Rajkumar Buyya and Domenico Laforenza.
1 The SpaceWire Internet Tunnel and the Advantages It Provides For Spacecraft Integration Stuart Mills, Steve Parkes Space Technology Centre University.
1 ESnet Network Measurements ESCC Feb Joe Metzger
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
World Class Standards CCIF New York - April Grids, Clouds and Service Infrastructures ETSI Strategy & New Initiatives.
Connect communicate collaborate perfSONAR MDM updates: New interface, new possibilities Domenico Vicinanza perfSONAR MDM Product Manager
Windows Small Business Server 2003 Setting up and Connecting David Overton Partner Technical Specialist.
Margherita Forcolin (Insiel S.p.A.) Thessaloniki, 13 October 2011.
Internet2 Performance Update Jeff W. Boote Senior Network Software Engineer Internet2.
1 Measuring Circuit Based Networks Joint Techs Feb Joe Metzger
Effective and Open System for Wavelengths Monitoring AICT 2008, Athens, Greece, 8-13 June 2008 A. Binczewski 1, Ł. Grzesiak 1, E. Kenny 2, K. Stanecki.
Connect. Communicate. Collaborate Implementing Multi-Domain Monitoring Services for European Research Networks Szymon Trocha, PSNC A. Hanemann, L. Kudarimoti,
Hands-On Microsoft Windows Server Implementing Microsoft Internet Information Services Microsoft Internet Information Services (IIS) –Software included.
Authentication and Authorisation for Research and Collaboration Pilots on the Integrated R&E AAI Paul van Dijk, Activity Lead Pilots.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Connect communicate collaborate Intercontinental Multi-Domain Monitoring for the LHC Community Domenico Vicinanza perfSONAR MDM Product Manager DANTE –
Connect. Communicate. Collaborate The authN and authR infrastructure of perfSONAR MDM Ann Arbor, MI, September 2008.
Connect. Communicate. Collaborate perfSONAR MDM Service for LHC OPN Loukik Kudarimoti DANTE.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Building Dynamic Lightpaths in GÉANT Tangui Coulouarn, DeIC E-Infrastructure Autumn Workshop, Chiinău 8 September 2014.
PerfSONAR-PS Functionality February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Jeremy Nowell EPCC, University of Edinburgh A Standards Based Alarms Service for Monitoring Federated Networks.
Connect. Communicate. Collaborate GEANT2 Monitoring Services Emma Apted, DANTE Operations EGEE III, Budapest, 3 rd October 2007.
Connect communicate collaborate perfSONAR MDM for LHCOPN/LHCONE: partnership, collaboration, interoperability, openness Domenico Vicinanza perfSONAR MDM.
Connect communicate collaborate LHCONE Diagnostic & Monitoring Infrastructure Richard Hughes-Jones DANTE Delivery of Advanced Network Technology to Europe.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Data Manipulation with Globus Toolkit Ivan Ivanovski TU München,
PerfSONAR-PS Working Group Aaron Brown/Jason Zurawski January 21, 2008 TIP 2008 – Honolulu, HI.
CERN IT Department CH-1211 Genève 23 Switzerland t CERN IT Monitoring and Data Analytics Pedro Andrade (IT-GT) Openlab Workshop on Data Analytics.
DICE: Authorizing Dynamic Networks for VOs Jeff W. Boote Senior Network Software Engineer, Internet2 Cándido Rodríguez Montes RedIRIS TNC2009 Malaga, Spain.
Javier Orellana JRA4 Coordinator Face to Face Partners Meeting University College London 11 December 2003 EGEE is proposed as a project funded by the European.
Charaka Palansuriya EPCC, The University of Edinburgh An Alarms Service for Federated Networks Charaka.
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
DICE Diagnostic Service Joe Metzger Joint Techs Measurement Working Group January
Connect communicate collaborate perfSONAR MDM News Domenico Vicinanza DANTE (UK)
INFSO-RI Enabling Grids for E-sciencE Network Services Development Network Resource Provision 3 rd EGEE Conference, Athens, 20 th.
1 Network related topics Bartosz Belter, Wojbor Bogacki, Marcin Garstka, Maciej Głowiak, Radosław Krzywania, Roman Łapacz FABRIC meeting Poznań, 25 September.
Javier Orellana EGEE-JRA4 Coordinator CERN March 2004 EGEE is proposed as a project funded by the European Union under contract IST Network.
1 Network Measurement Challenges LHC E2E Network Research Meeting October 25 th 2006 Joe Metzger Version 1.1.
Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.
RESERVOIR Service Manager NickTsouroulas Head of Open-Source Reference Implementations Unit Juan Cáceres
Bob Jones EGEE Technical Director
Scientific workflow in Kepler – hands on tutorial
GÉANT Multi-Domain Bandwidth-on-Demand Service
Networking for the Future of Science
PerfSONAR: Development Status
Integration of Network Services Interface version 2 with the JUNOS Space SDK
Campus Monitoring Service
Network Monitoring and Troubleshooting with perfSONAR MDM
Internet2 Performance Update
ESnet Network Measurements ESCC Feb Joe Metzger
Case Study: Algae Bloom in a Water Reservoir
Use of handheld electronic devices for census data collection (Bhutan)
Anja Burghardt, Institute for Employment Research (IAB)
Resources and Schedule
AIMS Equipment & Automation monitoring solution
“Detective”: Integrating NDT and E2E piPEs
CAD DESK PRIMAVERA PRESENTATION.
ESDEN - modernisation of data exchange in the ESS
Network Services Evolution and Development
Presentation transcript:

Network performance event management based upon the perfSONAR framework Robert Szuman – Poznań Supercomputing and Networking Center, Poland TERENA Networking Conference 2011, Prague The research leading to these results has received funding from the European Community’s Seventh Framework Programme (FP7/2007-2013) under grant agreement no 238875 (GÉANT)"

Agenda Introduction Requirements Alarms perfSONAR Event management architecture Architecture advantages Implementation Additional information About GÉANT

Introduction Efficient and scalable event management functionality for the multi-domain network monitoring Supports NOCs not to overlook network performance incidents Prepared for extensions when new alarms are needed Based on standards (OGF) Replacement for existing solutions NPM Alarms Service (the event management tool created for the GÉANT network few years ago) Software product to be deployed in the GN3 Service Area

Requirements (1) Scalability – applicable for multi-domain and highly distributed environment Extensibility – simple adding new alarms Flexibility – alarm conditions as well as threshold values easily configurable Standards – communication between architecture components and the information model (topology)

Requirements (2) Use of existing framework that offers basic functionalities suitable for the multi-domain environment - perfSONAR Integration with already existing monitoring applications - access to multiple network performance data sources User-friendly visualisation with Nagios application (client side)

Alarms (1) User-selected alarms for the first release: RoutingAlarm (sourceSite, destinationSite) - if the path, as determined by traceroute output, changes and there are no light-paths down between the source and destination, then raise an alarm InterfaceCongestionAlarm (router, interface) - if a router interface output drops is above a threshold, and the router interface utilisation is below a threshold, raise an alarm. The cross-check of interface utilisation value can suppress alarms caused by output drops which are expected when the utilisation is high

Alarms (2) RoutingOutOfNetworkWarning (sourceSite, destinationSite) - if the route changes, and it includes a hop not in the user-defined list, raise an alarm InterfaceErrorsAlarm (router, interface) - if a router interface input errors is above a threshold, raise an alarm The proposed alarm severities follow the network management software convention because users are already familiar to them (Normal, Warning, Critical)

perfSONAR Multi-domain infrastructure for network performance monitoring Set of services delivering performance measurements in a federated environment Services act as an intermediate layer, between the performance measurement tools and the diagnostic or visualization applications Standardised communication (NMC) and information model (NM) - Open Grid Forum (OGF) Easy to add new functionalities – in this case it is events management Wide collaboration: GNx projects, US institutions (led by Internet2 and ESnet), RNP (Brasil)

Event Management Architecture Different variants of architecture (communication models) were considered The most distributed one selected User-defined rules for creating events Clear separation of basic functionalities: storage, alarms detection and visualisation Running within the perfSONAR infrastructure

Event Management Architecture – single-domain view

Event Management Architecture – multi-domain view

Architecture advantages perfSONAR provides a set of already existing functionalities (e.g. storage, service lookup) prepared for the multi-domain environment Distributed nature of perfSONAR services helps to easily add new functionalities or system components Separation of components allows to replace them dynamically (no need to stop event management service)

Implementation Java implementation (web services) Use of the perfSONAR MDM development library for services (pSbase) Open source (BSD-like) The plugin for visualization in Nagios (communication via perfSONAR protocol - NMC) The implementation scheduled for the perfSONAR MDM release in August/September 2011 The early pilot implementation before the final version will be provided for testing

Additional information Detailed specification document is available on the web site of GN3 project (community access only) Intranet->Research->JRA2->Task3->Documents->Events_Management_in_pS https://intranet.geant.net/sites/Research/JRA2/T3/Documents/Events_Management_in_pS/Events_Management_in_perfSONAR.pdf The authors (the PSNC team) will be glad to answer any questions sent via email More info about perfSONAR MDM - http://perfsonar.geant.net/

The pan-European infrastructure and Global Connectivity GN3 contract - total funding from the EC of 93 million Euro for four years from 1 April 2009 Together with Europe's national research networks, GÉANT connects 40 million users in over 8,000 institutions across 40 countries

Thank you for your attention! Robert Szuman (PSNC): rszuman@man.poznan.pl