Nagios Integration January 31 2010, perfSONAR-PS Developers Meeting Jason Zurawski, Internet2 Brian Tierney, ESnet.

Slides:



Advertisements
Similar presentations
NAGIOS AND CACTI NETWORK MANAGEMENT AND MONITORING SYSTEMS.
Advertisements

29 Oded Moshe, Director of Product Management Beta Release October 19, 2010 Official Release November 9, 2010.
1 Network Monitoring with Nagios Asian Internet Interconnection Initiatives Project Yan Adikusuma Nara Institute of Science and Technology
Circuit Monitoring July 16 th 2011, OGF 32: NMC-WG Jason Zurawski, Internet2 Research Liaison.
University of St Andrews School of Computer Science Experiences with a Private Cloud St Andrews Cloud Computing co-laboratory James W. Smith Ali Khajeh-Hosseini.
Nagios on Tier1 farm Jonathan Wheeler RAL Tier1 Fabric Team 20 th June 2008.
Current Status (Tutorial tomorrow)
The Platform as a Service Model for Networking Eric Keller, Jennifer Rexford Princeton University INM/WREN 2010.
NGS – INCA Monitoring David Spence – University of Oxford Shiv Kaushal – University of Leeds.
Nagios XI 2012 Mike Guthrie Twitter: mguthrie88 Projects:
Overview of network monitoring development at AMRES Slavko Gajin.
1 CHEP 2000, Roberto Barbera Roberto Barbera (*) Grid monitoring with NAGIOS WP3-INFN Meeting, Naples, (*) Work in collaboration with.
Network Time Protocol (NTP) August 9 th 2011, OSG Site Admin Workshop Jason Zurawski – Internet2 Research Liaison.
ManageEngine TM Applications Manager 8 Monitoring Custom Applications.
Network Performance Toolkit (NPToolkit) A Knoppix Live-CD Rich Carlson Tools Tutorial 12/4/06.
Network Testing Tools Ettore Tamiro GARR - Network Operation Center PAP Workshop July 15, 2009.
Operating Systems.
PerfSONAR in ATLAS/WLCG Shawn McKee, Marian Babik ATLAS Jamboree / Network Section 3 rd December 2014.
OSG Logging Architecture Update Center for Enabling Distributed Petascale Science Brian L. Tierney: LBNL.
R. Lange, M. Giacchini: Monitoring a Control System Using Nagios Monitoring a Control System Using Nagios Ralph Lange, BESSY – Mauro Giacchini, LNL.
1 © Talend 2014 Service Locator Talend ESB Training 2014 Jan Bernhardt Zsolt Beothy-Elo
Today’s Agenda Chapter 12 Admin Tasks Chapter 13 Automating Admin Tasks.
PerfSONAR Client Construction February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D.
Performance Measurement Tools August 9 th 2011, OSG Site Admin Workshop Jason Zurawski – Internet2 Research Liaison.
Performance Measurement Tools March 10 th 2011, OSG All Hands Workshop - Network Performance Jason Zurawski, Internet2.
Josh Riggs Utilizing Open Source Network Monitoring.
Enterprise PI - How do I manage all of this? Robert Raesemann J Jacksonville, FL.
Network Management Tool Amy Auburger. 2 Product Overview Made by Ipswitch Affordable alternative to expensive & complicated Network Management Systems.
Overview of MSS System Human Actors Non-Human Actors In-house developed components Third party products.
PerfSONAR Information Services Update Jason Zurawski Feb 2, 2009 Winter Joint Techs 2009, College Station Texas.
Network Monitoring for OSG Shawn McKee/University of Michigan OSG Staff Planning Retreat July 10 th, 2012 July 10 th, 2012.
Network and Transfer WG Metrics Area Meeting Shawn McKee, Marian Babik Network and Transfer Metrics Kick-off Meeting 26 h November 2014.
Connect communicate collaborate perfSONAR MDM updates: New interface, new weathermap, towards a complete interoperability Domenico Vicinanza perfSONAR.
Internet2 Performance Update Jeff W. Boote Senior Network Software Engineer Internet2.
Marcelo R.N. Mendes. What is FINCoS? A Java-based set of tools for data generation, load submission, and performance measurement of event processing systems;
Alarm Network System Supervised by: Dr. Luai Malhis. Prepared by: Mahmoud Musa & Mustafa Assaf.
New perfSonar Dashboard Andy Lake, Tom Wlodek. What is the dashboard? I assume that everybody is familiar with the “old dashboard”:
OWAMP August 10 th 2010, OSG Site Admin Workshop - Network Performance Jason Zurawski, Internet2.
CIT 470: Advanced Network and System AdministrationSlide #1 CIT 470: Advanced Network and System Administration System Monitoring.
GEMINI + An MDIP Proposal 120/07/2012 Raphael Dourado Fibre-BR I&M Team Meeting.
PerfSONAR-PS Functionality February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D.
How to Deploy and Configure the Smart Net Total Care CSPC Collector
Marcelo R.N. Mendes. What is FINCoS? A set of tools for data generation, load submission, and performance measurement of CEP systems; Main Characteristics:
Network and Transfer WG perfSONAR operations Shawn McKee, Marian Babik Network and Transfer Metrics WG Meeting 28 h January 2015.
PerfSONAR Update Shawn McKee/University of Michigan LHCONE/LHCOPN Meeting Cambridge, UK February 9 th, 2015.
OSG Networking: Summarizing a New Area in OSG Shawn McKee/University of Michigan Network Planning Meeting Esnet/Internet2/OSG August 23 rd, 2012.
Copyright 2015, Robert W. Hasker. Continuous Inspection  Code reviews  Powerful tool  Difficult to ensure meaningful reviews take place  Static analysis.
PerfSONAR-PS Working Group Aaron Brown/Jason Zurawski January 21, 2008 TIP 2008 – Honolulu, HI.
GEMINI: Active Network Measurements Martin Swany, Indiana University.
A way to develop software that emphasizes communication, collaboration, and integration between development and IT operations teams.
LHCONE Monitoring Thoughts June 14 th, LHCOPN/LHCONE Meeting Jason Zurawski – Research Liaison.
Marcelo R.N. Mendes. What is FINCoS? A Java-based set of tools for data generation, load submission, and performance measurement of event processing systems;
Service Charging Platform. EMS (Entity Management System) 0 Logging Agent Provides detailed activity logs and reports all raw facts as they happen to.
Monitoring Alfresco with Nagios/Icinga Toni de la Fuente Alfresco Senior Solutions Engineer Blog: blyx.com
Advanced Network Diagnostic Tools Richard Carlson EVN-NREN workshop.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Author etc Alarm framework requirements Andrea Sciabà Tony Wildish.
PerfSONAR Update Jason Zurawski October, 2007 OGF 21 – Seattle WA.
Campana (CERN-IT/SDC), McKee (Michigan) 16 October 2013 Deployment of a WLCG network monitoring infrastructure based on the perfSONAR-PS technology.
PSPT 3.2 Development Update October 13 th 2010, USATLAS Distributed Facilities Workshop Jason Zurawski, Internet2.
Application or server monitoring
CIT 470: Advanced Network and System Administration
Essentials of UrbanCode Deploy v6.1 QQ147
Version Control with Subversion
Networking for the Future of Science
Network Monitoring and Troubleshooting with perfSONAR MDM
Internet2 Performance Update
Deployment & Advanced Regular Testing Strategies
CIT 470: Advanced Network and System Administration
Performance Measuring & Monitoring
Presentation transcript:

Nagios Integration January , perfSONAR-PS Developers Meeting Jason Zurawski, Internet2 Brian Tierney, ESnet

Idea Configuration – Static configuration (e.g. Easy stuff) – Dynamic configuration (e.g. Hard stuff) GUIs – Monitoring other instances – Visualizing the data on the toolkit 2 – 8/25/2014, © 2009 Internet2 Outline

Nagios will be used to monitor the health of the toolkit – Ensuring processes are running (or not running) – Ensuring data is meeting thresholds – Alerting in the event of a problem – Visualizing stability over time Do not want to recommend development on 3.1 versions – See suggested dev freeze in ‘LiveCD’ topic Would be included on – 8/25/2014, © 2009 Internet2 Idea

Will be a need to have custom configuration Each toolkit will choose different setup options, forcing different sets of things to care about – Where to send – Which processes to monitor – Which data sets to monitor – Different definitions for key thresholds (time based, data based) Will break this into two types: – ‘static’ is the same for all instances – ‘dynamic’ depends on the environment 4 – 8/25/2014, © 2009 Internet2 Configuration

Process Monitoring – Httpd – Ntpd (running + synced) – Service watcher process (re-starting pS daemons) Host Monitoring – Disk (too full) – Load (too high) – Process count (too high) General configuration – Need to know an SMTP host to relay through – Send the to someone (admin GUI will record this) – Send certain notifications to pS? 5 – 8/25/2014, © 2009 Internet2 Configuration - Static

Process Monitoring – ssh (if enabled) – Measurement daemons (owamp/bwctl/ndt/npad/pSB master and collector) – as enabled – pS Daemons (LS, SNMP, pSB, PingER) – as enabled Process running + respond to WS requests – Mysqld (if running) Data sets – Can check in one two ways: Through the WS Direct DB Query – Could also do both 6 – 8/25/2014, © 2009 Internet2 Configuration - Dynamic

Data Sets (cont.) – Data above or below a threshold Errors on an interface Utilization too high BWCTL expectation too low OWAMP loss/jitter too high – Data older than a time period Will need to see regular testing config for this (e.g older than the data expectation interval) – Data flapping between states OWAMP/PingER latency Interface status 7 – 8/25/2014, © 2009 Internet2 Configuration - Dynamic

Host Monitoring – Monitor the health of related machines? – Custom alerts RAM Disk Processing General configuration – How often to alert? 8 – 8/25/2014, © 2009 Internet2 Configuration - Dynamic

Use existing Nagios GUIs to show a mesh of deployments (or the entire pSPT world) Other GUIs out there – – 8/25/2014, © 2009 Internet2 GUIs

Nagios Integration January , perfSONAR-PS Developers Meeting Jason Zurawski, Internet2 Brian Tierney, ESnet For more information, visit 10 – 8/25/2014, © 2009 Internet2