EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks NagiosGrapher Viewing the history of metrics.

Slides:



Advertisements
Similar presentations
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Tutorial How to get started.
Advertisements

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Regional Operations Dashboard Workplan Cyril.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Release Process Maria Alandes Pradillo.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Simply monitor a grid site with Nagios J.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite IPv6 compliance project tests Further.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks perfSONAR deployment over Spanish LHC Tier.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks General relationships with EGEE JRA1 SA3.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The network monitoring in grid context Operations.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks PPS All sites Meeting: Introduction & Agenda.
INFSO-RI Enabling Grids for E-sciencE Installation and configuration of gLite Resource Broker Emidio Giorgio INFN EGEE-EMBRACE tutorial,
Graphing and statistics with Cacti AfNOG 11, Kigali/Rwanda.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GRNET SA3 Progress Report Ioannis Liabotis.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Middleware Deployment and Support in EGEE.
Enabling Grids for E-sciencE EGEE-III INFSO-RI Using DIANE for astrophysics applications Ladislav Hluchy, Viet Tran Institute of Informatics Slovak.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GStat 2.0 Joanna Huang (ASGC) Laurence Field.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Nagios for Grid Services E. Imamagic, SRCE.
INFSO-RI Enabling Grids for E-sciencE SA1 and gLite: Test, Certification and Pre-production Nick Thackray SA1, CERN.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA2 Quality Plan for EGEE III Geneviève.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid Site Monitoring with Nagios E. Imamagic,
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Batch Systems and the Info (Dynamic) Provider.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Status report on Application porting at SZTAKI.
EGEE is a project funded by the European Union under contract IST Tools survey status, first experiences with the prototype Diana Bosio EGEE.
INFSO-RI Enabling Grids for E-sciencE Information and Monitoring Status and Plans Plzeň, 10 July 2006 Steve Fisher/RAL.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Wojciech Lapka SAM Team CERN EGEE’09 Conference,
EGEE-III INFSO-RI Enabling Grids for E-sciencE Antonio Retico CERN, Geneva 19 Jan 2009 PPS in EGEEIII: Some Points.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 – The Ganga Evolution Andrew Maier.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Regional Dashboard Cyril L’Orphelin - CNRS/IN2P3.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Using GStat 2.0 for Information Validation.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The future of the gLite release process Oliver.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Tools and techniques for managing virtual machine images Andreas.
EGEE-II INFSO-RI Enabling Grids for E-sciencE NA2 Materials Owen Appleton EGEE and gLite are registered trademarks.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Task tracking SA3 All Hands Meeting Prague.
ASIS + RPM: ASISwsmp German Cancio, Lionel Cons, Philippe Defert, Andras Nagy CERN/IT Presented by Alan Lovell.
EGEE-II INFSO-RI Enabling Grids for E-sciencE YAIM Overview MiMOS Grid tutorial HungChe, ASGC OPS Team.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Computational chemistry with ECCE on EGEE.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Communication tools between Grid Virtual.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid Monitoring Tools E. Imamagic, SRCE CE.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA3 partner collaboration tasks & process.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks C. Martín, A. Lorca (UCM) Introduction to.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Middleware Update Maria Alandes Pradillo.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The LCG interface Stefano BAGNASCO INFN Torino.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Regional Nagios Emir Imamagic /SRCE EGEE’09,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks InGRID: A Generic Autonomous Expert System.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite – UNICORE interoperability Daniel Mallmann.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Best Practice and Training Mingchao Ma Operation.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MSA3.4.1 “The process document” Oliver Keeble.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System Tutorial Laurence Field.
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
EGEE is a project funded by the European Union under contract IST Installation and configuration of gLite services Robert Harakaly, CERN,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks LHCOPN Operations WS: Introduction & Objectives.
INFSO-RI Enabling Grids for E-sciencE Operations Parallel Session Summary Markus Schulz CERN IT/GD Joint OSG and EGEE Operations.
EGEE-III INFSO-RI Enabling Grids for E-sciencE JRA1 and SA3 All Hands Meeting December 2009, CERN, Geneva Product Teams –
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operations: Evolution of the Role of.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA3 Resources Robin McConnell.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Management Claudio Grandi.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ROC model assessment AP ROC ShuTing Liao.
Maite Barroso – WP4 Workshop – 10/12/ n° 1 -WP4 Workshop- Developers’ Guide Maite Barroso 10/12/2002
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Dashboard for Operations Cyril L’Orphelin.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CYFRONET site report Marcin Radecki CYFRONET.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarksEGEE-III INFSO-RI MPI on the grid:
Open Science Grid Configuring RSV OSG Resource & Service Validation Thomas Wang Grid Operations Center (OSG-GOC) Indiana University.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GOCDB4 Gilles Mathieu, RAL-STFC, UK An introduction.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Status of the SAM/Nagios/GSTAT Components.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MyEGEE David Horat (
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Nagios Grid Monitor E. Imamagic, SRCE OAT.
Lab 1 introduction, debrief
Presentation transcript:

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NagiosGrapher Viewing the history of metrics Felix Ehm CERN IT-GD-ITR

Enabling Grids for E-sciencE EGEE-II INFSO-RI Content Existing monitoring in Nagios Introduction to NagiosGrapher Installation & Configuration NagiosGrapher Web Interface Advantages/Disadvantages

Enabling Grids for E-sciencE EGEE-II INFSO-RI Existing monitoring in Nagios Nagios Reports

Enabling Grids for E-sciencE EGEE-II INFSO-RI Introduction to NagiosGrapher Introduction –Nagios extention to monitor service metrics developed by NETWAYS –Post-processes Nagios probe output –Uses RoundRobinDatabases for storing metric values (min,max,avg) –Offers web interface to create/watch graphs for choosen service metric values in a specific time periods (current, daily, weekly, monthly, yearly) –PERL based scripts –RPM’s available for SUSE (Ubuntu next)./check_icmp -H localhost OK - localhost: rta 0.054ms, lost 0%|rta=0.054ms; ; ;0; pl=0%;40;80;; NagiosGrapher (Nagios Plugin Output) RRDTools

Enabling Grids for E-sciencE EGEE-II INFSO-RI Installation –If you have a RPM file – be lucky! –Otherwise:  Download package from /  Shipped installation guide: NagiosGrapher/doc/INSTALL  configure with autoconf and ‘configure’ SLC : configure --layout redhat  fix missing packages  Install Iterative process

Enabling Grids for E-sciencE EGEE-II INFSO-RI Configuration (NagiosGrapher) Configuration files are similar to Nagios ones (*.ncfg) –Main configuration file: /etc/nagios/ngraph.ncfg –Other files usually in /etc/nagios/ngraph.d/.* –Main NagiosGrapher executable : /usr/lib/nagios/plugins/contrib/collect2.pl  Runs as daemon and post processes output from Nagios either through named pipe or network –But also: /usr/lib/nagios/plugins/contrib/fifo_write.pl  Wrapper for standard Nagios fifo_write module to enable write timeout ngraph.ncfg: –change: perffile_path directive must be commented

Enabling Grids for E-sciencE EGEE-II INFSO-RI Configuration (Nagios) nagios.cfg –add: cfg_dir=/etc/nagios/serviceext –add: service_perfdata_file=/tmp/service-perfdata –change: process-performance-data=1 –change: service_perfdata_command=process-service-command commands.cgi: –change: service-perfdata-command command_line directive.. # 'process-service-perfdata' command definition define command{ command_name process-service-perfdata command_line /usr/lib/nagios/plugins/contrib/fifo_write.pl /var/log/nagios/rw/ngraph.pipe '$HOSTNAME$\t$SERVICEDESC$\t$SERVICEOUTPUT$\t$SERVICEPERFDATA$\n' 3 } One liner!

Enabling Grids for E-sciencE EGEE-II INFSO-RI Startup Activate NagiosGrapher service check configuration files –NagiosGrapher reads all *.ncfg files recursively in /etc/nagios/ngraph.d/ –e.g. check_ping.ncfg_disabled rename to check_ping.ncfg Restart Nagios Start NagiosGrapher Watch the logfile –tail –f /var/log/nagios/ngraph.log Successful? –Reduce loglevel from default (255, heavy trace) to lower level no log rotation!

Enabling Grids for E-sciencE EGEE-II INFSO-RI Please wait…

Enabling Grids for E-sciencE EGEE-II INFSO-RI Nagios Web Interface

Enabling Grids for E-sciencE EGEE-II INFSO-RI NagiosGrapher Web Interface Week Month Year Day Current Interface to choose values/time scope

Enabling Grids for E-sciencE EGEE-II INFSO-RI NagiosGrapher Webinterface

Enabling Grids for E-sciencE EGEE-II INFSO-RI Advantages/Disadvantages Advantages ‘Easy’ to install Creates RRDs on the fly Creates serviceext info for page integration on the fly Easy adaptable to own service checks Real time graphing Future work –Logrotate in next version –Graph ‘zooming’ Disadvantages Problems at large scale ~7000 services: 20min to update RRD files Heavy weight operation: Regular expressions to find values in service performance output Graphs can’t show two different scales (two y-axis) Little bugs –NagiosGrpaher init script doesn’t work correctly –PERL complains about uninitialized variables

Enabling Grids for E-sciencE EGEE-II INFSO-RI Questions