EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Simply monitor a grid site with Nagios J. Casey, CERN E. Imamagic, SRCE ISGC 2008

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 2 Overview Nagios Nagios-based grid monitoring Site monitoring prototype Demo Current status Future work Conclusions

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 3 Nagios Open source monitoring framework –widely used & actively developed Host and service problems detection and recovery Provides wide set of basic sensors –easy to develop custom sensors Centralized vs. distributed deployment High configurability –service dependencies, fine-grained notification options Web interface –status view, administration

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 4 Nagios-based Grid Monitoring Monitoring CRO-GRID Infrastructure ( ) –Globus Toolkit Pre-WS & WS, UNICORE, other services –active recovery of services – Monitoring EGEE resources in Central Europe (CE) –core services since mid 2006 –all CE sites for 1st line support since September 2006 – Grid Services Monitoring (GSM) WG –site monitoring prototype, mid 2007 – (egee.srce.hr) – (CERN-PPS)

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 5 Site Monitoring Prototype … Site nodes Site BDII CESELFC MyProxy Refresh proxy Get VOMS proxy Service checks Get remote results Probe descriptions … Get site’s & nodes information Get nodes information Live node checks Get Nagios results Site admins Get site status Issue alarms Monitoring server

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 6 Grid Probes Provided by SRCE, CERN, OSG Security facilities & services –CA distribution, Certificate lifetime, MyProxy Monitoring & information services –R-GMA, BDII, MDS, GridICE Job management services –Globus Gatekeeper, RB, WMS, WMProxy, Job matching File management services –GridFTP, SRM, DPNS, LFC, FTS

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 7 Standard Components Specifications defined by GSM WG Probe wrapper –enables integration of standardized probes –Grid Monitoring Probes Specification – ificationhttps://twiki.cern.ch/twiki/bin/view/LCG/GridMonitoringProbeSpec ification Publisher & remote gatherers –integration with other tools –Grid Monitoring Data Exchange Standard – ngeStandardhttps://twiki.cern.ch/twiki/bin/view/LCG/GridMonitoringDataExcha ngeStandard

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 8 Nagios Config Generator Uses multiple information sources –SAM, BDII, active heuristic checks Modular approach –plugging in additional information sources –integration with other monitoring systems (e.g. LEMON) User-defined rules –configuration tuning for non-standard grid sites Standalone configuration –integration with existing Nagios server

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 9 Remote gLite UI Avoid installation of grid middleware on Nagios server –execute grid probes on existing gLite UI –use Nagios Remote Plugin Executor (NRPE) … Site nodes Site BDII CESELFC Service checks

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 10

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 11

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 12

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 13 SAM Standard probes NPM

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 14 Current Status Three sets of standard probes integrated –SRCE, CERN, OSG Two external monitoring systems –SAM, ENOC DownCollector Several deployments –CERN-PPS, SRCE, NIKHEF, PIC, IN2P3, ScotGrid RPMs in apt and yum repository Installation and configuration manual More info

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 15 Future Work NCG development –providing configuration for multiple sites (regional monitoring) –providing configuration for multiple VOs Integration with global monitoring systems –ActiveMQ messaging system –Operations Automation Team mandate Enabling “on-host” check via NRPE –process, logs, ports, files, etc Probe description & site topology databases definition

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 16 Conclusions Nagios –highly configurable monitoring framework with notifications, service dependencies, … –widely used by site admins Grid extensions –integration with existing infrastructure (user certificates, VOMS, GOCDB, SAM) –probes for key grid services Implementation of GSM WG specifications –probe wrapper, publisher & remote gatherers –easy integration with existing probes and monitoring systems

Enabling Grids for E-sciencE EGEE-II INFSO-RI ISGC 2008 / Simply monitor a grid site with Nagios 17 Thank You! Questions?