INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN.

Slides:



Advertisements
Similar presentations
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
Advertisements

DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
GLUE Schema: conceptual model and implementation
Enabling Grids for E-sciencE Grid Monitoring Workshop Monterey Bay, California, 25 June 2007 Antonio Pierro INFN-BARI (Italy) Antonio.pierro.
Dave Kant Grid Monitoring and Accounting Dave Kant CCLRC e-Science Centre, UK HEPiX at Brookhaven 18 th – 22 nd Oct 2004.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Simply monitor a grid site with Nagios J.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
1 BIG FARMS AND THE GRID Job Submission and Monitoring issues ATF Meeting, 20/06/03 Sergio Andreozzi.
INFSO-RI Enabling Grids for E-sciencE GridICE: a monitoring service for Grid Systems Sergio Andreozzi INFN (Italy)
A.Guarise – F.Rosso 1 Enabling Grids for E-sciencE INFSO-RI Comprehensive Accounting Views on large computing farms. Andrea Guarise & Felice Rosso.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System on gLite middleware Vincent.
A monitoring tool for a GRID operation center Sergio Andreozzi (INFN CNAF), Sergio Fantinel (INFN Padova), David Rebatto (INFN Milano), Gennaro Tortone.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GStat 2.0 Joanna Huang (ASGC) Laurence Field.
And Tier 3 monitoring Tier 3 Ivan Kadochnikov LIT JINR
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks WMSMonitor: a tool to monitor gLite WMS/LB.
Lemon Monitoring Miroslav Siket, German Cancio, David Front, Maciej Stepniewski CERN-IT/FIO-FS LCG Operations Workshop Bologna, May 2005.
INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Batch Systems and the Info (Dynamic) Provider.
Conference name Company name INFSOM-RI Speaker name The ETICS Job management architecture EGEE ‘08 Istanbul, September 25 th 2008 Valerio Venturi.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Wojciech Lapka SAM Team CERN EGEE’09 Conference,
Enabling Grids for E-sciencE INFSO-RI Tools for CIC Operations, Bologna, 24th May Monitoring workflow in EGEE GOC DB is used to get the list.
INFSO-RI Enabling Grids for E-sciencE The gLite File Transfer Service: Middleware Lessons Learned form Service Challenges Paolo.
HLRmon accounting portal DGAS (Distributed Grid Accounting System) sensors collect accounting information at site level. Site data are sent to site or.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Using GStat 2.0 for Information Validation.
Recent improvements in HLRmon, an accounting portal suitable for national Grids Enrico Fattibene (speaker), Andrea Cristofori, Luciano Gaido, Paolo Veronesi.
DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 1 GLUE Schema - Status Report DataTAG WP4 meeting Bologna,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
Data Transfer Service Challenge Infrastructure Ian Bird GDB 12 th January 2005.
DataTAG is a project funded by the European Union CERN, 8 May 2003 – n o 1 / 29 GridICE The eyes of the grid A monitoring tool for a Grid Operation Center.
INFSO-RI Enabling Grids for E-sciencE /10/20054th EGEE Conference - Pisa1 gLite Configuration and Deployment Models JRA1 Integration.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks APEL CPU Accounting in the EGEE/WLCG infrastructure.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Deliverable DSA1.4 Jules Wolfrat ARM-9 –
EGEE-II INFSO-RI Enabling Grids for E-sciencE Storage Accounting for Grid Environments Fabio Scibilia INFN - Catania.
Accounting in LCG/EGEE Can We Gauge Grid Usage via RBs? Dave Kant CCLRC, e-Science Centre.
EGEE is a project funded by the European Union under contract INFSO-RI Grid accounting with GridICE Sergio Fantinel, INFN LNL/PD LCG Workshop November.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Regional Nagios Emir Imamagic /SRCE EGEE’09,
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
HLRmon accounting portal The accounting layout A. Cristofori 1, E. Fattibene 1, L. Gaido 2, P. Veronesi 1 INFN-CNAF Bologna (Italy) 1, INFN-Torino Torino.
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System Tutorial Laurence Field.
+ Support multiple virtual environment for Grid computing Dr. Lizhe Wang.
Open Science Grid OSG Resource and Service Validation and WLCG SAM Interoperability Rob Quick With Content from Arvind Gopu, James Casey, Ian Neilson,
DataTAG is a project funded by the European Union International School on Grid Computing, 23 Jul 2003 – n o 1 GridICE The eyes of the grid PART I. Introduction.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operational Procedures (Contacts, procedures,
DataTAG is a project funded by the European Union CERN, 8 May 2003 – n o 1 / 10 Grid Monitoring A conceptual introduction to GridICE Sergio Andreozzi
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid is a Bazaar of Resource Providers and.
INFSO-RI Enabling Grids for E-sciencE GOCDB Requirements John Gordon, STFC.
EGEE-II INFSO-RI Enabling Grids for E-sciencE WLCG File Transfer Service Sophie Lemaitre – Gavin Mccance Joint EGEE and OSG Workshop.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Dashboard for Operations Cyril L’Orphelin.
DGAS Distributed Grid Accounting System INFN Workshop /05/1009, Palau Giuseppe Patania Andrea Guarise 6/18/20161.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Status of SRB/SRM interface development Fu-Ming Tsai Academia Sinica Grid Computing.
Enabling Grids for E-sciencE INFN Workshop – May 7-11 Rimini 1 Grid Accounting Status at INFN Riccardo Brunetti INFN-TORINO.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
INFSO-RI Enabling Grids for E-sciencE GridICE: status and plans for gLite integration and user level job monitoring Sergio Andreozzi.
Grid Monitoring and Diagnostic Tools: GridICE, GSTAT, SAM Giuseppe Misurelli INFN-CNAF giuseppe.misurelli cnaf.infn.it.
Enabling Grids for E-sciencE Claudio Cherubino INFN DGAS (Distributed Grid Accounting System)
DGAS Accounting – toward national grid infrastructures HPDC workshop on Monitoring, Logging and Accounting, (MLA) in production Grids 10/06/2009, Munich.
Enabling Grids for E-sciencE GridICE: overview and current status Guido Cuscela INFN – Bari Service Challenge Technical Meeting September.
Job monitoring and accounting data visualization
Monitoring: problems, solutions, experiences
Sergio Fantinel, INFN LNL/PD
GridICE monitoring for the EGEE infrastructure
EDT-WP4 monitoring group status report
a VO-oriented perspective
Danilo Dongiovanni INFN-CNAF
EGEE Middleware: gLite Information Systems (IS)
Presentation transcript:

INFSO-RI Enabling Grids for E-sciencE GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN (Italy) ISGC 2007, Taipei (Taiwan)

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), OUTLINE Brief Architecture Overview Stakeholders Sample Usage Views

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), Deployment Layout and info Sources GOC DB standard info providers extended info providers GOCDB collected information

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), Infrastructure Layout DB GRIS (GLUE+ schema) LEMON Server cluster head node information providers farm monitoring archive run ldif output write read information index BDII/GIIS (GLUE schema) monitoring server First discovery phase Cont. discovery & collection ldap query web interface cluster worker node /proc filesystem sensors run read metric output LEMON monitoring agent cluster worker node /proc filesystem sensors run read metric output GridICE Schema SITE Level

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), Stakeholders High level Managers –Interested in bird-eyes view of resources status and usage (aggregations, reports, graphs) Grid Operators (CIC, ROC,…) –Detail views for day by day shifts help Site Administrators –Site level grid and fabric detail views Grid Users –Interested in job submission ad tracking

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), GridICE sensors at fabric level Standard per host metric collection –CPU, MEM, VMEM, FileSystem, Net Interfaces, … GridICE specific probes for advanced measurement –In Production:  Job monitoring  LRMSInfo  Generic/per role Daemons status with simple config –Ready but not in release:  WMSLB –In developing (almost ready)  storage (CASTOR, DPM, dCache) internal status (almost done, integration needed)  FTS

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), Summary High Level Overview

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), VOs Summary View

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), VO Computational Resources

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), Available Brokers Status

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), Site Comp. Resources Status

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), Site Details

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), Daemons Grid Service Status Site can be notified by the GridICE server on daemons status change

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), Site Grid Jobs

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), Site detailed graphs

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), SNAP

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), SNAP

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), SNAP

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), SNAP

Enabling Grids for E-sciencE INFSO-RI ISGC2007, Taipei (Taiwan), SNAP