SUM like functionality with WLCG-MON Ivan Dzhunov.

Slides:



Advertisements
Similar presentations
Nagios XI 2012 Mike Guthrie Twitter: mguthrie88 Projects:
Advertisements

Dashboards Slide by ana’s presentation. Tired of these challenges? No centralized view of executive information from multiple functional areas and systems;
Creating Hyperion Planning Applications with EPMA
WEST Presented By 3s. Introduction Project Overview Project Overview Use Case Diagram Use Case Diagram Domain Model Diagram Domain Model Diagram UI for.
WLCG Monitoring Consolidation NEC`2013, Varna Julia Andreeva CERN IT-SDC.
Access 2007 Product Review. With its improved interface and interactive design capabilities that do not require deep database knowledge, Microsoft Office.
Information Processing Lecture 9B Criteria for File Organisation.
Experiment Support Introduction to HammerCloud for The LHCb Experiment Dan van der Ster CERN IT Experiment Support 3 June 2010.
Session-02. Index. Jsp in Struts 2 Web.xml File in Struts 2.
Overview of Data Management solutions for the Control and Operation of the CERN Accelerators Database Futures Workshop, CERN June 2011 Zory Zaharieva,
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
Dependency Injection and Model-View-Controller. Overview Inversion of Control Model-View-Controller.
Contents 1.What is MATRIX Mobile 2.Menu Options 3.Installation 4.Access.
Curricunet to Banner Interface College of the Sequoias Lee McDonald Joni Jordan.
Advanced Features of Nagios XI Sam Lansing -
A WALK THROUGH THE GENWARE AUDIT PROCESSOR™ Brought to you by Genware Computer Systems to schedule your demonstration.
©Ian Sommerville 2000Software Engineering, 6th edition. Chapter 23Slide 1 Chapter 23 Software Cost Estimation.
Business Intelligence (BI) Primer BI Tools in SharePoint 2010 Excel Services Performance Point Services.
Procrastinator: Pacing Mobile Apps’ Usage of the Network mobisys 2014.
Universidade Fernando Pessoa UFP Tools Development Nuno Fernandes Luís Borges Gouveia Feliz Ribeiro Gouveia.
New perfSonar Dashboard Andy Lake, Tom Wlodek. What is the dashboard? I assume that everybody is familiar with the “old dashboard”:
Utah’s Indicator-Based Information System for Public Health (IBIS-PH) Utah Department of Health Office of Public Health Assessment Lois M. Haggard, Ph.D.,
Function Point Analysis. Function Points Analysis (FPA) What is Function Point Analysis (FPA)? Function points are a standard unit of measure that represent.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Service Availability Monitoring – Status.
Creating JT files from I-DEAS. Lee Simmons July 2009.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Overview of STEP09 monitoring issues Julia Andreeva, IT/GS STEP09 Postmortem.
Julia Andreeva, CERN IT-ES GDB Every experiment does evaluation of the site status and experiment activities at the site As a rule the state.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Wojciech Lapka SAM Team CERN EGEE’09 Conference,
WLCG infrastructure monitoring proposal Pablo Saiz IT/SDC/MI 16 th August 2013.
© 2013 IBM Corporation IBM Tivoli Composite Application Manager for Transactions Transaction Tracking Best Practice for Workspace Navigation.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Ricardo Rocha CERN (IT/GS) EGEE’08, September 2008, Istanbul, TURKEY Experiment.
XROOTD AND FEDERATED STORAGE MONITORING CURRENT STATUS AND ISSUES A.Petrosyan, D.Oleynik, J.Andreeva Creating federated data stores for the LHC CC-IN2P3,
Julia Andreeva on behalf of the Dashboard team. 45 machines (14 dedicated to cms) 9% still on SLC4 (two weeks ago 30%) Services.
Julia Andreeva on behalf of the MND section MND review.
De’Bill Final Project – android app Team Members: Ilya Shamis, Daniel Grinberg, Nirit Lapidot Supervisor: Prof. Moshe Sipper.
Validation of SAM3 monitoring data (availability & reliability of services) Ivan Dzhunov, Pablo Saiz (CERN), Elena Tikhonenko (JINR, Dubna) April 11, 2014.
Library Online Resource Analysis (LORA) System Introduction Electronic information resources and databases have become an essential part of library collections.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Monitoring of the LHC Computing Activities Key Results from the Services.
Mr. Justin “JET” Turner CSCI 3000 – Fall 2015 CRN Section A – TR 9:30-10:45 CRN – Section B – TR 5:30-6:45.
MND review. Main directions of work  Development and support of the Experiment Dashboard Applications - Data management monitoring - Job processing monitoring.
Global ADC Job Monitoring Laura Sargsyan (YerPhI).
GridView - A Monitoring & Visualization tool for LCG Rajesh Kalmady, Phool Chand, Kislay Bhatt, D. D. Sonvane, Kumar Vaibhav B.A.R.C. BARC-CERN/LCG Meeting.
SAM Database and relation with GridView Piotr Nyczyk SAM Review CERN, 2007.
03/09/2007http://pcalimonitor.cern.ch/1 Monitoring in ALICE Costin Grigoras 03/09/2007 WLCG Meeting, CHEP.
Network integration with PanDA Artem Petrosyan PanDA UTA,
DDM Central Catalogs and Central Database Pedro Salgado.
Computation of Service Availability Metrics in Gridview Digamber Sonvane, Rajesh Kalmady, Phool Chand, Kislay Bhatt, Kumar Vaibhav Computer Division, BARC,
Prototype of new Site Usability interface Amol Wakankar March, /1/20111.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Dashboard for Operations Cyril L’Orphelin.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI 2 nd level support training Marian Babik, David Collados, Wojciech Lapka,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Update on Service Availability Monitoring (SAM) Marian Babik, David Collados,
© 2013 IBM Corporation 1 Welcome to SUA/ILMT design validation session.
Flexible Availability Computation Engine for WLCG Rajesh Kalmady, Phool Chand, Vaibhav Kumar, Digamber Sonvane, Pradyumna Joshi, Vibhuti Duggal, Kislay.
WLCG Transfers monitoring EGI Technical Forum Madrid, 17 September 2013 Pablo Saiz on behalf of the Dashboard Team CERN IT/SDC.
Computing in High Energy and Nuclear Physics 2012 May 21-25, 2012 New York United States The version control service for ATLAS data acquisition configuration.
Daniele Bonacorsi Andrea Sciabà
Enterprise Service Bus
NGI and Site Nagios Monitoring
POW MND section.
Pedro Andrade ACE Status Update Pedro Andrade
Evolution of SAM in an enhanced model for monitoring the WLCG grid
SRM2 Migration Strategy
Experiment Dashboard overviw of the applications
Advancements in Availability and Reliability computation Introduction and current status of the Comp Reports mini project C. Kanellopoulos GRNET.
Discussions on group meeting
TS4.10 Comp Reports A new approach to Computing Availability/Reliability reports for EGI Progress Report C. Kanellopoulos GRNET 9/14/2018.
Monitoring of the infrastructure from the VO perspective
Metadata The metadata contains
Kashif Mohammad Deputy Technical Co-ordinator (South Grid) Oxford
Presentation transcript:

SUM like functionality with WLCG-MON Ivan Dzhunov

What do we mean by SUM like?  Historical plots  sites availability/reliability  services availability/reliability  metrics history per hostname  metric’s detailed output  Latest results table  “SUM uses the screen very economically”  drill down navigation between the plots  filters for sites, group of sites, services, metrics, hostnames 6 Dec 2013 Ivan Dzhunov 2

Site reliability historical plot  New type of historical metric plot implemented in SSB (WLCG-MON)  Reliability calculated by formula good/(good+bad)  good = {‘warning’, ‘ok’}  bad = {‘critical’, ‘unknown ’}  Configurable per metric  Idea is to use the same plot for service reliability 6 Dec 2013 Ivan Dzhunov 3

Service reliability historical plot ?  We need plot like showing reliability for set of service flavors (CREAM-CE, SRMv2) for set of sites (T2_ES_CIEMAT, T2_FR_CCIN2P3) per profile  In SSB status of single service flavor (per profile) is different metric  Need of cross metric, cross instance historical SSB plot – MxN -SSB not flexible enough, has historical plots only per metric (1xN) or per instance (Mx1)  Here we thought a bit. If we want to provide SUM like functionality, why not use SUM ? 6 Dec 2013 Ivan Dzhunov 4

Current usage of SUM  SUM  User interface for displaying SAM data  No DB behind it, works with API calls  SSB interacting with SUM  SSB data not in sync with re-computed historical SAM data 6 Dec 2013 Ivan Dzhunov 5 SUM UI API calls SSB UI SAM data SSB data get current data

Future usage of SUM  SUM on top of WLCG-MON  Single data store  Re-computed data will be seen by both applications 6 Dec 2013 Ivan Dzhunov 6 SUM UI WLCG-MON API calls topology profile definition metric results SSB UI

SUM on top of WLCG-MON 6 Dec 2013 Ivan Dzhunov 7

Advantages of using SUM  Migration to WLCG-MON will be transparent for the end user  SUM will serve the same plots and data as it used to do  No UI has to be re-written  Validation of the new system will be much easier  Validate data out of two equivalent systems – “old” and “new” SUM 6 Dec 2013 Ivan Dzhunov 8

Disadvantages of using SUM  Maintain 2 different user interfaces 6 Dec 2013 Ivan Dzhunov 9

Which way do we go ? 6 Dec 2013 Ivan Dzhunov 10

WLCG-MON TODO list …assuming we decide to adopt SUM  SUM side  metric result details and latest results part  Availability plots when site/service downtimes are introduced to WLCG-MON  Profiles definition – currently in static JSON file -> move to DB  Changes in aggregation, SUM actions  Service type flavor mapping  Changes in aggregation?, SUM actions  Site/service downtime handling  Re-computations on aggregated data with SSB “modify metric data” functionality  Validate data  Monthly reports 6 Dec 2013 Ivan Dzhunov 11