MAGO Monitoring All Grid Objects Anna Jannace 1, Carmine Spizuoco 1, Francesco Adinolfi 1, Giovanni Bracco 2 1- Consorzio Campano per lInformatica e lAutomazione.

Slides:



Advertisements
Similar presentations
INFN & Globus activities Massimo Sgaravatto INFN Padova.
Advertisements

TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.
ICS 434 Advanced Database Systems
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance
8.
GRID workload management system and CMS fall production Massimo Sgaravatto INFN Padova.
Network Management Overview IACT 918 July 2004 Gene Awyzio SITACS University of Wollongong.
Technical Architectures
Workload Management Workpackage Massimo Sgaravatto INFN Padova.
Data Grids: Globus vs SRB. Maturity SRB  Older code base  Widely accepted across multiple communities  Core components are tightly integrated Globus.
Software Frameworks for Acquisition and Control European PhD – 2009 Horácio Fernandes.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 1: Introduction to Windows Server 2003.
GRID Workload Management System Massimo Sgaravatto INFN Padova.
Workload Management Massimo Sgaravatto INFN Padova.
Chapter 9: Moving to Design
Status of Globus activities within INFN (update) Massimo Sgaravatto INFN Padova for the INFN Globus group
Magda – Manager for grid-based data Wensheng Deng Physics Applications Software group Brookhaven National Laboratory.
Evaluation of the Globus GRAM Service Massimo Sgaravatto INFN Padova.
SaaS, PaaS & TaaS By: Raza Usmani
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 1: Introduction to Windows Server 2003.
A centralized system.  Active Directory is Microsoft's trademarked directory service, an integral part of the Windows architecture. Like other directory.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
11 REVIEWING MICROSOFT ACTIVE DIRECTORY CONCEPTS Chapter 1.
IT – DBMS Concepts Relational Database Theory.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Version 4.0. Objectives Describe how networks impact our daily lives. Describe the role of data networking in the human network. Identify the key components.
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
11/16/2012ISC329 Isabelle Bichindaritz1 Web Database Application Development.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting October 10-11, 2002.
Unit – I CLIENT / SERVER ARCHITECTURE. Unit Structure  Evolution of Client/Server Architecture  Client/Server Model  Characteristics of Client/Server.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
And Tier 3 monitoring Tier 3 Ivan Kadochnikov LIT JINR
Copyright © cs-tutorial.com. Overview Introduction Architecture Implementation Evaluation.
Globus Toolkit Massimo Sgaravatto INFN Padova. Massimo Sgaravatto Introduction Grid Services: LHC regional centres need distributed computing Analyze.
CEOS Working Group on Information Systems and Services - 1 Data Services Task Team Discussions on GRID and GRIDftp Stuart Doescher, USGS WGISS-15 May 2003.
Cole David Ronnie Julio. Introduction Globus is A community of users and developers who collaborate on the use and development of open source software,
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
Tier3 monitoring. Initial issues. Danila Oleynik. Artem Petrosyan. JINR.
Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.
Status of Globus activities Massimo Sgaravatto INFN Padova for the INFN Globus group
D.Spiga, L.Servoli, L.Faina INFN & University of Perugia CRAB WorkFlow : CRAB: CMS Remote Analysis Builder A CMS specific tool written in python and developed.
Introduction to Core Database Concepts Getting started with Databases and Structure Query Language (SQL)
Active Directory Domain Services (AD DS). Identity and Access (IDA) – An IDA infrastructure should: Store information about users, groups, computers and.
E-commerce Architecture Ayşe Başar Bener. Client Server Architecture E-commerce is based on client/ server architecture –Client processes requesting service.
Enterprise Architectures
Workload Management Workpackage
Business System Development
By: Raza Usmani SaaS, PaaS & TaaS By: Raza Usmani
StoRM Architecture and Daemons
Accounting at the T1/T2 Sites of the Italian Grid
Study course: “Computing clusters, grids and clouds” Andrey Y. Shevel
CSC 480 Software Engineering
CRESCO Project: Salvatore Raia
CHAPTER 3 Architectures for Distributed Systems
The Improvement of PaaS Platform ZENG Shu-Qing, Xu Jie-Bin 2010 First International Conference on Networking and Distributed Computing SQUARE.
EDT-WP4 monitoring group status report
GSAF Grid Storage Access Framework
University of Technology
GSAF Grid Storage Access Framework
#01 Client/Server Computing
The Globus Toolkit™: Information Services
Module 01 ETICS Overview ETICS Online Tutorials
MAGO Monitoring All Grid Objects
GRID Workload Management System for CMS fall production
#01 Client/Server Computing
Presentation transcript:

MAGO Monitoring All Grid Objects Anna Jannace 1, Carmine Spizuoco 1, Francesco Adinolfi 1, Giovanni Bracco 2 1- Consorzio Campano per lInformatica e lAutomazione Industriale (C.R.I.A.I.) [f.adinolfi, a.jannace, 2- ENEA This poster describes the CRESCO subproject 1.2 MAGO: Monitoring All Grid Objects of CRESCO. This High Performance Computing system was installed to provide the required computing power to the CRESCO project applications and to integrate CRESCO HPC system into ENEA-GRID infrastructure. This project is the result of the collaboration between ENEA and C.R.I.A.I. Consorzio Campano di Ricerca per linformatica e lautomazione industriale. The process of Monitoring & Discovery resources is needed in HPC system to find and solve the malfunctions arising in the infrastructure. MAGO aims to realize an innovative tool to monitor ENEA-Grid resources. The main ENEA-GRID software components are: Multi-site resource manager LSF Multicluster, OpenAFS distributed file system, Kerberos 5 authentication, GUI based on CITRIX technologies. After a technological survey, the Information System model was chosen in according to the GLUE Schema standard ( The study was based on the ENEA Grid infrastructure. Its characteristics imply the choice of Ganglia ( as the core of the monitoring system. The picture describe the monitoring system and its components: MAGO WEB, CORE and DB. One of the peculiarities of the environments is the capability to be decentralized, allowing availability and robustness, also in case of crash involving specific computers. It was chosen in this work to create a centralized and hierarchical structure, because the system monitors Grid resources, but it does not manage them, and because such approach allows to minimize maintenance on single host. MAGO SYSTEM mago.sql Core System MAGO magoupdate.sh MSiteLoader MSiteProvider MMasterLoader Metric Web Application MAGO SignOn MSetup MMonitor Menquiry MAGO Monitoring All Grid Objects INTEGRATION IN ENEA-GRID The set of mature technologies, which belong to the infrastructure ENEA, allows to place MAGO as a tool for monitoring of activities carried out from Grid infrastructure. HIGH LEVEL VIEW Usage of different technologies made it possible to implement a flexible, modular, scalable, fault tolerance monitoring tool. To understand this complexity is important to observe what and how many objects constitute the system, then in which way they interact with each other. WEB Configuration Viewing Alarms Inclusion of new metrics Query on database AFS Container of source code, application, script Saving configurations for each site and host Storing Metrics CORE Decrease of collected metrics by the demons of Gmetad Ganglia MAGO environment automatic installation on Host Information Transfer on the server site Fetch and decoding input metrics MAGO DB Large database containing information about: Configuration Metrics Measurements Subnets Alarms CORE The core of MAGO is a distributed three level based architecture Livello SERVER CENTRALE Mago Core System Livello Server di SITO Livello HOST Direzione Dellinformazione The path shows the information flow from Server Site origin to Master Server destination WEB VIEW The MAGO Web Application has an user interface providing the following features: Configuration of each subsystem Access to the system through a secure connection on a CRESCO front-end host Usage of capabilities provided by AFS and LSF systems already available in ENEA-Grid Capability Robustness Reliability Modularity Scalability Fault tolerance MAGO project extends the functionalities offered by Ganglia package URL APPLICATION http// DOCUMENTATION REFERENCE CRIAI ENEA Summary