HLRmon accounting portal

Slides:



Advertisements
Similar presentations
29 June 2006 GridSite Andrew McNabwww.gridsite.org VOMS and VOs Andrew McNab University of Manchester.
Advertisements

Sergey Belov, LIT JINR 15 September, NEC’2011, Varna, Bulgaria.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
08/11/908 WP2 e-NMR Grid deployment and operations Technical Review in Brussels, 8 th of December 2008 Marco Verlato.
HPDC 2007 / Grid Infrastructure Monitoring System Based on Nagios Grid Infrastructure Monitoring System Based on Nagios E. Imamagic, D. Dobrenic SRCE HPDC.
Summary of Accounting Discussion at the GDB in Bologna Dave Kant CCLRC, e-Science Centre.
A.Guarise – F.Rosso 1 Enabling Grids for E-sciencE INFSO-RI Comprehensive Accounting Views on large computing farms. Andrea Guarise & Felice Rosso.
GILDA testbed GILDA Certification Authority GILDA Certification Authority User Support and Training Services in IGI IGI Site Administrators IGI Users IGI.
1 1 Service Composition for LHC Computing Grid Monitoring Beob Kyun Kim e-Science Division, KISTI
Cracow Grid Workshop October 2009 Dipl.-Ing. (M.Sc.) Marcus Hilbrich Center for Information Services and High Performance.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks WMSMonitor: a tool to monitor gLite WMS/LB.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The GILDA training infrastructure.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
INFSO-RI Enabling Grids for E-sciencE EGEE is a project funded by the European Union under contract INFSO-RI Grid Accounting.
INFSO-RI Enabling Grids for E-sciencE GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN.
Structural Biology on the GRID Dr. Tsjerk A. Wassenaar Biomolecular NMR - Utrecht University (NL)
HLRmon accounting portal DGAS (Distributed Grid Accounting System) sensors collect accounting information at site level. Site data are sent to site or.
Recent improvements in HLRmon, an accounting portal suitable for national Grids Enrico Fattibene (speaker), Andrea Cristofori, Luciano Gaido, Paolo Veronesi.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
Tier3 monitoring. Initial issues. Danila Oleynik. Artem Petrosyan. JINR.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) The Egyptian Grid Infrastructure Maha Metawei
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks APEL CPU Accounting in the EGEE/WLCG infrastructure.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting Old and New Requirements John Gordon Revised 22/3/12.
LCG WLCG Accounting: Update, Issues, and Plans John Gordon RAL Management Board, 19 December 2006.
Accounting in LCG Dave Kant CCLRC, e-Science Centre.
Automatic testing and certification procedure for IGI products in the EMI era and beyond Sara Bertocco INFN Padova on behalf of IGI Release Team EGI Community.
HLRmon accounting portal The accounting layout A. Cristofori 1, E. Fattibene 1, L. Gaido 2, P. Veronesi 1 INFN-CNAF Bologna (Italy) 1, INFN-Torino Torino.
INFSO-RI Enabling Grids for E-sciencE DGAS, current status & plans Andrea Guarise EGEE JRA1 All Hands Meeting Plzen July 11th, 2006.
Breaking the frontiers of the Grid R. Graciani EGI TF 2012.
1/3/2006 Grid operations: structure and organization Cristina Vistoli INFN CNAF – Bologna - Italy.
OSG Status and Rob Gardner University of Chicago US ATLAS Tier2 Meeting Harvard University, August 17-18, 2006.
INFN/IGI contributions Federated Clouds Task Force F2F meeting November 24, 2011, Amsterdam.
G. Russo, D. Del Prete, S. Pardi Kick Off Meeting - Isola d'Elba, 2011 May 29th–June 01th A proposal for distributed computing monitoring for SuperB G.
Access to the GRID Access by means of an User Interface (UI). It could be: –A dedicated PC, installed in a similar way to the others grid elements –UI.
HLRmon Enrico Fattibene INFN-CNAF 1EGI-TF Lyon, France19-23 September 2011.
DGAS Distributed Grid Accounting System INFN Workshop /05/1009, Palau Giuseppe Patania Andrea Guarise 6/18/20161.
Using HLRmon for advanced visualization of resource usage Enrico Fattibene INFN - CNAF ISCG 2010 – Taipei March 11 th, 2010.
Enabling Grids for E-sciencE INFN Workshop – May 7-11 Rimini 1 Grid Accounting Status at INFN Riccardo Brunetti INFN-TORINO.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Storage Accounting John Gordon STFC GDB, Lyon 6 th April2011 GDB January 2012.
Enabling Grids for E-sciencE Claudio Cherubino INFN DGAS (Distributed Grid Accounting System)
DGAS Accounting – toward national grid infrastructures HPDC workshop on Monitoring, Logging and Accounting, (MLA) in production Grids 10/06/2009, Munich.
Enabling Grids for E-sciencE GridICE: overview and current status Guido Cuscela INFN – Bari Service Challenge Technical Meeting September.
Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.
EGEE is a project funded by the European Union under contract INFSO-RI DGAS Grid accounting L.Gaido on behalf of A.Guarise LCG Workshop November.
WLCG Accounting Task Force Introduction Julia Andreeva CERN 9 th of June,
How to integrate portals with EGI accounting system R.Graciani EGI TF 2012.
Daniele Bonacorsi Andrea Sciabà
Bob Jones EGEE Technical Director
Job monitoring and accounting data visualization
DGAS A.Guarise April 19th, Athens
Regional Operations Centres Core infrastructure Centres
POW MND section.
Grid accounting system
ATLAS support in LCG.
Enrico Fattibene INFN-CNAF
Accounting at the T1/T2 Sites of the Italian Grid
The CCIN2P3 and its role in EGEE/LCG
Giuseppe Patania Nov, Martina Franca (Ta)‏
a VO-oriented perspective
GSAF Grid Storage Access Framework
Monitoring of the infrastructure from the VO perspective
SCL, Institute of Physics Belgrade, Serbia
Danilo Dongiovanni INFN-CNAF
The GENIUS portal and the GILDA t-Infrastructure
DGAS Today and tomorrow
User Accounting Integration Spreading the Net.
The LHCb Computing Data Challenge DC06
Presentation transcript:

HLRmon accounting portal Enrico Fattibene INFN – CNAF enrico.fattibene@cnaf.infn.it hlrmon@lists.infn.it

Motivation Resource usage accounting in Grid is challenging due to the distributed nature of the infrastructure and the heterogeneous nature of the accessed resources necessary for its stakeholders, such as site managers, VO managers, operation centers, etc. Users need to access accounting information at different levels of aggregation an exhaustive and easy to use graphical interface is fundamental many views are needed

HLRmon HLRmon (Home Location Register monitor) is the accounting portal of choice of the Italian National Grid Initiative (NGI): Developed and funded in the framework of the INFN Grid project Based on the Distributed Grid Accounting Service (DGAS) Deployed in production since 2007 Has been customized to meet the WLCG needs: Specific aggregation views for the Tier-1 and Tier-2 sites and the LHC VOs Both CPU and storage accounting https://dgas.cnaf.infn.it/ (requires a valid certificate released by a CA recognized by LCG) Trasformare l’url in un link cliccabile

Why HLRmon? Ready to be deployed on a National Grid for the implementation of a stand-alone accounting infrastructure Highly customizable views Visualization of data at different levels of aggregation site, VO, CA, VOMS role, job type (Grid vs local) Visualization of CPU and Wall Time normalized by different benchmarks WLCG views which integrate data retrieved by the gLite Information System and storage accounting data Customizable for a desired set of sites and VOs

HLRmon accounting portal Is based on the DGAS accounting system Provides a complete section on CPU accounting reports Offers a fine granularity of data aggregation Allows a role-based investigation of Grid user jobs Includes customized WLCG views with CPU and storage accounting information Is successfully deployed as accounting portal for National Grids

DGAS + HLRmon DGAS sensors collect accounting information at site level Site data are sent to site or multi-site HLRs (Home Location Register) A top level HLR receives accounting data from all the Grid HLRs The HLRmon server retrieves data from the top level HLR and present them through a web interface National Grid HLRmon Top-level HLR Site A Multi-site HLR Site HLR (DGAS server) Site B Site B Computing Element Computing Element Computing Element DGAS sensors DGAS sensors DGAS sensors DGAS sensors

Visit HLRmon for Italian Grid Infrastructure https://dgas.cnaf.infn.it/hlrmon/report/charts.php (a personal certificate in the browser is required) Enrico Fattibene INFN – CNAF enrico.fattibene@cnaf.infn.it hlrmon@lists.infn.it 7