Download presentation
Presentation is loading. Please wait.
Published byDerek Cameron Modified over 8 years ago
1
HLRmon accounting portal The accounting layout A. Cristofori 1, E. Fattibene 1, L. Gaido 2, P. Veronesi 1 INFN-CNAF Bologna (Italy) 1, INFN-Torino Torino (Italy) 2 hlrmon-lists@to.infn.ithlrmon-lists@to.infn.it - https://dgas.cnaf.infn.it/hlrmon/ DGAS (Distributed Grid Accounting System) sensors collect accounting information at site level. Site data are sent to site or multi-site HLRs (Home Location Register). A top level HLR receives accounting data from all the Grid HLRs. HLRmon retrieves data from the top level HLR and presents them through a web interface. Aggregated data are also sent to the central EGI Accounting Portal. HLRmon is successfully deployed as accounting portal for IGI and other Grid projects/NGIs using DGAS as accounting system. General purpose CPU reports WLCG reports Different metrics to analyze: CPU and Wall Clock Time, expressed in days and normalized on the mean power capacity of the site Number of executed jobs Job efficiency in terms of (CPU Time / Wall Time) ratio Different keys of data aggregation: Site Virtual Organization VOMS group and role Certification Authority and Registration Authority Job type (Grid or local) Grid user DN An advanced selection menu permits to choose a desired subgroup of values for each aggregation key. A specific view with data grouped per discipline is provided: the mapping information between VOs and disciplines is currently retrieved from the EGI Operations Portal. The charts allow the analysis of CPU and storage resources usage at the WLCG Tier1 and Tier2 by the LHC experiments, over the last month and the last year. The resource usage and the amount of pledged resources are compared. Accounting data are grouped by site and by VO. Storage data are taken by a script running on the sites and sent to HLRmon via email. Architecture Towards complete storage reports HLRmon provides a storage accounting section for WLCG sites and VOs. A more generalized approach, integrated in DGAS, is being developed. Non-standard schema is used to generate records (no standard schema exists). Records are retrieved at sites and stored on the HLRs. HLRmon is able to retrieve storage information directly from the desired HLR. Each record on the HLR has a timeDuration calculated as the difference between two consecutive measurements. HLRmon calculates the daily disk consumption in terms of space-per- hour as the integral of the used space over time. Data are aggregated per site, VO and Storage Area. Collectors retrieve: aggregated CPU accounting information from a desired HLR storage accounting data by probes running on the SRM instances at WLCG sites values of some GLUE attributes about the computing power capacity of the WLCG sites An aggregation layer is responsible for the data manipulation to produce charts and tabular reports visualized by the graphical interface. Data aggregated per Grid user are directly retrieved from the HLR database at run- time and are just accessible by authorized users.
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.