WLCG Resources Reporting

Slides:



Advertisements
Similar presentations
Accounting Update Dave Kant Grid Deployment Board Nov 2007.
Advertisements

Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES WLCG operations: communication channels Andrea Sciabà WLCG operations.
Storage Accounting John Gordon, STFC GDB June 2012.
Computing for ILC experiment Computing Research Center, KEK Hiroyuki Matsunaga.
Summary of Accounting Discussion at the GDB in Bologna Dave Kant CCLRC, e-Science Centre.
European Grid Initiative Federated Cloud update Peter solagna Pre-GDB Workshop 10/11/
1 Resource Provisioning Overview Laurence Field 12 April 2015.
Towards a Global Service Registry for the World-Wide LHC Computing Grid Maria ALANDES, Laurence FIELD, Alessandro DI GIROLAMO CERN IT Department CHEP 2013.
GDB March User-Level, VOMS Groups and Roles Dave Kant CCLRC, e-Science Centre.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Wojciech Lapka SAM Team CERN EGEE’09 Conference,
WLCG infrastructure monitoring proposal Pablo Saiz IT/SDC/MI 16 th August 2013.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Global Accounting in the Grid and Cloud John Gordon, STFC HEPiX, Beijing.
Ian Bird, WLCG MB; 27 th October 2015 October 27, 2015
Storage Accounting John Gordon, STFC GDB March 2013.
EMI INFSO-RI Accounting John Gordon (STFC) APEL PT Leader.
Local Job Accounting Cristina del Cano Novales STFC-RAL.
Automatic Resource & Usage Monitoring Steve Traylen/Flavia Donno CERN/IT.
Accounting Update John Gordon and Stuart Pullinger January 2014 GDB.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks John Gordon SA1 Face to Face CERN, June.
APEL Cloud Accounting Status and Plans APEL Team John Gordon.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks APEL CPU Accounting in the EGEE/WLCG infrastructure.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting Old and New Requirements John Gordon Revised 22/3/12.
PIC port d’informació científica EGEE – EGI Transition for WLCG in Spain M. Delfino, G. Merino, PIC Spanish Tier-1 WLCG CB 13-Nov-2009.
LCG WLCG Accounting: Update, Issues, and Plans John Gordon RAL Management Board, 19 December 2006.
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
1 Cloud Services Requirements and Challenges of Large International User Groups Laurence Field IT/SDC 2/12/2014.
HLRmon accounting portal The accounting layout A. Cristofori 1, E. Fattibene 1, L. Gaido 2, P. Veronesi 1 INFN-CNAF Bologna (Italy) 1, INFN-Torino Torino.
Cloud Accounting Survey of current status Andrea Guarise – Bologna- Giornata di studio sul Cloud Computing 6 Febbraio 2013.
Accounting Review Summary from the pre-GDB related to CPU (wallclock) accounting Julia Andreeva CERN-IT GDB 13th April
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Best Practices and Use cases David Bouvet,
APEL Architecture Alison Packer. Overview Grid jobs accounting tool APEL Client software - installed in sites (CEs, gLite- APEL node) APEL Server accepts.
WLCG Accounting Task Force Update Julia Andreeva CERN GDB, 8 th of June,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Storage Accounting John Gordon, STFC OMB August 2013.
Using HLRmon for advanced visualization of resource usage Enrico Fattibene INFN - CNAF ISCG 2010 – Taipei March 11 th, 2010.
John Gordon EMI TF and EGI CF March 2012 Accounting Workshop.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
Storage Accounting John Gordon STFC GDB, Lyon 6 th April2011 GDB January 2012.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI APEL Regional Accounting Alison Packer (STFC) Iván Díaz Álvarez (CESGA) APEL.
WLCG Resource Reporting 2 Laurence Field Cloud Status Document A few comments received Mainly minor text changes New final version (v1) has been generated.
The Grid Information System Maria Alandes Pradillo IT-SDC White Area Lecture, 4th June 2014.
Accounting Review Summary and action list from the (pre)GDB Julia Andreeva CERN-IT WLCG MB 19th April
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI MPI VT report OMB Meeting 28 th February 2012.
WLCG Accounting Task Force Introduction Julia Andreeva CERN 9 th of June,
EMI is partially funded by the European Commission under Grant Agreement RI EMI Status And Plans Laurence Field, CERN Towards an Integrated Information.
Transition to EGI PSC-06 Istanbul Ioannis Liabotis Greece GRNET
HTCondor Accounting Update
GridPP37, Ambleside Adrian Coveney (STFC)
Main objectives To have by the end of August :
Laurence Field IT/SDC Cloud Activity Coordination
John Gordon STFC OMB 26 July 2011
E-GRANT: EGI Resource Allocation Tool Current status
WLCG Accounting Task Force Update Julia Andreeva CERN IT on behalf of the WLCG Accounting Task Force GDB
Benchmarking Changes and Accounting
FedCloud Blueprint Update
Towards an Integrated Information system: the EMI view
Raw Wallclock in APEL John Gordon, STFC-RAL
JRA1.4 - Account for different resource types
Proposal for obtaining installed capacity
WLCG Accounting Task Force Update Julia Andreeva CERN WLCG Workshop 08
APEL Storage Accounting
Outline Introduction Objectives Motivation Expected Output
WLCG dedicated accounting portal (proposal)
Cristina del Cano Novales STFC - RAL
Input on Sustainability
Operations Officer, EGI
New Types of Accounting Beyond CPU
GLOBUS ACCOUNTING USING GRID-SAFE - DEMO
User Accounting Integration Spreading the Net.
Status of Cloud Accounting and future plans
Presentation transcript:

WLCG Resources Reporting Laurence Field

WLCG Resource Reporting Not the same as grid or cloud accounting! But they both have a role to play WLCG is supported by MoUs MoUs represent a commitment to support WLCG Pledges are a renewal of that commitment And the level of that commitment Ensure sufficient resources are in place Report on how those resources were used Cloud usage must therefore also be reported Can not be considered production otherwise

WLCG Resource Reporting Task Force Mission Ensure cloud resource can be reported And hence be counted towards pledges Objectives Gap analysis of current situation Define a plan with a list of actions Follow up on the action list Outputs Analysis and proposal document https://twiki.cern.ch/twiki/pub/ITSDC/WLCGResourceReporting/WLCGResourceReporting-v1.docx Twiki page  https://twiki.cern.ch/twiki/bin/view/ITSDC/WLCGResourceReporting Action List Follow-up

Proposal Build upon the existing APEL cloud accounting work Publisher extracts the required information from the cloud resource Sends the result to the accounting database Includes a HEP-SPEC-06 normalization factor Should be registered as eu.egi.cloud.accounting in the GOCDB Automated monitoring verifies that records are being published EGI Accounting Portal provides an aggregated summary Should be cross-checked with information from the VO OSG resources can send accounting summaries from Gratia Similar to how this is done for Grid resources So far NorduGrid resources are publishing directly using SSM Extend REBUS to include cloud accounting values 5 5

Action List Analysis and proposal document  Publishers available [1]  OpenStack  OpenNebula  Normalization method  Example provided [1]  WLCG view in the EGI Accounting Portal [1]  Extend REBUS to incorporate information from the portal  [1] https://twiki.cern.ch/twiki/bin/view/ITSDC/WLCGResourceReporting [2] http://accounting.egi.eu/cloud_tier2.php 6 6

EGI Accounting Portal –Tier 1

EGI Accounting Portal –Tier 2

Future Work Consumer-side accounting Identify sites wishing to integrate their private cloud And use it offset against their pledge resources Extend REBUS reports to include accounting information From their private cloud Recommend that the task force terminates Integrating sites and validation is an operational activity Consumer-side accounting See next talk! 9 9

Summary Analysis and proposal documented Building upon the existing APEL work Publishers for OpenStack are available New WLCG view in EGI Accounting Portal Some WLCG sites already publishing Identify sites wishing to integrate their private cloud Work with them to update their reports And verify the accuracy of the values produced Recommend that the task force terminates And moves to a more operational footing