JRA1.4 - Account for different resource types

Slides:

Advertisements

Similar presentations

Storage Accounting John Gordon, STFC GDB June 2012.

Advertisements

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI GPGPU Accounting John Gordon STFC 09/04/2013 EGI CF – Accounting and Billing1.

SRM 2.2: status of the implementations and GSSD 6 th March 2007 Flavia Donno, Maarten Litmaath INFN and IT/GD, CERN.

EMI INFSO-RI EMI Structure, Plans, Deliverables Alberto Di Meglio (CERN) Project Director ATLAS Software & Computing Week Geneva, 21 July 2011.

MW Readiness WG Update Andrea Manzi Maria Dimou Lionel Cons 10/12/2014.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Global Accounting in the Grid and Cloud John Gordon, STFC HEPiX, Beijing.

Storage Accounting John Gordon, STFC GDB March 2013.

EMI INFSO-RI Accounting John Gordon (STFC) APEL PT Leader.

Accounting Update John Gordon and Stuart Pullinger January 2014 GDB.

Accounting non-Grid Use John Gordon Management Board 7/6/2007.

APEL Cloud Accounting Status and Plans APEL Team John Gordon.

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks APEL CPU Accounting in the EGEE/WLCG infrastructure.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting Old and New Requirements John Gordon Revised 22/3/12.

Accounting For Multicore Jobs John Gordon, STFC, UK Scientific Computing Department, APEL Team MB 17 th March 2015.

LCG WLCG Accounting: Update, Issues, and Plans John Gordon RAL Management Board, 19 December 2006.

LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.

LCG User Level Accounting John Gordon CCLRC-RAL LCG Grid Deployment Board October 2006.

CERN - IT Department CH-1211 Genève 23 Switzerland t Service Infrastructure EMI Kickoff Meeting.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI-InSPIRE APEL for Accounting John Gordon, Stuart Pullinger STFC.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting Requirements Stuart Pullinger STFC 09/04/2013 EGI CF – Accounting.

Cloud Accounting Survey of current status Andrea Guarise – Bologna- Giornata di studio sul Cloud Computing 6 Febbraio 2013.

The HEPiX IPv6 Working Group David Kelsey (STFC-RAL) EGI OMB 19 Dec 2013.

APEL Architecture Alison Packer. Overview Grid jobs accounting tool APEL Client software - installed in sites (CEs, gLite- APEL node) APEL Server accepts.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Storage Accounting John Gordon, STFC OMB August 2013.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI GLUE 2: Deployment and Validation Stephen Burke egi.eu EGI OMB March 26 th.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting Requirements Stuart Pullinger STFC 09/04/2013 EGI CF – Accounting.

LCG Accounting Update John Gordon, CCLRC-RAL 10/1/2007.

EMI is partially funded by the European Commission under Grant Agreement RI EMI Outlook and Open Source Activities Alberto DI MEGLIO, CERN Project.

John Gordon EMI TF and EGI CF March 2012 Accounting Workshop.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.

Accounting Update John Gordon. Outline Multicore CPU Accounting Developments Cloud Accounting Storage Accounting Miscellaneous.

Storage Accounting John Gordon STFC GDB, Lyon 6 th April2011 GDB January 2012.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI John Gordon EGI Virtualisation and Cloud Workshop Amsterdam 13 th May 2011.

Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI APEL Regional Accounting Alison Packer (STFC) Iván Díaz Álvarez (CESGA) APEL.

EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number Federated Cloud Update.

Accounting Review Summary and action list from the (pre)GDB Julia Andreeva CERN-IT WLCG MB 19th April

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI MPI VT report OMB Meeting 28 th February 2012.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting task force T. Ferrari/EGI.eu Accounting task force/TCB meeting.

HTCondor Accounting Update

HTCondor Accounting Update

GridPP37, Ambleside Adrian Coveney (STFC)

John Gordon STFC OMB 26 July 2011

The New APEL Client Will Rogers, STFC.

WLCG Resources Reporting

WLCG Accounting Task Force Update Julia Andreeva CERN IT on behalf of the WLCG Accounting Task Force GDB

Benchmarking Changes and Accounting

Plans to support IPv6-only CPU on WLCG

Towards an Integrated Information system: the EMI view

Raw Wallclock in APEL John Gordon, STFC-RAL

Proposal for obtaining installed capacity

Accounting Requirements

T-StoRM: a StoRM testing framework

Update from the HEPiX IPv6 WG

APEL Storage Accounting

Outline Introduction Objectives Motivation Expected Output

Infrastructure Area EMI All Hands Summary.

EMI: dal Produttore al Consumatore

WLCG and support for IPv6-only CPU

John Gordon (STFC) APEL PT Leader

IPv6 transition Vincenzo Spinoso EGI Operations.

New Types of Accounting Beyond CPU

Accounting Repository

UMD 2 Decommissioning Status

UMD 2 Decommissioning Status

APEL as a Global Accounting Repository

Greg Corbett, Adrian Coveney

JRA1.4 New Types of Accounting

IPv6 update Duncan Rand Imperial College London

User Accounting Integration Spreading the Net.

Presentation transcript:

JRA1.4 - Account for different resource types John Gordon, Alison Packer, Will Rogers STFC Inspire JRA1 Meeting 25-OCT-2012

Inspire JRA1 Meeting 25-OCT-2012 Types of Accounting CPU Cloud Storage Parallel jobs Bandwidth Application Inspire JRA1 Meeting 25-OCT-2012

Inspire JRA1 Meeting 25-OCT-2012 CPU Accounting External Clients migrated to using new APEL System: OSG/gratia INFN/DGAS NDGF, CH (sites are UNIBE-LHEP, UNIBE-ID & UNIGE-DPNC)/SGAS One external client left on old system, IN2P3, who will work on migration in November (personnel changes have affected completion of this work) Inspire JRA1 Meeting 25-OCT-2012

Inspire JRA1 Meeting 25-OCT-2012 CPU Accounting contd. Other new clients: IGE/GridSafe – testing successful QosCoSGrid/MAPPER – testing EDGI – have a plan, awaiting testing UNICORE – successfully tested, implementing new SSM protocol New version of CAR work in progress to resolve acceptable DN format, John Gordon presented CAR profile to OMB http://bit.ly/Nppvrp New client will support local job accounting Inspire JRA1 Meeting 25-OCT-2012

Inspire JRA1 Meeting 25-OCT-2012 MPI Accounting collection agreed, defined in CAR EMI-3 client to be deployed in 2013 will include this Visualisation under discussion Inspire JRA1 Meeting 25-OCT-2012

Inspire JRA1 Meeting 25-OCT-2012 Storage Accounting StAR agreed, John Gordon presented StAR profile http://bit.ly/PoYu3x to OMB http://bit.ly/Nppvrp STFC database ready, SSM deployed to receive StAR from dcache, StoRM, DPM, one client testing INFN will investigate using their current storage accounting system which harvests data from the BDII to publish StAR records to APEL using SSM for other systems Visualisation to be agreed Inspire JRA1 Meeting 25-OCT-2012

Inspire JRA1 Meeting 25-OCT-2012 Cloud Accounting VM prototype in use on EGI Testbed – 7 clients sending records (OpenNebula & Openstack) Visualisation to be agreed INFN to assist publishing cloud accounting records from other resource providers, initially start investigating a solution for WNoDeS but will also contact the Okeanos team to check their status. Inspire JRA1 Meeting 25-OCT-2012

Bandwidth, Application Needs detailed requirements, requested of Tier1s and EU-DAT, none received yet. Application No update Inspire JRA1 Meeting 25-OCT-2012