Greg Corbett, Adrian Coveney

Slides:

Advertisements

Similar presentations

© 2008 EBSCO Information Services SUSHI, COUNTER and ERM Systems An Update on Usage Standards Ressources électroniques dans les bibliothèques électroniques.

Advertisements

OCLC Online Computer Library Center OCLC Cataloging Update Connexion client 1.50 & more OCLC CJK Users Group Annual Meeting San Francisco, CA April 8,

Paper on Best implemented scientific concept for E-Governance Virtual Machine By Nitin V. Choudhari, DIO,NIC,Akola By Nitin V. Choudhari, DIO,NIC,Akola.

Testing as a Service with HammerCloud Ramón Medrano Llamas CERN, IT-SDC

Web site archiving by capturing all unique responses Kent Fitch, Project Computing Pty Ltd Archiving the Web Conference Information Day National Library.

Lecture 15 – Amazon Network as a Service. Recall IaaS Server as a Service Storage as a Service Network as a Service.

Paper on Best implemented scientific concept for E-Governance projects Virtual Machine By Nitin V. Choudhari, DIO,NIC,Akola.

Cloud Status Laurence Field IT/SDC 09/09/2014. Cloud Date Title 2 SaaS PaaS IaaS VMs on demand.

Presented to: By: Date: Federal Aviation Administration Basic Information About the XASDI Feed A Telcon with Vendors ASDI Vendors and Users FAA 18 May.

MC Strategies 2009 CDS Administrator Roundtable Archiving, Manager Zone, Q&A February 26, 2009.

MDPHnet & ESP Data Partner Participation Overview The following slides describe the necessary steps for a data partner to participate in the MDPHnet Network.

Accounting Update Stuart Pullinger, STFC Scientific Computing Department, APEL Team GDB 10 th December 2014.

Storage Accounting John Gordon, STFC GDB March 2013.

HLRmon accounting portal DGAS (Distributed Grid Accounting System) sensors collect accounting information at site level. Site data are sent to site or.

Commissioning the CERN IT Agile Infrastructure with experiment workloads Ramón Medrano Llamas IT-SDC-OL

Accounting Update John Gordon and Stuart Pullinger January 2014 GDB.

1 Project Priority List (PPL) Update Troy Anderson ERCOT Enterprise Project Portfolio Management January 2011.

APEL Cloud Accounting Status and Plans APEL Team John Gordon.

1 Cloud Services Requirements and Challenges of Large International User Groups Laurence Field IT/SDC 2/12/2014.

HLRmon accounting portal The accounting layout A. Cristofori 1, E. Fattibene 1, L. Gaido 2, P. Veronesi 1 INFN-CNAF Bologna (Italy) 1, INFN-Torino Torino.

Accounting John Gordon WLC Workshop 2016, Lisbon.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Storage Accounting John Gordon, STFC OMB August 2013.

Accounting Update John Gordon. Outline Multicore CPU Accounting Developments Cloud Accounting Storage Accounting Miscellaneous.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI John Gordon EGI Virtualisation and Cloud Workshop Amsterdam 12 th May 2011.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI APEL Regional Accounting Alison Packer (STFC) Iván Díaz Álvarez (CESGA) APEL.

WLCG Resource Reporting 2 Laurence Field Cloud Status Document A few comments received Mainly minor text changes New final version (v1) has been generated.

EPAM Cloud Orchestration

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI MPI VT report OMB Meeting 28 th February 2012.

1 EGI Federated Cloud Architecture Matteo Turilli Senior Research Associate, OeRC, University of Oxford Chair – EGI Federated Clouds Task Force

How to integrate portals with EGI accounting system R.Graciani EGI TF 2012.

GridPP37, Ambleside Adrian Coveney (STFC)

Partner Billing and Reporting

Update on revised HEPiX Contextualization

Deploy Containerized OPNFV Cluster Efficiently Using Daisy Installer

John Gordon STFC OMB 26 July 2011

The New APEL Client Will Rogers, STFC.

WLCG Resources Reporting

David Cameron ATLAS Site Jamboree, 20 Jan 2017

Raw Wallclock in APEL John Gordon, STFC-RAL

JRA1.4 - Account for different resource types

WLCG Accounting Task Force Update Julia Andreeva CERN WLCG Workshop 08

CPU accounting of public cloud resources

Outline Introduction Objectives Motivation Expected Output

Cristina del Cano Novales STFC - RAL

Discussions on group meeting

 Published: October 3, 2016  Languages: English, Spanish, Chinese (Simplified),  Chinese (Traditional), French, German, Japanese, Portuguese (Brazil)

ASPEC May 2016 Incidents 0 incidents, 0 near misses

Exam VCE Questions

Community Aids Reporting System (CARS): Federal Reporting Requirements

Dynamic DNS support for EGI Federated cloud

Content is being revised and updated by Cabrillo Team

CDISC SHARE API v1.0 CAC Update 22 February 2018

ISI Web of Knowledge Early updates

Step 1 Click: “Continue to the Online Permit Center”

New Types of Accounting Beyond CPU

UMD and Operations Vincenzo Spinoso EGI Operations.

VCE IT Theory Slideshows Updated for 2016

DGAS Today and tomorrow

Accounting Repository

Contractor Sourcing Application (CSA) Training

Operations Management Board January 29

Lecture 5: Functions and Parameters

APEL as a Global Accounting Repository

Backfilling the Grid with Containerized BOINC in the ATLAS computing

November 5, th Grade Science

Core Activities re-assessment

User Accounting Integration Spreading the Net.

Status of Cloud Accounting and future plans

Presentation transcript:

Greg Corbett, Adrian Coveney Accounting Update Greg Corbett, Adrian Coveney EGI Federated Cloud Annual Meting – November 2016

Contents New Cloud Accounting Schema Long Running VM Support Summary and a Request

New Cloud Accounting Schema v0.4 of the Cloud Usage Record Contains extra fields for benchmarking, defining clusters within a site, and public IP count Scripts to support this tested for oneacct and caso Clients ready to deploy in production Originally planned to deploy alongside long-running VM support but will now do it separately

Long Running VM Support Current cloud accounting assigns all the usage of a VM to the month it started in (https://accounting-next.egi.eu/cloud/sum_cpu/SITE/DATE/2015/11/2016/11/egi/onlyinfrajobs/) Have a method to process all daily records sent by sites to produce totals for usage by a VM in each month during its lifetime Reprocessing of all old cloud records is very time intensive and we are re-considering the feasibility of this method. Should be achievable but need to improve the efficiency of processing. Current summarising processes the latest record for all VMs back to the start of time. Processing ALL records for ALL VMs may not be achievable.

Summary and a Request Currently working on a revised release that just includes the new v0.4 schema. Aim to release before the end of the year. Long running VM support needs more work and with current effort available, this will not be possible before the end of the year. We would like VMs to report CPU time used. If you have input to Open Nebula or OpenStack development, please request this.