Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE www.egi.eu EGI-InSPIRE RI-261323 John Gordon EGI Virtualisation and Cloud Workshop Amsterdam 12 th May 2011.

Slides:



Advertisements
Similar presentations
Cloud Computing Mick Watson Director of ARK-Genomics The Roslin Institute.
Advertisements

SLA-Oriented Resource Provisioning for Cloud Computing
HEPiX Virtualisation Working Group Status, July 9 th 2010
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INSFO-RI Ioannis Konstantinou Greek.
An Approach to Secure Cloud Computing Architectures By Y. Serge Joseph FAU security Group February 24th, 2011.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI - Identity Management Steven Newhouse Director, EGI.eu Federated Identity.
Tier-1 experience with provisioning virtualised worker nodes on demand Andrew Lahiff, Ian Collier STFC Rutherford Appleton Laboratory, Harwell Oxford,
Storage Accounting John Gordon, STFC GDB June 2012.
Chapter 3: Operating-System Structures System Components Operating System Services System Calls System Programs System Structure Virtual Machines System.
EGI-InSPIRE RI EGI-InSPIRE RI EGI-InSPIRE EGI services for the long tail of science Peter Solagna Senior Operations.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Future support of EGI services Tiziana Ferrari/EGI.eu Future support of EGI.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI GPGPU Accounting John Gordon STFC 09/04/2013 EGI CF – Accounting and Billing1.
Ian Alderman A Little History…
Cloud Use Cases, Required Standards, and Roadmaps Excerpts From Cloud Computing Use Cases White Paper
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Vision for European DCIs Steven Newhouse Project Director, EGI-InSPIRE 15/09/2010.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Federated Cloud F2F Security Issues in the cloud Introduction Linda Cornwall,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI (Present and) Future of the EGI Services for WLCG Peter Solagna – EGI.eu.
EMI INFSO-RI Accounting John Gordon (STFC) APEL PT Leader.
Cloud Computing is a Nebulous Subject Or how I learned to love VDF on Amazon.
Accounting Update John Gordon and Stuart Pullinger January 2014 GDB.
APEL Cloud Accounting Status and Plans APEL Team John Gordon.
EGI-InSPIRE RI EGI EGI-InSPIRE RI Service Operations Security Policy the new generalised site operations security policy.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI SPG future work EGI Technical Forum Lyon, 21 Sep 2011 David Kelsey, STFC/RAL.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI VM Management Chair: Alexander Papaspyrou 2/25/
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Evolution of AAI for e- infrastructures Peter Solagna Senior Operations Manager.
1 Cloud Services Requirements and Challenges of Large International User Groups Laurence Field IT/SDC 2/12/2014.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI-InSPIRE APEL for Accounting John Gordon, Stuart Pullinger STFC.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Draft Security Virtualisation Policy (for Romain Wartel – CERN) EGI Technical.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting Requirements Stuart Pullinger STFC 09/04/2013 EGI CF – Accounting.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI CERN and HelixNebula, the Science Cloud Fernando Barreiro Megino (CERN IT)
Accounting John Gordon WLC Workshop 2016, Lisbon.
EGI-InSPIRE RI SPG Tasks for Year 2011 Jan 2011 Kelsey/Security Policy Group1.
Unit 2 VIRTUALISATION. Unit 2 - Syllabus Basics of Virtualization Types of Virtualization Implementation Levels of Virtualization Virtualization Structures.
© 2012 Eucalyptus Systems, Inc. Cloud Computing Introduction Eucalyptus Education Services 2.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Questionnaires to Cloud technology providers and sites Linda Cornwall, STFC,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Storage Accounting John Gordon, STFC OMB August 2013.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Technology Sustainability Discussion Points DCI Sustainability Meeting.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting Requirements Stuart Pullinger STFC 09/04/2013 EGI CF – Accounting.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
EGI-Engage EGI Webinar - Introduction - Gergely Sipos EGI.eu / MTA SZTAKI 6/26/
EGI-InSPIRE EGI-InSPIRE RI The European Grid Infrastructure Steven Newhouse Director, EGI.eu Project Director, EGI-InSPIRE 29/06/2016CoreGrid.
Storage Accounting John Gordon STFC GDB, Lyon 6 th April2011 GDB January 2012.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI John Gordon EGI Virtualisation and Cloud Workshop Amsterdam 13 th May 2011.
Enabling Grids for E-sciencE Claudio Cherubino INFN DGAS (Distributed Grid Accounting System)
EGI-InSPIRE RI EGI Compute and Data Services for Open Access in H2020 Tiziana Ferrari Technical Director, EGI.eu
RI EGI-InSPIRE RI Pre-OMB meeting Preparation for the Workshop “EGI towards H2020” NGI_UK John Gordon and.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Session Intro and Pay-for-Use Overview Sy Holsinger Senior Strategy and.
HEPiX Virtualisation working group Andrea Chierici INFN-CNAF Workshop CCR 2010.
EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.
Ian Bird, CERN WLCG Project Leader Amsterdam, 24 th January 2012.
1 EGI Federated Cloud Architecture Matteo Turilli Senior Research Associate, OeRC, University of Oxford Chair – EGI Federated Clouds Task Force
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Role and Challenges of the Resource Centre in the EGI Ecosystem Tiziana Ferrari,
J. Templon Nikhef Amsterdam Physics Data Processing Group Monitoring Session Summary EGI Virtualization Workshop May, Amsterdam Thanks to all the.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Scientific Publications Repository
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Information Services et al. Standup Chair: Morris Riedel With thanks to Sergio.
How to integrate portals with EGI accounting system R.Graciani EGI TF 2012.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI SVG F2F Virtual Machines VM images, software run on VMS. 3 rd March 2015.
Evolution of storage and data management
John Gordon STFC OMB 26 July 2011
Amazon Instance Purchasing Options
Linked Challenges Virtualisation has a key role to play….
Monitoring Session Intro
WLCG Collaboration Workshop;
1. 2 VIRTUAL MACHINES By: Satya Prasanna Mallick Reg.No
3.2 Virtualisation.
OS Virtualization.
Public vs Private Cloud Usage Costs:
New Types of Accounting Beyond CPU
Cloud Computing Architecture
Traditional Virtualized Infrastructure
Presentation transcript:

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI John Gordon EGI Virtualisation and Cloud Workshop Amsterdam 12 th May Accounting Breakout

EGI-InSPIRE RI

EGI-InSPIRE RI My View My high level view of cloud accounting can be summarised as:- 1.Accounting for work done in a virtual machine can be done by traditional methods. – as long as you make sure any logging you need is persistent beyond the end of the VM. –I don’t think we need to spend much, if any, time of this today. 2.Accounting for the use of a VM instance is similar to that of a job, in that the resource you are accounting has a defined lifetime like a job and most of the resources you would account on like cpu, memory, i/o, networking, were foreseen in the OGF UR even though no-one has actually implemented them all yet (AFAIK). –Extend PGF UR? 3.Both the above need to be done but one risks double billing. –Eg both the VM owner and end user get charged

EGI-InSPIRE RI software, standards, use, gaps, issues 4

EGI-InSPIRE RI Software EGI has infrastructure in place to collect accounting records Hypervisors keep logs Amazon etc produce bills Other projects? –FLESSR 5

EGI-InSPIRE RI Features and requirements Accounting for VM –Are a VM accountable like a job? –For VM (e.g services) running for months you don’t want to wait for the shut down of the machine (as for grid jobs) to bill for it. You need intermediate bills (e.g. weekly) for that VM usage. –If you account for a VM you account for all the time (with all the cores) the machine runs, either if it is idle or not Accounting for storage –Accounting for a service more than the usage of the disk space. The persistence storage is reserved also after the VM is shut down –Currently there is no usage record for storage, as soon as it is available it could be used for both virtual and physical storage usage.

EGI-InSPIRE RI Standards Start from the OGF current standard: Usage Record –Extend the current standards to account virtual resources Standards for network accounting? –Account for reservation of resources and for actual usage 7

EGI-InSPIRE RI Use Account the actual CPU power available for the VM. That is what the user gets. The provisioning of a instance defines the major part of the accounting, not the actual usage 8

EGI-InSPIRE RI Gaps VM usage record Storage accounting Network accounting –Currently wrap into the job accounting Data usage accounting –# of I/O operations (who’s billed?) 9

EGI-InSPIRE RI Issues Identity management Normalization Billing Fairness and capacity (out of scope) Agreements and policies 10