Www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE www.egi.eu EGI-InSPIRE RI-261323 Accounting Requirements Stuart Pullinger STFC 09/04/2013 EGI CF – Accounting.

Slides:



Advertisements
Similar presentations
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Security Policy Group Summary EGI TF David Kelsey 6/28/
Advertisements

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Unified Middleware Distribution (UMD): SW provisioning to EGI Mario David.
EGI: SA1 Operations John Gordon EGEE09 Barcelona September 2009.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EG recent developments T. Ferrari/EGI.eu ADC Weekly Meeting 15/05/
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI GPGPU Accounting John Gordon STFC 09/04/2013 EGI CF – Accounting and Billing1.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Enforcement of the personal data retention policy Peter Solagna, EGI.eu WLCG.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI (Present and) Future of the EGI Services for WLCG Peter Solagna – EGI.eu.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Global Accounting in the Grid and Cloud John Gordon, STFC HEPiX, Beijing.
Storage Accounting John Gordon, STFC GDB March 2013.
EMI INFSO-RI Accounting John Gordon (STFC) APEL PT Leader.
Accounting Update John Gordon and Stuart Pullinger January 2014 GDB.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.
APEL Cloud Accounting Status and Plans APEL Team John Gordon.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks APEL CPU Accounting in the EGEE/WLCG infrastructure.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting Old and New Requirements John Gordon Revised 22/3/12.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Monitoring of the LHC Computing Activities Key Results from the Services.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI SPG future work EGI Technical Forum Lyon, 21 Sep 2011 David Kelsey, STFC/RAL.
Accounting For Multicore Jobs John Gordon, STFC, UK Scientific Computing Department, APEL Team MB 17 th March 2015.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Ops Portal New Requirements.
LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI-InSPIRE APEL for Accounting John Gordon, Stuart Pullinger STFC.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Grid Oversight in Service Level Agreement environment Małgorzata Krakowian,
RI EGI-InSPIRE RI UMD 2 Decommissioning Status Cristina Aiftimiei EGI.eu.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Requirements Status EGI.eu UCB
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting Requirements Stuart Pullinger STFC 09/04/2013 EGI CF – Accounting.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI TS8.10 A new approach to Computing Availability/Reliability reports for EGI.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Operations Portal Development Update on Requirements Cyril L'Orphelin IN2P3/CNRS.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI VOMS Proxy Lifetime UCB 21 Aug 2012 David Kelsey STFC.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI UMD Roadmap Steven Newhouse 14/09/2010.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Training Marketplace Claire Devereux STFC, UK
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Resource allocation Małgorzata Krakowian 1.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Regionalisation summary Prague 1.
APEL Architecture Alison Packer. Overview Grid jobs accounting tool APEL Client software - installed in sites (CEs, gLite- APEL node) APEL Server accepts.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Storage Accounting John Gordon, STFC OMB August 2013.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI GLUE 2: Deployment and Validation Stephen Burke egi.eu EGI OMB March 26 th.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Technology Sustainability Discussion Points DCI Sustainability Meeting.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Resource allocation brainstorming space
John Gordon EMI TF and EGI CF March 2012 Accounting Workshop.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Update on Service Availability Monitoring (SAM) Marian Babik, David Collados,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Regional tools use cases overview Peter Solagna – EGI.eu On behalf of the.
Accounting Update John Gordon. Outline Multicore CPU Accounting Developments Cloud Accounting Storage Accounting Miscellaneous.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI A pan-European Research Infrastructure supporting the digital European Research.
RI EGI-InSPIRE RI Puppet community Next steps Peter Solagna – EGI.eu.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI John Gordon EGI Virtualisation and Cloud Workshop Amsterdam 12 th May 2011.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI APEL Regional Accounting Alison Packer (STFC) Iván Díaz Álvarez (CESGA) APEL.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Operations Portal OTAG September, 21th 2011 Cyril L’Orphelin – CCIN2P3/CNRS.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI-Engage Accounting Portal contribution Iván Díaz 2014/06/05.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI MPI VT report OMB Meeting 28 th February 2012.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI SA1.2 Plans 2013 Security Operations David Kelsey (STFC) 26/02/2013 Operations.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Globus Integration Task Force Meeting Gert Svensson, PDC, KTH 10/2/2016 Lyon,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting task force T. Ferrari/EGI.eu Accounting task force/TCB meeting.
RI EGI-InSPIRE RI Operations Portal Lightweight Release Process Cristina Aiftimiei EGI.eu.
Transition to EGI PSC-06 Istanbul Ioannis Liabotis Greece GRNET
John Gordon STFC OMB 26 July 2011
The New APEL Client Will Rogers, STFC.
Benchmarking Changes and Accounting
Raw Wallclock in APEL John Gordon, STFC-RAL
JRA1.4 - Account for different resource types
Accounting Requirements
Maite Barroso, SA1 activity leader CERN 27th January 2009
APEL Storage Accounting
Outline Introduction Objectives Motivation Expected Output
John Gordon (STFC) APEL PT Leader
New Types of Accounting Beyond CPU
UMD 2 Decommissioning Status
UMD 2 Decommissioning Status
APEL as a Global Accounting Repository
JRA1.4 New Types of Accounting
User Accounting Integration Spreading the Net.
Presentation transcript:

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Accounting Requirements Stuart Pullinger STFC 09/04/2013 EGI CF – Accounting and Billing1

EGI-InSPIRE RI RT for Accounting 2699 Globus middleware publishes accounting data 2722 security policy on accounting data 2798 Regional Accounting Repo: Keep local the accounting data for specific regional VOs 3269 APEL bzip2 support for SGE accounting records 3327 Support for local jobs in the accounting system 3328 Accounting of parallel and multi-core jobs 3495 Requirement for bandwidth accounting 3771 More fine-grained HS06 calculation in APEL 4005 Follow ENVRI and data accounting 4532 Accounting of failed jobs 4538 Organize the working group to analyze and create requirements for visualizing all new types of accounting 5042 Publishing of accounting data by APEL central db 5551 Regional Accounting Repo - Testing phase 6047 Storage Accounting Summaries to Accounting Portal 6191 MPI Accounting: Summaries to Accounting Portal 20/09/2011 Business Models & Sustainability – EGI TF Lyon - Sept

EGI-InSPIRE RI Globus middleware publishes accounting data Testing successful. Asked for a few tweaks. Developer left. New one getting up to speed. 20/09/2011 Business Models & Sustainability – EGI TF Lyon - Sept

EGI-InSPIRE RI security policy on accounting data This ticket seems to have been hijacked from the original for user support statistics A lot of what was asked for was delivered as part of the VT on the NGI Report. Can the requestor please review? 20/09/2011 Business Models & Sustainability – EGI TF Lyon - Sept

EGI-InSPIRE RI Regional Accounting Repo: Keep local the accounting data for specific regional VOs Done The regional accounting portal can filter on VOs just like the APEL client. All under the control of the NGI Manager (and the site manager for what gets published from the site) The VO doesn’t have control. Just like it doesn’t currently for sites publishing. 20/09/2011 Business Models & Sustainability – EGI TF Lyon - Sept

EGI-InSPIRE RI Support for local jobs in the accounting system Done APEL client in EMI3 supports this. All under the control of the Site Manager The VO doesn’t have control. Just like it doesn’t currently for sites publishing grid jobs. 20/09/2011 Business Models & Sustainability – EGI TF Lyon - Sept

EGI-InSPIRE RI Accounting of parallel and multi-core jobs Implemented in EMI3 version of APEL client. Not yet published to accounting portal Have given portal a sample of data to allow them to develop views. 20/09/2011 Business Models & Sustainability – EGI TF Lyon - Sept

EGI-InSPIRE RI Regional Accounting Repo - Testing phase Taiwan and South Africa tested. SA moving to production. 20/09/2011 Business Models & Sustainability – EGI TF Lyon - Sept

EGI-InSPIRE RI Regional Accounting Repo - Testing phase Taiwan and South Africa tested. SA moving to production. 20/09/2011 Business Models & Sustainability – EGI TF Lyon - Sept

EGI-InSPIRE RI OMB Action: publishing of accounting data by APEL central db The technology for this was developed as part of the Regional Accounting Repository It is being deployed to send data to the Accounting Portal Publishing to other places will come after the portal. 20/09/2011 Business Models & Sustainability – EGI TF Lyon - Sept

EGI-InSPIRE RI Regional Accounting Repo - Testing phase Taiwan and South Africa tested. SA moving to production. 20/09/2011 Business Models & Sustainability – EGI TF Lyon - Sept

EGI-InSPIRE RI Storage Accounting Summaries to Accounting Portal Plan is to send all storage records to portal to allow them to test views before we firm up the form of the summary. Will dump sample records to allow portal to start development. Sample data given to portal to develop views 20/09/2011 Business Models & Sustainability – EGI TF Lyon - Sept

EGI-InSPIRE RI MPI Accounting: Summaries to Accounting Portal MPI Summaries are currently created in repo. Will not be available in production summary stream until database migration. Will start message stream of MPI only summaries to portal to allow their development to start. Sample data has been sent to portal for development of views 20/09/2011 Business Models & Sustainability – EGI TF Lyon - Sept