LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006.

Slides:



Advertisements
Similar presentations
LCG WLCG Operations John Gordon, CCLRC GridPP18 Glasgow 21 March 2007.
Advertisements

Accounting Update Dave Kant Grid Deployment Board Nov 2007.
Stefano Belforte INFN Trieste 1 CMS SC4 etc. July 5, 2006 CMS Service Challenge 4 and beyond.
Storage Accounting John Gordon, STFC GDB June 2012.
Dave Kant Grid Monitoring and Accounting Dave Kant CCLRC e-Science Centre, UK HEPiX at Brookhaven 18 th – 22 nd Oct 2004.
BINP/GCF Status Report BINP LCG Site Registration Oct 2009
Summary of Accounting Discussion at the GDB in Bologna Dave Kant CCLRC, e-Science Centre.
LCG Introduction John Gordon, SFTC GDB December 2 nd 2009.
JSPG: User-level Accounting Data Policy David Kelsey, CCLRC/RAL, UK LCG GDB Meeting, Rome, 5 April 2006.
1 1 Service Composition for LHC Computing Grid Monitoring Beob Kyun Kim e-Science Division, KISTI
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Kelsey RAL/STFC,
Accounting in LCG Dave Kant CCLRC, e-Science Centre.
Multicore Accounting John Gordon, STFC-RAL WLCG MB, July 2015.
GDB March User-Level, VOMS Groups and Roles Dave Kant CCLRC, e-Science Centre.
Tony Doyle - University of Glasgow 8 July 2005Collaboration Board Meeting GridPP Report Tony Doyle.
INFSO-RI Enabling Grids for E-sciencE Enabling Grids for E-sciencE Pre-GDB Storage Classes summary of discussions Flavia Donno Pre-GDB.
Ian Bird LCG Project Leader WLCG Collaboration Issues WLCG Collaboration Board 24 th April 2008.
LCG Storage Accounting John Gordon CCLRC – RAL LCG Grid Deployment Board September 2006.
LCG Accounting John Gordon Grid Deployment Board 13 th January 2004.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks DSA1.4 – Objectives and Status Ioannis Liabotis.
Storage Accounting John Gordon, STFC GDB March 2013.
Local Job Accounting Cristina del Cano Novales STFC-RAL.
Automatic Resource & Usage Monitoring Steve Traylen/Flavia Donno CERN/IT.
Jan 2010 OSG Update Grid Deployment Board, Feb 10 th 2010 Now having daily attendance at the WLCG daily operations meeting. Helping in ensuring tickets.
Site Manageability & Monitoring Issues for LCG Ian Bird IT Department, CERN LCG MB 24 th October 2006.
LCG Support for Pilot Jobs John Gordon, STFC GDB December 2 nd 2009.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks John Gordon SA1 Face to Face CERN, June.
Accounting non-Grid Use John Gordon Management Board 7/6/2007.
LCG Pilot Jobs and glexec John Gordon.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks APEL CPU Accounting in the EGEE/WLCG infrastructure.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Communication tools between Grid Virtual.
DJ: WLCG CB – 25 January WLCG Overview Board Activities in the first year Full details (reports/overheads/minutes) are at:
Accounting For Multicore Jobs John Gordon, STFC, UK Scientific Computing Department, APEL Team MB 17 th March 2015.
LCG WLCG Accounting: Update, Issues, and Plans John Gordon RAL Management Board, 19 December 2006.
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
EGEE is a project funded by the European Union under contract IST Roles & Responsibilities Ian Bird SA1 Manager Cork Meeting, April 2004.
LCG User Level Accounting John Gordon CCLRC-RAL LCG Grid Deployment Board October 2006.
LCG Service Challenges SC2 Goals Jamie Shiers, CERN-IT-GD 24 February 2005.
Accounting in LCG/EGEE Can We Gauge Grid Usage via RBs? Dave Kant CCLRC, e-Science Centre.
LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team Kickoff Meeting.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Ian Bird All Activity Meeting, Sofia
Enabling Grids for E-sciencE CMS/ARDA activity within the CMS distributed system Julia Andreeva, CERN On behalf of ARDA group CHEP06.
LCG Issues from GDB John Gordon, STFC WLCG MB meeting September 28 th 2010.
INFSO-RI Enabling Grids for E-sciencE DGAS, current status & plans Andrea Guarise EGEE JRA1 All Hands Meeting Plzen July 11th, 2006.
LHCC Referees Meeting – 28 June LCG-2 Data Management Planning Ian Bird LHCC Referees Meeting 28 th June 2004.
LCG Pilot Jobs + glexec John Gordon, STFC-RAL GDB 7 December 2007.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operations: Evolution of the Role of.
John Gordon Grid Accounting Update John Gordon (for Dave Kant) CCLRC e-Science Centre, UK LCG Grid Deployment Board NIKHEF, October.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
EGEE is a project funded by the European Union under contract IST Issues from current Experience SA1 Feedback to JRA1 A. Pacheco PIC Barcelona.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Accounting Portal Pablo Rey, Javier Lopez.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid is a Bazaar of Resource Providers and.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Storage Accounting John Gordon, STFC OMB August 2013.
INFSO-RI Enabling Grids for E-sciencE EGEE general project update Fotis Karayannis EGEE South East Europe Project Management Board.
LCG Accounting Update John Gordon, CCLRC-RAL 10/1/2007.
LCG Introduction John Gordon, STFC-RAL GDB June 11 th, 2008.
LCG Introduction John Gordon, STFC-RAL GDB November 7th, 2007.
Accounting Update Dave Kant, John Gordon RAL Javier Lopez, Pablo Rey Mayo CESGA.
LCG Introduction John Gordon, STFC GDB December 7 th 2010.
18/12/03PPD Christmas Lectures 2003 Grid in the Department A Guide for the Uninvolved PPD Computing Group Christmas Lecture 2003 Chris Brew.
James Casey, CERN IT-GD WLCG Workshop 1st September, 2007
Communication, Communication, Communication
Regional Operations Centres Core infrastructure Centres
Benchmarking Changes and Accounting
John Gordon, STFC-RAL GDB 10 October 2007
Proposal for obtaining installed capacity
Collaboration Board Meeting
User Accounting Integration Spreading the Net.
Presentation transcript:

LCG Accounting Reporting Update John Gordon, CCLRC LCG Grid Deployment Board 5 th April 2006

LCG John Gordon – GDB 5 April06 Tier1 Reporting

LCG John Gordon – GDB 5 April06 Background  On 22 nd February I sent a list of sites who were not publishing accounting to:-  MB  GDB  EGEE ROC Managers  I asked them to:- a) check the list for sites in your country or supported by your Tier1/ROC. I think these should be obvious but if anyone has problems, let me know. b) approach these sites and ask why they are not publishing and report the reason back to me. I will collate the replies. If you consider that they will not be contributing to LHC computing then that is a valid reason for the MB but they may be hearing from EGEE. c) make them aware of the LCG policy agreed by the last MB that everyone should publish regular accounts for their LHC VOs by some method (as discussed during my MB Accounting talk) d) if there are legal or security arguments why they cannot publish, please highlight this so that we can get a working group investigating the implications. e) get an estimate from them of when they can start publishing.  Very few replies (none on policies or legal issues)  ~72 sites not publishing in last 3 months cf ~150 who have published at all

LCG John Gordon – GDB 5 April06 21 February 2006 RegionSite Name AsiaPacific GOG-Singapore Taiwan-IPAS-LCG2 Taiwan-NCUCC-LCG2 TOKYO-LCG2 TW- NCUHEP CentralEurope BUDAPEST CYFRONET-IA64 egee.man.poznan.pl GUP-JKU SiGNET WARSAW- EGEE CERN ALBERTA-LCG2 BEIJING-CNIC-LCG2-IA64 BEIJING-LCG2 BNL-LCG2 CARLETONU-LCG2 CERN-CIC CERN HPBR-LCG2 HPTC-LCG2ia64 NCP-LCG2 PAkGrid-LCG2SDU-LCG2 TORONTO- LCG2 TRIUMF-GC-LCG2 UIOWA-LCG2 FranceCGG-LCG2 IN2P3-SUBATECH IN2P3-LAPP GermanySwitzerlandEkplcg2 GSI-LCG2 ITWM ItalyINFN-BOLOGNA-CMS INFN-CATANIA INFN-LNL-2 INFN-MILANO ItalyINFN-NAPOLI INFN-PADOVA INFN-PISA2 INFN-TORINO NorthernEuropeBEgrid-KULeuven BEgrid-UGent BEgrid-ULB-VUB BelGrid-UCL HPC2N Morpheus NorthernEuropeNIKHEF-ELPROD NSC-BLUESMOKE SARA-LISA RussiaKharkov-KIPT-LCG2 RU-Protvino-IHEP RU-SPbSU ru-Novgorod-NOVSU-LCG2 SouthWesternEuropeUB-LCG2 UKIBITLab-LCG (x2) CAVENDISH-LCG2 UCL-HEP UKI-LT2-IC-LeSC UKI cpDIASie csQUBuk csTCDie csUCCie giAITie giDCUie giDITie giITCie giITTAie giITTRie giNUIMie giRCSIie giULie giWITie mpUCDie obsARMuk

LCG John Gordon – GDB 5 April06 Actions from February MB  Countries to give feedback on legal issues with LCG- wide accounting (By April) Finland only  APEL to understand gLite implications (previous talk)  Tier1s to help ‘their’ associated sites to deploy and configure APEL. (More Green sites)  or to use their own accounting system to publish to LCG Repository  Sites to check their APEL logs for errors  give feedback to increase reliability and robustness  Sites to compare with other sources as reality check  eg if Ganglia shows 90% average utilisation over a month then APEL numbers should agree.  Work with OSG to push/pull their LCG accounting data  (Previous talk)

LCG John Gordon – GDB 5 April06 05 March 2006 RegionSite Name AsiaPacific GOG-Singapore Taiwan-IPAS-LCG2 Taiwan-NCUCC-LCG2 TOKYO-LCG2 TW- NCUHEP CentralEurope BUDAPEST CYFRONET-IA64 egee.man.poznan.pl GUP-JKU SiGNET WARSAW- EGEE WARSAW-LCG2 CERN ALBERTA-LCG2 BEIJING-CNIC-LCG2-IA64 BEIJING-LCG2 BNL-LCG2 CARLETONU-LCG2 CERN-CIC CERN HPBR-LCG2 HPTC-LCG2 HPTC-LCG2ia64 NCP-LCG2 SDU-LCG2 TORONTO-LCG2 TRIUMF-GC-LCG2 UIOWA-LCG2 FranceCGG-LCG2(*) IN2P3-SUBATECH IN2P3-LAPP GermanySwitzerlandEkplcg2 GSI-LCG2 ITWM RWTH-Aachen ItalyINFN-BOLOGNA-CMS INFN-CATANIA INFN-LNL-2 INFN-MILANO ItalyINFN-NAPOLI INFN-PADOVA INFN-PISA2 INFN-TORINO NorthernEuropeBEgrid-KULeuven BEgrid-UGent BEgrid-ULB-VUB BelGrid-UCL HPC2N Morpheus NorthernEuropeNIKHEF-ELPROD NSC NSC-BLUESMOKE SARA-LISA RussiaKharkov-KIPT-LCG2 RU-Protvino-IHEP RU-SPbSU ru-Novgorod-NOVSU-LCG2 SouthEastEuropeMK-01-UKIM_II SouthWestEuropeUB-LCG2 UKI BITLab-LCG (x2) CAVENDISH-LCG2 UCL-HEP UKI-LT2-IC-LeSC QMUL- eScience UKI cpDIASie csQUBuk csTCDie csUCCie giAITie giDCUie giDITie giITCie giITTAie giITTRie giNUIMie giRCSIie giULie giWITie mpUCDie obsARMuk

LCG John Gordon – GDB 5 April06 05 April 2006 (incomplete) RegionSite Name AsiaPacific GOG-Singapore Taiwan-IPAS-LCG2 Taiwan-NCUCC-LCG2 TOKYO-LCG2 TW- NCUHEP CentralEurope BUDAPEST CYFRONET-IA64 egee.man.poznan.pl GUP-JKU SiGNET WARSAW- EGEE WARSAW-LCG2 AMD64.PSNC.PL CERN ALBERTA-LCG2 BEIJING-CNIC-LCG2-IA64 BEIJING-LCG2 BNL-LCG2 CARLETONU-LCG2 CERN-CIC CERN HPBR-LCG2 HPTC-LCG2 HPTC-LCG2ia64 NCP-LCG2 SDU-LCG2 TORONTO-LCG2 TRIUMF-GC-LCG2 UIOWA-LCG2 FranceCGG-LCG2(*) IN2P3-SUBATECH IN2P3-LAPP GermanySwitzerlandEkplcg2 GSI-LCG2 ITWM RWTH-Aachen ItalyINFN-BOLOGNA-CMS INFN-CATANIA INFN-LNL-2 INFN-MILANO ItalyINFN-NAPOLI INFN-PADOVA INFN-PISA2 INFN-TORINO NorthernEuropeBEgrid-KULeuven BEgrid-UGent BEgrid-ULB-VUB BelGrid-UCL HPC2N Morpheus NorthernEuropeNIKHEF-ELPROD NSC NSC-BLUESMOKE SARA-LISA Russia Kharkov-KIPT-LCG2 RU-Protvino-IHEP RU-SPbSU RRC-KI ru-Novgorod- NOVSU-LCG2 SouthEastEuropeMK-01-UKIM_II TAU-LCG2 SouthWestEuropeUB-LCG2 UKI BITLab-LCG (x2) CAVENDISH-LCG2 UCL-HEP UKI-LT2-IC-LeSC QMUL- eScience UKI-LT2-CENTRAL UKI cpDIASie csQUBuk csTCDie csUCCie giAITie giDCUie giDITie giITCie giITTAie giITTRie giNUIMie giRCSIie giULie giWITie mpUCDie obsARMuk

LCG John Gordon – GDB 5 April06 Comments  We have observed that the list of sites not publishing has a few false positives.  Some non-publishing sites may be publishing under another name (mainly sorted)  Some flagged sites were not yet in production.  No way of flagging old that should no longer be publishing. Type=Closed proposed  NIKHEF publish from their own database and are seeing an R-GMA problem. (??)

LCG John Gordon – GDB 5 April06

LCG John Gordon – GDB 5 April06

LCG John Gordon – GDB 5 April06 Reporting to CRRB  The OB wants the CRRB to receive monthly figures for LHC use at Tier1 Centres  to start with  We have sufficient CPU reporting in APEL for T1s  but only report Grid work  How many T1s run significant non-Grid LHC work?  Not ready with tape and disk reporting yet  So what do we do?  How about manual reporting?  Example courtesy of Manuel Delfino

LCG John Gordon – GDB 5 April06

LCG John Gordon – GDB 5 April06 Which Numbers?  What numbers are to be input?  CPU easy, use APEL or your local system  Normailise to SI2K kilohours as in APEL  Disk and tape are not so easy  TBdays integrated over the month?  months have different numbers of days  Average TB/day ?  A snapshot on the 1 st (or last) day of the month?  all per LHC VO  allocated or used space?

LCG John Gordon – GDB 5 April06 Can we do better?  A simple tool could take the manually produced disk and tape numbers and publish them to the central APEL respository  The change to automatic measurement and submission would then be controlled and easily phased in.