EGEE-III INFSO-RI-222667 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks John Gordon SA1 Face to Face CERN, June.

Slides:



Advertisements
Similar presentations
Transition to a new CPU benchmark on behalf of the “GDB benchmarking WG”: HEPIX: Manfred Alef, Helge Meinhard, Michelle Michelotto Experiments: Peter Hristov,
Advertisements

Accounting Update Dave Kant Grid Deployment Board Nov 2007.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks From ROCs to NGIs The pole1 and pole 2 people.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Romanian SA1 report Alexandru Stanciu ICI.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks LHCOPN Ops WG Act 4 – Conclusion Guillaume.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse EGEE’s plans for transition.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks PPS All sites Meeting: Introduction & Agenda.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ROD model assessment ROC UKI John Walsh.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Middleware Deployment and Support in EGEE.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GStat 2.0 Joanna Huang (ASGC) Laurence Field.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks, An Overview of the GridWay Metascheduler.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA3 Resources Robin McConnell.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Kelsey RAL/STFC,
EGEE-III INFSO-RI Enabling Grids for E-sciencE Monitoring and enforcement of Service Level Agreements John Shade EGEE-II / EGEE.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team James Casey EGEE’08.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Multi-level monitoring - an overview James.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks France Grilles The French NGI R. Rumler,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA2 Quality Plan for EGEE III Geneviève.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Service Availability Monitoring – Status.
Enabling Grids for E- sciencE EGEE and gLite are registered trademarks EGEE-III INFSO-RI Analysis of Overhead and waiting times.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Build Programme and Multi-Platform.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-EGI Grid Operations Transition Maite.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Batch Systems and the Info (Dynamic) Provider.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA1: Grid Operations Maite Barroso (CERN)
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Wojciech Lapka SAM Team CERN EGEE’09 Conference,
EGEE-III INFSO-RI Enabling Grids for E-sciencE Operations Automation Team KoM, May ROC VIEW (SWE)‏ Javier Lopez Cacheiro/
EGEE-III INFSO-RI Enabling Grids for E-sciencE Antonio Retico CERN, Geneva 19 Jan 2009 PPS in EGEEIII: Some Points.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Pre-production in EGEEIII Operation principles Antonio Retico EGEE-II / EGEE II SA1.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MSG - A messaging system for efficient and.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks DSA1.4 – Objectives and Status Ioannis Liabotis.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGI Operations Tiziana Ferrari EGEE User.
EMI INFSO-RI Accounting John Gordon (STFC) APEL PT Leader.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Using GStat 2.0 for Information Validation.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Xavier Jeannin (CNRS/UREC Paris, FR) 24.
Automatic Resource & Usage Monitoring Steve Traylen/Flavia Donno CERN/IT.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA3 – Procedures for Training Event Robin.
Accounting Update John Gordon and Stuart Pullinger January 2014 GDB.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Standard network trouble tickets exchange.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks APEL CPU Accounting in the EGEE/WLCG infrastructure.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid Monitoring Tools E. Imamagic, SRCE CE.
LCG WLCG Accounting: Update, Issues, and Plans John Gordon RAL Management Board, 19 December 2006.
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The EGEE User Support Infrastructure Alistair.
HEPMARK2 Consiglio di Sezione 9 Luglio 2012 Michele Michelotto - Padova.
LCG Accounting/Reporting John Gordon, STFC MB November 9 th 2011.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team Kickoff Meeting.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Ian Bird All Activity Meeting, Sofia
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks LHCOPN Operations WS: Introduction & Objectives.
Definitions Information System Task Force 8 th January
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operations: Evolution of the Role of.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA3 Resources Robin McConnell.
Installation Accounting Status Flavia Donno CERN/IT-GS WLCG Management Board, CERN 28 October 2008.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks What all NGIs need to do: Helpdesk / User.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Dashboard for Operations Cyril L’Orphelin.
LCG Accounting Update John Gordon, CCLRC-RAL 10/1/2007.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations automation team presentazione.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Bob Jones EGEE project director.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Towards an Information System Product Team.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GOCDB4 Gilles Mathieu, RAL-STFC, UK An introduction.
Accounting Update John Gordon. Outline Multicore CPU Accounting Developments Cloud Accounting Storage Accounting Miscellaneous.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks IT ROC: Vision for EGEE III Tiziana Ferrari.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Alberto Escolano – RedIRIS alberto.escolano.
1 Impact assessment of e-infrastructures lessons learnt from EGEE Bob Jones CERN IT Department Bob JonesNovember 2010.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operational Tools Advisory Group - Transition.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Country Reports AAM Brussels.
Benchmarking Changes and Accounting
Raw Wallclock in APEL John Gordon, STFC-RAL
Transition to a new CPU benchmark
Cristina del Cano Novales STFC - RAL
Presentation transcript:

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks John Gordon SA1 Face to Face CERN, June 9 th 2009 Benchmarking Changes

Enabling Grids for E-sciencE EGEE-III INFSO-RI Background EGEE has used SpecInt2000 as a measure of its sites capacity and as a normalisation for cpu accounting Now out of date. SPEC has released a set of 2006 benchmarks, manufacturers no longer publish SI2K results, SI2K is no longer a good indicator of the performance of HEP applications HEPiX Working Group tasked with finding a replacement. EGEE transition plan - Bob Jones – CB - 3 March

Enabling Grids for E-sciencE EGEE-III INFSO-RI HEPSPEC06 The HEPiX WG evaluated a variety of HEP codes and different cpus They chose one of the SPEC2006 set of benchmarks called SPECall_cpp2006 This reflected the mix of Int and FP found in HEP applications and scaled with cpu speed. This is not one of those usually published by manufacturers –So sites have to run it themselves. (A Good Thing!) Conversion 1 HEPSPEC06 = 250 SpecInt HEPSPEC06 = 1k SpecInt2000 EGEE transition plan - Bob Jones – CB - 3 March

Enabling Grids for E-sciencE EGEE-III INFSO-RI Plan 1. WLCG MoU Pledges will be scaled as above 2. Installed Capacity should be measured using HESPEC06 3. Accounting records usage in HEPSPEC06 EGEE transition plan - Bob Jones – CB - 3 March

Enabling Grids for E-sciencE EGEE-III INFSO-RI APEL APEL centrally stores the raw cpu used by jobs and a value normalised to the GlueHostBenchMarkSI00 value published in Glue. GLUE 2.0 allows multiple benchmarks –But not yet deployed Not everyone will change the benchmark they use at once. Changing the infrastructure to store multiple values only for a migration is not justified. EGEE transition plan - Bob Jones – CB - 3 March

Enabling Grids for E-sciencE EGEE-III INFSO-RI APEL Plan Sites should: 1.Measure resources using HEPSPEC06 2.*250 3.Publish as SI00 as before 4.Set Glue Flag to say HEPSPEC06 has been used APEL gathers comparable data from all sites Monitoring can identify sites which have/have not changed benchmark. Raise tickets etc CESGA Portal can show usage in either (both?) benchmarks by conversion. Eventually when most sites have changed, the portal default will change When GLUE2.0 deployed, publish raw HEPSPEC06 values –Or possibly reuse SI00 EGEE transition plan - Bob Jones – CB - 3 March

Enabling Grids for E-sciencE EGEE-III INFSO-RI Quote from Reference Document WLCG is currently (feb 2009) in a state of transition with respect to the units of core power measurement. For sites whose MEASUREMENTS are still based on the old SpectInt2000 suite, the measured power must be published only via the GlueHostBenchMarkSI00 attribute. For sites whose core power MEASUREMENTS are done using the new HEP-SPEC06 benchmark, the result of this measurement must be PUBLISHED via the attribute GlueHostProcessorOtherDescription: Benchmark= - HEP-SPEC06, where in the CPU power is expressed in the new unit. In addition, this HEP-SPEC06 measurement must be CONVERTED (via the agreed conversion factor) to SpecInt2000 units, and this resulting value must be PUBLISHED via the the GlueHostBenchmarkSI00 attribute. putingReadinessChallenges/WLCG_GlueSchemaUsage -1.8.pdfhttps://twiki.cern.ch/twiki/pub/LCG/WLCGCommonCom putingReadinessChallenges/WLCG_GlueSchemaUsage -1.8.pdf EGEE transition plan - Bob Jones – CB - 3 March

Enabling Grids for E-sciencE EGEE-III INFSO-RI What to do? License the SPEC2006 benchmark suite Run HEPSPEC06 on your cpus –Details on HEPiX web. Publish values according to Installed Capacity document. EGEE transition plan - Bob Jones – CB - 3 March