Installation Accounting Status Flavia Donno CERN/IT-GS WLCG Management Board, CERN 28 October 2008.

Slides:



Advertisements
Similar presentations
LCG WLCG Operations John Gordon, CCLRC GridPP18 Glasgow 21 March 2007.
Advertisements

NorthGrid status Alessandra Forti Gridpp12 Brunel, 1 February 2005.
6/3/2014 BMC Remedy Software License Management Example Manuel Linares.
HTCondor and the European Grid Andrew Lahiff STFC Rutherford Appleton Laboratory European HTCondor Site Admins Meeting 2014.
Storage: Futures Flavia Donno CERN/IT WLCG Grid Deployment Board, CERN 8 October 2008.
Scheduling under LCG at RAL UK HEP Sysman, Manchester 11th November 2004 Steve Traylen
Jan 2010 Current OSG Efforts and Status, Grid Deployment Board, Jan 12 th 2010 OSG has weekly Operations and Production Meetings including US ATLAS and.
Accounting Update Dave Kant Grid Deployment Board Nov 2007.
OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
CERN - IT Department CH-1211 Genève 23 Switzerland t LCG Deployment GridPP 18, Glasgow, 21 st March 2007 Tony Cass Leader, Fabric Infrastructure.
LT 2 London Tier2 Status Olivier van der Aa LT2 Team M. Aggarwal, D. Colling, A. Fage, S. George, K. Georgiou, W. Hay, P. Kyberd, A. Martin, G. Mazza,
SRM 2.2: status of the implementations and GSSD 6 th March 2007 Flavia Donno, Maarten Litmaath INFN and IT/GD, CERN.
Monitoring the Grid at local, national, and Global levels Pete Gronbech GridPP Project Manager ACAT - Brunel Sept 2011.
CERN IT Department CH-1211 Geneva 23 Switzerland t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, November 2008.
John Gordon STFC-RAL Tier1 Status 9 th July, 2008 Grid Deployment Board.
APEL & MySQL Alison Packer Richard Sinclair. APEL Accounting Processor for Event Logs extracts job information by parsing batch system (PBS, LSF, SGE.
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
Accounting in LCG Dave Kant CCLRC, e-Science Centre.
Steve Traylen PPD Rutherford Lab Grid Operations PPD Christmas Lectures Steve Traylen RAL Tier1 Grid Deployment
Certification and test activity IT ROC/CIC Deployment Team LCG WorkShop on Operations, CERN 2-4 Nov
Report on Installed Resource Capacity Flavia Donno CERN/IT-GS WLCG GDB, CERN 10 December 2008.
INFSO-RI Enabling Grids for E-sciencE Enabling Grids for E-sciencE Pre-GDB Storage Classes summary of discussions Flavia Donno Pre-GDB.
WLCG Grid Deployment Board, CERN 11 June 2008 Storage Update Flavia Donno CERN/IT.
Proposal for a IS schema Massimo Sgaravatto INFN Padova.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Priorities update Andrea Sciabà IT/GS Ulrich Schwickerath IT/FIO.
Accounting Update Stuart Pullinger, STFC Scientific Computing Department, APEL Team GDB 10 th December 2014.
Storage Accounting John Gordon, STFC GDB March 2013.
LCG Introduction John Gordon, STFC GDB June 8 th 2011.
Automatic Resource & Usage Monitoring Steve Traylen/Flavia Donno CERN/IT.
Busy Storage Services Flavia Donno CERN/IT-GS WLCG Management Board, CERN 10 March 2009.
Accounting Update John Gordon and Stuart Pullinger January 2014 GDB.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks John Gordon SA1 Face to Face CERN, June.
Accounting For Multicore Jobs John Gordon, STFC, UK Scientific Computing Department, APEL Team MB 17 th March 2015.
LCG WLCG Accounting: Update, Issues, and Plans John Gordon RAL Management Board, 19 December 2006.
JINR WLCG Tier 1 for CMS CICC comprises 2582 Core Disk storage capacity 1800 TB Availability and Reliability = 99% 49% 44% JINR (Dubna)End of.
Report from GSSD Storage Workshop Flavia Donno CERN WLCG GDB 4 July 2007.
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
WLCG Grid Deployment Board CERN, 14 May 2008 Storage Update Flavia Donno CERN/IT.
Report on Installed Resource Capacity Flavia Donno CERN/IT-GS WLCG Management Board, CERN 25 November 2008.
Accounting in LCG/EGEE Can We Gauge Grid Usage via RBs? Dave Kant CCLRC, e-Science Centre.
Definitions Information System Task Force 8 th January
CMS: T1 Disk/Tape separation Nicolò Magini, CERN IT/SDC Oliver Gutsche, FNAL November 11 th 2013.
Grid Deployment Board 5 December 2007 GSSD Status Report Flavia Donno CERN/IT-GD.
The Grid Storage System Deployment Working Group 6 th February 2007 Flavia Donno IT/GD, CERN.
LCG Pilot Jobs + glexec John Gordon, STFC-RAL GDB 7 December 2007.
Accounting Review Summary from the pre-GDB related to CPU (wallclock) accounting Julia Andreeva CERN-IT GDB 13th April
DIRAC for Grid and Cloud Dr. Víctor Méndez Muñoz (for DIRAC Project) LHCb Tier 1 Liaison at PIC EGI User Community Board, October 31st, 2013.
INFN/IGI contributions Federated Clouds Task Force F2F meeting November 24, 2011, Amsterdam.
WLCG Accounting Task Force Update Julia Andreeva CERN GDB, 8 th of June,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Storage Accounting John Gordon, STFC OMB August 2013.
LCG Accounting Update John Gordon, CCLRC-RAL 10/1/2007.
WLCG Information System Status Maria Alandes Pradillo, CERN CERN IT Department, Support for Distributed Computing Group GDB 9 th September 2015.
CERN LCG1 to LCG2 Transition Markus Schulz LCG Workshop March 2004.
John Gordon EMI TF and EGI CF March 2012 Accounting Workshop.
Accounting Update John Gordon. Outline Multicore CPU Accounting Developments Cloud Accounting Storage Accounting Miscellaneous.
WLCG Operations Coordination Andrea Sciabà IT/SDC GDB 11 th September 2013.
WLCG Resource Reporting 2 Laurence Field Cloud Status Document A few comments received Mainly minor text changes New final version (v1) has been generated.
Scheduling systems Carsten Preuß
WLCG Resources Reporting
Farida Naz Andrea Sciabà
Short term improvements to the Information System: a status report
CREAM Status and Plans Massimo Sgaravatto – INFN Padova
Update on Plan for KISTI-GSDC
Raw Wallclock in APEL John Gordon, STFC-RAL
Proposal for obtaining installed capacity
WLCG Accounting Task Force Update Julia Andreeva CERN WLCG Workshop 08
APEL Storage Accounting
Cristina del Cano Novales STFC - RAL
Accounting Repository
Presentation transcript:

Installation Accounting Status Flavia Donno CERN/IT-GS WLCG Management Board, CERN 28 October 2008

Computing Capacity Initial assumptions: The source to calculate provided computing capacity at sites should be the information system. The computed capacity should be compared against the declared pledges. Therefore, it should be expressed in KiloSpecInto2000. The publishing vector should be the APEL portal: cesga WLCG Management Board, CERN 28 October

SubCluster Computing Capacity Useful Glue attributes TotalCPUs = Total number of assigned Job Slots in the queue PhysicalCPUs = Total number of real CPUs/physical chips in the subcluster LogicalCPUs = Total number of core/hyperthreaded CPUs in the subcluster WLCG Management Board, CERN 28 October Computing Element (queue) TotalCPUs Cluster SubCluster ProcModel ProcSpeed PhysicalCPUs LogicalCPUs SMPSize BenchMarkSI00 Installed Capacity = BenchMarkSI00*PhysicalCPUs

Computing Capacity Issues Published numbers mostly filled by hand by site admins Better information providers and validation tools can cure the situation SubClusters not homogeneous Published average should be OK Fairshare not published Is it OK to publish the total ? Normalized values If CPU speed is scaled up to some value then also SubCluster's Physical and Logical CPU count must be scaled so that the total power is reflected. Benchmark=KSI00 most problematic to check Retired as of February 2007 Most sites refer to spec.org SPEC.ORG reports CPU power per chip and not per core WLCG Management Board, CERN 28 October

Computing Capacity: some results 124 WLCG T2 Sites 13 WLCG T2 Sites not yet in GOCDB 21 WLCG T2 Sites not answering 103 WLCG T2 Sites OK 78 WLCG T2 Sites running PBS (and its flavors) - others mostly running condor (sge and lsf) 27 WLCG T2 PBS Sites do not publish Physical CPUs “pbsnodes –a” and “qmgr –c print server/queue ” used as validation through globus-job-run on the CE Processor Model/Speed compared with what published by SPEC.ORG to find out correct KSI00 per CPU WLCG Management Board, CERN 28 October

Computing Capacity: some results Canada-West Federation Pledges 2008 = 300KSI00 Computed Installed capacity= 90*1.5(135) + 64*2.7(172.8) + 420*1.5=(630)=937.8KSI00 ALBERTA-LCG2 ALBERTA-LCG2 'torque' 1 lcgce01.cpp.ualberta.ca{lcgce01.cpp.ualberta.ca:2119/jobmanager-lcgpbs- atlas{TotalCPUs=115}} 1 lcgce01.cpp.ualberta.ca{ClusterID=lcgce01.cpp.ualberta.ca,ProcModel=Opteron,ProcS peed=1800,PhysicalCPUs=0,LogicalCPUs=0,SMPSize=2,BenchMarkSI00=1500} SFU-LCG2 SFU-LCG2 'torque' 1 snowpatch-hep.westgrid.ca{snowpatch- hep.westgrid.ca:2119/jobmanager-lcgpbs-atlas{TotalCPUs=256}} 1 snowpatch- hep.westgrid.ca{ClusterID=snowpatch-hep.westgrid.ca,ProcModel=Intel(R) Xeon(R) CPU X GHz,ProcSpeed=2660,PhysicalCPUs=64,LogicalCPUs=1,SMPSize=2,BenchMark SI00=381} VICTORIA-LCG2 VICTORIA-LCG2 'torque' 1 lcg-ce.rcf.uvic.ca{lcg-ce.rcf.uvic.ca:2119/jobmanager- lcgpbs-general{TotalCPUs=432}} 1 lcg-ce.rcf.uvic.ca{ClusterID=lcg- ce.rcf.uvic.ca,ProcModel=Intel(R) Xeon(TM) CPU 3.20GHz,ProcSpeed=3202,PhysicalCPUs=2,LogicalCPUs=2,SMPSize=2,BenchMarkS I00=976} WLCG Management Board, CERN 28 October

Storage Capacity: status update They provide needed info with no sysadmin intervention. CASTOR information providers deployed at RAL They pass the validation procedure – minor changes needed Precise schedule needed DPM information providers deployed at a few sites (UK and France) In certification as a patch release for DPM dCache information providers available with dCache Some implementation problems. Phone conf scheduled for Thursday, 30 October OSG invited as well. StoRM information providers will be available at the end of November 2008 WLCG Management Board, CERN 28 October

Thank You WLCG Management Board, CERN 28 October 2008