Report on Installed Resource Capacity Flavia Donno CERN/IT-GS WLCG Management Board, CERN 25 November 2008.

Slides:

Advertisements

Similar presentations

LCG WLCG Operations John Gordon, CCLRC GridPP18 Glasgow 21 March 2007.

Advertisements

FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.

Storage: Futures Flavia Donno CERN/IT WLCG Grid Deployment Board, CERN 8 October 2008.

Storage Issues: the experiments’ perspective Flavia Donno CERN/IT WLCG Grid Deployment Board, CERN 9 September 2008.

EGEE SA1 Operations Workshop Stockholm, 13-15/06/2007 Enabling Grids for E-sciencE Service Level Agreement Metrics SLA SA1 Working Group Łukasz Skitał.

A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.

Accounting Update Dave Kant Grid Deployment Board Nov 2007.

TeraGrid Information Services December 1, 2006 JP Navarro GIG Software Integration.

Storage Accounting John Gordon, STFC GDB June 2012.

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Experiences with the GLUE information schema.

The EDGeS project receives Community research funding 1 Specific security needs of Desktop Grids Desktop Grids Desktop Grids EDGeS project EDGeS project.

OSG Operations and Interoperations Rob Quick Open Science Grid Operations Center - Indiana University EGEE Operations Meeting Stockholm, Sweden - 14 June.

OSG Services at Tier2 Centers Rob Gardner University of Chicago WLCG Tier2 Workshop CERN June 12-14, 2006.

SEE-GRID-SCI Regional Grid Infrastructure: Resource for e-Science Regional eInfrastructure development and results IT’10, Zabljak,

Monitoring the Grid at local, national, and Global levels Pete Gronbech GridPP Project Manager ACAT - Brunel Sept 2011.

SAMGrid as a Stakeholder of FermiGrid Valeria Bartsch Computing Division Fermilab.

July 25, 20071/21 OSG Information Services Gabriele Garzoglio, Rob Quick, Chris Green OSG Information Services, VO Monitoring Services and Resource Selection.

INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)

Report on Installed Resource Capacity Flavia Donno CERN/IT-GS WLCG GDB, CERN 10 December 2008.

July 29' 2010INDIA-CMS_meeting_BARC1 LHC Computing Grid Makrand Siddhabhatti DHEP, TIFR Mumbai.

INFSO-RI Enabling Grids for E-sciencE Enabling Grids for E-sciencE Pre-GDB Storage Classes summary of discussions Flavia Donno Pre-GDB.

Proposal for a IS schema Massimo Sgaravatto INFN Padova.

Jens G Jensen RAL, EDG WP5 Storage Element Overview DataGrid Project Conference Heidelberg, 26 Sep-01 Oct 2003.

EMI INFSO-RI Accounting John Gordon (STFC) APEL PT Leader.

The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana.

Automatic Resource & Usage Monitoring Steve Traylen/Flavia Donno CERN/IT.

Procedure to follow for proposed new Tier 1 sites Ian Bird CERN, 27 th March 2012.

Jan 2010 OSG Update Grid Deployment Board, Feb 10 th 2010 Now having daily attendance at the WLCG daily operations meeting. Helping in ensuring tickets.

DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 1 GLUE Schema - Status Report DataTAG WP4 meeting Bologna,

Procedure for proposed new Tier 1 sites Ian Bird WLCG Overview Board CERN, 9 th March 2012.

Accounting Update John Gordon and Stuart Pullinger January 2014 GDB.

Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks John Gordon SA1 Face to Face CERN, June.

LCG WLCG Accounting: Update, Issues, and Plans John Gordon RAL Management Board, 19 December 2006.

LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.

WLCG Grid Deployment Board CERN, 14 May 2008 Storage Update Flavia Donno CERN/IT.

WLCG Information System Use Cases Review WLCG Operations Coordination Meeting 18 th June 2015 Maria Alandes IT/SDC.

Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –

Next Steps after WLCG workshop Information System Task Force 11 th February

Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Andrea Sciabà Ideal information system - CMS Andrea Sciabà IS.

INFSO-RI Enabling Grids for E-sciencE Enabling Grids for E-sciencE Storage Element Model and Proposal for Glue 1.3 Flavia Donno,

Definitions Information System Task Force 8 th January

Grid Deployment Board 5 December 2007 GSSD Status Report Flavia Donno CERN/IT-GD.

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GLUE Schema Configuration for SRM 2.2 Stephen.

The Grid Storage System Deployment Working Group 6 th February 2007 Flavia Donno IT/GD, CERN.

REBUS wishlist (not exhaustive…) Cath Noble 23 May 2014.

Installation Accounting Status Flavia Donno CERN/IT-GS WLCG Management Board, CERN 28 October 2008.

OSG Status and Rob Gardner University of Chicago US ATLAS Tier2 Meeting Harvard University, August 17-18, 2006.

INFN/IGI contributions Federated Clouds Task Force F2F meeting November 24, 2011, Amsterdam.

WLCG Information System Status Maria Alandes Pradillo, CERN CERN IT Department, Support for Distributed Computing Group GDB 9 th September 2015.

John Gordon EMI TF and EGI CF March 2012 Accounting Workshop.

Storage Accounting John Gordon STFC GDB, Lyon 6 th April2011 GDB January 2012.

Grid Monitoring and Diagnostic Tools: GridICE, GSTAT, SAM Giuseppe Misurelli INFN-CNAF giuseppe.misurelli cnaf.infn.it.

Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.

Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.

LCG Introduction John Gordon, STFC GDB December 7 th 2010.

The Grid Information System Maria Alandes Pradillo IT-SDC White Area Lecture, 4th June 2014.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI MPI VT report OMB Meeting 28 th February 2012.

WLCG IPv6 deployment strategy

First proposal for a modification of the GIS schema

Monitoring and Information Services Technical Group Report

Towards GLUE Schema 2.0 Sergio Andreozzi INFN-CNAF Bologna, Italy

Bulk production of Monte Carlo

Short term improvements to the Information System: a status report

SRM2 Migration Strategy

Proposal for obtaining installed capacity

Outline Introduction Objectives Motivation Expected Output

A conceptual model of grid resources and services

Stephen Burke egi.eu EGI TF Prague September 20th 2012

Presentation transcript:

Report on Installed Resource Capacity Flavia Donno CERN/IT-GS WLCG Management Board, CERN 25 November 2008

Computing Capacity Glue attributes GlueSubClusterLogicalCPUs = Total number of core/hyperthreaded CPUs in the subcluster (including machines in state offline or down) GlueHostBenchMarkSI00 = Average SpecInt2000 rating per LogicalCPU CECapability: CPUScalingReferenceSI00= the CPU SI00 for which the published GlueCEMaxCPUTimes are valid. CECapability: Fairshare= : ; This value is used to express a specific VO share if VO shares are in operation. WLCG Management Board, CERN 25 November Computing Element (queue) AssignedJobSlots Capability Cluster Installed Capacity = ( ∑ WLCG Subclusters BenchMarkSI00*LogicalCPUs)/10 3 SubCluster HostProcessorModel HostProcessorSpeed HostProcessorSMPSize HostProcessorRAMSize PhysicalCPUs LogicalCPUs HostBenchMarkSI00 HostProcessorOtherDescription Mostly heterogeneous! Aggregation of heterogeneous computing resources managed by a batch system Set of (homogeneous) computing resources forming part of a Cluster It describes a batch queue

Storage Capacity WLCG Management Board, CERN 25 November Glue attributes GlueSACapability: Installed[Online|Nearline]Capacity = Online or Nearline space part of a Storage Area. It can be configured but not reserved or reserved but not yet part of a space token or reserved and assigned to a VO. VOInfo AccessControlBaseRule Tag Path StorageElement Installed Capacity = ( ∑ WLCG GlueSA GlueSACapability(InstalledCapacity) StorageArea AccessControlBaseRule Reserved[Online|Nearline]Size Total[Online|Nearline]Size Used[Online|Nearline]Size Free[Online|Nearline]Size Capability: Installed[Online|Nearline]Capacity= Not overlapping! It describes storage resources at a site. It could represent one or more storage systems. It describes a logical view of a portion of space that can include disk and tape resources. It describes VO specific attributes of a Storage Area

Installed Capacity: status WLCG Management Board, CERN 25 November A document has been published with all details, operational instructions for site administrators and explicative examples ges/WLCG_GlueSchemaUsage-1.7.pdf The document is the result of many discussions within the group which includes representatives from: The OGF Glue Schema Working Group The EGEE Worker Nodes Working Group OSG Storage Information Provider Developers Storage Accounting representatives Client providers We are in the process of reviewing WLCG/EGEE documents and tools to evaluate consequences and needed work: GridMap, Gstat, SAM tests APEL/cesga accounting and NGS Storage Accounting GOCDB Administrators FAQs and documents Glue 2.0