1 GRID – Stato dell’arte Alessandro Paolini (INFN-CNAF) Workshop della Commissione Calcolo e Reti dell'INFN Laboratori Nazionali del Gran Sasso 10 – 13 Giugno 2008

2 Primary components of the production grid The primary components of the Italian Production Grid are: Computing and storage resources Access point to the grid Services Other elements are as much fundamental for the working, managing and monitoring of the grid: Middleware Monitoring tool Accounting tool Management and control infrastructure Users

3 GRID Management Grid management is performed by the Italian Regional Operation Center (ROC). The main activities are: Production of Infngrid release and test Deployment of the release to the sites, support to local administrators and sites certification Periodical check of the resources and services status Support at an Italian level Support at an European level Introduction of new Italian sites in the grid Introduction of new regional VOs in the grid

4 The Italian Regional Operation Center (ROC) One of 10 existing ROC in EGEE Operations Coordination Centre (OCC) –Management, oversight of all operational and support activities Regional Operations Centres (ROC) –providing the core of the support infrastructure, each supporting a number of resource centres within its region Grid Operator on Duty Grid User Support (GGUS) –At FZK, coordination and management of user support, single point of contact for users

5 Users and sites support EGEE make use of the GGUS (Global Grid UserSupport) ticketing system Each ROC utilizes different tools interfaced to GGUS in a bidirectional Way. By means of Web services, it is possible to: Transfer tickets from the global to regional system Transfer tickets from the regional to the global system The user groups support, whom ticket will be addressed, are defined Either in GGUS either in the regional systems In the Italian Regional Operation Centre the ticketing system utilized is based on XOOPS/xHelp

6 Sistema di supporto italiano

7 GRID Services Allow you to use the grid resources: Resource Broker (RB) / Workload Management System (WMS): they are responsible for the acceptance of submitted jobs and for sending those jobs to the appropriate resources Information System (IS): provides information about the grid resources and their status Virtual Organization Management System (VOMS): database for the authentication and authorization of the users Gridice: monitoring of resources, services and jobs Home Location Register (HLR): database for the accounting informations of the usage of resources LCG file catalog (LFC): file catalog File Transfer Service (FTS): file movements in an efficient and reliable way MonBox: collector for local data of R-GMA

8 Access to the GRID Access by means of an User Interface (UI). It could be: –A dedicated PC, installed in a similar way to the others grid elements –UI Plug-and-Play (UI PnP), a software you can install on any pc without root privilegies –A web portal: To access the GRID you need a personal certificate released by a Certification Authority trusted by EGEE/LCG infrastructure: the user authentication is performed through X-509 certificates To be authorized to submit jobs you have to belong to a Virtual Organisation (VO). A VO is a kind of users group usually working on the same project and using the same application software on the grid.

9 General Purpose Services (I) 2 Resource Brokers 1 Top Level BDII 2 voms servers + 1 replica per ciascuno 1 gridice server 1 LCG File Catalog server

10 General Purpose Services (II) 3 WMS 2 Logging & Bookkeeping 2 Resource Brokers 2 Top Level BDII 1 server MyProxy 1 FTS

11 VOMS Servers (I)

12 VOMS Servers (II)

13 Accounting using DGAS DGAS (Distributed Grid Accounting System) is fully deployed in INFNGrid (13 site HLRs + 1 HLR of 2 nd level (testing). The site HLR is a service designed to manage a set of ‘accounts’ for the Computing Elements of a given computing site. For each job executed on a Computing Element (or a on local queue), the Usage Record for that job is stored on the database of the site HLR. Each site HLR can: Receive Usage Records from the registered Computing Elements. Answer to site manager queries such as: –Datailed job list queries (with many search keys: per user, VO, FQAN,CEId…) –Aggregate usage reports, such as per hour, day, month…, with flexible search criteria. Optionally forward Usage Records to APEL database. Optionally forward Usage Records to a VO specific HLR. Site HLR Site layer Usage MeteringResource’s layer -Aggregate site info -VO (with role/group) usage on the site. -Detailed Resource Usage info -Job level info GOC

14 Tier1 & Tier2 HLRs hostsito hlr-t1.cr.cnaf.infn.itINFN-T1 prod-hlr-02.ct.infn.it INFN-CATANIA prod-hlr-01.pd.infn.it INFN-PADOVA prod-hlr-01.ba.infn.it INFN-BARI atlashlr.lnf.infn.it INFN-FRASCATI t2-hlr-01.lnl.infn.it INFN-LEGNARO prod-hlr-01.mi.infn.it INFN-MILANO t2-hlr-01.na.infn.itINFN-NAPOLI, INFN-NAPOLI-ATLAS gridhlr.pi.infn.itINFN-PISA t2-hlr-01.roma1.infn.it INFN-ROMA1, INFN-ROMA1-CMS, INFN-ROMA1-VIRGO grid005.to.infn.it INFN-TORINO HLR prod-hlr-01.pd.infn.it (INFN-PADOVA) reference for central-northern area sites CNR-ILC-PISAINFN-GENOVA CNR-PROD-PISAINFN-PARMA INAF-TRIESTEINFN-PERUGIA INFN-CNAFINFN-TRIESTE INFN-BOLOGNASNS-PISA INFN-FERRARAUNIV-PERUGIA INFN-FIRENZE HLR prod-hlr-01.ct.infn.it (INFN-CATANIA) reference for central-southern area sites ENEA-INFOINFN-ROMA3 INFN-CAGLIARIITB-BARI INFN-LECCESPACI-CS-IA64 INFN-LNSSPACI-LECCE-IA64 INFN-NAPOLI-CMSSPACI-NAPOLI INFN-ROMA2SPACI-NAPOLI-IA64 11 Home Location Register di sito per Tier1 e Tier2 2 HLRs per i siti medio-piccoli

15 VO Dedicated Services (I)

16 VO Dedicated Services (II)

17 Experimental Services Tests su alcuni componenti rilasciati dagli sviluppatori, in parallelo con SA3 –Applicazione delle ultime patch appena rilasciate su alcuni WMS presenti in produzione, per consentire alle VO di testarne la compatibilità con i loro tools –CreamCE: in collaborazione con alcuni siti in cui sono state installate diverse istanze

18 Other Services

19 Deployment Status (I) SITESTATUSSITESTATUS CNR-ILC-PISACERTIFIEDINFN-PISACERTIFIED CNR-PROD-PISACERTIFIEDINFN-ROMA1CERTIFIED ENEA-INFOCERTIFIEDINFN-ROMA1-CMSCERTIFIED ESA-ESRINCERTIFIEDINFN-ROMA1-VIRGOCERTIFIED INFN-BARICERTIFIEDINFN-ROMA2CERTIFIED INFN-BOLOGNACERTIFIEDINFN-ROMA3CERTIFIED INFN-CATANIACERTIFIEDINFN-T1CERTIFIED INFN-CNAFCERTIFIEDINFN-TORINOCERTIFIED INFN-CNAF-LHCBCERTIFIEDINFN-TRIESTECERTIFIED INFN-FERRARACERTIFIEDSNS-PISACERTIFIED INFN-FRASCATICERTIFIEDSPACI-CS-IA64CERTIFIED INFN-GENOVACERTIFIEDSPACI-NAPOLICERTIFIED INFN-LECCECERTIFIEDUNI-PERUGIACERTIFIED INFN-LNL-2CERTIFIEDINAF-TRIESTEHW PROBLEMS INFN-LNSCERTIFIEDINFN-CAGLIARIHW PROBLEMS INFN-MILANOCERTIFIEDINFN-CASCINAHW PROBLEMS INFN-NAPOLICERTIFIEDINFN-FIRENZESupp. Unavailable INFN-NAPOLI-ATLASCERTIFIEDINFN-NAPOLI-CMSTESTs ONGOING INFN-NAPOLI-PAMELACERTIFIEDITB-BARICooling Maint. INFN-PADOVACERTIFIEDSISSA-TRIESTETESTs ONGOING INFN-PARMACERTIFIEDSPACI-LECCE-IA64HW & MW PROBLEMS INFN-PERUGIACERTIFIEDSPACI-NAPOLI-IA64HW & MW PROBLEMS 44 Siti in totale: 35 Siti attivi 2 siti in fase di certificazione 31 siti INFN 13 siti di altri enti (cnr, enea, esa, inaf, spaci, univ.PG) 3 siti con architettura IA64 (1 attivo)

20

21 Release INFNGRID Based on gLite3 We are still in a O.S. transition phase: there are two releases INFNGRID: 3.0 for SL3, 3.1 for SL4 Several customizations: additional VOs (~20) accounting (DGAS): New profile (HLR server) + additional packages on CE and WN monitoring (GRIDICE) Quattor (collaboration with CNAF-T1) Dynamic Information-Providers for LSF: corrected configuration, new vomaxjobs (3.1/SL4 WIP) transparent support to MPICH and MPICH-2 GRelC (Grid Relational Catalog) StoRM (Storage Resource Manager) GFAL Java API & NTP Work-in-progress: creamCE patched MyProxy (long-live proxy delegation with voms extensions) AMGA Web Interface GSAF (Grid Storage Access Framework) Secure Storage System gLite for Windows with torque/maui support

22 Deployment Status (II) EGEE gLite 3.1 updates ( Update Update Update Update Update Update Update Update Update Update Update Update 14 INFNGRID gLite 3.1 Update 14/15/16 (SL4) - 18/03/2008 INFNGRID gLite 3.1 Update 17 (SL4) - 01/04/2008 INFNGRID gLite 3.1 Update 18/19/20/21 (SL4) - 28/04/2008 INFNGRID gLite 3.1 Update 22/23/24/25 (SL4) - WIP

23 Deployment Status (III) EGEE gLite 3.0 updates ( Update Update Update Update Update Update Update Update Update 35 INFNGRID gLite 3.0 Update 35/36 (SL3) - 11/29/2007 INFNGRID gLite 3.0 Update 37 (SL3) - 05/12/2007 INFNGRID gLite 3.0 Update 38 (SL3) - 25/01/2008 INFNGRID gLite 3.0 Update 39 (SL3) - 05/02/2008 INFNGRID gLite 3.0 Update 43 (SL3) - WIP/2008 INFNGRID gLite 3.0 Update 42 (SL3) - 28/04/2008 INFNGRID gLite 3.0 Update 41 (SL3) - 01/04/2008 INFNGRID gLite 3.0 Update 40 (SL3) - 18/03/2008

24 Supported VOs VOs supported: 4 LHC (ALICE, ATLAS, CMS, LHCB) 3 test (DTEAM, OPS, INFNGRID) 20 Regional 1 catch all VO: GRIDIT 21 Other VOs

25 VO Regionali VOutenti argo25 bio68 compassit7 compchem59 cyclops13 egrid28 enea12 enmr.eu14 euchina61 euindia51 eumed99 gridit132 inaf27 infngrid207 ingv13 libi17 lights.infn.it16 pamela19 planck33 theophys57 virgo utenti registrati in CDF

26 HLRmon

27 WMS MONITOR (I)

28 WMS MONITOR (II)

29 Useful links Italian grid project: Italian production grid: HLR MON: WMS MON: gLite Middleware: