GRID activities INFN/CNAF Cristina Aiftimiei /SDDS cristina.aiftimiei@cnaf.infn.it This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License

OpenStack Summit – Tokyo 2015 Outline INFN – National Institute for Nuclear Physics, Italy Projects NGI_IT Operations Coordination GRID Central Services GRID Middleware development & support OpenStack Summit – Tokyo 2015

INFN = Istituto Nazionale di Fisica Nucleare (National Institute for Nuclear Physics) Italian research agency dedicated to the study of the fundamental constituents of matter and the laws that govern them, under the supervision of the Ministry of Education, Universities and Research (MIUR). It conducts theoretical and experimental research in the fields of subnuclear, nuclear and astroparticle physics, in close collaboration with Italian universities. Strong experience and know-how also in cutting-edge technology and instruments. Among them, long-standing experience on HPC, distributed storage and computing (Grids and Clouds) Strong focus also on technology transfer programs. Transfer of technologies and know-how to Italian and European companies, developed within INFN scientific programs.

INFN sites About 30 among full INFN branches and collaboration groups hosted in university departments 4 national laboratories: Catania, Frascati, Gran Sasso, Legnaro 3 national centers: CNAF, National Center for Research and Development in Informatics and Telematics, Bologna GSSI, Gran Sasso Science Institute, L’Aquila TIFPA, Trento Institute for Fundamental Physics and Applications, a Trento

INFN - lines of research & projects Projects addressing “next generation computing infrastructure” DataGrid (2001 – 2004) Research and Technological Development for an International Data Grid EC: 9.6 M€ - INFN 9.69% DataTaG (2002-2004): Research & technological development for a Data TransAtlantic Grid EC: 4.1 M€ - INFN 15.29% EGEE I, II, III (2004 – 2010) Enabling Grids for E-sciencE EC: 100,8M€ - INFN 11% EMI (2010 – 2013) Europeean Middleware Initiative EC: 12 M€ - INFN 16% EGI-Inspire (2010 – 2014) Integrated Sustainable Pan-European Infrastructure for Researchers in Europe EC: 25 M€ - INFN 6,9%

INFN - lines of research & projects Projects addressing “next generation computing infrastructure” DataGrid (2001 – 2004) Research and Technological Development for an International Data Grid EC: 9.6 M€ - INFN 9.69% DataTaG (2002-2004): Research & technological development for a Data TransAtlantic Grid EC: 4.1 M€ - INFN 15.29% EGEE I, II, III (2004 – 2010) Enabling Grids for E-sciencE EC: 100,8M€ - INFN 11% EMI (2010 – 2013) Europeean Middleware Initiative EC: 12 M€ - INFN 16% EGI-Inspire (2010 – 2014) Integrated Sustainable Pan-European Infrastructure for Researchers in Europe EC: 25 M€ - INFN 6,9% Grid Computing - enabling resource sharing and coordinated problem solving in dynamic, multi-institutional virtual organization

INFN - lines of research & projects NEW projects addressing “next generation computing infrastructure” National Projects PRISMA (2012 – 2015) PiattafoRme cloud Interoperabili per SMArt-government MIUR/EC 27.4/20.3 M€ - INFN 8,14% OCP (2014 – 2016) OpenCityPlatform - Smart Cities and Communities and Social Innovation MIUR 11.9 M€ - INFN 13,2% International Projects EGI – Engage (2015 – 2017) Engaging the Research Community towards an Open Science Commons `EC: 8 M€ - INFN 7,5% INDIGO – DataCloud (2015 – 2017) INtegrating Distributed data Infrastructures for Global ExplOitation EC: 11 M€ - INFN ~18,7%

INFN - lines of research & projects NEW projects addressing “next generation computing infrastructure” National Projects PRISMA (2012 – 2015) PiattafoRme cloud Interoperabili per SMArt-government MIUR/EC 27.4/20.3 M€ - INFN 8,14% OCP (2014 – 2016) OpenCityPlatform - Smart Cities and Communities and Social Innovation MIUR 11.9 M€ International Projects EGI – Engage (2015 – 2017) Engaging the Research Community towards an Open Science Commons `EC: 8 M€ - INFN 7,5% INDIGO – DataCloud (2015 – 2017) INtegrating Distributed data Infrastructures for Global ExplOitation EC: 11 M€ - INFN ~18,7% Cloud Computing - enabling ubiquitous, convenient, on-demand […] access to a shared pool of configurable computing resources […] that can be rapidly provisioned and released […]

OpenStack Summit – Tokyo 2015 Outline INFN – National Institute for Nuclear Physics, Italy Projects NGI_IT Operations Coordination GRID Central Services GRID Middleware development & support OpenStack Summit – Tokyo 2015

NGI_IT Grid > Coordination of the Italian NGI The Grid Operation Service supports a large variety of scientific disciplines organized in 30+ VOs, including the WLCG ones Operation of central services INFN-distributed cluster of WMS/LB, top-BDII, VOMS A national NAGIOS-SAM instance Local and central highly-available LFC instances Squid and CVMFS services A general-purpose Grid Web portal Additional tasks Coordination of the Italian Resource Center managers Coordination of the Grid User Support Involvement in the EGI.eu Operations team, with roles of supervision of the status of the overall infrastructure and of contributing to the software provisioning process The supervision of the activity of the IGI Computer Security Incident Response Team 22.09.2016

NGI_IT - Sites Sites: Certified: 43 Candidate:1 Closed: 48 Included 4 EGI FedCloud+1 “Central Services” Candidate:1 Closed: 48 22.09.2016

NGI_IT - Services Services: 427 (268 WLCG): CREAM CE: 72 (53) APEL: 40 (24); glite-APEL – 27 (20) site-BDII: 23 (11) SRM: 45 (24) VO-box: 5 Central Services: Top-BDII: 11 (2) WMS: 16 ARGUS: 11 (9) VOMS: 10 (1) MyProxy: 2 centralLFC: 2 22.09.2016

NGI_IT - Operations 22.09.2016

NGI_IT - Operations WMS VOMS BDII-top (virtual) LFC (virtual) 4 (+ 2 @ CT, 1 @ FE) serving 38 VO (4 LHC) 3 (virtual) used by Nagios-monitoring 1 (virtual) for site certification VOMS 3 (virtual), replicated - 2 @ PD, 1 @ UNINA BDII-top (virtual) 4 production in DNS load-balancing, 1 for site certification LFC (virtual) 2 + 2 (19 + 2 VO) 2 MyProxy 1 Nagios (virtual) serving whole NGI_IT – in decommissionig 3 CVMFS (virtual) for virgo, padme, gridit 2 SQUID server xGUS – NGI_IT ticketing system 22.09.2016

GRID Middleware development & support Software Products > StoRM Storage Manager Service (SRM) for generic disk-based storage systems with a POSIX API SRM solution of choice for the Tier-1, which is based on GPFS. The integration with the tape system (based on TSM) is through GEMSS Major activities WebDAV support much more reliable and being improved Additional refactoring and simplification of the code base to further reduce the maintenance. VOMS Attribute authority which serves as a central repository for authorization information associated to a member of a VO The administration Web interface to VOMS now connects directly to the CERN database containing user affiliation to experiments Argus Authorization Service that renders consistent authorization decisions for distributed services Based on the XACML standard 22.09.2016

GRID Middleware development & support Grid & Cloud Portal - https://portal.italiangrid.it Grid Job submission via Web Simple Job Submission via DIRAC Workflow management and submission via WS-Pgrade Grid & Cloud data management via Web Move data from local PC to Grid. Move, Rename, Replica, Delete, Set ACL for the Grid data. Move data from Grid to local PC or Remote (SFTP, FTP, WEBDav). Move data from Grid to Cloud and viceversa Making easier the request and management of X.509 certificate and the request for a VO membership Provisioning of a Cloud enviroment via Web Instantiate and manage a Virtual Machine. Manage Public and Private SSH keys. Browse Metadata Catalog. Connect to a Virtual Machine. Resource Providers available: 22.09.2016

Supported VOs ~30 (% of 3,452,876,596 Normalised CPU time (HEPSPEC06) usage 2015-2016) alice (24%), atlas (26%), cms (21%), lhcb (12%) –> total = 83% virgo (5%), belle (4%), biomed (2,41%), compchem (2%), pamela (1%), calet.org (1%) 22.09.2016

22.09.2016

22.09.2016