DPM at ATLAS sites and testbeds in Italy Alessandro De Salvo (INFN, Roma1), Alessandra Doria (INFN, Napoli), Elisabetta Vilucchi (INFN, Laboratori Nazionali di Frascati) 23/11/2016 A. Doria - DPM Workshop 2016 - Paris

DPM at ATLAS IT Sites 3 out of 4 ATLAS Tier2 in Italy adopted DPM since 2007. The Tier1 at CNAF (Bologna) ad Milano Tier2 use STORM with GPFS. The Site Managers of the 3 DPM Tier2s (Frascati National Labs, Napoli and Roma) are involved in the DPM collaboration During the last year the ATLAS Tier3 in Cosenza deployed its storage system (~400 TB) with DPM. Italian ATLAS sites Milano Bologna T1 Roma Frascati Napoli Cosenza 23/11/2016 A. Doria - DPM Workshop 2016 - Paris

DPM setup at ATLAS IT Tier2s The storage setup is similar, with some peculiarity: INFN FRASCATI: 1PB, 11 pool nodes Head node on a virtual machine and MySql DB on a physical server DB replication with MySQL master/slave configuration . INFN NAPOLI: 2PB, 22 pool nodes Head node and Mysql DB on the same physical server DB daily backups with Percona xtrabackup. INFN ROMA: 1.5PB , 16 pool nodes MySQL main replica in the DPM head node, Slave replica on a different node, with backup The three sites run with DPM 1.8.11, the latest release in EPEL 23/11/2016 A. Doria - DPM Workshop 2016 - Paris

Puppet + Foreman for DPM configuration 13/12/2013 Puppet + Foreman for DPM configuration All the 3 sites use puppet with Foreman for DPM configuration (and for installation and configuration of most/all site servers) DPM Workshop 2015: “Parametrized Puppet modules developed: Puppet manifests released with DPM must be adapted in order to handle parameters from Foreman” New releases (starting with 1.8.11): DPM developers released the modules puppet-dpm and puppet-dmlite that make the configuration much easier, directly allowing to use both Foreman and hiera as ENC. 23/11/2016 A. Doria - DPM Workshop 2016 - Paris A.Doria

Puppet + Foreman setup: Pros & Cons 13/12/2013 Puppet + Foreman setup: Pros & Cons Pros: Use Foreman GUI to set configuration parameters, no file handling. Reuse of generic classes , advantage of a hierarchical model Same tool used for node installation and configuration Easier than before with the puppet-dpm module Cons: First approach to the tools not so much friendly Passwords in clear on Foreman server Less consciousness of configuration details, harder to debug in case of problem 23/11/2016 A. Doria - DPM Workshop 2016 - Paris A.Doria

EPEL testbeds in Italy Each new DPM version is first released in EPEL-testing repo by the DPM developers Two testbed installations: Frascati: installed in 2013 for the first time, Head node + 2 pool nodes (one physical and one virtual), is a “official” EPEL testbed for DPM Roma: instantiated at the end of April 2014 for the first time, now migrated to Ovirt+CEPH. “private” testbed but fully functional and re-installable very quickly. Validation of DPM 1.8.7, 1.8.8, 1.8.9, 1.8.10, 1.8.11 puppet-dpm module validated this summer. 23/11/2016 A. Doria - DPM Workshop 2016 - Paris

EPEL testing - DPM 1.9.0 The new release has several new features. The upgrade of Frascati testbed from Dpm-1.8.11 to Dpm-1.9.0 was smooth for the components already present in the old release. Some more parameters to configure, via Foreman. Some issues in the test of the new DOME flavour. Initial tests performed with the new dpm-tester tool, that tries transfers with different protocols. Very useful! We started to test the quotatokens and the caching mechanisms. 23/11/2016 A. Doria - DPM Workshop 2016 - Paris

23/11/2016 A. Doria - DPM Workshop 2016 - Paris

Ongoing and planned activities related to DPM Project about storage access from external resources and about caching Tests with the HTTP Dynamic Federation These activities will also contibute to the WLCG Regional Federation Demonstrator, as presented at Nov 16 GDB 23/11/2016 A. Doria - DPM Workshop 2016 - Paris

Storage access from external resources Project at INFN (joint ATLAS and CMS) about storage access by jobs running on cloud resources. Different Cloud providers and/or external resource owners Aruba CloudItalia Microsoft Azure ($20.000 grant now in place, collaboration starting now) Different possibilities for data access GPFS over WAN (with AFM cache) Already in place between CNAF and Bari, but needs some tuning for clouds Not general purpose, needs GPFS at both sites Storage federations Xrootd and Https/WebDAV Access to storage federations through distributed cache 23/11/2016 A. Doria - DPM Workshop 2016 - Paris

Usecase for DPM cache We plan to setup testbeds with Microsoft Azure and CloudItalia, with cached data access: use of DPM in caching mode We also plan to evaluate: the full in-cloud DPM setup the hybrid situation with the DPM head node is installed at INFN and DPM volatile pools are in the cloud, acting as caches for the jobs running in the cloud. Interesting solutions also in view of diskless sites. 23/11/2016 A. Doria - DPM Workshop 2016 - Paris

Tests with DynaFed In the last years we performed tests with DPM in HTTP Dynamic Federation (results presented at Chep 2015): PROOF-based analysis jobs accessed with HTTPS/WebDav protocol to input datasets stored in two different DPM SEs (Frascati and Napoli) using the ATLAS federator server located at DESY. The fallback mechanism of the Dynamic Federation behaved as expected, with a delay due to the transition phase: the jobs accessed data on the nearest SE; if it went down they were redirected to the other server. To extend this testing activity, a new Dynamic Federation will be set up, installing a federator server for ATLAS in Italy Several ATLAS sites (different SRM: DPM and StoRM) will be involved, starting with Frascati, Napoli, Roma and CNAF. Functionality and performance tests will be accomplished. 23/11/2016 A. Doria - DPM Workshop 2016 - Paris

Conclusions Our activity with the DPM collaboration is Very useful for the optimal management of our production site resources Stimulating for experimentations in correlated fields DPM greatly improved with the latest releases. I want to thank the DPM developers for the great work and for their helpfulness ! 23/11/2016 A. Doria - DPM Workshop 2016 - Paris