1. DPM at ATLAS sites and testbeds in Italy
Alessandro De Salvo (INFN, Roma1),
Alessandra Doria (INFN, Napoli),
Elisabetta Vilucchi (INFN, Laboratori Nazionali di Frascati)
23/11/2016
A. Doria - DPM Workshop Paris

2. DPM at ATLAS IT Sites
3 out of 4 ATLAS Tier2 in Italy adopted DPM since 2007.
The Tier1 at CNAF (Bologna) ad Milano Tier2 use STORM with GPFS.
The Site Managers of the 3 DPM Tier2s (Frascati National Labs, Napoli and Roma) are involved in the DPM collaboration
During the last year the ATLAS Tier3 in Cosenza deployed its storage system (~400 TB) with DPM.
Italian ATLAS sites
Milano
Bologna T1
Roma
Frascati
Napoli
Cosenza
23/11/2016
A. Doria - DPM Workshop Paris

3. DPM setup at ATLAS IT Tier2s
The storage setup is similar, with some peculiarity:
INFN FRASCATI: 1PB, 11 pool nodes
Head node on a virtual machine and MySql DB on a physical server
DB replication with MySQL master/slave configuration .
INFN NAPOLI: 2PB, 22 pool nodes
Head node and Mysql DB on the same physical server
DB daily backups with Percona xtrabackup.
INFN ROMA: 1.5PB , 16 pool nodes
MySQL main replica in the DPM head node,
Slave replica on a different node, with backup
The three sites run with DPM , the latest release in EPEL
23/11/2016
A. Doria - DPM Workshop Paris

4. Puppet + Foreman for DPM configuration
13/12/2013
Puppet + Foreman for DPM configuration
All the 3 sites use puppet with Foreman for DPM configuration (and for installation and configuration of most/all site servers)
DPM Workshop 2015: “Parametrized Puppet modules developed: Puppet manifests released with DPM must be adapted in order to handle parameters from Foreman”
New releases (starting with ):
DPM developers released the modules puppet-dpm and puppet-dmlite that make the configuration much easier, directly allowing to use both Foreman and hiera as ENC.
23/11/2016
A. Doria - DPM Workshop Paris
A.Doria

5. Puppet + Foreman setup: Pros & Cons
13/12/2013
Puppet + Foreman setup: Pros & Cons
Pros:
Use Foreman GUI to set configuration parameters, no file handling.
Reuse of generic classes , advantage of a hierarchical model
Same tool used for node installation and configuration
Easier than before with the puppet-dpm module
Cons:
First approach to the tools not so much friendly
Passwords in clear on Foreman server
Less consciousness of configuration details, harder to debug in case of problem
23/11/2016
A. Doria - DPM Workshop Paris
A.Doria

6. EPEL testbeds in Italy
Each new DPM version is first released in EPEL-testing repo by the DPM developers
Two testbed installations:
Frascati: installed in 2013 for the first time, Head node + 2 pool nodes (one physical and one virtual), is a “official” EPEL testbed for DPM
Roma: instantiated at the end of April 2014 for the first time, now migrated to Ovirt+CEPH. “private” testbed but fully functional and re-installable very quickly.
Validation of DPM 1.8.7, 1.8.8, 1.8.9, ,
puppet-dpm module validated this summer.
23/11/2016
A. Doria - DPM Workshop Paris

7. EPEL testing - DPM 1.9.0 The new release has several new features.
The upgrade of Frascati testbed from Dpm to Dpm was smooth for the components already present in the old release.
Some more parameters to configure, via Foreman.
Some issues in the test of the new DOME flavour.
Initial tests performed with the new dpm-tester tool, that tries transfers with different protocols. Very useful!
We started to test the quotatokens and the caching mechanisms.
23/11/2016
A. Doria - DPM Workshop Paris

8. 23/11/2016
A. Doria - DPM Workshop Paris

9. Ongoing and planned activities related to DPM
Project about storage access from external resources and about caching
Tests with the HTTP Dynamic Federation
These activities will also contibute to the WLCG Regional Federation Demonstrator, as presented at Nov 16 GDB
23/11/2016
A. Doria - DPM Workshop Paris

10. Storage access from external resources
Project at INFN (joint ATLAS and CMS) about storage access by jobs running on cloud resources.
Different Cloud providers and/or external resource owners
Aruba
CloudItalia
Microsoft Azure ($ grant now in place, collaboration starting now)
Different possibilities for data access
GPFS over WAN (with AFM cache)
Already in place between CNAF and Bari, but needs some tuning for clouds
Not general purpose, needs GPFS at both sites
Storage federations
Xrootd and Https/WebDAV
Access to storage federations through distributed cache
23/11/2016
A. Doria - DPM Workshop Paris

11. Usecase for DPM cache
We plan to setup testbeds with Microsoft Azure and CloudItalia, with cached data access:
use of DPM in caching mode
We also plan to evaluate:
the full in-cloud DPM setup
the hybrid situation with the DPM head node is installed at INFN and DPM volatile pools are in the cloud, acting as caches for the jobs running in the cloud.
Interesting solutions also in view of diskless sites.
23/11/2016
A. Doria - DPM Workshop Paris

12. Tests with DynaFed
In the last years we performed tests with DPM in HTTP Dynamic Federation (results presented at Chep 2015):
PROOF-based analysis jobs accessed with HTTPS/WebDav protocol to input datasets stored in two different DPM SEs (Frascati and Napoli) using the ATLAS federator server located at DESY.
The fallback mechanism of the Dynamic Federation behaved as expected, with a delay due to the transition phase: the jobs accessed data on the nearest SE; if it went down they were redirected to the other server.
To extend this testing activity, a new Dynamic Federation will be set up, installing a federator server for ATLAS in Italy
Several ATLAS sites (different SRM: DPM and StoRM) will be involved, starting with Frascati, Napoli, Roma and CNAF.
Functionality and performance tests will be accomplished.
23/11/2016
A. Doria - DPM Workshop Paris

13. Conclusions Our activity with the DPM collaboration is
Very useful for the optimal management of our production site resources
Stimulating for experimentations in correlated fields
DPM greatly improved with the latest releases.
I want to thank the DPM developers for the great work and for their helpfulness !
23/11/2016
A. Doria - DPM Workshop Paris