EMI is partially funded by the European Commission under Grant Agreement RI Roadmap & Future Work Ricardo Rocha ( on behalf of the DPM team )

EMI INFSO-RI Our system works – We should make sure it stays like this – Major changes increase the risk Some small changes make big impacts – Synchronous GET requests, improved load balancing, … – We are doing these first But there’s a future beyond those… – It’s a BIG DATA world out there – There are now building blocks we can make use of Future is three-fold 2

EMI INFSO-RI Current Roadmap: Core 3 Package consolidation: EPEL compliance Fixes in multi-threaded clients Synchronous GET requests Replace httpg with https on the SRM Improve dpm-replicate (dirs and FSs) GUIDs in DPM Reports on usage information Quotas? Accounting metrics HOT file replication

EMI INFSO-RI Current Roadmap: More 4 HTTP / DAV ( read only ) GridPP Admin Toolkit NFS 4.1 / pNFS ( read only ) DMLITE ( MySQL, read only ) New XROOTD plugin Experimental DMLITE plugins

EMI INFSO-RI What’s next? S3, Hadoop, CEPH, ZFS, … – Lots of new things getting to production state Can we make use of them? – DPM as it is does not ease life in this respect Preparing the future 5 Change Me WEBDAV pNFS XROOT DPM DPNS

EMI INFSO-RI Significant code refactoring almost finished – Making DPM plugin friendly Separation between namespace and pool management – DMLITE is a plugin stack NS: MySQL, Oracle, memcache, DynFederation, … POOL: Native DPM, HADOOP, S3, CEPH, … Meet DMLITE 6 WEBDAV pNFS XROOTD DMLITE NS POOL NATIVE DPM CLOUD (S3, …) HADOOP

EMI INFSO-RI MySQL – Our first new plugin, first version finished Memcached – Ongoing work – For improved nameserver performance Cloud / S3 – What do we need in addition to HTTP? – How hard is it to have one additional pool in the cloud? Hadoop (or CEPH, or ZFS, …) – And how hard is it to have one additional pool with a different backend, sharing the same namespace? DMLITE Plugins 7

EMI INFSO-RI WebDAV vs DPNS – What’s missing in the DAV standard? – Transition / evaluation: we are working on a DAV enabled DPNS client HTTP is gaining traction – GET / PUT only? Or can we use it for random i/o? – So easy to use it’s tempting… Open Questions 8

EMI INFSO-RI DPM is a grid-aware lightweight, easy to configure storage system – And it will always stay like that Some coming changes will greatly improve performance Refactoring gives us access to what others are doing – Standard building blocks, standard clients Lots of new things ready to be used – But we need to improve our testing process – And faster release cycles Summary 9