Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT DPM / LFC and FTS news Ricardo Rocha ( on behalf of the IT/GT/DMS section )

Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT DPM / LFC Status, Issues, Developments

CERN IT Department CH-1211 Geneva 23 Switzerland t GT Release Status Current production version is – lcgdm-183https://svnweb.cern.ch/trac/lcgdm/blog/official-release- lcgdm-183 –In EPEL, EMI1 and EMI2 (no gLite) What’s included –EPEL compliance –New DAV frontend (old dpm httpd is gone) –Thread safe clients –… What’s not included –New DPM XROOT plugin (released independently) –Any of the new DMLITE developments –More on this later 3

CERN IT Department CH-1211 Geneva 23 Switzerland t GT Recent Issues Issue with LFC API / Py26 (#84716) –Tracked down to issue with EPEL5 Swig version –Currently considering the best solution Cleaning up invalid LFC replicas (#83335) –Solved… bulk requests using API/CLI tools DAV EMI2 install failure (#85141) –Related to dependencies on gridsite, solved with the EPEL update EMI2 LFC dies regularly (#85161) –Happens to any of lfc/dpm/dpns daemons –Documented as a known issue with bit support (#81508) –Available in EMI2 and EPEL repositories 4

CERN IT Department CH-1211 Geneva 23 Switzerland t GT What’s next Lots of recent developments –We’re starting to push them now (next slide) Next core release: –First DMLITE release DAV frontend will start using the new libraries Other components not using dmlite for now –Improved replication mechanism –Lots of other small fixes –Feature complete… finishing certification Change in the release process –Independent component releases –Faster, lighter releases 5

CERN IT Department CH-1211 Geneva 23 Switzerland t GT What you’ll see soon after… DMLITE is our refactored core library –(wiki) –(paper) With many available plugins –‘Ready’: Legacy, MySQL, Oracle –‘Evaluation’: Memcache, S3 –‘Development’: Hadoop, VFS (Local Mount) And many frontends relying on them –‘Production’: HTTP/DAV, NFS (read-only) –‘Ready’: XROOT –‘Development’: GridFTP (dmlite based) Opens many many doors… 6

CERN IT Department CH-1211 Geneva 23 Switzerland t GT Common Interests FAX and LFC –ATLAS relies on the LFC for the LFN/SFN mapping –Issue with universal read-only access –Solved with a new LFC release (deployed at CERN) FAX and DPM –New DPM XROOT plugin deployed in several UK sites, part of the ATLAS XROOT federation –Requires DPM XROOT or higher Which itself requires DPM >= –Issue with core XROOT version in EPEL Stuck at 3.0.x in EPEL5 due to backwards incompat change Will be solved with XROOT 3.3, early September We can then do a production release of our plugin 7

CERN IT Department CH-1211 Geneva 23 Switzerland t GT Common Interests DPM and Random I/O –Longstanding issue with ATLAS DPM usage –Bad RFIO performance forced ‘download first’ –We’re doing a thorough evaluation of the current alternatives to RFIO XROOT vs HTTP vs RFIO NFS to be included when it’s writable In collaboration with ASGC –Results will make you happy 8

CERN IT Department CH-1211 Geneva 23 Switzerland t GT Common Interests DPM and Random I/O –Longstanding issue with ATLAS DPM usage –Bad RFIO performance forced ‘download first’ –We’re doing a thorough evaluation of the current alternatives to RFIO XROOT vs HTTP vs RFIO NFS to be included when it’s writable In collaboration with ASGC –Results will make you happy 9 LAN / Chunk Size: / File Size: ProtocolN. ReadsRead SizeRead Time HTTP50022,773, HTTP100046,027, XROOT50022,773, XROOT100046,027, RFIO50022,773, RFIO100046,027, PRELIMINARY

CERN IT Department CH-1211 Geneva 23 Switzerland t GT Common Interests DPM and Random I/O –Longstanding issue with ATLAS DPM usage –Forces ‘download first’ –We’re doing a thorough evaluation of the current alternatives to RFIO XROOT vs HTTP vs RFIO NFS to be included when it’s writable In collaboration with ASGC –Results will make you happy 10 LAN / Chunk Size: / File Size: / 5000 Reads ProtocolMax. VectorRead SizeRead Time HTTP81,166,613, HTTP162,156,423, HTTP243,211,861, HTTP324,226,877, HTTP648,535,839, XROOT81,166,613, XROOT162,156,423, XROOT243,211,861, XROOT324,226,877, XROOT648,535,839, PRELIMINARY

CERN IT Department CH-1211 Geneva 23 Switzerland t GT Common Interests DPM and Random I/O –Longstanding issue with ATLAS DPM usage –Bad RFIO performance forced ‘download first’ –We’re doing a thorough evaluation of the current alternatives to RFIO XROOT vs HTTP vs RFIO NFS to be included when it’s writable In collaboration with ASGC –Results will make you happy 11 WAN / Chunk Size: / File Size: ProtocolN. ReadsRead SizeRead Time HTTP50022,773, HTTP100046,027, XROOT50022,773, XROOT100046,027, RFIO50022,773,112 RFIO100046,027,143 PRELIMINARY

CERN IT Department CH-1211 Geneva 23 Switzerland t GT Other interesting activities ATLAS analysis evaluation (Athena/ROOT) –Working both with Wahid and ShuTing on this HTTPS to HTTP redirection now available Waiting for an Athena fix for completing HTTPS tests – Similar activity with CMS for HTTP(S) Our goal is to evaluate performance of DPM directly from the experiment analysis –We need a lot of help on this 12

Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT FTS 3, GFAL/LCG_UTIL Status, Issues, Developments

CERN IT Department CH-1211 Geneva 23 Switzerland t GT FTS 3 Status –Available on the CERN Pilot Service and RAL Similar SE configuration as in FTS2 pilot Tests are visible in the standard monitoring –Continuous iterations (fixes and new features) –Current features are equivalent to FTS2 + GridFTP Session Reuse (PLEASE try it) 14

CERN IT Department CH-1211 Geneva 23 Switzerland t GT FTS 3 Recent bugs fixed –EOS SRM space token usage –SRM not creating non existing dest dir (FIXED) –Proxy renewal race condition (FIXED) New features coming soon –Transfer auto-tuning based on previous transfers and network status –Draining FTS3 server –Database records history cleanup / purge jobs Organized testing starting soon 15

CERN IT Department CH-1211 Geneva 23 Switzerland t GT GFAL GFAL(1) is available in both EMI1 and EMI2 –Bug fixes and security fixes –Includes 32 bit support (with next EMI update) –New features go to GFAL2 16

CERN IT Department CH-1211 Geneva 23 Switzerland t GT GFAL2 Status of GFAL2 –Production release in EMI2 Update 2 Transfer API improvements Python bindings with transfer support Various optimizations and bug fixes Coherent documentation –New features coming soon Command line tools XROOT plugin HTTP/DAV and 3 rd party transfer xrootd Building block for FTS3 –Meaning it’s already heavily in use 17

CERN IT Department CH-1211 Geneva 23 Switzerland t GT LCG_UTIL Current production version is –Released in EMI1 and EMI2 –32 bits support –In maintenance mode from here on… new features go to GFAL2 18