STATUS OF DCACHE N2N AND MONITORING REPORT I
CURRENT SITUATION xrootd4j is a part of dCache implemented in such a way that each change requires new dCache version xrootd4j for dCache versions and 2.2+ have different interfaces for authentication and authorization plugins. N2N Two versions available. Tested and working. dCache version is needed if simultaneous N2N and authentication are required. When given PFN it is transparent. To use gFLNs two pre-requisites: Variable $LFC_HOST to be defined and pointed appropriately Have ATLAS certificate proxy. Documented here:
CURRENT SITUATION Monitoring There is a program that once a minute queries dCache billing DB, makes UDP packets in the xrootd format and sends them to collector. Due to very low overlap of information collected from dCache and xrootd only two variables are sent: in and out traffic. Installed and working at MWT2 and AGLT2
FUTURE PLANS I Xrootd4j itself will become a plugin for dCache, thus enabling easier updates and independence from underlying dCache version. This will require new versions of dCache ( , 2.2.xxx, 2.4)
FUTURE PLANS II N2N There will be just one version of N2N. Already written and unofficially tested Monitoring We get access to most of messages between xrootd client and xrootd4j dCache server. Consequences of this approach: No need for a billing DB and extra process mining it. Gives us a lot of freedom. And we’ll need it. Makes us responsible for it’s performance Need to completely understand xrootd protocol Need to understand what part of it dCache supports Leaves us open to protocol changes Will take me some serious time to write it – week or two
FUTURE PLANS III We should get – hopefully this week a CERN based no- authentication needed copy of LFC to be used by European sites. Expectation is that no changes in N2N will be needed. We should test WebDAV read-only access to LFC Will need new versions of both N2N versions (C++ and Java)
RESERVE
EVENTS BASED Package version: 1.0 Connect event conn id (generated by server) host ip [client version] [protocol] File open event conn id filename file id (generated by server) size mode (r/w) File close event conn id file id bytes read/written [read ops, Vector read ops, write ops ] Disconnect event conn id Connection duration [optional] Events sends it’s info immediately. Collector does: dns lookups (host,client) joins info using connID, fileID
TIMER BASED EVENTS ( ~ ONCE A MINUTE) Package version: 1.0 Server version: xxx Server ip Total bytes read and written Current number of connections Number of connection attempts in last period Number of successful connections in last period List of fileIDs of all currently active files and bytes transferred to/from them.
OVERLAP select protocol, isnew, transfersize, connectiontime from billinginfo; protocol | isnew | transfersize | connectiontime GFtp-1.0 | t | 2698 | 9 GFtp-1.0 | f | | 46 DCap-3.0 | f | | DCap-3.0 | f | | 646 DCap-3.0 | f | | DCap-3.0 | f | | DCap-3.0 | f | | GFtp-1.0 | t | | 6769
DETAILS DCACHE 1 \d billinginfo Column | Type | datestamp | timestamp without time zone | :52: useless cellname | character varying | useless action | character varying | transfer useless - always transfer transaction | character varying | useless pnfsid | character varying | 00005D39999EFE644ABBB4E1DBBE1D4AA61F useless fullsize | numeric | transfersize | numeric | storageclass | character varying | useless isnew | boolean | f - read/write client | character varying | useless connectiontime | numeric | errorcode | numeric | 0 errormessage | character varying | '' protocol | character varying | DCap-3.0 initiator | character varying | door:DCap-umfs03- useless
DETAILS DCACHE 2 \d doorinfo Table "public.doorinfo" Column | Type | Modifiers datestamp | timestamp without time zone | :05: cellname | character varying | DCap-msufs11- action | character varying | request owner | character varying | /DC=org/DC=doegrids/OU=People/CN=Edward Diehl or unknown mappeduid | numeric | or -1 mappedgid | numeric | or -1 client | character varying | unknown transaction | character varying | door:DCap-umfs01- pnfsid | character varying | FC61A F651FC7E90E connectiontime | numeric | 2256 queuedtime | numeric | 0 errorcode | numeric | 0 errormessage | character varying | '' path | character varying | /pnfs/aglt2.org/atlashotdisk/cond10_data/000021/lar/cond10_data lar.COND/cond10_data lar.COND._0008.pool.ro ot