Magda status and related work in PPDG year 2 Torre Wenaus, BNL/CERN US ATLAS Core/Grid Software Workshop, BNL May 6-7, 2002 CERN

Core/Grid Software Workshop, May 2002 Torre Wenaus, BNL/CERN 2 Status  Full time developer/support since March 1: Wensheng Deng  Development, support: ATLAS DC, US ATLAS testbed, LAr bench test DAQ, GDMP integration  ATLAS DC production usage for cataloging (passive and active) and replication  Improved usability, doc for replication; dynamic replication; more replication modes  DC1 data replication from BNL to CERN to begin  To be used for data replication among the ~18 sites of DC1 phase 0  260k files, ~11TB cataloged at present  GDMP integration beginning  Issues given to GDMP in Jan re: Magda integration fixed in V3  David Rebatto, a CS working for Laura Perini, is helping  GDMP3 being set up in Milan; will install Magda and do integration work there

Core/Grid Software Workshop, May 2002 Torre Wenaus, BNL/CERN 3 PPDG Year 2 & Magda  GDMP integration  Use GDMP to support a ‘publish/subscribe’ replication mode within Magda, targeted at ‘conventional production’ usage (what GDMP is designed for)  Magda still ‘adds value’ with a more flexible approach to data management and replication  Application in demos  Build Magda outwards into distributed job management/analysis, building on Pavel’s work and ‘adding value’ to MOP?  Distributed job management is to be the ATLAS PPDG yr 2 focus  Together with distributed analysis?  Apply as replica manager in hybrid store common project  Build it outwards (or adapt it) to support more metadata? E.g. data history information; HES metadata (HEMP a teeny step in this direction)  To be eclipsed by Alien? Examine Alien and evaluate

Core/Grid Software Workshop, May 2002 Torre Wenaus, BNL/CERN 4 Magda and Globus  Magda currently uses gsiftp for replication between grid-enabled sites  A Magda -> Globus replica catalog ‘loader’ exists, but untested  Globus RC V1 was too feature-weak to integrate  Feedback given to Globus team  Some potential Magda developments deliberately not done, anticipating functionality in next Globus RC version; eg scalability  Now, alpha Globus replica location service is out  We want to alpha test it by integrating it in Magda  Will provide scalability if it works well  Also, alpha Globus robust file transfer service is out  We want to alpha test it by integrating it in Magda  Will simplify Magda if it works well: less error handling