Author - Title- Date - n° 1 Partner Logo WP5 Summary Paris John Gordon WP5 6th March 2002

John Gordon - SE Workshop - 24/09/01° 2 u WP5 Meeting 4th March u ReplicaManager & StorageElement

John Gordon - SE Workshop - 24/09/01° 3 WP5 meeting u Deliverables n D5.1 - Review of Current Technology s submitted and accepted n D5.2 - Architecture and Design s submitted and accepted u Testbed1 n RFIO server on SE, Client on CE, SE, WN n Information providers for SE use by RB (and Files) n Staging scripts in GDMP

John Gordon - SE Workshop - 24/09/01° 4 So what is an SE in Testbed1? u A disk server u running GDMP v2.1 u running information providers u running data servers (RFIO, GridFTP) u optionally NFS mount user data on local CE u optionally stage replicated data to MSS

John Gordon - SE Workshop - 24/09/01° 5 Testbed1 u Testbed 1.0 January n RFIO rpms in overall package lists but not on all nodes n Staging script rpms corrupt, not tested with GDMP n SE information providers used by RB n File information providers tested? u Testbed 1.1 and later n RFIO tested on SE, CE, WN n Staging scripts finally tested with Castor n Multiple instances of GDMP for multiple VOs

John Gordon - SE Workshop - 24/09/01° 6 Testbed2 u SE will be a Grid Service that interfaces storage systems to the Grid u It will support multiple data transfer protocols and Mass Storage Systems n although a particular SE may only support one protocol and one MSS u It will present a common API to storage and will add extra functionality

John Gordon - SE Workshop - 24/09/01° 7 Interface 1 Interface 3 Interface 2 Message Queue Session Manager System LogHouse Keeping MetaData MSS Interface MSS Interface MSS1MSS2 Top layer Core Bottom layer Clients Storage Element SE Architecture

John Gordon - SE Workshop - 24/09/01° 8 WP5 Testbed1 Status u RFIO n Castor-enabled commands plus rfiod in RPM n Delivered to IT today n Should be in Testbed 1.1 next week n Library in CERNLIB on CE u Information Providers n Delivered to testbed1 n Not widely tested n schema extended for testbed1.1 to support multiple VO

John Gordon - SE Workshop - 24/09/01° 9 WP5 Testbed1 Status u Staging to MSS n Scripts written using RFIO n Tested to disk n Still need to be packaged (today?) n Can be used as-is with RFIO or modified for your HSM n Fundamental problem of uid/gid at CERN n not tested with GDMP

John Gordon - SE Workshop - 24/09/01° 10 Published Plans for 2002 u From December 2001December 2001 u Revise? Revise?

John Gordon - SE Workshop - 24/09/01° 11 Project List u Core SE n Gradually breaking down design into components. u GSI/Castor - multithreads being added, mapfile needed u Disk Pool Manager - July u Information Provider Testing n performanc testing and R-GMA testin u GridFTP & Globus i/o (JJ, MG) n HSM (Globus xio)

John Gordon - SE Workshop - 24/09/01° 12 Project List 2 u RFIO n RFIO over GridFTP, u BBFTP n RFIO, HPSS, GridFTP Interface u Castor Filesystem n use slashgrid module for handling grid certs n VFS rather than Coda

Author - Title- Date - n° 13 Partner Logo WP1/2/5/8 Paris Wednesday 6th March 2002

John Gordon - SE Workshop - 24/09/01° 14 RM and SE Issues u What is an owner? n File creator gets full control and can delegate. n Could call ‘administrator’ rather then owner. u Who owns files in SE? n RM has admin rights for master and replicas u File Metadata n many items of metadata need to be copied when replica is created so that (eg) access rights are the same for replicas as master.

John Gordon - SE Workshop - 24/09/01° 15 Security u GSI taken for granted for authentication u What model of authorisation? n Will CAS meet requirements? We don’t know yet. n How fine-grained should permissions be? (file, directory, role?) directory u Input to Security Group

John Gordon - SE Workshop - 24/09/01° 16 Storage u All disk servers should be SEs even if integrated in CE u Advanced reservation in SE n API to get filenames for new files in SE u How to handle reservation of internal WN disk? n Does batch system handle this?

John Gordon - SE Workshop - 24/09/01° 17 BrokerInfoFile u Extensions are needed in the short term for TB1 n Which SE(s) n Output Filename n TFN? s WP8 want all files to look local

John Gordon - SE Workshop - 24/09/01° 18 Metadata u Additional metadata still to be defined.

John Gordon - SE Workshop - 24/09/01° 19 Additional Data Interfaces u Extra information on creation - permanent u Root server n supports collections of files and partial file access u Slashgrid n under development as local filesystem on grid site n could develop as unix filesystem interface to SE. u Remote open?

John Gordon - SE Workshop - 24/09/01° 20 ReplicaManager examples u By Heinz Stockinger u How does one apply ACL to file being registered? n Possible now by creating file yourself in SE and registering with RM n not when using copy and register

John Gordon - SE Workshop - 24/09/01° 21 Scheduling & Open u Example of RB/RM scheduling from Kurt

John Gordon - SE Workshop - 24/09/01° 22 JDL extensions u Access pattern hints u Partial file access