Enabling Grids for E-sciencE EGEE-II INFSO-RI Status of SRB/SRM interface development Fu-Ming Tsai Academia Sinica Grid Computing

EGEE-II INFSO-RI Enabling Grids for E-sciencE 2 Outline What is SRM? Why SRM? What is SRB? Our SRM architecture Progress Future plan

EGEE-II INFSO-RI Enabling Grids for E-sciencE 3 What is SRM? SRM is an unique interface for accessing diffident backend storages for diffident middleware. Easy to develop applications to adapt different backend storages. Provide space and file management on the storage system. SRM is the web service interface and the implementation usually depends on the backend storage technology.

EGEE-II INFSO-RI Enabling Grids for E-sciencE 4 Why SRM? Storage Elements (SE) can use different type of technologies –CASTOR, dCache, DPM, BeStMan,...,etc. –DRM (Disk Resource Manager)/TRM (Tape Resource Manager) /HRM (Hierarchical Resource Manager) Grid middleware needs to access files with an uniform interface –Manage storage resources –Not a file transfer protocol

EGEE-II INFSO-RI Enabling Grids for E-sciencE 5 SRM features Provides space management Provides an uniform access interface Manages DRM/TRM/HRM Does not transfer files itself. Manage the life time of file

EGEE-II INFSO-RI Enabling Grids for E-sciencE 6 What is SRB (Storage Resource Broker) ? Developed by San Diego Supercomputer Center A distributed file management system (Data Grid), based on a client-server architecture. Allows users to access files seamlessly across a distributed environment, based upon their attributes rather than just their names or physical locations. It replicates, syncs, archives, and connects heterogeneous resources in a logical and abstracted manner.

EGEE-II INFSO-RI Enabling Grids for E-sciencE 7 SRB Physical Structure Oracle ClientSRB Server Oracle RDBMS SRB location B SRB location B SRB location D SRB Server Storage Space Storage Driver SRB Server Storage Space Storage Driver SRB Server Storage Space Storage Driver location X

EGEE-II INFSO-RI Enabling Grids for E-sciencE 8 SRM for SRB – Our Implementation

EGEE-II INFSO-RI Enabling Grids for E-sciencE 9 Cache server (+gridftp server) Architecture Overview Core Cache repository SRB+DSI File catalog SRB/gridftp Gridftp/management API SRM API File transfer (gridftp) Web Service Data server management Users/applications

EGEE-II INFSO-RI Enabling Grids for E-sciencE 10 Support Flexible File/Space Types SRM system has a caching mechanism and has to take care of SRM issues like file lifetime, space management, …,etc. –Volatile space –Durable space –Permanent space In our implementation –Volatile space & Durable space  In the temporary storage space. –Permanent space  In the SRB env.

EGEE-II INFSO-RI Enabling Grids for E-sciencE 11 Checking Disk Status How to get the disk usage of the space? –Need to know the free and used space on cache server and SRB server –SRB does not provide the mechanism to monitor resource usage –We need to know the usage  Space management In our implementation –InfoServer:  Deployed on cache server and non-Mcat enabled SRB server –SRBInfoServer:  Deployed on Mcat-enabled SRB server

EGEE-II INFSO-RI Enabling Grids for E-sciencE 12 Naming Mapping between SURL, TURL, and file name –Different naming space on cache server and SRB server  /XXX/YYY/ZZZ: cache server  /Zone/home/UserAccount.UserDomain/: SRB server  How to map the them?? In our implementation –Use AMGA to provide uniform naming space  /XXX/YYY/ZZZ –How to map to TURL  On cache server mounted point  On SRB server User’s home collection

EGEE-II INFSO-RI Enabling Grids for E-sciencE 13 Typical Use Case

EGEE-II INFSO-RI Enabling Grids for E-sciencE 14 Progress What we have done: –We have finished the parts about authorizing users, web service interface (just interface) and gridftp deployment, and SRB-DSI, and some functions like directory functions, permission functions,..,etc. –Milestone: demo during SC07. What we are doing: –Now, we are focusing on the implementation of our core (data transfer functions and space management).

EGEE-II INFSO-RI Enabling Grids for E-sciencE 15 Future Plan Short term –Implement interface compatible SRM version 2.2. Mid-term –Interact and test with other data management systems such as Castor, dCache, …,etc. Long-term –Interoperate with gLite.  Hope glite users who join VO can access files and resources in SRB and vice versa.

EGEE-II INFSO-RI Enabling Grids for E-sciencE 16 Future Plan

EGEE-II INFSO-RI Enabling Grids for E-sciencE 17 Future Plan SRB SRM

EGEE-II INFSO-RI Enabling Grids for E-sciencE 18 References SRM-SRB interface project wiki page – SRM working group: – SRB: – Globus: – CoG: – Axis: –

EGEE-II INFSO-RI Enabling Grids for E-sciencE 19 Thanks for your attention