1. Data Management The GSM-WG Perspective

2. Background SRM is the Storage Resource Manager A Control protocol for Mass Storage Systems Standard protocol: OGF GSM-WG –Chairs: A Shoshani (LBNL), J Jensen (STFC RAL)

3. Who Is Using It? EGEE, OSG,… WLCG … Not only academic HPC TIER 0 Country or ROC

4. Storage Element Implementations dCache (DESY+FNAL) DPM (CERN) CASTOR (CERN+RAL) BestMan (LBNL) Jasmine (JLAB) StoRM (INFN/ICTP-EGRID) 111111111111

5. What is a “Storage Element”? Storage Element Disk storage Tape storage THE (gLite) GRID Computing Data Mgmt Metadata Disk storage Disk Pools

6. What is a “Storage Element” Interface to mass storage systems Part of a loosely coupled grid Provide uniform (control) interface Protect the storage system against the grid Enable grid to efficiently use storage

7. What is a Storage Element? Data Transfer Control Interface (SRM)‏ Information System Storage Element Used by EGEE, OSG,… Six-seven different implementations An SRM is a “Storage Element” but not vice versa GIN: Use SRB as Storage Element

8. Tech ~6 interoperating implementations –362 storage elements deployed –226 are SRM1 implementations –6 SRM2 implementations (can’t be quite right) Some Open Source, some not Using SOAP over GSI sockets –Delegation needed for srmCopy –No WS-Anything

9. Where is the File GUID SURL LFN Physical File TURL Physical File Storage Elements Physical File Physical File

10. Information View (simplified) Storage Area Storage Element VOInfo Control Protocol Data Transfer Protocol Space? Resource Accounting Owner/ Access

11. How is the file? Capa- bilities Expiration Mode Release When expired Warn When expired Perma- nent Retention Policy ReplicaOutputCustodial Access Latency OnlineNearline (Offline) (Lost) (…)

12. How I reach the file? File Access Parameters Overwrite Mode YesNo When Different Access Pattern TransferProcessing Connection WANLAN

13. Transfer Protocols WAN protocols –Must always support GridFTP –Suggestion to support HTTP/HTTPS GSI issue though - see tech slide dCache supports http for reading Support LAN protocols –Secure vs insecure

14. LCG: GFAL LCG (will) decide to use GFAL – the “Grid File Access Library” It was decided to interface to EDG SE using SRM 1 interface For now using EDG RM POSIX interface SRM 1 client EDG 2.1 Storage Element Mass Storage EDG SRM

15. EGEE: DICOM server support The Grid Storage Element WP10 DM2 DICOM Server Metadata Encrypt, anonymise Metadata Store keyStore patient metadata Access control on metadata required; different ACLs for different types of metadata

16. Challenges Users State of the Art Middleware Economy, Sustainability Scale, Performance CapabilitiesServices

17. Users Usability Customer mgmt Culture, History Applications

18. Services DiscoveryAccountingAvailabilityTrust

19. State of the Art MediaVirtualisation Web Services

20. Middleware Ease of install And Config Maintenance Support ApplicationsStability

21. Scale, Performance Scale, Performance Volume Number of files Size of files Transfer rates Staging

22. Sustainability, Economy Economy Cost Model AgreementDynamicTrustScale

23. Capabilities SECURITYCurationAccessContent