1. FP7-INFRA-222667 Enabling Grids for E-sciencE www.eu-egee.org EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008 Grid services Dusan Vudragovic dusan@phy.bg.ac.yu Scientific Computing Laboratory Institute of Physics Belgrade, Serbia

2. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Set of basic Grid services Job submission/management File transfer (individual, queued) Database access Data management (replication, metadata) Monitoring/Indexing system information

3. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia VOMS (1/4) Virtual Organization Membership Service – Problem description

4. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia VOMS (2/4) – Grid Security Infrastructure (GSI) enables secure authentication and communication over an open network  Public key encryption  Digital X.509 certificate  Secure Sockets Layer (SSL) communication protocol – Certification Authority (CA) – grid-mapfile mechanism – LCAS/LCMAPS mechanism allow for a more detailed definition of user privilege – VOMS server example https://voms.phy.bg.ac.yu:8443/voms/aegis

5. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia VOMS (3/4)

6. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia VOMS (4/4) – Use delegation to establish dynamic distributed system Computing Center VO Rights Computing Center Service

7. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia BDII (1/2) Berkely Database Information Index – Information Service (IS)  Globus Monitoring and Discovery Service (MDS) GLUE Schema Lightweight Directory Access Protocol (LDAP) Distinguished Name (DN) Directory Information Tree (DIT) Grid Resource Information Server (GRIS)  Relational Grid Monitoring Architecture

8. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia BDII (2/2) GStat http://goc.grid.sinica.edu.tw/gstat/ GOC DB https://goc.gridops.org/

9. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia RGMA Relational Grid Monitoring Architecture – Global distributed relational database – Model is more powerful than the LDAP-based one – Advance query operations – Architecture consists of three major components  Producers - provide the information  Consumers - request the information  Registry - mediates the communication between the Producers and the Consumers EGEE Accounting Portal http://www3.egee.cesga.es/gridsite/accounting/CESGA/egee_view.php

10. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia WMS(1/2) Run the Workload Management System – To accept job submissions – Dispatch jobs to appropriate Compute Element (CE) – Allow users  To get information about their status  To retrieve their output A configuration file on each UI node determines which WMS node(s) will be used When a user submits a job, JDL options are to: – Specify CE – Allow WMS to choose CE (using optional tags to define requirements) – Specify SE (then WMS finds “nearest” appropriate CE, after interrogating File catalogue service)

11. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia WMS (2/2) Workload Management System WMS monitoring tool

12. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia LB Logging and Bookkeeping service – Who did what and when? – What’s happening to my job? – Usually runs on WMS node

13. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia CE Homogeneous set of worker nodes Grid gate node Local resource management system: Condor / PBS / LSF master Gatekeeper Job request Loc. Info system Logging A&A Information system L&B A CE is a grid batch queue with a “grid gate” front-end:

14. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia SE Storage elements hold files: write once, read many Replica files can be held on different SE: – “close” to CE; share load on SE File Catalogue - what replicas exist for a file and where are they? Loc. Info System Event Logging A&A GridFTP Disk arrays or tapes Info system L&B Gatekeeper File transferRequests

15. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Other Grid services PX (MyProxy) FTS (File Transfer Service) LFC (Logical File Catalog) AMGA (ARDA Metadata Grid Application)

16. Enabling Grids for E-sciencE FP7-INFRA-222667 EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia What really happens Filecatalogue Logging & Book-keeping WMSStorageElementComputingElement InformationService Job Status DataSets info Auth. &Auth. Job Submit Event Job Query Job Status Input “sandbox” Input “sandbox” + Broker Info Output “sandbox” Output “sandbox” Publish SE & CE info User interface