The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Workload Management System + Logging&Bookkeeping Installation and Configuration Nabil Joint EPIKH/EUMEDGRID Support event in Rabat Morocco,

2 Rabat, Joint EPIKH/EUMEDGRID Support Site Admin Outline Brief introduction to WMS, LB Before installation Preliminaries steps : Preparing the Linux machine Installing the Middleware 3.1 – Step 0 : Repository settings – Step 1 : WMS and LB installation – Step 2 : Yaim Configuration of installed services Testing of installed services

3 Rabat, Joint EPIKH/EUMEDGRID Support Site Admin gLite Grid WM service : WMS

o The Workload Management System (WMS) is the gLite service that allows users to submit jobs, and performs all tasks required to execute them, without exposing the user to the complexity of the Grid. o The workload manager (WM) is the principal component in the WMS. o Purpose of the Workload Manager (WM) is to accept and satisfy requests for job management coming from its clients o The WM hands over the job to an appropriate Computing Element (CE) for execution taking into account requirements and the preferences expressed in the job description. 4 Rabat, Joint EPIKH/EUMEDGRID Support Site Admin gLite Grid WM service : WMS

o The Logging and Bookkeeping service (LB) tracks jobs in terms of event (important points of job life, e.g. submission, finding a matching CE, starting execution etc.) gathered from various WMS components as well as CEs. o L&B collects informations about all important events in the Grid job life -transitions between components or services (WMS components) -results of matching and brokerage -waiting in queue systems -start and end of execution 5 Logging and Bookkeeping service (LB) Rabat, Joint EPIKH/EUMEDGRID Support Site Admin

The instructions provided in this presentation assume that you are going to use a machine with Scientific Linux 4.8 i bit installed.  Virtual Machine image (GILDA VM Base_SLC4.8_i386) available at: We will install a 3.1 Middleware version 32 bit –The YUM package manager is considered the default installation tool –The Yaim is a tool to configure the middleware Grid services For this TEST installation: we are going to configure a VO Eumed 6 Before installation Rabat, Joint EPIKH/EUMEDGRID Support Site Admin

Check that you have a valid hostname –public IP address with forward and reverse DNS resolution –to edit the hostname (must be root) Network Time Protocol settings –to edit the hostname (must be root) –and configure the service to start at boot 7 Preparing the Linux machine Rabat, Joint EPIKH/EUMEDGRID Support Site Admin bash# hostname -f bash# vi /etc/hosts bash# hostname bash# domainname bash# vi /etc/hosts bash# hostname bash# domainname bash# yum install ntp –y bash# /etc/init.d/ntpd stop bash# ntpdate #retype it more times bash# /etc/init.d/ntpd start bash# yum install ntp –y bash# /etc/init.d/ntpd stop bash# ntpdate #retype it more times bash# /etc/init.d/ntpd start bash# chkconfig ntpd on

To login to the VM you can use the winscp then open a terminal and write the password Password: grid Rabat, Joint EPIKH/EUMEDGRID Support Site Admin

o Specify the mrepo host: export MREPO= o Configure the repository as follows: REPOS="dag glite-GENERIC lcg-CA jpackage glite-WMS glite-LB" o Get repositories with: for name in $REPOS; do wget $MREPO/$name.repo -O /etc/yum.repos.d/$name.repo; done 9 Step 0: Repository settings Rabat, Joint EPIKH/EUMEDGRID Support Site Admin

10 Step 0: Repository settings Rabat, Joint EPIKH/EUMEDGRID Support Site Admin Repository description file sample (check it)

o Modify the glite-GENERIC.repo as following: (vi /etc/yum.repos.d/glite-GENERIC.repo) # # gLite generic repositories # [glite-generic] name = gLite 3.1 generic baseurl = $basearch enabled = 1 protect = 0 [glite-generic_updates] name = gLite 3.1 generic updates baseurl = enabled = 0 protect = 0 11 Some Modifications Rabat, Joint EPIKH/EUMEDGRID Support Site Admin

o Then update your host: yum clean all o Install CAs on ALL profiles: yum install ca-policy-egi-core -y o Install jdk: yum install jdk 12 YUM install Rabat, Joint EPIKH/EUMEDGRID Support Site Admin

o Install via YUM, the WMS and LB metapackages: yum install glite-WMS –y yum clean all yum install glite-LB –y Move the host certificate provided you by the CA to the right path /etc/grid-security –Give them the right UNIX permissions –All nodes, except UI, WN and BDII-Site require the host certificate/key files to be installed. Please Contact your national Certification Authority (CA) to understand how to obtain a host certificate 13 Step 1: WMS and LB installation Rabat, Joint EPIKH/EUMEDGRID Support Site Admin

o Move the host cert to the right path mv /root/pcXXcert.pem /etc/grid-security/hostcert.pem mv /root/pcXXkey.pem /etc/grid-security/hostkey.pem o Give them the right permissions chmod 400 /etc/grid-security/hostkey.pem chmod 644 /etc/grid-security/hostcert.pem ~]# ll /etc/grid-security/ total 32 drwxr-xr-x 2 root root May 27 12:08 certificates -rw-r--r-- 1 root root 887 May 16 10:02 hostcert.pem -r root root 887 May 16 10:02 hostkey.pem drwxr-xr-x 2 root root 4096 May 27 11:21 vomsdir Note !!! Important Install the eumed voms certificate in /etc/grid-security/vomsdir/ wget ftp://repo.magrid.ma/pub/WMS/voms-02.pd.infn.it.pem 14 Host cetificates Rabat, Joint EPIKH/EUMEDGRID Support Site Admin

15 site-info.def Rabat, Joint EPIKH/EUMEDGRID Support Site Admin All the configuration samples files are located in /opt/glite/yaim/examples/siteinfo directory it’s better to make a copy of the original files Open your own site-info.def and customize it: Copy the eumed profiles inside default ones: vi /opt/glite/yaim/etc/siteinfo/site-info.def mkdir /opt/glite/yaim/etc/siteinfo/ cp /opt/glite/yaim/examples/siteinfo/site-info.def /opt/glite/yaim/etc/siteinfo/site-info.def mkdir /opt/glite/yaim/etc/siteinfo/ cp /opt/glite/yaim/examples/siteinfo/site-info.def /opt/glite/yaim/etc/siteinfo/site-info.def cp /opt/glite/yaim/examples/siteinfo/users.conf /opt/glite/yaim/etc/siteinfo/users.conf cp /opt/glite/yaim/examples/siteinfo/groups.conf /opt/glite/yaim/etc/siteinfo/groups.conf cp /opt/glite/yaim/examples/siteinfo/users.conf /opt/glite/yaim/etc/siteinfo/users.conf cp /opt/glite/yaim/examples/siteinfo/groups.conf /opt/glite/yaim/etc/siteinfo/groups.conf

16 Step 2: Yaim configuration YAIM generic configuration variables INSTALL_ROOT=/opt MYSQL_PASSWORD=secret PX_HOST=myproxy.ct.infn.it WMS_HOST=pcXX.magrid.ma SITE_NAME=Grid-School GLITE_LOCATION_LOG=/var/log/glite VOS= "eumed"  Add eumed here ######### # eumed # ######### VO_EUMED_SW_DIR =$VO_SW_DIR/eumed VO_EUMED_DEFAULT_SE =$SE_HOST VO_EUMED_STORAGE_DIR =$CLASSIC_STORAGE_DIR/eumed VO_EUMED_VOMS_SERVERS=" 'vomss://voms2.cnaf.infn.it:8443/voms/eumed?/eumed' 'vomss://voms- 02.pd.infn.it:8443/voms/eumed?/eumed'" VO_EUMED_VOMSES ="'eumed voms2.cnaf.infn.it /C=IT/O=INFN/OU=Host/L=CNAF/CN=voms2.cnaf.infn.it eumed' 'eumed voms-02.pd.infn.it /C=IT/O=INFN/OU=Host/L=Padova/CN=voms-02.pd.infn.it eumed'" VO_EUMED_VOMS_CA_DN ="'/C=IT/O=INFN/CN=INFN CA' '/C=IT/O=INFN/CN=INFN CA'" VO_EUMED_WMS_HOSTS ="pcXX.magrid.ma" Rabat, Joint EPIKH/EUMEDGRID Support Site Admin

o WMS, LB specific configuration variables o WMS Pre configuration o LB Pre configuration o Configure WMS and LB via YAIM 17 Step 2: WMS, LB Yaim configuration Rabat, Joint EPIKH/EUMEDGRID Support Site Admin # Hostname of the WMS WMS_HOST=pcXX.magrid.ma LB_HOST=pcXX.magrid.ma # Hostname of the WMS WMS_HOST=pcXX.magrid.ma LB_HOST=pcXX.magrid.ma bash# vi /services/glite-wms LB_HOST= " pcXX.magrid.ma:9000 " GLITE_WMS_LCGMON_FILE= " /var/log/wms_logmon.log " bash# vi /services/glite-wms LB_HOST= " pcXX.magrid.ma:9000 " GLITE_WMS_LCGMON_FILE= " /var/log/wms_logmon.log " bash# vi /opt/glite/etc/LB-super-user /C=MA/O=MaGrid/OU=CNRST/CN=pcXX.magrid.ma bash# vi /opt/glite/etc/LB-super-user /C=MA/O=MaGrid/OU=CNRST/CN=pcXX.magrid.ma bash# >/site-info.def –n glite-WMS –n glite-LB/opt/glite/yaim/bin/yaim – c –s <site-info.def_path

18 Testing WMS-LB Rabat, Joint EPIKH/EUMEDGRID Support Site Admin

19 Testing WMS, LB from a UI Rabat, Joint EPIKH/EUMEDGRID Support Site Admin o From your user interface:  Voms-proxy-init –voms eumed  export gLITE_WMS_WMPROXY_ENDPOINT= glite_wms_wmproxy_server o Submit a job

20 References Rabat, Joint EPIKH/EUMEDGRID Support Site Admin