1. gLite WN Installation Giuseppe LA ROCCA INFN Catania giuseppe.larocca@ct.infn.it ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia

2. Overview Pre-requisites Installation of a gLite WN Configuration Testing References Outline 2

3. Overview The Worker Node is a service where the jobs run. Its main functionally are: – execute the jobs – update to Computing Element the status of the jobs It can run several kinds of client batch system: Torque LSF SGE Condor

4. TORQUE client The Torque client is composed by a: – pbs_mom which places the job into execution. – It is also responsible for returning the job’s output to the user

5. Login to Virtual Machine Start SSH to ui.thinkgrid.org Use the username and password specified in your tutorial worksheet to ssh to your VM E.g.: ssh –X kualalumpur @ui.thinkgrid.org 5

6. Pre-requisites Start from a base SL4.7 machine with the following rpm groups : –X Window System –Editors X Software Development –Text-based Internet –Server Configuration Tools –Development Tools –Administration Tools –System Tools –Legacy Software Development Please refer to Site_Pre-Installation to prepare and set up your machine for gLite middleware installationSite_Pre-Installation

7. A general requirement for the gLite nodes is that they are synchronized. Configure the file /etc/ntp.conf by adding the lines dealing with your time server configuration such as, for instance: # Prohibit general access to this service. restrict default ignore restrict 193.206.144.10 mask 255.255.255.255 nomodify notrap noquery server 127.127.1.0 # local clock fudge 127.127.1.0 stratum 10 server ntp-1.infn.it Syncronizing…

8. Edit the file /etc/ntp/step-tickers adding a list of your time server(s) hostname(s) cat /etc/ntp/step-tickers 193.206.144.10 If you are running a kernel firewall, you will have to allow inbound communication on the NTP port. If you are using iptables, you can add the following to /etc/sysconfig/iptables -A INPUT -s -p udp --dport 123 -j ACCEPT You can then reload the firewall : service iptables restart Syncronizing…

9. Activate the ntpd service with the following commands: # ntpdate ntp-1.infn.it # service ntpd start # chkconfig ntpd on You can check ntpd's status by running the following command : # ntpq -p Syncronizing…

10. Repository settings Configure the repositories as follow: cd /etc/yum.repos.d/ wget ftp://mirror.biruni.upm.my/repos/3.1/glite-WN.repo \ftp://mirror.biruni.upm.my/repos/3.1/glite-WN.repo \ ftp://mirror.biruni.upm.my/repos/3.1/lcg-CA.repo \ ftp://mirror.biruni.upm.my/repos/3.1/jpackage.repo \ http://grid018.ct.infn.it/mrepo/repos/gilda.repo \ ftp://mirror.biruni.upm.my/repos/3.1/glite- TORQUE_client.repo

11. Install meta-packages Install Java and the meta-package for the UI  yum install glite-WN glite-TORQUE_client java-1.6.0-sun- compat Install the CAs and the utils to support the GILDA VO:  yum install lcg-CA gilda_utils

12. Configure Download the “corrected” site-info.def for your server cd /opt/glite/yaim/etc/ wget ftp://mirror.biruni.upm.my/klacgrid/site-info.defftp://mirror.biruni.upm.my/klacgrid/site-info.def wget ftp://mirror.biruni.upm.my/klacgrid/users.confftp://mirror.biruni.upm.my/klacgrid/users.conf wget ftp://mirror.biruni.upm.my/klacgrid/groups.confftp://mirror.biruni.upm.my/klacgrid/groups.conf Protect your configuration file chmod 600 site-info.def Verify your configuration file source site-info.def

13. Configure WN Settings for the site-info.def MY_DOMAIN="thinkgrid.org“ # Human-readable name of your site SITE_NAME=ACGRID-CE-  Customize here! # The contact e-mail of your site SITE_EMAIL=“”  Add your email here # Hostname of the CE CE_HOST=  Customize here! TORQUE_SERVER=$CE_HOST BATCH_SERVER=$CE_HOST BATCH_VERSION=2.3.0 # Jobmanager specific settings. Please, define: # lcgpbs, lcglfs, lcgsge or lcgcondor JOB_MANAGER=lcgpbs # Number of Logical CPUs (cores) of the WN in the SubCluster CE_SMPSIZE=1

14. Configure WN # torque, lsf, sge or condor CE_BATCH_SYS=torque BATCH_LOG_DIR=/var/spool/pbs_server/logs/ # Space separated list of SEs hostnames SE_LIST=se.$MY_DOMAIN  Customize here! # Hostname of the RGMA server MON_HOST=ui.$MY_DOMAIN # Space separated list of VOs supported by your site VOS="gilda euasia" # Prefix of the experiment software directory in your CE VO_SW_DIR=/opt/exp_soft # Space separated list of queues configured in your CE QUEUES="gilda euasia" GILDA_GROUP_ENABLE="gilda" EUASIA_GROUP_ENABLE="euasia"

15. Configure (cont.) ########## # EUASIA # ########## VO_EUASIA_SW_DIR=$VO_SW_DIR/euag VO_EUASIA_DEFAULT_SE=$DPM_HOST VO_EUASIA_STORAGE_DIR=$CLASSIC_STORAGE_DIR/euasia VO_EUASIA_VOMS_SERVERS="vomss://voms.grid.sinica.edu.tw:8443/v oms/euasia?/euasia" VO_EUASIA_VOMSES="'euasia voms.grid.sinica.edu.tw 15015 /C=TW/O=AS/OU=GRID/CN=voms.grid.sinica.edu.tw euasia'" VO_EUASIA_VOMS_CA_DN="'/C=TW/O=AS/OU=GRID/CN=voms.grid.sinica. edu.tw'" VO_EUASIA_CA_DN="'/C=TW/O=AS/CN=Academia Sinica Grid Computing Certification Authority Mercury' '/C=TW/O=AS/CN=Academia Sinica Grid Computing Certification Authority Mercury'"

16. Configure (cont.) ######### # GILDA # ######### VO_GILDA_SW_DIR=$VO_SW_DIR/gilda VO_GILDA_DEFAULT_SE=$DPM_HOST VO_GILDA_STORAGE_DIR=$CLASSIC_STORAGE_DIR//gilda VO_GILDA_QUEUES= "gilda" VO_GILDA_VOMS_SERVERS="vomss://voms.ct.infn.it:8443/voms/gilda ?/gilda" VO_GILDA_VOMSES="'gilda voms.ct.infn.it 15001 /C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it gilda'" VO_GILDA_VOMS_CA_DN="'/C=IT/O=INFN/CN=INFN CA' '/C=IT/O=INFN/CN=INFN CA'"

17. Configure (cont.)  Configure the /opt/glite/yaim/etc/wn-list.conf  Configure WN /opt/glite/yaim/bin/yaim –c –s site-info.def \ –n glite-WN \ -n glite-TORQUE_client

18. Install VOMS cert. Download under /etc/grid-security/vomsdir/ the EUASIA voms host certificate wget http://ca.grid.sinica.edu.tw/publication/newCRT/newcerts/0341.crt and rename this file to voms.grid.sinica.edu.tw.pem

19. Verify if the pbs_mom is active and if its status is free: [root@wn root]# /etc/init.d/pbs_mom status pbs_mom (pid 3692) is running... # pbsnodes -a vm.thinkgrid.org state = free  np = 2 properties = lcgpro ntype = cluster status = arch=linux,uname=Linux wn.localdomain 2.4.21-37.EL.cern 1 Tue Oct 4 16:45:05 CEST 2005 i686,sessions=5892 5910 563 1703 2649,3584,nsessions=6,nusers=1,idletime=1569,totmem=254024kb,av ailmem=69852kb,physmem=254024kb,ncpus=1,loadave=0.30,rectime= 1159016111 Testing

20. Firewall Settings For further information, see the document http://glite.cvs.cern.ch/cgi-bin/glite.cgi/org.glite.site- info.ports/doc/middleware-ports.txt?revision=1.15&view=markupthe http://glite.cvs.cern.ch/cgi-bin/glite.cgi/org.glite.site- info.ports/doc/middleware-ports.txt?revision=1.15&view=markupthe

21. References Refer to the following references for more details about required variables of the gLite WN: –https://twiki.cern.ch/twiki/bin/view/LCG/Site- info_configuration_variables#WNhttps://twiki.cern.ch/twiki/bin/view/LCG/Site- info_configuration_variables#WN