WMS LB BDII Installation and Configuration

Slides:



Advertisements
Similar presentations
12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATOR E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
Advertisements

Basic Grid Job Submission Alessandra Forti 28 March 2006.
1 Kolkata, Asia Joint CHAIN/EU-IndiaGrid2/EPIKH School for Grid Site Administrators, The EPIKH Project (Exchange Programme.
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America User Interface installation and configuration.
E-science grid facility for Europe and Latin America UI PnP and UI Installation User and Site Admin Tutorial Riccardo Bruno – INFN Catania.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) VOMS Installation and configuration Bouchra
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) CE+WN+siteBDII Installation and configuration Bouchra
E-science grid facility for Europe and Latin America Installation and configuration of a top BDII Gianni M. Ricciardi – Consorzio COMETA.
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America BDII Server Installation Vanessa.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Workload Management System + Logging&Bookkeeping Installation.
E-science grid facility for Europe and Latin America LFC Server Installation and Configuration Antonio Calanducci INFN Catania.
E-science grid facility for Europe and Latin America gLite WMS Installation and configuration Riccardo Bruno – INFN.CT 30/06/2008 – 04/07/2008.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America MyProxy server installation Emidio Giorgio.
EPIKH School for Grid Site Administrators, Amman, /32 Introductions BDII Installation and Configuration Miguel Angel Díaz Corchero
9th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
12th EELA Tutorial for Users and System Administrators E-infrastructure shared between Europe and Latin America User Interface installation.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS + LB Installation Emidio Giorgio INFN.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation and Configuration Antonio Juan.
BDII Server Installation and Configuration Manuel Rubio del Solar Extremadura Advanced Research Center (CETA-CIEMAT) 11th EELA Tutorial for Users Sevilla,
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation and Configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America User Interface (gLite 1.4) Installation.
E-infrastructure shared between Europe and Latin America Introduction to the tutorial for site managers Vanessa Hamar Universidad de Los.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Introduction to the tutorial for site managers.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS+LB Server Installation Tony Calanducci.
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America BDII Server Installation Yubiryn Ramírez.
EGEE-II INFSO-RI Enabling Grids for E-sciencE YAIM Overview MiMOS Grid tutorial HungChe, ASGC OPS Team.
Third EELA Tutorial for Managers and Users E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS+LB Server Installation Eduardo Murrieta.
User Interface UI TP: UI User Interface installation & configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation Claudio Cherubino.
12th EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) UI Installation and Configuration Dong Xu IHEP,
Presentation of the results khiat abdelhamid
GLite WN Installation Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
First South Africa Grid Training Installation and configuration of BDII Gianni M. Ricciardi Consorzio COMETA First South Africa Grid Training Catania,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks BDII Server Installation & Configuration.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) WMS LB BDII Installation and Configuration Salma Saber
Site BDII and CE Installation Muhammad Farhan Sjaugi, UPM 2009 November , UM Malaysia 1.
Overview about other gLite services Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
South African Grid Training WORKER NODE Albert van Eck UFS - ICTS 17 November 2009 Slides by GIUSEPPE PLATANIA.
Lightweight Directory Access Protocol Objectives –This chapter will first show you how to install and use LDAP Contents –The LDAP Database Structure –Scenario.
User Interface (UI) Installation Bandung ITB Desember 2009.
16-26 June 2008, Catania (Italy) First South Africa Grid Training LFC Server Installation and Configuration Antonio Calanducci INFN Catania.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Elisa Ingrà Consortium GARR- Roma WMS LB.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Workload Management System + Logging&Bookkeeping Installation.
Regional SEE-GRID-SCI Training for Site Administrators
gLite Information System
Elisa Ingrà Consortium GARR- Roma
MyProxy Server Installation
Installation and configuration of a top BDII
LFC Installation and Configuration
WMS LB Installation and Configuration
Practical: The Information Systems
WMS Installation and Configuration
CE+WN+siteBDII Installation and configuration
UI PnP and gLite UI installation
UI Installation and Configuration
Installation and configuration of a Computing Element
gLite User Interface Installation
Berkley Database Information Index (BDII) Server Installation & Configuration Giuseppe La Rocca INFN – Catania gLite Tutorial Rome, April 2006.
login: clermont-ferrandxx password: GridCLExx
WMS LB topBDII Installation and Configuration
EGEE Middleware: gLite Information Systems (IS)
gLite User Interface Installation and configuration
BDII Server Installation and Configuration
UI Installation and Configuration
WMS+LB Server Installation and Configuration
Presentation transcript:

WMS LB BDII Installation and Configuration Antonio Juan Rubio Montero antonio.rubio -at- ciemat.es CIEMAT, Madrid (Spain) Latin America 3 2010 - Joint GISELA/EPIKH School for Grid Site Administrators Nov 22-26, 2010. Valparaíso(Chile)

Based in previous EPIKH and EELA-2 presentations and adapted to the last gLite 3.1 repositories A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 2

Workload Management System (WMS) The Workload Management System (WMS) is the gLite service that allows users to submit jobs, and performs all tasks required to execute them, without exposing the user to the complexity of the Grid. The workload manager (WM) is the principal component in the WMS. Purpose of the Workload Manager (WM) is to accept and satisfy requests for job management coming from its clients The WM hands over the job to an appropriate Computing Element (CE) for execution taking into account requirements and the preferences expressed in the job description. A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010

Logging and Bookkeeping service (LB) The Logging and Bookkeeping service (LB) tracks jobs in terms of event (important points of job life, e.g. submission, finding a matching CE, starting execution etc.) gathered from various WMS components as well as CEs. A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 4

gLite WMS Architecture A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 5

cancellation expressed gLite WMS Architecture Acts as the portal for accepting all external requests to the workload manager. Job submission, cancellation expressed via a JDL A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 6

immediately available gLite WMS Architecture Keeps submission requests Requests are kept for a while if no resources are immediately available A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 7

gLite WMS Architecture Finds an appropriate CE for each submission request, taking into account job requests and preferences, Grid status, utilization policies on resources A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 8

gLite WMS Architecture A cache where overall resource information about the grid is stored for querying by the matchmaker. Updating these info via the information updater. A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 9

gLite WMS Architecture Updating of information is carried out by reading information from the top-level BDII server of the virtual organization. A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 10

gLite WMS Architecture The LB is responsible to: - Stores events generated by the various components of the WMS - Querying the LB user can retrieve information about the status of the job A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 11

Preliminaries The instructions provided in this presentation assume that you are going to use a machine with Scientific Linux CERN 4.8 (32 bits) installed. Virtual Machine image (GILDA VM Base_SLC4.8_i386) available at: https://gilda.ct.infn.it/VirtualServices.html GILDA VO: ATTENTION PLEASE: DON’T MAKE THE FOLLOWING INSTRUCTIONS FOR GILDA VO IN YOUR SITE IF YOU DON’T SUPPORT THIS TUTORIAL VO. IT’S JUST FOR TEST INSTALLATIONS AND USER TEST GISELA: This project maintains prod.vo.eu-eela.eu from EELA-2 as the production VO for its infrastructure. A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 12

To login to the VM you can use putty or winscp to open a terminal Machine: clusterXX Password: valparaisoXX / “passwordXX” A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 13

Network Time Protocol Let’s check if date’s machine is correct with: if NTP date isn’t correct: /etc/init.d/ntpd stop ntpdate ntp-1.infn.it /etc/init.d/ntpd start /etc/init.d/ntpd status ntpq -p if not let’s configure file and make service start on boot: chkconfig ntpd on A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 14

System requirements Please check: If you have a valid hostname To verify, type: hostname -f To edit the hostname: vi /etc/hosts vi /etc/hostname vi /etc/sysconfig/network hostname <pc_name> A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 15

export REPOS=“dag ig-sl4 lcg-ca glite-bdii glite-wms glite-lb“ Repository settings Specify the mrepo host: export MREPO=http://cluster30.fis.utfsm.cl/mrepo/yum/ Configure the repository as follows export REPOS=“dag ig-sl4 lcg-ca glite-bdii glite-wms glite-lb“ (“jpackage” is not necessary) (“glite-generic” could induce dependency problems) Get repositories with: for name in $REPOS; do wget $MREPO/$name.repo -O /etc/yum.repos.d/$name.repo; done Copy the gilda utils (Note: only for Gilda VO): wget http://grid018.ct.infn.it/mrepo/repos/gilda.repo -O /etc/yum.repos.d/gilda.repo Copy the UTFSM SL4 repository (only for this tutorial) wget http://cluster30.fis.utfsm.cl/mrepo/yum/utfsm-sl4.repo /etc/yum.repos.d/utfsm-sl4.repo A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 16

YUM install Then update your host: yum clean all Install CAs on ALL profiles: yum install lcg-CA GISELA: cd /etc/yum.repos.d wget http://gaia.eela.ufrj.br/repos/i386/eela.repo yum install eela-vomscerts Gilda utils:(ATTENTION PLEASE: DON’T MAKE THE FOLLOWING FOR YOUR SITE IT’S JUST FOR THE TEST INSTALLATION!) yum install gilda_utils (Installs ca_Gilda and glida-vomscert) Ig yaim: yum install ig-yaim A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 17

WMS+LB+BDII installation yum install ig_WMS ig_LB ig_BDII Problem (only in SL4.8 no CERN): RPM incompatiblity between openlap and openldap-servers / openldap-clients yum remove openldap Problem: RPM incompatibility between “glite-security-voms-api-cpp” and “glite-security-voms-api-noglobus” Yum error example: Transaction Check Error Transaction Check Error: file /opt/glite/lib/libvomsapi_nog.a conflicts between attempted installs of glite-security-voms-api-cpp-1.9.10-8.slc4 and glite-security-voms-api-noglobus-1.8.8-2.slc4 A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 18

Force to install separately WMS and LB Install WMS: yum install ig_WMS Install LB: You can not install ig_LB in a straighforward way yum install ig_LB ==================================================== Package Arch Version Repository Installing: ig_LB i386 3.1.19-0_ig52_sl4 ig_sl4 Installing for dependencies: glite-LB i386 3.1.19-0 glite-LB_sl4_updates glite-security-voms-api-noglobus i386 1.8.8-2.slc4 glite-WMS_sl4_release Try to select/install only a packet each time: wget http://cluster30.fis.utfsm.cl/mrepo/glite_sl4-i386/RPMS.lb-updates/glite-LB-3.1.19-0.i386.rpm rpm -ihv --nodeps glite-LB-3.1.19-0.i386.rpm wget http://cluster30.fis.utfsm.cl/mrepo/ig_sl4-i386/RPMS.3_1_0/ig_LB-3.1.19-0_ig52_sl4.i386.rpm rpm -ihv --nodeps ig_LB-3.1.19-0_ig52_sl4.i386.rpm BDII install: yum install ig_BDII A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 19

Host cetificates Move the host cert to the right path wget http://cluster30.fis.utfsm.cl/repos/certs/clusterXX.tar.gz /etc/grid-security/clusterXX.tar.gz cd /etc/grid-security tar -xvzf clusterXX.tar.gz Give them the right permissions chmod 400 /etc/grid-security/hostkey.pem chmod 644 /etc/grid-security/hostcert.pem [root@ clusterXX ~]# ll /etc/grid-security/ total 32 drwxr-xr-x 2 root root 20480 Jun 27 12:08 certificates -rw-r--r-- 1 root root 887 Jun 16 10:02 hostcert.pem -r-------- 1 root root 887 Jun 16 10:02 hostkey.pem drwxr-xr-x 2 root root 4096 Jun 27 11:21 vomsdir A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 20

site-info.def Generate configuration file from YAIM template cp /opt/glite/yaim/examples/siteinfo/ig-site-info.def /opt/glite/yaim/examples/siteinfo/mysite-info.def Open your own site-info.def and customize it: vi /opt/glite/yaim/examples/siteinfo/mysite-info.def WARNING: as configuration files may contain passwords and other sensitive information. It is generally a bad idea maintain the site-info.def world readable A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 21

WMS-LB Configuration (1/2) INSTALL_ROOT=/opt MYSQL_PASSWORD=secret WMS_HOST=clusterXX.fis.utfsm.cl SITE_EMAIL=none@none.cl VOS="gilda prod.vo.eu-eela.eu"  Add the VOs here (Note: gilda VO is for testing) LB_HOST=clusterXX.ciemat.es # Optional: to define a list of LBs used by the VO: # VO_<vo_name>_LB_HOSTS="vo-lb1 [vo-lb2 [...]]" VO_GILDA_VOMS_CA_DN="/C=IT/O=INFN/CN=INFN CA" VO_GILDA_SW_DIR=$VO_SW_DIR/gilda VO_GILDA_VOMS_SERVERS="voms://voms.ct.infn.it:8443/voms/gilda?/gilda" VO_GILDA_VOMSES="'gilda voms.ct.infn.it 15001 /C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it gilda'" VO_PROD_VO_EU_EELA_EU_VOMS_CA_DN="'/C=BR/O=ICPEDU/O=UFF BrGrid CA/CN=UFF Brazilian Grid Certification Authority' '/DC=es/DC=irisgrid/CN=IRISGridCA'" VO_PROD_VO_EU_EELA_EU_SW_DIR=$VO_SW_DIR/prod VO_PROD_VO_EU_EELA_EU_VOMS_SERVERS="vomss://voms.eela.ufrj.br:8443/voms/prod.vo.eu-eela.eu?/prod.vo.eu-eela.eu" VO_PROD_VO_EU_EELA_EU_VOMSES="'prod.vo.eu-eela.eu voms.eela.ufrj.br 15003 /C=BR/O=ICPEDU/O=UFF BrGrid CA/O=UFRJ/OU=IF/CN=host/voms.eela.ufrj.br prod.vo.eu-eela.eu' 'prod.vo.eu-eela.eu voms-eela.ceta-ciemat.es 15003 /DC=es/DC=irisgrid/O=ceta-ciemat/CN=host/voms-eela.ceta-ciemat.es prod.vo.eu-eela.eu'" A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 22

WMS-LB Configuration (2/2) Open glite-wms file and edit: vi /opt/glite/yaim/examples/siteinfo/services/glite-wms LB_HOST="clusterXX.fis.utfsm.cl:9000" GLITE_WMS_LCGMON_FILE="/var/log/wms_lcgmon.log" Copy the gilda profiles inside ig ones cat /opt/glite/yaim/etc/gilda/gilda_ig-groups.conf >> /opt/glite/yaim/examples/ig-groups.conf cat /opt/glite/yaim/etc/gilda/gilda_ig-users.conf >> /opt/glite/yaim/examples/ig-users.conf Copy the EELA(gisela) profiles inside ig ones cd /tmp wget http://eoc.eu-eela.eu/files/EELA-2VOs.tgz tar xzvf EELA-2VOs.tgz cat siteinfo/users.conf >> /opt/glite/yaim/examples/igusers.conf cat siteinfo/groups.conf >> /opt/glite/yaim/examples/iggroups.conf CONFIGURE /opt/glite/yaim/bin/ig_yaim -c -s /opt/glite/yaim/examples/siteinfo/mysite-info.def -n ig_WMS -n ig_LB A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 23

Please test some security files Test DN of host certificate only contain hostname (no service description): [root@clusterXX]# openssl x509 -noout -in hostcert.pem -subject subject= /C=IT/O=GILDA/OU=Host/L=VALPARAISO/CN=clusterXX.fis.utfsm.cl CN must not contain: host/clusterXX.fis.utfsm <some kind of service>/clusterXX.fis.utfsm Test the VO security configuration in /etc/grid-mapfile For gilda VO: [root@clusterXX]# cat /etc/grid-security/vomsdir/gilda/voms.ct.infn.it.lsc /C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it /C=IT/O=INFN/CN=INFN CA

Testing WMS-LB From a UI enter: [valparaisoXX@cluster30 ~]$ voms-proxy-init –voms gilda [valparaisoXX@cluster30 ~]$ export GLITE_WMS_WMPROXY_ENDPOINT= https://clusterXX.fis.utfsm.cl:7443/glite_wms_wmproxy_server Create a .jdl file: [valparaisoXX@cluster30 ~]$ cat hostname.jdl Type = "Job"; JobType = "Normal"; Executable = "/bin/hostname"; StdOutput = "hostname.out"; StdError = "hostname.err"; OutputSandbox = {"hostname.err","hostname.out"}; Arguments = "-f"; ShallowRetryCount = 3; A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 25

Testing WMS-LB with a job [valparaisoXX@cluster30 ~]$ glite-wms-job-list-match -a hostname.jdl Connecting to the service https://grid-test-60.trigrid.it:7443/glite_wms_wmproxy_server ========================================================================== COMPUTING ELEMENT IDs LIST The following CE(s) matching your job requirements have been found: *CEId* - grisuce.scope.unina.it:2119/jobmanager-lcgpbs-grisu_long - grisuce.scope.unina.it:2119/jobmanager-lcgpbs-grisu_short - ce.scope.unina.it:2119/jobmanager-lcgpbs-egee_long - ce1-egee.srce.hr:2119/jobmanager-sge-prod - gilda-01.pd.infn.it:2119/jobmanager-lcgpbs-gilda - ce-edu.grid.acad.bg:2119/jobmanager-pbs-gilda - ce.scope.unina.it:2119/jobmanager-lcgpbs-egee_short - sirius-ce.ct.infn.it:2119/jobmanager-lcgpbs-gilda - grid010.ct.infn.it:2119/jobmanager-lcgpbs-gilda - iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-gilda A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 26

Testing WMS-LB services [root@clusterXX]# service gLite status *** globus-gridftp: globus-gridftp-server (pid 13095) is running... *** glite-wms-wmproxy: WMProxy httpd listening on port 7443 httpd (pid 26197 12937 12936 12935 12934 12933 12932) is running .... === WMProxy Server running instances: UID PID PPID C STIME TTY TIME CMD *** glite-wms-wm: /opt/glite/bin/glite-wms-workload_manager (pid 12466) is running... *** glite-wms-lm: Logmonitor running... *** glite-wms-jc: JobController running in pid: 12525 CondorG master running in pid: 12581 CondorG schedd running in pid: 12662 *** glite-wms-ice: /opt/glite/bin/glite-wms-ice-safe (pid 12636) is running... *** glite-proxy-renewald: glite-proxy-renewd running *** glite-lb-proxy: glite-lb-proxy running as 13250 *** glite-lb-locallogger: glite-lb-logd running glite-lb-interlogd not running *** glite-lb-bkserverd: glite-lb-notif-interlogd running glite-lb-bkserverd running as 13764 A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 27

Snapshot of open TCP/UDP services [root@clusterXX]# netstat -lp Active Internet connections (only servers) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 *:23168 *:* LISTEN 10429/condor_schedd tcp 0 0 *:9000 *:* LISTEN 1341/glite-lb-bkser tcp 0 0 *:9001 *:* LISTEN 1341/glite-lb-bkser tcp 0 0 *:9002 *:* LISTEN 1869/glite-lb-logd tcp 0 0 *:mysql *:* LISTEN 348/mysqld tcp 0 0 *:20907 *:* LISTEN 10439/condor_negoti tcp 0 0 *:9003 *:* LISTEN 1341/glite-lb-bkser tcp 0 0 *:22541 *:* LISTEN 10429/condor_schedd tcp 0 0 *:sunrpc *:* LISTEN 2832/portmap tcp 0 0 *:9618 *:* LISTEN 10410/condor_collec tcp 0 0 *:21586 *:* LISTEN 32043/condor_master tcp 0 0 *:2170 *:* LISTEN 12688/bdii-fwd [acc tcp 0 0 localhost.localdomain:2171 *:* LISTEN 12677/slapd tcp 0 0 *:7443 *:* LISTEN 32301/httpd tcp 0 0 *:ssh *:* LISTEN 2915/sshd tcp 0 0 *:2811 *:* LISTEN 32507/globus-gridft udp 0 0 *:23168 *:* 10429/condor_schedd udp 0 0 *:22541 *:* 10429/condor_schedd udp 0 0 *:9618 *:* 10410/condor_collec udp 0 0 *:20907 *:* 10439/condor_negoti udp 0 0 *:24767 *:* 10429/condor_schedd udp 0 0 *:bootpc *:* 3800/dhclient udp 0 0 *:21586 *:* 32043/condor_master udp 0 0 *:sunrpc *:* 2832/portmap udp 0 0 clusterXX.ciemat.es:ntp *:* 10415/ntpd udp 0 0 localhost.localdomain:ntp *:* 10415/ntpd udp 0 0 *:ntp *:* 10415/ntpd udp 0 0 *:35616 *:* 32507/globus-gridft A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 28

Snapshot of running processes [root@clusterXX]# ps -eo user, args glite /opt/glite/bin/glite-lb-proxy -i /var/glite/glite-lb-proxy.pid … glite /opt/glite/bin/glite-lb-bkserverd --notif-il-sock=/tmp/glite-lb-notif.sock --notif-il-fprefix=/var/tmp/glite-lb-notif --super-users-file /opt/glite/etc/LB-super-users -c /home/glite/.certs/hostcert.pem -k /home/glite/.certs/hostkey.pem -i /var/glite/glite-lb-bkserverd.pid --dump-prefix /var/glite/dump --purge-prefix /var/glite/purge glite /opt/glite/bin/glite-lb-notif-interlogd -f /var/tmp/glite-lb-notif -s /tmp/glite-lb-notif.sock -M 10485760 -c /home/glite/.certs/hostcert.pem -k /home/glite/.certs/hostkey.pem glite /opt/glite/bin/glite-lb-logd -c /home/glite/.certs/hostcert.pem -k /home/glite/.certs/hostkey.pem glite /opt/glite/bin/glite-lb-interlogd -c /home/glite/.certs/hostcert.pem -k /home/glite/.certs/hostkey.pem glite perl /opt/condor-7.4.1/libexec/glite/condorc-authorizer glite perl /opt/condor-7.4.1/libexec/glite/condorc-advertiser glite perl /opt/condor-7.4.1/libexec/glite/condorc-vo-advertiser glite perl /opt/condor-7.4.1/libexec/glite/condorc-launcher edguser /usr/bin/perl -w /opt/bdii/sbin/bdii-update /opt/bdii/etc/bdii.conf edguser /usr/sbin/slapd -f /opt/bdii/var/2172/bdii-slapd.conf -h ldap://localhost:2172 -u edguser edguser /usr/sbin/slapd -f /opt/bdii/var/2171/bdii-slapd.conf -h ldap://localhost:2171 -u edguser glite /opt/glite/bin/glite-wms-workload_manager --conf glite_wms.conf --daemon /var/glite/glite-wms-workload_manager.pid glite /opt/glite/bin/glite-wms-job_controller -c glite_wms.conf glite /opt/condor-c/sbin/condor_master -f glite /opt/glite/bin/glite-wms-log_monitor -c glite_wms.conf glite /opt/glite/bin/glite-proxy-renewd -r /var/glite/spool/glite-renewd -t /home/glite/.certs/hostcert.pem -k /home/glite/.certs/hostkey.pem -A root /usr/sbin/httpd -k restart -f /opt/glite/etc/glite_wms_wmproxy_httpd.conf glite /usr/sbin/fcgi- -k restart -f /opt/glite/etc/glite_wms_wmproxy_httpd.conf …. root /opt/globus/sbin/globus-gridftp-server -p 2811 -d error,warn,info -l /var/log/gridftp-session.log -Z /var/log/globus-gridftp.log –s A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 29

Active services on startup [root@clusterXX yaim]# chkconfig --list | grep activo mysqld 0:desactivado 1:desactivado 2:activo 3:activo 4:activo 5:activo 6:desactivado fetch-crl 0:desactivado 1:desactivado 2:desactivado 3:activo 4:activo 5:activo 6:desactivado gLite 0:desactivado 1:desactivado 2:desactivado 3:activo 4:activo 5:activo 6:desactivado bdii 0:desactivado 1:desactivado 2:desactivado 3:activo 4:activo 5:activo 6:desactivado ntpd 0:desactivado 1:desactivado 2:activo 3:activo 4:activo 5:activo 6:desactivado yum 0:desactivado 1:desactivado 2:activo 3:activo 4:activo 5:activo 6:desactivado globus-gridftp 0:desactivado 1:desactivado 2:activo 3:activo 4:activo 5:activo 6:desactivado A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 30

Information System introduction GLUE: “Grid Laboratory Uniform Environment” LDAP: “Lightweight Directory Access Protocol” (OpenLDAP servers) The Hierarchy tree is stored as text files in LDIF (LDAP Data Interchange Files) format dn: dc=example,dc=root dc: example description: My company objectClass: dcObject objectClass: organization o: Example, Inc. ## FIRST Level hierarchy - people # this is an ENTRY sequence and is preceded by a BLANK line dn: ou=people, dc=example,dc=root ou: people description: All people in organisation objectClass: organizationalUnit ## SECOND Level hierarchy - people entries dn: cn=Joe Schmo,ou=people,dc=example,dc=root objectclass: inetOrgPerson cn: Joe Schmo sn: Schmo uid: jschmo mail: joe@example.com ou: sales A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 31 31

BDII service hierarchy Tipos de BDII Level Bind Top mds-vo-name=local,o=grid Site mds-vo-name=mysite,o=grid Resource mds-vo-name=resource,o=grid ldapsearch -x -p 2170 –h <top_BDII> -b 'mds-vo-name=local,o=grid‘ ldapsearch -x -p 2170 –h <site_BDII> -b 'mds-vo-name=<SITE_NAME>,o=grid' ldapsearch -x -p 2170 –h <resource_hostname> -b 'mds-vo-name=resource,o=grid' A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 32

Top BDII Configuration Attention: (gLite 3.1) BDII service always shows resource information at the same port than site-level or top-level information (2170) Top BDII Configuration BDII_HOST=clusterXX.fis.utfsm.cl BDII_HTTP_URL="http://grid018.ct.infn.it/fileadmin/bdii/glite-bdii-update.conf" <-posible bug?!!! NTP_HOSTS_IP="193.206.144.10 ntp-1.infn.it" (Note: this modifies /etc/ntp.conf) Then configure BDII (+WMS+LB): /opt/glite/yaim/bin/ig_yaim -c -s /opt/glite/yaim/examples/siteinfo/mysite-info.def –n ig_WMS –n ig_LB -n ig_BDII_top (To only install BDII: /opt/glite/yaim/bin/ig_yaim -c -s /opt/glite/yaim/examples/siteinfo/mysite-info.def -n ig_BDII_top) A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 33

Top BDII Post Configuration Set the CA autoupdate on /opt/glite/yaim/etc/gilda/set_CAs_autoupdate.sh Then Edit: vi /opt/bdii/etc/bdii.conf BDII_AUTO_UPDATE=yes BDII_MODIFY_DN=yes BDII_UPDATE_URL=http://grid018.ct.infn.it/fileadmin/bdii/glite-bdii-update.conf Restart BDII /etc/init.d/bdii restart Test bdii ldapsearch -x -h localhost -p 2170 -b mds-vo-name=local,o=grid (Note:”ldapsearch -x -h localhost -p 2170 -b mds-vo-name=resource,o=grid” for the resource information of this server) A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 34

Customize your Top BDII In order to customize an own Site BDII list: Install a HTTP server: yum install -y httpd Publish your customized glite-bdii-update.conf file (i.e. /var/www/html/bdii) as (http://clusterXX.fis.utfsm.cl/bdii/glite-bdii-update.conf) Set the BDII_UPDATE_URL accordingly in the file /opt/bdii/etc/bdii.conf file Restart the BDII service /etc/init.d/bdii restart A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 35

Testing the Top BDII from a UI [valparaisoXX@cluster30 ~]$ lcg-infosites --vo gilda ce --is <your top BDII> valor del bdii: gilda-bdii.ct.infn.it:2170 #CPU Free Total Jobs Running Waiting ComputingElement --------------------------------------------------------------------------------------------------------------------------- 8 8 0 0 0 ce-edu.grid.acad.bg:2119/jobmanager-pbs-gilda 0 0 0 0 0 ce.hpc.iit.bme.hu:2119/jobmanager-lcgpbs-gilda 168 124 63 44 19 ce1-egee.srce.hr:2119/jobmanager-sge-prod 24 23 3 0 3 grid010.ct.infn.it:2119/jobmanager-lcgpbs-gilda 14 14 1148 0 1148 gilda-01.pd.infn.it:2119/jobmanager-lcgpbs-gilda 20 20 1 0 1 sirius-ce.ct.infn.it:2119/jobmanager-lcgpbs-gilda 2168 2006 2 1 1 grisuce.scope.unina.it:2119/jobmanager-lcgpbs-grisu_short 2168 2006 15 15 0 grisuce.scope.unina.it:2119/jobmanager-lcgpbs-grisu_long 44 44 1 0 1 iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-gilda 5 5 0 0 0 dgt01.ui.savba.sk:2119/jobmanager-lcgpbs-gilda 16 16 0 0 0 gn0.hpcc.sztaki.hu:2119/jobmanager-lcgpbs-gilda 2168 2006 0 0 0 ce.scope.unina.it:2119/jobmanager-lcgpbs-egee_short 2168 2006 13 13 0 ce.scope.unina.it:2119/jobmanager-lcgpbs-egee_long A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 36

References INFNGrid installation http://igrelease.forge.cnaf.infn.it/doku.php?id=doc:guides:install-3_1 A. J Rubio-Montero Valparaíso, Chile. Joint GISELA/EPIKH School for Grid Site Admins. Nov 22, 2010 37