12th EELA Tutorial for Users and System Administrators E-infrastructure shared between Europe and Latin America BDII Server Installation Yubiryn Ramírez G. ULA – Venezuela. 12 EELA Tutorial Users and System Administrators. Lima,

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, This presentation is based on LCG and gLite manuals and previous EELA tutorials

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Outline Information System Overview How to install a BDII Server BDII customization and references

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Information System Overview The Information System (IS) provides information about grid´s resources and their actual status.

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Information System Levels Resource level: Grid Resource Information Server (GRIS) –One GRIS on top of each CE, SE, RB, MyProxy (no WNs). –Sensors and scripts get status of concrete resources statically (e.g. GlueCEUniqueID) or dynamically (e.g. GlueCEStateWaitingJobs) Site level: Grid Index Information Server (GIIS) –Compiles all the information of the different GRISs in a site. –LCG-2 recommends using a BDII instead of a GIIS  Improves robustness and stability.  Called the site BDII. Top level: Berkeley DB Information Index (BDII) –Keeps all Grid information about the VOs (generally only one). –Stores information from local BDIIs or GIISs in its database. –Only queries sites that are included in a configuration file.

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII Users and other Grid services (such as the RB) can query BDIIs to get information about the Grid status. Each BDII collects information from the site GIISes (or local BDII) defined in a configuration file, which is accessed through a web interfaces. Every two minutes a cron-job runs a script and collects information (pull model) from all the GIISes (local BDII) listed in the configuration file.

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII Each site can run a BDII. It collects the information coming from the BDIIs/GIISs At each site, a site GIIS collects the information given by the GRISs Local GRISs run on CE, SE, RB, MyProxy at each site and report dynamic and static information Abbreviations: BDII: Berkeley DataBase Information Index GIIS: Grid Index Information Server GRIS: Grid Resource Information Server From LCG2.3.0 site GIIS has been replaced by “site” BDII

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII RB Local GRIS SE Local GRIS CE Local GRIS BDII-A BDII-B SE Local GRIS SE Local GRIS CE Local GRIS SE Local GRIS BDII-C Site 1 Site 2 Site 3 Site BDII

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Installing BDII Server

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Preliminary and common steps Start from an instalation of SLC Install JAVA SDK Check the hostname Install and configure ntp daemon Install X.509 host certificates /etc/grid-security and check their file permissions. Install the latest version of glite-yaim Install the middleware

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Pre-requisites (1) Start from the base machine you installed in the INTRODUCTORY tutorial Verify that these packages are installed and properly configured: –Java SDK –Ntp daemon –Latest version of glite-yaim

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Pre-requisites (2) Check the hostname hostmane -f Install X.509 host certificates /etc/grid-security and check their file permissions. -rw-r--r-- 1 root root1127Jun 14 12:27 hostcert.pem -r root root887 Jun 14 12:28 hostkey.pem

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Glite and Gilda Metapackages MatapackageNode typeDescription Glite-BDIIBDIIA top level BDII GILDA_ig_BDII Gilda BDII GILDA_ig_RB_BDII Gilda RB + BDII Usual combinación: RB and BDII CE and BDII: doesn´t work

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, site-info.def All the configuration values to sites have to be configured in a site configuration file using key-value pairs. This file is shared among all the different gLite node types. So edit once and keep it in a safe place Create a copy of /opt/glite/yaim/examples/site-info.def template (coming from the glite-yaim-core package) to your reference directory for the installation (e.g. /root/siteinfo): cp /opt/glite/yaim/examples/site-info.def /root/siteinfo/site- info.def

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, site-info.def A good syntax test for your site configuration file is to try to source it manually running the command: source site-info.def The configuration is stored in a directory structure which will be extended in the near future. Currently the following files are used: site-info.def file and the vo.d directory.

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, vo.d directory The /root/siteinfo/vo.d directory Each file name in this directory has to be the lower-cased version of e VO name defined in site-info.def. The matching file should contain the definitions for that VO and will overwrite the ones which are defined in site-info.def. SW_DIR=$VO_SW_DIR/eela DEFAULT_SE=$CLASSIC_HOST STORAGE_DIR=$CLASSIC_STORAGE_DIR/eela

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, site-info.def fields BDII_FCR: URL of the Freedom of Choice for Resources. (Web interface that provides a facility for VOs to modify resources list available for them on a BDII level, based on their own decision or Sites Functional Test (SFT) results) BDII_HOST: BDII Hostname. BDII_HTTP_URL: List of the GIIS (or site BDII) from which the BDII server fetches the information

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, site-info.def fields BDII_REGIONS: List of nodes publishing information on the BDII. BDII_REGIONS="CE SE RB LFC VOBOX PX FTS MON“ BDII_CE_URL="ldap://$CE_HOST:2135/mds-vo-name=local,o=grid" BDII_SE_URL="ldap://$CLASSIC_HOST:2135/mds-vo- name=local,o=grid" … BDII_FTS_URL="ldap://$FTS_HOST:2170/mds-vo- name=resource,o=grid" BDII_MON_URL="ldap://$MON_HOST:2135/mds-vo- name=local,o=grid"

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Modify site-info.def Modify your site-info.def and edit this fields: BDII_HOST=limaXX.ring.pucp.edu.pe BDII_HTTP_URL=“ /gilda-bdii-update.conf” /gilda-bdii-update.conf

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Installation and Configuration Install the node /opt/glite/yaim/bin/yaim -i -s /root/siteinfo/site- info.def -m glite-BDII Configure the node /opt/glite/yaim/bin/yaim -c -s /root/siteinfo/site- info.def -n BDII

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Firewall configuration Be sure that your firewall is open for bdii listening port 2170: In /etc/sysconfig/iptables add: -A RH-Firewall-1-INPUT -m state --state NEW -m tcp -p tcp --dport j ACCEPT service iptables restart

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII Server Testing & Customization

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII testing Issue an ldapsearch to check if BDII is correctly publishing sites informations: ldapsearch -x -h -p b 'mds-vo- name=local,o=grid‘ Log into a LCG User Interface machine and use lcg- infosites: export LCG_GFAL_INFOSYS= :2170 lcg-infosites --vo gilda ce

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII customization BDII configuration file can be found in: /opt/bdii/etc/bdii.conf

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII customization (2) BDII_PORT_READ=2170 BDII_PORTS_WRITE=" " BDII_USER=edguser BDII_BIND=mds-vo-name=local,o=grid BDII_PASSWD=26082 BDII_SEARCH_FILTER='(|(objectClass=GlueSchemaVersion)(objectClass =GlueTop))' BDII_SEARCH_TIMEOUT=30 BDII_BREATHE_TIME=60  every 2 minute BDII cache is refreshed BDII_AUTO_UPDATE=yes  the list of GIIS is dynamic (no=static) BDII_AUTO_MODIFY=no BDII_DIR=/opt/bdii/ BDII_UPDATE_URL= update.conf BDII_UPDATE_LDIF= SLAPD=/usr/sbin/slapd SLAPADD=/usr/sbin/slapadd

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII customization (3) BDII log files in: /opt/bdii/var/bdii.log

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII customization (4) Example: –Change BDII_UPDATE_URL to: bdii/dteam/lcg2-all-sites.conf –Restart the service with: /etc/init.d/bdii restart –Give a look to the new information published by the service

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII customization (5) The file /opt/bdii/etc/bdii-update.conf contains the list of GIIS:... INFN-CATANIA ldap://grid010.ct.infn.it:2170/mds-vo- name=infn-catania,o=grid # INFN-CNAF ldap://grid011f.cnaf.infn.it:2170/mds-vo- name=infn-cnaf,o=grid # INFN-PADOVA ldap://gilda-ce-01.pd.infn.it:2170/mds- vo-name=infn-padova,o=grid # IISAS-BRATISLAVA ldap://dgt01.ui.savba.sk:2170/mds- vo-name=iisas-gilda,o=grid # ULA-MERIDA ldap://grid006.cecalc.ula.ve:2170/mds-vo- name=ula-merida,o=grid

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, References LCG-2 User Guide gLite 3.0 User Guide gLite 3.0 Generic Installation and Configuration Guide Manual-Install/ YAIM guide for sysadmins BDII Documentation: