Berkley Database Information Index (BDII) Server Installation & Configuration Giuseppe La Rocca INFN – Catania gLite Tutorial Rome, 18-21 April 2006

Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006 Outline Information System Overview How to install a BDII Server BDII customization References Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006 Information System: overview The Information System (IS) provides information about grid resources and their actual status. Computing and Storage resources at a site report their static and dynamic status information via GRISes (Grid Resource Information Server) one per grid element At each site an element called GIIS (Grid Index Information Server) collects information from all the site GRISes one per grid site The BDII (Berkley Database Information Index) queries the GIISes (of different sites) and acts as a cache storing information about the Grid status in its database. Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

IS Components: GRISs, GIISs and BDII Each site can run a BDII. It collects the information coming from the GIISs At each site, a site GIIS collects the information given by the GRISs Local GRISes run on CEs and SEs at each site and report dynamic and static information From LCG2.3.0 site GIIS has been replaced by “local” BDII Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006 The Information System in LCG The IS in LCG BDII-A BDII-B BDII-C CE Local GRIS CE Site GIIS CE Local GRIS CE Site GIIS CE Local GRIS CE Site GIIS SE Local GRIS SE Local GRIS CE Local GRIS SE Local GRIS CE Local GRIS SE Local GRIS RB Local GRIS Site 1 Site 2 Site 3 Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006 BDII Users and other Grid services (such as the RB) can interrogate BDIIs to get information about the Grid status. Each BDII collects information from the site GIISes (or local BDII) defined in a configuration file, which it accesses through a web interfaces. Every two minutes a cron-job runs a script and collects information (pull model) from all the GIIS (local BDII) listed in the configuration file Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

BDII Server Installation Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

Installation Pre-requisites Start from a fresh install of SLC 3.0.x Verify that apt is installed and properly configured: rpm -qa | grep apt Install apt if necessary: rpm -ivh http://linuxsoft.cern.ch/cern/slc30X/i386/SL/RPMS/apt-0.5.15cnc6-8.SL.cern.i386.rpm Java SDK is required to install almost any LCG/gLite grid services. Due to license issues, it is not found in the LCG repositories. So please download and install a release of Sun Java SDK >= 1.4.2_08 from http://java.sun.com/j2se/1.4.2/download.html chmod +x j2sdk-1_4_2_10-linux-i586-rpm.bin ./j2sdk-1_4_2_10-linux-i586-rpm.bin rpm -ivh j2sdk-1_4_2_10-linux-i586.rpm Preparing... ########################################### [100%] 1:j2sdk ########################################### [100%] Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

Node Syncronization with NTP Syncronization among all LCG nodes is mandatory. It can be achieved by the NTP protocol and a time server Install ntp if not already available for your system: apt-get install ntp Add your time server in /etc/ntp.conf restrict <time_server_IP_address> mask 255.255.255.255 nomodify notrap noquery server <time_server_name> (you can use ntp-1.infn.it – IP 193.206.144.10) Edit /etc/ntp/step-tickers adding your(s) time server(s) hostname If you are running a firewall, you will have to allow inbound comminication on the NTP port: -A RH-Firewall-1-INPUT -m state --state NEW -p udp --dport 123 -j ACCEPT Activate the ntpd service with the following commands: ntpdate <your ntp server name> service ntpd start chkconfig ntpd on Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006 YAIM Installation YAIM is a set of bash scripts used to install and easily configure the LCG middleware on the target machine Ensure you FQDN is properly set hostname –f Find the latest YAIM version at http://www.cern.ch/grid-deployment/gis/yaim/ Download it using wget wget http://www.cern.ch/grid-deployment/gis/yaim/lcg-yaim-2.7.0-3.noarch.rpm Install using rpm -ivh lcg-yaim-2.7.0-3.noarch.rpm Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

Site Configuration File All the configuration values to sites have to be configured in a site configuration file using key-value pairs. This file is shared among all the different LCG node types. So edit once and keep it in a safe place. Create a copy of /opt/lcg/yaim/examples/site-info.def template (coming from the lcg-yaim RPM) to your reference directory for the installation (e.g. /root): cp /opt/lcg/yaim/examples/site-info.def /root/my-site-info.def The general syntax of the file is a sequence of bash-like assignments of variables (<variable>=<value>, no spaces are allowed around =). A good syntax test for your site configuration file is to try to source it manually running the command: source my-site-info.def Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006 BDII Server related variables MY_DOMAIN=fis.uniroma3.it BDII_HOST=gilda03 BDII_HTTP_URL=“http://grid018.ct.infn.it/fileadmin/bdii/gilda-bdii-update.conf” list of the GIIS (or local BDII) from which the BDII server fetches the information In this example, we are using the GIISes of all the GILDA sites LCG_REPOSITORY and CA_REPOSITORY you have to set this variables only if you are using a software repository different from the default. LCG_REPOSITORY=“'rpm http://linuxsoft.cern.ch LCG/apt/LCG-2_7_0/sl3/en/i386 lcg_sl3 lcg_sl3.updates lcg_sl3.security' 'rpm http://grid-deployment.web.cern.ch/grid-deployment/gis apt/LCG-2_7_0/sl3/en/i386 lcg_sl3 lcg_sl3.updates lcg_sl3.security‘” CA_REPOSITORY="rpm http://grid-deployment.web.cern.ch/grid-deployment/gis apt/LCG_CA/en/i386 lcg" Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

Installation and configuration scripts Start the download and installation of all the needed package using the following command: /opt/lcg/yaim/scripts/install_node /root/my-site-info.def lcg-BDII Start the configuration of the BDII according the information provided into the my-site-info.def with: /opt/lcg/yaim/scripts/configure_node /root/my-site-info.def BDII If you are running a firewall, you will have to allow inbound comminication on the BDII port : -A RH-Firewall-1-INPUT -m state --state NEW -m tcp -p tcp --dport 2170 -j ACCEPT Installation and configuration scripts Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

Test your fresh new BDII Server Issue an ldapsearch to check if BDII is correctly publishing sites informations: ldapsearch -x -h gilda03.fis.uniroma3.it -p 2170 -b 'mds-vo-name=local,o=grid‘ Or Use LDAP Browser to test your BDII. You can download it from: http://www-unix.mcs.anl.gov/~gawor/ldap/index.html Log into a LCG User Interface machine and use lcg-infosites: export LCG_GFAL_INFOSYS=gilda03.fis.uniroma3.it:2170 lcg-infosites --vo gilda se Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006 BDII customization BDII configuration file can be found in /opt/bdii/etc/bdii.conf BDII_PORT_READ=2170 BDII_PORTS_WRITE="2171 2172 2173" BDII_USER=edguser BDII_BIND=mds-vo-name=local,o=grid BDII_PASSWD=23385 BDII_SEARCH_FILTER='(|(objectClass=GlueSchemaVersion)(objectClass=GlueTop))' BDII_SEARCH_TIMEOUT=30 BDII_BREATHE_TIME=60 -- every 2 minutes BDII cache is refreshed BDII_AUTO_UPDATE=yes -- set to no if you want to create a static list of GIIS BDII_AUTO_MODIFY=yes BDII_DIR=/opt/bdii/ BDII_UPDATE_URL=http://grid018.ct.infn.it/fileadmin/bdii/gilda-bdii-update.conf BDII_UPDATE_LDIF=http://goc.grid-support.ac.uk/gridsite/bdii/BDII/www/bdii-update.ldif SLAPD=/usr/sbin/slapd SLAPADD=/usr/sbin/slapadd Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

BDII customization (II) Change BDII_UPDATE_URL to: http://grid-deployment.web.cern.ch/grid-deployment/gis/lcg2-bdii/dteam/lcg2-all-sites.conf Restart the service with: /etc/init.d/bdii restart Give a look to the new information published by the service /opt/bdii/etc/bdii-update.conf contains the list of GIIS: ... INFN-CATANIA ldap://grid010.ct.infn.it:2170/mds-vo-name=infn-catania,o=grid # 2.6.0 INFN-CNAF ldap://grid011f.cnaf.infn.it:2170/mds-vo-name=infn-cnaf,o=grid # 2.6.0 INFN-PADOVA ldap://gilda-ce-01.pd.infn.it:2170/mds-vo-name=infn-padova,o=grid # 2.6.0 IISAS-BRATISLAVA ldap://dgt01.ui.savba.sk:2170/mds-vo-name=iisas-gilda,o=grid # 2.6.0 ULA-MERIDA ldap://grid006.cecalc.ula.ve:2170/mds-vo-name=ula-merida,o=grid … Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

BDII Log Files and References /opt/bdii/var/bdii.log BDII Documentation: http://lfield.home.cern.ch/lfield/cgi-bin/wiki.cgi?area=bdii&page=documentation https://uimon.cern.ch/twiki/bin/view/LCG/BdiiNotes Information System Trouble Shooting Guide http://lfield.home.cern.ch/lfield/trouble.html Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006

Giuseppe La Rocca, INFN Catania  gLite Tutorial  Roma, 18-21.04.2006