12th EELA Tutorial for Users and System Administrators www.eu-eela.org E-infrastructure shared between Europe and Latin America BDII Server Installation.

Slides:



Advertisements
Similar presentations
12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATOR E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
Advertisements

12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America SRM Installation and Configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America DPM Server Installation Luciano Diaz ICN-UNAM.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America DPM Server Installation Claudio Cherubino INFN – Catania.
9th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America SRM Installation and Configuration.
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America User Interface installation and configuration.
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
E-science grid facility for Europe and Latin America Installation and configuration of a top BDII Gianni M. Ricciardi – Consorzio COMETA.
DPM Server Installation Claudio Cherubino INFN - Catania.
IST E-infrastructure shared between Europe and Latin America VOMS and MyProxy Server installation and configuration Pedro Henrique.
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America BDII Server Installation Vanessa.
1 Introduction to the tutorial for site managers Antonio Fuentes Red.es/RedIRIS EGEE/EUMedGrid/EELA Tutorial for Managers Sevilla,
E-science grid facility for Europe and Latin America LFC Server Installation and Configuration Antonio Calanducci INFN Catania.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America MyProxy server installation Emidio Giorgio.
Klaster obliczeniowy WLCG – cz.I Alice::WTU::LCG - skład: VOBOX  alicluster.if.pw.edu.plVM: saturn.if.pw.edu.pl CREAM-CE  aligrid.if.pw.edu.pl VM: saturn.if.pw.edu.pl.
GLite Information System(s) Antonio Juan Rubio Montero CIEMAT 10 th EELA Tutorial. Madrid, May 7 th -11 th,2007.
9th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
12th EELA Tutorial for Users and System Administrators E-infrastructure shared between Europe and Latin America User Interface installation.
E-infrastructure shared between Europe and Latin America 12th EELA Tutorial for Users and System Administrators gLite Information System.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS + LB Installation Emidio Giorgio INFN.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation and Configuration Antonio Juan.
INFSO-RI Enabling Grids for E-sciencE BDII installation & configuration Giuseppe Platania INFN Catania EMBRACE Tutorial Clermont-Ferrand,
BDII Server Installation and Configuration Manuel Rubio del Solar Extremadura Advanced Research Center (CETA-CIEMAT) 11th EELA Tutorial for Users Sevilla,
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation and Configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America User Interface (gLite 1.4) Installation.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Worker Node installation & configuration.
E-infrastructure shared between Europe and Latin America Introduction to the tutorial for site managers Vanessa Hamar Universidad de Los.
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA gLite Information System Pedro Rausch IF.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Introduction to the tutorial for site managers.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America gLite Information System Claudio Cherubino.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS+LB Server Installation Tony Calanducci.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America DPM Server Installation Claudio Cherubino.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America R-GMA Server Installation Valeria Ardizzone.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
E-infrastructure shared between Europe and Latin America gLite Information System(s) Manuel Rubio del Solar CETA-CIEMAT EELA Tutorial, Mérida,
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America BDII Server Installation Yubiryn Ramírez.
Site-BDII Installation&Configuration Sara Bertocco INFN Padova 11 th International GridKa School 2013 – Big Data, Clouds and Grids.
EGEE-II INFSO-RI Enabling Grids for E-sciencE YAIM Overview MiMOS Grid tutorial HungChe, ASGC OPS Team.
Third EELA Tutorial for Managers and Users E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin.
YAIM gLite configuration tool Sara Bertocco INFN Padova 11 th International GridKa School 2013 – Big Data, Clouds and Grids.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS+LB Server Installation Eduardo Murrieta.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System Tutorial Laurence Field.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation Claudio Cherubino.
12th EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
First South Africa Grid Training Installation and configuration of BDII Gianni M. Ricciardi Consorzio COMETA First South Africa Grid Training Catania,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks BDII Server Installation & Configuration.
E-science grid facility for Europe and Latin America Updates on Information System Annamaria Muoio - INFN Tutorials for trainers 01/07/2008.
INFSO-RI Enabling Grids for E-sciencE The Information System: GRIS, GIIS, BDII, information providers, Installation,Configuration,
Site BDII and CE Installation Muhammad Farhan Sjaugi, UPM 2009 November , UM Malaysia 1.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
User Interface (UI) Installation Bandung ITB Desember 2009.
16-26 June 2008, Catania (Italy) First South Africa Grid Training LFC Server Installation and Configuration Antonio Calanducci INFN Catania.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Worker Node & Torque Client Installation.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Elisa Ingrà Consortium GARR- Roma WMS LB.
LFC Server Installation & Configuration
gLite Information System
Installation and configuration of a top BDII
gLite Information System(s)
Information System Virginia Martín-Rubio Pascual
Berkley Database Information Index (BDII) Server Installation & Configuration Giuseppe La Rocca INFN – Catania gLite Tutorial Rome, April 2006.
Site BDII Installation&Configuration
gLite Information System(s)
EGEE Middleware: gLite Information Systems (IS)
gLite Information System
BDII Server Installation and Configuration
WMS+LB Server Installation and Configuration
Information System (BDII)
Information Services Claudio Cherubino INFN Catania Bologna
Presentation transcript:

12th EELA Tutorial for Users and System Administrators E-infrastructure shared between Europe and Latin America BDII Server Installation Yubiryn Ramírez G. ULA – Venezuela. 12 EELA Tutorial Users and System Administrators. Lima,

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, This presentation is based on LCG and gLite manuals and previous EELA tutorials

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Outline Information System Overview How to install a BDII Server BDII customization and references

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Information System Overview The Information System (IS) provides information about grid´s resources and their actual status.

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Information System Levels Resource level: Grid Resource Information Server (GRIS) –One GRIS on top of each CE, SE, RB, MyProxy (no WNs). –Sensors and scripts get status of concrete resources statically (e.g. GlueCEUniqueID) or dynamically (e.g. GlueCEStateWaitingJobs) Site level: Grid Index Information Server (GIIS) –Compiles all the information of the different GRISs in a site. –LCG-2 recommends using a BDII instead of a GIIS  Improves robustness and stability.  Called the site BDII. Top level: Berkeley DB Information Index (BDII) –Keeps all Grid information about the VOs (generally only one). –Stores information from local BDIIs or GIISs in its database. –Only queries sites that are included in a configuration file.

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII Users and other Grid services (such as the RB) can query BDIIs to get information about the Grid status. Each BDII collects information from the site GIISes (or local BDII) defined in a configuration file, which is accessed through a web interfaces. Every two minutes a cron-job runs a script and collects information (pull model) from all the GIISes (local BDII) listed in the configuration file.

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII Each site can run a BDII. It collects the information coming from the BDIIs/GIISs At each site, a site GIIS collects the information given by the GRISs Local GRISs run on CE, SE, RB, MyProxy at each site and report dynamic and static information Abbreviations: BDII: Berkeley DataBase Information Index GIIS: Grid Index Information Server GRIS: Grid Resource Information Server From LCG2.3.0 site GIIS has been replaced by “site” BDII

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII RB Local GRIS SE Local GRIS CE Local GRIS BDII-A BDII-B SE Local GRIS SE Local GRIS CE Local GRIS SE Local GRIS BDII-C Site 1 Site 2 Site 3 Site BDII

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Installing BDII Server

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Preliminary and common steps Start from an instalation of SLC Install JAVA SDK Check the hostname Install and configure ntp daemon Install X.509 host certificates /etc/grid-security and check their file permissions. Install the latest version of glite-yaim Install the middleware

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Pre-requisites (1) Start from the base machine you installed in the INTRODUCTORY tutorial Verify that these packages are installed and properly configured: –Java SDK –Ntp daemon –Latest version of glite-yaim

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Pre-requisites (2) Check the hostname hostmane -f Install X.509 host certificates /etc/grid-security and check their file permissions. -rw-r--r-- 1 root root1127Jun 14 12:27 hostcert.pem -r root root887 Jun 14 12:28 hostkey.pem

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Glite and Gilda Metapackages MatapackageNode typeDescription Glite-BDIIBDIIA top level BDII GILDA_ig_BDII Gilda BDII GILDA_ig_RB_BDII Gilda RB + BDII Usual combinación: RB and BDII CE and BDII: doesn´t work

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, site-info.def All the configuration values to sites have to be configured in a site configuration file using key-value pairs. This file is shared among all the different gLite node types. So edit once and keep it in a safe place Create a copy of /opt/glite/yaim/examples/site-info.def template (coming from the glite-yaim-core package) to your reference directory for the installation (e.g. /root/siteinfo): cp /opt/glite/yaim/examples/site-info.def /root/siteinfo/site- info.def

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, site-info.def A good syntax test for your site configuration file is to try to source it manually running the command: source site-info.def The configuration is stored in a directory structure which will be extended in the near future. Currently the following files are used: site-info.def file and the vo.d directory.

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, vo.d directory The /root/siteinfo/vo.d directory Each file name in this directory has to be the lower-cased version of e VO name defined in site-info.def. The matching file should contain the definitions for that VO and will overwrite the ones which are defined in site-info.def. SW_DIR=$VO_SW_DIR/eela DEFAULT_SE=$CLASSIC_HOST STORAGE_DIR=$CLASSIC_STORAGE_DIR/eela

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, site-info.def fields BDII_FCR: URL of the Freedom of Choice for Resources. (Web interface that provides a facility for VOs to modify resources list available for them on a BDII level, based on their own decision or Sites Functional Test (SFT) results) BDII_HOST: BDII Hostname. BDII_HTTP_URL: List of the GIIS (or site BDII) from which the BDII server fetches the information

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, site-info.def fields BDII_REGIONS: List of nodes publishing information on the BDII. BDII_REGIONS="CE SE RB LFC VOBOX PX FTS MON“ BDII_CE_URL="ldap://$CE_HOST:2135/mds-vo-name=local,o=grid" BDII_SE_URL="ldap://$CLASSIC_HOST:2135/mds-vo- name=local,o=grid" … BDII_FTS_URL="ldap://$FTS_HOST:2170/mds-vo- name=resource,o=grid" BDII_MON_URL="ldap://$MON_HOST:2135/mds-vo- name=local,o=grid"

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Modify site-info.def Modify your site-info.def and edit this fields: BDII_HOST=limaXX.ring.pucp.edu.pe BDII_HTTP_URL=“ /gilda-bdii-update.conf” /gilda-bdii-update.conf

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Installation and Configuration Install the node /opt/glite/yaim/bin/yaim -i -s /root/siteinfo/site- info.def -m glite-BDII Configure the node /opt/glite/yaim/bin/yaim -c -s /root/siteinfo/site- info.def -n BDII

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, Firewall configuration Be sure that your firewall is open for bdii listening port 2170: In /etc/sysconfig/iptables add: -A RH-Firewall-1-INPUT -m state --state NEW -m tcp -p tcp --dport j ACCEPT service iptables restart

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII Server Testing & Customization

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII testing Issue an ldapsearch to check if BDII is correctly publishing sites informations: ldapsearch -x -h -p b 'mds-vo- name=local,o=grid‘ Log into a LCG User Interface machine and use lcg- infosites: export LCG_GFAL_INFOSYS= :2170 lcg-infosites --vo gilda ce

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII customization BDII configuration file can be found in: /opt/bdii/etc/bdii.conf

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII customization (2) BDII_PORT_READ=2170 BDII_PORTS_WRITE=" " BDII_USER=edguser BDII_BIND=mds-vo-name=local,o=grid BDII_PASSWD=26082 BDII_SEARCH_FILTER='(|(objectClass=GlueSchemaVersion)(objectClass =GlueTop))' BDII_SEARCH_TIMEOUT=30 BDII_BREATHE_TIME=60  every 2 minute BDII cache is refreshed BDII_AUTO_UPDATE=yes  the list of GIIS is dynamic (no=static) BDII_AUTO_MODIFY=no BDII_DIR=/opt/bdii/ BDII_UPDATE_URL= update.conf BDII_UPDATE_LDIF= SLAPD=/usr/sbin/slapd SLAPADD=/usr/sbin/slapadd

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII customization (3) BDII log files in: /opt/bdii/var/bdii.log

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII customization (4) Example: –Change BDII_UPDATE_URL to: bdii/dteam/lcg2-all-sites.conf –Restart the service with: /etc/init.d/bdii restart –Give a look to the new information published by the service

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, BDII customization (5) The file /opt/bdii/etc/bdii-update.conf contains the list of GIIS:... INFN-CATANIA ldap://grid010.ct.infn.it:2170/mds-vo- name=infn-catania,o=grid # INFN-CNAF ldap://grid011f.cnaf.infn.it:2170/mds-vo- name=infn-cnaf,o=grid # INFN-PADOVA ldap://gilda-ce-01.pd.infn.it:2170/mds- vo-name=infn-padova,o=grid # IISAS-BRATISLAVA ldap://dgt01.ui.savba.sk:2170/mds- vo-name=iisas-gilda,o=grid # ULA-MERIDA ldap://grid006.cecalc.ula.ve:2170/mds-vo- name=ula-merida,o=grid

E-infrastructure shared between Europe and Latin America Lima, 12th EELA Tutorial, References LCG-2 User Guide gLite 3.0 User Guide gLite 3.0 Generic Installation and Configuration Guide Manual-Install/ YAIM guide for sysadmins BDII Documentation: