Overview about other gLite services Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.

Slides:



Advertisements
Similar presentations
12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATOR E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
Advertisements

The Gilda User Interface Discipline: Grid Computing, 07/08-2 Practical classes Inês Dutra, DCC/FCUP.
INFSO-RI Enabling Grids for E-sciencE Computing Element installation & configuration Giuseppe Platania INFN Catania EMBRACE Tutorial.
FP6−2004−Infrastructures−6-SSA User Interface Installation Valeria Ardizzone INFN – Catania Grid tutorial for users and.
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America User Interface installation and configuration.
E-science grid facility for Europe and Latin America UI PnP and UI Installation User and Site Admin Tutorial Riccardo Bruno – INFN Catania.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Overview of software tools for gLite installation & configuration.
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) VOMS Installation and configuration Bouchra
E-science grid facility for Europe and Latin America Installation and configuration of a top BDII Gianni M. Ricciardi – Consorzio COMETA.
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America BDII Server Installation Vanessa.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Workload Management System + Logging&Bookkeeping Installation.
E-science grid facility for Europe and Latin America LFC Server Installation and Configuration Antonio Calanducci INFN Catania.
E-science grid facility for Europe and Latin America gLite WMS Installation and configuration Riccardo Bruno – INFN.CT 30/06/2008 – 04/07/2008.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America MyProxy server installation Emidio Giorgio.
INFSO-RI Enabling Grids for E-sciencE Installation and configuration of gLite Resource Broker Emidio Giorgio INFN EGEE-EMBRACE tutorial,
EPIKH School for Grid Site Administrators, Amman, /32 Introductions BDII Installation and Configuration Miguel Angel Díaz Corchero
INFSO-RI Enabling Grids for E-sciencE WMS + LB Installation Emidio Giorgio Giuseppe La Rocca INFN EGEE Tutorial, Rome November.2005.
9th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
12th EELA Tutorial for Users and System Administrators E-infrastructure shared between Europe and Latin America User Interface installation.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS + LB Installation Emidio Giorgio INFN.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation and Configuration Antonio Juan.
BDII Server Installation and Configuration Manuel Rubio del Solar Extremadura Advanced Research Center (CETA-CIEMAT) 11th EELA Tutorial for Users Sevilla,
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks User Interface: installation, configuration.
Network Time Protocol Objectives Contents to learn how to setup ntp
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Giuseppe La Rocca INFN – Catania
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation and Configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America User Interface (gLite 1.4) Installation.
E-infrastructure shared between Europe and Latin America Introduction to the tutorial for site managers Vanessa Hamar Universidad de Los.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Introduction to the tutorial for site managers.
INFSO-RI Enabling Grids for E-sciencE User Interface (UI) Installation Giuseppe La Rocca INFN Catania - Italy First Latin American.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America R-GMA Server Installation Valeria Ardizzone.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America BDII Server Installation Yubiryn Ramírez.
EGEE-II INFSO-RI Enabling Grids for E-sciencE YAIM Overview MiMOS Grid tutorial HungChe, ASGC OPS Team.
Third EELA Tutorial for Managers and Users E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Progress report from University of Cyprus.
12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS+LB Server Installation Eduardo Murrieta.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation Claudio Cherubino.
12th EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) UI Installation and Configuration Dong Xu IHEP,
Presentation of the results khiat abdelhamid
GLite WN Installation Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite VOMS Installation and Configuration Riccardo Bruno
First South Africa Grid Training WORKER NODE Albert van Eck University of the Free State 25 July, 2008.
First South Africa Grid Training Installation and configuration of BDII Gianni M. Ricciardi Consorzio COMETA First South Africa Grid Training Catania,
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) LFC Installation and Configuration Dong Xu IHEP,
SEE-GRID-SCI MON Hands-on Session Vladimir Slavnić Institute of Physics Belgrade Serbia The SEE-GRID-SCI initiative.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks BDII Server Installation & Configuration.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) WMS LB BDII Installation and Configuration Salma Saber
Site BDII and CE Installation Muhammad Farhan Sjaugi, UPM 2009 November , UM Malaysia 1.
WORKER NODE Alfonso Pardo EPIKH School, System Admin Tutorial Beijing, 2010 August 30th – 2010 September 3th.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
South African Grid Training WORKER NODE Albert van Eck UFS - ICTS 17 November 2009 Slides by GIUSEPPE PLATANIA.
NTP in UBuntu. The Network Time Protocol (NTP) is a protocol for synchronizing the clocks of computer systems over packet-switched, variable- latency.
User Interface (UI) Installation Bandung ITB Desember 2009.
16-26 June 2008, Catania (Italy) First South Africa Grid Training LFC Server Installation and Configuration Antonio Calanducci INFN Catania.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Elisa Ingrà Consortium GARR- Roma WMS LB.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Workload Management System + Logging&Bookkeeping Installation.
LFC Server Installation & Configuration
Installation and configuration of a top BDII
WMS Installation and Configuration
UI PnP and gLite UI installation
UI Installation and Configuration
Berkley Database Information Index (BDII) Server Installation & Configuration Giuseppe La Rocca INFN – Catania gLite Tutorial Rome, April 2006.
WMS LB topBDII Installation and Configuration
BDII Server Installation and Configuration
UI Installation and Configuration
Presentation transcript:

Overview about other gLite services Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia

gLite Top BDII LFC File Catalog WMS+LB AMGA MON Outline 2

Pre-requisites Start from a base SL4.7 machine with the following rpm groups : –X Window System –Editors X Software Development –Text-based Internet –Server Configuration Tools –Development Tools –Administration Tools –System Tools –Legacy Software Development

A general requirement for the gLite nodes is that they are synchronized. Configure the file /etc/ntp.conf by adding the lines dealing with your time server configuration such as, for instance: # Prohibit general access to this service. restrict default ignore restrict mask nomodify notrap noquery server # local clock fudge stratum 10 server ntp-1.infn.it Syncronizing…

Edit the file /etc/ntp/step-tickers adding a list of your time server(s) hostname(s) cat /etc/ntp/step-tickers If you are running a kernel firewall, you will have to allow inbound communication on the NTP port. If you are using iptables, you can add the following to /etc/sysconfig/iptables -A INPUT -s -p udp --dport 123 -j ACCEPT You can then reload the firewall : service iptables restart Syncronizing…

Activate the ntpd service with the following commands: # ntpdate # service ntpd start # chkconfig ntpd on You can check ntpd's status by running the following command : # ntpq -p Syncronizing…

Repository settings Configure the repositories as follow: Top BDII cd /etc/yum.repos.d/ wget ftp://mirror.biruni.upm.my/repos/3.1/glite-BDII.repo \ftp://mirror.biruni.upm.my/repos/3.1/glite-BDII.repo \ ftp://mirror.biruni.upm.my/repos/3.1/lcg-CA.repo \ ftp://mirror.biruni.upm.my/repos/3.1/jpackage.repo \ \ ftp://mirror.biruni.upm.my/repos/3.1/dag.repo \ LFC File Catalog cd /etc/yum.repos.d/ wget ftp://mirror.biruni.upm.my/repos/3.1/glite-LFC_mysql.repo \ftp://mirror.biruni.upm.my/repos/3.1/glite-LFC_mysql.repo \ ftp://mirror.biruni.upm.my/repos/3.1/lcg-CA.repo \ ftp://mirror.biruni.upm.my/repos/3.1/jpackage.repo \ \ ftp://mirror.biruni.upm.my/repos/3.1/dag.repo \

Repository settings Configure the repositories as follow: WMS+LB cd /etc/yum.repos.d/ wget ftp://mirror.biruni.upm.my/repos/3.1/glite-WMS.repo \ftp://mirror.biruni.upm.my/repos/3.1/glite-WMS.repo \ ftp://mirror.biruni.upm.my/repos/3.1/glite-LB.repo \ ftp://mirror.biruni.upm.my/repos/3.1/lcg-CA.repo \ ftp://mirror.biruni.upm.my/repos/3.1/jpackage.repo \ \ ftp://mirror.biruni.upm.my/repos/3.1/dag.repo \ AMGA cd /etc/yum.repos.d/ wget ftp://mirror.biruni.upm.my/repos/3.1/glite-AMGA_postgress.repo \ ftp://mirror.biruni.upm.my/repos/3.1/lcg-CA.repo \ ftp://mirror.biruni.upm.my/repos/3.1/jpackage.repo \ ftp://mirror.biruni.upm.my/repos/3.1/dag.repo \

Repository settings Configure the repositories as follow: MON cd /etc/yum.repos.d/ wget ftp://mirror.biruni.upm.my/repos/3.1/glite-MON.repo \ftp://mirror.biruni.upm.my/repos/3.1/glite-MON.repo \ ftp://mirror.biruni.upm.my/repos/3.1/lcg-CA.repo \ ftp://mirror.biruni.upm.my/repos/3.1/jpackage.repo \ \ ftp://mirror.biruni.upm.my/repos/3.1/dag.repo yum clean all Loading "kernel-module" plugin Cleaning up Everything 72 headers removed 0 packages removed 12 metadata files removed 0 cache files removed 6 cache files removed

Install meta-packages Top BDII: Install Java and the meta-package for the UI yum install glite-BDII java sun-compat LFC: Install Java and the meta-package for the LFC yum install glite-LFC_mysql java sun-compat WMS+LB: Install Java and the meta-package for the WMS+LB yum install glite-WMS glite-LB java sun-compat AMGA: Install Java and the meta-package for the AMGA yum install glite-AMGA_postgress java sun-compat MON: Install Java and the meta-package for the MON yum install glite-MON java sun-compat Install the CAs and the utils to support the GILDA VO: yum install lcg-CA gilda_utils

Configure Download the “corrected” site-info.def for your server cd /opt/glite/yaim/examples/siteinfo/ wget ftp://mirror.biruni.upm.my/klacgrid/site-info.defftp://mirror.biruni.upm.my/klacgrid/site-info.def Protect your configuration file chmod 600 site-info.def Verify your configuration file source site-info.def

Configure Top BDII Settings for the site-info.def # Hostname of the top level BDII BDII_HOST= # Hostname of the DPM head node DPM_HOST=“ “ ???? # Human-readable name of your site SITE_NAME= # The contact of your site SITE_ =“”

Configure Top BDII Settings for the /opt/glite/yaim/examples/siteinfo/services/glite- bdii_site SITE_DESC=“Your Site description" SITE_SUPPORT_ ="" SITE_SECURITY_ ="" SITE_LOC="City, Country" SITE_WEB=" SITE_OTHER_GRID="INFNGRID|EGEE" # List of hosts where there are services that want to publish into the BDII BDII_REGIONS="CE SE" # The following example is valid for hosts using BDII. # If your host is using MDS instead (all 3.0 nodes) # change the port to 2135 and mds-vo-name=local BDII_CE_URL="ldap://$CE_HOST:2170/mds-vo-name=resource,o=grid" BDII_SE_URL="ldap://$DPM_HOST:2170/mds-vo-name=resource,o=grid"

Configure LFC Settings for the site-info.def # Human-readable name of your site SITE_NAME= # MySQL admin password. Choose a good password! MYSQL_PASSWORD= LFC_HOST= # Standard database on the LFC host LFC_DB_HOST=$LFC_HOST LFC_DB=cns_db LFC_CENTRAL="gilda euasia“ # INFN-GRID: set this var to "yes" if your LFC server is a # replica of a "central" one, and has to be read_only for # users. Default value: no LFC_READONLY=no LFC_DB_PASSWORD=$MYSQL_PASSWORD # Space separated list of supported VOs by your site VOS="gilda euasia"

Configure WMS+LB Settings for the site-info.def # Hostname of the top level BDII BDII_HOST= # MySQL admin password. Choose a good password! MYSQL_PASSWORD= # Human-readable name of your site SITE_NAME= # The contact of your site SITE_ =“” # Hostname of the WMS WMS_HOST= # Space separated list of supported VOs by your site VOS="gilda euasia"

Configure WMS+LB Settings for the /opt/glite/yaim/examples/siteinfo/services/glite-wms # Set LB_HOST="host1:port1 host2:port2 host3:port3" # if more than one LB is installed on separate nodes LB_HOST=“ :9000“

Configure WMS+LB Settings for the /opt/glite/yaim/default/glite-wms.pre GLITE_LOCATION_VAR="/var/glite" GLITE_LOCATION_LOG="/var/log/glite" GLITE_LOCATION_TMP="/var/glite" GLITE_SD_PLUGIN="bdii" GLITE_WMS_GROUP=glite GLITE_WMS_USER=glite GLITE_WMS_QUERY_TIMEOUT=300 GLITE_PR_TIMEOUT=300 GLITE_WMS_WMPROXY_MAX_SERVED_REQUESTS=50 # Amount of time a job spend in WM queue before to be aborted. # If too short it generates trouble with job collections. WMS_EXPIRY_PERIOD=86400 # Time waited before to retry a match making after a first # failure. Good compromise 1800 WMS_MATCH_RETRY_PERIOD=21600

Configure AMGA Settings for the site-info.def # Space separated list of VOs supported by your site VOS="gilda euasia" #Variable that will be used for the root user to log into the amga server-put here a valid DN AMGA_ROOT_USER_DN='C = IT, O = GILDA, OU = Personal Certificate, L = INFN Catania, CN = Giuseppe La Rocca' #Variable that will be used for the test user (SAM tests etc) to log into the amga server-put here a valid DN AMGA_TEST_USER_DN='C = IT, O = GILDA, OU = Personal Certificate, L = INFN Catania, CN = Giuseppe La Rocca' INSTALL_ROOT="/opt"

Configure MON Box Settings for the site-info.def # Hostname of the RGMA server MON_HOST= # Uncomment this variable if you are installing a mysql server # It is the MySQL admin password. MYSQL_PASSWORD=KualaLumpur MYSQL_HOST=$MON_HOST MYSQL_REMOTE_USER=momadmin # Hostname of the CE CE_HOST= # Human-readable name of your site SITE_NAME= # Hostname of the site BDII SITE_BDII_HOST=

Configure MON Box Settings for the /opt/glite/yaim/defaults/glite-mon.pre # If GIN is to be configured using the site bdii set this to # "yes“. If fmon is to be used set this to no - defaults to # yes if not set GIN_BDII="yes" # If "yes" encrypt UserDNs with a 1024-bit RSA key # If "no", UserDNs are not published (default) APEL_PUBLISH_USER_DN="no" # The name of the user for access to the remote MySQL server MYSQL_REMOTE_USER="root" # The name of the host where the mysql server is located MYSQL_HOST="localhost"

Configure MON Box Before to configure yum install mysql-server ============================================================================= Package Arch Version Repository Size ============================================================================= Installing: mysql-server i el4.sl sl-base 9.9 M Installing for dependencies: mysql i el4.sl sl-base 3.1 M perl-DBD-mysql i el4.rf dag 221 k perl-DBI i el4.rf dag 858 k perl-Net-Daemon noarch el4.rf dag 44 k perl-PlRPC noarch el4.rf dag 33 k Transaction Summary ============================================================================= Install 6 Package(s) Update 0 Package(s) Remove 0 Package(s) Total download size: 14 M [.. cut.. ]

Configure (cont.) ########## # EUASIA # ########## VO_EUASIA_SW_DIR=$VO_SW_DIR/euag VO_EUASIA_DEFAULT_SE=$DPM_HOST VO_EUASIA_STORAGE_DIR=$CLASSIC_STORAGE_DIR/euasia VO_EUASIA_VOMS_SERVERS="vomss://voms.grid.sinica.edu.tw:8443/v oms/euasia?/euasia" VO_EUASIA_VOMSES="'euasia voms.grid.sinica.edu.tw /C=TW/O=AS/OU=GRID/CN=voms.grid.sinica.edu.tw euasia'" VO_EUASIA_VOMS_CA_DN="'/C=TW/O=AS/OU=GRID/CN=voms.grid.sinica. edu.tw'" VO_EUASIA_CA_DN="'/C=TW/O=AS/CN=Academia Sinica Grid Computing Certification Authority Mercury' '/C=TW/O=AS/CN=Academia Sinica Grid Computing Certification Authority Mercury'"

Configure (cont.) ######### # GILDA # ######### VO_GILDA_SW_DIR=$VO_SW_DIR/gilda VO_GILDA_DEFAULT_SE=$DPM_HOST VO_GILDA_STORAGE_DIR=$CLASSIC_STORAGE_DIR//gilda VO_GILDA_QUEUES=“gilda" VO_GILDA_VOMS_SERVERS="vomss://voms.ct.infn.it:8443/voms/gilda ?/gilda" VO_GILDA_VOMSES="'gilda voms.ct.infn.it /C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it gilda'" VO_GILDA_VOMS_CA_DN="'/C=IT/O=INFN/CN=INFN CA' '/C=IT/O=INFN/CN=INFN CA'"

Host certificates All nodes except UI, WN and BDII require the host certificate/key files to be installed; Contact your national Certification Authority (CA) to obtain a host certificate if you do not have one already; Make sure to place the two files in the target node into the /etc/grid-security directory and check the access right for hostkey.pem is only readable by root and that the public key, hostcert.pem, is readable by everybody.

Configure Top BDII: /opt/glite/yaim/bin/yaim – c – s site-info.def – n glite-BDII_top LFC: /opt/glite/yaim/bin/yaim – c – s site-info.def – n glite-LFC_mysql WMS+LB: /opt/glite/yaim/bin/yaim – c – s site-info.def – n glite-WMS – n glite-LB AMGA: /opt/glite/yaim/bin/yaim – c – s site-info.def – n glite- AMGA__postgres MON: /opt/glite/yaim/bin/yaim – c – s site-info.def – n glite-MON

Install VOMS cert. Download under /etc/grid-security/vomsdir/ the EUASIA voms host certificate wget s/0341.crt and rename this file to voms.grid.sinica.edu.tw.pem

Firewall Settings Fro further information, see the document info.ports/doc/middleware-ports.txt?revision=1.15&view=markupthe info.ports/doc/middleware-ports.txt?revision=1.15&view=markupthe

References Refer to the following references for more details about required variables of the gLite UI: – n_variableshttps://twiki.cern.ch/twiki/bin/view/LCG/UI_configuratio n_variables – info_configuration_variableshttps://twiki.cern.ch/twiki/bin/view/LCG/Site- info_configuration_variables