GLite WN Installation Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.

Slides:



Advertisements
Similar presentations
12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATOR E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
Advertisements

The Gilda User Interface Discipline: Grid Computing, 07/08-2 Practical classes Inês Dutra, DCC/FCUP.
INFSO-RI Enabling Grids for E-sciencE Computing Element installation & configuration Giuseppe Platania INFN Catania EMBRACE Tutorial.
FP6−2004−Infrastructures−6-SSA User Interface Installation Valeria Ardizzone INFN – Catania Grid tutorial for users and.
1 Kolkata, Asia Joint CHAIN/EU-IndiaGrid2/EPIKH School for Grid Site Administrators, The EPIKH Project (Exchange Programme.
1 Worker Nodes Installation&Configuration Sara Bertocco INFN Padova 11 th International GridKa School 2013 – Big Data, Clouds and Grids.
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America User Interface installation and configuration.
E-science grid facility for Europe and Latin America UI PnP and UI Installation User and Site Admin Tutorial Riccardo Bruno – INFN Catania.
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) VOMS Installation and configuration Bouchra
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) CE+WN+siteBDII Installation and configuration Bouchra
E-science grid facility for Europe and Latin America Installation and configuration of a top BDII Gianni M. Ricciardi – Consorzio COMETA.
The gLite API – PART I Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America BDII Server Installation Vanessa.
1 Introduction to the tutorial for site managers Antonio Fuentes Red.es/RedIRIS EGEE/EUMedGrid/EELA Tutorial for Managers Sevilla,
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Workload Management System + Logging&Bookkeeping Installation.
E-science grid facility for Europe and Latin America LFC Server Installation and Configuration Antonio Calanducci INFN Catania.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America MyProxy server installation Emidio Giorgio.
EPIKH School for Grid Site Administrators, Amman, /32 Introductions BDII Installation and Configuration Miguel Angel Díaz Corchero
9th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
12th EELA Tutorial for Users and System Administrators E-infrastructure shared between Europe and Latin America User Interface installation.
UNIT - III. Time Server It is a daemon that runs on one machine and to which other systems synchronize their system clocks. It is a service that provides.
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks User Interface: installation, configuration.
Network Time Protocol Objectives Contents to learn how to setup ntp
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Giuseppe La Rocca INFN – Catania
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation and Configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America User Interface (gLite 1.4) Installation.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Worker Node installation & configuration.
E-infrastructure shared between Europe and Latin America Introduction to the tutorial for site managers Vanessa Hamar Universidad de Los.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Introduction to the tutorial for site managers.
INFSO-RI Enabling Grids for E-sciencE User Interface (UI) Installation Giuseppe La Rocca INFN Catania - Italy First Latin American.
CREAM Installation&Configuration Sara Bertocco INFN Padova 11 th International GridKa School 2013 – Big Data, Clouds and Grids.
CE: compute element TP: CE & WN Compute Element Worker Node Installation configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America R-GMA Server Installation Valeria Ardizzone.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
EGEE-II INFSO-RI Enabling Grids for E-sciencE YAIM Overview MiMOS Grid tutorial HungChe, ASGC OPS Team.
Third EELA Tutorial for Managers and Users E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin.
South African Grid Training COMPUTING ELEMENT Albert van Eck UFS - ICTS 18 November 2009 Slides by: GIUSEPPE PLATANIA.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS+LB Server Installation Eduardo Murrieta.
E-science grid facility for Europe and Latin America COMPUTING ELEMENT GIUSEPPE PLATANIA INFN Catania 30 June - 4 July, 2008.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation Claudio Cherubino.
12th EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) UI Installation and Configuration Dong Xu IHEP,
Presentation of the results khiat abdelhamid
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite VOMS Installation and Configuration Riccardo Bruno
First South Africa Grid Training WORKER NODE Albert van Eck University of the Free State 25 July, 2008.
First South Africa Grid Training Installation and configuration of BDII Gianni M. Ricciardi Consorzio COMETA First South Africa Grid Training Catania,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks BDII Server Installation & Configuration.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) WMS LB BDII Installation and Configuration Salma Saber
Site BDII and CE Installation Muhammad Farhan Sjaugi, UPM 2009 November , UM Malaysia 1.
Overview about other gLite services Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
WORKER NODE Alfonso Pardo EPIKH School, System Admin Tutorial Beijing, 2010 August 30th – 2010 September 3th.
INFSO-RI Enabling Grids for E-sciencE Worker Node installation & configuration Giuseppe Platania INFN Catania EMBRACE Tutorial Clermont-Ferrand,
South African Grid Training WORKER NODE Albert van Eck UFS - ICTS 17 November 2009 Slides by GIUSEPPE PLATANIA.
NTP in UBuntu. The Network Time Protocol (NTP) is a protocol for synchronizing the clocks of computer systems over packet-switched, variable- latency.
User Interface (UI) Installation Bandung ITB Desember 2009.
16-26 June 2008, Catania (Italy) First South Africa Grid Training LFC Server Installation and Configuration Antonio Calanducci INFN Catania.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Worker Node & Torque Client Installation.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Elisa Ingrà Consortium GARR- Roma WMS LB.
User Interface. Possible ways for deploying UI
LFC Server Installation & Configuration
Installation and configuration of a top BDII
(Exchange Programme to advance e-Infrastructure Know-How)
UI PnP and gLite UI installation
UI Installation and Configuration
Berkley Database Information Index (BDII) Server Installation & Configuration Giuseppe La Rocca INFN – Catania gLite Tutorial Rome, April 2006.
WMS LB topBDII Installation and Configuration
UI Installation and Configuration
Presentation transcript:

gLite WN Installation Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia

Overview Pre-requisites Installation of a gLite WN Configuration Testing References Outline 2

Overview The Worker Node is a service where the jobs run. Its main functionally are: – execute the jobs – update to Computing Element the status of the jobs It can run several kinds of client batch system: Torque LSF SGE Condor

TORQUE client The Torque client is composed by a: – pbs_mom which places the job into execution. – It is also responsible for returning the job’s output to the user

Login to Virtual Machine Start SSH to ui.thinkgrid.org Use the username and password specified in your tutorial worksheet to ssh to your VM E.g.: ssh –X 5

Pre-requisites Start from a base SL4.7 machine with the following rpm groups : –X Window System –Editors X Software Development –Text-based Internet –Server Configuration Tools –Development Tools –Administration Tools –System Tools –Legacy Software Development Please refer to Site_Pre-Installation to prepare and set up your machine for gLite middleware installationSite_Pre-Installation

A general requirement for the gLite nodes is that they are synchronized. Configure the file /etc/ntp.conf by adding the lines dealing with your time server configuration such as, for instance: # Prohibit general access to this service. restrict default ignore restrict mask nomodify notrap noquery server # local clock fudge stratum 10 server ntp-1.infn.it Syncronizing…

Edit the file /etc/ntp/step-tickers adding a list of your time server(s) hostname(s) cat /etc/ntp/step-tickers If you are running a kernel firewall, you will have to allow inbound communication on the NTP port. If you are using iptables, you can add the following to /etc/sysconfig/iptables -A INPUT -s -p udp --dport 123 -j ACCEPT You can then reload the firewall : service iptables restart Syncronizing…

Activate the ntpd service with the following commands: # ntpdate ntp-1.infn.it # service ntpd start # chkconfig ntpd on You can check ntpd's status by running the following command : # ntpq -p Syncronizing…

Repository settings Configure the repositories as follow: cd /etc/yum.repos.d/ wget ftp://mirror.biruni.upm.my/repos/3.1/glite-WN.repo \ftp://mirror.biruni.upm.my/repos/3.1/glite-WN.repo \ ftp://mirror.biruni.upm.my/repos/3.1/lcg-CA.repo \ ftp://mirror.biruni.upm.my/repos/3.1/jpackage.repo \ \ ftp://mirror.biruni.upm.my/repos/3.1/glite- TORQUE_client.repo

Install meta-packages Install Java and the meta-package for the UI  yum install glite-WN glite-TORQUE_client java sun- compat Install the CAs and the utils to support the GILDA VO:  yum install lcg-CA gilda_utils

Configure Download the “corrected” site-info.def for your server cd /opt/glite/yaim/etc/ wget ftp://mirror.biruni.upm.my/klacgrid/site-info.defftp://mirror.biruni.upm.my/klacgrid/site-info.def wget ftp://mirror.biruni.upm.my/klacgrid/users.confftp://mirror.biruni.upm.my/klacgrid/users.conf wget ftp://mirror.biruni.upm.my/klacgrid/groups.confftp://mirror.biruni.upm.my/klacgrid/groups.conf Protect your configuration file chmod 600 site-info.def Verify your configuration file source site-info.def

Configure WN Settings for the site-info.def MY_DOMAIN="thinkgrid.org“ # Human-readable name of your site SITE_NAME=ACGRID-CE-  Customize here! # The contact of your site SITE_ =“”  Add your here # Hostname of the CE CE_HOST=  Customize here! TORQUE_SERVER=$CE_HOST BATCH_SERVER=$CE_HOST BATCH_VERSION=2.3.0 # Jobmanager specific settings. Please, define: # lcgpbs, lcglfs, lcgsge or lcgcondor JOB_MANAGER=lcgpbs # Number of Logical CPUs (cores) of the WN in the SubCluster CE_SMPSIZE=1

Configure WN # torque, lsf, sge or condor CE_BATCH_SYS=torque BATCH_LOG_DIR=/var/spool/pbs_server/logs/ # Space separated list of SEs hostnames SE_LIST=se.$MY_DOMAIN  Customize here! # Hostname of the RGMA server MON_HOST=ui.$MY_DOMAIN # Space separated list of VOs supported by your site VOS="gilda euasia" # Prefix of the experiment software directory in your CE VO_SW_DIR=/opt/exp_soft # Space separated list of queues configured in your CE QUEUES="gilda euasia" GILDA_GROUP_ENABLE="gilda" EUASIA_GROUP_ENABLE="euasia"

Configure (cont.) ########## # EUASIA # ########## VO_EUASIA_SW_DIR=$VO_SW_DIR/euag VO_EUASIA_DEFAULT_SE=$DPM_HOST VO_EUASIA_STORAGE_DIR=$CLASSIC_STORAGE_DIR/euasia VO_EUASIA_VOMS_SERVERS="vomss://voms.grid.sinica.edu.tw:8443/v oms/euasia?/euasia" VO_EUASIA_VOMSES="'euasia voms.grid.sinica.edu.tw /C=TW/O=AS/OU=GRID/CN=voms.grid.sinica.edu.tw euasia'" VO_EUASIA_VOMS_CA_DN="'/C=TW/O=AS/OU=GRID/CN=voms.grid.sinica. edu.tw'" VO_EUASIA_CA_DN="'/C=TW/O=AS/CN=Academia Sinica Grid Computing Certification Authority Mercury' '/C=TW/O=AS/CN=Academia Sinica Grid Computing Certification Authority Mercury'"

Configure (cont.) ######### # GILDA # ######### VO_GILDA_SW_DIR=$VO_SW_DIR/gilda VO_GILDA_DEFAULT_SE=$DPM_HOST VO_GILDA_STORAGE_DIR=$CLASSIC_STORAGE_DIR//gilda VO_GILDA_QUEUES= "gilda" VO_GILDA_VOMS_SERVERS="vomss://voms.ct.infn.it:8443/voms/gilda ?/gilda" VO_GILDA_VOMSES="'gilda voms.ct.infn.it /C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it gilda'" VO_GILDA_VOMS_CA_DN="'/C=IT/O=INFN/CN=INFN CA' '/C=IT/O=INFN/CN=INFN CA'"

Configure (cont.)  Configure the /opt/glite/yaim/etc/wn-list.conf  Configure WN /opt/glite/yaim/bin/yaim –c –s site-info.def \ –n glite-WN \ -n glite-TORQUE_client

Install VOMS cert. Download under /etc/grid-security/vomsdir/ the EUASIA voms host certificate wget and rename this file to voms.grid.sinica.edu.tw.pem

Verify if the pbs_mom is active and if its status is free: root]# /etc/init.d/pbs_mom status pbs_mom (pid 3692) is running... # pbsnodes -a vm.thinkgrid.org state = free  np = 2 properties = lcgpro ntype = cluster status = arch=linux,uname=Linux wn.localdomain EL.cern 1 Tue Oct 4 16:45:05 CEST 2005 i686,sessions= ,3584,nsessions=6,nusers=1,idletime=1569,totmem=254024kb,av ailmem=69852kb,physmem=254024kb,ncpus=1,loadave=0.30,rectime= Testing

Firewall Settings For further information, see the document info.ports/doc/middleware-ports.txt?revision=1.15&view=markupthe info.ports/doc/middleware-ports.txt?revision=1.15&view=markupthe

References Refer to the following references for more details about required variables of the gLite WN: – info_configuration_variables#WNhttps://twiki.cern.ch/twiki/bin/view/LCG/Site- info_configuration_variables#WN