FP6−2004−Infrastructures−6-SSA-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America SRM + gLite IO Server install Emidio Giorgio.

Slides:



Advertisements
Similar presentations
12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America SRM Installation and Configuration.
Advertisements

EGEE is a project funded by the European Union under contract IST Using SRM: DPM and dCache G.Donvito,V.Spinoso INFN Bari
Storage: Futures Flavia Donno CERN/IT WLCG Grid Deployment Board, CERN 8 October 2008.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America FiReMan Installation Emidio Giorgio INFN.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America DPM Server Installation Luciano Diaz ICN-UNAM.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America DPM Server Installation Claudio Cherubino INFN – Catania.
9th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America SRM Installation and Configuration.
FP6−2004−Infrastructures−6-SSA User Interface Installation Valeria Ardizzone INFN – Catania Grid tutorial for users and.
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America User Interface installation and configuration.
E-science grid facility for Europe and Latin America UI PnP and UI Installation User and Site Admin Tutorial Riccardo Bruno – INFN Catania.
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) VOMS Installation and configuration Bouchra
DPM Server Installation Claudio Cherubino INFN - Catania.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America GENIUS server installation and configuration.
IST E-infrastructure shared between Europe and Latin America VOMS and MyProxy Server installation and configuration Pedro Henrique.
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America BDII Server Installation Vanessa.
1 Introduction to the tutorial for site managers Antonio Fuentes Red.es/RedIRIS EGEE/EUMedGrid/EELA Tutorial for Managers Sevilla,
FP6−2004−Infrastructures−6-SSA Computing Element & Torque Server Installation Giuseppe La Rocca INFN – Catania Grid tutorial for users and system.
E-science grid facility for Europe and Latin America LFC Server Installation and Configuration Antonio Calanducci INFN Catania.
E-science grid facility for Europe and Latin America gLite WMS Installation and configuration Riccardo Bruno – INFN.CT 30/06/2008 – 04/07/2008.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America AMGA Server Installation Tony Calanducci.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America MyProxy server installation Emidio Giorgio.
INFSO-RI Enabling Grids for E-sciencE R-GMA Server Installation Tony Calanducci INFN Catania - Italy First Latin American Workshop.
INFSO-RI Enabling Grids for E-sciencE Installation and configuration of gLite Resource Broker Emidio Giorgio INFN EGEE-EMBRACE tutorial,
INFSO-RI Enabling Grids for E-sciencE WMS + LB Installation Emidio Giorgio Giuseppe La Rocca INFN EGEE Tutorial, Rome November.2005.
INFSO-RI Enabling Grids for E-sciencE WMS & LB Installation Giuseppe La Rocca INFN Catania - Italy First Latin American Workshop.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Computing Element & Torque Server Installation.
 CASTORFS web page - CASTOR web site - FUSE web site -
9th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
12th EELA Tutorial for Users and System Administrators E-infrastructure shared between Europe and Latin America User Interface installation.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS + LB Installation Emidio Giorgio INFN.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation and Configuration Antonio Juan.
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation and Configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America User Interface (gLite 1.4) Installation.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Worker Node installation & configuration.
E-infrastructure shared between Europe and Latin America Introduction to the tutorial for site managers Vanessa Hamar Universidad de Los.
INFSO-RI Enabling Grids for E-sciencE Installing a gLite VOMS Server Giuseppe La Rocca INFN EGEE Tutorial Rome November 2005.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Introduction to the tutorial for site managers.
INFSO-RI Enabling Grids for E-sciencE Installing a gLite VOMS server Joachim Flammer Integration Team, CERN EMBRACE Tutorial, Clermont-Ferrand.
INFSO-RI Enabling Grids for E-sciencE User Interface (UI) Installation Giuseppe La Rocca INFN Catania - Italy First Latin American.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America gLite Information System Claudio Cherubino.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS+LB Server Installation Tony Calanducci.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America DPM Server Installation Claudio Cherubino.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America R-GMA Server Installation Valeria Ardizzone.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
Ninth EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America BDII Server Installation Yubiryn Ramírez.
Third EELA Tutorial for Managers and Users E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS+LB Server Installation Eduardo Murrieta.
TP: Grid site installation BEINGRID site installation.
INFSO-RI Enabling Grids for E-sciencE Installing & configuring Joachim Flammer Integration Team, CERN EMBRACE Tutorial, Clermont-Ferrand.
INFSO-RI Enabling Grids for E-sciencE Computing Element & Torque Server Installation Giuseppe La Rocca INFN Catania - Italy First.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation Claudio Cherubino.
12th EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite VOMS Installation and Configuration Riccardo Bruno
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks File Transfer Service Installation (v. 1.4)
INFSO-RI Enabling Grids for E-sciencE FiReMan Catalog installation Emidio Giorgio INFN EGEE tutorial, Rome
INFSO-RI Enabling Grids for E-sciencE FiReMan Catalog installation Emidio Giorgio INFN First Latin American Workshop for Grid Administrators.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
16-26 June 2008, Catania (Italy) First South Africa Grid Training LFC Server Installation and Configuration Antonio Calanducci INFN Catania.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Worker Node & Torque Client Installation.
LFC Server Installation & Configuration
Classic Storage Element
Federico Bitelli bitelli<at>fis.uniroma3.it
MyProxy Server Installation
gLite User Interface Installation
R-GMA Server Installation (v. 1.4)
Installing a gLite VOMS Server
INFNGRID Workshop – Bari, Italy, October 2004
Presentation transcript:

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America SRM + gLite IO Server install Emidio Giorgio INFN Catania First EELA Grid Tutorial for user and system administrators Madrid,

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 2 SRM + gLite IO server IO server is the gLite component in charge of handling user input-output request gLite IO server relies against a Mass Storage System implementing SRM interface gLite IO server comunicates with MSS through SRM Tested MSS are CASTOR, dCache and DPM So to use gLite IO you need an SRM too ! Further details on DPM –

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 3 Dpm installation

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 4 Installing DPM via apt 1.Verify if apt is present: –rpm -qa | grep apt –Install apt if necessary:  rpm -ivh cnc6-8.SL.cern.i386.rpmhttp://linuxsoft.cern.ch/cern/slc30X/i386/SL/RPMS/apt cnc6-8.SL.cern.i386.rpm 2.Add gLite apt repository: –Put one of the following lines in a file (e.g. glite.list) inside the /etc/apt/sources.list.d directory –rpm rhel30 externals Release1.5 updates 3.Update apt repository: –apt-get update –apt-get dist-upgrade 4.Install DPM server: –apt-get install glite-dpm-disk-server-config –apt-get install glite-dpm-server-mysql-config Extra packages needed (non freely distributable) : J2SE v 1.4.2_08 JRE: See

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 5 Request host certificates for the box – Copy host certificate ( hostcert.pem and hostkey.pem ) in /etc/grid-certificates. – chmod 644 hostcert.pem – chmod 400 hostkey.pem If planning to use certificates released by unsupported EGEE CA’s, be sure that their public key and CRLs (usually distributed with an rpm) are installed. – CA GILDA ones are available from Preliminary

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 6 gLite configuration – short reminder Configuration files – XML format – templates provided in /opt/glite/etc/config/templates Hierarchy of configuration file – Global configuration file – service specific configuration files Parameter groups – User parameters (‘changeme’) – Advanced parameters – System parameters

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 7 Configuration Configuration comes through the execution of pyhton scripts, which takes as input xml files. So services have to be configured by editing these xml files Xml files are provided as templates, under / opt/glite/etc/config/templates Copy templates file to /opt/glite/etc/config glite-dpm-server.cfg.xml glite-rgma-gin.cfg.xml glite-global.cfg.xml glite-rgma-servicetool.cfg.xml glite-dpm-disk-server.cfg.xml glite-rgma-common.cfg.xml glite-security-utils.cfg.xml vo-list.cfg.xml

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 8 Other cfg.xml vo-list.cfg.xml –Fill with the information on the VO (VOMS) that the services will support. glite-rgma-common.cfg.xml –Set the RGMA-server name(s) glite-rgma-servicetool.cfg.xml –Just the machine FQDN name on rgma.servicetool.sitename attribute glite-global.cfg.xml –General aspects. Typically just the JAVA_HOME attribute needs to be changed, put in the location of your JVM glite-rgma-gin.cfg.xml –“NO” for both the attributes glite-security-utils.cfg.xml –Just set the cron.mailto attribute value

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 9 glite-dpm-disk-server.cfg.xml Provides configuration for the DPM clients (gsiftp, rfio) An instance of dpm-disk-server must be running on each machine exporting disk space Preliminary –Each “piece” of fs we want to export must stay on a separate partition, owned by the user running DPM client services –So create a separate partition on filesystem –See command history for details Key values : dpm-server.host : set to the DPM server FQDN (itself in this configuration) dpns-server.host : set to the DPNS server FQDN (itself in this configuration) Now we need to configure the DPM server…….

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 10 glite-dpm-server.cfg.xml Key values – db.type mysql (don’t set root password and be sure that mysql server hasn’t…) – disk-server.list : fill with list of disk server which are exporting filesystems (the box itself in this case) – io-server.voname : name of vo in the IO server this DPM will support – io-server.hostname : put the name of the machine which will run the IO server relying on this DPM (the box itself in this case) – io-server.certificate.subject : the subject of IO server host certificate

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 11 Commit configuration Once edited xml files, commit configuration for both disk-server and DPM server – cd /opt/glite/etc/config/scripts –./glite-dpm-disk-server-config.py –-configure –./glite-dpm-server-config.py –-configure –./glite-dpm-server-config.py –-start –./glite-dpm-disk-server-config.py –start

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 12 Post configuration DPM server and disk-server are now running, but they are not exporting any part of filesystem We have to build the DPNS namespace, with the right permissions – dpns-mkdir – dpns-chmod – dpns-chown – dpns-setacl We should make aware DPM clients of which disk space they have to export – dpm-addfs – dpm-addpool The disk portion we’ll export should stay on a separate partition owned by the user running dpm (dpmmgr usually) See related history for deep details !

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 13 IO server Installation

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 14 Installing gLite IO server via apt 1.Verify if apt is present: –rpm -qa | grep apt –Install apt if necessary:  rpm -ivh cnc6-8.SL.cern.i386.rpmhttp://linuxsoft.cern.ch/cern/slc30X/i386/SL/RPMS/apt cnc6-8.SL.cern.i386.rpm 2.Add gLite apt repository: –Put one of the following lines in a file (e.g. glite.list) inside the /etc/apt/sources.list.d directory –rpm rhel30 externals Release1.4 updates 3.Update apt repository: –apt-get update –apt-get dist-upgrade 4.Install DPM server: –apt-get install glite-io-server-config Extra packages needed (non freely distributable) : J2SE v 1.4.2_08 JRE: See

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 15 Request host certificates for the box – Copy host certificate ( hostcert.pem and hostkey.pem ) in /etc/grid-certificates. – chmod 644 hostcert.pem – chmod 400 hostkey.pem If planning to use certificates released by unsupported EGEE CA’s, be sure that their public key and CRLs (usually distributed with an rpm) are installed. – CA GILDA ones are available from Preliminary

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 16 Configuration Configuration comes through the execution of pyhton scripts, which takes as input xml files. So services have to be configured by editing these xml files Xml files are provided as templates, under / opt/glite/etc/config/templates Copy templates file to /opt/glite/etc/config glite-global.cfg.xml glite-rgma-servicetool.cfg.xml glite-io-server.cfg.xml glite-rgma-common.cfg.xml glite-security-utils.cfg.xml

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 17 Other cfg.xml glite-rgma-common.cfg.xml –Set the RGMA-server name(s) glite-rgma-servicetool.cfg.xml –Just the machine FQDN name on rgma.servicetool.sitename attribute glite-global.cfg.xml –General aspects. Typically just the JAVA_HOME attribute needs to be changed, put in the location of your JVM glite-security-utils.cfg.xml –Just set the cron.mailto attribute value

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 18 glite-io-server.cfg.xml VO instance section(s) : for each VO served, need to configure an instance –init.CatalogType (fireman) –io-resolve-common.SeHostname (the name of SRM box) –io-resolve-common.SrmEndPoint SRM endpoint –io-resolve-common.RootPath DPNS namespace for the VO –io-resolve-common.SeProtocol rfio –io-authz-fas.FasEndpoint endpoint of Fireman catalogue –io-resolve-fireman.FiremanEndpoint = FasEndpoint –io-daemon.Port (< 9999) General section : service parameter (uid, gid) –init.username init.groupname uid—gid

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America First EELA Grid Tutorial for user and system administrators 19 Post configuration Before committing configuration, is better to check the gridmap file is filled Put on /opt/glite/etc/glite-mkgridmap.conf a line for each served VO The vo users will be mapped so to the user running IO daemons /opt/glite/etc/config/scripts/mkgridmap.py./glite-io-server-config.py --configure./glite-io-server-config.py --start Enjoy ! group vomss://voms.ct.infn.it:8443/voms/gilda?/gilda gliteio