A closer look at the VDT RPMs Alain Roy OSG Software Coordinator.

Slides:



Advertisements
Similar presentations
Sabah Salih The School of Physics & Astronomy The University of Manchester Manchester M13 9PL Scientific Linux?
Advertisements

Andrew McNab - EDG Access Control - 14 Jan 2003 EU DataGrid security with GSI and Globus Andrew McNab University of Manchester
Basic Grid Job Submission Alessandra Forti 28 March 2006.
New VOMS servers campaign GDB, 8 th Oct 2014 Maarten Litmaath IT/SDC.
Installing Linux softwares Sirak Kaewjamnong. 2 Software packets  When Linux developers create their software they typically bundle all the executable.
A walkthrough of the SageQuest Mobile Control Online & ESC integration.
Partner Logo German Cancio – WP4-install LCFG HOW-TO - n° 1 WP4 hands-on workshop: EDG LCFGng exercises
OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.
INFSO-RI Enabling Grids for E-sciencE Practicals on VOMS and MyProxy Emidio Giorgio INFN Retreat between GILDA and ESR VO, Bratislava,
1 Worker Nodes Installation&Configuration Sara Bertocco INFN Padova 11 th International GridKa School 2013 – Big Data, Clouds and Grids.
E-science grid facility for Europe and Latin America UI PnP and UI Installation User and Site Admin Tutorial Riccardo Bruno – INFN Catania.
Open Science Grid Software Stack, Virtual Data Toolkit and Interoperability Activities D. Olson, LBNL for the OSG International.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Overview of software tools for gLite installation & configuration.
December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide Grid Technology: The Rough Guide Grid Building.
1 Dynamic Application Installation (Case of CMS on OSG) Introduction CMS Software Installation Overview Software Installation Issues Validation Considerations.
OSG Services at Tier2 Centers Rob Gardner University of Chicago WLCG Tier2 Workshop CERN June 12-14, 2006.
E-science grid facility for Europe and Latin America Installation and configuration of a top BDII Gianni M. Ricciardi – Consorzio COMETA.
OSG Middleware Roadmap Rob Gardner University of Chicago OSG / EGEE Operations Workshop CERN June 19-20, 2006.
DB server + PHPMyAdmin ดรัสวิน วงศ์ปรเมษฐ์ สาขาวิชาเทคโนโลยีสารสนเทศ คณะ วิทยาศาสตร์ มรภ. บร. 19/10/56.
MAE Continuous Integration Administration guide July 8th, 2013.
CERN Manual Installation of a UI – Oxford July - 1 LCG2 Administrator’s Course Oxford University, 19 th – 21 st July Developed.
G RID M IDDLEWARE AND S ECURITY Suchandra Thapa Computation Institute University of Chicago.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Workload Management System + Logging&Bookkeeping Installation.
E-science grid facility for Europe and Latin America LFC Server Installation and Configuration Antonio Calanducci INFN Catania.
Nadia LAJILI User Interface User Interface 4 Février 2002.
Evolution of the Open Science Grid Authentication Model Kevin Hill Fermilab OSG Security Team.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America MyProxy server installation Emidio Giorgio.
August 13, 2003Eric Hjort Getting Started with Grid Computing in STAR Eric Hjort, LBNL STAR Collaboration Meeting August 13, 2003.
An Introduction to Designing and Executing Workflows with Taverna Aleksandra Pawlik materials by: Katy Wolstencroft University of Manchester.
INFSO-RI Enabling Grids for E-sciencE Installation and configuration of gLite Resource Broker Emidio Giorgio INFN EGEE-EMBRACE tutorial,
Jabberd Quick Installation Guide. The jabberd server is the original open-source server implementation of the Jabber protocol, and is the most popular.
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
Open Science Grid OSG CE Quick Install Guide Siddhartha E.S University of Florida.
E-infrastructure shared between Europe and Latin America Security Hands-on Christian Grunfeld, UNLP 8th EELA Tutorial, La Plata, 11/12-12/12,2006.
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA Hands-on on security Pedro Rausch IF - UFRJ.
March 11, 2008 USCMS Tier-2 Workshop Oh Dear God Alain made a PowerPoint presentation 1.
Condor-G A Quick Introduction Alan De Smet Condor Project University of Wisconsin - Madison.
General rules 1. Rule: 2. Rule: 3. Rule: 10. Rule: Ask questions ……………………. 11. Rule: I do not know your skill. If I tell you things you know, please stop.
State of the OSG Software Stack Alain Roy OSG Software Coordinator.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Creating and running an application.
LESSON ONE DECISION ANALYSIS Subtopic 4 - R Programming Created by The North Carolina School of Science and Math forThe North Carolina School of Science.
Portal Update Plan Ashok Adiga (512)
VDT 1 The Virtual Data Toolkit Todd Tannenbaum (Alain Roy)
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America Security Hands-on Vanessa.
The OSG and Grid Operations Center Rob Quick Open Science Grid Operations Center - Indiana University ATLAS Tier 2-Tier 3 Meeting Bloomington, Indiana.
CREAM Installation&Configuration Sara Bertocco INFN Padova 11 th International GridKa School 2013 – Big Data, Clouds and Grids.
E-infrastructure shared between Europe and Latin America Security Hands-on Alexandre Duarte CERN Fifth EELA Tutorial Santiago, 06/09-07/09,2006.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America WMS+LB Server Installation Tony Calanducci.
OSG Site Admin Workshop - Mar 2008Using gLExec to improve security1 OSG Site Administrators Workshop Using gLExec to improve security of Grid jobs by Alain.
RedHat Package Management RPM and YUM in RedHat Enterprise, Fedora, Suse and Centos.
Open Science Grid Build a Grid Session Siddhartha E.S University of Florida.
Site Authorization Service Local Resource Authorization Service (VOX Project) Vijay Sekhri Tanya Levshina Fermilab.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) 马兰馨 IHEP, CAS Hands on gLite Security.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) UI Installation and Configuration Dong Xu IHEP,
GLite WN Installation Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
RI EGI-TF 2010, Tutorial Managing an EGEE/EGI Virtual Organisation (VO) with EDGES bridged Desktop Resources Tutorial Robert Lovas, MTA SZTAKI.
First South Africa Grid Training Installation and configuration of BDII Gianni M. Ricciardi Consorzio COMETA First South Africa Grid Training Catania,
The Great Migration: From Pacman to RPMs Alain Roy OSG Software Coordinator.
OSG Status and Rob Gardner University of Chicago US ATLAS Tier2 Meeting Harvard University, August 17-18, 2006.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) 马兰馨 IHEP, CAS Setting Up a Repository.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Overview of software tools for gLite installation & configuration.
Open Science Grid Configuring RSV OSG Resource & Service Validation Thomas Wang Grid Operations Center (OSG-GOC) Indiana University.
Why you should care about glexec OSG Site Administrator’s Meeting Written by Igor Sfiligoi Presented by Alain Roy Hint: It’s about security.
Overview of software tools for gLite installation & configuration
Installation and configuration of a top BDII
UI Installation and Configuration
Summary from last MB “The MB agreed that a detailed deployment plan and a realistic time scale are required for deploying glexec with setuid mode at WLCG.
Configuration Of A Pull Network.
UI Installation and Configuration
Presentation transcript:

A closer look at the VDT RPMs Alain Roy OSG Software Coordinator

OSG Site Admin Meeting, 10-Aug-2011 Hands-on? This is supposed to be a 30 minute hands-on tutorial I have no idea how to do a hands-on in 30 minutes. So I’m going to walk you through the process instead. I’ll do the CE  Because it illustrates the most  For today, you’re better off with the worker node or client 2

OSG Site Admin Meeting, 10-Aug-2011 That said… I really want you to try this! We need feedback! Are any of you willing to do a trial test with RPMS? Please? Pretty please? 3

OSG Site Admin Meeting, 10-Aug-2011 Online instructions You can read instructions online: 4 twiki.grid.iu.edu/bin/view/Documentation/RPMTempDocuments

OSG Site Admin Meeting, 10-Aug-2011 Prerequisites RHEL-5 like computer  We’ve only tested Scientific Linux 5 Recommend a non-production M or VM for now Willing to use EPEL Willing to not to use dag or rpmforge 5

OSG Site Admin Meeting, 10-Aug-2011 A quick note… I edited the screenshots so I could put them in a large font size, particularly some word wrap & abbreviations Please ask if there is any confusion. 6

OSG Site Admin Meeting, 10-Aug Install the EPEL yum repo info Download & install one RPM: 7 % wget i386/epel-release-5-4.noarch.rpm... Saving to: `epel-release-5-4.noarch.rpm.1’ 100%[============================>] 12, K/s in 0.1s % sudo rpm -i epel-release-5-4.noarch.rpm warning: epel-release-5-4.noarch.rpm: Header V3 DSA signature: NOKEY, key ID f6

OSG Site Admin Meeting, 10-Aug Install the VDT yum repo info Download & install one RPM: 8 % sudo rpm -Uvh x86_64/osg-release noarch.rpm Retrieving Preparing... ################################# [100%] 1:osg-release ################################# [100%]

OSG Site Admin Meeting, 10-Aug-2011 Check: do you have the repos? 9 % ls /etc/yum.repos.d/epel* /etc/yum.repos.d/osg* epel.repo osg.repo osg-development.repo osg-testing.repo

OSG Site Admin Meeting, 10-Aug-2011 Check: What’s the OSG repo like? 10 % cat /etc/yum.repos.d/osg-testing.repo [osg-testing] name=OSG Software for EL 5 - Testing - $basearch baseurl= failovermethod=priority priority=98 enabled=0 [osg-testing-source] name=OSG Software for EL 5 - Testing - $basearch - Source baseurl= failovermethod=priority priority=98 enabled=0

OSG Site Admin Meeting, 10-Aug Choose what to install 11 Your heart’s desirePackage Name Worker Nodeosg-wn-client Clientosg-client VOMSosg-voms RSVrsv Compute Element—Condorosg-ce-condor Compute Element—PBS/Torqueosg-ce-pbs Compute Element—LSFosg-ce-lsf Compute Element—SGEosg-ce-sge CE packages are individualized:  Installs appropriate Globus GRAM job manager  Installs appropriate Gratia probes Good first choices

OSG Site Admin Meeting, 10-Aug Let’s install the CE (Bleeding Edge!) 12 % sudo yum --enablerepo=osg-testing \ --nogpgcheck install osg-ce-condor Loaded plugins: kernel-module osg-testing | 1.9 kB 00: > Package osg-ce-condor.noarch 0: to be updated --> Processing Dep: osg-ce= for: osg-ce-condor --> Processing Dep: gratia-probe-condor for: osg-ce-condor... ======================================================= Package Arch Version Repository Size ======================================================= Installing for dependencies:... globus-authz x86_ el5 epel 13 k globus-gatekeeper x86_ osg osg-testing 38 k Note the use of both EPEL and OSG repository.

OSG Site Admin Meeting, 10-Aug Let’s configure it! 13 % rpm -qf /etc/osg/ce.ini osg-configure el5.noarch Note: configuration in /etc/osg: % ln -s /etc/osg/ce.ini /etc/osg/config.ini % vi /etc/config.ini % configure-osg -v -d Configuration verified successfully % configure-osg -c Configure-osg completed successfully

OSG Site Admin Meeting, 10-Aug Let’s keep on configuring it 14 % /usr/share/globus/setup/setup-globus-gatekeeper Creating gatekeeper configuration file... Done Creating grid services directory... Done % /usr/share/globus/setup/setup-globus-gram-job-manager Creating state file directory. Done. Checking if state dir. supports POSIX file locking... yes Reading gatekeeper configuration file... Determining system information... Creating job manager configuration file... Done % /usr/share/globus/globus-job-manager-service -add -s jobmanager-fork -m fork

OSG Site Admin Meeting, 10-Aug Great! Let’s run a job! 15 % /sbin/service globus-gatekeeper start Starting globus-gatekeeper: Gatekeeper running as daemon, ignoring -inetd! GRAM contact: fermicloud067.fnal.gov:2119:/DC=org/DC=doegrids/OU=Services/CN=fermiclo ud067.fnal.gov [ OK ] % grid-proxy-init Your identity:... /CN=Alain Roy Enter GRID pass phrase for this identity: Creating proxy Done Your proxy is valid until: Wed Aug 10 05:40: % globusrun -a -r fermicloud067 GRAM Authentication test successful

OSG Site Admin Meeting, 10-Aug-2011 Move to FHS No more $VDT_LOCATION No more $GLOBUS_LOCATION Everything is in FHS locations: 16 % which grid-proxy-init /usr/bin/grid-proxy-init % which globus-gatekeeper /usr/sbin/globus-gatekeeper

OSG Site Admin Meeting, 10-Aug-2011 More FHS locations 17 % head -2 /var/log/globus-gatekeeper.log TIME: Sun Aug 7 23:38: PID: Notice: 6: /usr/sbin/globus-gatekeeper pid=21219 starting at Sun Aug 7 23:38: % head -2 /etc/vomses "cdf" "voms.fnal.gov" "15020" "/DC=org/DC=doegrids/OU=Services/CN=http/voms.fnal.gov" "cdf" "cdf" "voms.cnaf.infn.it" "15001" "/C=IT/O=INFN/OU=Host/L=CNAF/CN=voms.cnaf.infn.it" "cdf“ % ls -1 /etc/grid-security/vomsdir/ atlas/ belle/ cdf/ We can validate VOMS certificates:

OSG Site Admin Meeting, 10-Aug-2011 What about jobs? Jobs expect there to be $OSG_GRID/setup.sh. Where’s that at? 18 % cat/etc/osg/wn-client/setup.sh #!/bin/sh # You no longer need to source /setup.sh # However, this file has been left for backward # compatibility purposes. Jobs don’t need to set the environment, but if you set $OSG_GRID to /etc/osg/wn-client, jobs will source it and not fail.

OSG Site Admin Meeting, 10-Aug-2011 Goodbye PRIMA We don’t ship PRIMA with the RPMs. If you want to use GUMS, you use lcmaps (software underlying glexec) Connection from Globus to lcmaps: Edit gums server in two files:  /etc/lcmaps.db  /etc/gums/gums-client.properties 19 % cat /etc/grid-security/gsi-authz.conf globus_mapping //usr/lib64/liblcas_lcmaps_gt4_mapping.so lcmaps_callout

OSG Site Admin Meeting, 10-Aug-2011 Globus 5 We are using Globus from EPEL EPEL provides Globus This means:  We need to do plenty of compatibility testing  Web-services GRAM is gone There is some uncertainty about Globus 5.0.x vs. 5.2.x  This is being resolved now… More news soon 20

OSG Site Admin Meeting, 10-Aug-2011 Questions? Comments? 21