August 13, 2003Eric Hjort Getting Started with Grid Computing in STAR Eric Hjort, LBNL STAR Collaboration Meeting August 13, 2003.

Slides:



Advertisements
Similar presentations
Globus Workshop at CoreGrid Summer School 2006 Dipl.-Inf. Hamza Mehammed Leibniz Computing Centre.
Advertisements

Digital Certificate Installation & User Guide For Class-2 Certificates.
Installation & User Guide
Digital Certificate Installation & User Guide For Class-2 Certificates.
Digital Certificate Installation & User Guide For Class-2 Certificates.
Grid Resource Allocation Management (GRAM) GRAM provides the user to access the grid in order to run, terminate and monitor jobs remotely. The job request.
CERN LCG Overview & Scaling challenges David Smith For LCG Deployment Group CERN HEPiX 2003, Vancouver.
Human Subjects Training Requirements All researchers, advisors, and research assistants must complete training. You must have an overall passing rate of.
1c.1 Assignment 2 Preliminaries Review Full details in assignment write-up. ITCS 4146/5146 Grid Computing, 2007, UNC-Charlotte, B. Wilkinson. Jan 24, 2007.
Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.
AssignPrelim1.1 ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson. Course Preliminaries.
1c.1 Assignment 2 Preliminaries Review (Full details in assignment write-up.)‏ © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
Security Mechanisms The European DataGrid Project Team
Grid Services at NERSC Shreyas Cholia Open Software and Programming Group, NERSC NERSC User Group Meeting September 17, 2007.
1c.1 Assignment 2 Preliminaries Review (Full details in assignment write-up.)‏ © 2011 B. Wilkinson/Clayton Ferner. Fall 2011 Grid computing course. Modification.
Downloading and Installing AutoCAD Architecture 2015 This is a 4 step process 1.Register with the Autodesk Student Community 2.Downloading the software.
Installing geant4 v9.5 using Windows Daniel Brandt, 06 April 2012 Installing Geant4 v9.5 for Windows A step-by-step guide for Windows XP/Vista/7 using.
JOIN A COMMUNITY OF 80,000 E-COMMERCE SITES WORLDWIDE.
Updating User Information Password – use this field to change your own password Confirm Password – retype the new password for verification purposes To.
ORNL is managed by UT-Battelle for the US Department of Energy Globus: Proxy Lifetime Endpoint Lifetime Oak Ridge Leadership Computing Facility.
Digital Certificate Installation & User Guide For Class - 2 Certificates.
Initial Moodle site sign in instructions..  To restate the definition of Moodle from their web site "Moodle is an Open Source Course Management System.
Let’s Make An Form! Bonney Armstrong GD 444 Westwood College February 9, 2005.
System for Administration, Training, and Educational Resources for NASA SATERN Overview for Learners May 2006.
AQS Web Quick Reference Guide Changing Raw Data Values Using Maintenance 1. From Main Menu, click Maintenance, Sample Values, Raw Data 2. Enter monitor.
High Performance Louisiana State University - LONI HPC Enablement Workshop – LaTech University,
IFORM ACCOUNT MAINTENANCE ICT4D SESSION 4. IFORMBUILDER WEBSITE REQUIREMENTS To access the iFormBuilder website, you need the following items: -Reliable.
Grid NERSC demo Shreyas Cholia Open Software and Programming NERSC User Group Meeting September 19, 2007.
Guidelines for ENSCONET partners in the use of the e-forum.
Andrey Meeting 7 October 2003 General scheme: jobs are planned to go where data are and to less loaded clusters SUNY.
Exporting User Certificate from Internet Explorer.
GRID. Register Fill the form. Your IP (Juanjo) signature is needed and the one from the.
© 2007 UC Regents1 Track 1: Cluster and Grid Computing NBCR Summer Institute Session 1.1: Introduction to Cluster and Grid Computing July 31, 2007 Wilfred.
INFSO-RI Enabling Grids for E-sciencE How to join GILDA Riccardo Bruno INFN gLite Tutorial at the First EGEE User Forum CERN,
E-infrastructure shared between Europe and Latin America Security Hands-on Christian Grunfeld, UNLP 8th EELA Tutorial, La Plata, 11/12-12/12,2006.
Association with the Gilda Virtual Organization Certificate,VO membership, and MyProxy Server usage.
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA Hands-on on security Pedro Rausch IF - UFRJ.
Condor-G A Quick Introduction Alan De Smet Condor Project University of Wisconsin - Madison.
Security Mechanisms The European DataGrid Project Team
Mtivity Client Support System Quick start guide. Mtivity Client Support System We are very pleased to announce the launch of a new Client Support System.
12th September 2007UK e-Science All Hands Meeting1 John Kewley Grid Technology Group e-Science Centre STFC Daresbury Laboratory GROWL.
February 28, 2003Eric Hjort PDSF Status and Overview Eric Hjort, LBNL STAR Collaboration Meeting February 28, 2003.
Creating and running an application.
January 26, 2003Eric Hjort HRMs in STAR Eric Hjort, LBNL (STAR/PPDG Collaborations)
4th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America Security Hands-on Vanessa.
VisPortal Project developer’s experience C.E.Siegerist, J. Shalf, E.W. Bethel NERSC/LBNL Visualization Group T.J. Jankun-Kelley, O. Kreylos, K.L. Ma CIPIC/UC.
Page 1 of 42 To the ETS – Create Client Account & Maintenance Online Training Course Individual accounts (called a Client Account) are subsets of the Site.
John Kewley e-Science Centre All Hands Meeting st September, Nottingham GROWL: A Lightweight Grid Services Toolkit and Applications John Kewley.
How To Get Started in Analysis with Atlas software FAQ on How to Get account at BNL
National Energy Research Scientific Computing Center (NERSC) Visportal : interface to grid enabled NERC resources Cristina Siegerist NERSC Center Division,
Further aspects of EGEE middleware components INFN, Catania EGEE is funded by the European Union under contract IST
Client installation DIRAC Project. DIRAC Client Software  Many operations can be performed through the Web interface  Even more to come  However, certain.
Initiating Teragrid Sessions Raghu Reddy. Outline Motivation Initial Setup –Certificates –Proxies –Grid-map file entries and DNs Softenv for customizing.
A GANGA tutorial Professor Roger W.L. Jones Lancaster University.
LCG2 Tutorial Viet Tran Institute of Informatics Slovakia.
Hands on Security, Authentication and Authorization Virginia Martín-Rubio Pascual RedIRIS/Red.es Curso Grid y e-Ciencia.
EGI-InSPIRE RI Grid Training for Power Users EGI-InSPIRE N G I A E G I S Grid Training for Power Users Institute of Physics Belgrade.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) 马兰馨 IHEP, CAS Hands on gLite Security.
1 Grid Security Jinny Chien Academia Sinica Computing Centre Deployment team.
Enabling Grids for E-sciencE gLite security pratical tutorial Dario Russo INFN Catania Catania,
Trusted Organizations In the grid world one single CA usually covers a predefined geographic region or administrative domain: – Organization – Country.
How to use Drupal Awdhesh Kumar (Team Leader) Presentation Topic.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Continue by your own… Riccardo Bruno
Welcome! To the ETS – Create Client Account & Maintenance
Submit BOSS Jobs on Distributed Computing System
Part 2 Setting up a web server the easy way
Part 2 Setting up a web server the easy way
Grid Computing Software Interface
Presentation transcript:

August 13, 2003Eric Hjort Getting Started with Grid Computing in STAR Eric Hjort, LBNL STAR Collaboration Meeting August 13, 2003

Eric Hjort Purpose of the Talk Encourage STAR users to get started on Grid Computing: –It’s not hard to do some simple, useful things –Soon the STAR job scheduler will be grid-enabled –Important to start building grid expertise among STAR users Provide a step-by-step tutorial: –Obtain a DOE Grid certificate –Get your certificate installed and working –Examples of a few simple grid commands

August 13, 2003Eric Hjort A Couple Definitions… What is Globus? The Globus Project produces the Globus Toolkit, which has become the standard for software often called grid middleware. What is PPDG? PPDG is the Particle Physics Data Grid, a collaboration between 4 computer science projects and 6 physics experiments, including STAR.

August 13, 2003Eric Hjort Getting a DOE Grid Certificate Start at Follow the links “How to Request Certificates”, then “How to Request Personal Certificates”. Follow instructions, and provide the following information: Affiliation = PPDG Sponsor = your supervisor Additional Comments = STAR experiment Click “Submit” to get your certificate issued.

August 13, 2003Eric Hjort Importing your Certificate into your Browser Once your certificate has been issued you will receive an containing instructions and a link. Follow the link and click on the “Import Your Certificate” button. This will import your certificate into your browser. You can see your certificate: IE: Tools->Internet options->Content Netscape: Edit->Preferences->Privacy&Security- >Certificates

August 13, 2003Eric Hjort Exporting your certificate Continuing with the instructions on the doegrids.org page, the next step is to export your certificate from your browser to your computer (look for an “export” button where you saw your certificate). This will result in the creation of a file on your computer, possibly with an extension of.p12, but depending on your browser possibly something else like.pkcs12.

August 13, 2003Eric Hjort Generating your key pair It is necessary to install your certificate at any facility where you want to do grid commands, e.g., grid- proxy-init. To do this: Copy your.p12 file from your computer to your account at PDSF or RCF. Create a.globus subdirectory of your home directory Generate your key pair: openssl pkcs12 –in YourCert.p12 –clcerts –nokeys –out $HOME/.globus/usercert.pem openssl pkcs12 –in YourCert.p12 –nocerts -out $HOME/.globus/userkey.pem Reset the permissions on the userkey.pem file you just created: “chmod 600 userkey.pem”. Your certificate is now installed!

August 13, 2003Eric Hjort Updating grid-mapfiles The final step before you can use grid tools is to get the grid-mapfile updated at each of STAR’s grid- enabled sites (RCF and PDSF at present). The grid-mapfile maps your certificate to your local account at that site. The grid-mapfile is updated by local site administrators and the procedure is site-dependent. At RCF you can make a request through the BNL bugzilla system –Click on Enter a new bug report –Click on Grid Related and you will go to the BNL Grid Bug report system. –Select “user registration” from the product list –Enter your account information and the subject and issuer lines from your usercert.pem file

August 13, 2003Eric Hjort Updating grid-mapfiles (cont’d) At PDSF grid-mapfile updates are handled through NIM (NERSC Information Management) –Go to NIM: –Login. –Under “My Stuff” select “My Contact Info” –Copy the subject and issuer info from your usercert.pem file into the corresponding fields (down at the bottom) The PDSF grid-mapfiles should be updated with your information within 24 hours

August 13, 2003Eric Hjort Are we there yet??? If you can do a grid-proxy-init, then YES! Test it at a facility where you have the.pem files in your.globus directory. At RCF: –Login to stargrid02.rcf.bnl.gov –“grid-proxy-init” At PDSF: –Login to pdsfint.nersc.gov as usual –“module load globus” –“grid-proxy-init” If grid-proxy-init accepts your GRID pass phrase your proxy will be created: Your identity: /O=doesciencegrid.org/OU=People/CN=Eric Hjort 8713 Enter GRID pass phrase for this identity: Creating proxy Done Your proxy is valid until Tue Aug 12 05:16:

August 13, 2003Eric Hjort Quick summary in 6 steps Request a certificate from doegrids.org When notified, import certificate to your browser Export your certificate from your browser to your computer Copy your certificate from your computer to each grid- enabled facility that you plan to work at generate a key pair at each facility Get the grid-mapfiles updated at all grid-enabled STAR computing facilities Test with grid-proxy-init Note: This process can be confusing, especially the first time you try it. There are numerous options (usually the defaults are OK) and various passwords involved so it’s a good idea to take notes as you try it.

August 13, 2003Eric Hjort Simple grid commands grid-proxy-init: –Initializes your grid proxy. Default lifetime 12 hours. –Use option “-hours N” to increase to N hours. grid-proxy-info: –Shows info on your proxy, including time until expiration. PDSF user copies a file RCF->PDSF: –globus-url-copy -vb gsiftp://stargrid02.rcf.bnl.gov/star/u/hjort/test.txt file:/auto/u/hjort/test.txt –-vb is verbose mode –gsiftp: refers to a file in a remote location and stands for Globus Security Infrastructure File Transfer Protocol. In this example it is used in the source URL. –file: refers to a local file, in this case the destination URL

August 13, 2003Eric Hjort globus-job-run globus-job-run: do a command on a remote site. –Example: globus-job-run stargrid02.rcf.bnl.gov /bin/ls /star/u/griduser –This command, issued from PDSF, would list the contents of the directory /star/u/griduser at RCF –Note that the path is needed for the executable (ls). -s option: execute my script (located at PDSF) at RCF: –Example: globus-job-run stargrid02.rcf.bnl.gov –s gridjob.pl –Convenient because I can edit my script locally but execute it remotely –Can also use –stdin and –stdout options to specify stdin and stdout

August 13, 2003Eric Hjort globus-job-submit and globusrun globus-job-submit –Similar to globus-job-run but with a batch interface –Doesn’t yet support the staging (-s) option. globusrun –Allows user to use Globus Resource Specification Language (RSL) to specify more complex jobs. –globus-job-run and globus-job-submit are wrappers around globusrun

August 13, 2003Eric Hjort Resources The Globus website: The Globus 2.4 user’s Guide: fp.globus.org/gt2.4/admin/guide-user.html (STAR does not use Globus 3 yet) fp.globus.org/gt2.4/admin/guide-user.html Iwona Sakrejda’s “Introducing Grid Services at NERSC” is at akrejda akrejda Iwona provides a much more detailed description of things discussed briefly in this tutorial.

August 13, 2003Eric Hjort Summary This tutorial is meant to supply just enough information to get you started on grid computing in STAR Getting your certificate can be confusing, and the details of how to do it can depend on things such as what browser you use, etc. Once you are set up, however, there is little or no maintenance – just remember your pass phrase Anybody that does STAR computing, especially people who use both RCF and PDSF, is encouraged to spend an hour or two trying to get started on the grid.