FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Luciano Díaz ICN-UNAM Based on Domenico Vicinanza presentation CERN Fourth EELA Tutorial for Managers and Users Mexico City, 28 August - 01 September 2006 GENIUS Grid portal Hands on
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Outline Useful information Exercises 1.GENIUS logging in and base settings 2.Launch a job described by a JDL which already exists in the UI 3.Prepare a job described by a JDL and store it on the UI 4.Submit the job described by the JDL created in the previous exercise 5.Preparing a job described by the JDL with a file to ship in the input sandbox 6.Submitting the job prepared in the previous exercise
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 3 Useful information GENIUS Tutorial website: Tutorial accounts on glite-tutor: Username: mexicocityXX where XX goes from 01 to 60 Password: GridMEXxx where xx goes from 01 to 60 When issuing the myproxy-init command: Myproxy password: MEXICOCITY for all the accounts
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 4 Introduction: the two-layers Authentication 1. Authentication with the User Interface 2. Authentication to the Grid. Input password of the proxy (specified when you shall execute myproxy-init) Input password of the user account: mexicocityXX
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 5 Exercise 1 GENIUS logging in and base settings
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 6 Outline of the exercise 1/2 Login at your UI account (passwd: GridMEXxx) Store a proxy on a remote Myproxy Server machine with the command (using the passphrase MEXICOCITY): >myproxy-init --voms gilda Retrieve a local proxy from MyProxy server: > myproxy-get-delegation (must use your new MyProxy passphrase)
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 7 Outline of the exercise 2/2 Verify your new local proxy: >voms-proxy-info --all Destroy your local proxy with the command and then inspect it >voms-proxy-destroy Go on the with your browser, put your Myproxy passphrase. Come back on the terminal and execute >voms-proxy-info --all
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 8 >myproxy-init --voms gilda mexicocity20]$ myproxy-init --voms gilda Cannot find file or dir: /home/mexicocity20/.glite/vomses Your identity: /C=IT/O=GILDA/OU=Personal Enter GRID pass phrase: verify OK Creating temporary proxy Done Contacting voms.ct.infn.it:15001 [/C=IT/O=GILDA/OU=Host/L=INFN "gilda" Done Creating proxy Done Your proxy is valid until Sun Sep 3 06:35: Enter MyProxy pass phrase: Verifying password - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user mexicocity20 now exists on grid001.ct.infn.it. mexicocity20]$ Password: MEXICOCITY Choose a new password; This password will be referred later as myproxy password
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 9 Get credentials from the MyProxy server >myproxy-get-delegation >voms-proxy-info -all mexicocity20]$ myproxy-get-delegation Enter MyProxy pass phrase: A proxy has been received for user mexicocity20 in /tmp/x509up_u519 mexicocity20]$ voms-proxy-info -all subject : /C=IT/O=GILDA/OU=Personal issuer : /C=IT/O=GILDA/OU=Personal identity : /C=IT/O=GILDA/OU=Personal type : unknown strength : 512 bits path : /tmp/x509up_u519 timeleft : 11:51:33 === VO gilda extension information === VO : gilda subject : /C=IT/O=GILDA/OU=Personal issuer : /C=IT/O=GILDA/OU=Host/L=INFN attribute : /gilda/Role=NULL/Capability=NULL timeleft : 11:34:59 mexicocity20]$
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 10 Destroying local voms proxy >voms-proxy-destroy >voms-proxy-info -all mexicocity20]$ voms-proxy-destroy mexicocity20]$ voms-proxy-info -all Couldn't find a valid proxy. mexicocity20]$
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 11 The Genius Home Page
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 12 …then authenticating on GENIUS using myproxy passwd… GRID authentication The password is the one set when issued the myproxy-init command Myproxy password set before
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 13 Exercise 2 Launch a job described by a JDL which already exists in the UI We suppose to have the JDL file and all the other required data (input sandbox files) on the UI and we shall try to submit the job on the GRID
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 14 Authentication with MyProxy
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 15 GRID Settings
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 16 Set VO/VOMS
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 17 Selecting jdl file
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 18 Specify the CE Resource
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 19 Job successfully submitted
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 20 Job completed successfully
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 21 Retrieving Job results 1/3
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 22 Retrieving Job results 2/3
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 23 Retrieving job results 3/3
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 24 Exercise 3 Prepare a job described by a JDL and store it on the UI In this exercise we are going to create a new file on the UI called helloworld.jdl describing a simple job
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 25 First step: create the JDL file [ JobType = "Normal"; Executable = "/bin/echo"; Arguments = "Hello World !"; StdOutput = "std.out"; StdError = "std.err"; OutputSandbox = {"std.out","std.err"}; ]
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 26 The JDL is ready to be executed
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 27 Inspecting our JDL
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 28 Exercise 4 Submit the job described by the JDL created in the previous exercise In this exercise we are going to submit the job described by the JDL file edited in the previous step
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 29 Select JDL file 1/3
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 30 Submitting the JDL 2/3
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 31 Retrieving job results 3/3
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 32 Exercise 5 Preparing a job described by the JDL with a file to ship in the input sandbox In this exercise we are going prepare the JDL description for a job which executes a shell script. The.sh file will be shipped to the CE through the input sandbox
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 33 Step 1: Create the shell script #!/bin/sh MY_NAME="Your name" WORKER_NODE_NAME=glite-tutor.ct.infn.it echo "Hello $MY_NAME, from $WORKER_NODE_NAME" ls -a echo "This job is running on this CE: " /opt/edg/bin/edg-brokerinfo getCE
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 34 Step2: create the JDL file [ Executable = "startScript.sh"; StdOutput = "std.out"; StdError = "std.err"; VirtualOrganisation = "gilda"; InputSandbox = {"startScript.sh"}; OutputSandbox = {"std.out","std.err",".BrokerInfo"}; RetryCount = 7; ]
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 35 Exercise 6 Submitting the job prepared in the previous exercise In this exercise we are going submit the job which executes a shell script, prepared in the previous exercise. The.sh file will be shipped to the CE through the input sandbox
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 36 Submitting job
Fourth EELA Tutorial, Mexico City, 28 August - 01 September 2006 FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America 37 Retrieving the results