1. FP6−2004−Infrastructures−6-SSA-026409 www.eu-eela.org E-infrastructure shared between Europe and Latin America Moisés Hernández Duarte UNAM FES Cuautitlán Tutorial on grid, visualization and high performance calculation Mexico City, October 23 – 26, 2007 Based on Luciano Díaz presentation, ICN-UNAM GENIUS Grid portal Hands on

2. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America Outline Useful information Exercises 1.GENIUS logging in and base settings 2.Launch a job described by a JDL which already exists in the UI 3.Prepare a job described by a JDL and store it on the UI 4.Submit the job described by the JDL created in the previous exercise 5.Preparing a job described by the JDL with a file to ship in the input sandbox 6.Submitting the job prepared in the previous exercise

3. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 3 Useful information GENIUS Tutorial website: https://glite-tutor2.ct.infn.it Tutorial accounts on glite-tutor: Username: mexicocityXX where XX goes from 01 to 40 Password: GridMEXxx where xx goes from 01 to 40 When issuing the myproxy-init command: Myproxy password: MEXICOCITY for all the accounts

4. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 4 Introduction: the two-layers Authentication 1. Authentication with the User Interface 2. Authentication to the Grid. Input password of the proxy (specified when you shall execute myproxy-init) Input password of the user account: mexicocityXX

5. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 5 Exercise 1 GENIUS logging in and base settings

6. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 6 Outline of the exercise 1/2 Login at your UI account (passwd: GridMEXxx) Store a proxy on a remote Myproxy Server machine with the command (using the passphrase MEXICOCITY): >myproxy-init --voms gilda Retrieve a local proxy from MyProxy server: > myproxy-get-delegation (must use your new MyProxy passphrase)

7. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 7 Outline of the exercise 2/2 Verify your new local proxy: >voms-proxy-info --all Destroy your local proxy with the command and then inspect it >voms-proxy-destroy Go on the https://glite-tutor2.ct.infn.it with your browser, put your Myproxy passphrase. Come back on the terminal and execute >voms-proxy-info --all

8. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 8 >myproxy-init --voms gilda [mexicocity20@eela-132 mexicocity20]$ myproxy-init --voms gilda Cannot find file or dir: /home/mexicocity20/.glite/vomses Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/Email=roberto.barbera@ct.infn.it Enter GRID pass phrase: verify OK Creating temporary proxy................................................... Done Contacting voms.ct.infn.it:15001 [/C=IT/O=GILDA/OU=Host/L=INFN Catania/CN=voms.ct.infn.it/Email=emidio.giorgio@ct.infn.it] "gilda" Done Creating proxy........................................ Done Your proxy is valid until Sun Sep 3 06:35:26 2006 Enter MyProxy pass phrase: Verifying password - Enter MyProxy pass phrase: A proxy valid for 168 hours (7.0 days) for user mexicocity20 now exists on grid001.ct.infn.it. [mexicocity20@eela-132 mexicocity20]$ Password: MEXICOCITY Choose a new password; This password will be referred later as myproxy password

9. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 9 Get credentials from the MyProxy server >myproxy-get-delegation >voms-proxy-info -all [mexicocity20@eela-132 mexicocity20]$ myproxy-get-delegation Enter MyProxy pass phrase: A proxy has been received for user mexicocity20 in /tmp/x509up_u519 [mexicocity20@eela-132 mexicocity20]$ voms-proxy-info -all subject : /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/Email=roberto.barbera@ct.infn.it/CN=proxy/CN=proxy/CN=proxy issuer : /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/Email=roberto.barbera@ct.infn.it/CN=proxy/CN=proxy identity : /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/Email=roberto.barbera@ct.infn.it/CN=proxy/CN=proxy type : unknown strength : 512 bits path : /tmp/x509up_u519 timeleft : 11:51:33 === VO gilda extension information === VO : gilda subject : /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/Email=roberto.barbera@ct.infn.it issuer : /C=IT/O=GILDA/OU=Host/L=INFN Catania/CN=voms.ct.infn.it/Email=emidio.giorgio@ct.infn.it attribute : /gilda/Role=NULL/Capability=NULL timeleft : 11:34:59 [mexicocity20@eela-132 mexicocity20]$

10. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 10 Destroying local voms proxy >voms-proxy-destroy >voms-proxy-info -all [mexicocity20@eela-132 mexicocity20]$ voms-proxy-destroy [mexicocity20@eela-132 mexicocity20]$ voms-proxy-info -all Couldn't find a valid proxy. [mexicocity20@eela-132 mexicocity20]$

11. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 11 The Genius Home Page

12. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 12 …then authenticating on GENIUS using myproxy passwd… GRID authentication The password is the one set when issued the myproxy-init command Myproxy password set before

13. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 13 Exercise 2 Launch a job described by a JDL which already exists in the UI We suppose to have the JDL file and all the other required data (input sandbox files) on the UI and we shall try to submit the job on the GRID

14. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 14 Authentication with MyProxy

15. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 15 GRID Settings

16. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 16 Set VO/VOMS

17. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 17 Selecting jdl file

18. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 18 Specify the CE Resource

19. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 19 Job successfully submitted

20. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 20 Job completed successfully

21. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 21 Retrieving Job results 1/3

22. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 22 Retrieving Job results 2/3

23. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 23 Retrieving job results 3/3

24. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 24 Exercise 3 Prepare a job described by a JDL and store it on the UI In this exercise we are going to create a new file on the UI called helloworld.jdl describing a simple job

25. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 25 First step: create the JDL file [ JobType = "Normal"; Executable = "/bin/echo"; Arguments = "Hello World !"; StdOutput = "std.out"; StdError = "std.err"; OutputSandbox = {"std.out","std.err"}; ]

26. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 26 The JDL is ready to be executed

27. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 27 Inspecting our JDL

28. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 28 Exercise 4 Submit the job described by the JDL created in the previous exercise In this exercise we are going to submit the job described by the JDL file edited in the previous step

29. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 29 Select JDL file 1/3

30. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 30 Submitting the JDL 2/3

31. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 31 Retrieving job results 3/3

32. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 32 Exercise 5 Preparing a job described by the JDL with a file to ship in the input sandbox In this exercise we are going prepare the JDL description for a job which executes a shell script. The.sh file will be shipped to the CE through the input sandbox

33. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 33 Step 1: Create the shell script #!/bin/sh MY_NAME="Your name" WORKER_NODE_NAME=glite-tutor.ct.infn.it echo "Hello $MY_NAME, from $WORKER_NODE_NAME" ls -a echo "This job is running on this CE: " /opt/edg/bin/edg-brokerinfo getCE

34. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 34 Step2: create the JDL file [ Executable = "startScript.sh"; StdOutput = "std.out"; StdError = "std.err"; VirtualOrganisation = "gilda"; InputSandbox = {"startScript.sh"}; OutputSandbox = {"std.out","std.err",".BrokerInfo"}; RetryCount = 7; ]

35. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 35 Exercise 6 Submitting the job prepared in the previous exercise In this exercise we are going submit the job which executes a shell script, prepared in the previous exercise. The.sh file will be shipped to the CE through the input sandbox

36. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 36 Submitting job

37. Users Tutorial, Mexico City, 23 - 24 October 2007 FP6−2004−Infrastructures−6-SSA-026409 E-infrastructure shared between Europe and Latin America 37 Retrieving the results