1. 1 www.portal.p-grade.hu P-GRADE Portal hands-on Gergely Sipos sipos@sztaki.hu MTA SZTAKI Hungarian Academy of Sciences

2. 2 Open the tutorial sheets from event webpage http://indico.cern.ch/conferenceDisplay.py?confId=34654

3. 3 P-GRADE Portal (SZTAKI, Budapest) based on v2. 7 Infrastructure Client machines Proxy download GILDA Grid services GILDA MyProxy server gLite Proxy MyProxy name: istanbul MyProxy password: istanbul portal.p-grade.hu/multi-grid

4. 4 Exercise 1 Import and execute a pre-defined application Traffic simulation Generates the road network map of Manchester Put traffic lights and cars on the map. Simulate road traffic. Visualizes the density of cars Download workflow archive Includes binaries Includes input data Import workflow to P-GRADE Open workflow in editor Map jobs to GILDA broker Submit workflow Monitor execution Download result

5. 5 Exercise 1 Import and execute a pre-defined application Traffic simulation Generates the road network map of Manchester Put traffic lights and cars on the map. Simulate road traffic. Visualizes the density of cars Download workflow archive Includes binaries Includes input data Import workflow to P-GRADE Open workflow in editor Map jobs to GILDA broker Submit workflow Monitor execution Download result x.jpg

6. 6 Exercise 2 Solve matrix multiplication on GILDA (one job workflow) Job executable: C code, compiled on GILDA UI Expects command line parameters: M V Knows nothing about the grid Job input/output files: Program reads matrixes from two files called INPUT1 and INPUT2 Program writes result matrix into file called OUTPUT Local execution on a PC:./multiply M V Task: Execute the program on EGEE, transfer input and output files in Sandboxes from the client 3 3 2 1 3 1 1 1 3 3 3 Binary executable INPUT1 3 3 5 2 7 6 7 9 3 8 2 INPUT2 3 3 25 35 29 14 17 18 42 51 54 OUTPUT

7. 7 gLite Storage Element Exercise 3 Save the multiplication OUTPUT on a Storage Element and register in the File Catalog Modify output file type from “Local” to “Remote” Specify a logical file name as target location: lfn:/grid/gilda/tutorials/istanbulXX 3 3 2 1 3 1 1 1 3 3 3 Binary executable INPUT1 3 3 5 2 7 6 7 9 3 8 2 INPUT2 3 3 25 35 29 14 17 18 42 51 54 OUTPUT Storage Element is selected automatically by gLite middleware lfn:/grid/gilda/tutorials/istanbulXX/… Logical file name is defined by you gLite File Catalog Browse result file using the File Manager Portlet

8. 8 Exercise 4 Combine jobs to build a MatrixOperations workflow AB[*, 0] T * AB[*, 1] Matrix AMatrix B A * B A * B [ *, 0 ]A * B [ *, 1 ] B ( A * B [ *, 0 ] T ) * ( A * B [ *, 1 ] ) A * B [ *, 0 ] T 2 1 3 1 1 1 3 3 3 5 2 7 6 7 9 3 8 2 25 35 29 14 17 18 42 51 54 25 14 42 35 17 51 25 14 42 3255

9. 9 Portal accounts: ***** Portal passwords: ***** Login to Portal: Available on event webpage Tutorial sheet: No need to wait for jobs to finish – proceed to next exercise

10. 10 Explanation of user authentication MyProxy server P-GRADE Portal server GILDA services Proxy VOMS server Proxy VOMS ext. Proxy VOMS ext. Myproxy account Portal account Proxy based authentication Login & psw based authentication Tutors generated and uploaded your proxy

11. 11 Trick: Job level fault tolerance Exclude erroneous sites from the grid by controling the brokering process: 1.Open the JDL editor of the job in the Workflow Editor 2.Write other.GlueCEInfoHostname != “hostname” into the “Ranks & requirements” window Automatic job resubmission: 1.Add ShallowRetryCount = 3 into JDL

12. 12 PS Tutorial Matrix multiplication PS parameter study workflow with 5 parameters Multiplication job 1 2 3 4 5 6 7 8 12 2 1 3 1 1 1 3 3 3 Matrix2 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 15...

13. 13 Multiplication job Auto generator Input files stored on SEs and registered in LFC catalog 1 2 3 4 5 6 7 8 9 1 2 3 4 5 6 7 8 12 1 2 3 4 5 6 7 8 15 1 2 3 4 5 6 7 8 Y 9 <= Y <=21, step 3 2 1 3 1 1 1 3 3 3 Matrix2 Output files stored on SEs and registered in LFC catalog... PS Tutorial Matrix multiplication PS parameter study workflow with 5 parameters