Download presentation
Presentation is loading. Please wait.
Published byMatilda Nash Modified over 9 years ago
1
EDAGRID TUTORIAL Dr. Tuan-Anh Nguyen Ho Chi Minh City University of Technology Prof. Pierre Kuonen University of Applied Sciences of Fribourg, Switzerland
2
Overview First part: EDAGrid middleware How to use EDAGrid middleware to submit jobs How to describe a job flow Part two: EDAGrid programming Writing a simple Grid program with POP- C++ Executing the program on EDAGrid
3
Supercomputer PC Supercomputer My laptop Workstation SMP Cluster The Grid environment ?
4
EDAGrid infrastructure: Objectives Middleware for computing Grid Execute parallel applications transparently with a QoS of resources Use case User EDAGrid middleware “Execute my app on 4 processors with at least 500MFlops and 1GB/s network”
5
Login User name: acomp2007 Password: guess Create a subdirectory mkdir cd Server information: Grid FTP server gsiftp://serverkstn.cse.hcmut.edu.vn:2811 Your home: /home/acomp2007
6
Describe jobs XML based job descriptions Resource characteristics Application characteristics Staging description... A single job description Number of CPUs How many CPU each node Linpack benchmark Network bandwidth... Where are executables Agruments Compatible platforms How to stage in/out data...
7
Describe a simple job 1 /bin/sleep 10 Edit job.xml: Submit the job eda_job_submit -w job.xml
8
Resource requirement Add resource requirement to the job description 100MFlops but at least 60MFlops is also acceptable Physical memory of at lease 256MB 1 100 256 /bin/sleep 10 NetworkBandwidth (MBit/s) IndividualCPUFree5 (0...1) IndividualCPUFree10 (0...1) IndividualCPUFree15 (0...1) IndividualCPUCount
9
Stage data in/out gsiftp://serverkstn.cse.hcmut.edu.vn:2811 Sort data....... 1 gsiftp://serverkstn.cse.hcmut.edu.vn:2811/PATH_TO_YOUR_FILE file:///${GLOBUS_USER_HOME}/data file:///$ /bin/sort ${GLOBUS_USER_HOME}/data --output=${GLOBUS_USER_HOME}/result file:///${GLOBUS_USER_HOME}/result file:///$ gsiftp://serverkstn.cse.hcmut.edu.vn:2811/PATH_TO_YOUR_OUTPUT...
10
Describe a multijob workflow... Job 1 Job 2 Job 3
11
Parallel sort.... split data sort 2 sort 1 mer ge result... Note: - To sort (all platforms): /bin/sort -output= - To merge (all platforms): /bin/sort -merge -output= - To split (only available on YOUR machine): /home/edagrid/demo/splittext
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.