1. Sun Grid Engine Grid Computing Assignment – Fall 2005 James Ruff Senior Department of Mathematics and Computer Science Western Carolina University

2. We will: Discover what Sun Grid Engine is and what it accomplishes. Find out the advantages and disadvantages of Sun Grid Engine. Submit an example job submission using the command line. Submit and monitor a job using the Graphical User Interface. Discover a real application of Sun Grid Engine. (Using Scheme)

3. What is Sun Grid Engine? Sun Grid Engine, basically speaking, is software designed for cluster computing. Sun Grid Engine has two main versions: a professional version that may be purchased and a free open source implementation.

4. What Does Sun Grid Engine Allow Me to do? Run jobs on a cluster (1+ nodes) that may include parallel jobs. Submit job(s) to a cluster, which will then select which machine the job(s) will run on. Basically, SGE allows a user to run jobs on remote machines.

5. Pros/Cons of Sun Grid Engine Relatively easy installation. Wide usage, thus large knowledge base. Allows for GUI interface. Requires NFS. Large network strain. (Worst Case) Requires each user’s account to be mounted across the cluster. Pros Cons

6. An Example Setup of Sun Grid Engine Master Host Execution Host / Administration Host Submission Host Shadow Master Host Execution Host / Administration Host / Submission Host

7. Demonstration: Finding Hosts Sun Grid Engine allows any user to see how many hosts are available to run jobs. This is done using the ‘ qhost ’ command. % qhost This should result with several different hosts, along with how many processors each node has, the amount of ram, the amount of swap space and the usage of those resources.

8. Execution Host Selection The particular node your job runs on depends on the scheduling policies for your cluster. In general, no single node job should execute on the same node twice in a row. (Given there are at least two execution nodes.)

9. Demonstration: qrsh (Sun Grid Engine Remote Shell Execution) The binary ‘ /bin/hostname ’ displays the hostname of the current machine. Example: % qrsh /bin/hostname –Try running this command several times. Notice that the execution changes to different nodes.

10. Batch Jobs in Sun Grid Engine Batch jobs are submitted in the form of a shell script. (ex: bash) The script should be viewable by the entire cluster. (Unless other arrangements have been made to transfer between nodes.)

11. Demonstration: A Sleepy Job Execution Script: #$ -S /bin/sh # print date and time date sleep 60 # print date and time again date sleep 60 # See which host we are running on hostname

12. Demonstration: A Sleepy Job (Con’t) Checking the status of our job: % qstat The ‘ qstat ’ command will return the queue that the job is executing on. (The execution host name.) The status will also be listed in the output.

13. Other Useful Commands for Sun Grid Engine Job Submission qdel – Deletes a specified job. qhold – Holds a specified job. qrls - Releases a specified job from previous hold state. qresub – Submit a copy of a currently executing job.

14. Demonstration: A Sleepy Job – Gathering Output The filenames for the output (using a default submission) are the following: –(scriptfilename).sh.o(jobID) – The standard output that was produced by your job. –(scriptfilename).sh.e(jobID) – The standard error output that was produced by your job. To view your files, use the following: % cat filename.sh.?(jobID)

15. Beyond the Command Line – Sun Grid Engine’s Graphical User Interface Sun Grid Engine provides a Graphical User Interface that can complete everything that we did during the previous examples.

16. Demonstration: Starting the Graphical User Interface Please enter the following command to start the graphical user interface: % qmon >/dev/null 2>&1 &

17. Exploring the Graphical User Interface The Graphical User Interface has a wide variety of options. We will only concern ourselves with the following icons: View the Status of a Job Exit GUI

18. Demonstration: Running A Job through a GUI in Sun Grid Engine To bring up the submission window, please click on the submission icon. (Shown to the left)

20. Demonstration: Checking the status of the job Please click ‘Done’ and select the ‘Job Status’ button. Click on the tab called ‘Running Jobs’.

23. Demonstration: Closing qmon Please click on the ‘Done’ button. To close qmon, click on the ‘Exit’ button.

24. Demonstration: Creating our own submission script An existing binary, cal, is used to print out the current month. We can create a submission script to submit the binary to Sun Grid Engine (Filename: CalSubmission.sh ): /usr/bin/cal $1

25. Demonstration (Con’t) We can submit this script with command line arguments. %qsub CalSubmission.sh 2006 %qsub CalSubmission.sh 2000 The output will appear shortly in files as previously shown.

26. Submission to Sun Grid Engine Through GRAM Gridwise technologies, with other groups, have created an adapter where users can use the Sun Grid Engine as a scheduler for GRAM job submissions. Thus, the master node of Sun Grid Engine can now become the master node for GRAM submissions to SGE.

27. Demonstration: Submitting a Job to SGE through GRAM First, we must have a proxy. (As described in the GRAM presentation.) % grid-proxy-init (Enter YOUR password here.) We already have a container running on port 8443 (Secure).

28. Demonstration (Con’t) The GRAM job submission for SGE is almost identical to Fork. % globusrun-ws –submit \ -streaming –Ft SGE \ -c /usr/bin/uptime The submission may take up to a couple of minutes.

29. SGE Job Submissions are not limited to pre-existing binaries We have created two scripts thus far: simple.sh and CalSubmission.sh These scripts may be submitted to GRAM: %globusrun-ws –submit \ -streaming –Ft SGE \ -c /home/yourusername/simple.sh

30. How This Works GRAM is responsible for authorization. After authorization, SGE is used to choose the node to execute on. The streaming capability requires the use of RFT (Reliable File Transfer).

31. Conclusion We have: –Explored the Pros/Cons of using Sun Grid Engine. –Used the command line and graphical user interface to submit a wide variety of jobs to the Sun Grid Engine. –Used GRAM to submit jobs to the cluster using Sun Grid Engine.

32. Questions? Please ask!