1. CFI 2004 Clusters @ UW A quick overview with lots of time for Q&A and exploration.

2. Q: What is a cluster? A: A group of machines that can work together to produce results.

3. ?

4. ?

6. Characteristics  Group of machines  Not necessarily homogeneous  Common set of users  Some sort of batch system

7. Why do I want one? Ideally your jobs are able to be parallelized and do not require allocation of large chunks of memory.

8. When do I not want one? When you need large chunks of memory, or when you only need a single fast CPU

9. What do we have?  marroo - 21 nodes  shiraz - 21 nodes  vidal - 16 nodes

10. How do I get to them? Accounts - SSH client -

11. Quick Hardware Specs  SunFire X4100 - dual CPU, dual core  2.4GHz Opteron cores  8GB RAM

12. Filesystems  /home - big, shared  /scratch-net - big, shared  /scratch - local, not so big  Network filesystems on a NAS

13. Backups There aren’t (yet?) any, so be careful

14. Power shiraz and marroo have a UPS each backing head nodes and NAS vidal will be getting a UPS to back at least that also

15. What can I do? They’re Linux boxes, so anything you could normally do on your workstation. Plus a bit more.

16. Sun N1 Grid Engine Fairly simple setup of batch system, our implementation has only a single queue.

17. N1GE QuickStart Only on vidal sge-root is /home/N1GE6 Cell name is “default” Important commands are qsub and qstat

18. Commercial Software CFI grant has allowances for MatLab CPLEX is installed on vidal, arrange for licensing

19. Free Software Of course, there are lots of packages available for Linux. We have installed R on vidal, along with some packages.

20. Updates and Security Compute nodes as static as possible Head nodes receive security updates Head node reboots scheduled in advance

21. Other Stuff Ganglia for rough usage data and trends Head nodes monitored for connectivity Mailing list!

24. Hopefully this…

25. … leads to this: Fun in the Sun