1. Tutorial on Distributed High Performance Computing 14:30 – 19:00 (2:30 pm – 7:00 pm) Wednesday November 17, 2010 Jornadas Chilenas de Computación 2010 INFONOR-CHILE 2010 November 15th - 19th, 2010 Antofagasta, Chile Dr. Barry Wilkinson University of North Carolina Charlotte Oct 23, 2010 © Barry Wilkinson

2. 2 Agenda Part 1 14.30 – 16.30 (2:30 pm – 4:30 pm) Review of distributed high performance computing landscape, cluster computing, grid computing, cloud computing, grid portals and toolkits, GPU computing for HPC, CUDA. 16.30 – 17.00 (4:30 pm – 5:00 pm) Coffee Break Part 2 17.00 – 19.00 (5:00 pm – 7:00 pm) Grid computing infrastructure design, portal design, higher-level interfaces challenge of porting applications to a Grid. (Hands-one experience in Grid computing workshop)

3. Part 1 14.30 – 16.30 (2:30 pm – 4:30 pm) Distributed high performance computing landscape

4. 4 Some Highlights of High Performance Computing 1970198019902000201020151960 Packet switched networks ARPNET Internet TCP TCP/IP Ethernet WWW Parallel Computers Cluster computing MPIPVM Condor Geographically distributed computing Grid computing HPC Cloud computing GPGPU cluster CUDA Globus Future HPC 1950 Term “Parallel Programming” (title of 1958 paper by Gill)

5. “The grid virtualizes heterogeneous geographically disperse resources” from "Introduction to Grid Computing with Globus," IBM Redbooks Using geographically distributed and interconnected computers together for computing and for resource sharing. Grid Computing

6. Grid Computing History Began in mid 1990s with experiments using computers at geographically dispersed sites. Seminal experiment – “I-way” experiment at 1995 Supercomputing conference (SC’95), using 17 sites across US running: – 60+ applications. – Existing networks (10 networks).

7. Need to harness computers Original driving force behind Grid computing same as behind the early development of networks that became the Internet: – Connecting computers at distributed sites for high performance computing.

8. However, Grid computing is about collaborating and resource sharing as much as it is about high performance computing.

9. Virtual Organizations Grid computing offers potential of virtual organizations: – groups of people, both geographically and organizationally distributed, working together on a problem, sharing computers AND other resources such as databases and experimental equipment.

10. Crosses multiple administrative domains. Hallmark of larger Grid computing projects. Resources being shared owned either by members of virtual organization or donated by others. Introduces challenging technical and social- political challenges. Requires true collaboration.

11. Key concepts in the history of Grid computing

12. Led by Ian Foster, a co- developer of I-Way demonstration, and founder of Grid computing concept. Globus -- middleware software Grid computing toolkit. Evolved through several implementation versions although basic components remained essentially same : Security, Data management Execution management Information services Run time environment) Globus Project 2010 home page http://www.globus.org/

13. Although Globus widely adopted, there are other software infrastructure projects. Europe 1997 - 2002 UNICORE (UNiform Interface to COmputing REsources) Initially funded by German Ministry for Education and Research. Continued with other European funding. Basis of several European efforts in Grid computing and elsewhere. Many similarities to Globus. 2004 - 2010 EGEE project (Enabling Grids for E-Science) Series of projects funded by European Commission, now ended Developed gLite, a middleware stack for Grid computing Other grid computing middleware software

14. 14 Follow-on from EGEE Enabling Grids for E-sciencE (2002-2010) http://www.egi.edu/

15. Applications Originally e-Science applications – Computational intensive Traditional high performance computing addressing large problems Not necessarily one big problem but a problem that has to be solved repeatedly with different parameters. – Data intensive Computational but emphasis on large amounts of data to store and process – Experimental collaborative projects Now also e-Business applications – To improve business models and practices. – Sharing corporate computing resources and databases – On-demand Grid computing … indirectly led to cloud computing.

16. Grid Computing verse Cluster Computing Grid computing NOT simply a large cluster Potential and challenges different. Cluster Computing Message passing programming using tools such as MPI. Network security is not a big issue. Usually an ssh connection to front node of cluster sufficient. Computers under one administrative domain Grid computing Running jobs of remote machines, distributed workflow Internet technologies, web services,... Security is a big issue.

17. Grid Computing verse Cluster Computing Of course, there are things in common Both use multiple computers Both require job scheduler to place jobs.

18. Cloud computing Lot of hype on Cloud computing at the moment. Business model in which services provided on servers that can be accessed through Internet. Lineage of cloud computing can be traced back to on-demand Grid computing in the early 2000s.

19. Cloud computing using virtualized resources

20. Common thread between Grid computing and cloud computing is use of Internet to access resources. Cloud computing driven by widespread access that Internet provides and Internet technologies. However cloud computing quite distinct from original purpose of Grid computing. Cloud Computing

21. Grid Computing verse Cloud Computing Whereas Grid computing focuses on collaborative and distributed shared resources, Cloud computing concentrates upon placing services for users to pay to use. Technology for cloud computing emphases: – use of software as a service (SaaS)‏ – virtualization (process of separating particular user’s software environment from underlying hardware).

22. Sample Grid Computing Projects

23. NSF Network for Earthquake Engineering Simulation (NEES)‏ Sample projects in 2000 – 2010 period --- Environment/Earth

24. 24 http://nees.berkeley.edu

25. 25 http://scoop.sura.org

26. http://www.earthsystemgrid.org

27. 1a.27 http://www.ediamond. ox.ac.uk/ Medicine/Biology Project period: 2002-2005

28. http://www.openmolgrid.org/ Project period: 2002-2005…

29. Large Hadron Collider experimental facility for complex particle experiments at CERN (European Center for Nuclear Research, near Geneva Switzerland). Development of grid started in 2002 and continuing Touted as the “World’s biggest computing grid” http://www.bnl.gov/bnlweb/pubaf/pr/PR_display.asp?prID=840&template=Today Physics CERN LCH Computing grid (LCG)‏

30. http://public.web.cern.ch/public/en/LHC/LHC-en.html

31. 31 http://kg.web.cern.ch/lcg

32. LCG depends on two major science grid infrastructures …. EGEE - Enabling Grids for E-Science OSG - US Open Science Grid From: LCG Overview - May 2007 - Les Robertson, http://lcg.web.cern.ch/LCG/dissemination.html

33. Grid computing infrastructure projects Not tied to one specific application

34. TeraGrid circa 2004

35. 1-1.35 TeraGrid (As of 2008 - )

36. Open Science Grid (OSG) Started around 2005, received $30 million funding from NSF and DOE, 2006: Boston University Brookhaven National Laboratory California Institute of Technology Columbia University Cornell University Fermi National Accelerator Laboratory Indiana University Lawrence Berkeley National Laboratory Stanford Linear Accelerator Center University of California, San Diego University of Chicago University of Florida University of Iowa University of North Carolina/RENCI University of Wisconsin-Madison

37. 37 http://www.opensciencegrid.org

38. http://myosg.grid.iu.edu/map/promo, Sept 2010

39. http://www.suragrid.org/ Southeastern Universities Research Association, SURAGrid

40. DEISA (Distributed European Infrastructure for Supercomputing Applications) 2004 - 2008 DEISA-1 2008 – 2011 DEISA-2 1a.40 European centered multi-national Grid Example

41. Vision of a single universal international Grid such as the Internet/World Wide Web May never be achieved though. More likely - Grids will connect to other Grids but will maintain their identity. 1a.41

42. 42 Our Grid Computing Course (University of North Carolina-Charlotte and University of North Carolina-Wilmington ) Taught on North Carolina Research and Education Network (NCREN) that connects all 16 state campuses and also private institutions  Fall 2004: 8 sites  Fall 2005: 12 sites  Spring 2007:3 sites  Fall 2008:5 sites  Spring 2010:8 sites Spring 2010 has 70+ students Figure 3 NCREN televideo classroom at the University of North Carolina Charlotte. 42

43. http://www.cs.uncc.edu/~abw/gridcourse/ 43

44. Break/questions