Parallel Computing About the Course Ondřej Jakl Institute of Geonics, Academy of Sci. of the CR TUL

Today the first part of a two-part course on Parallel Computing “Parallel newcomers” as the supposed audience Prerequisites: basic skills in (sequential) programming (C lang.) Fact: No chance to learn parallel programming in one day Goals: To provide some orientation in the field, to show directions for self-study Material motivated from numerous textbooks and information sources –[Foster 1995] the most important one Based on a parallel programming course given at VSB-TUO, but major update Not certain if able to keep the schedule Second part (September?) – more advanced topics (suggestions?), some practical training? About the course

Lecture 1: Motivation & Contexts Lecture 2: The Hardware Story Lecture 3: Models of Parallel Computations Lecture 4: Message Passing Interface I Lecture 5: Parallel Application Design Lecture 6: Performance Analysis Outline of the course part 1

[Foster 1995] Ian Foster: Designing and Building Parallel Programs. Addison-Wesley, Literature (1) [Quinn 2004] Michael J. Quinn: Parallel Programming in C with MPI and OpenMP. McGraw-Hill, 2004 [Lin 2009] Calvin Lin, Larry Snyder: Principles of Parallel Programming. Addison-Wesley, 2009

[Wilkinson 1999] Barry Wilkinson, Michael Allen: Parallel Programming: Techniques and Applications Using Networked Workstations... Prentice-Hall 1999 Literature (2) [Grama 2003] Ananth Grama et al.: Introduction to Parallel Computing, 2 edition. Addison Wesley, 2003 [Andrews 2000] Gregory R. Andrews : Foundations of Multithreaded, Parallel, and Distributed Programming. Addison Wesley, 2000

[Hughes 2004] Cameron Hughes, Tracey Hughes: Parallel And Distributed Programming Using C++. Addison Wesley, 2004 Literature (3) [Dowd 1998] Kevin Dowd, Charles Severance: High Performance Computing, Second Edition. O'Reilly Media, 1998 [Gropp 1999] William Gropp, Ewing Lusk, Anthony Skjellum: Using MPI, 2nd Edition. The MIT Press, 1999

[Jaja 1992] Joseph Jaja: Introduction to Parallel Algorithms. Addison Wesley, 1992 Literature (4) [Ježek 1999] Karel Ježek et al.: Paralelní architektury a programy. ZČU, 1999 [Tvrdík 2000] Pavel Tvrdík: Paralelní systémy a algoritmy. ČVUT, 2000

High Performance Computing NGSSC Summer school at PDC materials, August 1998, KTH, Stockholm TRACS HPC course materials, EPCC, Edinburgh, 2000 LLNL High Performance Computing Training materials erials Cyberinfrastructure Tutor materials Wikipedia... Acknowledgements