Parallel and Distributed Computing Overview Professors Johnnie Baker and Robert Walker

Instructors Professor Johnnie W. Baker Professor Robert Walker Primary Lecturer Professor Robert Walker Particularly Architecture Lectures Guest Lecturers from Parallel Processing Group Lecture in areas of expertise Occasionally cover classes when I am away

Textbook and References Parallel Programming in C with MPI and OpenMP Michael Quinn, author Published by McGraw Hill in 2004 Used in both PDC and PDA References for Supplementary Reading Other textbooks and reference books Conference and journal papers Assigned reading will either be handed out or posted on course website

Two Complementary Courses Parallel & Distributed Computing (Fall) Architectures Languages Parallel Programming Algorithm Examples for some architectures Parallel & Distributed Algorithms (Spring) Important Models of Computation Designing Efficient Algorithms for Various Models PDC and PDA can be taken in either order Preference is for PDC to be taken first

Specific Topics Fundamental concepts in parallel computation. Synchronous Computation SIMD, Vector, Pipeline Computing Associative and Multi-Associative Computing ASC Language and Programming MultiC Language and Programming Fortran 90 and HPF Languages Asynchronous (MIMD) Shared Memory Computation OpenMP language Symmetric Multiprocessors or SMPs Asynchronous (MIMD) Distributed Memory Computation Communications MPI Language and Programming Architectures Interconnection Networks (synchronous and asynchronous) Specific Computer Examples for above computation paradigms MIMD-SIMD Comparisons in Real-Time Applications

Assignments and Grading Homework assignments Problems assigned for most chapters Probably 5-7 different assignments Some assignments will involve programming Course Grade Based on homework, midterm, and final Approximate weights (assuming grader) Homework 40% Midterm Exam 30% Final Exam 30%