CIS5930: Advanced Topics in Parallel and Distributed Systems Instructor: Xin Yuan, 168 Love, xyuan@cs.fsu.edu, 4-9133 Office hour: 10:00am-11:30am Tuesday and Thursday, or by appointment Course website: blackboard and http://www.cs.fsu.edu/~xyuan/cis5930/index.html CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

Course objectives Bringing the students up-to-date in research in extreme scale parallel and distributed systems Introducing software, algorithmic, and analytical tools and techniques that are necessary to perform research in this area. At the end of the course, the students should be able to Explain current research issues in extreme scale parallel and distributed systems. Apply techniques to investigate, model, and simulate extreme scale parallel and distributed systems. CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

Topics covered Programming paradigms You should know some of the paradigms such as client/server, p2p. MPI, GPU/MIC, Mapreduce, hybrid Interconnect design, model, and evaluation Topology, routing, flow control, congestion control New networking technologies: InfiniBand, 100G Ethernet, Openflow Modeling and simulation methods System software and communication sub-systems The implementation of the communication sub-systems (e.g. MPI) Application tracing issues Resilience, Power, and Security CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

Textbook and course materials Required: none Course materials Mostly papers from recent top conferences in PDS or HPC Some from online tutorials MPI: http://www-unix.mcs.anl.gov/mpi/ OpenMP: http://www.openmp.org CUDA: NVIDIA CUDA Programming Guide OpenCL: OpenCL Programming Guide for the CUDA Architecture CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

Course schedule (tentative) Week 1: Syllabus and introduction Week 2: Programming paradigm (MPI, GPU/MIC, Mapreduce, hybrid) Week 3: Programming paradigm (MPI, GPU/MIC, Mapreduce, hybrid) Week 4: Programming paradigm (MPI, GPU/MIC, Mapreduce, hybrid) Week 5: Interconnect basics Week 6: Interconnect technology: Infiniband, 100G Ethernet, Openflow Week 7: New interconnect proposals Week 8: Interconnect modeling and simulation methods Week 9: System software and communication sub-systems Week 10: Spring break Week 11: System software and communication sub-systems Week 12: Resilience, power, and security Week 13: Resilience, power, and security Week 14: Resilience, power, and security Week 15: Term project presentation Week 16: Term project presentation CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

Prerequisite COP 4610: Operating systems No requirement for background knowledge of parallel and distributed computing You should have one of the following (not official, but …) CDA5125 COP5570 CNT5505 CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

Grading Always groups of 2 students (unless you prefer to be alone) 10 % - classroom participation Read the papers before coming to class. 20% - classroom presentation 10% - homework, paper critics, programming assignments. 40% - course project 20% final exam (take home) CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

Course policies Attendance: required. Late assignments: not accepted without a valid excuse. Missed exam: following the university rules. Let me know when you need to miss an exam ASAP. Incomplete grade: Miss the final with an accepted excuse Due to extraordinary circumstances with appropriate documentation. CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

Academic Integrity Violation No copying from anywhere Don’t ask others for solutions and don’t give solutions to others. Violation The university requires all violations to be reported. First violation with level 1 agreement: 0 for the particular assignment/exam and the lowering of one letter (A->B) for course final grade. Second violation: resolved through the office of the Dean and the Faculties CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University

Accommodation for Disabilities Register with and provide documentation to the Student Disability Resource Center (SDRC). Bring a letter to me from the SDRC `indicating you need academic accomodations. This should be done within the first week of class CIS5930 Advanced Topics in Parallel and Distributed Systems Florida State University