1. 1 Distributed Computing Algorithms CSCI-6966

2. 2 Distributed Computing: everything not centralized many processors

3. 3 Distributed Systems: Internet The machines of our department ATM machines, bank accounts

4. 4 What is then parallel computing? Many processors in the same machine All processors solve the same task A restricted form of distributed computing

5. 5 Basic Distributed Systems: Message passing Shared Memory

6. 6 Message Passing Systems message Can be implemented easily in hardware

7. 7 Shared Memory Systems Not easy to implement in hardware Easy to write distributed programs

8. 8 Distributed Algorithms Several problems: Communication Problems Coordination Problems Specific problems

9. 9 The counting problem Shared variable Sequential Bottleneck

10. 10 Solution: Counting network many shared variables

11. 11 Routing Problem

12. 12 Finding the spanning tree problem

13. 13 Leader election problem Leader

14. 14 Mutual Exclusion Problem Critical Region One processor allowed

15. 15 Consensus Problem Time 0 Final Time 0 1 0 1 0 1 1 1 1 1 1 1