2. Distributed Systems and Algorithms (DSA from A to Z) Carey Williamson iCORE Professor and NSERC IRC Department of Computer Science University of Calgary

3. Copyright © 2005 Department of Computer Science November 20052 Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing You are here!

4. Copyright © 2005 Department of Computer Science November 20053 Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing Databases - Alhajj - Barbosa - Barker - Hammad Networks - Li - Mahanti - Williamson Distributed Algorithms/ Reliability - Higham Multi-agent/ Biological Systems - Denzinger - Jacob Simulation/ Grid/HPC - Simmonds - Unger

5. Copyright © 2005 Department of Computer Science November 20054 ADSA: Yesterday to Today  Bio-Informatics and Bio-Computing  Cache Invalidation Schemes for Mobile Databases  Keyword Search in Structured Databases  Knowledge Discovery and Data Mining  Multi-agent Systems  Partitioning  Replication in Grid Environment  Web Databases  XML and Data Reengineering

6. Copyright © 2005 Department of Computer Science November 20055 ADSA: Today to Tomorrow  Bio-Informatics and Bio-Computing  Data Mining  Distributed Systems  Database Security  Autonomic Systems  Systems Integration  XML Data Systems/Repositories  Sensor Systems  Stream Mining DBA

7. Copyright © 2005 Department of Computer Science November 20056 Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing Databases - Alhajj - Barbosa - Barker - Hammad Networks - Li - Mahanti - Williamson Distributed Algorithms/ Reliability - Higham Multi-agent/ Biological Systems - Denzinger - Jacob Simulation/ Grid/HPC - Simmonds - Unger

8. Copyright © 2005 Department of Computer Science November 20057 Distributed Algorithms (Higham) Did you know that... –many commercial multi-processors don’t work correctly? –Herlihy’s hierarchy collapses for hard real-time apps? –self-stabilizing algorithms matter in real-life? –sensor networks are the next big thing? Lisa Higham studies the theoretical side of distributed computation, including fault-tolerance, parallel algorithms, memory consistency models, wait-free computation, and sensor networks

9. Copyright © 2005 Department of Computer Science November 20058 Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing Databases - Alhajj - Barbosa - Barker - Hammad Networks - Li - Mahanti - Williamson Distributed Algorithms/ Reliability - Higham Multi-agent/ Biological Systems - Denzinger - Jacob Simulation/ Grid/HPC - Simmonds - Unger

10. Copyright © 2005 Department of Computer Science November 20059 Multi-Agent Systems (Denzinger) Application of advanced artificial intelligence (AI) techniques to problems requiring learning, cooperation, coordination, and negotiation between and among multiple (software) agents Examples: –Internet search –software agent negotiation –finding good/bad strategies in gaming applications See poster for details!

11. Copyright © 2005 Department of Computer Science November 200510 Biological Computation (Jacob) One ant: dumb Lots of ants: smart Swarm intelligence!! The world of biology offers fascinating insights into computational models, showing the power of evolutionary algorithms and swarm intelligence See poster for details!

12. Copyright © 2005 Department of Computer Science November 200511 Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing Databases - Alhajj - Barbosa - Barker - Hammad Networks - Li - Mahanti - Williamson Distributed Algorithms/ Reliability - Higham Multi-agent/ Biological Systems - Denzinger - Jacob Simulation/ Grid/HPC - Simmonds - Unger

13. Copyright © 2005 Department of Computer Science November 200512 Networks and Systems Which of the following statements is NOT true? (a) Over 60% of U of C Internet traffic is P2P (b) Microsoft IE browser violates TCP FIN rules (c) In WLANs, “one bad apple spoils the batch” (d) Web traffic workloads exhibit heavy tails (e) Internet media streaming quality is often poor (f) Network coding achieves optimal throughput (g) There is $100 taped underneath your chair Multiple Choice Quiz Answer: (g)

14. Copyright © 2005 Department of Computer Science November 200513 Network Coding Theory (Li) BitTorrent: The Next Generation?

15. Copyright © 2005 Department of Computer Science November 200514 Content Distribution Systems (Mahanti) Multimedia streaming on wired networks Multimedia streaming on wireless networks Quality adaptation for streaming media Scalable multicast streaming protocols Internet traffic classification and modeling Peer-to-peer (P2P) systems See poster for details!

16. Copyright © 2005 Department of Computer Science November 200515 Network Performance (Williamson) “Make the Internet go faster” Research area? –Wireless/cellular networks, Internet protocols, computer systems performance evaluation Approach? –Experimental, simulation, analytical Key challenges? –Citius, Altius, Fortius! –Performance, scalability, robustness

17. Copyright © 2005 Department of Computer Science November 200516 Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing Databases - Alhajj - Barbosa - Barker - Hammad Networks - Li - Mahanti - Williamson Distributed Algorithms/ Reliability - Higham Multi-agent/ Biological Systems - Denzinger - Jacob Simulation/ Grid/HPC - Simmonds - Unger

18. Copyright © 2005 Department of Computer Science November 200517 Grid Computing (Simmonds, Unger) What? –High performance computing for big science apps –Service based architecture with user-level authentication and credential delegation –Enables creation of federated computing environments spanning administrative domains How? –Standard interfaces to HPC systems –High performance data transfer tools (> 900 Mbps!!) –Additional tools build on top of these services Where? –U of C (and U of A, U of L, UBC, SFU, …)

19. Copyright © 2005 Department of Computer Science November 200518 WestGrid

20. Copyright © 2005 Department of Computer Science November 200519 Grid Research Activities Grid Monitoring Data Management Data Analysis http://www.westgrid.ca http://grid.ucalgary.ca

21. Copyright © 2005 Department of Computer Science November 200520 Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing Databases - Alhajj - Barbosa - Barker - Hammad Networks - Li - Mahanti - Williamson Distributed Algorithms/ Reliability - Higham Multi-agent/ Biological Systems - Denzinger - Jacob Simulation/ Grid/HPC - Simmonds - Unger

22. Copyright © 2005 Department of Computer Science November 200521 DSA Posters on Display Today Multi-Objective Optimization to Produce the Most Natural Clustering (Alhajj/Barker) VIREX: A Visual Tool for Querying Relational DBs to Produce XML Documents (Alhajj/Barker) Managing Complex Data (Barbosa) System Testing by Learning Behavior (Denzinger) Evolutionary and Swarm Design (Jacob) Non-Traditional Data Management (Hammad) Content Distribution Systems (Mahanti)

23. Copyright © 2005 Department of Computer Science November 200522 Summary: DSA Members Reda Alhajj (Databases) Denilson Barbosa (Databases) Ken Barker (Databases) Jörg Denzinger (Multi-Agent Systems) Moustafa Hammad (Databases) Lisa Higham (Distributed Algorithms) Christian Jacob (Biological Computation) Zongpeng Li (Network Coding Theory) Anirban Mahanti (Content Distribution Systems) Rob Simmonds (Grid Computing) Brian Unger (Grid Computing) Carey Williamson (Network Performance) Questions?