Distributed Systems and Algorithms (DSA from A to Z) Carey Williamson iCORE Professor and NSERC IRC Department of Computer Science University of Calgary

Copyright © 2005 Department of Computer Science November Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing You are here!

Copyright © 2005 Department of Computer Science November Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing Databases - Alhajj - Barbosa - Barker - Hammad Networks - Li - Mahanti - Williamson Distributed Algorithms/ Reliability - Higham Multi-agent/ Biological Systems - Denzinger - Jacob Simulation/ Grid/HPC - Simmonds - Unger

Copyright © 2005 Department of Computer Science November ADSA: Yesterday to Today  Bio-Informatics and Bio-Computing  Cache Invalidation Schemes for Mobile Databases  Keyword Search in Structured Databases  Knowledge Discovery and Data Mining  Multi-agent Systems  Partitioning  Replication in Grid Environment  Web Databases  XML and Data Reengineering

Copyright © 2005 Department of Computer Science November ADSA: Today to Tomorrow  Bio-Informatics and Bio-Computing  Data Mining  Distributed Systems  Database Security  Autonomic Systems  Systems Integration  XML Data Systems/Repositories  Sensor Systems  Stream Mining DBA

Copyright © 2005 Department of Computer Science November Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing Databases - Alhajj - Barbosa - Barker - Hammad Networks - Li - Mahanti - Williamson Distributed Algorithms/ Reliability - Higham Multi-agent/ Biological Systems - Denzinger - Jacob Simulation/ Grid/HPC - Simmonds - Unger

Copyright © 2005 Department of Computer Science November Distributed Algorithms (Higham) Did you know that... –many commercial multi-processors don’t work correctly? –Herlihy’s hierarchy collapses for hard real-time apps? –self-stabilizing algorithms matter in real-life? –sensor networks are the next big thing? Lisa Higham studies the theoretical side of distributed computation, including fault-tolerance, parallel algorithms, memory consistency models, wait-free computation, and sensor networks

Copyright © 2005 Department of Computer Science November Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing Databases - Alhajj - Barbosa - Barker - Hammad Networks - Li - Mahanti - Williamson Distributed Algorithms/ Reliability - Higham Multi-agent/ Biological Systems - Denzinger - Jacob Simulation/ Grid/HPC - Simmonds - Unger

Copyright © 2005 Department of Computer Science November Multi-Agent Systems (Denzinger) Application of advanced artificial intelligence (AI) techniques to problems requiring learning, cooperation, coordination, and negotiation between and among multiple (software) agents Examples: –Internet search –software agent negotiation –finding good/bad strategies in gaming applications See poster for details!

Copyright © 2005 Department of Computer Science November Biological Computation (Jacob) One ant: dumb Lots of ants: smart Swarm intelligence!! The world of biology offers fascinating insights into computational models, showing the power of evolutionary algorithms and swarm intelligence See poster for details!

Copyright © 2005 Department of Computer Science November Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing Databases - Alhajj - Barbosa - Barker - Hammad Networks - Li - Mahanti - Williamson Distributed Algorithms/ Reliability - Higham Multi-agent/ Biological Systems - Denzinger - Jacob Simulation/ Grid/HPC - Simmonds - Unger

Copyright © 2005 Department of Computer Science November Networks and Systems Which of the following statements is NOT true? (a) Over 60% of U of C Internet traffic is P2P (b) Microsoft IE browser violates TCP FIN rules (c) In WLANs, “one bad apple spoils the batch” (d) Web traffic workloads exhibit heavy tails (e) Internet media streaming quality is often poor (f) Network coding achieves optimal throughput (g) There is $100 taped underneath your chair Multiple Choice Quiz Answer: (g)

Copyright © 2005 Department of Computer Science November Network Coding Theory (Li) BitTorrent: The Next Generation?

Copyright © 2005 Department of Computer Science November Content Distribution Systems (Mahanti) Multimedia streaming on wired networks Multimedia streaming on wireless networks Quality adaptation for streaming media Scalable multicast streaming protocols Internet traffic classification and modeling Peer-to-peer (P2P) systems See poster for details!

Copyright © 2005 Department of Computer Science November Network Performance (Williamson) “Make the Internet go faster” Research area? –Wireless/cellular networks, Internet protocols, computer systems performance evaluation Approach? –Experimental, simulation, analytical Key challenges? –Citius, Altius, Fortius! –Performance, scalability, robustness

Copyright © 2005 Department of Computer Science November Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing Databases - Alhajj - Barbosa - Barker - Hammad Networks - Li - Mahanti - Williamson Distributed Algorithms/ Reliability - Higham Multi-agent/ Biological Systems - Denzinger - Jacob Simulation/ Grid/HPC - Simmonds - Unger

Copyright © 2005 Department of Computer Science November Grid Computing (Simmonds, Unger) What? –High performance computing for big science apps –Service based architecture with user-level authentication and credential delegation –Enables creation of federated computing environments spanning administrative domains How? –Standard interfaces to HPC systems –High performance data transfer tools (> 900 Mbps!!) –Additional tools build on top of these services Where? –U of C (and U of A, U of L, UBC, SFU, …)

Copyright © 2005 Department of Computer Science November WestGrid

Copyright © 2005 Department of Computer Science November Grid Research Activities Grid Monitoring Data Management Data Analysis

Copyright © 2005 Department of Computer Science November Computer Science (CPSC) Quantum Computing & Cryptography Evolutionary Software Engineering Distributed Systems & Algorithms Visual & Interactive Computing Databases - Alhajj - Barbosa - Barker - Hammad Networks - Li - Mahanti - Williamson Distributed Algorithms/ Reliability - Higham Multi-agent/ Biological Systems - Denzinger - Jacob Simulation/ Grid/HPC - Simmonds - Unger

Copyright © 2005 Department of Computer Science November DSA Posters on Display Today Multi-Objective Optimization to Produce the Most Natural Clustering (Alhajj/Barker) VIREX: A Visual Tool for Querying Relational DBs to Produce XML Documents (Alhajj/Barker) Managing Complex Data (Barbosa) System Testing by Learning Behavior (Denzinger) Evolutionary and Swarm Design (Jacob) Non-Traditional Data Management (Hammad) Content Distribution Systems (Mahanti)

Copyright © 2005 Department of Computer Science November Summary: DSA Members Reda Alhajj (Databases) Denilson Barbosa (Databases) Ken Barker (Databases) Jörg Denzinger (Multi-Agent Systems) Moustafa Hammad (Databases) Lisa Higham (Distributed Algorithms) Christian Jacob (Biological Computation) Zongpeng Li (Network Coding Theory) Anirban Mahanti (Content Distribution Systems) Rob Simmonds (Grid Computing) Brian Unger (Grid Computing) Carey Williamson (Network Performance) Questions?