CSE 486/586 Distributed Systems Wrap-up

Slides:



Advertisements
Similar presentations
CS425 /CSE424/ECE428 – Distributed Systems – Fall 2011 Material derived from slides by I. Gupta, M. Harandi, J. Hou, S. Mitra, K. Nahrstedt, N. Vaidya.
Advertisements

CSE 486/586, Spring 2012 CSE 486/586 Distributed Systems Leader Election Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2012 CSE 486/586 Distributed Systems Consensus Steve Ko Computer Sciences and Engineering University at Buffalo.
Failure Detection The ping-ack failure detector in a synchronous system satisfies – A: completeness – B: accuracy – C: neither – D: both.
CSE 486/586, Spring 2014 CSE 486/586 Distributed Systems Consistency Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2013 CSE 486/586 Distributed Systems Consensus Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2013 CSE 486/586 Distributed Systems Byzantine Fault Tolerance Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2012 CSE 486/586 Distributed Systems Byzantine Fault Tolerance Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2012 CSE 486/586 Distributed Systems Transactions Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2013 CSE 486/586 Distributed Systems Consistency Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2012 CSE 486/586 Distributed Systems Introduction Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2013 CSE 486/586 Distributed Systems Logical Time Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586 CSE 486/586 Distributed Systems Introduction Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2013 CSE 486/586 Distributed Systems Introduction Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2013 CSE 486/586 Distributed Systems Mid-Semester Overview Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2013 CSE 486/586 Distributed Systems Wrap-up Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2012 CSE 486/586 Distributed Systems Wrap-up Steve Ko Computer Sciences and Engineering University at Buffalo.
Lecture 11-1 Computer Science 425 Distributed Systems CS 425 / CSE 424 / ECE 428 Fall 2010 Indranil Gupta (Indy) September 28, 2010 Lecture 11 Leader Election.
CSE 486/586, Spring 2012 CSE 486/586 Distributed Systems Mutual Exclusion & Leader Election Steve Ko Computer Sciences and Engineering University.
CSE 486/586 CSE 486/586 Distributed Systems Byzantine Fault Tolerance Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2014 CSE 486/586 Distributed Systems Consistency Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586 Distributed Systems Consistency --- 3
CSE 486/586, Spring 2014 CSE 486/586 Distributed Systems Introduction Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2012 CSE 486/586 Distributed Systems Replication Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586 CSE 486/586 Distributed Systems Consistency Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2013 CSE 486/586 Distributed Systems Byzantine Fault Tolerance Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2014 CSE 486/586 Distributed Systems Transactions on Replicated Data Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2012 CSE 486/586 Distributed Systems Paxos Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586 CSE 486/586 Distributed Systems Leader Election Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586 CSE 486/586 Distributed Systems Consensus Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2014 CSE 486/586 Distributed Systems Paxos Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2014 CSE 486/586 Distributed Systems Byzantine Fault Tolerance Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586, Spring 2013 CSE 486/586 Distributed Systems Consistency Steve Ko Computer Sciences and Engineering University at Buffalo.
CSE 486/586 Distributed Systems Byzantine Fault Tolerance
CSE 486/586 Distributed Systems Gossiping
CSE 486/586 Distributed Systems Reliable Multicast --- 1
CSE 486/586 Distributed Systems Leader Election
CSE 486/586 Distributed Systems Mid-Semester Overview
CSE 486/586 Distributed Systems Paxos
CSE 486/586 Distributed Systems Consistency --- 2
CSE 486/586 Distributed Systems Consistency --- 1
CSE 486/586 Distributed Systems Logical Time
CSE 486/586 Distributed Systems Wrap-up
CSE 486/586 Distributed Systems Time and Synchronization
CSE 486/586 Distributed Systems Failure Detectors
CS 194: Lecture 1 University of California Berkeley
CSE 486/586 Distributed Systems Byzantine Fault Tolerance
CSE 486/586 Distributed Systems Consistency --- 3
CSE 486/586 Distributed Systems Consistency --- 1
CSE 486/586 Distributed Systems Leader Election
CSE 486/586 Distributed Systems Concurrency Control --- 3
CSE 486/586 Distributed Systems Mutual Exclusion
IS 651: Distributed Systems Final Exam
Distributed Computing:
CSE 486/586 Distributed Systems Wrap-up
CSE 486/586 Distributed Systems Introduction
Distributed Systems (15-440)
CSE 486/586 Distributed Systems Consistency --- 2
CSE 486/586 Distributed Systems Consistency --- 3
CSE 486/586 Distributed Systems Consistency --- 1
CSE 486/586 Distributed Systems Paxos
CSE 486/586 Distributed Systems Logical Time
CSE 486/586 Distributed Systems Mutual Exclusion
CSE 486/586 Distributed Systems Byzantine Fault Tolerance
CSE 486/586 Distributed Systems Time and Synchronization
CSE 486/586 Distributed Systems Concurrency Control --- 3
CSE 486/586 Distributed Systems Leader Election
CSE 486/586 Distributed Systems Consensus
CSE 486/586 Distributed Systems Mid-Semester Overview
Presentation transcript:

CSE 486/586 Distributed Systems Wrap-up Steve Ko Computer Sciences and Engineering University at Buffalo

CSE 486/586 Administrivia PA4 due this Friday (5/6) @ 11:59am Final: 5/12, Thursday, 8am – 11am Knox 20 Everything, 1-page letter-sized cheat sheet allowed No restroom use (this quickly becomes chaotic) Multiple choices Important things about the final week PA4 scores will hopefully be posted before the final. No office hours next week Final grading I’m shooting for Wednesday (5/18) for posting, Thursday (5/19) for reviewing, and Friday for finalizing. This will change if there’s any delay in grading at the scoring center.

Building a Distributed System “The number of people who know how to build really solid distributed systems…is about ten” Scott Shenker, Professor at UC Berkeley Are you confident now? What were the most interesting topic to you?

Things We Discussed (Midterm) Networking basics (feat. the Internet) Failure detection Time synchronization Logical time & global states P2P & DHT Reliable multicast Consensus basics Mutual exclusion & leader election RPC

Things We Discussed Transactions & concurrency control Replication Gossiping Distributed file systems Paxos BFT Security

The Way I See It We’ve learned some of the building blocks & fundamental results… Networking basics, failure detection, logical time, reliable multicast, mutual exclusion, leader election, transactions, concurrency control, replication, gossiping, Paxos, BFT, … …and how real systems get built using those… P2P, DHT, Dynamo, … …and also got some experience in building/using the fundamental building blocks… Ordered multicast for messaging, a DHT, and a replicated key-value storage

Distributed Systems 10 Questions Course goal: answering 10 questions on distributed systems At the end of the semester, if you can answer only 10 questions about distributed systems, you’ll probably get an A. Easy enough! What are those questions? Organized in 6 themes 1~2 questions in each theme A few (or several) lectures to answer each question

Theme 1: Hint What’s up? Hey!

Theme 1: Communications Q1: how do you talk to another machine? A: Networking basics Know how to use socket now? Q2: how do you talk to multiple machines at once? A: Multicast What is “reliable multicast”? What orderings are there for ordered multicast? Q3: can you call a function/method/procedure running in another machine? A: RPC What is a stub compiler (generator)?

I thought I was doing it… Theme 2: Hint I thought I was doing it… I’m shaking my tail. What? I’m doing it too!

Theme 2: Concurrency Q4: how do you control access to shared resources? A: Distributed mutual exclusion, leader election, etc. Ring election? Modified ring election? Bully algorithm?

Theme 3: Hint I want to shake my tail. No, I don’t want to. OK No way!

Theme 3: Consensus Q5: how do multiple machines reach an agreement? A: it’s impossible! (the FLT result), but algorithms do exist that get around the impossibility (Paxos, BFT, etc.) What are the phases for Paxos?

Theme 4: Hint Who has a brain? I do. I don’t.

Theme 4: Storage Management Q6: how do you locate where things are and access them? A: DHT, distributed file systems, etc. Consistent hashing?

I have a feeling that something went wrong… Theme 5: Hint I have a feeling that something went wrong… zzz…

Theme 5: Non-Byzantine Failures Q7: how do you know if a machine has failed? A: Failure detection What is the fundamental limit of a failure detector? Q8: how do you program your system to operate continually even under failures? A: Replication, gossiping Linearizability? Sequential consistency? One-copy seriarizability?

Theme 6: Hint We’re under attack!

Theme 6: Byzantine Failures Q9: how do you deal with attackers? A: Security What is a digital certificate? Q10: what if some machines malfunction? A: Byzantine fault tolerance To tolerate f faulty nodes, how many nodes do we need in total?

Acknowledgements These slides contain material developed and copyrighted by Indranil Gupta (UIUC).