CS6282 Very Large Scale Distributed Systems

Slides:

Advertisements

Similar presentations

An Overview of Peer-to-Peer Sami Rollins

Advertisements

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Peer-to-Peer Streaming.

Building Cloud-ready Video Transcoding System for Content Delivery Networks(CDNs) Zhenyun Zhuang and Chun Guo Speaker: 饒展榕.

Eddie Bortnikov/Aran Bergman, Principles of Reliable Distributed Systems, Technion EE, Spring Principles of Reliable Distributed Systems Recitation.

Self-Correlating Predictive Information Tracking for Large-Scale Production Systems Zhao, Tan, Gong, Gu, Wambolt Presented by: Andrew Hahn.

NUS.SOC.CS Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media.

588 Section 6 Neil Spring May 11, Schedule Notes – (1 slide) Multicast review –(3slides) RLM (the paper you didn’t read) –(3 slides) ALF & SRM –(8.

Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek and Hari alakrishnan.

Library Automation and Digital Libraries Class #5 LBSC 690 Information Technology.

EPFL-I&C-LSIR [P-Grid.org] Workshop on Distributed Data and Structures ’04 NCCR-MICS [IP5] presented by Anwitaman Datta Joint work with Karl Aberer and.

Focus on Distributed Hash Tables Distributed hash tables (DHT) provide resource locating and routing in peer-to-peer networks –But, more than object locating.

Rock Creek Campus. ◊ Introduces basic elements of website creation using Adobe Dreamweaver CS5 ◊ Includes web terminology, basic XHTML, uploading pages.

Project Management Take a Tour of the Online Course.

Research on cloud computing application in the peer-to-peer based video-on-demand systems Speaker : 吳靖緯 MA0G rd International Workshop.

CS223 Algorithms D-Term 2013 Instructor: Mohamed Eltabakh WPI, CS Introduction Slide 1.

Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.

Exploring VoD in P2P Swarming Systems By Siddhartha Annapureddy, Saikat Guha, Christos Gkantsidis, Dinan Gunawardena, Pablo Rodriguez Presented by Svetlana.

Understanding data communications Taekyoung Kwon

COCONET: Co-Operative Cache driven Overlay NETwork for p2p VoD streaming Abhishek Bhattacharya, Zhenyu Yang & Deng Pan.

An Architecture for Video Surveillance Service based on P2P and Cloud Computing Yu-Sheng Wu, Yue-Shan Chang, Tong-Ying Juang, Jing-Shyang Yen speaker:

Advanced Computer Networks by Behzad Akbari Spring 2011 In the Name of the Most High.

Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED.

DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S

1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.

NSF Critical Infrastructures Workshop Nov , 2006 Kannan Ramchandran University of California at Berkeley Current research interests related to workshop.

Distributed systems [Fall 2014] G Lec 1: Course Introduction.

1 COMPSCI 110 Operating Systems Who - Introductions How - Policies and Administrative Details Why - Objectives and Expectations What - Our Topic: Operating.

NUS.SOC.CS5248 Ooi Wei Tsang 1 CS6282 Very Large Scale Distributed Systems Ooi Wei Tsang SOC

NUS.SOC.CS Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media.

HUAWEI TECHNOLOGIES CO., LTD. Page 1 Survey of P2P Streaming HUAWEI TECHNOLOGIES CO., LTD. Ning Zong, Johnson Jiang.

Super-peer Network. Motivation: Search in P2P Centralised (Napster) Flooding (Gnutella)  Essentially a breadth-first search using TTLs Distributed Hash.

Adaptive Web Caching CS411 Dynamic Web-Based Systems Flying Pig Fei Teng/Long Zhao/Pallavi Shinde Computer Science Department.

1 MSc Project Yin Chen Supervised by Dr Stuart Anderson 2003 Grid Services Monitor Long Term Monitoring of Grid Services Using Peer-to-Peer Techniques.

Grid programming with components: an advanced COMPonent platform for an effective invisible grid © GridCOMP Grids Programming with components.

NUS.SOC.CS5248 Ooi Wei Tsang Systems Support for Continuous Media OOI WEI TSANG.

1 CS240: Network Routing Michalis Faloutsos. 2 Scope Routing Basics BGP routing Ad hoc routing Security Issues Group communications: Broadcast, Multicast.

Building a Distributed Full-Text Index for the Web by Sergey Melnik, Sriram Raghavan, Beverly Yang and Hector Garcia-Molina from Stanford University Presented.

1 Secure Peer-to-Peer File Sharing Frans Kaashoek, David Karger, Robert Morris, Ion Stoica, Hari Balakrishnan MIT Laboratory.

NUS.SOC.CS5248 Ooi Wei Tsang Course Matters. NUS.SOC.CS5248 Ooi Wei Tsang Deadlines 11 Oct: Survey Paper Due 18 Oct: Paper Reviews Due.

 Course Overview Distributed Systems IT332. Course Description  The course introduces the main principles underlying distributed systems: processes,

NUS.SOC.CS Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media.

Unit 9: Distributing Computing & Networking Kaplan University 1.

NUS.SOC.CS5248 Ooi Wei Tsang 1 Proxy Caching for Streaming Media.

Distributed Computing Systems CSCI 4780/6780. Scalability ConceptExample Centralized servicesA single server for all users Centralized dataA single on-line.

Introduction to CS739: Distribution Systems UNIVERSITY of WISCONSIN-MADISON Computer Sciences Department CS 739 Distributed Systems Andrea C. Arpaci-Dusseau.

Learning Management System. Introduction Software application or Web-based technology used to plan, implement, and assess a specific learning process.

Computer Science Least Privilege and Privilege Deprivation: Towards Tolerating Mobile Sink Compromises in Wireless Sensor Network Presented by Jennifer.

A Practical Performance Analysis of Stream Reuse Techniques in Peer-to-Peer VoD Systems Leonardo B. Pinho and Claudio L. Amorim Parallel Computing Laboratory.

NUS.SOC.CS5248 Ooi Wei Tsang Systems Support for Continuous Media.

Design and Implementation of a High- Performance Distributed Web Crawler Vladislav Shkapenyuk, Torsten Suel 실시간 연구실 문인철

TV Broadcasting What to look for Architecture TV Broadcasting Solution

COMPSCI 110 Operating Systems

Introduction to SDNS-Mon

Live Global Sports Events

ADDIE & ASSURE Jasper (Jia) Pan Oct

CS5248: Systems Support for Continuous Media

Examview training October 30, 2008.

Introduction to Computational Thinking

Overview The designer role in CE 4 has been separated into two new roles in CE6: Designer Role Instructor Role The Auditor role has been added as.

Cloud Data Anonymization Using Hadoop Map-Reduce Framework With Qos Evaluation and Behaviour analysis PROJECT GUIDE: Ms.S.Subbulakshmi TEAM MEMBERS: A.Mahalakshmi( ).

CHAPTER 3 Architectures for Distributed Systems

CSCD 433/533 Advanced Computer Networks

DATA RETRIEVAL IN ADHOC NETWORKS

Presentation and Evaluation

Announcements Survey … no really, you will be polled

Small-Scale Peer-to-Peer Publish/Subscribe

Topics in Formal Reasoning for Cyber-Physical Systems

CSCD 433/533 Advanced Computer Networks

New Tools In Education Minjun Wang

DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S

Presentation transcript:

CS6282 Very Large Scale Distributed Systems Ooi Wei Tsang SOC1-04-20 ooiwt@comp.nus.edu.sg

Distributed Systems What is a distributed system? “Several computers doing something together” What is some examples of distributed systems?

Very Large Scale Distributed Systems Add “very large scale”. What are some examples?

New technological trends lead to VLDS More PCs, More CPU cycles, More bandwidth.

Examples

P2P File Sharing

MMORPG

News Alert

Web Services

Sensor Network

Examples of VLDS P2P File Sharing MMORPG News Alert Video on Demand

Explore basic techniques and their applications Scope of CS6282 Explore basic techniques and their applications

Goal At the end of the class, students are expected to understand how to build large scale distributed systems.

Target Audience Anyone interested in distributed systems or doing related research (db, grid, sensors, media etc.)

I am here to light you on fire, not to fill your bucket. Learning Mode I am here to light you on fire, not to fill your bucket.

Learning Mode We learn together

Activities Read Think Discuss Innovate

Continuous Assessments

Exam (20%) Open Book Essay Type

Project (50%) Individual/Pair Research Based Expect Something New

Types of Project Identify a new problem Propose a solution

Types of Project Existing Problem New Solution

Types of Project Existing Solutions New Evaluations

Types of Project Existing Solutions New Application

Collect and Analyze Data Types of Project Collect and Analyze Data New Insights

Project Components Define Problem Find Solution Implement Evaluate Present

Project Deliverables 8-page research paper Poster presentations

Combine Project with your current research (subj. to advisor’s approval) with another module (subj to instructor’s approval)

In Class Participation Discussions Scribing Presentations

Scribing Scribe notes Discuss and merge Typeset in LaTeX Post online

Presentations Read papers Present in class Answer questions

Assignments + Quizzes Quizzes Paper Reviews Survey

Zero-Tolerance for Plagiarism WARNING Zero-Tolerance for Plagiarism

CS5223 Distributed Systems Related Class CS5223 Distributed Systems Tue 6:30-8:30pm LT33 Gary Tan

Very Large Scale Distributed Systems Add “very large scale”. What are some examples?

Design Requirements

Correct

Scalable

Robust

Efficient

Simple

Secure

Design Requirements Correct Scalable Robust Efficient Simple Secure

Undesirable Characteristics

Numbers

Scattered

Dynamic

Unreliable

Untrustable

Undesirable Properties Numbers Scattered Dynamic Unreliable Untrustable

Motivating Examples

DNS (lookup)

P2P File Sharing (lookup, storage)

VoD (multicast)

MMORPG (global states)

Network Management (data collection)

Olympics News Alert (event notification)

Operations Lookup Multicast Data Collection Storage Event Notifications :

Standard Techniques

(or some form of Hierarchy) Build a Tree (or some form of Hierarchy)

Build a Mesh/Graph (or some structure)

Gossip (send to random nodes)

Flood (send to everyone)