NUS.SOC.CS5248 Ooi Wei Tsang 1 CS6282 Very Large Scale Distributed Systems Ooi Wei Tsang SOC1-04-20

Slides:

Advertisements

Similar presentations

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Peer-to-Peer Streaming.

Advertisements

Building Cloud-ready Video Transcoding System for Content Delivery Networks(CDNs) Zhenyun Zhuang and Chun Guo Speaker: 饒展榕.

Using the IDEA Student Ratings System: An Introduction University of Saint Thomas Fall

Resilient Peer-to-Peer Streaming Paper by: Venkata N. Padmanabhan Helen J. Wang Philip A. Chou Discussion Leader: Manfred Georg Presented by: Christoph.

Search Engines and Information Retrieval

Eddie Bortnikov/Aran Bergman, Principles of Reliable Distributed Systems, Technion EE, Spring Principles of Reliable Distributed Systems Recitation.

Self-Correlating Predictive Information Tracking for Large-Scale Production Systems Zhao, Tan, Gong, Gu, Wambolt Presented by: Andrew Hahn.

NUS.SOC.CS Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media.

Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek and Hari alakrishnan.

CS300 Planning and Executing a Project Terry Hinton Helen Treharne.

Object Naming & Content based Object Search 2/3/2003.

Research Trends in Software Engineering – CS661 Shafay Shamail Malik Jahan Khan.

What Can Databases Do for Peer-to-Peer Steven Gribble, Alon Halevy, Zachary Ives, Maya Rodrig, Dan Suciu Presented by: Ryan Huebsch CS294-4 P2P Systems.

Project Management Take a Tour of the Online Course.

ADVANCE MOBILE TECHNOLOGY & NETWORKING Course Content.

Civil Engineering Applications of GIS. Reg Souleyrette, Ph.D., P.E. Eric R. Green, GISP, PE, MSCE Tony Fields, GIS Analyst.

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Application-Level Multicast.

Project Proposal Secure Web Access for Tests.  Professors, instructors, and teachers use websites to teach and post data for students to study. If these.

Efficient and Robust Query Processing in Dynamic Environments Using Random Walk Techniques Chen Avin Carlos Brito.

CS223 Algorithms D-Term 2013 Instructor: Mohamed Eltabakh WPI, CS Introduction Slide 1.

Exploring VoD in P2P Swarming Systems By Siddhartha Annapureddy, Saikat Guha, Christos Gkantsidis, Dinan Gunawardena, Pablo Rodriguez Presented by Svetlana.

Search Engines and Information Retrieval Chapter 1.

Educational Media Creation Center: EMCC March 15, Educational Media Creation Center EMCC Mike Barker Manager, EMCC

An Architecture for Video Surveillance Service based on P2P and Cloud Computing Yu-Sheng Wu, Yue-Shan Chang, Tong-Ying Juang, Jing-Shyang Yen speaker:

Break Dengue in a Nutshell. WHAT WE WILL DO? Joint all forces against Dengue Leverage the power of social movements Be a pilot for other NTD fighting.

Advanced Computer Networks by Behzad Akbari Spring 2011 In the Name of the Most High.

1 Commissioned by PAMSA and German Technical Co-Operation National Certificate in Paper & Pulp Manufacturing NQF Level 3 Collect and use data to establish.

DISTRIBUTED SYSTEMS Principles and Paradigms Second Edition ANDREW S

1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.

The Auditor Role The auditor has the same view of the course as the student does, but no marks are recorded for auditors.

NUS.SOC.CS Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media.

Efficient P2P Searches Using Result-Caching From U. of Maryland. Presented by Lintao Liu 2/24/03.

HUAWEI TECHNOLOGIES CO., LTD. Page 1 Survey of P2P Streaming HUAWEI TECHNOLOGIES CO., LTD. Ning Zong, Johnson Jiang.

1 MSc Project Yin Chen Supervised by Dr Stuart Anderson 2003 Grid Services Monitor Long Term Monitoring of Grid Services Using Peer-to-Peer Techniques.

1 System for Administration, Training, and Educational Resources for NASA Training Evaluations.

NUS.SOC.CS5248 Ooi Wei Tsang Systems Support for Continuous Media OOI WEI TSANG.

1 CS240: Network Routing Michalis Faloutsos. 2 Scope Routing Basics BGP routing Ad hoc routing Security Issues Group communications: Broadcast, Multicast.

Building a Distributed Full-Text Index for the Web by Sergey Melnik, Sriram Raghavan, Beverly Yang and Hector Garcia-Molina from Stanford University Presented.

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) 1 Proxy Caching for Streaming Media.

NUS.SOC.CS5248 Ooi Wei Tsang Course Matters. NUS.SOC.CS5248 Ooi Wei Tsang Deadlines 11 Oct: Survey Paper Due 18 Oct: Paper Reviews Due.

 Course Overview Distributed Systems IT332. Course Description  The course introduces the main principles underlying distributed systems: processes,

NUS.SOC.CS Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media.

Unit 9: Distributing Computing & Networking Kaplan University 1.

NUS.SOC.CS5248 Ooi Wei Tsang Application-Level Multicast.

1 © Xchanging 2010 no part of this document may be circulated, quoted or reproduced without prior written approval of Xchanging. MOSS Training – UI customization.

NUS.SOC.CS5248 Ooi Wei Tsang 1 Proxy Caching for Streaming Media.

Distributed Computing Systems CSCI 4780/6780. Scalability ConceptExample Centralized servicesA single server for all users Centralized dataA single on-line.

Introduction to CS739: Distribution Systems UNIVERSITY of WISCONSIN-MADISON Computer Sciences Department CS 739 Distributed Systems Andrea C. Arpaci-Dusseau.

CoopNet: Cooperative Networking

FYE Instructor Training Trainers: Julie McLaughlin and Diane Stump.

Assessing Students Online Patricia S. Rahmlow, Computer Science Instructor Montgomery County Community College Blue Bell, PA

CSCD 433/533 Advanced Computer Networks Lecture 1 Course Overview Spring 2016.

Web Design Vocabulary #3. HTML Hypertext Markup Language - The coding scheme used to format text for use on the World Wide Web.

Learning Management System. Introduction Software application or Web-based technology used to plan, implement, and assess a specific learning process.

A Practical Performance Analysis of Stream Reuse Techniques in Peer-to-Peer VoD Systems Leonardo B. Pinho and Claudio L. Amorim Parallel Computing Laboratory.

NUS.SOC.CS5248 Ooi Wei Tsang Systems Support for Continuous Media.

Live Global Sports Events

ADDIE & ASSURE Jasper (Jia) Pan Oct

CS5248: Systems Support for Continuous Media

Proxy Caching for Streaming Media

Application-Level Multicast

Overview The designer role in CE 4 has been separated into two new roles in CE6: Designer Role Instructor Role The Auditor role has been added as.

Cloud Data Anonymization Using Hadoop Map-Reduce Framework With Qos Evaluation and Behaviour analysis PROJECT GUIDE: Ms.S.Subbulakshmi TEAM MEMBERS: A.Mahalakshmi( ).

CHAPTER 3 Architectures for Distributed Systems

Course Overview - Database Systems

Connecticut Core Standards for Mathematics

CS6282 Very Large Scale Distributed Systems

A Model of Power Transmission Disturbances in Simple Systems

Distributed Hash Tables

Presentation transcript:

NUS.SOC.CS5248 Ooi Wei Tsang 1 CS6282 Very Large Scale Distributed Systems Ooi Wei Tsang SOC

Distributed Systems

Very Large Scale Distributed Systems

New technological trends lead to VLDS

Examples

P2P File Sharing

MMORPG

News Alert

Web Services

Sensor Network

Examples of VLDS P2P File Sharing MMORPG News Alert Video on Demand

Scope of CS6282 Explore basic techniques and their applications

Goal At the end of the class, students are expected to understand how to build large scale distributed systems.

Target Audience Anyone interested in distributed systems or doing related research (db, grid, sensors, media etc.)

Learning Mode I am here to light you on fire, not to fill your bucket.

Learning Mode We learn together

Activities Read Think Discuss Innovate

Continuous Assessments

Exam (20%) Open Book Essay Type

Project (50%) Individual/Pair Research Based Expect Something New

Types of Project Identify a new problem Propose a solution

Types of Project Existing Problem New Solution

Types of Project Existing Solutions New Evaluations

Types of Project Existing Solutions New Application

Types of Project Collect and Analyze Data New Insights

Project Components Define Problem Find Solution Implement Evaluate Present

Project Deliverables 8-page research paper Poster presentations

Combine Project with your current research (subj. to advisor’s approval) with another module (subj to instructor’s approval)

In Class Participation Discussions Scribing Presentations

Scribing Scribe notes Discuss and merge Typeset in LaTeX Post online

Presentations Read papers Present in class Answer questions

Assignments + Quizzes Quizzes Paper Reviews Survey

WARNING Zero-Tolerance for Plagiarism

Related Class CS5223 Distributed Systems Tue 6:30-8:30pm LT33 Gary Tan

Very Large Scale Distributed Systems

Design Requirements

Correct

Scalable

Robust

Efficient

Simple

Secure

Design Requirements Correct Scalable Robust Efficient Simple Secure

Undesirable Characteristics

Numbers

Scattered

Dynamic

Unreliable

Untrustable

Undesirable Properties Numbers Scattered Dynamic Unreliable Untrustable

Motivating Examples

DNS (lookup)

P2P File Sharing (lookup, storage)

VoD (multicast)

MMORPG (global states)

Network Management (data collection)

Olympics News Alert (event notification)

Operations Lookup Multicast Data Collection Storage Event Notifications :

Standard Techniques

Build a Tree (or some form of Hierarchy)

Build a Mesh/Graph (or some structure)

Gossip (send to random nodes)

Flood (send to everyone)