Replica Placement Heuristics of Application-level Multicast

Slides:



Advertisements
Similar presentations
Dynamic Replica Placement for Scalable Content Delivery Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy, EECS Department.
Advertisements

Scheduling in Web Server Clusters CS 260 LECTURE 3 From: IBM Technical Report.
P2P data retrieval DHT (Distributed Hash Tables) Partially based on Hellerstein’s presentation at VLDB2004.
Peer-to-Peer Systems Chapter 25. What is Peer-to-Peer (P2P)? Napster? Gnutella? Most people think of P2P as music sharing.
Research: Group communication in distributed interactive applications Student: Knut-Helge Vik Institute: University of Oslo, Simula Research Labs.
LOAD BALANCING IN A CENTRALIZED DISTRIBUTED SYSTEM BY ANILA JAGANNATHAM ELENA HARRIS.
Common approach 1. Define space: assign random ID (160-bit) to each node and key 2. Define a metric topology in this space,  that is, the space of keys.
Receiver-driven Layered Multicast S. McCanne, V. Jacobsen and M. Vetterli SIGCOMM 1996.
Spring 2003CS 4611 Content Distribution Networks Outline Implementation Techniques Hashing Schemes Redirection Strategies.
SCAN: A Dynamic, Scalable, and Efficient Content Distribution Network Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy,
1 Data Persistence in Large-scale Sensor Networks with Decentralized Fountain Codes Yunfeng Lin, Ben Liang, Baochun Li INFOCOM 2007.
Beneficial Caching in Mobile Ad Hoc Networks Bin Tang, Samir Das, Himanshu Gupta Computer Science Department Stony Brook University.
Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang IEEE Transactions on Multimedia, Vol. 6, No. 2, April.
Efficient Content Location Using Interest-based Locality in Peer-to-Peer Systems Presented by: Lin Wing Kai.
Quantitative Characterization of Denial of Service Attacks: A Case Study of Location Services Adam Bargteil David Bindel Yan Chen.
Scalable Adaptive Data Dissemination Under Heterogeneous Environment Yan Chen, John Kubiatowicz and Ben Zhao UC Berkeley.
Distributed Token Circulation in Mobile Ad Hoc Networks Navneet Malpani, Intel Corp. Nitin Vaidya, Univ. Illinois Urbana-Champaign Jennifer Welch, Texas.
Performance Evaluation of Peer-to-Peer Video Streaming Systems Wilson, W.F. Poon The Chinese University of Hong Kong.
1 Load Balance and Efficient Hierarchical Data-Centric Storage in Sensor Networks Yao Zhao, List Lab, Northwestern Univ Yan Chen, List Lab, Northwestern.
Freenet A Distributed Anonymous Information Storage and Retrieval System I Clarke O Sandberg I Clarke O Sandberg B WileyT W Hong.
SomeCast A Paradigm for Real-Time Adaptive Reliable Multicast Presented by: Ibrahim Matta IEEE Real-Time Technology and Applications Symposium (RTAS ‘2000),
Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang, and Ya-Qin Zhang IEEE TRANSACTIONS ON MULTIMEDIA,
1 Load Balance and Efficient Hierarchical Data-Centric Storage in Sensor Networks Yao Zhao, List Lab, Northwestern Univ Yan Chen, List Lab, Northwestern.
An Active Reliable Multicast Framework for the Grids M. Maimour & C. Pham ICCS 2002, Amsterdam Network Support and Services for Computational Grids Sunday,
Storage management and caching in PAST PRESENTED BY BASKAR RETHINASABAPATHI 1.
Achieving Load Balance and Effective Caching in Clustered Web Servers Richard B. Bunt Derek L. Eager Gregory M. Oster Carey L. Williamson Department of.
ICS362 Distributed Systems Dr Ken Cosh Week 5. Review Communication – Fundamentals – Remote Procedure Calls (RPC) – Message Oriented Communication – Stream.
Google File System Simulator Pratima Kolan Vinod Ramachandran.
Overcast: Reliable Multicasting with an Overlay Network CS294 Paul Burstein 9/15/2003.
1 BitHoc: BitTorrent for wireless ad hoc networks Jointly with: Chadi Barakat Jayeoung Choi Anwar Al Hamra Thierry Turletti EPI PLANETE 28/02/2008 MAESTRO/PLANETE.
Jonathan Walpole CSE515 - Distributed Computing Systems 1 Teaching Assistant for CSE515 Rahul Dubey.
Using the Small-World Model to Improve Freenet Performance Hui Zhang Ashish Goel Ramesh Govindan USC.
Segment-Based Proxy Caching of Multimedia Streams Authors: Kun-Lung Wu, Philip S. Yu, and Joel L. Wolf IBM T.J. Watson Research Center Proceedings of The.
1 On the Placement of Web Server Replicas Lili Qiu, Microsoft Research Venkata N. Padmanabhan, Microsoft Research Geoffrey M. Voelker, UCSD IEEE INFOCOM’2001,
Distributed Session Announcement Agents for Real-time Streaming Applications Keio University, Graduate School of Media and Governance Kazuhiro Mishima.
Ion Stoica, Robert Morris, David Karger, M. Frans Kaashoek, Hari Balakrishnan MIT and Berkeley presented by Daniel Figueiredo Chord: A Scalable Peer-to-peer.
A Routing Underlay for Overlay Networks Akihiro Nakao Larry Peterson Andy Bavier SIGCOMM’03 Reviewer: Jing lu.
1 On the Placement of Web Server Replicas Lili Qiu, Microsoft Research Venkata N. Padmanabhan, Microsoft Research Geoffrey M. Voelker, UCSD IEEE INFOCOM’2001,
An IP Address Based Caching Scheme for Peer-to-Peer Networks Ronaldo Alves Ferreira Joint work with Ananth Grama and Suresh Jagannathan Department of Computer.
Fast Crash Recovery in RAMCloud. Motivation The role of DRAM has been increasing – Facebook used 150TB of DRAM For 200TB of disk storage However, there.
Fault Tolerance in CORBA and Wireless CORBA Chen Xinyu 18/9/2002.
Plethora: Infrastructure and System Design. Introduction Peer-to-Peer (P2P) networks: –Self-organizing distributed systems –Nodes receive and provide.
On Reducing Mesh Delay for Peer- to-Peer Live Streaming Dongni Ren, Y.-T. Hillman Li, S.-H. Gary Chan Department of Computer Science and Engineering The.
Content caching and scheduling in wireless networks with elastic and inelastic traffic Group-VI 09CS CS CS30020 Performance Modelling in Computer.
Peer to Peer Network Design Discovery and Routing algorithms
CS 6401 Overlay Networks Outline Overlay networks overview Routing overlays Resilient Overlay Networks Content Distribution Networks.
Topologically-Aware Overlay Construction and Sever Selection Sylvia Ratnasamy, Mark Handley, Richard Karp, Scott Shenker.
Two Peer-to-Peer Networking Approaches Ken Calvert Net Seminar, 23 October 2001 Note: Many slides “borrowed” from S. Ratnasamy’s Qualifying Exam talk.
P2P Search COP P2P Search Techniques Centralized P2P systems  e.g. Napster, Decentralized & unstructured P2P systems  e.g. Gnutella.
Large Scale Sharing Marco F. Duarte COMP 520: Distributed Systems September 19, 2004.
1 Low Latency Multimedia Broadcast in Multi-Rate Wireless Meshes Chun Tung Chou, Archan Misra Proc. 1st IEEE Workshop on Wireless Mesh Networks (WIMESH),
On the Placement of Web Server Replicas Yu Cai. Paper On the Placement of Web Server Replicas Lili Qiu, Venkata N. Padmanabhan, Geoffrey M. Voelker Infocom.
System Models Advanced Operating Systems Nael Abu-halaweh.
Yiting Xia, T. S. Eugene Ng Rice University
Accelerating Peer-to-Peer Networks for Video Streaming
Internet Indirection Infrastructure (i3)
Introduction to Load Balancing:
A Study of Group-Tree Matching in Large Scale Group Communications
Mohammad Malli Chadi Barakat, Walid Dabbous Alcatel meeting
NTHU CS5421 Cloud Computing
Plethora: Infrastructure and System Design
VDN: Virtual Machine Image Distribution Network for Cloud Data Centers
Early Measurements of a Cluster-based Architecture for P2P Systems
SCOPE: Scalable Consistency in Structured P2P Systems
Providing Secure Storage on the Internet
CIS679: Anycast Review of Last lecture Anycast.
QuaSAQ: Enabling End-to-End QoS for Distributed Multimedia Databases
Group Based Management of Distributed File Caches
Dynamic Replica Placement for Scalable Content Delivery
Performance-Robust Parallel I/O
Presentation transcript:

Replica Placement Heuristics of Application-level Multicast Chia-Hsing Yu Jiahua He CSE of UCSD

Project Presentation of CSE 222A Outline Multicast and RMX Model and Heuristics Simulation and Results Conclusion and Future Work 2019/4/8 Project Presentation of CSE 222A

Application-level Multicast Goal Distribute Contents to Many Clients Problem How to reduce the load of the central server? How to reduce the response time of requests? Replication at different servers 2019/4/8 Project Presentation of CSE 222A

RMX: Reliable Multicast proXy TCP SRM: Reliable IP Multicast 2019/4/8 Project Presentation of CSE 222A

Project Presentation of CSE 222A RMX Semantic reliability information  representation of information Sender can lower the stream resolution if the network load is heavy 2019/4/8 Project Presentation of CSE 222A

Project Presentation of CSE 222A Existing Problems Only sources, no replicas No request, only recovery request Static RMXs in network Static configuration of data groups 2019/4/8 Project Presentation of CSE 222A

Project Presentation of CSE 222A Related works Replication in unstructured P2P (Princeton) Owner, Path, Random PAST(Microsoft and Rice) Nodes with similar id’s OceanStore (Berkeley) On or near the clients Focus on persistent storage with versions Chain (Cornell) Machines with replicas of a same file form a chain Focus on availability 2019/4/8 Project Presentation of CSE 222A

Project Presentation of CSE 222A Model and Heuristics Fixed sources and dynamic replicas Streaming multicast on demand No replication Baseline Replication on path FIFO LRU Color 2019/4/8 Project Presentation of CSE 222A

Project Presentation of CSE 222A Baseline Only sources, no replicas Learning bridge scheme to search Learn routing information from incoming data Soft state: periodically refresh Request suppression Ideal condition: no loss 2019/4/8 Project Presentation of CSE 222A

Project Presentation of CSE 222A FIFO and LRU Replication on path Broadcast to search FIFO: Remove the oldest one if no space LRU: Order the files by last usage 2019/4/8 Project Presentation of CSE 222A

Project Presentation of CSE 222A Color Graph coloring Neighbors with different colors (files) from mine Can get more different files from neighbors Remove the file with nearest replica Visiting Frequency More frequently visited, more possible to be visited Cost function: dist * freq dist: distance to the nearest replica freq: visiting frequency Upper bound of the cost if removed 2019/4/8 Project Presentation of CSE 222A

Project Presentation of CSE 222A Simulator Event-driven Simulator New Event New Event New Event Event Handler Min Heap Earliest Event 2019/4/8 Project Presentation of CSE 222A

Project Presentation of CSE 222A Simulator(2) Stream-level Simulation SIM_SEND_STREAM( bit rate, length ) Input Network Topology Host Resources Stream Sources User Requests 2019/4/8 Project Presentation of CSE 222A

Experiment Configuration Network Topology Binary Tree Host Resources 127 hosts (data groups) Hard disk size variable Stream Sources 1270 sources (average 10 per host) 500 Kbps, 8000 seconds each Randomly distributed User Request Total number variable Experiment Span 100 hours 2019/4/8 Project Presentation of CSE 222A

Experiment Configuration (2) Variances Number of requests: 211 ~ 218 Hard disk size: 8G ~ 128G Metrics Client view average response time Server view load (number of streams per RMX) load balance (standard deviation of load) System view throughput 2019/4/8 Project Presentation of CSE 222A

Client View Avg. Response Time vs. # of Requests About 30% improvement 2019/4/8 Project Presentation of CSE 222A

Client View Avg. Response Time vs. Disk Size Disk size outperforms replication strategy 2019/4/8 Project Presentation of CSE 222A

Server View Avg. # of Streams vs. # of Requests About 50% improvement 2019/4/8 Project Presentation of CSE 222A

Server View S.D. # of Streams vs. # of Requests About 50% improvement 2019/4/8 Project Presentation of CSE 222A

Server View Avg. # of Streams vs. Disk Size Disk size outperforms replication strategy 2019/4/8 Project Presentation of CSE 222A

Server View S.D. # of Streams vs. Disk Size Disk size outperforms replication strategy 2019/4/8 Project Presentation of CSE 222A

System View Throughput vs. # Requests About 25% improvement 2019/4/8 Project Presentation of CSE 222A

System View Throughput vs. Disk Size Upper bound 25.4398 System View Throughput vs. Disk Size 2019/4/8 Project Presentation of CSE 222A

Project Presentation of CSE 222A Contributions Implement and analyze Baseline, FIFO, LRU algs Propose and verify Color heuristics Avg. response time: up to 30% improvement Load: up to 50% improvement Load balance: up to 50% improvement Throughput: up to 25% improvement 2019/4/8 Project Presentation of CSE 222A

Project Presentation of CSE 222A Future Works Biased requests Heterogeneous environment (hosts, links, streams) Random forward More sophisticated heuristics Experiment in real environment 2019/4/8 Project Presentation of CSE 222A