1 Enabling Contribution Awareness in an Overlay Broadcasting System Yu-Wei (Eric) Sung Michael Bishop, Sanjay Rao School of ECE SIGCOMM, Pisa, September.

Slides:



Advertisements
Similar presentations
Layered Video for Incentives in P2P Live Streaming
Advertisements

Opportunities and Challenges of Peer-to-Peer Internet Video Broadcast Speaker: Shao-Fen Chou Adivisor: Dr. Ho-Ting Wu 11/14/
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Peer-to-Peer Streaming.
Layered Peer-to-Peer Streaming Yi Cui, Klara Nahrstedt Department of Computer Science University of Illinois at Urbana-Champaign Source International Workshop.
CONFIDENTIAL©2008 MEDIAMELON, INC. DCIA PRESENTATION Kumar Subramanian
1 Nazanin Magharei, Reza Rejaie University of Oregon INFOCOM 2007 PRIME: P2P Receiver-drIven MEsh based Streaming.
TDK - Team Distributed Koders Distributed Systems I Team Report II 1/24/07 Team Members: Kumar Keswani John Kaeuper Jason Winnebeck Fairness in P2P Streaming.
MMCN 19 Jan 2005 Ooi Wei Tsang Peer-to-Peer Streaming.
Natural Selection in Peer-to-Peer Streaming: From the Cathedral to the Bazaar Vivek Shrivastava, Suman Banerjee University of Wisconsin-Madison, USA ACM.
1 Considering Priority in Overlay Multicast Protocols under Heterogeneous Environments Michael Bishop, Sanjay Rao – Purdue University Kunwadee Sripanidkulchai.
Resilient Peer-to-Peer Streaming Paper by: Venkata N. Padmanabhan Helen J. Wang Philip A. Chou Discussion Leader: Manfred Georg Presented by: Christoph.
Forwarding Redundancy in Opportunistic Mobile Networks: Investigation and Elimination Wei Gao 1, Qinghua Li 2 and Guohong Cao 3 1 The University of Tennessee,
1 EGOIST Overlay Routing using Selfish Neighbor Selection Georgios Smaragdakis Joint work with Vassilis Lekakis, Nikos Laoutaris, Azer Bestavros, John.
Receiver-driven Layered Multicast S. McCanne, V. Jacobsen and M. Vetterli SIGCOMM 1996.
CStream: Neighborhood Bandwidth Aggregation For Better Video Streaming Thangam Vedagiri Seenivasan Advisor: Mark Claypool Reader: Robert Kinicki 1 M.S.
Measurement-Based Optimization Techniques for Bandwidth-Demanding Peer-to- Peer Systems T. S. Eugene Ng, Yang-hua Chu, Sanjay G. Rao, Kunwadee Sripanidkulchai.
Scalable Application Layer Multicast Suman Banerjee Bobby Bhattacharjee Christopher Kommareddy ACM SIGCOMM Computer Communication Review, Proceedings of.
1 Enabling Contribution Awareness in an Overlay Broadcasting System ACM SIGCOMM 2006 Presented by He Yuan.
P2PC AST : A Peer-to-Peer Multi-Cast Scheme for Streaming Data Antonio NICOLOSI New York University Siddhartha ANNAPUREDDY.
Issues in Offering Live P2P Streaming Service to Residential Users Nazanin Magharei, *Yang Guo, and Reza Rejaie Dept. of Computer and Information Science.
Application Layer Multicast
1March -05 Jiangchuan Liu with Xinyan Zhang, Bo Li, and T.S.P.Yum Infocom 2005 CoolStreaming/DONet: A Data-Driven Overlay Network for Peer-to-Peer Live.
Understanding Mesh-based Peer-to-Peer Streaming Nazanin Magharei Reza Rejaie.
CS218 – Final Project A “Small-Scale” Application- Level Multicast Tree Protocol Jason Lee, Lih Chen & Prabash Nanayakkara Tutor: Li Lao.
6/28/2015Reza Rejaie INFOCOM 07 1 Nazanin Magharei, Reza Rejaie University of Oregon PRIME: P2P Receiver-drIven MEsh based.
Scalable Live Video Streaming to Cooperative Clients Using Time Shifting and Video Patching Meng Guo and Mostafa H. Ammar INFOCOM 2004.
PPCast: A Peer-to-Peer based Video broadcast solution Presented by Shi Lu Feb. 28, 2006.
Peter Parnes, CDT1/22 Media Scaling of IP-Multicast Streams in Heterogeneous Networks Peter Parnes LTU-CDT/Marratech Roxy Workshop Media Scaling.
GnuStream: a P2P Media Streaming Prototype Xuxian Jiang, Yu Dong, Dongyan Xu, and Bharat Bhargava.
Purdue University - Infocom Enabling Confidentiality of Data Delivery in an Overlay Broadcasting System Ruben Torres, Xin Sun, Aaron Walters, Cristina.
Department of Computer Science & Engineering The Chinese University of Hong Kong Constructing Robust and Resilient Framework for Cooperative Video Streaming.
Locality-Aware Content Distribution Danny Bickson, Dahlia Malkhi, David Rabinowitz.
Receiver-driven Layered Multicast Paper by- Steven McCanne, Van Jacobson and Martin Vetterli – ACM SIGCOMM 1996 Presented By – Manoj Sivakumar.
Exploring VoD in P2P Swarming Systems By Siddhartha Annapureddy, Saikat Guha, Christos Gkantsidis, Dinan Gunawardena, Pablo Rodriguez Presented by Svetlana.
Bullet: High Bandwidth Data Dissemination Using an Overlay Mesh.
CPS 214 Computer Networks and Distributed Systems
1 Optimal Multicast Smoothing of Streaming Video over an Internetwork S. Sen, D. Towsley, Z-L. Zhang, J. Dey
Overcast: Reliable Multicasting with an Overlay Network CS294 Paul Burstein 9/15/2003.
1 Towards Cinematic Internet Video-on-Demand Bin Cheng, Lex Stein, Hai Jin and Zheng Zhang HUST and MSRA Huazhong University of Science & Technology Microsoft.
Overlay Network Physical LayerR : router Overlay Layer N R R R R R N.
CPSC 441: Multimedia Networking1 Outline r Scalable Streaming Techniques r Content Distribution Networks.
Resilient Peer-to-Peer Streaming Presented by: Yun Teng.
Higashino Lab. Maximizing User Gain in Multi-flow Multicast Streaming on Overlay Networks Y.Nakamura, H.Yamaguchi and T.Higashino Graduate School of Information.
Secure Group Communication: Key Management by Robert Chirwa.
Streaming over Subscription Overlay Networks Department of Computer Science Iowa State University.
Live Streaming over Subscription Overlay Networks CS587x Lecture Department of Computer Science Iowa State University.
Tony McGregor RIPE NCC Visiting Researcher The University of Waikato DAR Active measurement in the large.
A Framework for Internetworking Heterogeneous High-Performance Networks via GMPLS and Web Services Xi Yang, Tom Lehman Information Sciences Institute (ISI)
Hybrid Cellular-Ad hoc Data Network Shuai Zhang, Ziwen Zhang, Jikai Yin.
Quantitative Evaluation of Unstructured Peer-to-Peer Architectures Fabrício Benevenuto José Ismael Jr. Jussara M. Almeida Department of Computer Science.
Enabling Conferencing Applications on the Internet using an Overlay Multicast Architecture Yang-hua Chu, Sanjay Rao, Srini Seshan and Hui Zhang Carnegie.
PRIME: P2P Receiver-drIven MEsh based Streaming Nazanin Magharei, Reza Rejaie University of Oregon Presenter Jungsik Yoon.
On the Optimal Scheduling for Media Streaming in Data-driven Overlay Networks Meng ZHANG with Yongqiang XIONG, Qian ZHANG, Shiqiang YANG Globecom 2006.
A Utility-based Approach to Scheduling Multimedia Streams in P2P Systems Fang Chen Computer Science Dept. University of California, Riverside
Global Internet 2005 A Comparative Study of Multicast Protocols: Top, Bottom, or In the Middle? Li Lao (UCLA), Jun-Hong Cui (UCONN) Mario Gerla (UCLA),
Peer-to-Peer Result Dissemination in High-Volume Data Filtering Shariq Rizvi and Paul Burstein CS 294-4: Peer-to-Peer Systems.
Approved for Public Release; Distribution Unlimited. Case Number: , © 2006 The MITRE Corporation. All rights reserved Characterization Framework.
CoopNet: Cooperative Networking
Inside the New Coolstreaming: Principles, Measurements and Performance Implications Bo Li, Susu Xie, Yang Qu, Gabriel Y. Keung, Chuang Lin, Jiangchuan.
Design and Implementation of Overlay Multicast Tree Protocol June 17 th Jeonghun Noh Eric Setton Professor Bernd Girod Design and Implementation.
1 FairOM: Enforcing Proportional Contributions among Peers in Internet-Scale Distributed Systems Yijun Lu †, Hong Jiang †, and Dan Feng * † University.
Using Rhythmic Nonces for Puzzle-Based DoS Resistance Ellick M. Chan, Carl A. Gunter, Sonia Jahid, Evgeni Peryshkin, and Daniel Rebolledo University of.
© 2006 Andreas Haeberlen, MPI-SWS 1 Monarch: A Tool to Emulate Transport Protocol Flows over the Internet at Large Andreas Haeberlen MPI-SWS / Rice University.
Managing Data Transfer in Computer Clusters with Orchestra
Server Allocation for Multiplayer Cloud Gaming
EECS 582 Final Review Mosharaf Chowdhury EECS 582 – F16.
TDK - Team Distributed Koders Distributed Systems I
Overlay Networking Overview.
Aditya Ganjam, Bruce Maggs*, and Hui Zhang
Enabling Contribution Awareness in an Overlay Broadcasting System
Presentation transcript:

1 Enabling Contribution Awareness in an Overlay Broadcasting System Yu-Wei (Eric) Sung Michael Bishop, Sanjay Rao School of ECE SIGCOMM, Pisa, September 14, 2006

2 Video Broadcast using Overlay Multicast Tokyo LA San Francisco Boston NYC Pisa Tokyo NYC LA Boston San Francisco Pisa Encoder A/V Signal Overlay Tree Ethernet DSL E D E E D D D E

3 State-of-Art in Overlay Multicast Key successes already achieved –Architecture Validation and Protocol Design Narada, Yoid, Overcast, NICE, SplitStream, ALMI, CoopNet, Bullet… –Significant progress on scaling, resiliency –Real Deployments Tmesh (Michigan), CoolStreaming (HK), ESM (CMU) Much success to date: –Homogeneous environments with abundant bandwidths Can we go further? Is overlay multicast feasible in mainstream Internet environments?

4 Focus of This Paper Heterogeneity in node upload/forwarding bandwidth: –Upload access bandwidth varies widely –Hosts may choose to forward differently Resource-scarce –E.g. 80% DSL/Cable modem, 20% Ethernet, Src Rate : 300Kbps –Insufficient resources to provide full source rate to all receivers Critical problem: not received enough attention DownloadUpload DSL Kbps64-256Kbps Cable 1-6Mbps Kbps Ethernet ≥ 10Mbps Bandwidth Resources

5 Key Contributions Comprehensive solution to enable overlay broadcasting in resource-scarce, heterogeneous environments Implementation on top of an operational broadcasting system Internet study using traces from operational deployments

6 Talk Outline Application Framework and System Design –Distributed bandwidth allocation policy –Multi-tree overlay structure Experimental Methodology Important Results Summary

7 How to allocate bandwidth? Host i “contributes/forwards” f i : – Bandwidth actually served to children in the broadcast – May be less than access bandwidth How much bandwidth r i should host i receive? Simple policy: bit-for-bit  r i = f i, inadequate since –Resource-rich host can contribute more than src rate –Resource-poor hosts are constrained by their upload bandwidth.

8 Our Approach Provide support for bandwidth allocation policies –More generic than bit-for-bit –Amenable to distributed implementation –Differential and Equitable Distribution r i = α × f i + ( 1–α ) × ( avg f ) –Motivated by recent work on linear taxation [Sigcomm 04 PINS workshop] Entitled bandwidth 0 < α < 1 Contribution ∑ f j / N j

9 Multiple Overlay Trees [Coopnet,SplitStream] Source Peer A Peer C S/3 With support from MDC, split into T-equally sized stripes T trees, each distributes a single stripe of size S/T Overall quality depends on the number of stripes received Number of trees node i is entitled to = S Kbps Tree 1 Tree 3 Tree 2

10 Entitled Bandwidth: Example S=400Kbps, T=4, S/T=100Kbps, f E =500Kbps, f D =100Kbps, avg f =300Kbps,α=0.5 –r E =0.5* *300=400Kbps  entitled to 4 trees –r D =0.5* *300=200Kbps  entitled to 2 trees Source E E E E D D 100Kbps

11 Excess Bandwidth Source E E E ED D En. node 100Kbps D D Unused bandwidth may still exist after peers receive their entitled bandwidth –When found: Excess Bandwidth Peer D: entitled to 2 trees, excess in other trees

12 Key Design Issues Entitled Bandwidth Computation r i = α × f i + ( 1–α ) × ( avg f ) –Distributed global state sampling –Smoothing entitled bandwidth Excess Bandwidth Discovery –Fair distribution while minimizing oscillation –Achieved by active probes with Backoff, Prioritization

13 Evaluation Goals How effective are these heuristics in providing incentives? –Bandwidth How stable is the resulting system? –Time between tree reductions –Reconnection time

14 Evaluation Methodology Playback 20-min segments of real traces on Planetlab: Use Slashdot to evaluate 2 systems: –Cont-Agnostic: multi-tree broadcast system –Cont-Aware: multi-tree + contribution-aware heuristics S=400Kbps, T=4, stripe size S/T=100Kbps –2 types of peers: Ethernet f max ≤ 800Kbps, DSL f max ≤ 100Kbps –HC: Kbps, LC: Kbps Broadcast EventDSL (100Kbps) Ethernet (10Mbps) Peak Group Size SIGCOMM200248%52%78 SOSP200348%52%54 Rally75%25%481 Slashdot73%27%158 GrandChallenge82%18%276 Mainstream Internet Conferences

15 Performance: High Contributors SystemMeanStd. Dev Cont-Agnostic Cont-Aware Better Cont-Aware gives HC better performance

16 Performance: Low Contributors SystemMeanStd. Dev Cont-Agnostic Cont-Aware Similar performance among similar contributors Better

17 Stability Time between Tree Reductions –Cont-Aware performs slightly worse –Reductions => slight dips in quality Not complete disconnection, 63.4% from 4  3, 34.1% from 3  2, only 2.5% from 2  1 and 1  0 Reconnection time (in sec) Cont-AwareCont-Agnostic HC LC Overall

18 Performance across traces for high contributors

19 Summary Focus: Video broadcasting in resource-scarce, heterogeneous environments Comprehensive solution to address this challenge –Leverages two key ideas: Multi-trees and Linear Taxation –Implemented on top of an operational Broadcast System –Internet study using traces from operational deployments Key step to extend overlay broadcasting in mainstream Internet environments Future work: exploration of resource allocation policies, cheating of nodes, detecting node capabilities.

20 Thank you! Questions?