NUS.SOC.CS5248-2014 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Peer-to-Peer Streaming.

Slides:



Advertisements
Similar presentations
Dynamic Replica Placement for Scalable Content Delivery Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy, EECS Department.
Advertisements

LOGO Video Packet Selection and Scheduling for Multipath Streaming IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 9, NO. 3, APRIL 2007 Dan Jurca, Student Member,
Receiver-driven Layered Multicast S. McCanne, V. Jacobsen and M. Vetterli University of Calif, Berkeley and Lawrence Berkeley National Laboratory SIGCOMM.
SplitStream by Mikkel Hesselager Blanné Erik K. Aarslew-Jensen.
SplitStream: High- Bandwidth Multicast in Cooperative Environments Monica Tudora.
MMCN 19 Jan 2005 Ooi Wei Tsang Peer-to-Peer Streaming.
Resilient Peer-to-Peer Streaming Paper by: Venkata N. Padmanabhan Helen J. Wang Philip A. Chou Discussion Leader: Manfred Georg Presented by: Christoph.
Receiver-driven Layered Multicast S. McCanne, V. Jacobsen and M. Vetterli SIGCOMM 1996.
CStream: Neighborhood Bandwidth Aggregation For Better Video Streaming Thangam Vedagiri Seenivasan Advisor: Mark Claypool Reader: Robert Kinicki 1 M.S.
SCAN: A Dynamic, Scalable, and Efficient Content Distribution Network Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy,
ZIGZAG A Peer-to-Peer Architecture for Media Streaming By Duc A. Tran, Kien A. Hua and Tai T. Do Appear on “Journal On Selected Areas in Communications,
A New Approach for the Construction of ALM Trees using Layered Coding Yohei Okada, Masato Oguro, Jiro Katto Sakae Okubo International Conference on Autonomic.
A Comparison of Layering and Stream Replication Video Multicast Schemes Taehyun Kim and Mostafa H. Ammar.
Layered Range Multicast for Video On Demand Duc A. Tran Kien A. Hua Tai T. Do.
Network Coding for Large Scale Content Distribution Christos Gkantsidis Georgia Institute of Technology Pablo Rodriguez Microsoft Research IEEE INFOCOM.
Scalable Application Layer Multicast Suman Banerjee Bobby Bhattacharjee Christopher Kommareddy ACM SIGCOMM Computer Communication Review, Proceedings of.
Robust and Efficient Path Diversity in Application-Layer Multicast for Video Streaming Ruixiong Tian, Qian Zhang, Senior Member, IEEE, Zhe Xiang, Yongqiang.
ZIGZAG: An Efficient Peer-to-Peer Scheme for Media Streaming Duc A. Tran, Kien A. Hua, Tai Do University of Central Florida INFOCOM Twenty-Second.
CS218 – Final Project A “Small-Scale” Application- Level Multicast Tree Protocol Jason Lee, Lih Chen & Prabash Nanayakkara Tutor: Li Lao.
Scalable Live Video Streaming to Cooperative Clients Using Time Shifting and Video Patching Meng Guo and Mostafa H. Ammar INFOCOM 2004.
Chunkyspread: Multi-tree Unstructured Peer to Peer Multicast Vidhyashankar Venkataraman (Vidhya) Paul Francis (Cornell University) John Calandrino (University.
Peter Parnes, CDT1/22 Media Scaling of IP-Multicast Streams in Heterogeneous Networks Peter Parnes LTU-CDT/Marratech Roxy Workshop Media Scaling.
Deliver Multimedia Streams with Flexible QoS via a Multicast DAG Yu Cai 02/26/2004.
Nearcast: A Locality-Aware P2P Live Streaming Approach for Distance Education XUPING TU, HAI JIN, and XIAOFEI LIAO Huazhong University of Science and Technology.
Nus.soc.cs5248 Ooi Wei Tsang Recent Papers from conferences.
# Idowu Samuel O. # Kashif Shahzad # Arif Kamal M7001E - Multimedia systems [ltu.se] ©2011.
CS Spring 2009 CS 414 – Multimedia Systems Design Lecture 24 – P2P Streaming Klara Nahrstedt Ramsés Morales.
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Application-Level Multicast.
Exploring VoD in P2P Swarming Systems By Siddhartha Annapureddy, Saikat Guha, Christos Gkantsidis, Dinan Gunawardena, Pablo Rodriguez Presented by Svetlana.
Bullet: High Bandwidth Data Dissemination Using an Overlay Mesh.
ON DESIGING END-USER MULTICAST FOR MULTIPLE VIDEO SOURCES Y.Nakamura, H.Yamaguchi, A.Hiromori, K.Yasumoto †, T.Higashino and K.Taniguchi Osaka University.
1 Optimal Multicast Smoothing of Streaming Video over an Internetwork S. Sen, D. Towsley, Z-L. Zhang, J. Dey
Overcast: Reliable Multicasting with an Overlay Network CS294 Paul Burstein 9/15/2003.
Resilient Peer-to-Peer Streaming Presented by: Yun Teng.
Higashino Lab. Maximizing User Gain in Multi-flow Multicast Streaming on Overlay Networks Y.Nakamura, H.Yamaguchi and T.Higashino Graduate School of Information.
Tsunami: Maintaining High Bandwidth Under Dynamic Network Conditions Dejan Kostić, Ryan Braud, Charles Killian, Eric Vandekieft, James W. Anderson, Alex.
Streaming over Subscription Overlay Networks Department of Computer Science Iowa State University.
NUS.SOC.CS5248 Ooi Wei Tsang Previously, on CS5248..
Overcast: Reliable Multicasting with an Overlay Network Paper authors: Jannotti, Gifford, Johnson, Kaashoek, O’Toole Jr. Slides by Chris Johnstone.
Fair Layered Coding Streaming Jaime García-Reinoso  Iván Vidal  Francisco Valera University Carlos III of Madrid Alex Bikfalvi IMDEA Networks.
Paper # – 2009 A Comparison of Heterogeneous Video Multicast schemes: Layered encoding or Stream Replication Authors: Taehyun Kim and Mostafa H.
Peer-to-Peer Network Tzu-Wei Kuo. Outline What is Peer-to-Peer(P2P)? P2P Architecture Applications Advantages and Weaknesses Security Controversy.
Peer-Assisted Content Distribution Pablo Rodriguez Christos Gkantsidis.
2007/03/26OPLAB, NTUIM1 A Proactive Tree Recovery Mechanism for Resilient Overlay Network Networking, IEEE/ACM Transactions on Volume 15, Issue 1, Feb.
A Utility-based Approach to Scheduling Multimedia Streams in P2P Systems Fang Chen Computer Science Dept. University of California, Riverside
A Membership Management Protocol for Mobile P2P Networks Mohamed Karim SBAI, Emna SALHI, Chadi BARAKAT.
LightFlood: An Efficient Flooding Scheme for File Search in Unstructured P2P Systems Song Jiang, Lei Guo, and Xiaodong Zhang College of William and Mary.
NUS.SOC.CS5248 Ooi Wei Tsang Course Matters. NUS.SOC.CS5248 Ooi Wei Tsang Deadlines 11 Oct: Survey Paper Due 18 Oct: Paper Reviews Due.
NUS.SOC.CS5248 Ooi Wei Tsang Application-Level Multicast.
On Reducing Mesh Delay for Peer- to-Peer Live Streaming Dongni Ren, Y.-T. Hillman Li, S.-H. Gary Chan Department of Computer Science and Engineering The.
RELIABLE APPLICATION LAYER MULTICAST OVER COMBINED WIRED AND WIRELESS NETWORKS AUTHORS - MASAHIRO KOBAYASHI, MEMBER, IEEE, HIDEHISA NAKAYAMA, MEMBER, IEEE,
A P2P On-Demand Video Streaming System with Multiple Description Coding Yanming Shen, Xiaofeng Xu, Shivendra Panwar, Keith Ross, Yao Wang Polytechnic University.
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Rate Adaptations.
CS 6401 Overlay Networks Outline Overlay networks overview Routing overlays Resilient Overlay Networks Content Distribution Networks.
CoopNet: Cooperative Networking
1 FairOM: Enforcing Proportional Contributions among Peers in Internet-Scale Distributed Systems Yijun Lu †, Hong Jiang †, and Dan Feng * † University.
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Application-Level Multicast.
Proxy Caching for Streaming Media
Application-Level Multicast
Error Recovery.
Rate Adaptations.
Video On Demand.
TDK - Team Distributed Koders Distributed Systems I
Ying Qiao Carleton University Project Presentation at the class:
Peer-to-Peer Streaming: An Hierarchical Approach
An Overview of Peer-to-Peer
EE 122: Lecture 22 (Overlay Networks)
Design and Implementation of OverLay Multicast Tree Protocol
Jeonghun Noh Sachin Deshpande* Information Systems Laboratory
Presentation transcript:

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Peer-to-Peer Streaming

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Peer-to-Peer Streaming A type of application-level multicast But packets are forwarded by end- host (not proxies)

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Peer-to-Peer Streaming ALM with end-hosts as forwarders S Video Server End Host Overlay Links

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Issues with P2P Streaming Depends on peers to forward packets, but peers can fail/leave anytime S

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) CoopNet Resilient Peer-to-Peer Streaming, V. Padmanabhan et. al. ICNP 2003

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Idea Split video into k “parts”, send one part along one tree

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) “Smart” Splitting A node may be able to reconstruct partial data with a subset of the parts More parts, better quality “Multiple Description Coding”

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Simple Example (Video) Divide into two descriptions 1. Even frames 2. Odd frames “Multiple State Encoding” Does not scale to a large number of descriptions

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Layered Coding Layer 1 Layer 2Layer 3

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Layered Coding One layer one description? But there are dependencies between the descriptions

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Multiple Description Coding D1 D3 D2 L1 L2.1 L2.2 L2.1 XOR L2.2 L3.1 L3.2 L3.3

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Multiple Description Coding D1 L1 L2.1 L1 L2.3 L1 L2.1 L1 L2.3 D2 D3 D4 L3.1 L3.2 L3.3 XOR L2.2 L2.4 L2.2 L2.4 L2.3 L2.4 L2.1 L2.2

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) How to Build Tree? Send one description along one tree only A node is internal node in at most one tree, and is leaf node in the rest of the trees

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Example R R

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Tree Maintenance The source of video maintains all states. Isn’t this a centralized design that is not robust?

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Node Join Becomes internal node in a tree with least number of internal nodes. Becomes leaf node in the rest of the trees.

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) To join as internal node Pick highest internal node with enough bandwidth as parent. If cannot find, pick internal node with leaf node as child, preempt the leaf node.

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) To join as leaf node Pick highest internal node with enough bandwidth as parent. If cannot find, migrate an internal node from another tree.

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Network Efficiency When choosing parents, breaks ties by choosing closer node as parents.

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Effects of Number of Trees

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Effects of Number of Trees

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) MDC versus FEC

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Summary of CoopNet Robustness through redundancy in coding network paths

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Issues with P2P Streaming Not all peers are happy to contribute resources — selfish peers exist. S

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Deter Selfish Peers Add a constraint: A peer can only receive at most as much as it is willing to send S/R >= 1

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Practical Issues Asymmetric Links Different downlink capacity

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Dagster Contributor Aware P2P Streaming in Heterogeneous Environment MMCN 2005

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Goals Robustness wrt transient peers Deter selfish users without restricting S:R ratio Heterogeneous receivers

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Issue 1 Heterogeneous receivers Solution: Transcoding

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Transcoding S C B A D E F

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Issue 2 Improve Robustness Solution: Distributed Streaming

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Distributed Streaming S C B A D E F

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Multiple State Encoding S C B A D E F 1,2,3,4.. 1,3,5.. 2,4,6..

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Issue 3 Provide incentives without constraining S:R ratio? Solution: give peers that pledge more contributions some benefits “contributor-aware”

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Providing Incentives Idea: allow a peer to preempt another peer with smaller contributions Benefits Lower rejection rate Closer to source

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) DAG Construction

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Example S B A 0:30 15:5

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Example S B A 0:30 15:5

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Example S B A 0:30 15:5 C 15:15

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Example: Preemption S C A 0:30 15:5 15:15 B 15:5

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Example: Rejection S B A 0:30 15:5 D 15:6

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Preemption Rules A can preempt B if A is willing to donate more than B B can find new parents after preemption

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Example S B A 0:30 15:5 E 10:5

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Example S B A 0:30 15:5 E 10:5

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Example S B A 0:30 15:5 H 2:1 F G 10:5

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Example: 2 Preemptions S B A 0:30 15:5 H 2:1 F G 10:5

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Details Centralized control at the server to prevent illegal preemption

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Details Minimize number of descendents affected when preempting peers Find a subset of children to preempt, such that number of descendents affected is minimized, and preempted bandwidth is enough for the new node. KNAPSACK problem!

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Details Prefer parents who are closer to the source and have large contributions

NUS.SOC.CS Roger Zimmermann (based in parton slides by Ooi Wei Tsang) Details Peers can cheat by pledging more contributions than they are capable of. We can only do our best to detect such cheaters :-(

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Evaluations

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Simulation Setup Host characteristics based on study of Gnutella and Napster by Saroiu et. al.

Number of Peers Rejection Rate Best Fit (no Preemption) Contributor-Aware (with Preemption) Non Contributor Aware (with Preemption)

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Number of Peers Average Level Contributor Aware Non-Contributor Aware

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Level Average Donated Bandwidth Contributor Aware Non-contributor Aware

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Requested Bandwidth Donated Bandwidth Admitted Rejected

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Number of Parents Dagster limits maximum number of parents a node can have. How many is ideal?

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Number of Peers Rejection Rate P = 1 P > 1

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Number of Peers Average Level P = 2 P = 1

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Robustness with P Typical frame-rate fps. If P = 3, and one parent fails, then clients can expect to receive fps.

Remaining Tasks 19 November 2014 (end of day): Project reports and software due. In-class presentation on 19 & 20 November Room and schedule will be announced shortly. NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)