1March -05 Jiangchuan Liu with Xinyan Zhang, Bo Li, and T.S.P.Yum Infocom 2005 CoolStreaming/DONet: A Data-Driven Overlay Network for Peer-to-Peer Live.

Slides:



Advertisements
Similar presentations
Dynamic Replica Placement for Scalable Content Delivery Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy, EECS Department.
Advertisements

Opportunities and Challenges of Peer-to-Peer Internet Video Broadcast Speaker: Shao-Fen Chou Adivisor: Dr. Ho-Ting Wu 11/14/
Scheduling in Web Server Clusters CS 260 LECTURE 3 From: IBM Technical Report.
X stream Project proposal. Project goals: Students Students: Academic Supervisor Academic Supervisor: Advisors: Developing and Implementing a large scale.
Cooperative Overlay Networking for Streaming Media Content Feng Wang 1, Jiangchuan Liu 1, Kui Wu 2 1 School of Computing Science, Simon Fraser University.
An Empirical Study of Flash Crowd Dynamics in a P2P-based Live Video Streaming System Bo Li, Gabriel Y. Keung, Susu Xie, Fangming Liu, Ye Sun, and Hao.
P2P Media streaming Rutuja Raghoji Ramya Tridandapani Malini Karunagaran.
Network Coding in Peer-to-Peer Networks Presented by Chu Chun Ngai
MMCN 19 Jan 2005 Ooi Wei Tsang Peer-to-Peer Streaming.
Suphakit Awiphan, Takeshi Muto, Yu Wang, Zhou Su, Jiro Katto
LightFlood: An Optimal Flooding Scheme for File Search in Unstructured P2P Systems Song Jiang, Lei Guo, and Xiaodong Zhang College of William and Mary.
1 P2P Streaming Amit Lichtenberg Based on: - Hui Zhang, Opportunities and Challenges of Peer-to-Peer Internet Video Broadcast,
Presented by Santhi Priya Eda Vinutha Rumale.  Introduction  Approaches  Video Streaming Traffic Model  QOS in WiMAX  Video Traffic Classification.
Resilient Peer-to-Peer Streaming Paper by: Venkata N. Padmanabhan Helen J. Wang Philip A. Chou Discussion Leader: Manfred Georg Presented by: Christoph.
Yale LANS ShadowStream: Performance Evaluation as a Capability in Production Internet Live Streaming Networks Chen Tian Richard Alimi Yang Richard Yang.
Computer Science 1 ShapeShifter: Scalable, Adaptive End-System Multicast John Byers, Jeffrey Considine, Nicholas Eskelinen, Stanislav Rost, Dmitriy Zavin.
Streaming Video over the Internet: Approaches and Directions Dapeng Wu, Yiwei Thomas Hou et al. Presented by: Abhishek Gupta
1 Inside the New Coolstreaming: Principles, Measurements and Performance Implications Bo Li, Susu Xie, Yang Qu, Gabriel Y. Keung, Chuang Lin, Jiangchuan.
ZIGZAG A Peer-to-Peer Architecture for Media Streaming By Duc A. Tran, Kien A. Hua and Tai T. Do Appear on “Journal On Selected Areas in Communications,
Cis510: internet multimedia Papers to be presented today  Distributed Video Streaming over the Internet T Nguyen and A. Zakhor  On Peer-to-Peer Media.
Opportunities and Challenges of Peer-to-Peer Internet Video Broadcast J. Liu, S. G. Rao, B. Li and H. Zhang Proc. of The IEEE, 2008 Presented by: Yan Ding.
Peer-to-peer Multimedia Streaming and Caching Service Jie WEI, Zhen MA May. 29.
Network Coding for Large Scale Content Distribution Christos Gkantsidis Georgia Institute of Technology Pablo Rodriguez Microsoft Research IEEE INFOCOM.
Service Differentiated Peer Selection An Incentive Mechanism for Peer-to-Peer Media Streaming Ahsan Habib, Member, IEEE, and John Chuang, Member, IEEE.
Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang IEEE Transactions on Multimedia, Vol. 6, No. 2, April.
1 Enabling Contribution Awareness in an Overlay Broadcasting System ACM SIGCOMM 2006 Presented by He Yuan.
CoolStreaming/DONet: A Data- driven Overlay Network for Peer- to-Peer Live Media Streaming INFOCOM 2005 Xinyan Zhang, Jiangchuan Liu, Bo Li, and Tak- Shing.
An Alliance based PeeringScheme for P2P Live Media Streaming An Alliance based Peering Scheme for P2P Live Media Streaming Darshan Purandare Ratan Guha.
An Overlay Multicast Infrastructure for Live/Stored Video Streaming Visual Communication Laboratory Department of Computer Science National Tsing Hua University.
1 An Overlay Scheme for Streaming Media Distribution Using Minimum Spanning Tree Properties Journal of Internet Technology Volume 5(2004) No.4 Reporter.
PPCast: A Peer-to-Peer based Video broadcast solution Presented by Shi Lu Feb. 28, 2006.
Department of Computer Science & Engineering The Chinese University of Hong Kong Constructing Robust and Resilient Framework for Cooperative Video Streaming.
Locality-Aware Content Distribution Danny Bickson, Dahlia Malkhi, David Rabinowitz.
Slide courtesy: Dr. Sumi Helal & Dr. Choonhwa Lee at University of Florida, USA Prof. Darshan Purandare at University of Central Florida, USA Dr. Meng.
Scalable Reliable Multicast Architecture Wenjun Zeng Computer Science Department University of Missouri-Columbia.
Communication (II) Chapter 4
Exploring VoD in P2P Swarming Systems By Siddhartha Annapureddy, Saikat Guha, Christos Gkantsidis, Dinan Gunawardena, Pablo Rodriguez Presented by Svetlana.
COCONET: Co-Operative Cache driven Overlay NETwork for p2p VoD streaming Abhishek Bhattacharya, Zhenyu Yang & Deng Pan.
Providing Controlled Quality Assurance in Video Streaming across the Internet Yingfei Dong, Zhi-Li Zhang and Rohit Rakesh Computer Networking and Multimedia.
1 V1-Filename.ppt / yyyy-mm-dd / Initials P2P content distribution T Applications and Services in Internet, Fall 2008 Jukka K. Nurminen.
1 © 2008 Nokia continous_scheduling_fmn_2008 / / JAk Continuous Scheduling for Data-Driven Peer-to-Peer Streaming Jyrki Akkanen Peer-to-peer.
An Efficient Topology-Adaptive Membership Protocol for Large- Scale Cluster-Based Services Jingyu Zhou * §, Lingkun Chu*, Tao Yang* § * Ask Jeeves §University.
Bullet: High Bandwidth Data Dissemination Using an Overlay Mesh.
Prof. Younghee Lee 1 Computer networks u Lecture 12: Overlay network Prof. Younghee Lee u Some part of this teaching materials are prepared referencing.
“Intra-Network Routing Scheme using Mobile Agents” by Ajay L. Thakur.
Multicast Routing in Mobile Ad Hoc Networks (MANETs)
Resilient Peer-to-Peer Streaming Presented by: Yun Teng.
A Case for End System Multicast Yang-hua Chu, Sanjay G. Rao, Srinivasan Seshan and Hui Zhang Presentation by Warren Cheung Some Slides from
Higashino Lab. Maximizing User Gain in Multi-flow Multicast Streaming on Overlay Networks Y.Nakamura, H.Yamaguchi and T.Higashino Graduate School of Information.
Tsunami: Maintaining High Bandwidth Under Dynamic Network Conditions Dejan Kostić, Ryan Braud, Charles Killian, Eric Vandekieft, James W. Anderson, Alex.
Department of Information Engineering The Chinese University of Hong Kong A Framework for Monitoring and Measuring a Large-Scale Distributed System in.
Ch 1. Computer Networks and the Internet Myungchul Kim
TOMA: A Viable Solution for Large- Scale Multicast Service Support Li Lao, Jun-Hong Cui, and Mario Gerla UCLA and University of Connecticut Networking.
HUAWEI TECHNOLOGIES CO., LTD. Page 1 Survey of P2P Streaming HUAWEI TECHNOLOGIES CO., LTD. Ning Zong, Johnson Jiang.
PPSP Peer Protocol draft-gu-ppsp-peer-protocol PPSP WG IETF 82 Taipei Rui Cruz (presenter) Yingjie Gu, Jinwei Xia, Mário Nunes, David Bryan, João Taveira.
Adaptive Transmission for layered streaming in heterogeneous Peer-to-Peer networks Xin Xiao, Yuanchun Shi, Yuan Gao Dept. of CS&T, Tsinghua University.
On the Optimal Scheduling for Media Streaming in Data-driven Overlay Networks Meng ZHANG with Yongqiang XIONG, Qian ZHANG, Shiqiang YANG Globecom 2006.
A Utility-based Approach to Scheduling Multimedia Streams in P2P Systems Fang Chen Computer Science Dept. University of California, Riverside
APPLICATION LAYER MULTICASTING
Multiuser Receiver Aware Multicast in CDMA-based Multihop Wireless Ad-hoc Networks Parmesh Ramanathan Department of ECE University of Wisconsin-Madison.
LightFlood: An Efficient Flooding Scheme for File Search in Unstructured P2P Systems Song Jiang, Lei Guo, and Xiaodong Zhang College of William and Mary.
Peer-to-Peer Result Dissemination in High-Volume Data Filtering Shariq Rizvi and Paul Burstein CS 294-4: Peer-to-Peer Systems.
CS 6401 Overlay Networks Outline Overlay networks overview Routing overlays Resilient Overlay Networks Content Distribution Networks.
CoopNet: Cooperative Networking
Inside the New Coolstreaming: Principles, Measurements and Performance Implications Bo Li, Susu Xie, Yang Qu, Gabriel Y. Keung, Chuang Lin, Jiangchuan.
An overlay for latency gradated multicasting Anwitaman Datta SCE, NTU Singapore Ion Stoica, Mike Franklin EECS, UC Berkeley
Buffer Analysis of Live P2P Media Streaming Approaches Atif Nazir BSc ’07, LUMS.
Network Topologies for Scalable Multi-User Virtual Environments Lingrui Liang.
Ying Qiao Carleton University Project Presentation at the class:
Enabling Contribution Awareness in an Overlay Broadcasting System
Presentation transcript:

1March -05 Jiangchuan Liu with Xinyan Zhang, Bo Li, and T.S.P.Yum Infocom 2005 CoolStreaming/DONet: A Data-Driven Overlay Network for Peer-to-Peer Live Media Streaming

2March -05 Some Facts DONet – Data-driven Overlay Network CoolStreaming – Cooperative Overlay Streaming First release (CoolStreaming v0.9) May 2004 Till March 2005 Downloads: >100,000 Average online users: 6,000 Peak-time online users: 14,000 Google entries (CoolStreaming) : 5130

3March -05 Outline Motivation Background and related work Design of DONet/CoolStreaming Implementation and empirical Study Future work

4March -05 Motivation Enable large-scale live broadcasting in the Internet environment Capacity limitation ־Streaming: 500Kbps, server outbound band: 100Mbps ־200 concurrent users only Network heterogeneity No QoS guarantee

5March -05 Client/Server: Poor scalability

6March -05 IP multicast: Limited deployment

7March -05 Collaborative Communications

8March -05 Outline Motivation Background and related work Design of DONet/CoolStreaming Implementation and empirical Study Future work

9March -05 Related Solutions Content distribution networks Expensive Not quite scalable for a large number of audiences Self-organized overlay networks Application layer multicast Peer-to-peer communications

10March -05 Related Solutions Content distribution networks Expensive Live streaming (?) Self-organized overlay networks Application layer multicast Peer-to-peer communications

11March -05 Application Layer Multicast Issue: Structure construction Tree NICE, CoopNet, SpreadIt, ZIGZAG Mesh Narada and its extension Multi-tree SplitStream

12March -05 Application Layer Multicast (cont’d) Issue: Node dynamics Structure maintenance Passive/proactive repairing algorithms Advanced coding PALS (layered coding) CoopNet (multiple description coding)

13March -05 Gossip-based Dissemination Gossip Iteration ־Sends a new message to a random set of nodes ־Each node does similarly in the next round Pros: Simple, robust Cons: Redundancy, delay Related Peer-to-peer on-demand streaming

14March -05 Outline Motivation Background and related work Design of DONet/CoolStreaming Implementation and empirical Study Future work

15March -05 Data-driven Overlay (DONet) Target Live media broadcasting No IP multicast support Core operations Every node periodically exchanges data availability information with a set of partners Then retrieves unavailable data from one or more partners, or supplies available data to partners

16March -05 Features of DONet Easy to implement no need to construct and maintain a complex global structure Efficient data forwarding is dynamically determined according to data availability, not restricted by specific directions Robust and resilient adaptive and quick switching among multi-suppliers

17March -05 Key Modules Membership manager mCache – partial overlay view Update by gossip Partnership manager Random selection Partner refinement Transmission Scheduler

18March -05 Transmission Scheduling Problem: From which partner to fetch which data segment ? Constraints Data availability Playback deadline Heterogeneous partner bandwidth

19March -05 Scheduling algorithm Variation of Parallel machine scheduling NP-hard Heuristic Message exchanged ־Window-based buffer map (BM): Data availability ־Segment request (piggyback by BM) Less suppliers first Multi-supplier: Highest bandwidth within deadline first Simpler algorithm in current implementation Network coding ?

20March -05 Analysis on DONet Coverage ratio for distance k E.g. 95% nodes are covered in 6 hops for M=4 Average distance O(logN) DONet vs Tree-based overlay Much lower outage probability

21March -05 Outline Motivation Background and related work Design of DONet/CoolStreaming Implementation and empirical Study Future work

22March -05 PlanetLab Experiments Distributed experimental system DONet Module Console and automation Command dispatching and report collection Caveats Scalability Reproducibility Representability

23March -05 Geographical Node Distribution May 24, 2004 # of Active Node:

24March -05 Planet-Lab Result Data continuity, 200 nodes, 500 kbps streaming

25March -05 Control overhead

26March -05 Implementation: CoolStreaming First release: May 30, 2004 Source code: 2000-line Python Programming time: PlanetLab prototype: 2 weeks Export from prototype: 2 weeks Support formats: Real Video/Windows Media Platform/media independent Scale and capacity Total downloads: Peak time: concurrent users Streaming rate: kbps

27March -05 User Distribution (June 2004) Heterogeneous network environment LAN, DSL, CABLE...

28March -05 Online Statistics (Jun 21, 2004) Average Packet Loss around 1% - 5%

29March -05 Observations Current Internet has enough available band to support TV-quality streaming (>450Kbps) Bottleneck: server, end-to-end bandwidth Larger data-driven overlay  better streaming quality Capacity amplification

30March -05 Outline Motivation Background and related work Design of DONet/CoolStreaming Implementation and empirical Study Future work

31March -05 Future of DONet/Coolstreaming Content Solution: DONet/Coolstreaming as a capacity amplifier between content provider and clients Virtually part of network infrastructure Enhancement Scheduling algorithm ־Simplified version ־Network coding Transport protocol ־TCP (?)

32March -05 Future of DONet/Coolstreaming Enhancement (cont’d) User interface Combined with caching Combined with CDN ־Provide world-wide reliable media streaming service On-demand streaming

33March -05 Q & A Thanks