Peer-to-Peer Systems CNT

Slides:



Advertisements
Similar presentations
An Alliance based Peering Scheme for P2P Live Media Streaming Darshan Purandare Ratan Guha University of Central Florida August 31, P2P-TV, Kyoto.
Advertisements

P2P Live Video Streaming Polytechnic University Brooklyn, NY
1Abacast - Confidential1 Hybrid Content Delivery Network (CDN) Technologies and Services.
Peer-to-peer and agent-based computing Peer-to-Peer Computing: Introduction.
Dynamic Replica Placement for Scalable Content Delivery Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy, EECS Department.
Opportunities and Challenges of Peer-to-Peer Internet Video Broadcast Speaker: Shao-Fen Chou Adivisor: Dr. Ho-Ting Wu 11/14/
Internet for multimedia content Yogendra Pal Chief Engineer, All India Radio.
Peter R. Pietzuch Peer-to-Peer Computing – or how to make your BitTorrent downloads go faster... Peter Pietzuch Large-Scale Distributed.
Incentives Build Robustness in BitTorrent Bram Cohen.
Clayton Sullivan PEER-TO-PEER NETWORKS. INTRODUCTION What is a Peer-To-Peer Network A Peer Application Overlay Network Network Architecture and System.
Cooperative Overlay Networking for Streaming Media Content Feng Wang 1, Jiangchuan Liu 1, Kui Wu 2 1 School of Computing Science, Simon Fraser University.
Network Coding in Peer-to-Peer Networks Presented by Chu Chun Ngai
Ranveer Chandra , Kenneth P. Birman Department of Computer Science
CompSci 356: Computer Network Architectures Lecture 21: Content Distribution Chapter 9.4 Xiaowei Yang
Computer Science 1 ShapeShifter: Scalable, Adaptive End-System Multicast John Byers, Jeffrey Considine, Nicholas Eskelinen, Stanislav Rost, Dmitriy Zavin.
Streaming Video over the Internet: Approaches and Directions Dapeng Wu, Yiwei Thomas Hou et al. Presented by: Abhishek Gupta
Application Layer Overlays IS250 Spring 2010 John Chuang.
Web Caching Schemes1 A Survey of Web Caching Schemes for the Internet Jia Wang.
Internet Networking Spring 2006 Tutorial 12 Web Caching Protocols ICP, CARP.
Rheeve: A Plug-n-Play Peer- to-Peer Computing Platform Wang-kee Poon and Jiannong Cao Department of Computing, The Hong Kong Polytechnic University ICDCSW.
Opportunities and Challenges of Peer-to-Peer Internet Video Broadcast J. Liu, S. G. Rao, B. Li and H. Zhang Proc. of The IEEE, 2008 Presented by: Yan Ding.
Network Coding for Large Scale Content Distribution Christos Gkantsidis Georgia Institute of Technology Pablo Rodriguez Microsoft Research IEEE INFOCOM.
Cis e-commerce -- lecture #6: Content Distribution Networks and P2P (based on notes from Dr Peter McBurney © )
Department of Computer Engineering University of California at Santa Cruz Networking Systems (1) Hai Tao.
CoolStreaming/DONet: A Data- driven Overlay Network for Peer- to-Peer Live Media Streaming INFOCOM 2005 Xinyan Zhang, Jiangchuan Liu, Bo Li, and Tak- Shing.
1 Spring Semester 2007, Dept. of Computer Science, Technion Internet Networking recitation #13 Web Caching Protocols ICP, CARP.
1March -05 Jiangchuan Liu with Xinyan Zhang, Bo Li, and T.S.P.Yum Infocom 2005 CoolStreaming/DONet: A Data-Driven Overlay Network for Peer-to-Peer Live.
An Alliance based PeeringScheme for P2P Live Media Streaming An Alliance based Peering Scheme for P2P Live Media Streaming Darshan Purandare Ratan Guha.
An Overlay Multicast Infrastructure for Live/Stored Video Streaming Visual Communication Laboratory Department of Computer Science National Tsing Hua University.
Anonymous Gossip: Improving Multicast Reliability in Mobile Ad-Hoc Networks Ranveer Chandra (joint work with Venugopalan Ramasubramanian and Ken Birman)
# Idowu Samuel O. # Kashif Shahzad # Arif Kamal M7001E - Multimedia systems [ltu.se] ©2011.
CS Spring 2014 CS 414 – Multimedia Systems Design Lecture 40 – P2P Streaming (Part 4) Klara Nahrstedt.
Slide courtesy: Dr. Sumi Helal & Dr. Choonhwa Lee at University of Florida, USA Prof. Darshan Purandare at University of Central Florida, USA Dr. Meng.
Network Topologies.
Peer-To-Peer Multimedia Streaming Using BitTorrent Purvi Shah, Jehan-François Pâris University of Houston Houston, TX.
P2P File Sharing Systems
Communication (II) Chapter 4
Exploring VoD in P2P Swarming Systems By Siddhartha Annapureddy, Saikat Guha, Christos Gkantsidis, Dinan Gunawardena, Pablo Rodriguez Presented by Svetlana.
1 V1-Filename.ppt / yyyy-mm-dd / Initials P2P content distribution T Applications and Services in Internet, Fall 2008 Jukka K. Nurminen.
Peer-to-Peer Overlay Networks. Outline Overview of P2P overlay networks Applications of overlay networks Classification of overlay networks – Structured.
Chun-Yuan Chang, Cheng-Fu Chou * and Ming-Hung Chen Presenter: Prof. Cheng-Fu Chou National Taiwan University
Peer-to-Peer Networks (3) - IPTV Hongli Luo CEIT, IPFW.
© 2006 Cisco Systems, Inc. All rights reserved.Cisco Public 1 Version 4.0 Identifying Application Impacts on Network Design Designing and Supporting Computer.
Network Technologies essentials Week 9: Distributed file sharing & multimedia Compilation made by Tim Moors, UNSW Australia Original slides by David Wetherall,
Jonathan Walpole CSE515 - Distributed Computing Systems 1 Teaching Assistant for CSE515 Rahul Dubey.
CPSC 441: Multimedia Networking1 Outline r Scalable Streaming Techniques r Content Distribution Networks.
2: Application Layer1 Chapter 2 outline r 2.1 Principles of app layer protocols r 2.2 Web and HTTP r 2.3 FTP r 2.4 Electronic Mail r 2.5 DNS r 2.6 Socket.
A Case for End System Multicast Yang-hua Chu, Sanjay G. Rao, Srinivasan Seshan and Hui Zhang Presentation by Warren Cheung Some Slides from
CS Spring 2011 CS 414 – Multimedia Systems Design Lecture 37 – P2P Streaming and P2P Applications/PPLive Klara Nahrstedt Spring 2011.
HUAWEI TECHNOLOGIES CO., LTD. Page 1 Survey of P2P Streaming HUAWEI TECHNOLOGIES CO., LTD. Ning Zong, Johnson Jiang.
Making the Best of the Best-Effort Service (2) Advanced Multimedia University of Palestine University of Palestine Eng. Wisam Zaqoot Eng. Wisam Zaqoot.
2: Application Layer1 Chapter 2: Application layer r 2.1 Principles of network applications  app architectures  app requirements r 2.2 Web and HTTP r.
Adaptive Web Caching CS411 Dynamic Web-Based Systems Flying Pig Fei Teng/Long Zhao/Pallavi Shinde Computer Science Department.
A Simple Model for Analyzing P2P Streaming Protocols Zhou Yipeng Chiu DahMing John, C.S. Lui The Chinese University of Hong Kong.
CS Spring 2009 CS 414 – Multimedia Systems Design Lecture 37 – P2P Applications/PPLive Klara Nahrstedt Spring 2009.
ADVANCED COMPUTER NETWORKS Peer-Peer (P2P) Networks 1.
P2P Search COP P2P Search Techniques Centralized P2P systems  e.g. Napster, Decentralized & unstructured P2P systems  e.g. Gnutella.
Inside the New Coolstreaming: Principles, Measurements and Performance Implications Bo Li, Susu Xie, Yang Qu, Gabriel Y. Keung, Chuang Lin, Jiangchuan.
09/13/04 CDA 6506 Network Architecture and Client/Server Computing Peer-to-Peer Computing and Content Distribution Networks by Zornitza Genova Prodanoff.
INTERNET PROTOCOL TELEVISION (IP-TV)
Nuno Salta Supervisor: Manuel Ricardo Supervisor: Ricardo Morla
Internet Networking recitation #12
Lei Chen and Wendi B. Heinzelman , University of Rochester
INTERNET PROTOCOL TELEVISION (IP-TV)
The BitTorrent Protocol
Content Distribution Networks + P2P File Sharing
EE 122: Lecture 22 (Overlay Networks)
Content Distribution Networks + P2P File Sharing
2019/9/14 PPSP Survey.
Design and Implementation of OverLay Multicast Tree Protocol
Presentation transcript:

Peer-to-Peer Systems CNT 5517-5564 Dr. Sumi Helal & Dr. Choonhwa Lee Computer & Information Science & Engineering Department University of Florida, Gainesville, FL 32611 {helal, chl}@cise.ufl.edu

The State of the Art of P2P Video Streaming Slide courtesy: Prof. Darshan Purandare at University of Central Florida, USA Dr. Meng ZHANG, Dyyno Inc., USA Jan David Mol, Delft University of Technology, The Netherlands

Outline Introduction Video Streaming Approaches IP Multicast Content Distribution Network Application Layer Multicast Peer-to-Peer Swarming Protocol Noteworthy P2P Streaming Systems BT-Based Protocols CoolStreaming, GridMedia, PPLive Mobile P2P Streaming

P2P Is More Than File Download P2P Protocols: 1999: Napster, End System Multicast (ESM) 2000: Gnutella, eDonkey 2001: Kazaa 2002: eMule, BitTorrent 2003: Skype 2004: Coolstreaming, GridMedia, PPLive 2005~: TVKoo, TVAnts, PPStream, SopCast, … Next: VoD, IPTV, Gaming

Internet Traffic Internet video is ~1/4 of consumer Internet traffic – not including P2P All forms of video ~90% by 2012 TV, VoD, Internet, and P2P Mobile data traffic will double every year from now though 2012

Internet Video Streaming Large-scale video broadcast over Internet Real-time video streaming Large numbers of viewers AOL Live 8 broadcast peaked at 175,000 (July 2005) CBS NCAA broadcast peaked at 268,000 (March 2006) NFL Superbowl 2007 had 93 million viewers in the U.S. (Nielsen Media Research) Very high data rate TV quality video encoded with MPEG-4 would require 1.5 Tbps aggregate capacity for 100 million viewers

Video Streaming Approaches IP Multicast Content Distribution Networks Expensive Akamai, Limelight, etc Application Layer Multicast Alternative to IP Multicast Peer-to-Peer Based Scalable No setup cost Viable

IP Multicast Network layer solution Internet routers responsible for multicasting Group membership: remember group members for each multicast session Multicast routing: route data to members Efficient bandwidth usage Network topology is best known in network layer

IP Multicast Per-group state in routers Slow deployment High complexity, especially in core routers Scalability concern Violation of the end-to-end design principle: ‘stateless’ Slow deployment Changes at infrastructural level IP multicast is often disabled in routers Difficult to support higher layer functionality E.g., error control, flow control, and congestion control

Content Distribution Networks (CDNs) CDN nodes deployed at strategic locations These nodes cooperate with each other to satisfy an end user’s request User request is forwarded to a nearest CDN node, which has a cached copy QoS improves, as end user receives best possible connection Akamai, Limelight, etc

DNS query for www.cdn.com CDN Example HTTP request for www.foo.com/sports/sports.html origin server 1 DNS query for www.cdn.com 2 client CDN’s authoritative DNS server 3 HTTP request for www.cdn.com/www.foo.com/sports/ruth.gif CDN server near client Origin server (www.foo.com) distributes HTML replaces: http://www.foo.com/sports.ruth.gif with http://www.cdn.com/www.foo.com/sports/ruth.gif CDN company (cdn.com) distributes gif files uses its authoritative DNS server to route redirect requests

Application Layer Multicast (ALM) Application layer solution Multicast functionality in end systems End systems participate in multicast via an overlay structure Overlay consists of application-layer links Application-layer link is a logical link consisting of one or more links in underlying network Most ALM approaches form tree-based topology Tree construction & maintenance Disruption in the event of churn and node failures

ALM - Pros Easy to deploy Programmable end hosts No change to network infrastructure Programmable end hosts Overlay construction algorithms at end hosts can be easily applied Application-specific customizations

P2P Swarming Protocol Data-driven/swarming protocol BitTorrent Media content is broken down in small pieces and disseminated in a swarm Neighbor nodes use a gossip protocol to exchange their buffer map Nodes trade unavailable pieces BitTorrent CoolStreaming PPLive, SopCast, Fiedian, and TVAnts are derivates of CoolStreaming Proprietary and working philosophy not published Reverse engineered and measurement studies released

P2P Swarming Protocol Pull-based/mesh-based Robustness and simplicity Redundant chunk avoidance Robustness and simplicity Data availability information rather than an explicit structure to guide data flow (i.e., no need for streaming tree construction) Periodical exchange of data availability with random partners and subsequent retrieval of missing data (i.e., minimal impact from upstream node failures) Higher overhead and longer streaming delay Real-time scheduling constraints (i.e., need for good peer and chunk selection algorithms) 15

Tree-Push vs. Mesh-Pull

Tree-Push vs. Mesh-Pull Tree Based Content flows from server to nodes along the tree Node failures affect a complete sub-tree Long recovery time Mesh Based Nodes maintain state information of neighbor nodes Resilient to node failure High control overhead

Why Is P2P Streaming Hard? Real-time constraints Pieces needed in a sequential order and on time Bandwidth constraints Download speed >= video speed High user expectations Users spoiled with low start-up time and no/little loss High churn rate Robust network topology to minimize churn impact Fairness difficult to achieve High bandwidth peers have no incentive to contribute

BT-Based P2P Streaming BitTorrent Meta data (.torrent file) Download policy (piece selection: rarest first) Upload policy (peer selection: Tit-for-tat)

New Download Policy Request highest priority pieces High prio: download in-order Mid/low prio: download rarest-first Effect: dl speed = video speed: peer stays in high prio dl speed > video speed: peer is often in mid/low prio

BiToS: BitTorrent Streaming BitTorrent adapted for video streaming Changes to BitTorrent’s piece selection algorithm

CoolStreaming Video file is chopped and disseminated in a swarm Node upon arrival obtains a list of 40 peers from the server Node contacts these peers to join the swarm Every node has typically 4-8 neighbors, periodically sharing its buffer map with them Node exchanges missing chunks with its neighbors Deployed in the Internet and highly successful

CoolStreaming Membership Manager Partnership Manager Scheduler Maintains a list of members in the group Periodically generates membership messages Distributes it using Scalable Gossip Membership Protocol (SGAM) Partnership Manager Partners are members that have expected data segments Exchanges Buffer Map (BM) with partners Buffer Map contains availability information of segments Scheduler Determines which segment should be obtained from which partner Downloads segments from partners and uploads their wanted segments

Diagram of CoolStreaming System

GridMedia Designed to support large-scale live video streaming over the Internet The first generation: Gridmedia I Mesh-based multi-sender structure Combined with IP multicast First release: May 2004 The second generation: Gridmedia II Unstructured overlay Push-pull streaming mechanism First release: Jan. 2005

Pure Random Pull-Based Protocol Original GridMedia Overlay construction Peers self-organize into a richly connected random mesh Video delivery Peers periodically notifies its neighbor of what packets they hold in the current window of interest Each peer randomly chooses a neighbor to request missing packets If a packet does not arrive (i.e., timeout), it is repeatedly requested from a randomly selected neighbor until the packet slides out of the window

Hybrid Pull-Push Protocol Pull-based protocol has trade-off between control overhead and delay To minimize the delay Node notifies its neighbors of packet arrivals immediately Neighbors also request the packet immediately large control overhead To decrease the overhead Node waits until a group of packets arrive before informing its neighbors Neighbors can also request a batch of packets at a time considerable delay 27

Pull-Push Streaming Mechanism Pull mechanism as startup Successful pulls trigger packet pushes by the neighbors Every node subscribes to pushing packets from the neighbors Lost packets during the push interval are recovered by pull mechanism

Pull-Push Streaming Mechanism n-sub streams: packets with sequence number s % n Loop avoidance For n-sub streams, there are n packets in a packet group Packet party is composed of multiple packet groups. Push switching is determined by the pull results of the first packet group in a packet party

PPLive Data-driven P2P streaming Gossip-based protocols Peer management Channel discovery Very popular P2P IPTV application Over 100,000 simultaneous viewers and 40,000 viewers daily Over 200+ channels Windows Media Video and Real Video format

Mobile P2P Streaming Mobile video streaming Mobile environment Rapid growth of mobile P2P communication Video streaming expected to rise to as high as 91% of the Internet traffic in 2014 Mobile environment Increase of mobile and wireless peers Unsteady network connections Battery power Various video coding for mobile devices Frequent node churn Security

Mobile P2P Streaming Mobile node issues Other mobility considerations Uplink vs. downlink bandwidth Battery power Multiple interfaces Geo-targeting Other mobility considerations Processing power Link layer mobility Mobile IP & proxy mobile IP Tracker mobility

Pioneering Approaches Video proxy located at the edge of networks Adaptive video transcoding considering the network conditions and constraints of mobile users Distributed transcoding by fixed nodes Sub-streams from multiple parents are assembled Resilient to peer churns

Pioneering Approaches Hierarchical overlay Multiple network interfaces – access link vs. sharing link Peer fetches a video thru cellular networks (WAN) to share it with others over local networks (LAN) Cooperative video streaming P2P-based application layer channel bonding in resource-constrained mobile environments Similar, in spirit, to channel/link bundling technology at link layer to efficiently leverage the combined capacity of all access links

Questions?