Hybrid Peer-to-Peer Media Distribution Systems: a Performance Study Yicheng Tu, Jianzhong Sun and Sunil Prabhakar Department of Computer Sciences, Purdue.

Slides:



Advertisements
Similar presentations
Clayton Sullivan PEER-TO-PEER NETWORKS. INTRODUCTION What is a Peer-To-Peer Network A Peer Application Overlay Network Network Architecture and System.
Advertisements

Playback delay in p2p streaming systems with random packet forwarding Viktoria Fodor and Ilias Chatzidrossos Laboratory for Communication Networks School.
1 Efficient and Robust Streaming Provisioning in VPNs Z. Morley Mao David Johnson Oliver Spatscheck Kobus van der Merwe Jia Wang.
Natural Selection in Peer-to-Peer Streaming: From the Cathedral to the Bazaar Vivek Shrivastava, Suman Banerjee University of Wisconsin-Madison, USA ACM.
Suphakit Awiphan, Takeshi Muto, Yu Wang, Zhou Su, Jiro Katto
Queueing Models for P2P Systems.  Extend classical queuing theory for P2P systems.  Develop taxonomy for different variations of these queuing models.
Planning under Uncertainty
PROMISE: Peer-to-Peer Media Streaming Using CollectCast Mohamed Hafeeda, Ahsan Habib et al. Presented By: Abhishek Gupta.
Company Confidential 1 © 2005 Nokia V1-Filename.ppt / yyyy-mm-dd / Initials Towards a mobile content delivery network with a P2P architecture Carlos Quiroz.
Peer-to-Peer Networks as a Distribution and Publishing Model Jorn De Boever (june 14, 2007)
Simulation Where real stuff starts. ToC 1.What, transience, stationarity 2.How, discrete event, recurrence 3.Accuracy of output 4.Monte Carlo 5.Random.
Network Coding for Large Scale Content Distribution Christos Gkantsidis Georgia Institute of Technology Pablo Rodriguez Microsoft Research IEEE INFOCOM.
An Analysis of Internet Content Delivery Systems Stefan Saroiu, Krishna P. Gommadi, Richard J. Dunn, Steven D. Gribble, and Henry M. Levy Proceedings of.
Motivation Due to the development of new Internet access technologies (DSL's and HFC's), VoD services have become increasingly popular Despite the continuous.
Scalable and Continuous Media Streaming on Peer-to-Peer Networks M. Sasabe, N. Wakamiya, M. Murata, H. Miyahara Osaka University, Japan Presented By Tsz.
Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang IEEE Transactions on Multimedia, Vol. 6, No. 2, April.
Gossip-based Search Selection in Hybrid Peer-to-Peer Networks M. Zaharia and S. Keshav D.R.Cheriton School of Computer Science University of Waterloo,
A Trust Based Assess Control Framework for P2P File-Sharing System Speaker : Jia-Hui Huang Adviser : Kai-Wei Ke Date : 2004 / 3 / 15.
Building Low-Diameter P2P Networks Eli Upfal Department of Computer Science Brown University Joint work with Gopal Pandurangan and Prabhakar Raghavan.
Distributed Multimedia Streaming over Peer-to-Peer Network Jin B. Kwon, Heon Y. Yeom Euro-Par 2003, 9th International Conference on Parallel and Distributed.
Web Caching Robert Grimm New York University. Before We Get Started  Interoperability testing  Type theory 101.
Exploiting Content Localities for Efficient Search in P2P Systems Lei Guo 1 Song Jiang 2 Li Xiao 3 and Xiaodong Zhang 1 1 College of William and Mary,
PROMISE: Peer-to-Peer Media Streaming Using CollectCast M. Hefeeda, A. Habib, B. Botev, D. Xu, and B. Bhargava ACM Multimedia 2003, November 2003.
On Peer-to-Peer Media Streaming Dongyan Xu Mohamed Heffeda Susanne Hamrusch Bharat Bhargava 2002 International Conference on Distributed Computing Systems.
Hybrid Video Downloading / Streaming over peer-to-peer network Yufeng Shan and Shivkumar Kalyanaraman Multimedia and Expo, ICME '03. Proceedings.
An Overlay Multicast Infrastructure for Live/Stored Video Streaming Visual Communication Laboratory Department of Computer Science National Tsing Hua University.
Performance Evaluation of Peer-to-Peer Video Streaming Systems Wilson, W.F. Poon The Chinese University of Hong Kong.
Chord-over-Chord Overlay Sudhindra Rao Ph.D Qualifier Exam Department of ECECS.
Web Caching Robert Grimm New York University. Before We Get Started  Illustrating Results  Type Theory 101.
Comparing Hybrid Peer-to-Peer Systems Beverly Yang and Hector Garcia-Molina Presented by Marco Barreno November 3, 2003 CS 294-4: Peer-to-peer systems.
Adaptive Content Delivery for Scalable Web Servers Authors: Rahul Pradhan and Mark Claypool Presented by: David Finkel Computer Science Department Worcester.
On Peer-to-Peer Media Streaming by Dongyan Xu, Mohamed Hefeeda, Susanne Hambrusch, Bharat Bhargava Dept. of Computer Science, Purdue University, West Lafayette.
11/4/2003ACM Multimedia 2003, Berkeley, CA1 PROMISE: Peer-to-Peer Media Streaming Using CollectCast Mohamed Hefeeda 1 Joint work with Ahsan Habib 2, Boyan.
A Framework for Cost-Effective Peer-to- Peer Content Distribution Mohamed Hefeeda and Bharat Bhargava Department of Computer Sciences Purdue University.
Peer-to-peer Multimedia Streaming and Caching Service by Won J. Jeon and Klara Nahrstedt University of Illinois at Urbana-Champaign, Urbana, USA.
On-Demand Media Streaming Over the Internet Mohamed M. Hefeeda, Bharat K. Bhargava Presented by Sam Distributed Computing Systems, FTDCS Proceedings.
Peer-to-peer file-sharing over mobile ad hoc networks Gang Ding and Bharat Bhargava Department of Computer Sciences Purdue University Pervasive Computing.
Tradeoffs in CDN Designs for Throughput Oriented Traffic Minlan Yu University of Southern California 1 Joint work with Wenjie Jiang, Haoyuan Li, and Ion.
PROMISE: Peer-to-Peer Media Streaming Using CollectCast Presented by: Randeep Singh Gakhal CMPT 886, July 2004.
Receiver-driven Layered Multicast Paper by- Steven McCanne, Van Jacobson and Martin Vetterli – ACM SIGCOMM 1996 Presented By – Manoj Sivakumar.
1 Proxy-Assisted Techniques for Delivering Continuous Multimedia Streams Lixin Gao, Zhi-Li Zhang, and Don Towsley.
© 2009 AT&T Intellectual Property. All rights reserved. Multimedia content growth: From IP networks to Medianets Cisco-IEEE ComSoc Webinar. Sept. 23, 2009.
DEXA 2005 Quality-Aware Replication of Multimedia Data Yicheng Tu, Jingfeng Yan and Sunil Prabhakar Department of Computer Sciences, Purdue University.
Developing Analytical Framework to Measure Robustness of Peer-to-Peer Networks Niloy Ganguly.
DELAYED CHAINING: A PRACTICAL P2P SOLUTION FOR VIDEO-ON-DEMAND Speaker : 童耀民 MA1G Authors: Paris, J.-F.Paris, J.-F. ; Amer, A. Computer.
An Efficient Approach for Content Delivery in Overlay Networks Mohammad Malli Chadi Barakat, Walid Dabbous Planete Project To appear in proceedings of.
1 CS 425 Distributed Systems Fall 2011 Slides by Indranil Gupta Measurement Studies All Slides © IG Acknowledgments: Jay Patel.
Quantitative Evaluation of Unstructured Peer-to-Peer Architectures Fabrício Benevenuto José Ismael Jr. Jussara M. Almeida Department of Computer Science.
Peer-to-Peer Network Tzu-Wei Kuo. Outline What is Peer-to-Peer(P2P)? P2P Architecture Applications Advantages and Weaknesses Security Controversy.
Kaleidoscope – Adding Colors to Kademlia Gil Einziger, Roy Friedman, Eyal Kibbar Computer Science, Technion 1.
Efficient P2P Search by Exploiting Localities in Peer Community and Individual Peers A DISC’04 paper Lei Guo 1 Song Jiang 2 Li Xiao 3 and Xiaodong Zhang.
Analyzing the Vulnerability of Superpeer Networks Against Attack Niloy Ganguly Department of Computer Science & Engineering Indian Institute of Technology,
PROP: A Scalable and Reliable P2P Assisted Proxy Streaming System Computer Science Department College of William and Mary Lei Guo, Songqing Chen, and Xiaodong.
Peer-to-Peer and Collective Intelligence A platform for collaboration Andrew Roczniak Collective Intelligence Lab Multimedia Communications Research Lab.
Chapter 1 Introduction n Introduction: Problem Solving and Decision Making n Quantitative Analysis and Decision Making n Quantitative Analysis n Model.
De novo discovery of mutated driver pathways in cancer Discussion leader: Matthew Bernstein Scribe: Kun-Chieh Wang Computational Network Biology BMI 826/Computer.
OPERATING SYSTEMS CS 3530 Summer 2014 Systems and Models Chapter 03.
Content caching and scheduling in wireless networks with elastic and inelastic traffic Group-VI 09CS CS CS30020 Performance Modelling in Computer.
A simple model for analyzing P2P streaming protocols. Seminar on advanced Internet applications and systems Amit Farkash. 1.
Brief Announcement : Measuring Robustness of Superpeer Topologies Niloy Ganguly Department of Computer Science & Engineering Indian Institute of Technology,
SHADOWSTREAM: PERFORMANCE EVALUATION AS A CAPABILITY IN PRODUCTION INTERNET LIVE STREAM NETWORK ACM SIGCOMM CING-YU CHU.
A Measurement Study of Peer-to-Peer File Sharing Systems Presented by Hakim Weatherspoon CS294-4: Peer-to-Peer Systems By Stefan Saroiu, P. Krishna Gummadi,
Copyright © 2009 Pearson Education, Inc. 9.2 Hypothesis Tests for Population Means LEARNING GOAL Understand and interpret one- and two-tailed hypothesis.
Geethanjali College Of Engineering and Technology Cheeryal( V), Keesara ( M), Ranga Reddy District. I I Internal Guide Mrs.CH.V.Anupama Assistant Professor.
Mean Field Methods for Computer and Communication Systems Jean-Yves Le Boudec EPFL Network Science Workshop Hong Kong July
Cost-Effective Video Streaming Techniques Kien A. Hua School of EE & Computer Science University of Central Florida Orlando, FL U.S.A.
Composing Web Services and P2P Infrastructure. PRESENTATION FLOW Related Works Paper Idea Our Project Infrastructure.
An example of peer-to-peer application
The Impact of Replacement Granularity on Video Caching
Peer-to-Peer Information Systems Week 6: Performance
Presentation transcript:

Hybrid Peer-to-Peer Media Distribution Systems: a Performance Study Yicheng Tu, Jianzhong Sun and Sunil Prabhakar Department of Computer Sciences, Purdue University Paper published in ACM/SPIE Conference on Multimedia Computing and Networking (MMCN04)

Media Distribution Streaming needed QoS important Network bandwidth is the bottleneck –Multicast: CNN.COM –Unicast: online cinema –We concentrate on the latter Server-based system lacks sufficient capacity Improve capacity by proxies –Contention Distribution Networks (CDNs)

Peer-to-Peer in Media Streaming CDNs are expensive to build Investment increases as popularity of content does Peer-to-Peer(P2P) approach: –The idea: Utilize bandwidth among clients (peers) –Inexpensive –Capacity grows as popularity does Problems of P2P systems: –Object searching is slow in pure P2P system (e.g. Gnutella) –Limited/heterogeneous contributions from peers –Many-to-one streaming, difficult to synchronize –Duration of peer contribution (Peer failure)

Hybrid System = CDN + P2P Combine the advantages of both CDN and P2P Increase of bandwidth by a P2P community Search is done by a centralized directory server –Assume object updating is of reasonable frequency A small number of seed servers: –Used for streaming –Boot up the system –Complementary bandwidth source in case of failure System model and failure-resistant streaming protocol proposed by Xu et al. (2002) and Heefeda et al.(2003)

This Research Our Goal: To study the system dynamics of the aforementioned hybrid media streaming system Our approach: mathematical analysis –Non-trivial, a good model is the key –Previous attempt (Xu et al., 2002) gives no analytical results –Confirm analysis by large-scale simulation

System Model Players: –Directory Server –Servers Same name: Streaming servers, CDN servers –Peers (clients) Requesting peer Supplying peer Qualified peer –Media objects Operations Order of streaming entities: peers > servers

(Initial) Assumptions Only one object in the system and they are of the same streaming length (L) and bitrate(b) * The server side upload link is always the bottleneck Peer has infinite storage * Peer never fails * Requests are uniformly distributed among the peer population

Metrics System capacity: –total bandwidth of servers + qualified peers Server-peer transition time (k 0 ) *** Reject rate

Intuitively System capacity growth analogous to population growth of a single species in a biological system Servers and supplying peers give birth to requesting peers Each streaming cycle equals a generation Exponential growth

Mathematically Note α/b is the Capacity Growth Factor, the above can be transformed into

More on Mono-file System In a system with requesting rate λ, the condition for server- peer transition is: We get k 0 as:

What About Multi-file Systems? Previous framework cannot be applied here directly Difficult to model the interactions between per-file proliferation Analysis in a rather “indirect" way View system as a combination of F independent subsystems with and Statistical multiplexing (reality) vs. Sharing Multiplexing (our view) Then prove the above “view” is close to reality

k 0 in Multi-file System Each subsystem follows previous analysis Still it is hard to get k 0 for the whole system –System-level k 0 depends on distribution of N f –N f is unknown –λ f is also unknown, but it doesn’t matter Lets forget about the real solution to k 0 for a while and think about the optimal solution !!

Optimizing System-level k 0 An observation: k 0 is the maximum of all k 0,f –System reaches transition only when all single-file subsystem do The optimization: Minimize k 0 = max {k 0,f } (0≤f≤F ) Subject to

Optimal Choice of N f The above optimization has solution: k 0 = k 0,1 = k 0,2 = … = k 0,F Putting into the k 0,f formula: And for all f, we get: What does this mean? –The optimal choice of N f is directly related to λ f –Surprisingly, the optimal k 0 can be expressed by the same formula for mono-file system

To Make the Story Complete We proved the system converges to the optimal distribution of server bandwidth (N f ) We used confidence intervals to analyze how close the system is to the optimal situation –When bNλ f /λ > 10, very close ! What about the assumption of independence among subsystems –We introduce an "independence coefficient”β –βis close to 1 when the pool size M is big –Good thing: M should be and is big in general

Effects of Peer Failures Critical feature of any P2P system, cannot ignore Relate to the biological model: individuals die Model failures by assigning a lifespan to each peer, denoted as a random number X Assume a survival rate γ For any streaming period k, γ= Pr { X ≥T(k)+ L | X >T(k)} where T(k) is the starting time for period k.

Effects of Peer Failures Generally,γis difficult to get –It changes with age (k) –More specifically, it depends on the age structure Previous study (Saroiu et al., 2002)shows that peer lifespan follows an exponential distribution Revisit the survival rate, where s is the average lifespan. The next steps become easy

Effects of Peer Failures With a universalγvalue, Everything else is the same The transition time Note the Capacity Growth Factor becomesγ(1+α/b)

Experimental Results

Experiments: Effects of α

Effects of λ

Effects of Media Number

Number of Peers by Storage Use Experimentsk 0 (h) 1234β F = F = F = F = F = F =

Effects of Peer Failure

Conclusions The hybrid streaming system follows an exponential growth pattern The Capacity Growth Factor affects system performance more than other factors do Within some boundary, capacity growth of multi-file and mono-file systems can be described by the same equation Peer failures have significant effects on system capacity, it could kill the system Quantitative analysis of complex system is hard, but doable in some cases

References D. Xu, H-K. Chai, C. Rosenburg and S. Kulkarni. Analysis of a Hybrid Architecture for Cost-Effective Streaming Media Distribution. In Proc. of ACM/SPIE MMCN 2003,January M. Hefeeda, A. Habib, B. Botev, D. Xu, B. Bhargava, PROMISE: Peer-to-Peer Media Streaming Using CollectCast. In Proc. of ACM Multimedia 2003, Berkeley, CA, November 2003 S. Saroiu, P. K. Gummadi and S. D. Gribble. A Measurement Study of Peer-to-Peer File Sharing Systems. In Proc. of ACM/SPIE MMCN 2002,January 2002.