1 rStream: Resilient and Optimal Peer-to-Peer Streaming with Rateless Codes Chuan Wu, Baochun Li Department of Electrical and Computer Engineering University.

Slides:



Advertisements
Similar presentations
Jesper H. Sørensen, Toshiaki Koike-Akino, and Philip Orlik 2012 IEEE International Symposium on Information Theory Proceedings Rateless Feedback Codes.
Advertisements

Performance analysis of LT codes with different degree distribution
VSMC MIMO: A Spectral Efficient Scheme for Cooperative Relay in Cognitive Radio Networks 1.
Novasky: Cinematic-Quality VoD in a P2P Storage Cloud Speaker : 童耀民 MA1G Authors: Fangming Liu†, Shijun Shen§,Bo Li†, Baochun Li‡, Hao Yin§,
D.J.C MacKay IEE Proceedings Communications, Vol. 152, No. 6, December 2005.
1 Advancing Supercomputer Performance Through Interconnection Topology Synthesis Yi Zhu, Michael Taylor, Scott B. Baden and Chung-Kuan Cheng Department.
Playback delay in p2p streaming systems with random packet forwarding Viktoria Fodor and Ilias Chatzidrossos Laboratory for Communication Networks School.
On Large-Scale Peer-to-Peer Streaming Systems with Network Coding Chen Feng, Baochun Li Dept. of Electrical and Computer Engineering University of Toronto.
Lava: A Reality Check of Network Coding in Peer-to-Peer Live Streaming Mea Wang, Baochun Li Department of Electrical and Computer Engineering University.
Network Coding in Peer-to-Peer Networks Presented by Chu Chun Ngai
LightFlood: An Optimal Flooding Scheme for File Search in Unstructured P2P Systems Song Jiang, Lei Guo, and Xiaodong Zhang College of William and Mary.
Efficient and Flexible Parallel Retrieval using Priority Encoded Transmission(2004) CMPT 886 Represented By: Lilong Shi.
1 Data Persistence in Large-scale Sensor Networks with Decentralized Fountain Codes Yunfeng Lin, Ben Liang, Baochun Li INFOCOM 2007.
A Comparison of Layering and Stream Replication Video Multicast Schemes Taehyun Kim and Mostafa H. Ammar.
Network Coding for Large Scale Content Distribution Christos Gkantsidis Georgia Institute of Technology Pablo Rodriguez Microsoft Research IEEE INFOCOM.
Measurement-Based Optimization Techniques for Bandwidth-Demanding Peer-to- Peer Systems T. S. Eugene Ng, Yang-hua Chu, Sanjay G. Rao, Kunwadee Sripanidkulchai.
Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang IEEE Transactions on Multimedia, Vol. 6, No. 2, April.
Sliding-Window Digital Fountain Codes for Streaming of Multimedia Contents Matta C.O. Bogino, Pasquale Cataldi, Marco Grangetto, Enrico Magli, Gabriella.
CoolStreaming/DONet: A Data- driven Overlay Network for Peer- to-Peer Live Media Streaming INFOCOM 2005 Xinyan Zhang, Jiangchuan Liu, Bo Li, and Tak- Shing.
Multiple Sender Distributed Video Streaming Thinh Nguyen, Avideh Zakhor appears on “IEEE Transactions On Multimedia, vol. 6, no. 2, April, 2004”
End-to-End Analysis of Distributed Video-on-Demand Systems P. Mundur, R. Simon, and A. K. Sood IEEE Transactions on Multimedia, Vol. 6, No. 1, Feb 2004.
PROMISE: Peer-to-Peer Media Streaming Using CollectCast M. Hefeeda, A. Habib, B. Botev, D. Xu, and B. Bhargava ACM Multimedia 2003, November 2003.
LCN 2007, Dublin 1 Non-bifurcated Routing in Wireless Multi- hop Mesh Networks by Abdullah-Al Mahmood and Ehab S. Elmallah Department of Computing Science.
1 Distributed LT Codes Srinath Puducheri, Jörg Kliewer, and Thomas E. Fuja. Department of Electrical Engineering, University of Notre Dame, Notre Dame,
1March -05 Jiangchuan Liu with Xinyan Zhang, Bo Li, and T.S.P.Yum Infocom 2005 CoolStreaming/DONet: A Data-Driven Overlay Network for Peer-to-Peer Live.
Understanding Mesh-based Peer-to-Peer Streaming Nazanin Magharei Reza Rejaie.
Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang, and Ya-Qin Zhang IEEE TRANSACTIONS ON MULTIMEDIA,
1 Algorithms for Bandwidth Efficient Multicast Routing in Multi-channel Multi-radio Wireless Mesh Networks Hoang Lan Nguyen and Uyen Trang Nguyen Presenter:
Anya Apavatjrut, Katia Jaffres-Runser, Claire Goursaud and Jean-Marie Gorce Combining LT codes and XOR network coding for reliable and energy efficient.
Feng Lu Chuan Heng Foh, Jianfei Cai and Liang- Tien Chia Information Theory, ISIT IEEE International Symposium on LT Codes Decoding: Design.
Repairable Fountain Codes Megasthenis Asteris, Alexandros G. Dimakis IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 32, NO. 5, MAY /5/221.
Analyzing the Resilience-Complexity Tradeoff of Network Coding in Dynamic P2P Networks IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, VOL. 22,
BitTorrent Under a Microscope: Towards Static QoS Provision in Dynamic Peer-to-Peer Networks Tom H. Luan*, Xuemin (Sherman) Shen* and Danny H. K. Tsang.
Rateless Codes with Optimum Intermediate Performance Ali Talari and Nazanin Rahnavard Oklahoma State University, USA IEEE GLOBECOM 2009 & IEEE TRANSACTIONS.
1 Lava: A Reality Check of Network Coding in Peer-to-Peer Live Streaming Mea Wang, Baochun Li Department of Electrical and Computer Engineering University.
Network Aware Resource Allocation in Distributed Clouds.
Computer Science Informed Content Delivery Across Adaptive Overlay Networks Overlay networks have emerged as a powerful and highly flexible method for.
A Distributed Framework for Correlated Data Gathering in Sensor Networks Kevin Yuen, Ben Liang, Baochun Li IEEE Transactions on Vehicular Technology 2008.
Distributing Layered Encoded Video through Caches Authors: Jussi Kangasharju Felix HartantoMartin Reisslein Keith W. Ross Proceedings of IEEE Infocom 2001,
Resilient Peer-to-Peer Streaming Presented by: Yun Teng.
A novel approach of gateway selection and placement in cellular Wi-Fi system Presented By Rajesh Prasad.
Shifted Codes Sachin Agarwal Deutsch Telekom A.G., Laboratories Ernst-Reuter-Platz Berlin Germany Joint work with Andrew Hagedorn and Ari Trachtenberg.
An Optimal Partial Decoding Algorithm for Rateless Codes Valerio Bioglio, Rossano Gaeta, Marco Grangetto, and Matteo Sereno Dipartimento di Informatica.
Chih-Ming Chen, Student Member, IEEE, Ying-ping Chen, Member, IEEE, Tzu-Ching Shen, and John K. Zao, Senior Member, IEEE Evolutionary Computation (CEC),
User Cooperation via Rateless Coding Mahyar Shirvanimoghaddam, Yonghui Li, and Branka Vucetic The University of Sydney, Australia IEEE GLOBECOM 2012 &
Threshold Phenomena and Fountain Codes Amin Shokrollahi EPFL Joint work with M. Luby, R. Karp, O. Etesami.
Stochastic Multicast with Network Coding Ajay Gopinathan, Zongpeng Li Department of Computer Science University of Calgary ICDCS 2009, June , Montreal.
Kai-Chao Yang VCLAB, NTHU 1.  Unequal Error Protection Rateless Codes for Scalable Information Delivery in Mobile Networks (INFOCOM 2007)  Rateless.
CprE 545 project proposal Long.  Introduction  Random linear code  LT-code  Application  Future work.
Andrew Liau, Shahram Yousefi, Senior Member, IEEE, and Il-Min Kim Senior Member, IEEE Binary Soliton-Like Rateless Coding for the Y-Network IEEE TRANSACTIONS.
Paper # – 2009 A Comparison of Heterogeneous Video Multicast schemes: Layered encoding or Stream Replication Authors: Taehyun Kim and Mostafa H.
LT Network Codes Mary-Luc Champel, Kevin Huguenin, Anne-Marie Kermarrec and Nicolas Le Scouarnec Technicolor, Rennes, France IEEE ICDCS (International.
UEP LT Codes with Intermediate Feedback Jesper H. Sørensen, Petar Popovski, and Jan Østergaard Aalborg University, Denmark IEEE COMMUNICATIONS LETTERS,
P2P streaming with LT codes: a prototype experimentation
A P2P-Based Architecture for Secure Software Delivery Using Volunteer Assistance Purvi Shah, Jehan-François Pâris, Jeffrey Morgan and John Schettino IEEE.
A Robust Luby Transform Encoding Pattern-Aware Symbol Packetization Algorithm for Video Streaming Over Wireless Network Dongju Lee and Hwangjun Song IEEE.
Multi-Edge Framework for Unequal Error Protecting LT Codes H. V. Beltr˜ao Neto, W. Henkel, V. C. da Rocha Jr. Jacobs University Bremen, Germany IEEE ITW(Information.
LightFlood: An Efficient Flooding Scheme for File Search in Unstructured P2P Systems Song Jiang, Lei Guo, and Xiaodong Zhang College of William and Mary.
On Reducing Mesh Delay for Peer- to-Peer Live Streaming Dongni Ren, Y.-T. Hillman Li, S.-H. Gary Chan Department of Computer Science and Engineering The.
Nour KADI, Khaldoun Al AGHA 21 st Annual IEEE International Symposium on Personal, Indoor and Mobile Radio Communications 1.
Efficient Resource Allocation for Wireless Multicast De-Nian Yang, Member, IEEE Ming-Syan Chen, Fellow, IEEE IEEE Transactions on Mobile Computing, April.
Hongjie Zhu,Chao Zhang,Jianhua Lu Designing of Fountain Codes with Short Code-Length International Workshop on Signal Design and Its Applications in Communications,
Buffer Analysis of Live P2P Media Streaming Approaches Atif Nazir BSc ’07, LUMS.
1 Hierarchical Parallelization of an H.264/AVC Video Encoder A. Rodriguez, A. Gonzalez, and M.P. Malumbres IEEE PARELEC 2006.
1 Implementation and performance evaluation of LT and Raptor codes for multimedia applications Pasquale Cataldi, Miquel Pedros Shatarski, Marco Grangetto,
PATH DIVERSITY WITH FORWARD ERROR CORRECTION SYSTEM FOR PACKET SWITCHED NETWORKS Thinh Nguyen and Avideh Zakhor IEEE INFOCOM 2003.
Coding for Multipath TCP: Opportunities and Challenges Øyvind Ytrehus University of Bergen and Simula Res. Lab. NNUW-2, August 29, 2014.
Accelerating Peer-to-Peer Networks for Video Streaming
An improved LT encoding scheme with extended chain lengths
CRBcast: A Collaborative Rateless Scheme for Reliable and Energy-Efficient Broadcasting in Wireless Sensor/Actuator Networks Nazanin Rahnavard, Badri N.
Presentation transcript:

1 rStream: Resilient and Optimal Peer-to-Peer Streaming with Rateless Codes Chuan Wu, Baochun Li Department of Electrical and Computer Engineering University of Toronto IEEE Transactions on Parallel and Distributed Systems, Vol. 19, No. 1, pp , January 2008

2 References Chuan Wu, Baochun Li. "rStream: Resilient Peer-to-Peer Streaming with Rateless Codes," in the Proceedings of ACM Multimedia 2005, pp , Singapore, November 6-12, [11] Chuan Wu, Baochun Li. “Optimal Peer Selection for Minimum- Delay Peer-to-Peer Streaming with Rateless Codes,” in Proc. of ACM Workshop on Advances in Peer-to-Peer Multimedia Streaming(P2PMMS 2005), in conjunction with ACM Multimedia 2005, November 2005.

3 Outline Introduction Resilient P2P streaming with rateless codes Optimal peer selection and rate allocation Performance evaluation Conclusion

4 Introduction Technical challenges of P2P streaming  Network dynamics  Limited bandwidth availability  Delivery redundancy  Content reconciliation The same content may be unnecessarily delivered by multiple upstream peers, the peer nodes need to reconcile the differences among the contents held by different upstream peers before downloading Contribution  Propose a peer-to-peer streaming protocol, rStream Combination of rateless codes and optimal peer selection Rateless codes  A sufficient number of coded blocks from any set of peers may be used to recover the original content.  LT codes [3], Raptor codes [4], and online codes[5] Optimal peer selection strategy  guarantee bandwidth availability  minimize end-to-end latency [3] M. Luby, “LT Codes,” in Proc. of the 43rd Symposium on Foundataions of Computer Science, November [4] A. Shokrollahi, “Raptor Codes,” in Proc. of the IEEE International Symposium on Information Theory (ISIT) 2004, June [5] P. Maymounkov and D. Mazieres, “Rateless Codes and Big Downloads,”in Proc. of the 2nd Int. Workshop Peer-to-Peer Systems (IPTPS),February 2003.

5 Resilient P2P streaming with rateless codes Mesh streaming topology  A peer-to-peer live streaming session with one streaming source and multiple participating receivers. Tree-based.  Each receiver peer is served by one or more peers in the upstream, and may serve one or more receivers in the downstream. Motivation of using rateless codes  Network dynamics  Content reconciliation.

6 Fig. 1. An illustration of the mesh topology and peer-to-peer streaming model.

7 Resilient P2P streaming with rateless codes Rateless codes possess the excellent property of simple and efficient encoding and decoding with XOR only operations. Rateless code can potentially provide a nearly unlimited number of unique coded symbols, it further decreases the probability of block conflicts among upstream nodes in the parallel retrievals.  Rateless codes are useful towards finding a solution to the content reconciliation problem.

8 Description of LT Code Luby Transform (LT) Codes:  Encoding process For the i th encoded symbol, select degree d i by Soliton distribution Choose d i source symbols Perform XOR on chosen symbols  Decoding process Decode degree-one encoded symbols Remove degree-one edges iteratively … x1x1 x2x2 x3x3 x4x4 x5x5 x6x6 y1y1 y2y2 y3y3 y4y4 y5y5 x1x3x1x3 x2x2 x2x5x2x5 x3x5x6x3x5x6 Degree 123…k probability μ1μ1 μ2μ2 μ3μ3 …μkμk x4x4

9 Description of LT Code LT process: A B D y1y1 y2y2 y4y4 A  B A B  D covered : in the ripple S processed unprocessed: L C The most likely degree of encoded symbols that get released: k/L y3y3 A  C  D

10 Description of LT Code The intuition for the degree distribution:  More small degree than large degree. Easy to be decoded.  One single degree-one encoded symbol can trigger the LT process. Ideal Soliton Distribution: k : number of total original symbols i : degree of encoded symbols

11 Description of LT Code Ideal Soliton Distribution: probability degree

12 Fig. 2. Peer-to-peer streaming with different coding schemes: an example.

13 The rateless recoding protocol

14 Resilient P2P streaming with rateless codes Simulate a 300 Kbps live streaming session on random networks generated with BRITE [7] based on power-law degree distributions. Assume no constraints of peer upload/download capacities in this study. Heuristically assign transmission rates on the links to provide an aggregate receiving rate of 300 Kbps at each peer. [7] A. Medina, A. Lakhina, I. Matta, and J. Byers, “BRITE: Boston University Representative Internet Topology Generator,” Tech. Rep., 2000.

15 Fig. 3. Comparison of average streaming rates in large peer-to-peer streaming networks with 4 different coding schemes.

16 Optimal peer selection and rate allocation We seek to answer a question that is critical to any peer-to-peer streaming schemes:  In a mesh peer-to-peer network, what is the best way to select upstream peers and allocate transmission rates of the rateless-code coded streams, such that a specified streaming bit rate is satisfied and continuous playback is guaranteed at all the receivers? Formulate the problem as a linear optimization problem, and then design an efficient distributed optimal rate allocation algorithm.

17

18

19 Performance evaluation Simulation environment  The rStream protocols are written in the C++ programming language  Our implementation includes the rateless-code, based on the Robust Soliton distribution, encoder and decoder at each peer.  The implementation compile and run in all major UNIX variants  All our experiments are run on a high-performance cluster 50 Dell 1425SC and Sun v20z dual-CPU servers, each equipped with dual Intel Pentium 4 Xeon 3.6GHz and dual AMD Opteron 250 processors.

20 Increasing trend for encoding and decoding speed as c increases and δ decreases The speed decreases with the increase of k (as the block degree increases), and increases with the increase of l

21 Performance evaluation Emulate realistic networks  All the initial mesh topologies used in our experiments are random networks generated with power-law degree distributions with the BRITE topology generator [7]. In each network, a 300 Kbps media bitstream is streamed from a streaming source with 10 Mbps of upload capacity. 2 classes of receivers:  ADSL/cable modem peers 70% of the total population with download capacities in the range of 512 Kbps ~ 3Mbps and upload capacities in the range of 200 ~ 800 Kbps  Ethernet peers Other 30% with both upload and download capacities in the range of 3 ~ 8 Mbps. [7] A. Medina, A. Lakhina, I. Matta, and J. Byers, “BRITE: Boston University Representative Internet Topology Generator,” Tech. Rep., 2000.

22 Fig. 6. Control message overhead in random networks of different sizes. Stream a 20-minute 300 Kbps media stream The average control messaging bandwidth consumed at each peer : The pull-push mechanism involves very low control message overhead.

23 Fig. 7. Convergence speed in static networks. The number of iterations executed by the iterative algorithm, Table IV, to converge to optimality. The number slowly increases with network sizes, and remains at the same level in a fixed-sized network with different edge densities.

24 Fig. 8. Convergence time in static networks of 300 peers and 2400 edges. The convergence to the primal feasible solution is usually much faster, and even the convergence to a feasible solution, which achieves 90% optimality, is 20% faster.

25 Fig. 9. Average end-to-end link latency: a comparison between rStream and a peer selection heuristic. In the peer selection heuristic, each receiver distributes the required streaming rate among its upstream peers in proportion to their upload capacities. The rStream optimal rate allocation algorithm achieves much lower latencies than the heuristic, in networks of various sizes and edge densities.

26 Fig. 10. Peer-to-peer streaming topologies of 20 peers: a comparison. [20] J. Li, “PeerStreaming: A Practical Receiver-Driven Peer-to-Peer Media Streaming System,” Microsoft Research MSR-TR , Tech. Rep., September Our optimal peer selection, receivers are streaming from the best upstream peers with minimal end-to-end latencies. The heuristic[20], peers simply distribute their streaming rate among upstream peers, which may lead to large end-to-end latencies.

27 Fig. 11. End-to-end streaming delay in random networks. (A) Average peer end-to-end streaming delay in networks of different sizes. (B) Cumulative density function of peer end-to-end streaming delays in a 500-peer network. (A) The overall end-to-end streaming delay at each peer is decided by the number of overlay hops that the peer is away from the source, as well as the delay on each hop. (B) The delay at most peers is moderate, and only a small portion of peers experience a relatively longer delay.

28 Fig. 12. Convergence speed in a dynamic network with up to 300 peers. The convergence to new optimal rates in such dynamic scenarios is much faster. The algorithm always takes less than 30 iterations (1 ~ 2 seconds) to converge.

29 Fig. 13. Average goodput in a dynamic streaming session with 200 peers: k = 100, l = 1KB, c = 0.05, δ = 0.1. throughput, the aggregate rate of receiving coded media bitstreams at a peer l × no. of coded blocks received in t / t goodput, the aggregate rate of deriving original media contents, i.e., the actual streaming rate l × no. of original blocks decoded in t / t No significant streaming rate fluctuations in all scenarios, i.e., the average goodput is steadily maintained around 300 Kbps.

30 Fig. 14. Average throughput/goodput in a dynamic streaming session with 200 peers: T = 60 seconds, D = 4. The value of εreflects the average percentage of extra coded blocks required for decoding under each set of coding parameter values, In actual streaming, the number of coded blocks used for successful recovery of each segment varies.

31 Fig. 14. Average throughput/goodput in a dynamic streaming session with 200 peers: T = 60 seconds, D = 4. Such streaming rate stability reveals the fact that the slight variation in the number of coded blocks used to decode different segments actually introduces little jitter in the streaming.

32 Conclusion Propose a peer-to-peer streaming protocol, rStream, which involves the combination of rateless codes and optimal peer selection. Propose an optimal peer selection strategy to guarantee bandwidth availability and to minimize end-to-end latency.

33 References [2] X. Zhang, J. Liu, B. Li, and T. P. Yum, “CoolStreaming/DONet: A Data-driven Overlay Network for Peer-to-Peer Live Media Streaming,” in Proc. of IEEE INFOCOM 2005, March [3] M. Luby, “LT Codes,” in Proc. of the 43rd Symposium on Foundataions of Computer Science, November [4] A. Shokrollahi, “Raptor Codes,” in Proc. of the IEEE International Symposium on Information Theory (ISIT) 2004, June [5] P. Maymounkov and D. Mazieres, “Rateless Codes and Big Downloads,”in Proc. of the 2nd Int. Workshop Peer-to-Peer Systems (IPTPS),February [7] A. Medina, A. Lakhina, I. Matta, and J. Byers, “BRITE: Boston University Representative Internet Topology Generator,” Tech. Rep., [11] Chuan Wu, Baochun Li. “Optimal Peer Selection for Minimum-Delay Peer-to-Peer Streaming with Rateless Codes,” in Proc. of ACM Workshop on Advances in Peer-to-Peer Multimedia Streaming(P2PMMS 2005), in conjunction with ACM Multimedia 2005, November Chuan Wu, Baochun Li. "rStream: Resilient Peer-to-Peer Streaming with Rateless Codes," in the Proceedings of ACM Multimedia 2005, pp , Singapore, November 6-12, [20] J. Li, “PeerStreaming: A Practical Receiver-Driven Peer-to-Peer Media Streaming System,” Microsoft Research MSR-TR , Tech. Rep., September [29] M. Adler, R. Kumar, K. W. Ross, D. Rubenstein, T. Suel, and D. D. Yao, “Optimal Peer Selection for P2P Downloading and Streaming,” in Proc. of IEEE INFOCOM 2005, March 2005.