A Hierarchical Characterization of a Live Streaming Media Workload E. Veloso, V. Almeida W. Meira, A. Bestavros, S. Jin Proceedings of Internet Measurement.

Slides:



Advertisements
Similar presentations
Inktomi Confidential and Proprietary The Inktomi Climate Lab: An Integrated Environment for Analyzing and Simulating Customer Network Traffic Stephane.
Advertisements

Doc.: IEEE /1216r1 Submission November 2009 BroadcomSlide 1 Internet Traffic Modeling Date: Authors: NameAffiliationsAddressPhone .
CLive Cloud-Assisted P2P Live Streaming
Confused, Timid, and Unstable: Picking a Video Streaming Rate is Hard Published in 2012 ACM’s Internet Measurement Conference (IMC) Five students from.
Doc.: IEEE /0604r1 Submission May 2014 Slide 1 Modeling and Evaluating Variable Bit rate Video Steaming for ax Date: Authors:
Distributed Multimedia Systems
Computer Science Generating Streaming Access Workload for Performance Evaluation Shudong Jin 3nd Year Ph.D. Student (Advisor: Azer Bestavros)
Measurement, Modeling, and Analysis of a Peer-2-Peer File-Sharing Workload Presented For Cs294-4 Fall 2003 By Jon Hess.
1 10 Web Workload Characterization Web Protocols and Practice.
GlobeTraff A traffic workload generator for the performance evaluation of ICN architectures K.V. Katsaros, G. Xylomenos, G.C. Polyzos A.U.E.B. (presented.
Measurements of Congestion Responsiveness of Windows Streaming Media (WSM) Presented By:- Ashish Gupta.
An Empirical Study of Real Audio Traffic A. Mena and J. Heidemann USC/Information Sciences Institute In Proceedings of IEEE Infocom Tel-Aviv, Israel March.
A Peer-to-Peer On-Demand Streaming Service and Its Performance Evaluation Presenter: Nera Liu Author: Yang Guo, Kyoungwon Suh, Jim Kurose and Don Towsley.
FABIAN SCHNEIDER, SACHIN AGARWAL,TANSU ALPCAN, AND ANJA FELDMANN DEUTSCHE TELEKOM LABORATORIES/TECHNISCHE UNIVERSITAT BERLIN BERLIN, GERMANY ΣΗΜΑΝΤΗΡΑΚΗ.
Application layer (continued) Week 4 – Lecture 2.
An Analysis of Internet Content Delivery Systems Stefan Saroiu, Krishna P. Gommadi, Richard J. Dunn, Steven D. Gribble, and Henry M. Levy Proceedings of.
Improving Proxy Cache Performance: Analysis of Three Replacement Policies Dilley, J.; Arlitt, M. A journal paper of IEEE Internet Computing, Volume: 3.
Network Traffic Measurement and Modeling CSCI 780, Fall 2005.
Looking at the Server-side of P2P Systems Yi Qiao, Dong Lu, Fabian E. Bustamante and Peter A. Dinda Department of Computer Science Northwestern University.
A Hierarchical Characterization of a Live Streaming Media Workload IEEE/ACM Trans. Networking, Feb Eveline Veloso, Virg í lio Almeida, Wagner Meira,
Performance Evaluation of Peer-to-Peer Video Streaming Systems Wilson, W.F. Poon The Chinese University of Hong Kong.
Traffic Characterization Dr. Abdulaziz Almulhem. Almulhem©20012 Agenda Traffic characterization Switching techniques Internetworking, again.
Copyright © 2005 Department of Computer Science CPSC 641 Winter Network Traffic Measurement A focus of networking research for 20+ years Collect.
1 Lecture 24: Interconnection Networks Topics: communication latency, centralized and decentralized switches (Sections 8.1 – 8.5)
1 Measurement-based Characterization of a Collection of On-line Games Chris Chambers Wu-chang Feng Portland State University Sambit Sahu Debanjan Saha.
IEEE 7th Annual Workshop on Workload Characterization The USAR Characterization Model Adriano Pereira, Gustavo Gorgulho, Leonardo Silva, Wagner Meira Jr.,
A Hybrid Caching Strategy for Streaming Media Files Jussara M. Almeida Derek L. Eager Mary K. Vernon University of Wisconsin-Madison University of Saskatchewan.
Adaptive Content Delivery for Scalable Web Servers Authors: Rahul Pradhan and Mark Claypool Presented by: David Finkel Computer Science Department Worcester.
1 An Information Theoretic Approach to Network Trace Compression Y. Liu, D. Towsley, J. Weng and D. Goeckel.
Investigating Forms of Simulating Web Traffic Yixin Hua Eswin Anzueto Computer Science Department Worcester Polytechnic Institute Worcester, MA.
On-Demand Media Streaming Over the Internet Mohamed M. Hefeeda, Bharat K. Bhargava Presented by Sam Distributed Computing Systems, FTDCS Proceedings.
1 Efficient Management of Data Center Resources for Massively Multiplayer Online Games V. Nae, A. Iosup, S. Podlipnig, R. Prodan, D. Epema, T. Fahringer,
Can Internet Video-on-Demand Be Profitable? SIGCOMM 2007 Cheng Huang (Microsoft Research), Jin Li (Microsoft Research), Keith W. Ross (Polytechnic University)
Add image. 3 “ Content is NOT king ” today 3 40 analog cable digital cable Internet 100 infinite broadcast Time Number of TV channels.
1 Measurement-based Characterization of a Collection of On-line Games Chris Chambers Wu-chang Feng Portland State University Sambit Sahu Debanjan Saha.
Self-Similarity of Network Traffic Presented by Wei Lu Supervised by Niclas Meier 05/
Network Traffic Modeling Punit Shah CSE581 Internet Technologies OGI, OHSU 2002, March 6.
Traffic Modeling.
1 CMSCD1011 Introduction to Computer Audio Lecture 10: Streaming audio for Internet transmission Dr David England School of Computing and Mathematical.
FALL 2012 DSCI5240 Graduate Presentation By Xxxxxxx.
1 An SLA-Oriented Capacity Planning Tool for Streaming Media Services Lucy Cherkasova, Wenting Tang, and Sharad Singhal HPLabs,USA.
1 Cache Me If You Can. NUS.SOC.CS5248 OOI WEI TSANG 2 You Are Here Network Encoder Sender Middlebox Receiver Decoder.
Distributing Layered Encoded Video through Caches Authors: Jussi Kangasharju Felix HartantoMartin Reisslein Keith W. Ross Proceedings of IEEE Infocom 2001,
Segment-Based Proxy Caching of Multimedia Streams Authors: Kun-Lung Wu, Philip S. Yu, and Joel L. Wolf IBM T.J. Watson Research Center Proceedings of The.
An Efficient Approach for Content Delivery in Overlay Networks Mohammad Malli Chadi Barakat, Walid Dabbous Planete Project To appear in proceedings of.
The Case for Persistent-Connection HTTP Telecommunication System LAB 최 명길 Western Research Laboratory Research Report 95/4 (Proceedings of the SIGCOMM.
ACM NOSSDAV 2007, June 5, 2007 IPTV Experiments and Lessons Learned Panelist: Klara Nahrstedt Panel: Large Scale Peer-to-Peer Streaming & IPTV Technologies.
Performance of HTTP Application in Mobile Ad Hoc Networks Asifuddin Mohammad.
Distributed Maintenance of Cache Freshness in Opportunistic Mobile Networks Wei Gao and Guohong Cao Dept. of Computer Science and Engineering Pennsylvania.
1 Challenges in Scaling E-Business Sites  Menascé and Almeida. All Rights Reserved. Daniel A. Menascé Department of Computer Science George Mason.
03/11/2015 Michael Chai; Behrouz Forouzan Staffordshire University School of Computing Streaming 1.
Internet Measurment Multimedia 1. Properties Challenges Tools State of the Art 2.
Carnegie Mellon University Computer Science Department 1 OPEN VERSUS CLOSED: A CAUTIONARY TALE Bianca Schroeder Adam Wierman Mor Harchol-Balter Computer.
Unconstrained Endpoint Profiling Googling the Internet Ionut Trestian, Supranamaya Ranjan, Alekandar Kuzmanovic, Antonio Nucci Reviewed by Lee Young Soo.
Scheduled Video Delivery—A Scalable On-Demand Video Delivery Scheme Min-You Wu, Senior Member, IEEE, Sujun Ma, and Wei Shu, Senior Member, IEEE Speaker:
1 Part VII Component-level Performance Models for the Web © 1998 Menascé & Almeida. All Rights Reserved.
Measuring the Capacity of a Web Server USENIX Sympo. on Internet Tech. and Sys. ‘ Koo-Min Ahn.
A Measurement Based Memory Performance Evaluation of Streaming Media Servers Garba Isa Yau and Abdul Waheed Department of Computer Engineering King Fahd.
1 Internet Traffic Measurement and Modeling Carey Williamson Department of Computer Science University of Calgary.
-1- System Software Research Lab. Resource Management Policies for E-commerce Servers Daniel A. Menasce, Virgilio A. F. Almeida 2 nd Workshop on Internet.
Does Internet media traffic really follow the Zipf-like distribution? Lei Guo 1, Enhua Tan 1, Songqing Chen 2, Zhen Xiao 3, and Xiaodong Zhang 1 1 Ohio.
Computer Networks Bhushan Trivedi, Director, MCA Programme, at the GLS Institute of Computer Technology, Ahmadabad.
Implementing a Load-balancing Web Server Using Red Hat Cluster Suite
Evaluation of Load Balancing Algorithms and Internet Traffic Modeling for Performance Analysis By Arthur L. Blais.
A tool for locating QoS failures on an Internet path
Feifei Li, Ching Chang, George Kollios, Azer Bestavros
Network Traffic Modeling
Measurement-based Characterization of a Collection of On-line Games
Transport Layer Identification of P2P Traffic
Resource Sharing with Subexponential Distributions
Presentation transcript:

A Hierarchical Characterization of a Live Streaming Media Workload E. Veloso, V. Almeida W. Meira, A. Bestavros, S. Jin Proceedings of Internet Measurement Workshop, ACM SIGCOMM, Nov. 2002

2 Outline Introduction Data Collection Client Layer Characteristics Session Layer Characteristics Transport Layer Characteristics Conclusions

3 Introduction Workload characterization is important for Performance evaluation and prediction Capacity planning Rejecting client for a live stream is not a viable solution Value of live streams is the liveness Lose paying customers

4 Introduction Only a small number of studies on characterizing pre-recorded streaming media workloads This paper provides a characterization for live streams

5 Introduction Compare to Stored streams, Live streams exhibit Stronger temporal patterns of workload Fewer possible VCR functions Less correlations between different variables Users are less likely to stop viewing when QoS degrades

6 Data Collection A popular live show in Brazil “Reality TV Show” in early 2002, last for 90 days The live streams provided feeds captured from one of the cameras embedded in the environment surrounding the contestants

7 Data Collection For each entry of the log, it contains Client identification—e.g., IP address, player ID Client environment specification—e.g., OS version, CPU Requested object identification—e.g., URI of stream Transfer statistics—e.g., loss rate, average bandwidth Server load statistics—e.g., server CPU utilization Other information—e.g., referer URI, HTTP status Timestamp in seconds of when log entry was generated.

8 Data Collection

9 Client Layer Characteristics Focus on the characteristics of the client population Clients are identified by the unique player ID

10 Client Topological and Geographical Distribution Follow a Zipf profile with parameter α=1.29, 1.49 and 5.4 respectively

11 Temporal behavior of number of active clients Diurnal Effect on the live content Periodic Depends on the day of week

12 Client Arrival Process Client arrival process is not poisson Can be estimated by a sequence of piece-wise-stationary Poisson arrival processes Interarrival time of clients from logs Interarrival time of a piece-wise-stationary Poission process

13 Client Interest Profile Using transfer frequency as a measure of client interest in the content Client interest in a single object follows a Zipf distirbution

14 Session Layer Characteristics Focus on individual client activity The trace does not explicitly identify the delimiters of a session The authors choose a session timeout parameter T off to determine the number of sessions T off = 3600 seconds

15 Session ON/OFF Time ON times are highly variable Due to live content instead of temporal behaviors Lognormal OFF times form ripples around specific values In multiple of days => revisting daily or every two days Exponential Session ON Time vs Session starting time

16 Transport Layer Characteristics Focus on individual unicast data transfers Temporal behavior of no. of concurrent transfers Periodic over a weekly and daily period Similar to the temporal behavior of no. of active clients

17 Temporal behavior of transfer interarrival times Request arrival process is also periodic and non-stationary Due to the diurnal behavior

18 Transfer Length & Client Stickiness Similar to the session ON time The long tail shows the willingness of the client to “stick” to the live object

19 Transfer Bandwidth Bounded by client connection speed Bounded by congestion

20 Representativeness of Findings Compared the findings with another live show “Live News & Sports” Sport news & soccer players interviews requests from distinct clients within 2 weeks interarrival times depends on the content

21 Conclusions Client Layer Arrival process can be modeled by a piece-wise stationary Poisson process Identity of the client making a request can be modeled by a Zipf distribution Session Layer ON times follows Lognormal distribution OFF times follows exponential distribution Transfer Layer Arrival process can be modeled by a piece-wise stationary Poisson process Transfer bandwidth is primarily determined by client connection speed while 10% of transfers are being severely limited by congestion

22 Comments Piece-wise Poisson Process A good way to model the client arrival process But we need a priori knowledge of the average client arrival rate with a number of short period The client arrival pattern also depends on the content Hard to be used