CLAudit : Planetary-Scale Cloud Latency Auditing Platform Ondrej Tomanek ( ) Lukas Kencl ( ) Czech Technical.

Slides:



Advertisements
Similar presentations
SIM212 Service Management in Clouds Self-Service -- Metered -- Elastic (Key Tenets) Multi-tenant -- Automation -- Scalable Datacenter Admin Service.
Advertisements

Challenges Facing Enterprise IT REDUCED MANAGEMENT NEW ECONOMICS INCREASED OPPORTUNITIES.
1/20 Cloud Computing SLAs in FP7 Bruxelles, May 27, 2013 mPlane – an Intelligent Measurement Plane for Future Network and Application Management MPLANE.
Achieving Elasticity for Cloud MapReduce Jobs Khaled Salah IEEE CloudNet 2013 – San Francisco November 13, 2013.
Power BI Sites and Mobile BI. What You Will Learn Sharing and Collaboration Introducing Power BI Exploring Power BI Features and Services Partner Opportunities.
Hydra Partners Meeting March 2012 Bill Branan DuraCloud Technical Lead.
4/16/2017 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.
w/ Service Provider Foundation & Service Management Automation VMs, Networks, Automation Service Bus Database SQL Sever MySQL Web Sites Services Plans.
Finding Data for Quantitative Analysis Lecture 11.
Bandwidth Measurements for VMs in Cloud Amit Gupta and Rohit Ranchal Ref. Cloud Monitoring Framework by H. Khandelwal, R. Kompella and R. Ramasubramanian.
Cloud Computing Systems Lin Gu Hong Kong University of Science and Technology Sept. 21, 2011 Windows Azure—Overview.
Business Intelligence: The Next Big Thing (Really!) John Bair CTO, Ajilitee Sep 14, 2012 Presented to TDWI St. Louis Chapter.
Pricing Changes MSDN subscriptions Stand- alone tool Team collaboration Release management Visual Studio Team Foundation Server Device CAL Visual Studio.
Security Framework For Cloud Computing -Sharath Reddy Gajjala.
New Generation SDI and Cyber-Infrastructure Prof. Guoqing Li CEODE/CAS March 29, 2009, Newport Beach, USA Presented to 4th China-US Roundtable Meeting.
1 Performability Models for Designing Disaster Tolerant Cloud Computing Systems.
Dependability Models for Designing Disaster Tolerant Cloud Computing Systems.
MPlane – Building an Intelligent Measurement Plane for the Internet Maurizio Dusi – NEC Laboratories Europe NSF Workshop on perfSONAR.
Processing and Analyzing Large log from Search Engine Meng Dou 13/9/2012.
The New Era of Hybrid IT Infrastructure & Platforms – Vision Session AP001.
An Overlay Architecture for High Quality VoIP Streams IEEE Trans. on Multimedia 2006 R 翁郁婷 R 周克遠.
A Performance Evaluation of Azure and Nimbus Clouds for Scientific Applications Radu Tudoran KerData Team Inria Rennes ENS Cachan 10 April 2012 Joint work.
Collaborative Product Adoption Speed the Sales Process for Faster Time to Revenue.
Jan – Apr 2012 Private Cloud Day System Center 2012 announced Microsoft Management Summit System Center 2012 General Availability Windows Server 2012.
Lets agree that an Optimized Data Center is not yet a Cloud +=
Cloud Computing.
Microsoft Virtual Academy.
Department of Information Engineering The Chinese University of Hong Kong A Framework for Monitoring and Measuring a Large-Scale Distributed System in.
Welcome & Introductions
Available via NuGet independently, major revisions infrequent and with minimal breaking changes, sole dependency for each MAML library. Contains HTTP,
Pradeep Kumar C Support Escalation Engineer Windows Azure Diagnostics Logging and Monitoring in the Cloud.
A Light-Weight Distributed Scheme for Detecting IP Prefix Hijacks in Real-Time Lusheng Ji†, Joint work with Changxi Zheng‡, Dan Pei†, Jia Wang†, Paul Francis‡
Plethora: A Wide-Area Read-Write Storage Repository Design Goals, Objectives, and Applications Suresh Jagannathan, Christoph Hoffmann, Ananth Grama Computer.
1 Media Grid Initiative By A/Prof. Bu-Sung Lee, Francis Nanyang Technological University.
Configuring the ArcGIS for Emergency Management Damage Assessment Solution in Your Organization John Hauck.
 container for multiple resources  resources exist in one* resource group  resource groups can span regions  resource groups can span services.
Datalayer Notebook Allows Data Scientists to Play with Big Data, Build Innovative Models, and Share Results Easily on Microsoft Azure MICROSOFT AZURE ISV.
Clusters, Fault Tolerance, and Other Thoughts Daniel S. Katz JPL/Caltech SOS7 Meeting 4 March 2003.
Background Real-time environmental monitoring is a field garnering an ever-increasing amount of attention. The ability for sensors to make and publish.
Windows Azure Enterprises. Table of contents Introduction and Cloud Platform Basics Azure infrastructure scenarios Scenarios for Custom Applications on.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California ArcGIS for Land Records:
+ Logentries Is a Real-Time Log Analytics Service for Aggregating, Analyzing, and Alerting on Log Data from Microsoft Azure Apps and Systems MICROSOFT.
Scalability == Capacity * Density.
Tapio Levä & Antti Riikonen, Aalto University IEEE-SIIT 2013, 24–26 September 2013, Sophia-Antipolis, France Diffusion.
Windows Azure poDRw_Xi3Aw.
Microsoft Virtual Academy Module 12 Managing Services with VMM and App Controller.
A Lap around Azure API Apps. Customer Challenges What are API Apps? Creating and Consuming an API App using VS Adding authentication API Connectors Swagger.
Datazen – an overview Frank Geisler Please Support Our Sponsors SQL Saturday is made possible with the generous support of these sponsors.
Capacity Planning For the Hybrid Cloud From an infrastructure owner’s perspective.
SIP6 Platform Updates Based on CNGI-CERNET2 Network Research Center Tsinghua University.
AppAudit Effective Real-time Android Application Auditing Andrew Jeong
Lehrstuhl Informatik 5 (Informationssysteme) Prof. Dr. M. Jarke I5-KRKC MCC 2010 Dejan Kovachev Dominik Renzel Ralf Klamma Yiwei Cao Mobile Community.
© 2014 VMware Inc. All rights reserved. Dynatrace for vCloud Air High-level Overview Dynatrace 10/21/2014.
A Seminar On. What is Cloud Computing? Distributed computing on internet Or delivery of computing service over the internet. Eg: Yahoo!, GMail, Hotmail-
A Collaborative Quality Ranking Framework for Cloud Components
Latency of EMIR in Multi-Tier Deployment
Microsoft Virtual Academy
Transition Your SharePoint Designer Workflows to Microsoft Flow
World-Leading Research with Real-World Impact!
Scalable and Worldwide Cloud Platform Powers Expansion for White-Label Mobile TV Solution MINI-CASE STUDY “Microsoft Azure played a vital role in the design.
Replace with Application Image
دانشگاه شهیدرجایی تهران
تعهدات مشتری در کنوانسیون بیع بین المللی
Pramod Bhatotia, Ruichuan Chen, Myungjin Lee
Technical Resources & Training
Office 365 Development July 2014.
AOP Ad Blocking Audit (May 2018)
National Monitoring and Reporting System
What’s New for Developers in Office and SharePoint
Microsoft Data Insights Summit
Presentation transcript:

CLAudit : Planetary-Scale Cloud Latency Auditing Platform Ondrej Tomanek ( ) Lukas Kencl ( ) Czech Technical University in Prague Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform

Agenda Background Motivation CLAudit Measurements Anomaly showcase Conclusion Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform 2

Cloud service Cloud computing, Cloud service, Cloud application Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform 3

Cloud service latency Latency: sum of delays, semi-bounded, variable Service latency: made out of many sub-latencies Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform 4 4

Motivation Cloud service latency lacks a model Performance troubleshooting is nontrivial Emerging apps, Suboptimal practices, Overlay services Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform 5 TOOL What we need is a...

CLAudit - deployment Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform 6 Clients (Planetlab) AppServers (Azure) DBservers (Azure) Monitor (CTU)

CLAudit - components Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform 7 DATA CENTER

Measurements 8 Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform

Measurements - notes Measured variables Preprocessing Setup: – 3 minutes period – 5 probes of each type sent – median (and min) recorded – millisec precision – lost sample = 0 millisec 1 month = ~ 400 MB dataset Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform 9

Measurements - example Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform 10 Chicago

Anomaly showcase 11 Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform

Anomaly showcase – ‘HTTP spike’ Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform 12 Chicago

Anomaly showcase – ‘Periodic behavior’ Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform 13 Hong KongDublin

The paper contains: - more examples - more anomalies - event analyses 14 Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform

Future directions Latency model Representativeness – mobility, multiple VMs SDN & Realtime processing Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform 15 Conclusion Novel planetary-scale distributed approach to latency monitoring: – Allows for data interpretation and event reasoning – Helps Cloud users – Helps Cloud tenants – Helps Cloud providers

Thank you for attention Tomanek, Kencl: CLAudit - Planetary-Scale Cloud Latency Auditing Platform – published at IEEE Cloudnet 2013, San Francisco, USA The data are available for use (open license) We’re looking for partners and collaborators 16