Cataclysm: Handling Extreme Overloads in Internet Services

Slides:



Advertisements
Similar presentations
Queuing and Caching to Scalability James Kovacs
Advertisements

Module 12: Microsoft Windows 2000 Clustering. Overview Application of Clustering Technology Testing Tools.
CLOUD COMPUTING AN OVERVIEW & QUALITY OF SERVICE Hamzeh Khazaei University of Manitoba Department of Computer Science Jan 28, 2010.
U NIVERSITY OF M ASSACHUSETTS, A MHERST – Department of Computer Science Dynamic Provisioning for Multi-tier Internet Applications Bhuvan Urgaonkar, Prashant.
NETWORK LOAD BALANCING NLB.  Network Load Balancing (NLB) is a Clustering Technology.  Windows Based. (windows server).  To scale performance, Network.
A Case for Relative Differentiated Services and the Proportional Differentiation Model Constantinos Dovrolis Parameswaran Ramanathan University of Wisconsin-Madison.
1 Virtual Private Caches ISCA’07 Kyle J. Nesbit, James Laudon, James E. Smith Presenter: Yan Li.
Computer Science Scalability of Linux Event-Dispatch Mechanisms Abhishek Chandra University of Massachusetts Amherst David Mosberger Hewlett Packard Labs.
U NIVERSITY OF M ASSACHUSETTS, A MHERST – Department of Computer Science Dynamic Resource Allocation for Shared Data Centers Using Online Measurements.
Using Prices to Allocate Resources at Access Points Jimmy Shih, Randy Katz, Anthony Joseph One Administrative Domain Access Point A Access Point B Network.
LDU Parametrized Discrete-Time Multivariable MRAC and Application to A Web Cache System Ying Lu, Gang Tao and Tarek Abdelzaher University of Virginia.
U NIVERSITY OF M ASSACHUSETTS, A MHERST Department of Computer Science From Cloud Computing to Sensor Networks: Distributed Computing Research at LASS.
Computer Science Surplus Fair Scheduling: A Proportional-Share Scheduling Algorithm for Symmetric Multiprocessors Abhishek Chandra Micah Adler Pawan Goyal.
Capacity planning for web sites. Promoting a web site Thoughts on increasing web site traffic but… Two possible scenarios…
Admission Control and Dynamic Adaptation for a Proportional-Delay DiffServ-Enabled Web Server Yu Cai.
Chapter 2 Client Server Architecture
23 September 2004 Evaluating Adaptive Middleware Load Balancing Strategies for Middleware Systems Department of Electrical Engineering & Computer Science.
1 Latency Equalization: A Programmable Routing Service Primitive Minlan Yu Joint work with Marina Thottan, Li Li at Bell Labs.
Towards Autonomic Hosting of Multi-tier Internet Services Swaminathan Sivasubramanian, Guillaume Pierre and Maarten van Steen Vrije Universiteit, Amsterdam,
Resource Management in Virtualization-based Data Centers Bhuvan Urgaonkar Computer Systems Laboratory Pennsylvania State University Bhuvan Urgaonkar Computer.
Computer Science Cataclysm: Policing Extreme Overloads in Internet Applications Bhuvan Urgaonkar and Prashant Shenoy University of Massachusetts.
AGILE, DYNAMIC PROVISIONING OF MULTITIER INTERNET APPLICATIONS Bhuvan Urgaonkar, Prashant Shenoy, Abhishek Chandray, and Pawan Goyal ACM Transactions on.
GETTING WEB READY Introduction to Web Hosting. Table of Contents + Websites: The face of your business …………………………………………………………………………1 + Get your website.
Computer Science 1 Resource Overbooking and Application Profiling in Shared Hosting Platforms Bhuvan Urgaonkar Prashant Shenoy Timothy Roscoe † UMASS Amherst.
SEDA: An Architecture for Well-Conditioned, Scalable Internet Services
Applying Feedback Control to QoS management - an introduction -
Database Replication Policies for Dynamic Content Applications Gokul Soundararajan, Cristiana Amza, Ashvin Goel University of Toronto EuroSys 2006: Leuven,
U NIVERSITY OF M ASSACHUSETTS, A MHERST – Department of Computer Science An Analytical Model for Multi-tier Internet Services and its Applications Bhuvan.
IISWC 2007 Panel Benchmarking in the Web 2.0 Era Prashant Shenoy UMass Amherst.
CS 447 Network & Data Communication QoS (Quality of Service) & DiffServ Introduction Department of Computer Science Southern Illinois University Edwardsville.
Applicazione del paradigma Diffserv per il controllo della QoS in reti IP: aspetti teorici e sperimentali Stefano Salsano Università di Roma “La Sapienza”
Mechanisms for Quality of Service in Web Clusters V. Cardellini, E. Casalicchio, S.Tucci M. Colajanni University of Roma “Tor Vergata” University of Modena.
An Operating System Made for E-commerce --On Windows 2000 Advanced Server’s Enterprise-Readiness A Presentation A Presentationfor COSC 513: Operating Systems.
Computer Science 1 Resource Overbooking and Application Profiling in Shared Hosting Platforms Bhuvan Urgaonkar Prashant Shenoy Timothy Roscoe † UMASS Amherst.
A dynamic optimization model for power and performance management of virtualized clusters Vinicius Petrucci, Orlando Loques Univ. Federal Fluminense Niteroi,
Design and Evaluation of a Model for Multi-tiered Internet Applications Bhuvan Urgaonkar Internship project talk – Services Management Middleware Dept,
1 Admission Control and Request Scheduling in E-Commerce Web Sites Sameh Elnikety, EPFL Erich Nahum, IBM Watson John Tracey, IBM Watson Willy Zwaenepoel,
Computer Science Dynamic Resource Management in Internet Data Centers Prashant Shenoy University of Massachusetts.
U NIVERSITY OF M ASSACHUSETTS, A MHERST – Department of Computer Science Dynamic Resource Management in Internet Data Centers Bhuvan Urgaonkar Laboratory.
1 Agility in Virtualized Utility Computing Hangwei Qian, Elliot Miller, Wei Zhang Michael Rabinovich, Craig E. Wills {EECS Department, Case Western Reserve.
U NIVERSITY OF M ASSACHUSETTS, A MHERST – Department of Computer Science Dynamic Resource Management in Internet Hosting Platforms Ph.D. Thesis Defense.
Packet switching Monil Adhikari. Packet Switching Packet switching is the method by which the internet works, it features delivery of packets of data.
Friendly Virtual Machines Zhang,Bestavros etc., Boston Univ. ACM/USENIX VEE 2005 CSE 598c April 17, 2006 Bhuvan Urgaonkar CSE 598c April 17, 2006 Bhuvan.
Capsule Placement in the Service Platform Bhuvan Urgaonkar Timothy Roscoe Systems Group, Sprint ATL.
INTRODUCTION TO WEB HOSTING
Prashant Shenoy Lab Description Seminar 2009
Software defined networking: Experimental research on QoS
Douglas Potter IBI Minneapolis User Group November 2008
CIIT-Human Computer Interaction-CSC456-Fall-2015-Mr
Scale and Performance in the CoBlitz Large-File Distribution Service
Network Load Balancing
Regulating Data Flow in J2EE Application Server
Working at a Small-to-Medium Business or ISP – Chapter 7
Load Balancing Memcached Traffic Using SDN
Working at a Small-to-Medium Business or ISP – Chapter 7
Top Percentile Pricing and the Economics of Multi-Homing
Dynamic Provisioning for Multi-tier Internet Applications
Parallel I/O System for Massively Parallel Processors
Working at a Small-to-Medium Business or ISP – Chapter 7
Design of Multi-Service Networks with Multicast Support
AMP: A Better Multipath TCP for Data Center Networks
DotSlash: An Automated Web Hotspot Rescue System
Web switch support for differentiated services
Admission Control and Request Scheduling in E-Commerce Web Sites
Congestion Control in SDN-Enabled Networks
An Overview of Virtual Machine Architectures
Specialized Cloud Architectures
Performance and Scalability Issues of Multimedia Digital Library
Congestion Control in SDN-Enabled Networks
The Zero-Trust Model Redefining InfoSec.
Presentation transcript:

Cataclysm: Handling Extreme Overloads in Internet Services Bhuvan Urgaonkar and Prashant Shenoy University of Massachusetts Amherst Good morning. I am Bhuvan Urgaonkar from UMASS Amherst. The title of my paper is … This is joint work with my advisor PS and Timothy Roscoe from Intel Reserach.

Overloads in Internet Applications Bottleneck! Ecommerce app Internet apps experience overloads E.g. 20 fold increase in CNN traffic on 9/11 Goal: Handle overloads without app downtime Let me begin by providing the motivation behind this work. During the past few years there has been a proliferation of Internet applications. Examples of such applications include ecommerce applications, streaming media servers, online game servers etc. Due to falling hardware prices and improvements in networking technology, clusters of commodity servers have become a popular alternative to large multiprocessors for hosting these applications. Key idea: Scalable policing & provisioning

Cataclysm Components Provisioner: Queuing theoretic app models Add servers to overloaded apps Policer: Differentiated service and scalability Admit important requests during overload d2 > d1 d1 Admitted d2 Admission Control Dropped Classifier Switch to approx. admission control at high loads Even higher loads => multiple sentries, DNS RR

Cataclysm Policer Admits important requests during overloads Admitted requests see good response time Arrival rate 50 100 150 200 250 300 400 500 600 Time (sec) GLD SIL BRZ Fraction admitted 0.2 0.4 0.6 0.8 1 1.2 100 200 300 400 500 600 Time (sec) GLD SIL BRZ Single policer: arrival rates upto 19,000 req/s Can add more policers at higher loads

Concluding Remarks The Cataclysm hosting platform Scalable policer Dynamic provisioning of servers Implementation on Linux cluster of size 20 Experimentation with variety of workloads

More information: http://lass.cs.umass.edu/papers.html Thank you!