Managing Web Server Performance with AutoTune Agents by Y. Diao, J. L. Hellerstein, S. Parekh, J. P. Bigus Presented by Changha Lee.

Slides:



Advertisements
Similar presentations
IBM T.J. Watson Research Center Sigmetrics 2008 Tutorial: Introduction to Control Theory and Its Application to Computing Systems Self-Tuning Memory Management.
Advertisements

Managing Web server performance with AutoTune agents by Y. Diao, J. L. Hellerstein, S. Parekh, J. P. Bigu Jangwon Han Seongwon Park
Performance Testing - Kanwalpreet Singh.
SLA-Oriented Resource Provisioning for Cloud Computing
Sogang University ICC Lab Using Game Theory to Analyze Wireless Ad Hoc networks.
A Server-less Architecture for Building Scalable, Reliable, and Cost-Effective Video-on-demand Systems Jack Lee Yiu-bun, Raymond Leung Wai Tak Department.
Online Educational Game of Snakes and Ladders -Shalini Pradhan -Manali Joshi -Uttara Paingankar -Seema Joshi.
Chapter 4 M. Keshtgary Spring 91 Type of Workloads.
Toolbox Mirror -Overview Effective Distributed Learning.
Web Caching Schemes1 A Survey of Web Caching Schemes for the Internet Jia Wang.
Dynamic Process Allocation in Apache Server Yu Cai.
Differentiated Multimedia Web Services Using Quality Aware Transcoding S. Chandra, C.Schlatter Ellis and A.Vahdat InfoCom 2000, IEEE Journal on Selected.
A Hybrid Caching Strategy for Streaming Media Files Jussara M. Almeida Derek L. Eager Mary K. Vernon University of Wisconsin-Madison University of Saskatchewan.
Adaptive Content Delivery for Scalable Web Servers Authors: Rahul Pradhan and Mark Claypool Presented by: David Finkel Computer Science Department Worcester.
1 Sonia Fahmy Ness Shroff Students: Roman Chertov Rupak Sanjel Center for Education and Research in Information Assurance and Security (CERIAS) Purdue.
Yaksha: A Self-Tuning Controller for Managing the Performance of 3-Tiered Web Sites Abhinav Kamra, Vishal Misra CS Department Columbia University Erich.
LDU Parametrized Discrete-Time Multivariable MRAC and Application to A Web Cache System Ying Lu, Gang Tao and Tarek Abdelzaher University of Virginia.
© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice Automated Workload Management in.
CH 1 Introduction Prof. Ming-Shaung Ju Dept. of Mechanical Engineering NCKU.
CS Spring 2012 CS 414 – Multimedia Systems Design Lecture 34 – Media Server (Part 3) Klara Nahrstedt Spring 2012.
February 11, 2003Ninth International Symposium on High Performance Computer Architecture Memory System Behavior of Java-Based Middleware Martin Karlsson,
Web Server Load Balancing/Scheduling Asima Silva Tim Sutherland.
23 September 2004 Evaluating Adaptive Middleware Load Balancing Strategies for Middleware Systems Department of Electrical Engineering & Computer Science.
Towards Autonomic Hosting of Multi-tier Internet Services Swaminathan Sivasubramanian, Guillaume Pierre and Maarten van Steen Vrije Universiteit, Amsterdam,
A Self-tuning Page Cleaner for the DB2 Buffer Pool Wenguang Wang Rick Bunt Department of Computer Science University of Saskatchewan.
Generating Adaptation Policies for Multi-Tier Applications in Consolidated Server Environments College of Computing Georgia Institute of Technology Gueyoung.
Ajou University, South Korea ICSOC 2003 “Disconnected Operation Service in Mobile Grid Computing” Disconnected Operation Service in Mobile Grid Computing.
Krerk Piromsopa. Advance Net-Centric Computing Technology Krerk Piromsopa. Department of Computer Engineering. Chulalongkorn University.
© 2006 IBM Corporation Adaptive Self-Tuning Memory in DB2 Adam Storm, Christian Garcia-Arellano, Sam Lightstone – IBM Toronto Lab Yixin Diao, M. Surendra.
M i SMob i S Mob i Store - Mobile i nternet File Storage Platform Chetna Kaur.
Computers on Cruise Control Creating Adaptive Systems with Control Theory Ricardo Portillo The University of Texas at El Paso
Service Computation 2010November 21-26, Lisbon.
Event Management & ITIL V3
1 Wenguang WangRichard B. Bunt Department of Computer Science University of Saskatchewan November 14, 2000 Simulating DB2 Buffer Pool Management.
© Lindsay Bradford1 Scaling Dynamic Web Content Provision Using Elapsed-Time- Based Content Degradation Lindsay Bradford, Stephen Milliner and.
1 Specification and Implementation of Dynamic Web Site Benchmarks Sameh Elnikety Department of Computer Science Rice University.
1 Distributed Energy-Efficient Scheduling for Data-Intensive Applications with Deadline Constraints on Data Grids Cong Liu and Xiao Qin Auburn University.
Performance of HTTP Application in Mobile Ad Hoc Networks Asifuddin Mohammad.
Heavy and lightweight dynamic network services: challenges and experiments for designing intelligent solutions in evolvable next generation networks Laurent.
A Web-based System for Maintaining a Departmental Personnel List and Telephone Directory Patrick R. Michaud Department of Computing and Mathematical Sciences.
Architecture for Caching Responses with Multiple Dynamic Dependencies in Multi-Tier Data- Centers over InfiniBand S. Narravula, P. Balaji, K. Vaidyanathan,
Deeply Embedded Large Scale Networks Specify and Control Emerging Behavior.
DotSlash: Handling Web Hotspots at Dynamic Content Web Sites Weibin Zhao Henning Schulzrinne Department of Computer Science Columbia.
Automated Control in Cloud Computing: Challenges and Opportunities Harold C. Lim, Shivnath Babu, Jeffrey S. Chase, and Sujay S. Parekh ACM’s First Workshop.
Managing the Performance Impact of Administrative Utilities Paper by S. Parekh,K. Rose, J.Hellerstein, S. Lightstone, M.Huras, and V. Chang Presentation.
1 Integrating security in a quality aware multimedia delivery platform Paul Koster 21 november 2001.
Managing Server Energy and Operational Costs Chen, Das, Qin, Sivasubramaniam, Wang, Gautam (Penn State) Sigmetrics 2005.
Providing Differentiated Levels of Service in Web Content Hosting Jussara Almeida, etc... First Workshop on Internet Server Performance, 1998 Computer.
1 Admission Control and Request Scheduling in E-Commerce Web Sites Sameh Elnikety, EPFL Erich Nahum, IBM Watson John Tracey, IBM Watson Willy Zwaenepoel,
Search Engine using Web Mining COMS E Web Enhanced Information Mgmt Prof. Gail Kaiser Presented By: Rupal Shah (UNI: rrs2146)
Apache Global Configuration Apache MPM (multi-processing modul) Common Directives.
Matlab Tutorial for State Space Analysis and System Identification
Performance Testing Test Complete. Performance testing and its sub categories Performance testing is performed, to determine how fast some aspect of a.
Autonomic Response to Distributed Denial of Service Attacks Paper by: Dan Sterne, Kelly Djahandari, Brett Wilson, Bill Babson, Dan Schnackenberg, Harley.
Author : Cedric Augonnet, Samuel Thibault, and Raymond Namyst INRIA Bordeaux, LaBRI, University of Bordeaux Workshop on Highly Parallel Processing on a.
Ensieea Rizwani An energy-efficient management mechanism for large-scale server clusters By: Zhenghua Xue, Dong, Ma, Fan, Mei 1.
Building an E-commerce Web Site
/ Fast Web Content Delivery An Introduction to Related Techniques by Paper Survey B Li, Chien-chang R Sung, Chih-kuei.
Providing Differentiated Levels of Service in Web Content Hosting J ussara Almeida, Mihaela Dabu, Anand Manikutty and Pei Cao First Workshop on Internet.
Advanced Higher Computing Science The Project. Introduction Worth 60% of the total marks for the course Must include: An appropriate interface using input.
Spark on Entropy : A Reliable & Efficient Scheduler for Low-latency Parallel Jobs in Heterogeneous Cloud Huankai Chen PhD Student at University of Kent.
Presenter: Kuei-Yu Hsu Advisor: Dr. Kai-Wei Ke 2013/9/30 Performance analysis of video streaming on different hybrid CDN & P2P infrastructure.
Advanced Higher Computing Science
Web Server Load Balancing/Scheduling
Abhinav Kamra, Vishal Misra CS Department Columbia University
Web Server Load Balancing/Scheduling
Self-Tuning Memory Management of A Database System
Self-Managed Systems: an Architectural Challenge
Presentation transcript:

Managing Web Server Performance with AutoTune Agents by Y. Diao, J. L. Hellerstein, S. Parekh, J. P. Bigus Presented by Changha Lee

Contents Introduction Apache web server and performance tuning Server self-tuning with Autotune agents –Modeling Agent –Run-time Control Agent –Controller Design Agent Experimental assessment Conclusions

Introduction Managing the performance of E-commerce sites is challenging –Site content changes frequently : Dynamically varying workloads –Some applications of control theory to computing systems include flow and congestion control, differentiated caching and web service, multimedia streaming, web server performance, server control To maintain good performance –System administrators must tune their information technology environment Manual effort can be time consuming and error-prone, and requires highly skilled

Introduction (Cont’d) Applications all provide a degree of autonomic behavior by providing algorithms –To automatically control some aspect of a computing system's operation In this paper… –Proposing an agent-based solution Automates the ongoing system tuning Automatically designs an appropriate tuning mechanism for the target system

Apache Web Server and Performance Tuning The application-level tuning parameters in Apache Web server –MaxClients : The number of simultaneous requests that will be served –KeepAlive : Whether or not to allow persistent connections Significant parameters to effect CPU and memory utilization –Increasing MaxClients : Increasing both CPU and memory utilizations. –Decreasing KeepAlive : Allows worker process to be more active. Directly results in higher CPU utilization. Indirectly increases memory utilization (more clients can connect)

Results of Tuning the Apache web Server

Effects of Dynamic Workloads

Server Self-Tuning with AutoTune Agents Solution –Multiple agents Automate the entire methodology of controller design Perform the on-line system control –Agents are implemented using the ABLE (Agent Building and Learning Environment) »Java**based toolkit »ABLE : provides a comprehensive library of intelligent reasoning and learning components

Architecture of the autotune agents

Modeling Agent Quantifying the relationship between the tuning parameters and performance metrics A, B : 2 X 2 matrices –Include modeling parameters –Can be identified using the least squares method

Run-time Control Agent Implementing a state feedback controller –To make control decisions based on feedback of errors –K P : Proportional control gain for fast response –K I : Integral control gain for removing steady-state error

Controller Design Agent To design the pararmeters K p,K i Choosing the controller parameters based on minimizing the following quadratic cost function : Q and R perform some scaling functions in addition to determining a trade-off between control error and control variability

Experimental Environment Environment : Linux , Apache –Workload generator : WAGON (Web trAffic GeneratOr and beNchmark) –File access distribution : Web Stone Dynamic workload –Web pages generated through CGI –The session following a Poisson distribution –A rate of 10 sessions per second

Experimental Assessment(1) Results of autonomically tuning the Apache Web server

Experimental Assessment (2) Performance of the AutoTune controller for the Apache Web server under dynamic workloads

Conclustions Proposing an agent-based solution –Automating the ongoing system tuning –Automatically designing an appropriate tuning mechanism for the target system Experiments showing –The feedback-driven controller to be robust and adaptable to situations other than the one for which it was designed