Feifei Chen Swinburne University of Technology Melbourne, Australia

Slides:



Advertisements
Similar presentations
VM Interference and Placement for Server Consolidation Umesh Bellur IIT Bombay.
Advertisements

LIBRA: Lightweight Data Skew Mitigation in MapReduce
SLA-Oriented Resource Provisioning for Cloud Computing
Locality-Aware Dynamic VM Reconfiguration on MapReduce Clouds Jongse Park, Daewoo Lee, Bokyeong Kim, Jaehyuk Huh, Seungryoul Maeng.
Cloud Computing Resource provisioning Keke Chen. Outline  For Web applications statistical Learning and automatic control for datacenters  For data.
Energy-efficient Virtual Machine Provision Algorithms for Cloud System Ching-Chi Lin Institute of Information Science, Academia Sinica Department of Computer.
Overcoming the challenge of virtual blindness Colin Richardson on365 Ltd.
Green Cloud Computing Hadi Salimi Distributed Systems Lab, School of Computer Engineering, Iran University of Science and Technology,
GREEN CLOUD By Sphoorthy. LOGO WHAT IS CLOUD COMPUTING? Cloud computing is a model for enabling convenient, on- demand network access to a shared pool.
SLA-aware Virtual Resource Management for Cloud Infrastructures
Ceph vs Local Storage for Virtual Machine 26 th March 2015 HEPiX Spring 2015, Oxford Alexander Dibbo George Ryall, Ian Collier, Andrew Lahiff, Frazer Barnsley.
Keeping Hot Chips Cool Thermal Management for Green Computing Yang Ge Professor Qinru Qiu.
VMFlock: VM Co-Migration Appliance for the Cloud Samer Al-Kiswany With: Dinesh Subhraveti Prasenjit Sarkar Matei Ripeanu.
Energy Efficient Web Server Cluster Andrew Krioukov, Sara Alspaugh, Laura Keys, David Culler, Randy Katz.
1 Performability Models for Designing Disaster Tolerant Cloud Computing Systems.
Abstract Cloud data center management is a key problem due to the numerous and heterogeneous strategies that can be applied, ranging from the VM placement.
Dependability Models for Designing Disaster Tolerant Cloud Computing Systems.
Simulation of Cloud Environments
Virtual Machine Hosting for Networked Clusters: Building the Foundations for “Autonomic” Orchestration Based on paper by Laura Grit, David Irwin, Aydan.
Sherif Akoush 2 June 2008 Renewable Energy and Data Centres.
Enable Energy Efficiency Green I.T.: Reduce energy use of I.T. “IT for Green”: Use IT to improve energy use in buildings, transportation, grids, industry.
Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Environment.
Location-aware MapReduce in Virtual Cloud 2011 IEEE computer society International Conference on Parallel Processing Yifeng Geng1,2, Shimin Chen3, YongWei.
UI and Data Entry UI and Data Entry Front-End Business Logic Mid-Tier Data Store Back-End.
NYS Forum IT Greening Workgroup Thin Client Devices DHCR Experience with Virtual Desktops June 12, 2010.
Cloud Computing Energy efficient cloud computing Keke Chen.
Storage Management in Virtualized Cloud Environments Sankaran Sivathanu, Ling Liu, Mei Yiduo and Xing Pu Student Workshop on Frontiers of Cloud Computing,
Improving Network I/O Virtualization for Cloud Computing.
Resource Provisioning based on Lease Preemption in InterGrid Mohsen Amini Salehi, Bahman Javadi, Rajkumar Buyya Cloud Computing and Distributed Systems.
The Only Constant is Change: Incorporating Time-Varying Bandwidth Reservations in Data Centers Di Xie, Ning Ding, Y. Charlie Hu, Ramana Kompella 1.
Software-defined Networking Capabilities, Needs in GENI for VMLab ( Prasad Calyam; Sudharsan Rajagopalan;
Get More out of SQL Server 2012 in the Microsoft Private Cloud environment Steven Wort, Xin Jin Microsoft Corporation.
1 DOE Data Center Energy Efficiency Program and Tool Strategy Paul Scheihing U.S. Department of Energy Office of Energy Efficiency and Renewable Energy.
Liam Newcombe BCS Data Centre Specialist Group Secretary Modelling Data Centre Energy Efficiency and Cost.
DR Software: Essential Foundational Elements and Platform Components UCLA Smart Grid Energy Research Center (SMERC) Industry Partners Program (IPP) Meeting.
© ABB Inc. - USETI All Rights Reserved 10/17/2015 Insert image here An Economic Analysis Development Framework for Distributed Resources Aaron F. Snyder.
An Energy-Efficient Hypervisor Scheduler for Asymmetric Multi- core 1 Ching-Chi Lin Institute of Information Science, Academia Sinica Department of Computer.
BOF: Megajobs Gracie: Grid Resource Virtualization and Customization Infrastructure How to execute hundreds of thousands tasks concurrently on distributed.
Uwe Lüthy Solution Specialist, Core Infrastructure Microsoft Corporation Integrated System Management.
The Only Constant is Change: Incorporating Time-Varying Bandwidth Reservations in Data Centers Di Xie, Ning Ding, Y. Charlie Hu, Ramana Kompella 1.
Performance Analysis of Preemption-aware Scheduling in Multi-Cluster Grid Environments Mohsen Amini Salehi, Bahman Javadi, Rajkumar Buyya Cloud Computing.
LaHave House Project 1 LaHave House Project Automated Architectural Design BML + ARC.
DynamicMR: A Dynamic Slot Allocation Optimization Framework for MapReduce Clusters Nanyang Technological University Shanjiang Tang, Bu-Sung Lee, Bingsheng.
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Copyright © 2010, Performance and Power Management for Cloud Infrastructures Hien Nguyen Van; Tran, F.D.; Menaud, J.-M. Cloud Computing (CLOUD),
03/03/051 Performance Engineering of Software and Distributed Systems Research Activities at IIT Bombay Varsha Apte March 3 rd, 2005.
4/26/2017 Use Cloud-Based Load Testing Service to Find Scale and Performance Bottlenecks Randy Pagels Sr. Developer Technology Specialist © 2012 Microsoft.
Virtual techdays INDIA │ august 2010 virtual techdays INDIA │ august 2010 Building the Road to Private Cloud M.S.Anand │ Technology Evangelist,
Tweak Performance and Improve Availability of your Microsoft Azure VMs Rick
Enabling the Cloud OS Today  New high-density Web Sites with elastic cloud scaling and complete dev-ops experiences  New rich IaaS experience for self-service.
EuroSys Doctoral Workshop 2011 Resource Provisioning of Web Applications in Heterogeneous Cloud Jiang Dejun Supervisor: Guillaume Pierre
Joint Institute for Nuclear Research Synthesis of the simulation and monitoring processes for the data storage and big data processing development in physical.
Analysis and Forming of Energy Efficiency and Green IT Metrics Framework for Sonera Helsinki Data Center HDC Matti Pärssinen Thesis supervisor: Prof. Jukka.
Rick Claus Architect like a PRO for Performance and Availability of your Microsoft Azure VMs ARC43 6.
1 Implementing a Virtualized Dynamic Data Center Solution Jim Sweeney, Principal Solutions Architect, GTSI.
Let's build a VMM service template from A to Z in one hour Damien Caro Technical Evangelist Microsoft Central & Eastern Europe
Kick-off Meeting – Feb Stênio Fernandes SLA4CLOUD: Measurement and SLA Management of Heterogeneous Cloud Infrastructures.
Hao Wu, Shangping Ren, Gabriele Garzoglio, Steven Timm, Gerard Bernabeu, Hyun Woo Kim, Keith Chadwick, Seo-Young Noh A Reference Model for Virtual Machine.
Daniele Lezzi Execution of scientific workflows on federated multi-cloud infrastructures IBERGrid Madrid, 20 September 2013.
EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number Federated Cloud Update.
Use of Cloud Computing for Implementation of e-Governance Services
Dipartimento di Elettronica, Informazione e Bioingegneria
Information technology (IT) accounts for….
Green cloud computing 2 Cs 595 Lecture 15.
DOE Data Center Energy Efficiency Program and Tool Strategy
Analyzing Security and Energy Tradeoffs in Autonomic Capacity Management Wei Wu.
Computing Resource Allocation and Scheduling in A Data Center
Database Testing in Azure Cloud
TEMPLATE NOTES Our datasheet and mini-case study templates are formatted specifically for consistency of branding at Microsoft. Please do not alter font.
Presentation transcript:

Automating Performance and Energy Consumption Analysis for Cloud Applications Feifei Chen Swinburne University of Technology Melbourne, Australia Save this template as a new PowerPoint Presentation, giving it the name you require OR copy these templates from Slide Master view into your existing presentation’s Slide Master options If you go to >View > Slide Master you will see this template can be applied in Black, White or Grey background versions (which you will apply as you build or edit your presentation) Close Slide Master view. You can now construct your presentation. In the Slides area, select ‘New Slide’ to add a new slide. To apply a slide style to the new/highlighted slide - in the Slides area, select ‘Layout’ menu, select preferred slide style from the menu (eg. ‘Title and Content’) , select ‘Reset’. If you are updating an existing presentation, existing styles may not automatically update (hence using ‘reset’,) especially if the existing slide has not been produced with a template. Text from imposed text boxes may need to be cut & pasted into new auto-generated template text boxes etc. You should only use one colour template for each presentation (eg. Only black background, or white, or grey – not a combination) The Design uses only 24pt Arial as the font, with 22pt the minimum text size (used at third level). The title page ‘wave’ graphics can be increased in width, but not height. CRICOS Provider: 00111D | TOID: 3059 1

Outlines Background Problem Analysis Approach Evaluation 2

Cloud Computing 3 Give examples for assignment 2 deployment: IAAS – Amazon PaaS – EC2 with tomcat SaaA – Photo Album 3

Benefits of Cloud

High CO2 emissions contribution Dark Side of Cloud High CO2 emissions contribution Gartner Report 2007: IT industry contributes 2% of world's total CO2 emissions New York Times 2012: Data centres use about 30 billion watts of electricity per hour worldwide, equivalent to the output of about 30 nuclear power plants

Dark Side of Cloud High Operational Cost U.S. EPA Report 2007: 1.5% of total U.S. power consumption used by data centers which has more than doubled since 2000 and costs $4.5 billion

Green Cloud Computing

Service Level Agreement (SLA)

Understand both system performance and energy consumption pattern A key objective of cloud service providers: Develop solutions to cloud application deployment and management with minimum energy consumption while still guaranteeing performance and other Service Level Agreement (SLA) targets. Performance Service Providers Energy Consumption Understand both system performance and energy consumption pattern Assignment 7 – solution architect – 5 objectives For this – energy efficiency

Outlines Background Problem Analysis Approach Evaluation 10

Understand both system performance and energy consumption pattern: running extensive experiments with heterogeneous parameters/metrics and workloads; collecting appropriate cloud and application energy/performance measurements; performing energy/performance trade-off analysis. 11

JPetStore Deployment Workload 1000 Users 5000 Users

Challenges Manually performing the tasks is tedious and time- consuming Cloud system performance is related to Architecture Workload An automated performance and energy consumption evaluation framework is imperative The framework should be able to accommodate different cloud system architectures and adopt different application workloads during load tests and the trade-off evaluation process 13

Outlines Background Problem Analysis Approach Evaluation 14

Automated Performance and energy analysis tool - StressCloud

Automated Performance and energy analysis tool - StressCloud Cloud Architecture Model: All available resources in the target cloud system and their detailed configurations.

Automated Performance and energy analysis tool - StressCloud Cloud Application Workload Model: A set of Tasks modelling the target cloud application behaviour Computation-Intensive CPU-Intensive Memory-Intensive Data-Intensive Communication-Intensive Task: A stochastic form chart specifying the detailed user requests and required responses from the cloud system Task Type Service Type in StressCloud CPU-intensive Fibonacci sequence calculating Memory-intensive File processing Data-intensive Rational database operating Communication-intensive HTTP request/response

High-level Workload Model of JPetStore

Stochastic Form-Chart Example Of Each Task

Cloud System Architecture Model Example

Workload Deployment Scripts Example

Load Testing Scripts Example

Visualized Results

Outlines Background Problem Analysis Approach Evaluation 24

Experiment Setup Energy and performance profiling framework VM configuration   Virtual Machine Number of Cores RAM Hard Disk Small 1 2GB 80GB Medium 2 4GB Large 3 6GB XLarge 4 8GB

Energy Consumption and Throughput Experiment Results Test set 1: Keep the resource allocation strategy constant while changing workload System Configurations: 1 Large VM (3CPUs and 6GB RAM) Workload: user workload 50~200 Energy Consumption and Throughput Deploy MJPetStore on one VM with 3 CPUs and 6GB RAM. The initial number of users was set to 10. We then increased the concurrent requests number of each user from 50 to 200 in steps of 50.

Energy Consumption and Throughput Experiment Results Test set 2: Keep the workload constant while changing the resource allocation strategy System Configuration: 1Large: Deploy three types of tasks on the 1 VM. 3Small(D): Deploy three types of tasks on different VMs. 3Small(S): Deploy three types of tasks on the same VM with workloads evenly distributed across all VMs. Workload: user request 100. Energy Consumption and Throughput

Thanks! Feifei Chen feifeichen@swin.edu.au 28 Save this template as a new PowerPoint Presentation, giving it the name you require OR copy these templates from Slide Master view into your existing presentation’s Slide Master options If you go to >View > Slide Master you will see this template can be applied in Black, White or Grey background versions (which you will apply as you build or edit your presentation) Close Slide Master view. You can now construct your presentation. In the Slides area, select ‘New Slide’ to add a new slide. To apply a slide style to the new/highlighted slide - in the Slides area, select ‘Layout’ menu, select preferred slide style from the menu (eg. ‘Title and Content’) , select ‘Reset’. If you are updating an existing presentation, existing styles may not automatically update (hence using ‘reset’,) especially if the existing slide has not been produced with a template. Text from imposed text boxes may need to be cut & pasted into new auto-generated template text boxes etc. You should only use one colour template for each presentation (eg. Only black background, or white, or grey – not a combination) The Design uses only 24pt Arial as the font, with 22pt the minimum text size (used at third level). The title page ‘wave’ graphics can be increased in width, but not height. CRICOS Provider: 00111D | TOID: 3059 28