DENS: Data Center Energy-Efficient Network-Aware Scheduling

Slides:

Advertisements

Similar presentations

©2009 HP Confidential template rev Ed Turkel Manager, WorldWide HPC Marketing 4/7/2011 BUILDING THE GREENEST PRODUCTION SUPERCOMPUTER IN THE.

Advertisements

Min Song 1, Yanxiao Zhao 1, Jun Wang 1, E. K. Park 2 1 Old Dominion University, USA 2 University of Missouri at Kansas City, USA IEEE ICC 2009 A High Throughput.

Walter Binder University of Lugano, Switzerland Niranjan Suri IHMC, Florida, USA Green Computing: Energy Consumption Optimized Service Hosting.

ElasticTree: Saving Energy in Data Center Networks Brandon Heller, Srini Seetharaman, Priya Mahadevan, Yiannis Yiakoumis, Puneed Sharma, Sujata Banerjee,

Efficient Resource Management for Cloud Computing Environments Andrew J. Younge, Gregor von Laszewski, Lizhe Wang, Sonia Lopez-Alarcon, Warren Carithers.

A Cyber-Physical Systems Approach to Energy Management in Data Centers Presented by Chen He Adopted form the paper authors.

Green Cloud Computing Hadi Salimi Distributed Systems Lab, School of Computer Engineering, Iran University of Science and Technology,

The major IT companies, such as Microsoft, Google, Amazon, and IBM, pioneered the field of cloud computing and keep increasing their offerings in data.

“ElasticTree: Saving energy in data center networks“ by Brandon Heller, Seetharaman, Mahadevan, Yiakoumis, Sharma, Banerjee, McKeown presented by Nicoara.

SLA-aware Virtual Resource Management for Cloud Infrastructures

Keeping Hot Chips Cool Thermal Management for Green Computing Yang Ge Professor Qinru Qiu.

Datacenter Power State-of-the-Art Randy H. Katz University of California, Berkeley LoCal 0 th Retreat “Energy permits things to exist; information, to.

A Scalable, Commodity Data Center Network Architecture Mohammad Al-Fares, Alexander Loukissas, Amin Vahdat Presented by Gregory Peaker and Tyler Maclean.

Kick-off meeting 3 October 2012 Patras. Research Team B Communication Networks Laboratory (CNL), Computer Engineering & Informatics Department (CEID),

A Scalable, Commodity Data Center Network Architecture.

Efficient Resource Management for Cloud Computing Environments

Energy Aware Network Operations Authors: Priya Mahadevan, Puneet Sharma, Sujata Banerjee, Parthasarathy Ranganathan HP Labs IEEE Global Internet Symposium.

Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Environment.

E-STAB: Energy-Efficient Scheduling for Cloud Computing Applications with Traffic Load Balancing Dzmitry KliazovichUniversity of Luxembourg, Luxembourg.

OPTIMAL SERVER PROVISIONING AND FREQUENCY ADJUSTMENT IN SERVER CLUSTERS Presented by: Xinying Zheng 09/13/ XINYING ZHENG, YU CAI MICHIGAN TECHNOLOGICAL.

November , 2009SERVICE COMPUTATION 2009 Analysis of Energy Efficiency in Clouds H. AbdelSalamK. Maly R. MukkamalaM. Zubair Department.

Cloud Computing Energy efficient cloud computing Keke Chen.

DENS: Data Center Energy-Efficient Network-Aware Scheduling

Summer Report Xi He Golisano College of Computing and Information Sciences Rochester Institute of Technology Rochester, NY

A Survey on Optical Interconnects for Data Centers Speaker: Shih-Chieh Chien Adviser: Prof Dr. Ho-Ting Wu.

Joint Power Optimization Through VM Placement and Flow Scheduling in Data Centers DAWEI LI, JIE WU (TEMPLE UNIVERISTY) ZHIYONG LIU, AND FA ZHANG (CHINESE.

Copyright © 2011, Performance Evaluation of a Green Scheduling Algorithm for Energy Savings in Cloud Computing Truong Vinh Truong Duy; Sato,

OPERETTA: An Optimal Energy Efficient Bandwidth Aggregation System Karim Habak†, Khaled A. Harras‡, and Moustafa Youssef† †Egypt-Japan University of Sc.

Data Replication and Power Consumption in Data Grids Susan V. Vrbsky, Ming Lei, Karl Smith and Jeff Byrd Department of Computer Science The University.

Challenges Towards Elastic Power Management in Internet Data Centers Present by Sheng Cai.

Thermal Aware Data Management in Cloud based Data Centers Ling Liu College of Computing Georgia Institute of Technology NSF SEEDM workshop, May 2-3, 2011.

Green Computing Metrics: Power, Temperature, CO2, … Computing system: Many-cores, Clusters, Grids and Clouds Algorithm and model: task scheduling, CFD.

Dzmitry Kliazovich University of Luxembourg

June 30 - July 2, 2009AIMS 2009 Towards Energy Efficient Change Management in A Cloud Computing Environment: A Pro-Active Approach H. AbdelSalamK. Maly.

Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania.

Dzmitry Kliazovich University of Luxembourg, Luxembourg

Data Center Energy-Efficient Network-Aware Scheduling

GreenCloud: A Packet-level Simulator of Energy-aware Cloud Computing Data Centers Dzmitry Kliazovich ERCIM Fellow University of Luxembourg Apr 16, 2010.

Accounting for Load Variation in Energy-Efficient Data Centers

Kevin Harrison LTEC 4550 Assignment 3.  Ethernet Hub  An unsophisticated device that is used for connecting multiple Ethernet devices together.  Typically.

Next Generation HPC architectures based on End-to-End 40GbE infrastructures Fabio Bellini Networking Specialist | Dell.

Analysis and Forming of Energy Efficiency and Green IT Metrics Framework for Sonera Helsinki Data Center HDC Matti Pärssinen Thesis supervisor: Prof. Jukka.

INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.

Scalable Congestion Control Protocol based on SDN in Data Center Networks Speaker : Bo-Han Hua Professor : Dr. Kai-Wei Ke Date : 2016/04/08 1.

Schedulers for Hybrid Data Center Network Neelakandan Manihatty Bojan 2 nd Year PhD Student Advisor: Dr. Andrew W. Moore Eurosys Doctoral Workshop, 18.

Performance and Energy Efficiency Metrics for Communication Systems of Cloud Computing Data Centers Hrushikesh Mahapatro IT

GreenCloud: A Packet-level Simulator of Energy-aware Cloud Computing Data Centers Dzmitry Kliazovich, Pascal Bouvry, Yury Audzevich, and Samee Ullah Khan.

Energy Aware Network Operations

CIS 700-5: The Design and Implementation of Cloud Networks

Data Center Network Topologies

Overview: Cloud Datacenters

A Survey of Data Center Network Architectures By Obasuyi Edokpolor

Green cloud computing 2 Cs 595 Lecture 15.

Virtual Edge-Based Smart Community Network Management

Green Software Engineering Prof

Cloud Computing and Cloud Networking

Evaluation of Load Balancing Algorithms and Internet Traffic Modeling for Performance Analysis By Arthur L. Blais.

A Cognitive Approach for Cross-Layer Performance Management

Zhen Xiao, Qi Chen, and Haipeng Luo May 2013

ElasticTree: Saving Energy in Data Center Networks

NTHU CS5421 Cloud Computing

CLUSTER COMPUTING.

Business Data Communications, 4e

Internet and Web Simple client-server model

Cloud Computing Architecture

Network Architecture for Cyberspace

Multiple-resource Request Scheduling. for Differentiated QoS

7- chapter Seven Local Area Networks (LAN)

On the Role of Burst Buffers in Leadership-Class Storage Systems

Data Center Traffic Engineering

Presentation transcript:

DENS: Data Center Energy-Efficient Network-Aware Scheduling Dec 20, 2010 DENS: Data Center Energy-Efficient Network-Aware Scheduling Dzmitry Kliazovich University of Luxembourg Pascal Bouvry University of Luxembourg Samee Ullah Khan North Dakota State University

Why energy is important? Increased computing demand Data centers are rapidly growing Consume 10 to 100 times more energy per square foot than a typical office building Energy cost dynamics Energy accounts for 10% of data center operational expenses (OPEX) and can rise to 50% in the next few years Accompanying cooling system costs $2-$5 million per year December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Distribution of data center energy consumption December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Data center architectures Three-tier data center architecture Most Widely Used Nowadays Access, Aggregation, and Core layers Scales to over 10,000 servers December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Data center components Servers’ Energy Model memory modules, disks, I/O resources CPU Idle server consumes about 66% of the peak load for all CPU frequencies December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Data center components Switches Most common Top-of-Rack (ToR) switches typically operate at Layer-2 interconnecting gigabit links in the access network Aggregation and core networks host Layer-3 switches operating at 10 GE (or 100 GE) Links Transceivers’ power consumption depends on the quality of signal transmission in cables and is proportional to their cost 1 GE links consume 0.4W for 100 meter transmissions over twisted pair 10 GE links consume 1W for 300 meter transmission over optical fiber Supported power management modes DVFS, DNS, or both December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) Simulator components Switches’ Energy Model Chassis ~ 36% Linecards ~ 53% Port transceivers ~ 11% December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) DENS methodology DENS achieves balance between Energy consumed by the data center Individual job performances Job QoS requirements Data center traffic demands DENS is architecture specific Data Center Architecture December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) DENS methodology Avoid Overloading Computing server selection Penalize Under-loaded Servers Favor High Server Utilization December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) DENS methodology Computing server selection Favor Low Congestion Levels Penalize Congested Queues December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) DENS methodology Computing server selection Maximize Server Load, Minimizing Network Congestion December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Performance Evaluation GreenCloud simulator is developed Three-tier data center topology 1536 nodes, 32 racks, 4 core and 8 aggregation switches December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Performance Evaluation Server workload distribution Green scheduler Redistributing Computing Load DENS scheduler Round-robin scheduler December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Performance Evaluation Network workload distribution Network congestion Redistributing Load to Satisfy QoS Green scheduler DENS scheduler Round-robin scheduler December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Performance Evaluation Top-of-Rack (ToR) switch load Network congestion Green scheduler Green scheduler DENS scheduler DENS scheduler December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Performance Evaluation Energy QoS Data center energy consumption Parameter Power Consumption (kW·h) Round Robin scheduler Green Scheduler DENS Data center Servers Network switches 417.5K 353.7K 63.8K 203.3K (48%) 161.8K (45%) 41.5K (65%) 212.1K (50%) 168.2K (47%) 43.9K (68%) December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) Conclusions We acknowledge Funding form Luxembourg FNR in the framework of GreenIT project Research fellowship provided by the European Research Consortium for Informatics and Mathematics (ERCIM) Related publications "GreenCloud: A Packet-level Simulator of Energy-aware Cloud Computing Data Centers," in Journal of Supercomputing, special issue on Green Networks, 2011. “GreenCloud: A Packet-level Simulator of Energy-aware Cloud Computing Data Centers,” IEEE Global Communications Conference (GLOBECOM), Miami, FL, USA, December 2010. GreenCloud December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) Thank you! December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)