DENS: Data Center Energy-Efficient Network-Aware Scheduling

Slides:

Advertisements

Similar presentations

Min Song 1, Yanxiao Zhao 1, Jun Wang 1, E. K. Park 2 1 Old Dominion University, USA 2 University of Missouri at Kansas City, USA IEEE ICC 2009 A High Throughput.

Advertisements

Walter Binder University of Lugano, Switzerland Niranjan Suri IHMC, Florida, USA Green Computing: Energy Consumption Optimized Service Hosting.

ElasticTree: Saving Energy in Data Center Networks Brandon Heller, Srini Seetharaman, Priya Mahadevan, Yiannis Yiakoumis, Puneed Sharma, Sujata Banerjee,

Efficient Resource Management for Cloud Computing Environments Andrew J. Younge, Gregor von Laszewski, Lizhe Wang, Sonia Lopez-Alarcon, Warren Carithers.

Institute of Computer Science Foundation for Research and Technology – Hellas Greece Computer Architecture and VLSI Systems Laboratory Exploiting Spatial.

A Cyber-Physical Systems Approach to Energy Management in Data Centers Presented by Chen He Adopted form the paper authors.

Green Cloud Computing Hadi Salimi Distributed Systems Lab, School of Computer Engineering, Iran University of Science and Technology,

Linux Clustering A way to supercomputing. What is Cluster? A group of individual computers bundled together using hardware and software in order to make.

Xavier León PhD defense

The major IT companies, such as Microsoft, Google, Amazon, and IBM, pioneered the field of cloud computing and keep increasing their offerings in data.

Telecommunication Networks and integrated Services (TNS) Laboratory Department of Digital Systems University of Piraeus Research Center (UPRC) University.

SLA-aware Virtual Resource Management for Cloud Infrastructures

Keeping Hot Chips Cool Thermal Management for Green Computing Yang Ge Professor Qinru Qiu.

Datacenter Power State-of-the-Art Randy H. Katz University of California, Berkeley LoCal 0 th Retreat “Energy permits things to exist; information, to.

Energy-Efficient Design Some design issues in each protocol layer Design options for each layer in the protocol stack.

Present By : Bahar Fatholapour M.Sc. Student in Information Technology Mazandaran University of Science and Technology Supervisor:

CS : Creating the Grid OS—A Computer Science Approach to Energy Problems David E. Culler, Randy H. Katz University of California, Berkeley August.

A Scalable, Commodity Data Center Network Architecture Mohammad Al-Fares, Alexander Loukissas, Amin Vahdat Presented by Gregory Peaker and Tyler Maclean.

Kick-off meeting 3 October 2012 Patras. Research Team B Communication Networks Laboratory (CNL), Computer Engineering & Informatics Department (CEID),

A Scalable, Commodity Data Center Network Architecture.

Efficient Resource Management for Cloud Computing Environments

Energy Aware Network Operations Authors: Priya Mahadevan, Puneet Sharma, Sujata Banerjee, Parthasarathy Ranganathan HP Labs IEEE Global Internet Symposium.

Lawrence G. Roberts CEO Anagran September 2005 Enabling Data-Intensive iGrid Applications with Advanced Network Technology.

Identifying and Using Energy Critical Paths Nedeljko Vasić with Dejan Novaković, Satyam Shekhar, Prateek Bhurat, Marco Canini, and Dejan Kostić EPFL, Switzerland.

Chapter 6 High-Speed LANs Chapter 6 High-Speed LANs.

Department of Computer Science Engineering SRM University

Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Environment.

1 An SLA-Oriented Capacity Planning Tool for Streaming Media Services Lucy Cherkasova, Wenting Tang, and Sharad Singhal HPLabs,USA.

E-STAB: Energy-Efficient Scheduling for Cloud Computing Applications with Traffic Load Balancing Dzmitry KliazovichUniversity of Luxembourg, Luxembourg.

OPTIMAL SERVER PROVISIONING AND FREQUENCY ADJUSTMENT IN SERVER CLUSTERS Presented by: Xinying Zheng 09/13/ XINYING ZHENG, YU CAI MICHIGAN TECHNOLOGICAL.

Towards Sustainable Portable Computing through Cloud Computing and Cognitive Radios Vinod Namboodiri Wichita State University.

November , 2009SERVICE COMPUTATION 2009 Analysis of Energy Efficiency in Clouds H. AbdelSalamK. Maly R. MukkamalaM. Zubair Department.

Cloud Computing Energy efficient cloud computing Keke Chen.

Challenges towards Elastic Power Management in Internet Data Center.

Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters

A.SATHEESH Department of Software Engineering Periyar Maniammai University Tamil Nadu.

Joint Power Optimization Through VM Placement and Flow Scheduling in Data Centers DAWEI LI, JIE WU (TEMPLE UNIVERISTY) ZHIYONG LIU, AND FA ZHANG (CHINESE.

Copyright © 2011, Performance Evaluation of a Green Scheduling Algorithm for Energy Savings in Cloud Computing Truong Vinh Truong Duy; Sato,

Data Replication and Power Consumption in Data Grids Susan V. Vrbsky, Ming Lei, Karl Smith and Jeff Byrd Department of Computer Science The University.

Challenges Towards Elastic Power Management in Internet Data Centers Present by Sheng Cai.

Green Computing Metrics: Power, Temperature, CO2, … Computing system: Many-cores, Clusters, Grids and Clouds Algorithm and model: task scheduling, CFD.

Dzmitry Kliazovich University of Luxembourg

June 30 - July 2, 2009AIMS 2009 Towards Energy Efficient Change Management in A Cloud Computing Environment: A Pro-Active Approach H. AbdelSalamK. Maly.

Subways: A Case for Redundant, Inexpensive Data Center Edge Links Vincent Liu, Danyang Zhuo, Simon Peter, Arvind Krishnamurthy, Thomas Anderson University.

Energy-aware Node Placement in Wireless Sensor Networks Global Telecommunications Conference 2004 (Globecom 2004) Peng Cheng, Chen-Nee Chuah Xin Liu UCDAVIS.

Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania.

Dzmitry Kliazovich University of Luxembourg, Luxembourg

Data Center Energy-Efficient Network-Aware Scheduling

GreenCloud: A Packet-level Simulator of Energy-aware Cloud Computing Data Centers Dzmitry Kliazovich ERCIM Fellow University of Luxembourg Apr 16, 2010.

Copyright © 2010, Performance and Power Management for Cloud Infrastructures Hien Nguyen Van; Tran, F.D.; Menaud, J.-M. Cloud Computing (CLOUD),

Accounting for Load Variation in Energy-Efficient Data Centers

Kevin Harrison LTEC 4550 Assignment 3.  Ethernet Hub  An unsophisticated device that is used for connecting multiple Ethernet devices together.  Typically.

Jennifer Rexford Fall 2010 (TTh 1:30-2:50 in COS 302) COS 561: Advanced Computer Networks Energy.

Next Generation HPC architectures based on End-to-End 40GbE infrastructures Fabio Bellini Networking Specialist | Dell.

Analysis and Forming of Energy Efficiency and Green IT Metrics Framework for Sonera Helsinki Data Center HDC Matti Pärssinen Thesis supervisor: Prof. Jukka.

INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.

Software-Defined Architecture for Mobile Clouds in Device-to-Device Communication Muhammad Usman; Anteneh A. Gebremariam; Fabrizio Granelli; Dzmitry Kliazovich.

Schedulers for Hybrid Data Center Network Neelakandan Manihatty Bojan 2 nd Year PhD Student Advisor: Dr. Andrew W. Moore Eurosys Doctoral Workshop, 18.

DENS: Data Center Energy-Efficient Network-Aware Scheduling

Performance and Energy Efficiency Metrics for Communication Systems of Cloud Computing Data Centers Hrushikesh Mahapatro IT

GreenCloud: A Packet-level Simulator of Energy-aware Cloud Computing Data Centers Dzmitry Kliazovich, Pascal Bouvry, Yury Audzevich, and Samee Ullah Khan.

Energy Aware Network Operations

Data Center Network Topologies

Cloud Computing and Cloud Networking

A Cognitive Approach for Cross-Layer Performance Management

Zhen Xiao, Qi Chen, and Haipeng Luo May 2013

ElasticTree: Saving Energy in Data Center Networks

Internet and Web Simple client-server model

Cloud Computing Architecture

Multiple-resource Request Scheduling. for Differentiated QoS

Presentation transcript:

DENS: Data Center Energy-Efficient Network-Aware Scheduling Dec 20, 2010 DENS: Data Center Energy-Efficient Network-Aware Scheduling Dzmitry Kliazovich University of Luxembourg Pascal Bouvry University of Luxembourg Samee Ullah Khan North Dakota State University

Why energy is important? Increased computing demand Data centers are rapidly growing Consume 10 to 100 times more energy per square foot than a typical office building Energy cost dynamics Energy accounts for 10% of data center operational expenses (OPEX) and can rise to 50% in the next few years Accompanying cooling system costs $2-$5 million per year December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Distribution of data center energy consumption December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Data center architectures Three-tier data center architecture Most Widely Used Nowadays Access, Aggregation, and Core layers Scales to over 10,000 servers December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Data center components Servers’ Energy Model memory modules, disks, I/O resources CPU Idle server consumes about 66% of the peak load for all CPU frequencies December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Data center components Switches Most common Top-of-Rack (ToR) switches typically operate at Layer-2 interconnecting gigabit links in the access network Aggregation and core networks host Layer-3 switches operating at 10 GE (or 100 GE) Links Transceivers’ power consumption depends on the quality of signal transmission in cables and is proportional to their cost 1 GE links consume 0.4W for 100 meter transmissions over twisted pair 10 GE links consume 1W for 300 meter transmission over optical fiber Supported power management modes DVFS, DNS, or both December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) Simulator components Switches’ Energy Model Chassis ~ 36% Linecards ~ 53% Port transceivers ~ 11% December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) DENS methodology DENS achieves balance between Energy consumed by the data center Individual job performances Job QoS requirements Data center traffic demands DENS is architecture specific Data Center Architecture December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) DENS methodology Avoid Overloading Computing server selection Penalize Under-loaded Servers Favor High Server Utilization December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) DENS methodology Computing server selection Favor Low Congestion Levels Penalize Congested Queues December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) DENS methodology Computing server selection Maximize Server Load, Minimizing Network Congestion December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Performance Evaluation GreenCloud simulator is developed Three-tier data center topology 1536 nodes, 32 racks, 4 core and 8 aggregation switches December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Performance Evaluation Server workload distribution Green scheduler Redistributing Computing Load DENS scheduler Round-robin scheduler December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Performance Evaluation Network workload distribution Network congestion Redistributing Load to Satisfy QoS Green scheduler DENS scheduler Round-robin scheduler December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Performance Evaluation Top-of-Rack (ToR) switch load Network congestion Green scheduler Green scheduler DENS scheduler DENS scheduler December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Performance Evaluation Energy QoS Data center energy consumption Parameter Power Consumption (kW·h) Round Robin scheduler Green Scheduler DENS Data center Servers Network switches 417.5K 353.7K 63.8K 203.3K (48%) 161.8K (45%) 41.5K (65%) 212.1K (50%) 168.2K (47%) 43.9K (68%) December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) Conclusions We acknowledge Funding form Luxembourg FNR in the framework of GreenIT project Research fellowship provided by the European Research Consortium for Informatics and Mathematics (ERCIM) Related publications "GreenCloud: A Packet-level Simulator of Energy-aware Cloud Computing Data Centers," in Journal of Supercomputing, special issue on Green Networks, 2011. “GreenCloud: A Packet-level Simulator of Energy-aware Cloud Computing Data Centers,” IEEE Global Communications Conference (GLOBECOM), Miami, FL, USA, December 2010. GreenCloud December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)

Pascal Bouvry (pascal.bouvry@uni.lu) Thank you! December 20, 2010 Pascal Bouvry (pascal.bouvry@uni.lu)