Green Computing Metrics: Power, Temperature, CO2, … Computing system: Many-cores, Clusters, Grids and Clouds Algorithm and model: task scheduling, CFD.

Slides:



Advertisements
Similar presentations
Energy Efficient Scheduling in IaaS Cloud Mehdi Sheikhalishahi University of Calabria Supervisor: Prof. Lucio Grandinetti OGF 28 Munich, th March.
Advertisements

Evaluating the Cost-Benefit of Using Cloud Computing to Extend the Capacity of Clusters Presenter: Xiaoyu Sun.
University of Minnesota Optimizing MapReduce Provisioning in the Cloud Michael Cardosa, Aameek Singh†, Himabindu Pucha†, Abhishek Chandra
Power Management in Cloud Computing using Green Algorithm -Kushal Mehta COP 6087 University of Central Florida.
Efficient Resource Management for Cloud Computing Environments Andrew J. Younge, Gregor von Laszewski, Lizhe Wang, Sonia Lopez-Alarcon, Warren Carithers.
Cloudmesh Resource Shifting 1 2. Cloudmesh: from IaaS(NaaS) to Workflow (Orchestration) Workflow Virtual Cluster Components Infrastructure iPython (Pegasus)
A Cyber-Physical Systems Approach to Energy Management in Data Centers Presented by Chen He Adopted form the paper authors.
Green Cloud Computing Hadi Salimi Distributed Systems Lab, School of Computer Engineering, Iran University of Science and Technology,
Look Who’s Talking: Discovering Dependencies between Virtual Machines Using CPU Utilization HotCloud 10 Presented by Xin.
The major IT companies, such as Microsoft, Google, Amazon, and IBM, pioneered the field of cloud computing and keep increasing their offerings in data.
Keeping Hot Chips Cool Thermal Management for Green Computing Yang Ge Professor Qinru Qiu.
YZ X Rack Hot air Cold air Rack nod e. PCR Node i.Temp(t) Temp(x,y,z,t)
Energy Efficient Web Server Cluster Andrew Krioukov, Sara Alspaugh, Laura Keys, David Culler, Randy Katz.
Akhil Langer, Harshit Dokania, Laxmikant Kale, Udatta Palekar* Parallel Programming Laboratory Department of Computer Science University of Illinois at.
Efficient Resource Management for Cloud Computing Environments Andrew J. Younge Golisano College of Computing and Information Sciences Rochester Institute.
Efficient Resource Management for Cloud Computing Environments
Thermal Aware Resource Management Framework Xi He, Gregor von Laszewski, Lizhe Wang Golisano College of Computing and Information Sciences Rochester Institute.
Cyberaide Virtual Appliance: On-demand Deploying Middleware for Cyberinfrastructure Tobias Kurze, Lizhe Wang, Gregor von Laszewski, Jie Tao, Marcel Kunze,
Green IT and Data Centers Darshan R. Kapadia Gregor von Laszewski 1.
Department of Computer Science Engineering SRM University
XI HE Computing and Information Science Rochester Institute of Technology Rochester, NY USA Rochester Institute of Technology Service.
OPTIMAL SERVER PROVISIONING AND FREQUENCY ADJUSTMENT IN SERVER CLUSTERS Presented by: Xinying Zheng 09/13/ XINYING ZHENG, YU CAI MICHIGAN TECHNOLOGICAL.
Marcos Dias de Assunção 1,2, Alexandre di Costanzo 1 and Rajkumar Buyya 1 1 Department of Computer Science and Software Engineering 2 National ICT Australia.
Cloud Computing Energy efficient cloud computing Keke Chen.
DENS: Data Center Energy-Efficient Network-Aware Scheduling
Andrew J. Younge Golisano College of Computing and Information Sciences Rochester Institute of Technology 102 Lomb Memorial Drive Rochester, New York
David Pinney 7 November 2013 Open Modeling Framework.
YZ X Rack Hot air Rack Node (x,y,z ) Node (x,y,z )
YZ X Rack Hot air Rack Node (x,y,z ) Node (x,y,z )
Job Submission Condor, Globus, Java CoG Kit Young Suk Moon.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
Temperature Aware Load Balancing For Parallel Applications Osman Sarood Parallel Programming Lab (PPL) University of Illinois Urbana Champaign.
Challenges towards Elastic Power Management in Internet Data Center.
Summer Report Xi He Golisano College of Computing and Information Sciences Rochester Institute of Technology Rochester, NY
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)
Thermal-aware Issues in Computers IMPACT Lab. Part A Overview of Thermal-related Technologies.
ServiceSs, a new programming model for the Cloud Daniele Lezzi, Rosa M. Badia, Jorge Ejarque, Raul Sirvent, Enric Tejedor Grid Computing and Clusters Group.
 Apache Airavata Architecture Overview Shameera Rathnayaka Graduate Assistant Science Gateways Group Indiana University 07/27/2015.
Toward Green Data Center Computing Gregor von Laszewski Lizhe Wang.
VGreen: A System for Energy Efficient Manager in Virtualized Environments G. Dhiman, G Marchetti, T Rosing ISLPED 2009.
Software Architecture for Dynamic Thermal Management in Datacenters Tridib Mukherjee Graduate Research Assistant IMPACT Lab ( Department.
Thermal Aware Data Management in Cloud based Data Centers Ling Liu College of Computing Georgia Institute of Technology NSF SEEDM workshop, May 2-3, 2011.
Efficient Resource Management for Cloud Computing Environments Andrew J. Younge Golisano College of Computing and Information Sciences Rochester Institute.
NTU Cloud 2010/05/30. System Diagram Architecture Gluster File System – Provide a distributed shared file system for migration NFS – A Prototype Image.
Overview and Comparison of Software Tools for Power Management in Data Centers Msc. Enida Sheme Acad. Neki Frasheri Polytechnic University of Tirana Albania.
XI HE Computing and Information Science Rochester Institute of Technology Rochester, NY USA Rochester Institute of Technology Service.
Thermal-aware Task Placement in Data Centers Qinghui Tang Sandeep K S Gupta Georgios Varsamopoulos IMPACT Lab Arizona State University.
Timeshared Parallel Machines Need resource management Need resource management Shrink and expand individual jobs to available sets of processors Shrink.
Accounting for Load Variation in Energy-Efficient Data Centers
Xi He Golisano College of Computing and Information Sciences Rochester Institute of Technology Rochester, NY THERMAL-AWARE RESOURCE.
Tool Integration with Data and Computation Grid “Grid Wizard 2”
Ensieea Rizwani An energy-efficient management mechanism for large-scale server clusters By: Zhenghua Xue, Dong, Ma, Fan, Mei 1.
Thermal Management in Datacenters Ayan Banerjee. Thermal Management using task placement Tasks: Requires a certain number of servers (cores) for a specified.
+ Support multiple virtual environment for Grid computing Dr. Lizhe Wang.
Computing Facilities CERN IT Department CH-1211 Geneva 23 Switzerland t CF Cluman: Advanced Cluster Management for Large-scale Infrastructures.
Developing resource consolidation frameworks for moldable virtual machines in clouds Author: Liang He, Deqing Zou, Zhang Zhang, etc Presenter: Weida Zhong.
G. Russo, D. Del Prete, S. Pardi Kick Off Meeting - Isola d'Elba, 2011 May 29th–June 01th A proposal for distributed computing monitoring for SuperB G.
DENS: Data Center Energy-Efficient Network-Aware Scheduling
Lizhe Wang, Gregor von Laszewski, Jai Dayal, Thomas R. Furlani
GreenCloud: A Packet-level Simulator of Energy-aware Cloud Computing Data Centers Dzmitry Kliazovich, Pascal Bouvry, Yury Audzevich, and Samee Ullah Khan.
Thermal-aware Task Placement in Data Centers (part 4)
Forecasting with Cyber-physical Interactions in Data Centers (part 3)
Dipartimento di Elettronica, Informazione e Bioingegneria
3.2 Virtualisation.
Towards Green Aware Computing at Indiana University
Core Grid Functions: A Minimal Architecture for Grids
Core Grid Functions: A Minimal Architecture for Grids
Presentation transcript:

Green Computing Metrics: Power, Temperature, CO2, … Computing system: Many-cores, Clusters, Grids and Clouds Algorithm and model: task scheduling, CFD model, … Middleware: auditing & insertion service, green resource management service, …

Power aware virtual machine scheduling in a DVFS cluster Virtual machine in Grids and Clouds Dynamic Voltage Frequency Scheduling Objective: dynamically scale voltages for virtual machines in a cluster

Virtual machines in compute cluster vm Compute node Compute node vm Compute node vm File server File server Head node Head node vm job Start a vm Execute job in a vm

Schedule virtual machines PE Scheduling algorithm Scheduling algorithm VM cluster queue

Power aware scheduling algorithm 1.Sort VMs in a decreasing order of required CPU speed 2.Set PEs to lowest voltages 3.put VMs to PEs 4.If cannot accommodate, level up PE voltages 5.Level down PE voltages whenever it is possible to accommodate VMs

Simulation Results

Experimental Results

Thermal aware workload scheduling in data centers Job-temperature model Data center resource model Thermal aware scheduling algorithm (TASA) Thermal aware workload scheduling framework Simulation

Job-temperature profile

Y Z X Rack Hot air Rack Node (x,y,z ) Node (x,y,z ) Data center model (1)

Data center model (2)

Thermal aware scheduling framework

Thermal aware scheduling algorithm (TASA) 1.Get thermal field of data center 2.Get compute node temperature 3.Put hottest job to coldest resources 4.Predict the compute node temperature after job execution 5.If a compute node temperature > redline, set it idle 6.thermal aware backfilling when it is possible

Simulation Real workload logged in Buffalo Univ. Temperature logged FCFS in Buffalo Univ. TASA Discussion

Workload in CCR

CCR Temperature

Simulation Result (1) Reduce max temperature: 6 F Reduce average temperature: 15 F Reduce power consumption 4000 kW/h Reduce CO2 emission kg

Simulation Result (2) Response time increase 13%

Green Data Center Computing: concept Software sensor Auditing & Insertion service Physical sensor Monitoring service CFD model Auditing & Insertion service Cooling system and compute resources in a data center Thermal aware resource management Workload model

Command Line Information Task Submission Cyberaide Shell Authentication and Authority Java CoG Kit Secure Web Service Cyberaide Portal Python Client Client Layer Middleware Layer Resource Layer Workflow Information collector Information collector Data Center Cyberaide Green: Software achitecture Thermal-Aware Meta Scheduler