XI HE Computing and Information Science Rochester Institute of Technology Rochester, NY USA Rochester Institute of Technology Service.

Slides:



Advertisements
Similar presentations
Energy-efficient Task Scheduling in Heterogeneous Environment 2013/10/25.
Advertisements

University of Minnesota Optimizing MapReduce Provisioning in the Cloud Michael Cardosa, Aameek Singh†, Himabindu Pucha†, Abhishek Chandra
1 “Scheduling with Dynamic Voltage/Speed Adjustment Using Slack Reclamation In Multi-processor Real-Time Systems” Dakai Zhu, Rami Melhem, and Bruce Childers.
SLA-Oriented Resource Provisioning for Cloud Computing
Efficient Resource Management for Cloud Computing Environments Andrew J. Younge, Gregor von Laszewski, Lizhe Wang, Sonia Lopez-Alarcon, Warren Carithers.
A Cyber-Physical Systems Approach to Energy Management in Data Centers Presented by Chen He Adopted form the paper authors.
Green Cloud Computing Hadi Salimi Distributed Systems Lab, School of Computer Engineering, Iran University of Science and Technology,
Green Software Engineering Sheryl John Introducing green elements and guidelines in Software Engineering.
Keeping Hot Chips Cool Thermal Management for Green Computing Yang Ge Professor Qinru Qiu.
Task Assignment and Transaction Clustering Heuristics.
Energy Efficient Web Server Cluster Andrew Krioukov, Sara Alspaugh, Laura Keys, David Culler, Randy Katz.
Akhil Langer, Harshit Dokania, Laxmikant Kale, Udatta Palekar* Parallel Programming Laboratory Department of Computer Science University of Illinois at.
Present By : Bahar Fatholapour M.Sc. Student in Information Technology Mazandaran University of Science and Technology Supervisor:
Efficient Resource Management for Cloud Computing Environments Andrew J. Younge Golisano College of Computing and Information Sciences Rochester Institute.
Resource Management in Virtualization-based Data Centers Bhuvan Urgaonkar Computer Systems Laboratory Pennsylvania State University Bhuvan Urgaonkar Computer.
Thermal Aware Resource Management Framework Xi He, Gregor von Laszewski, Lizhe Wang Golisano College of Computing and Information Sciences Rochester Institute.
Green IT and Data Centers Darshan R. Kapadia Gregor von Laszewski 1.
XI HE Computing and Information Science Rochester Institute of Technology Rochester, NY USA Rochester Institute of Technology Service.
OPTIMAL SERVER PROVISIONING AND FREQUENCY ADJUSTMENT IN SERVER CLUSTERS Presented by: Xinying Zheng 09/13/ XINYING ZHENG, YU CAI MICHIGAN TECHNOLOGICAL.
Sensor-Based Fast Thermal Evaluation Model For Energy Efficient High-Performance Datacenters Q. Tang, T. Mukherjee, Sandeep K. S. Gupta Department of Computer.
November , 2009SERVICE COMPUTATION 2009 Analysis of Energy Efficiency in Clouds H. AbdelSalamK. Maly R. MukkamalaM. Zubair Department.
Cloud Computing Energy efficient cloud computing Keke Chen.
Andrew J. Younge Golisano College of Computing and Information Sciences Rochester Institute of Technology 102 Lomb Memorial Drive Rochester, New York
Energy Usage in Cloud Part2 Salih Safa BACANLI. Cooling Virtualization Energy Proportional System Conclusion.
Temperature Aware Load Balancing For Parallel Applications Osman Sarood Parallel Programming Lab (PPL) University of Illinois Urbana Champaign.
Summer Report Xi He Golisano College of Computing and Information Sciences Rochester Institute of Technology Rochester, NY
Lots of hype, little science But – lots of this hype is real, and there are many challenging engineering problems Initially, we focus on data centers:
1 Distributed Energy-Efficient Scheduling for Data-Intensive Applications with Deadline Constraints on Data Grids Cong Liu and Xiao Qin Auburn University.
Eneryg Efficiency for MapReduce Workloads: An Indepth Study Boliang Feng Renmin University of China Dec 19.
Grid Computing at The Hartford Condor Week 2008 Robert Nordlund
Abhilash Thekkilakattil, Radu Dobrin, Sasikumar Punnekkat Mälardalen Real-time Research Center, Mälardalen University Västerås, Sweden Towards Preemption.
Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters
GreenSched: An Energy-Aware Hadoop Workflow Scheduler
Headline in Arial Bold 30pt HPC User Forum, April 2008 John Hesterberg HPC OS Directions and Requirements.
Thermal-aware Issues in Computers IMPACT Lab. Part A Overview of Thermal-related Technologies.
1 CMPE 511 HIGH PERFORMANCE COMPUTING CLUSTERS Dilek Demirel İşçi.
Towards Dynamic Green-Sizing for Database Servers Mustafa Korkmaz, Alexey Karyakin, Martin Karsten, Kenneth Salem University of Waterloo.
Scheduling in HPC Resource Management System: Queuing vs. Planning Matthias Hovestadt, Odej Kao, Alex Keller, and Achim Streit 2003 Job Scheduling Strategies.
VGreen: A System for Energy Efficient Manager in Virtualized Environments G. Dhiman, G Marchetti, T Rosing ISLPED 2009.
Power-Aware Parallel Job Scheduling
Software Architecture for Dynamic Thermal Management in Datacenters Tridib Mukherjee Graduate Research Assistant IMPACT Lab ( Department.
An Energy-efficient Task Scheduler for Multi-core Platforms with per-core DVFS Based on Task Characteristics Ching-Chi Lin Institute of Information Science,
Thermal Aware Data Management in Cloud based Data Centers Ling Liu College of Computing Georgia Institute of Technology NSF SEEDM workshop, May 2-3, 2011.
Efficient Resource Management for Cloud Computing Environments Andrew J. Younge Golisano College of Computing and Information Sciences Rochester Institute.
Green Computing Metrics: Power, Temperature, CO2, … Computing system: Many-cores, Clusters, Grids and Clouds Algorithm and model: task scheduling, CFD.
Experiment Management with Microsoft Project Gregor von Laszewski Leor E. Dilmanian Link to presentation on wiki 12:13:33Service Oriented Cyberinfrastructure.
Virtualization and Databases Ashraf Aboulnaga University of Waterloo.
June 30 - July 2, 2009AIMS 2009 Towards Energy Efficient Change Management in A Cloud Computing Environment: A Pro-Active Approach H. AbdelSalamK. Maly.
1 Thermal Management of Datacenter Qinghui Tang. 2 Preliminaries What is data center What is thermal management Why does Intel Care Why Computer Science.
Thermal-aware Task Placement in Data Centers Qinghui Tang Sandeep K S Gupta Georgios Varsamopoulos IMPACT Lab Arizona State University.
Timeshared Parallel Machines Need resource management Need resource management Shrink and expand individual jobs to available sets of processors Shrink.
Accounting for Load Variation in Energy-Efficient Data Centers
Xi He Golisano College of Computing and Information Sciences Rochester Institute of Technology Rochester, NY THERMAL-AWARE RESOURCE.
CprE 458/558: Real-Time Systems (G. Manimaran)1 Energy Aware Real Time Systems - Scheduling algorithms Acknowledgement: G. Sudha Anil Kumar Real Time Computing.
Ensieea Rizwani An energy-efficient management mechanism for large-scale server clusters By: Zhenghua Xue, Dong, Ma, Fan, Mei 1.
Thermal Management in Datacenters Ayan Banerjee. Thermal Management using task placement Tasks: Requires a certain number of servers (cores) for a specified.
CSE 591: Energy-Efficient Computing Lecture 3 SPEED: processor Anshul Gandhi 347, CS building
Lizhe Wang, Gregor von Laszewski, Jai Dayal, Thomas R. Furlani
OPERATING SYSTEMS CS 3502 Fall 2017
Lecture 2: Performance Evaluation
Thermal-aware Task Placement in Data Centers (part 4)
Clouds , Grids and Clusters
Jacob R. Lorch Microsoft Research
Integration of Openstack Cloud Resources in BES III Computing Cluster
Green cloud computing 2 Cs 595 Lecture 15.
Computing Resource Allocation and Scheduling in A Data Center
Towards Green Aware Computing at Indiana University
CLUSTER COMPUTING.
Scientific Computational Reproducibility
Presentation transcript:

XI HE Computing and Information Science Rochester Institute of Technology Rochester, NY USA Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

Background Problem Definition Related work Data collection System model Analysis result Conclusion Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

 61 billion kilowatt-hours of power in 2006, 1.5 percent of all US electricity use, worthy of $4.5 billion.  Energy usage doubled between 2000 and 2006  Double again by 2011 [1] Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

Dynamic Voltage Scaling hardware Level Dynamic Frequency Scaling Fan Speeding Scaling Platform Virtualization Software Level Application Power Management Job Scheduling Middleware Level Virtual Machine Scheduling The basic idea is make the servers use as little electricity as possible. Cooling System Data Center Level Water management

Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab Dynamic Voltage Scaling Hardware Level Dynamic Frequency Scaling Fan Speeding Scaling Platform Virtualization Software Level Application Power Management Job Scheduling Middleware Level Virtual Machine Scheduling Platform Virtualization makes the server consolidation possible Cooling System Data Center Level Water management

Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab Dynamic Voltage Scaling Hardware Level Dynamic Frequency Scaling Fan Speeding Scaling Job Scheduling Middleware Level Virtual Machine Scheduling My Research Focus Cooling System Data Center Level Water management Platform Virtualization Software Level Application Power Management

Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab Dynamic Voltage Scaling Hardware Level Dynamic Frequency Scaling Fan Speeding Scaling Job Scheduling Middleware Level Virtual Machine Scheduling Cooling System Data Center Level Water management Platform Virtualization Software Level Application Power Management Save the cooling power and recycle water

Now we define the problem of thermal-aware scheduling as follows: Given a set of jobs. Find an optimal schedule to assign each job to the nodes to minimize the temperature increase in the data center. Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

The data is collected and provided by the Center for Computational Research (CCR) [3] at State University of New York at Buffalo from the U2 cluster. U2 clusters is composed of 1056 Dell PowerEdge SC1425 nodes each of which has 2 processors. The data from CCR is collected in a 30-days period, from to Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

We can model the data center Γ Γ = {C, J } Where, C indicates the U2 cluster, and J represents the jobs submitted to the data center to be scheduled for a period of time. Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

Where, the cluster C is composed of 1056 nodes. n i stands for the i th node in the cluster. T indicates the temperature in node n i which contain p 1 and p 2 2 processors. Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

Where, j i denotes the i th job running on a set of nodes. j i was submitted to the queue at the time of t submit and was queued at the time of t q. The job started execution at t s and ended execution at t e. It required cpus processors and consumed t cpu CPU time. Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

Job distribution in terms of its execution time. Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

Job distribution in terms of its size. Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

Job distribution in terms of its respond time. Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

Job arrival rate distribution Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

Temperature distribution Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

Relation between workload and temperature Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

The research is ongoing. Next step is to predict the future temperature. Then according to the future temperature, schedule the jobs. Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

 Thermal-aware Task Placement in Data Centers [2] Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

 Thermal-aware Task Placement in Data Centers [2] Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

22 Different task assignments lead to different power consumption distributions Different power consumption distributions lead to different temperature distributions Different temperature distributions lead to different total energy costs. For example, you have different cooling cost because you have to ensure the highest temperature is below the redline. Server task distribution Power consumption distribution Temperature distribution Energy cost

 Questions?  Comments?  Suggestions? Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

[1] elopment/downloads/EPA_Datacenter_Report_Con gress_Final1.pdf [2] Tang, Qinghui; Gupta, Sandeep Kumar S.; Varsamopoulos, Georgios; Parallel and Distributed Systems, IEEE Transactions on Volume 19, Issue 11, Nov Page(s): [3] “the Center of Computational Research.” [Online]. Available: http: // Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab

Node1 Temp:113F Node2 Temp:115F Data Center Task1 (2G*1Hour)Task2 (1G*3Hour)