Packing Jobs onto Machines in Datacenters

Slides:



Advertisements
Similar presentations
Energy-efficient Task Scheduling in Heterogeneous Environment 2013/10/25.
Advertisements

CALTECH CS137 Fall DeHon 1 CS137: Electronic Design Automation Day 19: November 21, 2005 Scheduling Introduction.
P3- Represent how data flows around a computer system
Real- time Dynamic Voltage Scaling for Low- Power Embedded Operating Systems Written by P. Pillai and K.G. Shin Presented by Gaurav Saxena CSE 666 – Real.
CHAPTER 2 PROCESSOR SCHEDULING PART I By U ğ ur HALICI.
Walter Binder University of Lugano, Switzerland Niranjan Suri IHMC, Florida, USA Green Computing: Energy Consumption Optimized Service Hosting.
Performance Anomalies Within The Cloud 1 This slide includes content from slides by Venkatanathan Varadarajan and Benjamin Farley.
Energy-efficient Virtual Machine Provision Algorithms for Cloud System Ching-Chi Lin Institute of Information Science, Academia Sinica Department of Computer.
Lincoln University Canterbury New Zealand Evaluating the Parallel Performance of a Heterogeneous System Elizabeth Post Hendrik Goosen formerly of Department.
MCITP Guide to Microsoft Windows Server 2008 Server Administration (Exam #70-646) Chapter 11 Windows Server 2008 Virtualization.
CMSC 421: Principles of Operating Systems Section 0202 Instructor: Dipanjan Chakraborty Office: ITE 374
SLA-aware Virtual Resource Management for Cloud Infrastructures
CPU Scheduling. Schedulers Process migrates among several queues –Device queue, job queue, ready queue Scheduler selects a process to run from these queues.
1 Class Constrained Packing We need to pack items into bins. All the bins have the same capacity. Each bin can accommodate items from a bounded number.
Energy Efficient Web Server Cluster Andrew Krioukov, Sara Alspaugh, Laura Keys, David Culler, Randy Katz.
Akhil Langer, Harshit Dokania, Laxmikant Kale, Udatta Palekar* Parallel Programming Laboratory Department of Computer Science University of Illinois at.
Processor 1 Processor 2 Disk 1 Disk 2 tasks Demo 1: Computer System with 2 Processors Sharing 2 Disks in Parallel.
GCSE Computing#BristolMet Session Objectives# Must identify some common types of computer system Should describe the meaning of a computer system Could.
Energy Aware Network Operations Authors: Priya Mahadevan, Puneet Sharma, Sujata Banerjee, Parthasarathy Ranganathan HP Labs IEEE Global Internet Symposium.
Energy, Energy, Energy  Worldwide efforts to reduce energy consumption  People can conserve. Large percentage savings possible, but each individual has.
Scheduling a Large DataCenter Cliff Stein Columbia University Google Research June, 2009 Monika Henzinger, Ana Radovanovic Google Research.
RAMCloud Design Review Recovery Ryan Stutsman April 1,
Task Dependence in Scheduling and Load Balancing Prof. Adam Meyerson UCLA.
Folklore Confirmed: Compiling for Speed = Compiling for Energy Tomofumi Yuki INRIA, Rennes Sanjay Rajopadhye Colorado State University 1.
Minimizing Response Time Implication in DVS Scheduling for Low Power Embedded Systems Sharvari Joshi Veronica Eyo.
M EAN -V ALUE A NALYSIS Manijeh Keshtgary O VERVIEW Analysis of Open Queueing Networks Mean-Value Analysis 2.
Chapter 3: Operating-System Structures System Components Operating System Services System Calls System Programs System Structure Virtual Machines System.
Approximation Algorithms for Task Allocation with QoS and Energy Considerations Bader N. Alahmad.
Temperature Aware Load Balancing For Parallel Applications Osman Sarood Parallel Programming Lab (PPL) University of Illinois Urbana Champaign.
Critical Power Slope Understanding the Runtime Effects of Frequency Scaling Akihiko Miyoshi, Charles Lefurgy, Eric Van Hensbergen Ram Rajamony Raj Rajkumar.
A-Level Computing#BristolMet Session Objectives# Must identify some common types of computer system Should describe the meaning of a computer system Could.
11 MANAGING PERFORMANCE Chapter 16. Chapter 16: MANAGING PERFORMANCE2 OVERVIEW  Optimize memory, disk, and CPU performance  Monitor system performance.
Memory The CPU in the computer fetches data and instructions from memory to process. This type of memory is called primary memory and it is the only memory.
Copyright © 2011, Performance Evaluation of a Green Scheduling Algorithm for Energy Savings in Cloud Computing Truong Vinh Truong Duy; Sato,
© 2012 IBM Corporation Platform Computing 1 IBM Platform Cluster Manager Data Center Operating System April 2013.
Chapter 5 Processor Scheduling Introduction Processor (CPU) scheduling is the sharing of the processor(s) among the processes in the ready queue.
Basic Systems and Software. Were we left off Computers are programmable (formal) machines. Digital information is stored as a series of two states (1.
Workload Clustering for Increasing Energy Savings on Embedded MPSoCs S. H. K. Narayanan, O. Ozturk, M. Kandemir, M. Karakoy.
Computer Performance. Hard Drive - HDD Stores your files, programs, and information. If it gets full, you can’t save any more. Measured in bytes (KB,
Jennifer Rexford Fall 2010 (TTh 1:30-2:50 in COS 302) COS 561: Advanced Computer Networks Energy.
Lecture 4 Page 1 CS 111 Summer 2013 Scheduling CS 111 Operating Systems Peter Reiher.
System Software (1) The Operating System
Memory Management Damian Gordon.
Wrong Presentation Put In
Energy Aware Network Operations
Cheltenham Courseware
Processes and threads.
Green cloud computing 2 Cs 595 Lecture 15.
Sujata Ray Dey Maheshtala College Computer Science Department
CS 425 / ECE 428 Distributed Systems Fall 2016 Nov 10, 2016
ElasticTree Michael Fruchtman.
CS 425 / ECE 428 Distributed Systems Fall 2017 Nov 16, 2017
Overview Introduction to Operating Systems
1. 2 VIRTUAL MACHINES By: Satya Prasanna Mallick Reg.No
Process Virtualization. Process Process is a program that has initiated its execution. A program is a passive entity; whereas a process is an active entity.
Digital Processing Platform
Zhen Xiao, Qi Chen, and Haipeng Luo May 2013
Energy Efficient Scheduling in IoT Networks
Sanjoy Baruah The University of North Carolina at Chapel Hill
Topics Introduction Hardware and Software How Computers Store Data
Process & its States Lecture 5.
TDC 311 Process Scheduling.
Cooperative Caching, Simplified
Sujata Ray Dey Maheshtala College Computer Science Department
Year 9 Entry Level Computing
Chapter 6: Scheduling Algorithms Dr. Amjad Ali
Operating System Overview
A workload-aware energy model for VM migration
Installing A Graphics Card
Chapter 13: I/O Systems “The two main jobs of a computer are I/O and [CPU] processing. In many cases, the main job is I/O, and the [CPU] processing is.
Presentation transcript:

Packing Jobs onto Machines in Datacenters Cliff Stein Columbia University

Modelling Partly from Rodero et. al. Partly from some google experience M heterogeneous machines (RAM, CPU, disk) N jobs (RAM, CPU, disk, processing time, arrival time) On-line Objectives: response time, energy Alternative Objective: minimum number of machines

Power saving assumptions If a machine is idle, it can be shut down (0 power) If a machine has light processing requirements, and high memory, the processor can be slowed down If a machine has low memory utilization, the memory can be slowed down If a machine doesn’t use disk much, the disk can be shut off (use network instead)

Table from Rodero Running normal Running Low Idle CPU 155w 105w 85w Memory 70w 30w Disk 50w 10w

First problem Off Line Pack Jobs onto Machines Flow Time constrained to be at most α (lower bound) Energy model. At any time on any machine, power is a function of (memory, cpu) as from previous table. Consider either three-state (off, low, high), or linear interpolation based on load. Minimize total energy used.

Second problem On-line Allow migration Deadlines?

A different problem