Deadline Scheduling and Heavy tail distributionS

Slides:



Advertisements
Similar presentations
1 Real-Time Queueing Theory Presented by: John Lehoczky Carnegie Mellon SAMSI Workshop Congestion Control and Heavy Traffic.
Advertisements

Feedback Control Real-Time Scheduling: Framework, Modeling, and Algorithms Chenyang Lu, John A. Stankovic, Gang Tao, Sang H. Son Presented by Josh Carl.
Hadi Goudarzi and Massoud Pedram
Lab Assignment 1 COP 4600: Operating Systems Principles Dr. Sumi Helal Professor Computer & Information Science & Engineering Department University of.
Elevator Scheduling Ingrid Cheh Xuxu Liu 05/05/09.
Fair Real-time Traffic Scheduling over A Wireless Local Area Network Maria Adamou, Sanjeev Khanna, Insup Lee, Insik Shin, and Shiyu Zhou Dept. of Computer.
1 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Embedded Systems Exercise 2: Scheduling Real-Time Aperiodic Tasks.
Overview of Matchmaking and Scheduling (Mapping) Algorithm
Load Balancing of Elastic Traffic in Heterogeneous Wireless Networks Abdulfetah Khalid, Samuli Aalto and Pasi Lassila
Competitive Analysis of Buffer Policies with SLA Commitments Boaz Patt-Shamir, Tel Aviv University Gabriel Scalosub, University of Toronto Yuval Shavitt,
Power Cost Reduction in Distributed Data Centers Yuan Yao University of Southern California 1 Joint work: Longbo Huang, Abhishek Sharma, LeanaGolubchik.
Towards Feasibility Region Calculus: An End-to-end Schedulability Analysis of Real- Time Multistage Execution William Hawkins and Tarek Abdelzaher Presented.
Queuing Theory For Dummies
Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Power Management for Solar-Driven Sensor Nodes Clemens Moser ( joint.
1 Ecole Polytechnque, Nov 7, 2007 Scheduling Unit Jobs to Maximize Throughput Jobs:  all have processing time (length) = 1  release time r j  deadline.
Optimization for QoS on Systems with Tasks Deadlines Luis Fernando Orleans Pedro Nuno Furtado.
Tians Scheduling: Using Partial Processing in Best-Effort Applications Yuxiong He *, Sameh Elnikety *, Hongyang Sun + * Microsoft Research + Nanyang Technological.
CSE 421 Algorithms Richard Anderson Lecture 6 Greedy Algorithms.
7/3/2015© 2007 Raymond P. Jefferis III1 Queuing Systems.
OS Fall ’ 02 Performance Evaluation Operating Systems Fall 2002.
Energy, Energy, Energy  Worldwide efforts to reduce energy consumption  People can conserve. Large percentage savings possible, but each individual has.
Scheduling of Flexible Resources in Professional Service Firms Arun Singh CS 537- Dr. G.S. Young Dept. of Computer Science Cal Poly Pomona.
Buffer Management for Shared- Memory ATM Switches Written By: Mutlu Apraci John A.Copelan Georgia Institute of Technology Presented By: Yan Huang.
Dimitrios Konstantas, Evangelos Grigoroudis, Vassilis S. Kouikoglou and Stratos Ioannidis Department of Production Engineering and Management Technical.
1 Real-Time Queueing Network Theory Presented by Akramul Azim Department of Electrical and Computer Engineering University of Waterloo, Canada John P.
Flows and Networks Plan for today (lecture 5): Last time / Questions? Waiting time simple queue Little Sojourn time tandem network Jackson network: mean.
Distributed Real-Time systems 1 By: Mahdi Sadeghizadeh Website: Sadeghizadeh.ir Advanced Computer Networks.
Integrated Risk Analysis for a Commercial Computing Service Chee Shin Yeo and Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Lab. Dept.
Fair Real-time Traffic Scheduling over Wireless Local Area Networks Insik Shin Joint work with M. Adamou, S. Khanna, I. Lee, and S. Zhou Dept. of Computer.
Throughput Competitive Online Routing Baruch Awerbuch Yossi Azar Serge Plotkin.
Yossi Azar Tel Aviv University Joint work with Ilan Cohen Serving in the Dark 1.
Stochastic Processes A stochastic process is a model that evolves in time or space subject to probabilistic laws. The simplest example is the one-dimensional.
© 2009 IBM Corporation 1 Improving Consolidation of Virtual Machines with Risk-aware Bandwidth Oversubscription in Compute Clouds Amir Epstein Joint work.
Probabilistic Preemption Control using Frequency Scaling for Sporadic Real-time Tasks Abhilash Thekkilakattil, Radu Dobrin and Sasikumar Punnekkat.
A Maiden Analysis of Longest Wait First Jeff Edmonds York University Kirk Pruhs University of Pittsburgh.
Scheduling Periodic Real-Time Tasks with Heterogeneous Reward Requirements I-Hong Hou and P.R. Kumar 1.
An Optimal Service Ordering for a World Wide Web Server A Presentation for the Fifth INFORMS Telecommunications Conference March 6, 2000 Amy Csizmar Dalal.
CprE 458/558: Real-Time Systems (G. Manimaran)1 CprE 458/558: Real-Time Systems RMS and EDF Schedulers.
An Optimal Distributed Call Admission control for Adaptive Multimedia in Wireless/Mobile Networks Reporter: 電機所 鄭志川.
CSCI1600: Embedded and Real Time Software Lecture 24: Real Time Scheduling II Steven Reiss, Fall 2015.
OPERATING SYSTEMS CS 3530 Summer 2014 Systems and Models Chapter 03.
Static Process Scheduling
Non-Preemptive Buffer Management for Latency Sensitive Packets Moran Feldman Technion Seffi Naor Technion.
Sandtids systemer 2.modul el. Henriks 1. forsøg m. Power Point.
Buffering problems Moran Feldman Technion Based on joint work with Seffi Naor.
CSE 421 Algorithms Richard Anderson Lecture 8 Greedy Algorithms: Homework Scheduling and Optimal Caching.
McGraw-Hill/Irwin Copyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 18 Management of Waiting Lines.
Networks (3TU) Plan for today (lecture 5): Last time / Questions? Tandem network Jackson network: definition Jackson network: equilibrium distribution.
OPERATING SYSTEMS CS 3502 Fall 2017
Simulation and Exploration of
Trading Timeliness and Accuracy in Geo-Distributed Streaming Analytics
Load Balancing and Data centers
Serve Assignment Policies
Lecture 24: Process Scheduling Examples and for Real-time Systems
CprE 458/558: Real-Time Systems
On Scheduling in Map-Reduce and Flow-Shops
Professor Arne Thesen, University of Wisconsin-Madison
MENTER: Dynamic Traffic Engineering for MPLS Networks
CSCI1600: Embedded and Real Time Software
Networked Real-Time Systems: Routing and Scheduling
Greedy Algorithms: Homework Scheduling and Optimal Caching
Deadline Scheduling and Heavy tailED distributions
Buffer Management for Shared-Memory ATM Switches
Javad Ghaderi, Tianxiong Ji and R. Srikant
Richard Anderson Winter 2019 Lecture 8 – Greedy Algorithms II
Predictive Keyword Scores to Optimize Online Advertising Campaigns
Cloud Computing and Multivariate Heavy Tails
Schedulability Conditions for Scheduling Algorithms
Numerical Studies on Braess-like Paradoxes for Non-Cooperative Load Balancing in Distributed Computer Systems By Said Fathy El-Zoghdy, Hisao Kameda, and.
Richard Anderson Autumn 2019 Lecture 8 – Greedy Algorithms II
Presentation transcript:

Deadline Scheduling and Heavy tail distributionS Lang Tong School of Electrical and Computer Engineering Cornell University, Ithaca, NY 14850

Overview What am I working on What do I intend to work on Deadline scheduling with outsourcing options: algorithms and performance analysis Worst-case optimal deadline scheduler What do I intend to work on Investigate impacts of multivariate heavy tail distribution on deadline scheduling performance

Deadline scheduling and outsourcing Key characteristics: Jobs with different sizes, deadlines, and rewards Multiple local inexpensive servers with varying capacities Expensive outsourcing options Scheduling actions: Admission: whether to take on a job Scheduling: which server should be assigned Outsourcing: whether and when to outsource

Applications Scheduling for distributed resources in cloud

Jobs with deadlines

Profit = Revenue - Cost

Offline deadline scheduling

Online deadline scheduling

Example: earliest deadline first (EDF)

Competitive ratio: online vs. offline

Optimal competitive ratio

EDF under stress

Deadline scheduling with admission control

Maximum competitive ratio

Maximum competitive ratio bounds

Maximum competitive ratio bounds

Insights and intuitions Easy cases: lightly loaded traffic Heavy tailed deadlines, heavy tailed interarrivals. Worst cases: Cascades of heavy tailed jobs. Optimal deadline scheduling Threshold admission control + EDF Load balancing

Converse:

Converse:

Achievability: TAGS Easy job: accept + LLF Difficult job: reward threshold test

Proof sketch:

Some numerical results: light tail jobs Exponential job length, Poisson arrival

Effects of job size Pareto job length, Poisson arrival

Effects of job size and arrival Pareto job length and independent Pareto inter-arrival

Effects of job size Pareto job length and Markov dependent Pareto inter-arrival

Summary remarks Deadline scheduling is a classical problem that arises in many applications with real-time operation constraints. Very little is known about the impact of heavy tailed distributions on performance. We have developed a simple but optimal online scheduling (in competitive ratio) with very good performance in simulations involving heavy tail distributions.