1. S ELFISH M IGRATE : A Scalable Algorithm for Non-clairvoyantly Scheduling Heterogeneous Processors Janardhan Kulkarni, Duke University Sungjin Im (UC Merced ), Kamesh Munagala (Duke), Kirk Pruhs (UPitt)

2. 1 1 2 2 M M ONLINE UNRELATED MACHINE MODEL 3 3 - processing length - rate of processing - weight

3. 1 1 2 2 M M ONLINE UNRELATED MACHINE 3 3 100 (rate = 1, length=100) (rate = 0.5, length 200) (rate = 2, length =50) Time - processing length - rate of processing (rate = 0, length = infinity)

4. 1 1 2 2 M M NON-CLAIRVOYANCE 3 3 (rate = 1, length=100) (rate = 0, infinity) (rate = 0.5, length = 200) (rate = 2, length =50) - processing length - rate of processing - weight Time

5. FLOW-TIME (DELAY OR RESPONSE TIME)

6. ANOTHER FORM

7. SPEED-AUGMENTATION: - Online scheduler runs at higher speed PREMPTION: - S top a job in middle of processing and continue later. MIGRATION: - Change the assignment of jobs to machines at no cost.

8. NO PARALLEL PROCESSING - No job is simultaneously processed on multiple machines. 1 1 2 2 OK

9. NO PARALLEL PROCESSING: - No job is simultaneously processed on multiple machines. 1 1 2 2 NOT ALLOWED

10. How to schedule jobs to minimize sum of weighted flow-time for unrelated machines in non-clairvoyant model?

11. It was very difficult Motivation

12. Heterogeneous architectures are ubiquitous Non-clairvoyance is very important in practice Motivation

13. S ELFISH M IGRATE is -speed -competitive for minimizing weighted flow-time on unrelated machines. Result also extends to energy + weighted flow-time. THE MAIN THEOREM

14. CLAIRVOYANT ALGORITHM Anand-Garg-Kumar, SODA ‘12 Chadha-Garg-Kumar-Muralidhara, STOC ‘09

15. Each machine schedules jobs using HDF (SJF) policy When a new job arrives, calculate the increase in the objective when the job is assigned to each of the machines. Assign the job greedily to the machine which increases the objective the least. ALGORITHM

16. SJF ALGORITHM 5 5 3 3 70 10 1 1 100 20 Increase B = 28 + 20 Increase A = 31 + 20 NEW

17. For all jobs For all machines

18. THE DUAL For all jobs machines and time instants

19. DUAL FITTING Increase in the objective due to the job The total number of jobs alive at time on machine Speed-Augmentation

20. = Increase in the objective due to the job and

21. The whole frame work breaks down for non-clairvoyant settings… 1.We cannot measure the increase in the objective 2.Migrating jobs is necessary 3.Migration of jobs makes calculating the flow- times difficult and complicates how jobs interfere with each other

22. SELFISHMIGRATE

23. KEY IDEA I Focus on speed at which jobs are getting processed and monotonicity of speed Speed of a job = fraction of the job processed at time

24. If is monotone, then

25. Dual Constraint:

26. If is monotone, then Dual Constraint:

27. Fraction of processor allocated = Round Robin or Proportional Sharing

28. If is monotone, then Dual Constraints:

29. If is monotone, then Dual Constraints: But which machine we should assign the job ?

30. If is monotone, then Dual Constraints: But which machine we should assign the job ? ANS IS MINIMUM

31. Dual constraints need us… For all jobs machines and time instants 1. BEST MACHINE- which maximizes speed. 2.The speed MONOTONICALLY increases.

32. KEY IDEA II: VIRTUAL QUEUES, VIRTUAL SPEED RR j

33. VIRTUAL QUEUES, VIRTUAL SPEEDS RR Inverse of instantaneous delay the job induces on the other jobs ahead of its virtual queue.

34. KEY IDEA II: VIRTUAL QUEUES, VIRTUAL SPEED RR Total delay induced by job if it stays on the machine till its completion is proportional to

35. KEY IDEA III: SELFISHMIGRATE RULE 1: NO JUMPING ( not even virtual ones! )

36. Virtual speed of other jobs does not decrease if a job enters the machine! RULE 1: NO JUMPING

37. RULE 2: BE SELFISH! Increases virtual speed… migrate! Any time!

38. RULE 2: BE SELFISH! Remains Same Increases!

39. Jobs migrate whenever they can increase their virtual speed...

40. Jobs migrate whenever they can increase their virtual speed…..

41. Jobs migrate whenever they can increase their virtual speed…

42. Jobs migrate whenever they can increase their virtual speed…..

43. This cannot go on forever… as virtual speeds are finite

44. We get …MONOTONICITY Virtual speeds are monotone non-decreasing!

45. BEST MACHINE each job chooses the best machine on arrival

46. BEST MACHINE (Nash Equilibrium on Virtual Speed) S ELFISH M IGRATE ensures this is true at all times by design!

47. BEST MACHINE Entire process can be thought as Coordination ‘game’ on virtual speeds

48. DUAL SETTINGS The total delay job causes on the jobs ahead of its virtual queue over its entire sojourn

52. DUAL SETTINGS The total delay job j causes on the jobs ahead of its virtual queue over its entire sojourn + its total processing time. The flow-time of all jobs (Cost of the algorithm)

53. The total number of jobs in the queue at time t. The total flow-time of all jobs (Cost of the algorithm) Dual setting = =

54. DUAL OBJECTIVE

55. What About Constraints? For all jobs machines and time instants

56. DELAY LEMMAS (Follows from a property of Round Robin) Total delay a job induced on jobs ahead of it over the interval Total delay a job induced on jobs ahead of it in

57. DELAY LEMMA

58. MINIMUM ( BEST MACHINE )

59. We gave a new framework to analyze non-clairvoyant scheduling problems CONCLUSIONS and OPEN PROBLEMS - norms of weighted flow-time

60. THANKS