1. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Heterogeneity-Aware Peak Power Management for Accelerator-Based Systems Gui-Bin Wang, Yi-Song Lin 2011 IEEE 17th International Conference on Parallel and Distributed Systems (ICPADS) Presented by Po-Ting Liu 2013/10/24 1

2. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Outline Introduction Motivation Mathematical Analyze and Algorithms Experiment Conclusion 2

3. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Introduction Motivation Mathematical Analyze and Algorithms Experiment Conclusion 3

4. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Introduction Importance of energy efficiency Coolingoverhead ReducereliabilityEnlarge system running cost Problem of High power consumption 4

5. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Introduction (cont.) Related work – Most for homogeneous system – None application-aware 5

6. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Introduction (cont.) 6

7. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Motivation Introduction Motivation Mathematical Analyze and Algorithms Experiment Conclusion 7

8. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Motivation Same power budget – Different partition ratio could produce different performance Different power budgets – The best partition ratio may be different 8

9. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms Introduction Motivation Mathematical Analyze and Algorithms Experiment Conclusion 9

10. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms 10

11. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) 11

12. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) Definition of schedule unit and work space – A loop iteration in a parallel loop is a basic schedule unit – Work space defined as 12

13. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) Execution time Total power consumption 13

14. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) 14

15. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) Use Lagrange multiplier 15

16. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) 16

17. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) The model predict the power usage – Some processors can run at their peak frequency – The frequency of residual processors should be smaller than peak 17

18. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) 18

19. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment Introduction Motivation Mathematical Analyze and Algorithms Experiment Conclusion 19

20. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment Experimental Environment 20 P.S. One CPU core to manage and schedule the GPU, other cores for executing program

21. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment (cont.) Tools – Tuning frequency CPU: ACPI (Advanced Configuration and Power Interface) GPU: AMD’s ADL interface (AMD Display Library) – Performance measure CPU: PCM (Performance Counter Monitor) GPU: Calculate from the speed on CPU and the relative speedup of GPU 21

22. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment (cont.) Experimental Application 22 Memory-intensive Compute-intensive

23. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment (cont.) 23

24. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment (cont.) 24

25. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment (cont.) Power Control Accuracy 25

26. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment (cont.) 26 Baseline: Peak frequency frequency Best Choose

27. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Conclusion Introduction Motivation Mathematical Analyze and Algorithms Experiment Conclusion 27

28. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Conclusion Power management for heterogeneous system Application-aware power management Maximize the system performance within a given power budget Improves the performance with 7.3% compared with existing method in average 28

29. Heterogeneity-Aware Peak Power Management for Accelerator-based Systems 29