Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Heterogeneity-Aware Peak Power Management for Accelerator-Based Systems Gui-Bin Wang, Yi-Song Lin 2011 IEEE 17th International Conference on Parallel and Distributed Systems (ICPADS) Presented by Po-Ting Liu 2013/10/24 1

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Outline Introduction Motivation Mathematical Analyze and Algorithms Experiment Conclusion 2

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Introduction Motivation Mathematical Analyze and Algorithms Experiment Conclusion 3

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Introduction Importance of energy efficiency Coolingoverhead ReducereliabilityEnlarge system running cost Problem of High power consumption 4

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Introduction (cont.) Related work – Most for homogeneous system – None application-aware 5

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Introduction (cont.) 6

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Motivation Introduction Motivation Mathematical Analyze and Algorithms Experiment Conclusion 7

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Motivation Same power budget – Different partition ratio could produce different performance Different power budgets – The best partition ratio may be different 8

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms Introduction Motivation Mathematical Analyze and Algorithms Experiment Conclusion 9

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms 10

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) 11

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) Definition of schedule unit and work space – A loop iteration in a parallel loop is a basic schedule unit – Work space defined as 12

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) Execution time Total power consumption 13

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) 14

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) Use Lagrange multiplier 15

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) 16

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) The model predict the power usage – Some processors can run at their peak frequency – The frequency of residual processors should be smaller than peak 17

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Mathematical Analyze and Algorithms (cont.) 18

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment Introduction Motivation Mathematical Analyze and Algorithms Experiment Conclusion 19

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment Experimental Environment 20 P.S. One CPU core to manage and schedule the GPU, other cores for executing program

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment (cont.) Tools – Tuning frequency CPU: ACPI (Advanced Configuration and Power Interface) GPU: AMD’s ADL interface (AMD Display Library) – Performance measure CPU: PCM (Performance Counter Monitor) GPU: Calculate from the speed on CPU and the relative speedup of GPU 21

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment (cont.) Experimental Application 22 Memory-intensive Compute-intensive

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment (cont.) 23

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment (cont.) 24

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment (cont.) Power Control Accuracy 25

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Experiment (cont.) 26 Baseline: Peak frequency frequency Best Choose

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Conclusion Introduction Motivation Mathematical Analyze and Algorithms Experiment Conclusion 27

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems Conclusion Power management for heterogeneous system Application-aware power management Maximize the system performance within a given power budget Improves the performance with 7.3% compared with existing method in average 28

Heterogeneity-Aware Peak Power Management for Accelerator-based Systems 29