1. Efficient Decoupling Capacitance Budgeting Considering Operation and Process Variations Yiyu Shi*, Jinjun Xiong +, Chunchen Liu* and Lei He* *Electrical Engineering Department, UCLA + IBM T. J. Watson Research Center, Yorktown Heights, NY This work is partially supported by NSF CAREER award and a UC MICRO grant sponsored by Altera, RIO and Intel.

2. Motivation The continuous semiconductor technology scaling leads to growing process variations, and statistical optimization has been actively researched to cope with process variations.  Stochastic gate sizing for power reduction [Bhardwaj:DAC’05, Mani:DAC’05]  Stochastic gate sizing for yield optimization [Davoodi:DAC’06, Sinha:ICCAD’05]  Stochastic buffer insertion to minimize delay [He:TCAD’07]  Adaptive body biasing with post-silicon tuning [Main:ICCAD’06] However, all these work ignore operation variation such as  crosstalk difference over input vectors  power supply noise fluctuation over time  processor temperature variation over workload A better design could be achieved by considering both operation and process variations  As a vehicle to demonstrate this point, we study the on-chip decoupling capacitance insertion and sizing (or decap budgeting) problem taking into account operation and process variations

3. Decap Budgeting Overview Nodes away from Vdd pin may suffer from supply noise due to sudden burst of activity  Provide current for surplus need from the local storage charge Side effect of adding too much decap  Increased leakage  Increased die area  Risk of yield loss Location matters  The closer to the turbulent point, the more noise reduction can be achieved Given the amount of decap to be inserted, find the optimal location so that the noise can be suppressed to a maximum extent. decap VnVn t0t0 t1t1 intrinsic cap Load current power supply We define the noise as the integral over time of the area below

4. Decap Budgeting Problem Formulation Objective  Find the distribution and location of the white space so the noise on power network is minimized Constraints:  Local decap constraints  Local decap constraints: amount of decap allowed at each location is limited due to placement constraint  Global decap constraints  Global decap constraints: total amount of decap allowed is limited due to leakage constraint Limitation of existing work:  Most existing work in essence uses worst case load current in order to guarantee there is no noise violation, which is too pessimistic  It is not clear how to provide decap budgeting solution that is robust to current loads under all kinds of operations for a circuit

5. Major Contribution of our work In this paper, we develop a novel stochastic model for current loads, taking into account operation variation such as temporal and logic-induced correlations and process variations such as systematic and random Leff variation. We propose a formal method to extract operation variation and formulate a new decap budgeting problem using the stochastic current model. We develop an effective yet efficient iterative alternative programming algorithm and conduct experiments using industrial designs. Experiments show that considering both operation and process variations can reduce over-design significantly. This demonstrates the importance of considering operation variation.

6. Outline Stochastic Modeling and Problem Formulation Algorithm Experimental Results Conclusions

7. Correlated Load Currents Strong correlation between load currents due to  Operation variation Currents at different ports have logic-induced correlation –Large number of ports with limited control bits –Currents at certain ports cannot reach maximum at the same time due to the inherent logic dependency for a given design Currents at the same port have temporal correlation –System takes several clock cycles to execute one instruction –The currents cannot reach maximum at all the clock cycles  Process variation Currents have intra-die variation due to process variation –The P/G network is robust to process variation, but the load currents have intra-die variation because the circuit suffers from process variation. –Leff variation is one of the primary variation sources and the variation is spatially correlated [Cao:DAC ’ 05]

8. Current Sampling Model the current in each clock cycle as a triangular waveform and assume constant rising/falling time  Other current waveforms can be used. It will not affect the algorithm  In our verification, we use the detailed non-simplified current waveform Partition a circuit into blocks and assume no correlation between different blocks [Najm:ICCAD’05] Extensive simulation for each block to get the peak current value in each clock cycle and at each port. Assume there is only temporal correlation within certain number of clock cycles L  L can be the number of clock cycles to execute certain function

9. Stochastic Current Modeling Divide peak current values into different sets according to the clock cycle and port number  The set contains peak current values at port k and in clock cycle j, j+L, j+2L,… Example: Take L=2, and consider two ports in 8 consecutive clock cycles  Define to be the stochastic variable with the sample set For example, has the samples 0.1, 0.3, 0.5, 0.7, and therefore has mean value 0,4 The correlation between and reflects the temporal correlation between clock cycle j 1 and j 2 The correlation between and reflects the logic induced correlation between port k 1 and k 2. clock cycles j, temporal correlation port k, logic-induced correlation

10. Extraction of Correlations The logic-induced correlation coefficient between port k 1 and k 2 at clock cycle j can be computed as Temporal correlation coefficient between clock cycle j 1 and j 2 at port k can be computed as To take process variation into consideration, sample each multiple times over different region, and the above two formulas can still be applied

11. Extraction of Correlations As is not Gaussian, apply Independent Component Analysis [ Hyvarinen’01] to remove the correlation between and get a new set of independent variables r 1, r 2, …  Each can be represented by the linear combination of r 1, r 2,…  Accordingly the waveform at each clock cycle can be reconstructed from those r 1,r 2,…, i.e.,  The new variables r i catch both the operation and process variations.

12. Example of Extracted Temporal Correlation The correlation map for peak currents between different clock cycles of one port from an industry application.  The P/G network is modeled as RC mesh  The load currents are obtained by detailed simulation of the circuit It can be seen that the correlation matrix can be clearly divided into four trunks, and L can be set as 10

13. Parameterized MNA Formulation Original MNA formulation With the design variables - decap area w i, the G, C matrices can be expressed as Together with the stochastic current model, the MNA formulation becomes:  With parameters w i and r i  The objective now is to find the optimal solution for those parameters More specifically, find the w i values that minimize the noise with the r i corresponding to the load currents which introduce the maximum noise

14. Stochastic Decap Formulation Minimize the maximum noise sum over all ports  Subject to the stochastic current variable upper/lower bound Subject to  Local decap area constraint due to placement constraint  Global decap area constraint due to leakage constraint Non-convex min/max optimization problem  Difficult to find global optimal solution

15. Outline Stochastic Modeling and Problem Formulation Algorithm Experimental Results Conclusions

16. Iterative Programming Algorithm Find the optimal decap budgeting for the giving max droop/bounce update the max droop/bounce update the decap budgeting Find the input corresponding to the max. droop/bounce for the given decap budgeting Cannot guarantee optimality, but can guarantee convergence and efficiency Experimental results show our algorithm can achieve good optimization results Each iteration we increase the white space allowed until all the white space has been used up or it converges

17. Illustration of Iterative Programming A0: Initial noise curve at one randomly selected port A1: The noise curve under the optimal decap budgeting for a giving droop/bounce A2: The noise curve with the input corresponding to the max. droop/bounce for the decap budgeting in A1 A3: The noise curve under the optimal decap budgeting for the giving max droop/bounce in A2 A0: Initial A1: (P3) A2: (P2) A3: (P3)

18. Sequential Programming We apply sequential linear programming (sLP) to solve each of the two sub-problems. For each sub-problem, we iteratively do the following two steps until the solution converges:  Compute the sensitivities of all the variables to the first order by moment matching.  Linearize the objective function with the sensitivities and the optimization problem becomes an LP first order sensitivities

19. Outline Stochastic Modeling and Problem Formulation Algorithm Experimental Results Conclusions

20. Impact of Current Correlations Model 1Maximum current at all ports Model 2Stochastic model with logic-induced correlation Model 3Model 2 + temporal correlation  Compared with the model assuming maximum currents at all ports, under the same decap area, Stochastic model with spatial correlation only reduce the noise by up to 3X Stochastic model with both spatial and temporal correlation reduce the noise by up to 9X Node #Noise (V*s)Runtime (s) Model 1Model 2Model 3Model 1Model 2Model 3 12846.33e-71.28e-74.10e-8104.2161.2282.3 104905.21e-51.09e-54.80e-6973.214302199 422807.92e-45.38e-49.13e-5273238235238 1663801.34e-25.37e-32.28e-3362557987821 avg11/2.68X1/9.10X11.50X2.26X

21. Impact of Leff Variation  Compared with the stochastic model without considering Leff variation, the stochastic model with it reduce the average noise by up to 4X and the 3-sigma noise by up to 13X Node #3429 3.06X V.R.sLPsLP + Leff mean (V*s) std (V*s) runtime (s) mean (V*s) std (V*s) runtime (s) 128410%9.28e-73.97e-7184.26.14e-71.38e-7332.8 1.81X 20%9.43e-74.55e-76.38e-71.86e-7 1049010%1.03e-44.79e-511217.22e-51.23e-53429 3.06X 20%1.22e-44.38e-57.94e-52.06e-5 4228010%2.29e-39.72e-422368.23e-41.01e-46924 3.10X 20%4.43e-31.01e-38.28e-41.92e-4 16638010%2.06e-29.91e-338245.31e-38.92e-411224 2.93X 20%2.31e-21.03e-25.92e-39.33e-4 avg10%1111/2.02X1/5.05X2.73X 20%111/1.95X1/4.05X

22. Conclusions In this paper, we develop a novel stochastic model for current loads, taking into account operation variation such as temporal and logic- induced correlations and process variations such as systematic and random Leff variation. We propose a formal method to extract operation variation and formulate a new decap budgeting problem using the stochastic current model. We develop an effective yet efficient iterative alternative programming algorithm and conduct experiments using industrial designs. Experimental results show that the noise can be reduced by up to 9X. We also apply similar idea to temperature-aware clock routing [Hao:ispd’07] and microprocessor floorplanning (Section 8C.2).

23. Thank you!