Statistical Sampling-Based Parametric Analysis of Power Grids Dr. Peng Li Presented by Xueqian Zhao EE5970 Seminar.

Slides:



Advertisements
Similar presentations
Bayesian Belief Propagation
Advertisements

Non-Gaussian Statistical Timing Analysis Using Second Order Polynomial Fitting Lerong Cheng 1, Jinjun Xiong 2, and Lei He 1 1 EE Department, UCLA *2 IBM.
Active Learning for Streaming Networked Data Zhilin Yang, Jie Tang, Yutao Zhang Computer Science Department, Tsinghua University.
Slide 1 Bayesian Model Fusion: Large-Scale Performance Modeling of Analog and Mixed- Signal Circuits by Reusing Early-Stage Data Fa Wang*, Wangyang Zhang*,
Siddharth Choudhary.  Refines a visual reconstruction to produce jointly optimal 3D structure and viewing parameters  ‘bundle’ refers to the bundle.
Yue Han and Lei Yu Binghamton University.
Exploiting Sparse Markov and Covariance Structure in Multiresolution Models Presenter: Zhe Chen ECE / CMR Tennessee Technological University October 22,
Stochastic Analog Circuit Behavior Modeling by Point Estimation Method
0 1 Width-dependent Statistical Leakage Modeling for Random Dopant Induced Threshold Voltage Shift Jie Gu, Sachin Sapatnekar, Chris Kim Department of Electrical.
Iowa State University Department of Computer Science Artificial Intelligence Research Laboratory Research supported in part by grants from the National.
Yuanlin Lu Intel Corporation, Folsom, CA Vishwani D. Agrawal
Volkan Cevher, Marco F. Duarte, and Richard G. Baraniuk European Signal Processing Conference 2008.
Multiobjective VLSI Cell Placement Using Distributed Simulated Evolution Algorithm Sadiq M. Sait, Mustafa I. Ali, Ali Zaidi.
Understanding the Accuracy of Assembly Variation Analysis Methods ADCATS 2000 Robert Cvetko June 2000.
Non-Linear Statistical Static Timing Analysis for Non-Gaussian Variation Sources Lerong Cheng 1, Jinjun Xiong 2, and Prof. Lei He 1 1 EE Department, UCLA.
Predictive Automatic Relevance Determination by Expectation Propagation Yuan (Alan) Qi Thomas P. Minka Rosalind W. Picard Zoubin Ghahramani.
Statistical Crosstalk Aggressor Alignment Aware Interconnect Delay Calculation Supported by NSF & MARCO GSRC Andrew B. Kahng, Bao Liu, Xu Xu UC San Diego.
Supply Voltage Degradation Aware Analytical Placement Andrew B. Kahng, Bao Liu and Qinke Wang UCSD CSE Department {abk, bliu,
Particle Filters for Mobile Robot Localization 11/24/2006 Aliakbar Gorji Roborics Instructor: Dr. Shiri Amirkabir University of Technology.
Statistical Gate Delay Calculation with Crosstalk Alignment Consideration Andrew B. Kahng, Bao Liu, Xu Xu UC San Diego
Value of Information for Complex Economic Models Jeremy Oakley Department of Probability and Statistics, University of Sheffield. Paper available from.
A Resource-level Parallel Approach for Global-routing-based Routing Congestion Estimation and a Method to Quantify Estimation Accuracy Wen-Hao Liu, Zhen-Yu.
Statistical Treatment of Data Significant Figures : number of digits know with certainty + the first in doubt. Rounding off: use the same number of significant.
1 Adjoint Method in Network Analysis Dr. Janusz A. Starzyk.
5 Top PED/Robustness Roadmapping Needs 1.Power and energy reduction achievable with less intrusive and more evolutionary techniques  Ex: dual-Vdd incurs.
Monte Carlo Methods in Partial Differential Equations.
More Realistic Power Grid Verification Based on Hierarchical Current and Power constraints 2 Chung-Kuan Cheng, 2 Peng Du, 2 Andrew B. Kahng, 1 Grantham.
1 Assessment of Imprecise Reliability Using Efficient Probabilistic Reanalysis Farizal Efstratios Nikolaidis SAE 2007 World Congress.
Colorado Center for Astrodynamics Research The University of Colorado STATISTICAL ORBIT DETERMINATION Project Report Unscented kalman Filter Information.
Computational Stochastic Optimization: Bridging communities October 25, 2012 Warren Powell CASTLE Laboratory Princeton University
Material Model Parameter Identification via Markov Chain Monte Carlo Christian Knipprath 1 Alexandros A. Skordos – ACCIS,
Particle Filtering in Network Tomography
1 Hybrid methods for solving large-scale parameter estimation problems Carlos A. Quintero 1 Miguel Argáez 1 Hector Klie 2 Leticia Velázquez 1 Mary Wheeler.
WSEAS AIKED, Cambridge, Feature Importance in Bayesian Assessment of Newborn Brain Maturity from EEG Livia Jakaite, Vitaly Schetinin and Carsten.
Probabilistic Mechanism Analysis. Outline Uncertainty in mechanisms Why consider uncertainty Basics of uncertainty Probabilistic mechanism analysis Examples.
Segmental Hidden Markov Models with Random Effects for Waveform Modeling Author: Seyoung Kim & Padhraic Smyth Presentor: Lu Ren.
Fast Thermal Analysis on GPU for 3D-ICs with Integrated Microchannel Cooling Zhuo Fen and Peng Li Department of Electrical and Computer Engineering, {Michigan.
Exam I review Understanding the meaning of the terminology we use. Quick calculations that indicate understanding of the basis of methods. Many of the.
PiCAP: A Parallel and Incremental Capacitance Extraction Considering Stochastic Process Variation Fang Gong 1, Hao Yu 2, and Lei He 1 1 Electrical Engineering.
Stochastic Linear Programming by Series of Monte-Carlo Estimators Leonidas SAKALAUSKAS Institute of Mathematics&Informatics Vilnius, Lithuania
1 ECE-517 Reinforcement Learning in Artificial Intelligence Lecture 7: Finite Horizon MDPs, Dynamic Programming Dr. Itamar Arel College of Engineering.
A Power Grid Analysis and Verification Tool Based on a Statistical Prediction Engine M.K. Tsiampas, D. Bountas, P. Merakos, N.E. Evmorfopoulos, S. Bantas.
Scalable Symbolic Model Order Reduction Yiyu Shi*, Lei He* and C. J. Richard Shi + *Electrical Engineering Department, UCLA + Electrical Engineering Department,
Tarek A. El-Moselhy and Luca Daniel
Virtual Vector Machine for Bayesian Online Classification Yuan (Alan) Qi CS & Statistics Purdue June, 2009 Joint work with T.P. Minka and R. Xiang.
On the Use of Sparse Direct Solver in a Projection Method for Generalized Eigenvalue Problems Using Numerical Integration Takamitsu Watanabe and Yusaku.
Stochastic Current Prediction Enabled Frequency Actuator for Runtime Resonance Noise Reduction Yiyu Shi*, Jinjun Xiong +, Howard Chen + and Lei He* *Electrical.
Parallel Solution of the Poisson Problem Using MPI
On the Assumption of Normality in Statistical Static Timing Analysis Halim Damerdji, Ali Dasdan, Santanu Kolay February 28, 2005 PrimeTime Synopsys, Inc.
QuickYield: An Efficient Global-Search Based Parametric Yield Estimation with Performance Constraints Fang Gong 1, Hao Yu 2, Yiyu Shi 1, Daesoo Kim 1,
Power Integrity Test and Verification CK Cheng UC San Diego 1.
Bayesian networks and their application in circuit reliability estimation Erin Taylor.
Markov Chain Monte Carlo for LDA C. Andrieu, N. D. Freitas, and A. Doucet, An Introduction to MCMC for Machine Learning, R. M. Neal, Probabilistic.
Outline Introduction Research Project Findings / Results
GeneMANIA: a real-time multiple association network integration algorithm for predicting gene function Sara Mostafavi, Debajyoti Ray, David Warde-Farley,
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
Monte Carlo Linear Algebra Techniques and Their Parallelization Ashok Srinivasan Computer Science Florida State University
Chance Constrained Robust Energy Efficiency in Cognitive Radio Networks with Channel Uncertainty Yongjun Xu and Xiaohui Zhao College of Communication Engineering,
Density Estimation in R Ha Le and Nikolaos Sarafianos COSC 7362 – Advanced Machine Learning Professor: Dr. Christoph F. Eick 1.
Proximity Optimization for Adaptive Circuit Design Ang Lu, Hao He, and Jiang Hu.
Ch 1. Introduction Pattern Recognition and Machine Learning, C. M. Bishop, Updated by J.-H. Eom (2 nd round revision) Summarized by K.-I.
Unified Adaptivity Optimization of Clock and Logic Signals Shiyan Hu and Jiang Hu Dept of Electrical and Computer Engineering Texas A&M University.
Monte Carlo Linear Algebra Techniques and Their Parallelization Ashok Srinivasan Computer Science Florida State University
Markov Chain Monte Carlo in R
Defining Statistical Sensitivity for Timing Optimization of Logic Circuits with Large-Scale Process and Environmental Variations Xin Li, Jiayong Le, Mustafa.
Filtering and State Estimation: Basic Concepts
Yiyu Shi*, Jinjun Xiong+, Howard Chen+ and Lei He*
Yiyu Shi*, Wei Yao*, Jinjun Xiong+ and Lei He*
Markov Networks.
August 8, 2006 Danny Budik, Itamar Elhanany Machine Intelligence Lab
Presentation transcript:

Statistical Sampling-Based Parametric Analysis of Power Grids Dr. Peng Li Presented by Xueqian Zhao EE5970 Seminar

Outline — Motivation — Prior works — Importance sampling technique — Sampling-based localized sensitivity analysis — Sampling-based 2 nd order parametric analysis — Conclusion

Motivation Power/Ground integrity becomes a serious challenge for modern chip design IR drops reduce noise margin and increase circuit delay —10% supply voltage fluctuations may translate in more than 10% timing variation Technology scaling worsens the P/G integrity —Reduction of power supply voltage

Analysis Challenge Modern P/G networks routinely reach multi-million node complexity —Full grid analysis becomes very expensive Need to consider significant variation in power consumption —Active power is mode dependent —Process and temperature variability impact significantly the leakage power Power grids are also subject to parametric variations due to fabrication fluctuations Multiplicity of variations in power grids make the analysis even more difficult

Prior Works P/G can be modeled as a linear system: Direct methods: —LU, Cholesky decomposition Iterative methods: —Conjugate gradient (CG), preconditioned CG —Multigrid method Since G is a sparse matrix, the complexity of above methods is around O(n 2 )

Random Walks Convert an electrical network to a random walk Circuit response estimated locally via mean estimation —Average over a set of statistical samples Locality exploited naturally without solving the complete network

Random Walks (cont.) Transition probabilities between states are obtained from the electrical network The random walk can be described as Markov chain The complexity can be reduced to O(n), compared to prior works.

Locally solve for selected circuit nodes Compute the nominal node voltage (IR drop) for each node —Achievable through random walks Sensitivities with respect to multiple process/loading variations?? High order parametric dependencies?? Localized Analysis

Adjoint Sensitivity Analysis Classical adjoint sensitivity analysis Requires two complete linear solutions —Obscure the possibility of locality Localized sensitivity analysis??

Intuition Original circuit differs from the perturbed circuit in circuit element values Want to solve both circuits simultaneously by only sampling in the original circuit Need to scale each sample to correct the sampling bias: D’ k  (P’ k /P k )D’ k P k1 P k2 P k3 node n i V dd … Original Circuit (A) P’ k1 P’ k2 P’ k3 node n i V dd … Perturbed Circuit (B) Value: D k Prob: P k = P k1 P k2 Value: D’ k Prob: P’ k = P’ k1 P’ k2 …

Importance Sampling View random walks algorithms as a Monte Carlo method Circuit response is estimated via mean estimation Importance sampling allows us to estimate the mean of a statistical distribution while sampling according to another distribution Ratio estimate

Localized Sensitivity Analysis Design / process parameters Perform sampling only in the nominal circuit Estimate the response in any parametric circuit Need to propagate the first order sensitivities while sampling in the nominal circuit

Localized Sensitivity Analysis Propagate circuit element parametric sensitivities Perform a few scalar arithmetic operations —Additions, subtractions, multiplications and divisions

Localized Parametric Analysis Flow Pick a new move according to the nominal ckt Compute the prob. of this move and update the path prob. P path for the param. ckt Accumulate the cost incurred by the move Weight the gain of the complete walk by W path = P path /P path (nom) … + Mean estimate: Sum up and normalize Pick a new move according to the nominal ckt Compute the prob. of this move and update the path prob. P path for the param. ckt Accumulate the cost incurred by the move Weight the gain of the complete walk by W path = P path /P path (nom) …

Second Order Analysis 2 nd order analysis gives more accurate results for larger perturbations Straightforward implementation is prohibitively expensive —276 coefficients needed for 22 variables ! Can exploit the inherent spatial locality in the algorithm formulation Adopt two 2 nd order parametric forms: —Voltage response estimate /cost incurred due to current sources —State-transition/path probabilities

Exploring Spatial Locality Naïve 2nd order analysis not feasible for a large number of inter-/intra die variations Model variations sources using a hierarchical model —Global, semi-global and local variations Local data types impacted only by a small set of variations —Represented in a SPARSE 2nd order form Global Local Semi-Global

Exploring Spatial Locality Data interactions —Local + local: efficiently computable —Global + global: only happen at end of each random walk —Global + local: many counts / dominant cost! Exploring sparsity Dominant cost: O(N G N L ), N L << N G Node of Interest

Importance Sampling Estimators Importance sampling Integration estimator Ratio estimator

Importance Sampling Estimators Regression estimator

Results Comparison of estimators —40k-node grid —Solve the nominal ckt and the perturbed circuit simultaneously IR drop estimation in the perturbed circuit

Results Localized sensitivity analysis —Simultaneously solve for sensitivities —Compared with direct sensitivity

Results A 250K node grid Resistance variation  Average: 12.3%  Max: 55% 22 variation sources  1 st order analysis: 23 coefficients  2 nd order analysis: 276 coefficients Runtime  1 st order: 3.1s  2 nd order: 22s 1000 samples: 1 st order errors 1000 samples: 2 nd order errors

Results A 1.1 million node grid Resistance variation  Average: 13%  Max: 55% Loading variation  Average: 19%  Max: 164% 22 variation sources  1 st order analysis: 23 coefficients  2 nd order analysis: 276 coefficients Runtime  1 st order: 4s  2 nd order: 28s 1000 samples: 1 st order errors1000 samples: 2 nd order errors

Results Runtime as a function of number of variations —Near-linear complexity achieved by exploring spatial locality 2 nd order analysis runtime

Conclusion Power/ground network verification is becoming increasingly difficult due to large problem complexity The analysis complexity exacerbates as we address process variations and current loading uncertainties Efficient parametric analysis is proposed to analyze large power grids locally —Adopt importance sampling in Monte Carlo method —Lends itself naturally to a localized version of the classical sensitivity analysis 2 nd order analysis improves the accuracy for larger loading and process variations —Explore the spatial locality of the algorithm formulation to achieve near-linear complexity