Probabilistic Modeling, Multiscale and Validation Roger Ghanem University of Southern California Los Angeles, California.

Slides:



Advertisements
Similar presentations
Copula Representation of Joint Risk Driver Distribution
Advertisements

Pattern Recognition and Machine Learning
Bayesian Belief Propagation
Structural reliability analysis with probability- boxes Hao Zhang School of Civil Engineering, University of Sydney, NSW 2006, Australia Michael Beer Institute.
Uncertainty Quantification & the PSUADE Software
Bayesian inference of normal distribution
Kriging.
Point-wise Discretization Errors in Boundary Element Method for Elasticity Problem Bart F. Zalewski Case Western Reserve University Robert L. Mullen Case.
Bayesian Estimation in MARK
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
Sensitivity Analysis In deterministic analysis, single fixed values (typically, mean values) of representative samples or strength parameters or slope.
TNO orbit computation: analysing the observed population Jenni Virtanen Observatory, University of Helsinki Workshop on Transneptunian objects - Dynamical.
An Efficient Method for Chip-Level Statistical Capacitance Extraction Considering Process Variations with Spatial Correlation W. Zhang, W. Yu, Z. Wang,
Chapter 4: Linear Models for Classification
Lecture 8 The Principle of Maximum Likelihood. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture.
Tolerance Analysis of Flexible Assemblies Michael Tonks.
CHAPTER 6 Statistical Analysis of Experimental Data
Using ranking and DCE data to value health states on the QALY scale using conventional and Bayesian methods Theresa Cain.
بيانات الباحث الإ سم : عبدالله حسين زكي الدرجات العلمية : 1- بكالوريوس هندسة الطيران – جامعة القاهرة - بتقدير جيد جداً مع مرتبة الشرف 2- ماجستير في الرياضيات.
Nonlinear Stochastic Programming by the Monte-Carlo method Lecture 4 Leonidas Sakalauskas Institute of Mathematics and Informatics Vilnius, Lithuania EURO.
Monte Carlo Methods in Partial Differential Equations.
Lecture II-2: Probability Review
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
Interval-based Inverse Problems with Uncertainties Francesco Fedele 1,2 and Rafi L. Muhanna 1 1 School of Civil and Environmental Engineering 2 School.
Statistical Methods For Engineers ChE 477 (UO Lab) Larry Baxter & Stan Harding Brigham Young University.
1 Hybrid methods for solving large-scale parameter estimation problems Carlos A. Quintero 1 Miguel Argáez 1 Hector Klie 2 Leticia Velázquez 1 Mary Wheeler.
Optimal Multilevel System Design under Uncertainty NSF Workshop on Reliable Engineering Computing Savannah, Georgia, 16 September 2004 M. Kokkolaras and.
Kalman filtering techniques for parameter estimation Jared Barber Department of Mathematics, University of Pittsburgh Work with Ivan Yotov and Mark Tronzo.
Polynomial Chaos For Dynamical Systems Anatoly Zlotnik, Case Western Reserve University Mohamed Jardak, Florida State University.
FDA- A scalable evolutionary algorithm for the optimization of ADFs By Hossein Momeni.
1 Institute of Engineering Mechanics Leopold-Franzens University Innsbruck, Austria, EU H.J. Pradlwarter and G.I. Schuëller Confidence.
Equation-Free (EF) Uncertainty Quantification (UQ): Techniques and Applications Ioannis Kevrekidis and Yu Zou Princeton University September 2005.
CSDA Conference, Limassol, 2005 University of Medicine and Pharmacy “Gr. T. Popa” Iasi Department of Mathematics and Informatics Gabriel Dimitriu University.
Maximum Likelihood Estimator of Proportion Let {s 1,s 2,…,s n } be a set of independent outcomes from a Bernoulli experiment with unknown probability.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
Non-Intrusive Stochastic Uncertainty Quantification Methods Don Zhang University of Southern California Uncertainty Quantification Workshop.
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 3: LINEAR MODELS FOR REGRESSION.
Tarek A. El-Moselhy and Luca Daniel
An Adaptive-Stochastic Boussinesq Solver With Safety Critical Applications In Nuclear Reactor Engineering Andrew Hagues PhD Student – KNOO Work Package.
Lecture 4: Statistics Review II Date: 9/5/02  Hypothesis tests: power  Estimation: likelihood, moment estimation, least square  Statistical properties.
Example: Bioassay experiment Problem statement –Observations: At each level of dose, 5 animals are tested, and number of death are observed.
Copyright 2011 by Coleman & Steele. Absolutely no reproduction of any portion without explicit written permission. 1 UNCERTAINTY ANALYSIS: A BASIC OVERVIEW.
Information Geometry and Model Reduction Sorin Mitran 1 1 Department of Mathematics, University of North Carolina, Chapel Hill, NC, USA Reconstruction.
Lab for Remote Sensing Hydrology and Spatial Modeling Dept of Bioenvironmental Systems Engineering National Taiwan University 1/45 GEOSTATISTICS INTRODUCTION.
NESSUS Overview and General Capabilities
Chapter 20 Statistical Considerations Lecture Slides The McGraw-Hill Companies © 2012.
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
Stats Term Test 4 Solutions. c) d) An alternative solution is to use the probability mass function and.
A Random Subgrouping Scheme for Ensemble Kalman Filters Yun Liu Dept. of Atmospheric and Oceanic Science, University of Maryland Atmospheric and oceanic.
Uncertainty and Reliability Analysis D Nagesh Kumar, IISc Water Resources Planning and Management: M6L2 Stochastic Optimization.
How do we classify uncertainties? What are their sources? – Lack of knowledge vs. variability. What type of measures do we take to reduce uncertainty?
Application of Dynamic Programming to Optimal Learning Problems Peter Frazier Warren Powell Savas Dayanik Department of Operations Research and Financial.
Workshop on the Elements of Predictability LOGISTICS BACKGROUND AND INTRODUCTION Roger Ghanem John Red-Horse Steve Wojtkiewicz Thanks to: Department of.
Bayesian Brain Probabilistic Approaches to Neural Coding 1.1 A Probability Primer Bayesian Brain Probabilistic Approaches to Neural Coding 1.1 A Probability.
Fundamentals of Data Analysis Lecture 11 Methods of parametric estimation.
Multiple Random Variables and Joint Distributions
Department of Civil and Environmental Engineering
Morgan Bruns1, Chris Paredis1, and Scott Ferson2
Statistical Methods For Engineers
Unfolding Problem: A Machine Learning Approach
Igor V. Cadez, Padhraic Smyth, Geoff J. Mclachlan, Christine and E
Filtering and State Estimation: Basic Concepts
Graduate School of Information Sciences, Tohoku University
Lecture # 2 MATHEMATICAL STATISTICS
Sampling Distributions (§ )
Unfolding with system identification
Survey Networks Theory, Design and Testing
Probabilistic Surrogate Models
Uncertainty Propagation
Presentation transcript:

Probabilistic Modeling, Multiscale and Validation Roger Ghanem University of Southern California Los Angeles, California

Outline  Introduction and Objectives  Representation of Information  Model Validation  Efficiency Issues

Introduction Objectives: –Determine certifiable confidence in model-based predictions: Certifiable = amenable to analysis Accept the possibility that certain statements, given available resources, cannot be certified. –Compute actions to increase confidence in model predictions: change the information available to the prediction. More experimental/field data, more detailed physics, more resolution for numerics… Stochastic models package information in a manner suitable for analysis: –Adapt this packaging to the needs of our decision-maker Craft a mathematical model that is parameterized with respect to the relevant uncertainties.

Two meaningful questions Nothing new here. What is new is: sensor technology computing technology Can/must adapt our “packaging” of information and knowledge accordingly.

Theoretical basis: Cameron-Martin Theorem The polynomial chaos decomposition of any square-integrable functional of the Brownian motion converges in mean-square as N goes to infinity. For a finite-dimensional representation, the coefficients are functions of the missing dimensions: they are random variables (Slud,1972).

The random quantities are resolved as surfaces in a normalized space: These could be, for example: Parameters in a PDE Boundaries in a PDE (e.g. Geometry) Field Variable in a PDE Multidimensional Orthogonal Polynomials Independent random variables Dimension of vector reflects complexity of Representation of Uncertainty

Uncertainty due to small experimental database or anything else. Uncertainty in model parameters Dimension of vector reflects complexity of Representation of Uncertainty

 Galerkin Projections  Maximum Likelihood  Maximum Entropy  Bayes Theorem  Ensemble Kalman Filter Characterization of Uncertainty

Characterization of Uncertainty Maximum Entropy Estimation / Spatio-Temporal Processes Temperature is measured as function of time along cables. Temperature fluctuations affect sound speed in the ocean.

Temperature time histories,, at various depths. Characterization of Uncertainty Maximum Entropy Estimation / Spatio-Temporal Processes

Reduced order model of KL expansion A typical plot of marginal pdf for a Karhunen- Loeve variable. Characterization of Uncertainty Maximum Entropy Estimation with Histogram Constraints Spearman Rank Correlation Coefficient is also matched:

Uncertainty Propagation: Stochastic Projection

Example Application: W76 Foam study Built-up structure with shell, foam and devices. Foam domain. 1. Modeled as non-stationary random field. 2. Accounting for random and structured variations 3. Limited observations are assumed: selected 30 locations on the foam. Limited statistical observations: Correlation estimator from small sample size: interval bounds on correlation matrix. System has HEX elements. Stochastic block has 2832 elements.

Example Application: W76 Foam study  Polynomial Chaos representation of epistemic information  Constrained polynomial chaos construction  Radial Basis function consistent spatial interpolation  Cubature integration in high-dimensions

Foam study Statistics of maximum acceleration Histogram of average of maximum acceleration

Foam study Statistics of maximum acceleration Plots of density functions of the maximum acceleration

Effect of missing information

Estimate %95 probability box Remarks:  Confidence intervals are due to finite sample size. CDF of calibrated stochastic parameters (3 out of 9 shown)

Sample Mean ofSample Variance of Remark: Based on only 25 samples. Validation Challenge Problem Treated as a random variables: Criterion for certifying a design (we would like to assess it without full- scale experiments:

Solution with 3 rd order chaos Solution with 3 rd order chaos and enrichment Exact solution Efficiency Issues: Basis Enrichment

NANO-RESONATOR WITH RANDOM GEOMETRY

semiconductor conductor OBJETCIVE: 1.Determine requirements on manufacturing tolerance. 2.Determine relationship between manufacturing tolerance and performance reliability.

APPROACH  Define the problem on some underlying deterministic geometry.  Define a random mapping from the deterministic geometry to the random geometry.  Approximate this mapping using a polynomial chaos decomposition.  Solve the governing equations using coupled FEM-BEM.  Compare various implementations.

TREATMENT OF RANDOM GEOMETRY Ref: Tartakovska & Xiu, 2006.

GOVERNING EQUATIONS Interior Electrostatic BVP : Elastic BVP for Semiconductor: Exterior Electrostatic BVP :

A couple of realizations of solution (deformed shape and charge distribution)

More Significant Probabilistic Results PDF of Vertical Displacement at tip. PDF of Maximum Principal Stress at a point.

Typical Challenge

Comparison of Monte Carlo, Quadrature and Exact Evaluations of the Element Integrations

Only one deterministic solve required. Minimal change to existing codes. Need iterative solutions with multiple right hand sides. Integrated into ABAQUS (not commercially). Using Components of Existing Analysis Software

Implementation: Sundance

Non-intrusive implementation

Implementation: Dakota

Example Application (non-intrusive)

joints

Example Application

Conclusions  Personal Experience: Every time I have come close to concluding on PCE, new horizons have unfolded in  Applications  Models  Algorithms  Software