Part 5 Parameter Identification (Model Calibration/Updating)

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

The Maximum Likelihood Method
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Fast Algorithms For Hierarchical Range Histogram Constructions
Kriging.
CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
1 12. Principles of Parameter Estimation The purpose of this lecture is to illustrate the usefulness of the various concepts introduced and studied in.
Model calibration using. Pag. 5/3/20152 PEST program.
Sensitivity Analysis In deterministic analysis, single fixed values (typically, mean values) of representative samples or strength parameters or slope.
Fundamentals of Data Analysis Lecture 12 Methods of parametric estimation.
Experimental Design, Response Surface Analysis, and Optimization
Cost of surrogates In linear regression, the process of fitting involves solving a set of linear equations once. For moving least squares, we need to.
Regression Analysis Once a linear relationship is defined, the independent variable can be used to forecast the dependent variable. Y ^ = bo + bX bo is.
Calibration Methods Introduction
Simple Linear Regression and Correlation
Propagation of Error Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
Tutorial 2, Part 1: Optimization of a damped oscillator.
Visual Recognition Tutorial
280 SYSTEM IDENTIFICATION The System Identification Problem is to estimate a model of a system based on input-output data. Basic Configuration continuous.
Maximum likelihood (ML)
Lecture 8 The Principle of Maximum Likelihood. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture.
Visual Recognition Tutorial
Connecting Microsoft Excel as a solver to optiSLang Tutorial: Using MS Excel as a solver to fit true stress / true strain curves of metallic materials.
Maximum likelihood (ML)
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
1 Assessment of Imprecise Reliability Using Efficient Probabilistic Reanalysis Farizal Efstratios Nikolaidis SAE 2007 World Congress.
On the Accuracy of Modal Parameters Identified from Exponentially Windowed, Noise Contaminated Impulse Responses for a System with a Large Range of Decay.
Sensitivity Analysis, Multidisciplinary Optimization, Robustness Evaluation, and Robust Design Optimization with optiSLang 3.2.
Introduction to Linear Regression and Correlation Analysis
Simple Linear Regression Models
BsysE595 Lecture Basic modeling approaches for engineering systems – Summary and Review Shulin Chen January 10, 2013.
EM and expected complete log-likelihood Mixture of Experts
Example II: Linear truss structure
Prof. Dr. S. K. Bhattacharjee Department of Statistics University of Rajshahi.
IPE 2003 Tuscaloosa, Alabama1 An Inverse BEM/GA Approach to Determining Heat Transfer Coefficient Distributions Within Film Cooling Holes/Slots Mahmood.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
WB1440 Engineering Optimization – Concepts and Applications Engineering Optimization Concepts and Applications Fred van Keulen Matthijs Langelaar CLA H21.1.
Lab 3b: Distribution of the mean
Progress in identification of damping: Energy-based method with incomplete and noisy data Marco Prandina University of Liverpool.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Lecture 4: Statistics Review II Date: 9/5/02  Hypothesis tests: power  Estimation: likelihood, moment estimation, least square  Statistical properties.
Propagation of Error Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
PROCESS MODELLING AND MODEL ANALYSIS © CAPE Centre, The University of Queensland Hungarian Academy of Sciences Statistical Model Calibration and Validation.
Statistics Presentation Ch En 475 Unit Operations.
LECTURE 3: ANALYSIS OF EXPERIMENTAL DATA
Tutorial 3, Part 1: Optimization of a linear truss structure
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
Analysis of Experimental Data; Introduction
Machine Learning 5. Parametric Methods.
ES 07 These slides can be found at optimized for Windows)
Chapter 2-OPTIMIZATION G.Anuradha. Contents Derivative-based Optimization –Descent Methods –The Method of Steepest Descent –Classical Newton’s Method.
BME 353 – BIOMEDICAL MEASUREMENTS AND INSTRUMENTATION MEASUREMENT PRINCIPLES.
Statistics Presentation Ch En 475 Unit Operations.
L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 12 1 MER301: Engineering Reliability LECTURE 12: Chapter 6: Linear Regression Analysis.
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and  2 Now, we need procedures to calculate  and  2, themselves.
Tutorial 2, Part 2: Calibration of a damped oscillator.
Mode Superposition Module 7. Training Manual January 30, 2001 Inventory # Module 7 Mode Superposition A. Define mode superposition. B. Learn.
R. Kass/W03 P416 Lecture 5 l Suppose we are trying to measure the true value of some quantity (x T ). u We make repeated measurements of this quantity.
Learning Theory Reza Shadmehr Distribution of the ML estimates of model parameters Signal dependent noise models.
Computational Intelligence: Methods and Applications Lecture 26 Density estimation, Expectation Maximization. Włodzisław Duch Dept. of Informatics, UMK.
Computacion Inteligente Least-Square Methods for System Identification.
The University of SydneySlide 1 Simulation Driven Biomedical Optimisation Andrian Sue AMME4981/9981 Week 5 Semester 1, 2016 Lecture 5.
Fundamentals of Data Analysis Lecture 11 Methods of parametric estimation.
Regression Analysis AGEC 784.
ESTIMATION.
The Maximum Likelihood Method
Data Mining Lecture 11.
Probabilistic Models for Linear Regression
Introduction to Instrumentation Engineering
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and 2 Now, we need procedures to calculate  and 2 , themselves.
Presentation transcript:

Part 5 Parameter Identification (Model Calibration/Updating)

2 Part 5: Parameter Identifikation 1) Define the Design space using continuous or discrete optimization variables Calibration using optiSLang 3) Find the best possible fit - choose an optimizer depending on the sensitive optimization parameter dimension/type Test Best Fit Simulation optiSLang 2) Scan the Design Space -Check the variation -Identify sensible parameters and responses -Check parameter bounds -extract start value

3 Part 5: Parameter Identifikation Validation of numerical models with test results (7 test configurations) Modelling with Madymo Sensitivity study to identify sensitive parameters and responses and to verify the design space Definition of the objective function Model Updating using optiSLang Δa max pressure integral acceleration integral acceleration peak = α+ β+ γ Zeit Validation of Airbag Modeling via Identification

4 Part 5: Parameter Identifikation Model Updating using optiSLang Test Best Fit Simulation optiSLang Validation of Airbag Modeling via Identification optiSLang’s genetic algorithm for global search 15 generation *10 individuals *7 test configuration (Total:11 h CPU)

5 Part 5: Parameter Identifikation System Identification Sankt Michael church Jena Fitting of Experiments to Numerical Models Mechanical properties of historical masonry are unknown Identification of system parameters via model updating for dynamic measurements (system identification) Ringing the bell is the critical load case

6 Part 5: Parameter Identifikation 6 3. Run Sensitivity study to identify sensitive parameters and responses and verify the design space 4. Definition of the objective function for Identification & optimize 1. Set up of an parametric simulation process, FE model of tensile test in LSDYNA to identify Gurson Damage Material Parameter 2. Integrate the process in optiSLang Stress-Strain curve obj_func = |FAIL_STRAIN – TARGET_STRAIN|  0 Target failure strain Failure strain from simulation Application Identification of failure strain

7 Part 5: Parameter Identifikation 7 Identification of one experiment Best Fit Simulation Identify one set of Gurson material values (FC,FF,EN) for mean experimental value 7 Parameter using ARSM algorithm for global search 1 start design from sensitivity (best design) 4 min/design (Total:8 h 1 CPU) 10 mm 4 mm 2 mm 3 calculations per design

8 Part 5: Parameter Identifikation 8 Best Fit Simulation Identify Gurson material (FC,FF,EN) values for mean, min, max representing the scatter range of experiments 12 Parameter using ARSM algorithm for global search is used 1 start design from sensitivity (best design) 4 min/design (Approx. total:23 h 1 CPU) 10 mm 4 mm 2 mm 3 *3 calculations per design FF0, FC, Lo curve Identify min, mean and max experimental value

9 Part 5: Parameter Identifikation Calibration of seismic fracturing Sensitivity evaluation of 200 rock parameter and the hydraulic fracture design Parameter due to seismic hydraulic fracture measurements Blue:Stimulated rock volume Red: seismic frac measurement With the knowledge about the most important parameter the update was significantly improved. Non-linear coupled fluid- mechanical analysis Solver: ANSYS/multiPlas Design evaluations: 160

10 Part 5: Parameter Identifikation Least Squares Minimization The likelihood of the parameters is proportional to the conditional probability of measurements y* from a given parameter set p Assuming normally distributed measurement errors Maximizing the likelihood (minimizing the log-likelihood) leads to the optimal parameter set If the errors are independent with constant standard deviation we obtain the well-known least squares formulation

11 Part 5: Parameter Identifikation Example: Calibration of a damped oscillator Mass m, damping c, stiffness k and initial kinetic energy Equation of motion: Undamped eigen-frequency: Lehr's damping ratio D Damped eigen-frequency

12 Part 5: Parameter Identifikation Example: Calibration of a damped oscillator Time-dependent displacement function Identification of the input parameters m, k, D and Ekin to optimally fit a reference displacement function Objective function is the sum of squared errors between the reference and the calculated displacement function values

13 Part 5: Parameter Identifikation Parameterization of signals Repeated block marker Vector objects with variable length

14 Part 5: Parameter Identifikation Definition of signal objects and functions Signal object consists of abscissa vector and several channels Signal functions to extract value from a single signal or to compare channels or different signals Definition of constant reference signals for model calibration

15 Part 5: Parameter Identifikation Definition of signal functions 1.Min/Max functions SIG_MIN_Y Extract the minimum ordinate of the channel SIG_MIN_X Extract the abscissa of the minimum ordinate of the channel SIG_MAX_Y Extract the maximum ordinate of the channel SIG_MAX_X Extract the abscissa of the maximum ordinate of the channel 2.Global functions SIG_Y_RANGE Extract the range of ordinate values of the channel SIG_MEAN Extract the mean of the channel SIG_STDDEV Extract the standard deviation of the channel SIG_RMS Extract the root mean square of the channel SIG_SUM Extract the sum of values of the channel SIG_EUCLID Extract the Euclidean norm of the channel SIG_NORM Extract the norm of specified order of the channel

16 Part 5: Parameter Identifikation Definition of signal functions 3.Difference between two channels SIG_DIFF_EUCLID Extract the Euclidean norm of the difference between two channels SIG_DIFF_NORM Extract the norm of specified order of the difference between two channels 4.Functions in slots SIG_***_SLOT Extract the function parameter (functions in 1.-3.) within the specified abscissa bounds 5.Global functions in steps SIG_MEAN_STEPS Extract the mean values within a specified number of equally spaced intervals SIG_STDDEV_STEPS Extract the standard deviation within a number of equally spaced intervals SIG_RMS_STEPS Extract the root mean square values within a number of equally spaced intervals

17 Part 5: Parameter Identifikation Example: Sensitivity analysis using MOP CoP of sum of squared errors is very low (45% CoP) and only m and k are found to be significant CoP of maximum values in time slot are much better (95% - 99% CoD) and all inputs are indicated to be significant 100 samples

18 Part 5: Parameter Identifikation Example: Sensitivity analysis using MOP CoP of sum of squared errors increases if number of samples is increased (from 45% to 84%) and one additional parameter becomes significant  Sensitivity study of objective function itself may require many samples due to a certain complexity  Analysis of single values may be more efficient 100 samples500 samples2000 samples

19 Part 5: Parameter Identifikation Example: Sensitivity analysis using MOP All inputs are significant for at least some of the output values  Identification of all input parameters is generally possible 100 samples500 samples FullmkDEkinFullmkDEkin RMSE45%19%44%--72%27%53%-21% Max099%-42%-57%99%-46%-56% Max297%7%41%9%47%99%10%45%8%43% Max497%15%42%18%29%98%15%44%16%30% Max698%23%36%23% 99%20%41%22%24% Max895%23%28%35%16%96%19%36%26%20%

20 Part 5: Parameter Identifikation Example: EA with global search Global optimization converges to small difference between output and reference

21 Part 5: Parameter Identifikation Signal post-processing optiSLang provides signal plots of each design in DOE or optimization flow with best design and specified reference signal

22 Part 5: Parameter Identifikation Example: Dependent parameters Different optimization runs lead to different parameter sets with similar differences Run 1: RMSE=0.183Run 2: RMSE=0.434

23 Part 5: Parameter Identifikation Example: Dependent parameters Reason for non-unique solution: The parameters E kin and m as well as k and m appear only pair-wisely in the displacement function  Only the ratio between E kin and m as well as k and m can be identified  We keep the value of m as constant General procedure: Check designs from DOE with almost equal objective values Or perform multiple global optimization runs Sensitivity indices quantify the global influence of each input, But: the dependency between input parameters with respect to the minimum objective values can not be identified

24 Part 5: Parameter Identifikation Example: EA with reduced parameter set Different optimization runs lead to similar parameter sets with similar differences  No parameter dependencies Run 1: RMSE=1.587Run 2: RMSE=0.287Run 3: RMSE=0.769

25 Part 5: Parameter Identifikation Example: Gradient-based optimization Local gradient-based optimization gives exact reference values for inputs Fitting is perfect (almost zero rmse)

26 Part 5: Parameter Identifikation Example: Identification with noisy reference Measurements are more or less precise Reference displacement function is disturbed by Gaussian noise with zero mean and standard deviation of 0.1 m Again global + local optimization with reduced input parameter set k, D and E kin

27 Part 5: Parameter Identifikation Example: Identification with noisy reference Evolutionary Algorithm (global search)

28 Part 5: Parameter Identifikation Example: Identification with noisy reference Gradient based (local search) Measurements errors may reduce the identification quality The accuracy of the identified parameters depends on the number of measurements and the sensitivity of the parameters

29 Part 5: Parameter Identifikation Estimation of model representation quality Assuming, that the model can reproduce the reality, the measurement error can be defined as the deviation of the fitted model from the reference solution Estimated error variance by assuming independent measurement errors with constant variance (p is the number of identified parameters, n the number of measurement points and y i * are the measurement values) The quality of the model representation may be estimated by the explained variance

30 Part 5: Parameter Identifikation Oscillator with exact measurements: Oscillator with noisy measurements: But: this measure can not distinguish between errors in the fit caused by inexact measurements or by inadequate models Estimation of model representation quality