Model calibration using. Pag. 5/3/20152 PEST program.

Slides:

Advertisements

Similar presentations

11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.

Advertisements

Computational Statistics. Basic ideas  Predict values that are hard to measure irl, by using co-variables (other properties from the same measurement.

Chap 12-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 12 Simple Regression Statistics for Business and Economics 6.

FTP Biostatistics II Model parameter estimations: Confronting models with measurements.

Experimental Design, Response Surface Analysis, and Optimization

6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.

Regression Analysis Module 3. Regression Regression is the attempt to explain the variation in a dependent variable using the variation in independent.

Regression Analysis Once a linear relationship is defined, the independent variable can be used to forecast the dependent variable. Y ^ = bo + bX bo is.

1 Simple Linear Regression and Correlation The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES Assessing the model –T-tests –R-square.

Ch11 Curve Fitting Dr. Deshi Ye

Regression Analysis Using Excel. Econometrics Econometrics is simply the statistical analysis of economic phenomena Here, we just summarize some of the.

Classification and Prediction: Regression Via Gradient Descent Optimization Bamshad Mobasher DePaul University.

Chapter 13 Multiple Regression

Chapter 10 Simple Regression.

Chapter 12 Simple Regression

BA 555 Practical Business Analysis

Chapter 12 Multiple Regression

Curve-Fitting Regression

Chapter 13 Introduction to Linear Regression and Correlation Analysis

Chapter 11 Multiple Regression.

Regression Diagnostics Checking Assumptions and Data.

11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.

Chapter 14 Introduction to Linear Regression and Correlation Analysis

Lecture 19 Simple linear regression (Review, 18.5, 18.8)

Nonlinear Stochastic Programming by the Monte-Carlo method Lecture 4 Leonidas Sakalauskas Institute of Mathematics and Informatics Vilnius, Lithuania EURO.

Introduction to Regression Analysis, Chapter 13,

1 Simple Linear Regression 1. review of least squares procedure 2. inference for least squares lines.

Statistics for Business and Economics 7 th Edition Chapter 11 Simple Regression Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch.

Regression and Correlation Methods Judy Zhong Ph.D.

Quantify prediction uncertainty (Book, p ) Prediction standard deviations (Book, p. 180): A measure of prediction uncertainty Calculated by translating.

Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.

Inference for regression - Simple linear regression

Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 12-1 Chapter 12 Simple Linear Regression Statistics for Managers Using.

Simple Linear Regression Models

1 Least squares procedure Inference for least squares lines Simple Linear Regression.

Stats for Engineers Lecture 9. Summary From Last Time Confidence Intervals for the mean t-tables Q Student t-distribution.

Hydrologic Modeling: Verification, Validation, Calibration, and Sensitivity Analysis Fritz R. Fiedler, P.E., Ph.D.

III. Ground-Water Management Problem Used for the Exercises.

Analytical vs. Numerical Minimization Each experimental data point, l, has an error, ε l, associated with it ‣ Difference between the experimentally measured.

Statistics for Business and Economics 7 th Edition Chapter 11 Simple Regression Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch.

Chap 12-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 12 Introduction to Linear.

EQT 373 Chapter 3 Simple Linear Regression. EQT 373 Learning Objectives In this chapter, you learn: How to use regression analysis to predict the value.

Curve-Fitting Regression

Multiple Regression Petter Mostad Review: Simple linear regression We define a model where are independent (normally distributed) with equal.

MARE 250 Dr. Jason Turner Multiple Regression. y Linear Regression y = b 0 + b 1 x y = dependent variable b 0 + b 1 = are constants b 0 = y intercept.

Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 13-1 Introduction to Regression Analysis Regression analysis is used.

Lecture 10: Correlation and Regression Model.

Machine Learning 5. Parametric Methods.

Chapter 2-OPTIMIZATION G.Anuradha. Contents Derivative-based Optimization –Descent Methods –The Method of Steepest Descent –Classical Newton’s Method.

Statistics Presentation Ch En 475 Unit Operations.

1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 

1 Simple Linear Regression Chapter Introduction In Chapters 17 to 19 we examine the relationship between interval variables via a mathematical.

Stats Methods at IC Lecture 3: Regression.

Chapter 13 Simple Linear Regression

Warm-Up The least squares slope b1 is an estimate of the true slope of the line that relates global average temperature to CO2. Since b1 = is very.

Why Model? Make predictions or forecasts where we don’t have data.

Regression Analysis AGEC 784.

Inference for Least Squares Lines

Linear Regression.

Regression Analysis Module 3.

Statistical Quality Control, 7th Edition by Douglas C. Montgomery.

Multiple Regression.

Simple Linear Regression

Chapter 11 Simple Regression

Chapter 13 Simple Linear Regression

Introduction to Regression

Presentation transcript:

Model calibration using

Pag. 5/3/20152 PEST program

Pag. Major steps of hydrologic modeling (Hydrologic) data Relate to model inputs Parameter estimation or model calibration Model -- parameters Predictions Prediction uncertainty Societal decisions

Pag. What is Model Calibration? 5/3/20154 PEST program Adjustment of the parameters of a mathematical or numerical model in order to optimize the agreement between observed data and the model's predictions. American meteorological society The process of adjusting model inputs so that model calculations match what we measure in the real-world. So, a good model calibration is not sufficient to develop a good model. Also need good data, a good model, and an adequate optimization method.

Pag. Real world data 5/3/20155 PEST program

Pag. Attempt 1 for model calibration 5/3/20156 PEST program

Pag. Attempt 2 for model calibration 5/3/20157 PEST program

Pag. Attempt 3 for model calibration 5/3/20158 PEST program

Pag. Calculation of residuals for model calibration 5/3/20159 PEST program

Pag. Statistical measures involving residuals 5/3/ PEST program

Pag. 5/3/ PEST program PEST is a nonlinear parameter estimation package capable of estimating parameters for any computer model. It solves a nonlinear least squares problem and minimizes the differences between the model's outputs and field measurements such as the calculated and measured discharges. PEST adapts to the model, the model does not need to adapt to PEST.

Pag. 5/3/ PEST program Minmizing Sum of Squared Residuals (SSR) The use of this equation, as an objective function to be minimized, implies certain assumptions about the residuals (Clarke, 1973): a)That the time series of residuals have zero mean and constant variance b)That the time series of residuals does not have a significant autocorrelation If confidence intervals are to be given for the estimated model parameters, then: c) residuals have to be distributed normally.

Pag. The role of PEST 5/3/ PEST program 1.(initial) Parameter Sensitivity Analysis : conducted on a larger parameter space, which allows excluding from the further analysis those parameters that have a relatively small impact on the model response.(initial) Parameter Sensitivity Analysis 2. Calibration: (parameter estimation): PEST “calibrates” a model by reducing the discrepancies between model outputs and field observations to a minimum in the weighted least squares sense.Calibration 3. Predictive analysis: Once a parameter set has been determined for which model behavior matches system behavior as well as possible, it is then reasonable to ask whether another parameter set exists which also results in reasonable simulation by the model of the system under study.Predictive analysis

Pag. PEST template, instruction, and control files 5/3/ PEST program 1.Template file: tells PEST how to write parameters in the model input fileTemplate file 2. Instruction file: tells PEST where it has to look for the model-generated output, and how to read it e.g. which column contains the simulated discharges.Instruction file 3. PEST conrol file: contains:User-supplied initial parameter values, range of permissible values that a parameter can take, observations, maximum number of iterations, etc.PEST conrol file

Pag. 5/3/ PEST program Optimization algorithm can be classified into two categories: 1.Global search e.g. Shuffled Complex Evolution-University of Arizona (SCE-UA, 1992). searches the entire parameter space and do a controlled random search in the direction of global optimum. 2. Local search e.g. PEST program (Doherty, 1994). Estimate parameters with observations using a gradient-based method.gradient-based method Gradient methods are much faster but can get stuck in local minima.

Pag. Local and global minima 5/3/ PEST program Response surface for an inverted goal function. Local minima are represented as peaks. It shows that for any given goal function, there exits many parameter sets for which the goal functions are not significantly different from each other, i.e., there are many potential solutions based on quite different parameter sets.

Pag. 5/3/ PEST program Based on Objective Function, the automated calibration procedures can be classified as: 1.Single objective procedures e.g. mean squared errors in PEST program. PEST trys to minimize the objective function in order to obtain a better fit between predicted and observed values. PEST offers the best parameter set. 2. Multiple objective procedures. The generated output from this approach is a set of solutions (called pareto solutions) instead of a unique solution.

Pag. When is a Model Calibrated? 5/3/ PEST program As the problem of parameter optimization is not unique, it is important that we define when a model is calibrated and what the magnitude of the prediction uncertainty is.

Pag. 5/3/ PEST program To see when a model is calibrated: 1.Calculate the 95% prediction uncertainty

Pag. 5/3/ PEST program 2. Normally, more than 80 percent of obsevations should be braketet by 95% confidence intervals (the upper and lower limits of the best parameter sets) a) is not a parameter calibration problem, b)calibration can obtain smaller uncertainty distribution, c) it can be expected that some measured data can fall outside the 95PPU.

Pag. 5/3/ PEST program 3. Upon reaching the above criteria, if there exits a significant r 2 and/or Nash-Sutcliff coefficient between the best simulation and the measured data for a calibration and a test (validation) data set, then the model can be considered calibrated.

Pag. Calibration issues 5/3/ PEST program After analysing residuals to check whether they are independent, homoscedastic and normally distributed with zero expectation; We need to consider following questions: 1.What is the data quality and error (data uncertainty)? How does it affect predictions? 2.What is the sensitivity of model matches to changes in model inputs? (non- uniqueness in solutions) 3.How good is good enough, for a well calibrated model?

Pag. 5/3/ PEST program Thank you

Pag. 5/3/ PEST program

Pag. 5/3/ PEST program WetSpa model parameter sensitivity for the Illinois River basin

Pag. 5/3/ PEST program Streamflow simulation using WetSpa at Illinois River basin, Oklahoma, USA

Pag. 5/3/ PEST program

Pag. PEST input template for WetSpa 5/3/ PEST program

Pag. PEST Instruction file for WetSpa 5/3/ PEST program

Pag. PEST conrol file for WetSpa 5/3/ PEST program