PARAMETER OPTIMIZATION. ANALYSIS and SUPPORT TOOLS Currently Available Statistical and Graphical Analyses Rosenbrock Optimization Troutman Sensitivity.

Slides:



Advertisements
Similar presentations
Measurement error in mortality models Clara Antón Fernández Robert E. Froese School of Forest Resources and Environmental Science. Michigan Technological.
Advertisements

1 Uncertainty in rainfall-runoff simulations An introduction and review of different techniques M. Shafii, Dept. Of Hydrology, Feb
Error and Uncertainty in Modeling George H. Leavesley, Research Hydrologist, USGS, Denver, CO.
NWS Calibration Workshop, LMRFC March, 2009 Slide 1 Sacramento Model Derivation of Initial Parameters.
Introduction to runoff modeling on the North Slope of Alaska using the Swedish HBV Model Emily Youcha, Douglas Kane University of Alaska Fairbanks Water.
Model calibration using. Pag. 5/3/20152 PEST program.
Sacramento Soil Moisture Accounting Model (SAC-SMA)
1 アンサンブルカルマンフィルターによ る大気海洋結合モデルへのデータ同化 On-line estimation of observation error covariance for ensemble-based filters Genta Ueno The Institute of Statistical.
Application and Evaluation of a Snowmelt Runoff Model in the Tamor River Basin, Eastern Himalaya using a Markov Chain Monte Carlo Data Assimilation Approach.
Aerosol radiative effects from satellites Gareth Thomas Nicky Chalmers, Caroline Poulsen, Ellie Highwood, Don Grainger Gareth Thomas - NCEO/CEOI-ST Joint.
Model calibration and validation
Parameter Estimation and Data Assimilation Techniques for Land Surface Modeling Qingyun Duan Lawrence Livermore National Laboratory Livermore, California.
Use of Multi-Model Super-Ensembles in Hydrology Lauren Hay George Leavesley Martyn Clark * Steven Markstrom Roland Viger U.S. Geological Survey Water Resources.
Water Management Presentations Summary Determine climate and weather extremes that are crucial in resource management and policy making Precipitation extremes.
Quantify prediction uncertainty (Book, p ) Prediction standard deviations (Book, p. 180): A measure of prediction uncertainty Calculated by translating.
WaterSmart, Reston, VA, August 1-2, 2011 Steve Markstrom and Lauren Hay National Research Program Denver, CO Jacob LaFontaine GA Water.
GEO7600 Inverse Theory 09 Sep 2008 Inverse Theory: Goals are to (1) Solve for parameters from observational data; (2) Know something about the range of.
National Weather Service River Forecast System Model Calibration Fritz Fiedler Hydromet 00-3 Tuesday, 23 May East Prospect Road, Suite 1 Fort.
El Vado Dam Hydrologic Evaluation Joseph Wright, P.E. Bureau of Reclamation Technical Services Center Flood Hydrology and Meteorology Group.
Hydrologic Modeling: Verification, Validation, Calibration, and Sensitivity Analysis Fritz R. Fiedler, P.E., Ph.D.
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
Zhang Mingwei 1, Deng Hui 2,3, Ren Jianqiang 2,3, Fan Jinlong 1, Li Guicai 1, Chen Zhongxin 2,3 1. National satellite Meteorological Center, Beijing, China.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 8-1 Confidence Interval Estimation.
Model Parameter Estimation Experimant (MOPEX). Science Issues What models are most appropriate for different climatic and physiographic regions? What.
Advances in Robust Engineering Design Henry Wynn and Ron Bates Department of Statistics Workshop at Matforsk, Ås, Norway 13 th -14 th May 2004 Design of.
Streamflow Predictability Tom Hopson. Conduct Idealized Predictability Experiments Document relative importance of uncertainties in basin initial conditions.
Practical Statistical Analysis Objectives: Conceptually understand the following for both linear and nonlinear models: 1.Best fit to model parameters 2.Experimental.
Center for Hydrometeorology and Remote Sensing, University of California, Irvine Basin Scale Precipitation Data Merging Using Markov Chain Monte Carlo.
Coupling of Atmospheric and Hydrologic Models: A Hydrologic Modeler’s Perspective George H. Leavesley 1, Lauren E. Hay 1, Martyn P. Clark 2, William J.
How does the choice/configuration of hydrologic models affect the portrayal of climate change impacts? Pablo Mendoza 1.
Integration of SNODAS Data Products and the PRMS Model – An Evaluation of Streamflow Simulation and Forecasting Capabilities George Leavesley 1, Don Cline.
May 6, 2015 Huidae Cho Water Resources Engineer, Dewberry Consultants
1 Calibration of Watershed Models Why calibrate? –OFS: short term forecasts –ESP: no run time mods –Learn model and hydrology –Good training for forecasting.
Assessing the impacts of climate change on Atbara flows using bias-corrected GCM scenarios SIGMED and MEDFRIEND International Scientific Workshop Relations.
Center for Radiative Shock Hydrodynamics Fall 2011 Review Assessment of predictive capability Derek Bingham 1.
River flow modeling of the Mekong River Basin A.W. Jayawardena Department of Civil Engineering The University of Hong Kong
Understanding hydrologic changes: application of the VIC model Vimal Mishra Assistant Professor Indian Institute of Technology (IIT), Gandhinagar
9 th LBA-ECO Science Team Meeting Assessing the Influence of Observational Data Error on SiB 2 Model Parameter Uncertainty Luis A. Bastidas 1, E. Rosero.
Application of the ORCHIDEE global vegetation model to evaluate biomass and soil carbon stocks of Qinghai-Tibetan grasslands Tan Kun.
Additional data sources and model structure: help or hindrance? Olga Semenova State Hydrological Institute, St. Petersburg, Russia Pedro Restrepo Office.
GoldSim Technology Group LLC, 2006 Slide 1 Sensitivity and Uncertainty Analysis and Optimization in GoldSim.
Meeting challenges on the calibration of the global hydrological model WGHM with GRACE data input S. Werth A. Güntner with input from R. Schmidt and J.
A Soil-water Balance and Continuous Streamflow Simulation Model that Uses Spatial Data from a Geographic Information System (GIS) Advisor: Dr. David Maidment.
Fine-Resolution, Regional-Scale Terrestrial Hydrologic Fluxes Simulated with the Integrated Landscape Hydrology Model (ILHM) David W Hyndman Anthony D.
JRC-AL – Bonn on Disaggregation of CAPRI results Renate Köble Adrian Leip.
DFT Applications Technology to calculate observables Global properties Spectroscopy DFT Solvers Functional form Functional optimization Estimation of theoretical.
Experience with modelling of runoff formation processes at basins of different scales using data of representative and experimental watersheds Olga Semenova.
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
Nathalie Voisin 1, Florian Pappenberger 2, Dennis Lettenmaier 1, Roberto Buizza 2, and John Schaake 3 1 University of Washington 2 ECMWF 3 National Weather.
Fritz Fiedler Calibration 2290 East Prospect Road, Suite 1 Fort Collins, Colorado National Weather Service River Forecast System Cooperative Program.
U.S. Department of the Interior U.S. Geological Survey U.S. Department of the Interior U.S. Geological Survey Scenario generation for long-term water budget.
A Modeling Framework for Improved Agricultural Water Supply Forecasting George Leavesley, Colorado State University, Olaf David,
Controls on Catchment-Scale Patterns of Phosphorous in Soil, Streambed Sediment, and Stream Water Marcel van der Perk, et al… Journal of Environmental.
Performance Comparison of an Energy- Budget and the Temperature Index-Based (Snow-17) Snow Models at SNOTEL Stations Fan Lei, Victor Koren 2, Fekadu Moreda.
Maximum likelihood estimators Example: Random data X i drawn from a Poisson distribution with unknown  We want to determine  For any assumed value of.
Intro to Statistics for the Behavioral Sciences PSYC 1900 Lecture 7: Regression.
G. Cowan Lectures on Statistical Data Analysis Lecture 9 page 1 Statistical Data Analysis: Lecture 9 1Probability, Bayes’ theorem 2Random variables and.
General Introduction. Developed by USGS Freely available via Internet
Development of an Ensemble Gridded Hydrometeorological Forcing Dataset over the Contiguous United States Andrew J. Newman 1, Martyn P. Clark 1, Jason Craig.
Hydrological Simulations for the pan- Arctic Drainage System Fengge Su 1, Jennifer C. Adam 1, Laura C. Bowling 2, and Dennis P. Lettenmaier 1 1 Department.
Automatic Calibration of HSPF model with NEXRAD rainfall data for DMIP Jae Ryu Hydrologist, National Drought Mitigation Center University of Nebraska Lincoln,
Exposure Prediction and Measurement Error in Air Pollution and Health Studies Lianne Sheppard Adam A. Szpiro, Sun-Young Kim University of Washington CMAS.
National Oceanic and Atmospheric Administration’s National Weather Service Colorado Basin River Forecast Center Salt Lake City, Utah 11 The Hydrologic.
Why Stochastic Hydrology ?
Simulation of stream flow using WetSpa Model
Chapter 6 Calibration and Application Process
Looking for universality...
Model performance & Evaluation Calibration and Validation
Streamflow Simulations of the Terrestrial Arctic Regime
Update 2.2: Uncertainty in Projected Flow Simulations
Presentation transcript:

PARAMETER OPTIMIZATION

ANALYSIS and SUPPORT TOOLS Currently Available Statistical and Graphical Analyses Rosenbrock Optimization Troutman Sensitivity Analysis Beta Testing Shuffle Complex Evolution Optimization Multi-Objective Generalized Sensitivity Analysis (MOGSA) Multi-Objective COMplex Evolution Algorithm (MOCOM) Generalized Likelihood Uncertainty Estimation (GLUE)

PARAMETER ESTIMATION (CALIBRATION) STRATEGY LEVELS Estimate all parameters from digital databases (GIS Weasel) and other regional relations Adjust ET parameter to match potential ET for area or region Apply XYZ method for precipitation and temperature distribution Calibrate parameters for hydrograph timing Calibrate all sensitive parameters

Optimization: Distributed Parameter Fitting Assume parameter values are spatially correct assume relative magnitudes of parameter values are correct Can fit all values of one parameter or subsets of a parameter All values of set or subset are moved in the same direction at the same time Values are moved either by the same fixed increment or as a percentage of their magnitude

MODEL CALIBRATION LIMITATIONS Ungauged basins (streamflow, meteorological data) Land-use change Climate change Over-parameterization Parameter equifinality

Rosenbrock Optimization Objective Functions | O i - P i | i  ( O i - P i ) 2 i  | ln(O i + 1) - ln( P i + 1) | i  ( ln(O i + 1) - ln( P i + 1) ) 2 i 

Multi-Objective COMplex Evolution Algorithm (MOCOM)

Pareto Optimality Pareto Solutions

Multi-Criteria Optimization X1X1 X2X2 X3X3 M(θ) Y 1 (θ) Y 2 (θ) Y 2 obs Y 1 obs F 2 (θ) F 1 (θ)   F 2 (θ) θ1θ1 θ2θ2 Pareto Solutions

Multi-Objective Uncertainty

Automatic Multicriteria Approach I.Identify several characteristic features each representing unique behavior of the watershed. II.Develop objective measures of the “closeness” of the model output to these features. III.Simultaneously minimize all of these measures with an optimization routine (MOCOM-UA).

Identifying Characteristic Behavior

Developing Objective Measures peaks/timing baseflow quick recession

Testing of Automatic Multicriteria Approach with SAC-SMA model Leaf River Watershed (1950 km 2 ) 11 years daily calibration data

MC: 500 Pareto Solutions

SAC-SMA Hydrograph Range

PARAMETER ESTIMATION and SENSITIVITY ANALYSIS

Objective Functions (measures of performance) | O i - P i | i  ( O i - P i ) 2 i  | ln(O i + 1) - ln( P i + 1) | i  ( ln(O i + 1) - ln( P i + 1) ) 2 i 

PRMS Sensitivity Analysis Sensitivity Matrix (relative sensitivity) Information Matrix Error Propagation Table –(5, 10, 20, 50% change in parameter value) Joint & Individual Standard Errors in Parameters –(measure of confidence) Correlation Matrix Hat Matrix –(diagonal elements are measure of influence a day is having on optimization, range 0-1)

Relative Sensitivity S R = ( Q PRED / P I ) * (P I / Q PRED ) 

Generalized Likelihood Uncertainty Estimation -- GLUE a methodology based on Monte Carlo simulation for estimating the predictive uncertainty associated with models

DOTTY PLOTS

Solar Radiation Transmission Coefficient (rad_trncf) vs Cover Density

Uncalibrated Estimate Parameter Equifinality (deg F) (inches) RockiesSierrasCascades

soil_moist_maxrad_trncf Objective Function Weasel Value Parameter Sensitivity and Weasel Determined Value Animas River (Rockies)

soil_moist_max rad_trncf Parameter Sensitivity and Weasel Determined Value EF Carson River (Sierras) Objective Function Weasel Value

soil_moist_maxrad_trncf Parameter Sensitivity and Weasel Determined Value CleElum River (Cascades) Objective Function Weasel Value

Multi-Objective Generalized Sensitivity Analysis (MOGSA)

Identifying Characteristic Behavior

Developing Objective Measures peaks/timing baseflow quick recession

MC: 500 Pareto Solutions

Parameter Sensitivity by Objective Function

93