Understanding Monte Carlo Experiment and succeding investigations Zoltán Barcza, Ferenc Horváth Department of Meteorology, Eötvös Loránd Universtiy, Budapest.

Slides:

Advertisements

Similar presentations

1 Uncertainty in rainfall-runoff simulations An introduction and review of different techniques M. Shafii, Dept. Of Hydrology, Feb

Advertisements

Estimating a Population Variance

A Simple Production Efficiency Model 1/18 Willem de Kooning ( ) A Tree in Naples.

Main features of the Biome-BGC MuSo model Zoltán BARCZA, Dóra HIDY Training Workshop for Ecosystem Modelling studies Budapest, May 2014.

Showcase of a Biome-BGC workflow presentation Zoltán BARCZA Training Workshop for Ecosystem Modelling studies Budapest, May 2014.

Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 12 l Multiple Regression: Predicting One Factor from Several Others.

Uncertainty and confidence intervals Statistical estimation methods, Finse Friday , 12.45–14.05 Andreas Lindén.

Experimental Design, Response Surface Analysis, and Optimization

Markov-Chain Monte Carlo

Propagation of Error Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.

Approaches to Data Acquisition The LCA depends upon data acquisition Qualitative vs. Quantitative –While some quantitative analysis is appropriate, inappropriate.

Confidence Intervals Underlying model: Unknown parameter We know how to calculate point estimates E.g. regression analysis But different data would change.

6/2/2015 A GAP-FILLING MODEL (GFM) FOR TOWER-BASED NET ECOSYSTEM PRODUCTIVITY MEASUREMENTS Zisheng Xing a, Charles P.-A. Bourque a, Fanrui Meng a, Roger.

G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem, random variables, pdfs 2Functions.

Data Freshman Clinic II. Overview n Populations and Samples n Presentation n Tables and Figures n Central Tendency n Variability n Confidence Intervals.

191 Drawing Statistical Inference from Simulation Runs......the "fun" stuff!

Monté Carlo Simulation MGS 3100 – Chapter 9. Simulation Defined A computer-based model used to run experiments on a real system.  Typically done on a.

Standard error of estimate & Confidence interval.

Time Series Analysis – Chapter 4 Hypothesis Testing Hypothesis testing is basic to the scientific method and statistical theory gives us a way of conducting.

Hydrologic Modeling: Verification, Validation, Calibration, and Sensitivity Analysis Fritz R. Fiedler, P.E., Ph.D.

TUTORIAL-07: GLUE Analysis Laura Dobor, Péter Ittzés, Dóra Ittzés, Ferenc Horváth & Zoltán Barcza Training WS for Ecosystem Modelling studies Budapest,

CHAPTER 14 MULTIPLE REGRESSION

BIOME-BGC estimates fluxes and storage of energy, water, carbon, and nitrogen for the vegetation and soil components of terrestrial ecosystems. Model algorithms.

EFFICIENT CHARACTERIZATION OF UNCERTAINTY IN CONTROL STRATEGY IMPACT PREDICTIONS EFFICIENT CHARACTERIZATION OF UNCERTAINTY IN CONTROL STRATEGY IMPACT PREDICTIONS.

Statistical Methods II&III: Confidence Intervals ChE 477 (UO Lab) Lecture 5 Larry Baxter, William Hecker, & Ron Terry Brigham Young University.

Design of Experiments DoE Antonio Núñez, ULPGC. Objectives of DoE in D&M Processes, Process Investigation, Product and Process Q-improvement, Statistical.

Statistical Methods II: Confidence Intervals ChE 477 (UO Lab) Lecture 4 Larry Baxter, William Hecker, & Ron Terry Brigham Young University.

Ecosystem Service Indicators, Biome-BGC and the SZTAKI Desktop Grid P. Ittzés 1, A. Cs. Marosi 2, Z. Barcza 1, F. Horváth 1 1. MTA Centre for Ecological.

Liebermann R 1, Kraft P 1, Houska T 1, Müller C 2,3, Haas E 4, Kraus D 4, Klatt S 4, Breuer L 1 1 Institute for Landscape Ecology and Resources Management,

BioVeL MS11 Workshop - Ecosystem functioning & valuation web services and workflows Recent model developments in Hungary: Biome-BGC MuSo Zoltán Barcza,

Gridded Biome-BGC Simulation with Explicit Fire-disturbance Sinkyu Kang, John Kimball, Steve W. Running Numerical Terradynamic Simulation Group, School.

BUSI 6480 Lecture 8 Repeated Measures.

Chapter 9: Inferences Based on Two Samples: Confidence Intervals and Tests of Hypotheses Statistics.

The influence of local calibration on the quality of UV-VIS spectrometer measurements in urban stormwater monitoring N. Caradot, H. Sonnenberg, M. Riechel,

CHEMISTRY ANALYTICAL CHEMISTRY Fall Lecture 6.

GoldSim Technology Group LLC, 2006 Slide 1 Sensitivity and Uncertainty Analysis and Optimization in GoldSim.

Demonstrating the Biome-BGC CARBON workflow on Taverna Workbench MS11 BioVeL workshop: Ecosystem functioning & valuation web services and workflows ELTE,

11 Confidence Intervals – Introduction A point estimate provides no information about the precision and reliability of estimation. For example, the sample.

On Methods For Estimating Forest Productivity: Field Measurement, Remote Sensing & Modelling Project EFFEctivity Workshop N o 2 - Croatian Forestry Society,

MODIS Net Primary Productivity (NPP)

Summarizing Risk Analysis Results To quantify the risk of an output variable, 3 properties must be estimated: A measure of central tendency (e.g. µ ) A.

BioVeL Biome-BGC ESI RegulationWorkflow Deriving Ecosystem Service Indicators for Regulation and Maintenance type ecosystem services.

WCRP Extremes Workshop Sept 2010 Detecting human influence on extreme daily temperature at regional scales Photo: F. Zwiers (Long-tailed Jaeger)

Lecture 8 Source detection NASSP Masters 5003S - Computational Astronomy

Using Microsoft Excel to Conduct Regression Analysis.

Ch 8 Estimating with Confidence 8.1: Confidence Intervals.

Classification and Regression Trees

Bayesian statistics named after the Reverend Mr Bayes based on the concept that you can estimate the statistical properties of a system after measuting.

Week 111 Review - Sum of Normal Random Variables The weighted sum of two independent normally distributed random variables has a normal distribution. Example.

8.3 Estimating a Population Mean Objectives SWBAT: STATE and CHECK the Random, 10%, and Normal/Large Sample conditions for constructing a confidence interval.

Matrix Models for Population Management & Conservation March 2014 Lecture 10 Uncertainty, Process Variance, and Retrospective Perturbation Analysis.

Capture-recapture Models for Open Populations “Single-age Models” 6.13 UF-2015.

PARAMETER OPTIMIZATION. ANALYSIS and SUPPORT TOOLS Currently Available Statistical and Graphical Analyses Rosenbrock Optimization Troutman Sensitivity.

Arctic RIMS & WALE (Regional, Integrated Hydrological Monitoring System & Western Arctic Linkage Experiment) John Kimball FaithAnn Heinsch Steve Running.

1 Life Cycle Assessment A product-oriented method for sustainability analysis UNEP LCA Training Kit Module k – Uncertainty in LCA.

TUTORIAL-04: Executing your first worflow run (using CARBON) Eszter Lellei-Kovács, Dóra Krasser & Ferenc Horváth Training WS for Ecosystem Modelling studies.

The Conditional Random-Effects Variance Component in Meta-regression

Supplementary Chapter B Optimization Models with Uncertainty

Types of risk Market risk

H676 Week 3 – Effect Sizes Additional week for coding?

FW364 Ecological Problem Solving Class 6: Population Growth

3-PG The Use of Physiological Principles in Predicting Forest Growth

Ecosystem Demography model version 2 (ED2)

Monte Carlo Simulation Managing uncertainty in complex environments.

Types of risk Market risk

BA 275 Quantitative Business Methods

Chapter 12 Review Inference for Regression

Distribution-free Monte Carlo for population viability analysis

Meeting of the Steering Group on Simulation (SGS) Defining the simulation plan in the Kriging meta-model development Thessaloniki, 07 February 2014.

Presentation transcript:

Understanding Monte Carlo Experiment and succeding investigations Zoltán Barcza, Ferenc Horváth Department of Meteorology, Eötvös Loránd Universtiy, Budapest MTA ÖK Institute of Ecology and Botany, Vácrátót Budapest of May, 2014

BOX WROTE THAT „Essentially, all models are wrong, but some are useful" Monte Carlo Experiment Monte Carlo Experiment

Biome-BGC Monte Carlo Experiment SpinUp ININormal INIOUTPUT daily monthly avg annual avg annual sum METDATA for SpinUp METDATA for Normal CO 2 (optional) NDEP (optional) EPC - ecophysiology SITE parameters MANAGEMENT (opt.) MORTALI TY (opt.) GROUNDWATER (opt.) MCE INI – parameter randomization

Biome-BGC Monte Carlo Experiment QUESTIONS: 1. WHAT DO I WANT TO RANDOMIZE? 2. HOW SHOULD I DEFINE PARAMETER INTERVALS?

Biome-BGC Monte Carlo Experiment 1. WHAT DO I WANT TO RANDOMIZE? We should only fix parameters which are measured locally (we ‘believe’ in these parameters). But: consider structural problems that can cause bias in the parameter values! MAIN ISSUE WITH PARAMETER ESTIMATION [CALIBRATION, OPTIMIZATION]: THE MODEL IS HIGHLY NON-LINEAR, AND HAS A LARGE DEGREE OF FREEDOM.

Biome-BGC Monte Carlo Experiment 1. OK, BUT WHAT DO I WANT TO RANDOMIZE? Typically the steps are: a)sensitivity analysis – use as many parameters as possible, and check the effect of parameter variability on the results. b)parameter estimation [optimization] – restrict the number of parameters to decrease the degree of freedom [literature also suggests that the number of parameters than can be estimated is quite low]

Biome-BGC Monte Carlo Experiment 2. HOW SHOULD I DEFINE PARAMETER INTERVALS? Parameterization of Biome-BGC: must read White et al. 2000:

Biome-BGC Monte Carlo Experiment White et al: 85 pages, vast amount of data

Biome-BGC Sensitivity Analysis OUTPUT VARIABLES = f (params)

Sensitivity analysis Parameter interval is critical. Investigated output is critical. Possible configurations: -wide parameter interval -small interval, e.g. 1% of total interval, around mean Note: check the sensitivity of the model to output which is interesting in your work! Slowly and quickly changing fluxes/pools are driven by different parameters….

Biome-BGC Generalized Likelihood Uncertainty Estimation (GLUE) LHOOD MISFIT ‘BEST’ ? OBSER- VATION DATA

0. maximum root depth 1. symbiotic+asymbiotic fixation of N 2. annual whole-plant mortality fraction 3. new fine root C : new leaf 4. current growth proportion 5. C:N of leaves 6. canopy light extinction coeff 7. canopy average specific leaf area 8. fraction of leaf N in Rubisco 9. maximum stomatal conductance Oensingen

Equifinality We have to learn to live together with equifinality…

GLUE Parameter uncertainty [confidence interval] can be calculated. Additionally, uncertainty of the calibrated model can be estimated if we run the model with the retained parameter sets, or with a subset of the best parameter settings. Parameter estimation can be performed for multiple years, for multiple sites, but it can also be performed for individual years… All depends on the scientific question that we want to answer.