Why it is good to be uncertain ? Martin Wattenbach, Pia Gottschalk, Markus Reichstein, Dario Papale, Jagadeesh Yeluripati, Astley Hastings, Marcel van.

Slides:



Advertisements
Similar presentations
Process-based modelling of vegetations and uncertainty quantification Marcel van Oijen (CEH-Edinburgh) Statistics for Environmental Evaluation Glasgow,
Advertisements

Bayesian tools for analysing and reducing uncertainty Tony OHagan University of Sheffield.
1 Uncertainty in rainfall-runoff simulations An introduction and review of different techniques M. Shafii, Dept. Of Hydrology, Feb
Showcase of a Biome-BGC workflow presentation Zoltán BARCZA Training Workshop for Ecosystem Modelling studies Budapest, May 2014.
Bayesian inference of normal distribution
General Statistics Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
Estimation, Variation and Uncertainty Simon French
Februar 2003 Workshop Kopenhagen1 Assessing the uncertainties in regional climate predictions of the 20 th and 21 th century Andreas Hense Meteorologisches.
Bayesian Estimation in MARK
Bayesian calibration and comparison of process-based forest models Marcel van Oijen & Ron Smith (CEH-Edinburgh) Jonathan Rougier (Durham Univ.)
Lectures on Stochastic System Analysis and Bayesian Updating June 29-July James L. Beck, California Institute of Technology Jianye Ching, National.
TNO orbit computation: analysing the observed population Jenni Virtanen Observatory, University of Helsinki Workshop on Transneptunian objects - Dynamical.
Estimating the contribution of agricultural land use to terrestrial carbon fluxes in the continental US Keith Paustian 1,2, Steven Ogle 2, Scott Denning.
Engineering Economic Analysis Canadian Edition
Management impacts on the C balance in agricultural ecosystems Jean-François Soussana 1 Martin Wattenbach 2, Pete Smith 2 1. INRA, Clermont-Ferrand, France.
Assessing uncertainty in bottom-up modelling crop- and grasslands M. Wattenbach a, Pia Gottschalk a, Fred Hattermann b, Claus Rachimow b, Michael Flechsig.
Uncertainty and Climate Change Dealing with uncertainty in climate change impacts Daniel J. Vimont Atmospheric and Oceanic Sciences Department Center for.
University of Oxford Quantifying and communicating the robustness of estimates of uncertainty in climate predictions Implications for uncertainty language.
Uncertainty analysis and Model Validation.
Interdisciplinary Modeling of Aquatic Ecosystems Curriculum Development Workshop July 18, 2005 Groundwater Flow and Transport Modeling Greg Pohll Division.
Using ranking and DCE data to value health states on the QALY scale using conventional and Bayesian methods Theresa Cain.
Value of Information for Complex Economic Models Jeremy Oakley Department of Probability and Statistics, University of Sheffield. Paper available from.
Helsinki University of Technology Systems Analysis Laboratory 1 London Business School Management Science and Operations 1 London Business School Management.
Quantify prediction uncertainty (Book, p ) Prediction standard deviations (Book, p. 180): A measure of prediction uncertainty Calculated by translating.
Page 1© Crown copyright 2004 Development of probabilistic climate predictions for UKCIP08 David Sexton, James Murphy, Mat Collins, Geoff Jenkins, Glen.
Data Analysis II Anthony E. Butterfield CH EN "There is a theory which states that if ever anybody discovers exactly what the Universe is for and.
Centre for Geo-information Fieldwork: the role of validation in geo- information science RS&GIS Integration Course (GRS ) Lammert Kooistra Contact:
Uncertainty Analysis and Model “Validation” or Confidence Building.
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
Copyright © 2010 Lumina Decision Systems, Inc. Monte Carlo Simulation Analytica User Group Modeling Uncertainty Series #3 13 May 2010 Lonnie Chrisman,
Harrison B. Prosper Workshop on Top Physics, Grenoble Bayesian Statistics in Analysis Harrison B. Prosper Florida State University Workshop on Top Physics:
Exam I review Understanding the meaning of the terminology we use. Quick calculations that indicate understanding of the basis of methods. Many of the.
Page 1© Crown copyright WP4 Development of a System for Carbon Cycle Data Assimilation Richard Betts.
Model inter-comparison on climate change in relation to grassland productivity Shaoxiu Ma, Gianni Bellocchi Romain Lardy, Haythem Ben-Touhami, Katja Klumpp.
CarboEurope, IMECC and GHG- Europe Mike Jones School of Natural Sciences Trinity College Dublin.
Flux tower representativeness >croplands< news from the workbench Martin Wattenbach Astley Hastings Pete Smith.
Methods Model. The TECOS model is used as forward model to simulate carbon transfer among the carbon pools (Fig.1). In the model, ecosystem is simplified.
Engineering Economic Analysis Canadian Edition
IWRM as a Tool for Adaptation to Climate Change Dealing with uncertainties.
Bayesian Inversion of Stokes Profiles A.Asensio Ramos (IAC) M. J. Martínez González (LERMA) J. A. Rubiño Martín (IAC) Beaulieu Workshop ( Beaulieu sur.
Spatial and temporal patterns of CH 4 and N 2 O fluxes from North America as estimated by process-based ecosystem model Hanqin Tian, Xiaofeng Xu and other.
General Statistics Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
Modelling protocols Marcel van Oijen (CEH-Edinburgh) With input from participants Garmisch Mar & May 2006, Protocol-GMP team, Protocol-UQ/UA team.
1 A Bayesian statistical method for particle identification in shower counters IX International Workshop on Advanced Computing and Analysis Techniques.
17 May 2007RSS Kent Local Group1 Quantifying uncertainty in the UK carbon flux Tony O’Hagan CTCD, Sheffield.
Center for Radiative Shock Hydrodynamics Fall 2011 Review Assessment of predictive capability Derek Bingham 1.
Variation of Surface Soil Moisture and its Implications Under Changing Climate Conditions 1.
Experiences in assessing deposition model uncertainty and the consequences for policy application Rognvald I Smith Centre for Ecology and Hydrology, Edinburgh.
Upscaling and Uncertainty Analysis of Greenhouse Gas Emission Inventories Linda Nol Analysis for the Dutch fen meadow landscapes.
Statistical Decision Theory Bayes’ theorem: For discrete events For probability density functions.
1 A Comparison of Information Management using Imprecise Probabilities and Precise Bayesian Updating of Reliability Estimates Jason Matthew Aughenbaugh,
- 1 - Overall procedure of validation Calibration Validation Figure 12.4 Validation, calibration, and prediction (Oberkampf and Barone, 2004 ). Model accuracy.
Uncertainty in national-scale soil C inventory estimates Keith Paustian 1,2, Stephen Ogle 2, Jay Breidt 3 1 Dept of Soil and Crop Sciences, Colorado State.
Ecosystems component – Cropland Activity Pete Smith & Martin Wattenbach Professor of Soils & Global Change School of Biological Sciences, University of.
- 1 - Computer model under uncertainty In previous lecture on accuracy assessment –We considered mostly deterministic models. – We did not distinguish.
The 4th Annual meeting of CarboEurope-IP E.-D. Schulze, coordinator MPI Biogeochemie, Jena Crete, November 13 to 17, 2006.
Taskforce IV: Treatment, quantification and integration of uncertainties in CarboEurope-IP Component uncertainties (Inventory, Eddy fluxes, Atmosphere.
DIAS INFORMATION DAY GLOBAL WATER RESOURCES AND ENVIRONMENTAL CHANGE Date: 09/07/2004 Research ideas by The Danish Institute of Agricultural Sciences (DIAS)
- 1 - Outline Introduction to the Bayesian theory –Bayesian Probability –Bayes’ Rule –Bayesian Inference –Historical Note Coin trials example Bayes rule.
Uncertainty analysis of carbon turnover time and sequestration potential in terrestrial ecosystems of the Conterminous USA Xuhui Zhou 1, Tao Zhou 1, Yiqi.
Outline Historical note about Bayes’ rule Bayesian updating for probability density functions –Salary offer estimate Coin trials example Reading material:
8 Sept 2006, DEMA2006Slide 1 An Introduction to Computer Experiments and their Design Problems Tony O’Hagan University of Sheffield.
Marc Kennedy, Tony O’Hagan, Clive Anderson,
Simulating cropland sites in Europe preliminary results
(Towards) anthropogenic CO2 emissions through inverse modelling
Uncertainty session "Uncertainties in measuring and modelling carbon and greenhouse gas balances in Europe“ JUTF activity Martin Wattenbach.
Ruth Doherty, Edinburgh University Adam Butler & Glenn Marion, BioSS
Adam Butler & Glenn Marion, Biomathematics & Statistics Scotland •
CS639: Data Management for Data Science
Modeling of Parametric Dependencies for Performance Prediction of Component-based Software Systems at Run-time Simon Eismann, Jürgen Walter, Joakim Kistowski,
Presentation transcript:

Why it is good to be uncertain ? Martin Wattenbach, Pia Gottschalk, Markus Reichstein, Dario Papale, Jagadeesh Yeluripati, Astley Hastings, Marcel van Oijen, Pete Smith Members of JUTF

outline Uncertainty - the big unknown Some general thoughts about sources of uncertainty Uncertainty in CarboEurope –Measurement uncertainty –Model uncertainty JUTF activities Where do we go next ?

Uncertainty - the big unknown “We demand rigidly defined areas of doubt and uncertainty!” Douglas Adams

Uncertainty the big unknown Uncertainty is a measure of the lack of confidence we have in our experimental or modelling results after we have corrected for any known error We can not measure it; we can only estimate its range of probability Consequently, uncertainty is not error

Uncertainty - sources Incomplete or imperfect observations Incomplete conceptual frameworks In accurate prescriptions of known processes Chaos Lack of predictability Source: IPCC Martin Manning and Michel Petit

Uncertainty - sources Ecosystem Model model scenario uncertainty - type D baseline uncertainty - type C conceptual uncertainty - type E scientific judgement uncertainty – type B measured/statistical uncertainty - type A Scenario uncertainty measurement

Measurement Uncertainty

Model uncertainty Input parameters and variables Uncertainty site scale Fertilization (Nitrogen)+/- 10% each application Temperature+/- 1°C Precipitation+/- 5% Global radiation+/- 5% Clay content+/- 10% Initial soil carbon+/- 10% siteNEE measured kgC ha -1 best estimate run kgC ha -1 Mean value of the Monte Carlo simulation kgC ha -1 Oensingen The discrepancy between simulated mean value from the Monte Carlo runs and the annual value obtained from a single run using the best estimates. suggest that using the best estimate may not lead to the most probable model result. Input distribution Monte Carlo – multi model run DNDC* model * DeNitrification-DeComposition model Output distribution

Model uncertainty – global uncertainty Gottschalk et al. 2007

Model uncertainty - factor importance Oensingen In Oensingen Ex Laqueuille In Laqueuille Ex Gottschalk et al. 2007

JUTF - Joint Uncertainty Task Force Two projects – two shared aims: –CarboEurope : CarboEurope-IP aims to understand and quantify the present terrestrial carbon balance of Europe and the associated uncertainty at local, regional and continental scale. –NitroEurope: an observing system for N fluxes and pools [Component 1] a network of manipulation experiments [Component 2] plot-scale C-N modelling [Component 3] landscape analysis [Component 4] European up-scaling [Component 5] and uncertainty and verification of European estimates [Component 6] –Joint efforts = JUTF

JUTF key activities Workshop in spring 2007 that brought together people from both projects. We (CEU) learned about: –The NEU protocols for good-modelling practice and for uncertainty quantification and analysis Marcel von Oijen approach of Bayesian calibration and model comparison as one of the key features of the uncertainty analysis methods –Agreement to have a joint model comparison exercise across scales using the Bayesian approach –Implementation of the up-scaling approach used in NEU as one method for CEU croplands up-scaling

Where do we go next Prior pdf Posterior pdf model Bayesian calibration model data

Why do we go Bayesian ? 1.BC uses parameter pdf’s instead of best estimates 2.Takes into account data pdf’s 3.Use Bayes’ Theorem to calculate posterior parameter pdf 4.Use Bayes’ Theorem to quantify the plausibility of different models 5.It will reduce the uncertainty in our model results in the case the model represents the system correctly 6.Do all future model runs with samples from the parameter pdf (i.e. quantify uncertainty of model results) BC can use data to reduce parameter uncertainty for any process-based model

summary Uncertainty is already a key feature in CEU measurement and modelling However, implementation of NEU protocols are a useful addition to already existing methods in CarboEurope –Only the Bayesian approach can not only quantify but also reduce uncertainty in model parameters even with limited information available Why it is good to be uncertain ? –bad communication of uncertainties leads to misinterpretation, misunderstanding and finally to wrong decisions (e.g. Harwood and Stokes 2003) –Only “rigidly defined areas of doubt and uncertainty” will prevent this

“There is a theory which states that if ever for any reason anyone discovers what exactly the Universe is for and why it is here it will instantly disappear and be replaced by something even more bizarre and inexplicable. There is another that states that this has already happened.” Douglas Adams Thank you for your attention

Some thoughts about Uncertainty "probability theory is the logic of science" "all statements are conditional" "models can not be usefully evaluated without comparison to other models“ Marcel van Oijen