Studying Uncertainty in Palaeoclimate Reconstruction SUPRaNet SUPRModels SUPR software Brian Huntley, Andrew Parnell Caitlin Buck, James Sweeney and many.

Slides:



Advertisements
Similar presentations
Probabilistic models Haixu Tang School of Informatics.
Advertisements

CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Bayesian Estimation in MARK
Sampling Distributions (§ )
Lecture 3 Probability and Measurement Error, Part 2.
Introduction of Probabilistic Reasoning and Bayesian Networks
What role should probabilistic sensitivity analysis play in SMC decision making? Andrew Briggs, DPhil University of Oxford.
CHAPTER 16 MARKOV CHAIN MONTE CARLO
1 Graphical Models in Data Assimilation Problems Alexander Ihler UC Irvine Collaborators: Sergey Kirshner Andrew Robertson Padhraic Smyth.
Constraining Astronomical Populations with Truncated Data Sets Brandon C. Kelly (CfA, Hubble Fellow, 6/11/2015Brandon C. Kelly,
Climate Research Branch / CCCma Discussion of use of statistical methods in palaeo-reconstructions Photo: F. Zwiers Francis Zwiers Climate Research Division,
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
Statistics.
A Two Level Monte Carlo Approach To Calculating
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 8 1Probability, Bayes’ theorem, random variables, pdfs 2Functions of.
G. Cowan 2011 CERN Summer Student Lectures on Statistics / Lecture 41 Introduction to Statistics − Day 4 Lecture 1 Probability Random variables, probability.
Palaeoclimate Reconstruction: Modelling Temporal Uncertainty Many collaborators: Stats: Bhattacharya, Gelfand, Salter-Townshend, Parnell, Whiley, Wilson,
Using ranking and DCE data to value health states on the QALY scale using conventional and Bayesian methods Theresa Cain.
Computer vision: models, learning and inference Chapter 10 Graphical Models.
Bayesian Analysis for Extreme Events Pao-Shin Chu and Xin Zhao Department of Meteorology School of Ocean & Earth Science & Technology University of Hawaii-
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
Lecture II-2: Probability Review
Binary Variables (1) Coin flipping: heads=1, tails=0 Bernoulli Distribution.
1 Spatial and Spatio-temporal modeling of the abundance of spawning coho salmon on the Oregon coast R Ruben Smith Don L. Stevens Jr. September.
Overview G. Jogesh Babu. Probability theory Probability is all about flip of a coin Conditional probability & Bayes theorem (Bayesian analysis) Expectation,
Error Analysis Accuracy Closeness to the true value Measurement Accuracy – determines the closeness of the measured value to the true value Instrument.
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
Probability theory 2 Tron Anders Moger September 13th 2006.
Model Inference and Averaging
G. Cowan 2009 CERN Summer Student Lectures on Statistics1 Introduction to Statistics − Day 4 Lecture 1 Probability Random variables, probability densities,
G. Cowan Lectures on Statistical Data Analysis Lecture 3 page 1 Lecture 3 1 Probability (90 min.) Definition, Bayes’ theorem, probability densities and.
1 Institute of Engineering Mechanics Leopold-Franzens University Innsbruck, Austria, EU H.J. Pradlwarter and G.I. Schuëller Confidence.
Theory of Probability Statistics for Business and Economics.
Random Numbers and Simulation  Generating truly random numbers is not possible Programs have been developed to generate pseudo-random numbers Programs.
Mixture Models, Monte Carlo, Bayesian Updating and Dynamic Models Mike West Computing Science and Statistics, Vol. 24, pp , 1993.
17 May 2007RSS Kent Local Group1 Quantifying uncertainty in the UK carbon flux Tony O’Hagan CTCD, Sheffield.
CLIMATE CHANGE THE GREAT DEBATE Session 5.
Statistical approach Statistical post-processing of LPJ output Analyse trends in global annual mean NPP based on outputs from 19 runs of the LPJ model.
POOLED DATA DISTRIBUTIONS GRAPHICAL AND STATISTICAL TOOLS FOR EXAMINING COMPARISON REFERENCE VALUES Alan Steele, Ken Hill, and Rob Douglas National Research.
Statistical Decision Theory Bayes’ theorem: For discrete events For probability density functions.
Stats Probability Theory Summary. The sample Space, S The sample space, S, for a random phenomena is the set of all possible outcomes.
Analyzing wireless sensor network data under suppression and failure in transmission Alan E. Gelfand Institute of Statistics and Decision Sciences Duke.
Additional Topics in Prediction Methodology. Introduction Predictive distribution for random variable Y 0 is meant to capture all the information about.
The generalization of Bayes for continuous densities is that we have some density f(y|  ) where y and  are vectors of data and parameters with  being.
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
WCRP Extremes Workshop Sept 2010 Detecting human influence on extreme daily temperature at regional scales Photo: F. Zwiers (Long-tailed Jaeger)
1 Introduction to Statistics − Day 3 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Brief catalogue of probability densities.
Statistics Sampling Distributions and Point Estimation of Parameters Contents, figures, and exercises come from the textbook: Applied Statistics and Probability.
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
G. Cowan Lectures on Statistical Data Analysis Lecture 9 page 1 Statistical Data Analysis: Lecture 9 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan Lectures on Statistical Data Analysis Lecture 5 page 1 Statistical Data Analysis: Lecture 5 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
École Doctorale des Sciences de l'Environnement d’Île-de-France Année Universitaire Modélisation Numérique de l’Écoulement Atmosphérique et Assimilation.
Kevin Stevenson AST 4762/5765. What is MCMC?  Random sampling algorithm  Estimates model parameters and their uncertainty  Only samples regions of.
Chapter 3: Uncertainty "variation arises in data generated by a model" "how to transform knowledge of this variation into statements about the uncertainty.
Bayesian Brain Probabilistic Approaches to Neural Coding 1.1 A Probability Primer Bayesian Brain Probabilistic Approaches to Neural Coding 1.1 A Probability.
Introduction to emulators Tony O’Hagan University of Sheffield.
Overview G. Jogesh Babu. R Programming environment Introduction to R programming language R is an integrated suite of software facilities for data manipulation,
Bayesian Inference: Multiple Parameters
Types of risk Market risk
LECTURE 09: BAYESIAN ESTIMATION (Cont.)
Appendix A: Probability Theory
Ch3: Model Building through Regression
Types of risk Market risk
Introduction to Instrumentation Engineering
Filtering and State Estimation: Basic Concepts
Where did we stop? The Bayes decision rule guarantees an optimal classification… … But it requires the knowledge of P(ci|x) (or p(x|ci) and P(ci)) We.
Statistical NLP: Lecture 4
Discrete Multivariate Distributions Revision and Simulation
Yalchin Efendiev Texas A&M University
Presentation transcript:

Studying Uncertainty in Palaeoclimate Reconstruction SUPRaNet SUPRModels SUPR software Brian Huntley, Andrew Parnell Caitlin Buck, James Sweeney and many others Science Foundation Ireland Leverhulm Trust

Result: one pollen core in Ireland 95% of plausible scenarios have at least one “100 year +ve change” > 5 o C Mean Temp of Coldest Month

Climate over 100,000 years Greenland Ice Core 10,000 year intervals Oxygen isotope – proxy for Greenland temp Median smooth. Past years The long summer

Past years Climate over 100,000 years Greenland Ice Core 10,000 year intervals The long summer Int Panel on Climate Change WG “During the last glacial period, abrupt regional warmings (probably up to 16 ◦ C within decades over Greenland) occurred repeatedly over the North Atlantic region”

Climate over 15,000 years Greenland Ice Core Younger Dryas Transition Holocene Ice dynamics? Ocean dynamics? What’s the probability of abrupt climate change?

Modelling Philosophy Climate is – Latent space-time stoch process C(s,t) All measurements are – Indirect, incomplete, with error – ‘Regionalised’ relative to some ‘support’ Uncertainty – Prob (Event) – Event needs explicitly defined function of C(s,t)

Proxy Data Collection Oak treeGISP iceSedimentPollen Thanks to Vincent Garreta

core samples mult. counts by taxa Pollen

Data

Data Issues Pollen 150 slices – 28 taxa (not species); many counts zero – Calibrated with modern data 8000 locations 14 C5 dates – worst uncertainties ± 2000 years Climate `smoothness’ – GISP data 100,000 years, as published

Model Issues Climate - Sedimentation - Veg response latent processes – Climate smooth (almost everywhere) – Sedimentation non decreasing – Veg response smooth Data generating process – Pollen – superimposed pres/abs & abundance – 14 C - Bcal Priors - Algorithms …….

SUPR-ambitions Principles – All sources of uncertainty – Models and modules – Communication Scientist to scientist to others Software Bclim Future SUPR tech stuff non-linear non-Gaussian multi-proxy space-time incl rapid change dating uncertainty mechanistic system models fully Bayesian fast software

Modelling Approach Latent processes – With defined stochastic properties – Involving explicit priors Conditional on ‘values’ of process(es) – Explicit stochastic models of – Forward Data Generating Processes – Combined via conditional independence – System Model

Modelling Approach Modular Algorithms – Sample paths, ensembles – Monte Carlo – Marginalisation to well defined random vars and events

Progress in Modelling Uncertainty Statistical models – Partially observed space-time stochastic processes – Bayesian inference Monte Carlo methods – Sample paths – Thinning, integrating Communication – Supplementary materials Modelled Uncertainty Does it change? In time? In space?

SUPR Info Proxy data: typically cores – Multiple proxies, cores; multivariate counts – Known location(s) in (2D) space – Known depths – unknown dates, some 14 C data – Calibration data – modern, imperfect System theory – Uniformitarian Hyp – Climate ‘smoothness’; Sedimention Rates ≥ 0 – Proxy Data Generating Processes

Chronology example

Bchron Models Sedimentation a latent process – Rates ≥ 0, piecewise const – Depth vs Time - piece-wise linear – Random change points (Poisson Process) – Random variation in rates (based on Gamma dist) 14 C Calibration curve latent process – ‘Smooth’ – in sense of Gaussian Process (Bcal) 14 C Lab data generation process – Gaussian errors

Bchron Algorithm Posterior – via Monte Carlo Samples Entire depth/time histories, jointly – Generate random piece-wise linear ‘curves’ – Retain only those that are ‘consistent’ with model of data generating system Inference – Key Parameter; shape par in Gamma dist – How much COULD rates vary?

20 Bivariate Gamma Renewal Process Comp Poisson Gamma wrt x ; x incs exponential Comp Poisson Gamma wrt y ; y incs exponential

21 Compound Poisson Gamma Process We take  y = 1 for access to CPG and  x > 2 for continuity wrt x Slope = Exp / Gamma = Exp x InvGamma infinite var if  x > 2

22 Modelling with Bivariate Gamma Renewal Process Data assumed to be subset of renewal points Implicitly not small Marginalised wrt renewal pts Indep increments process Stochastic interpolation by simulation new y unknown x

23 Stochastic Interpolation Unit Square Monotone piece-wise linear CPG Process

24 Stochastic Interpolation Monotone piece-wise linear CPG Process

25 Stochastic Interpolation Monotone piece-wise linear CPG Process

26 Stochastic Interpolation Monotone piece-wise linear CPG Process

27 Stochastic Interpolation Monotone piece-wise linear CPG Process

28 Stochastic Interpolation Monotone piece-wise linear CPG Process

29 Stochastic Interpolation Density Known Depths Known age Calendar age

Data

Glendalough Time-Slice “Transfer-Function” via Modern Training Data Hypothesis Modern analogue Climate at Glendalough 8,000 yearsBP “like” Somewhere right now The present is a model for the past

Calibration c (t) y(t ) Modern (c, y ) pairs In space c(t) y(t ) Eg dendro Two time series Much c data missing Eg pollen One time series All c data missing Space for time substitution Over- lapping time series

Calibration Model Simple model of Pollen Data Generating Process ‘Response’ y depends smoothly on clim c Two aspects Presence/Absence Rel abundance if present Taxa not species Eg y i =0 probq(c) y i ~Poisson (λ(c)) prob1-q(c) Thus obsy i =0, y i =1very diff implications

One-slice-at-a time Slice j has count vector y j, depth d j Whence – separately - π(c j | y j ) and π(t j | d j ) ResponseChronmodule

Uncertainty one-layer-at-a-time Pollen => Uncertain Climate Depth => Uncertain depth But monotonicity Here showing 10 of 150 layers

Uncertainty one-layer-at-a-time

Uncertainty jointly Many potential climate histories are Consistent with ‘one-at-a-time Jointly inconsistent with Climate Theory Refine/subsample

Coherent Histories One-slice-at-a-time samples => {c(t 1 ), c(t 2 ),……c(t n )}

Coherent Histories One-slice-at-a-time samples => {c(t 1 ), c(t 2 ),……c(t n )}

Coherent Histories One-slice-at-a-time samples => {c(t 1 ), c(t 2 ),……c(t n )}

Coherent Histories One-slice-at-a-time samples => {c(t 1 ), c(t 2 ),……c(t n )}

GISP series (20 years)

Climate property? Non-overlapping (20 year?) averages are such that first differences are: adequately modelled as independent inadequately modelled by Normal dist adequately modelled by Normal Inv Gaussian – Closed form pdf – Infinitely divisible – Easily simulated, scale mixture of Gaussian dist

One joint (coherent) history

MTCO Reconstruction One layer at a time, showing temporal uncertainty Jointly, century resolution, allowing for temporal uncertainty Marginal time-slice: may not be unimodal

Rapid Change in GDD5 Identify 100 yr period with greatest change One history

Rapid Change in GDD5 One history Identify 100 yr period with greatest change

Rapid Change in GDD5 Study uncertainty in non linear functionals of past climate 1000 histories Identify 100 yr period with greatest change

Result: one pollen core in Ireland 95% of plausible scenarios have at least one 100 year +ve change > 5 o C Mean Temp of Coldest Month

Communication Scientist to scientist Exeter Workshop – Data Sets – With Uncertainty Associated with what precise support?

Modelling Approach Latent processes – With defined stochastic properties – Involving explicit priors Conditional on ‘values’ of process(es) – Explicit stochastic models of – Forward Data Generating Processes – Combined via conditional independence Modular Algorithms – Sample paths, ensembles – Monte Carlo – Marginalisation to well defined random vars and events