Multi-model ensemble post-processing and the replicate Earth paradigm (Manuscript available on-line in Climate Dynamics) Craig H. Bishop Naval Research.

Slides:



Advertisements
Similar presentations
WCRP Overview. Two Problems in Climate Risk Management 1.Uncertainty in the projected impacts The British, he thought, must be gluttons for satire: even.
Advertisements

Measuring the performance of climate predictions Chris Ferro, Tom Fricker, David Stephenson Mathematics Research Institute University of Exeter, UK IMA.
ADVANCED STATISTICS FOR MEDICAL STUDIES Mwarumba Mwavita, Ph.D. School of Educational Studies Research Evaluation Measurement and Statistics (REMS) Oklahoma.
Februar 2003 Workshop Kopenhagen1 Assessing the uncertainties in regional climate predictions of the 20 th and 21 th century Andreas Hense Meteorologisches.
How do model errors and localization approaches affects model parameter estimation Juan Ruiz, Takemasa Miyoshi and Masaru Kunii
Errors in Error Variance Prediction and Ensemble Post-Processing Elizabeth Satterfield 1, Craig Bishop 2 1 National Research Council, Monterey, CA, USA;
Motivation The Carolinas has had a tremendous residential and commercial investment in coastal areas during the past 10 years. However rapid development.
1 Seasonal Forecasts and Predictability Masato Sugi Climate Prediction Division/JMA.
Jon Robson (Uni. Reading) Rowan Sutton (Uni. Reading) and Doug Smith (UK Met Office) Analysis of a decadal prediction system:
Geophysical Fluid Dynamics Laboratory Review June 30 - July 2, 2009 Geophysical Fluid Dynamics Laboratory Review June 30 - July 2, 2009.
1 Lecture 2: ANOVA, Prediction, Assumptions and Properties Graduate School Social Science Statistics II Gwilym Pryce
ANALYSIS OF VARIANCE.
Outline Further Reading: Detailed Notes Posted on Class Web Sites Natural Environments: The Atmosphere GE 101 – Spring 2007 Boston University Myneni L29:
Uncertainty and Climate Change Dealing with uncertainty in climate change impacts Daniel J. Vimont Atmospheric and Oceanic Sciences Department Center for.
The limited contribution of model uncertainty to the uncertainty in observationally-constrained estimates of anthropogenic warming Nathan Gillett, Canadian.
Statistical Background
Your Name Your Title Your Organization (Line #1) Your Organization (Line #2) Global warming.: Matthieu BERCHER, Master M.I.G.S., University of Burgundy,
Ensemble Post-Processing and it’s Potential Benefits for the Operational Forecaster Michael Erickson and Brian A. Colle School of Marine and Atmospheric.
Dr Mark Cresswell Statistical Forecasting [Part 1] 69EG6517 – Impacts & Models of Climate Change.
Analysis of Variance. v Single classification analysis of variance determines whether a relationship exists between a dependent variable and several classifications.
1 FORECASTING Regression Analysis Aslı Sencer Graduate Program in Business Information Systems.
Statistical Techniques I EXST7005 Review. Objectives n Develop an understanding and appreciation of Statistical Inference - particularly Hypothesis testing.
Barcelona, 2015 Ocean prediction activites at BSC-IC3 Virginie Guemas and the Climate Forecasting Unit 9 February 2015.
Which Test Do I Use? Statistics for Two Group Experiments The Chi Square Test The t Test Analyzing Multiple Groups and Factorial Experiments Analysis of.
1 The Venzke et al. * Optimal Detection Analysis Jeff Knight * Venzke, S., M. R. Allen, R. T. Sutton and D. P. Rowell, The Atmospheric Response over the.
CESD SAGES Scottish Alliance for Geoscience, Environment & Society Observing and Modelling Climate Change Prof. Simon Tett, Chair of Earth System Dynamics.
Global Warming Definition: an increase in the earth's atmospheric and oceanic temperatures widely predicted to occur due to an increase in the greenhouse.
Science Class:708 Kiante Gilliam What is the Effect of Global Warming on the Earth?
Model dependence and an idea for post- processing multi-model ensembles Craig H. Bishop Naval Research Laboratory, Monterey, CA, USA Gab Abramowitz Climate.
Data Assimilation Using Modulated Ensembles Craig H. Bishop, Daniel Hodyss Naval Research Laboratory Monterey, CA, USA September 14, 2009 Data Assimilation.
Managerial Economics Demand Estimation & Forecasting.
A unifying framework for hybrid data-assimilation schemes Peter Jan van Leeuwen Data Assimilation Research Center (DARC) National Centre for Earth Observation.
1 Climate Test Bed Seminar Series 24 June 2009 Bias Correction & Forecast Skill of NCEP GFS Ensemble Week 1 & Week 2 Precipitation & Soil Moisture Forecasts.
(Mt/Ag/EnSc/EnSt 404/504 - Global Change) Climate Models (from IPCC WG-I, Chapter 10) Projected Future Changes Primary Source: IPCC WG-I Chapter 10 - Global.
1.Introduction Prediction of sea-ice is not only important for shipping but also for weather as it can have a significant climatic impact. Sea-ice predictions.
Craig H. Bishop Elizabeth A Satterfield Kevin T. Shanley, David Kuhl, Tom Rosmond, Justin McLay and Nancy Baker Naval Research Laboratory Monterey CA November.
Copyright ©2011 Brooks/Cole, Cengage Learning Inference about Simple Regression Chapter 14 1.
Climate Change Stratosphere made up of gases that trap radiation (heat) from earth’s surface, causing it to be warmer than otherwise Acts like greenhouse,
Chapter 2 Statistical Background. 2.3 Random Variables and Probability Distributions A variable X is said to be a random variable (rv) if for every real.
BioSS reading group Adam Butler, 21 June 2006 Allen & Stott (2003) Estimating signal amplitudes in optimal fingerprinting, part I: theory. Climate dynamics,
 CLIMATE MODEL PRECIPITATION TREND ANALYSIS IN THE 20 TH CENTURY Karen Rivas Key Acknowledgements: Xubin Zeng & Koichi Sakaguchi UA/NASA Space Grant Symposium.
OCO 10/27/10 GFDL Activities in Decadal Intialization and Prediction A. Rosati, S. Zhang, T. Delworth, Y. Chang, R. Gudgel Presented by G. Vecchi 1. Coupled.
Past and Projected Changes in Continental-Scale Agro-Climate Indices Adam Terando NC Cooperative Research Unit North Carolina State University 2009 NPN.
BASIC STATISTICAL CONCEPTS Statistical Moments & Probability Density Functions Ocean is not “stationary” “Stationary” - statistical properties remain constant.
A Random Subgrouping Scheme for Ensemble Kalman Filters Yun Liu Dept. of Atmospheric and Oceanic Science, University of Maryland Atmospheric and oceanic.
Climate variability in wind waves from VOS visual observations Vika Grigorieva & Sergey Gulev, IORAS, Moscow  Climatology of visually observed wind waves.
VERIFICATION OF A DOWNSCALING SEQUENCE APPLIED TO MEDIUM RANGE METEOROLOGICAL PREDICTIONS FOR GLOBAL FLOOD PREDICTION Nathalie Voisin, Andy W. Wood and.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
29th Climate Diagnostic and Prediction Workshop 1 Boundary and Initial Flow Induced Variability in CCC-GCM Amir Shabbar and Kaz Higuchi Climate Research.
The Great 20 th Century Drying of Africa Ninth Annual CCSM Workshop Climate Variability Working Group 9 July 2004, Santa Fe Jim Hurrell, Marty Hoerling,
National Oceanic and Atmospheric Administration’s National Weather Service Colorado Basin River Forecast Center Salt Lake City, Utah 11 The Hydrologic.
Equatorial Atlantic Variability: Dynamics, ENSO Impact, and Implications for Model Development M. Latif 1, N. S. Keenlyside 2, and H. Ding 1 1 Leibniz.
Upper Rio Grande R Basin
Climate and Global Dynamics Laboratory, NCAR
ENSO Frequency Cascade and Implications for Predictability
Verifying Precipitation Events Using Composite Statistics
Climate Change Stratosphere made up of gases that trap radiation (heat) from earth’s surface, causing it to be warmer than otherwise Acts like greenhouse,
Makarand A. Kulkarni Indian Institute of Technology, Delhi
Observation Informed Generalized Hybrid Error Covariance Models
Exponential Smoothing
Biointelligence Laboratory, Seoul National University
2. University of Northern British Columbia, Prince George, Canada
IRI’s ENSO and Climate Forecasts Tony Barnston, Shuhua Li,
15.1 The Role of Statistics in the Research Process
Understanding and forecasting seasonal-to-decadal climate variations
Decadal prediction in the Pacific
Measuring the performance of climate predictions
Ensemble forecasts and seasonal precipitation tercile probabilities
ARCCSS & Climate Change Research Centre, UNSW, Sydney
Exponential Smoothing
Presentation transcript:

Multi-model ensemble post-processing and the replicate Earth paradigm (Manuscript available on-line in Climate Dynamics) Craig H. Bishop Naval Research Laboratory, Monterey Gab Abramowitz Climate Change Research Centre, UNSW

Slartibartfast and the replicate Earth ensemble Imagine a very large number of Earth replicates that experienced the same orbital / solar / GHG forcing Each Earth has a slightly different atmosphere / ocean state but all are consistent with observations Behaviour across replicate Earths defines the PDF ClimEnsemble forecasts can be viewed as attempts to create replicate Earths conditioned on the observations used for model development and initialization Slartibartfast: Magrathean planet designer Hitchhikers guide to the Galaxy (D. Adams)

Properties of replicate Earth Ensemble 1. Mean of distribution of replicate Earths is the linear combination of Earths that minimises distance from our Earths observations. 2. Time average of variance of replicate Earths equals mean square error of climate forecast based on mean of the replicate Earths. Multi-model ensembles do not look like replicate Earths

Replicate System Ensemble Transformation Ensemble created by sampling with frequency is like a replicate Earth ensemble in that (a) its sample mean is the minimum error variance estimate, and (b) its variance equals the error variance of the sample mean.

Forecast Test Take an ensemble of K CMIP5 climate forecasts initialized in the late 1800s and subject to prescribed future Green house gas forcing scenarios. Replace real 20 th century observations by pseudo- observations from one of the models and then use these to derive the ensemble transformation weights. Apply the derived transformation to the 21 st century ensemble and measure the performance of this transformed ensemble. Repeat the experiment using a different model as the pseudo- Earth

Distribution of forecast improvements Improvements are relative to ensemble mean Forecast improvements are significant!

Application of method to climate forecasts Derive transformation weights using real 20 th century observations Use weights to make a forecast of the CPD under a variety of predicted Green house gas forcing scenarios.

Apply to 4 distinct forcing scenarios

Transformation significantly affects regional variation of predicted warming

Conclusions The degree of model independence between the members of an ensemble influences the skill of a multi-model mean. Earth replicate ensemble an observationally plausible PD. Nevertheless, it provides: – A framework for understanding role of chaos in climate prediction, – properties that ensemble post-processing schemes should aim to emulate The replicate system post-processing method led to a marked reduction in RMSE of prediction in both hindcast and forecast mode. Application of technique to CMIP5 ensembles results in CPD predictions that relative to the unprocessed ensemble have: 1.less variance 2.more warming north of 45 North for all scenarios except the RCP85 scenario 3.less warming otherwise – particularly for the RCP85 scenario