Advanced uncertainty evaluation of climate models and their future climate projections H Järvinen, P Räisänen, M Laine, J Tamminen, P Ollinaho Finnish.

Slides:



Advertisements
Similar presentations
© Crown copyright 2006Page 1 CFMIP II sensitivity experiments Mark Webb (Met Office Hadley Centre) Johannes Quaas (MPI) Tomoo Ogura (NIES) With thanks.
Advertisements

1 Evaluating climate model using observations of tropical radiation and water budgets Richard P. Allan, Mark A. Ringer Met Office, Hadley Centre for Climate.
Februar 2003 Workshop Kopenhagen1 Assessing the uncertainties in regional climate predictions of the 20 th and 21 th century Andreas Hense Meteorologisches.
Sensitivity Analysis In deterministic analysis, single fixed values (typically, mean values) of representative samples or strength parameters or slope.
An Evaluation of the Surface Radiation Budget Over North America for a Suite of Regional Climate Models Student: Marko Markovic Director: Colin Jones Université.
Markov-Chain Monte Carlo
By : Kerwyn Texeira. Outline Definitions Introduction Model Description Model Evaluation The effect of dust nuclei on cloud coverage Conclusion Questions.
Introduction to Sampling based inference and MCMC Ata Kaban School of Computer Science The University of Birmingham.
CHAPTER 16 MARKOV CHAIN MONTE CARLO
Use of Bayesian Methods for Markov Modelling in Cost Effectiveness Analysis: An application to taxane use in advanced breast cancer Nicola Cooper, Keith.
© Crown copyright Met Office Radiation developments Latest work on the radiation code in the Unified Model James Manners, Reading collaboration meeting.
Climate Forcing and Physical Climate Responses Theory of Climate Climate Change (continued)
The Radiative Budget of an Atmospheric Column in Tropical Western Pacific Zheng Liu Department of Atmospheric Science University of Washington.
National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Pasadena, California 1 Joao Teixeira, Brian.
YODEN Shigeo Dept. of Geophysics, Kyoto Univ., JAPAN March 3-4, 2005: SPARC Temperature Trend Meeting at University of Reading 1.Introduction 2.Statistical.
Cloud feedbacks in ECHAM5: preparatory results for CMIP5 Daniel Klocke Johannes Quaas, Marco Giorgetta Max-Planck-Institut für Meteorologie KlimaCampus,
Using ranking and DCE data to value health states on the QALY scale using conventional and Bayesian methods Theresa Cain.
Bayesian Analysis for Extreme Events Pao-Shin Chu and Xin Zhao Department of Meteorology School of Ocean & Earth Science & Technology University of Hawaii-
Robin McDougall, Ed Waller and Scott Nokleby Faculties of Engineering & Applied Science and Energy Systems & Nuclear Science 1.
Cloud Biases in CMIP5 using MISR and ISCCP simulators B. Hillman*, R. Marchand*, A. Bodas-Salcedo, J. Cole, J.-C. Golaz, and J. E. Kay *University of Washington,
1 Assessment of Imprecise Reliability Using Efficient Probabilistic Reanalysis Farizal Efstratios Nikolaidis SAE 2007 World Congress.
WSEAS AIKED, Cambridge, Feature Importance in Bayesian Assessment of Newborn Brain Maturity from EEG Livia Jakaite, Vitaly Schetinin and Carsten.
Exam I review Understanding the meaning of the terminology we use. Quick calculations that indicate understanding of the basis of methods. Many of the.
H. Shiogama 1, M. Watanabe 2, T Ogura 1, M. Yoshiomori 2, T Yokohata 1, J.D. Annan 3, J.C. Hargreaves 3, M. Abe 1, S. Emori 1, T. Nozawa 1, A. Abe-Ouchi.
Kalman Filter (Thu) Joon Shik Kim Computational Models of Intelligence.
Comparing droplet activation parameterisations against adiabatic parcel models using a novel inverse modelling framework Warsaw: April 20 th 2015: Eulerian.
Radiation Group 3: Manabe and Wetherald (1975) and Trenberth and Fasullo (2009) – What is the energy balance of the climate system? How is it altered by.
1 CERES Results Norman Loeb and the CERES Science Team NASA Langley Research Center, Hampton, VA Reception NASA GSFC, Greenbelt, MD.
3 May 2007 GIST May Professor John Harries, Professor John Harries, Space and Atmospheric Physics group, Blackett Laboratory, Imperial College,
Simulation techniques Summary of the methods we used so far Other methods –Rejection sampling –Importance sampling Very good slides from Dr. Joo-Ho Choi.
Z.-C. Guo P. Dirmeyer X. Gao M. Zhao __________________________________ The 85th AMS Annual Meeting, San Diego, CA, Jan. 11, 2005 The sensitivity of soil.
Molecular Systematics
Seasonal Cycle of Climate Feedbacks in the NCAR CCSM3.0 Patrick Taylor CLARREO Science Team Meeting July 7, 2010 Patrick Taylor CLARREO Science Team Meeting.
Morrison/Gettelman/GhanAMWG January 2007 Two-moment Stratiform Cloud Microphysics & Cloud-aerosol Interactions in CAM H. Morrison, A. Gettelman (NCAR),
A Preliminary Evaluation of the Global Water and Energy Budgets in an Upcoming NASA Reanalysis Junye Chen (1,2) and Michael G. Bosilovich (2) 1 ESSIC,
Boundary Layer Clouds.
Markov Chain Monte Carlo for LDA C. Andrieu, N. D. Freitas, and A. Doucet, An Introduction to MCMC for Machine Learning, R. M. Neal, Probabilistic.
Lecture #9: Introduction to Markov Chain Monte Carlo, part 3
Reducing MCMC Computational Cost With a Two Layered Bayesian Approach
New CRM diagnostics dedicated to convective parameterization J-I Yano P. Bechtold, J.-P. Chaboureau, F. Guichard, J.-L. Redelsperger and J.-P. Lafore LMD,
Representation of Subgrid Cloud-Radiation Interaction and its Impact on Global Climate Simulations Xinzhong Liang (Illinois State Water Survey, UIUC )
Ocean Surface heat fluxes
Uncertainty Quantification in Climate Prediction Charles Jackson (1) Mrinal Sen (1) Gabriel Huerta (2) Yi Deng (1) Ken Bowman (3) (1)Institute for Geophysics,
© Crown copyright Met Office Uncertainties in the Development of Climate Scenarios Climate Data Analysis for Crop Modelling workshop Kasetsart University,
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
Joint AMWG/CVWG Workshop March 6-7, 2003 Improvements in Radiation Processes Bill Collins Andrew Conley, David Fillmore, Julia.
Gil McVean, Department of Statistics Thursday February 12 th 2009 Monte Carlo simulation.
CCSM AMWG Meeting June 25, 2003 Status of CAM Bill Collins and Leo Donner National Center for Atmospheric Research and Geophysical Fluid Dynamics Laboratory.
Radiative-Convective Model. Overview of Model: Convection The convection scheme of Emanuel and Živkovic-Rothman (1999) uses a buoyancy sorting algorithm.
Heating of Earth's climate continues in the 2000s based upon satellite data and ocean observations Richard P. Allan 1, N. Loeb 2, J. Lyman 3, G. Johnson.
Density Estimation in R Ha Le and Nikolaos Sarafianos COSC 7362 – Advanced Machine Learning Professor: Dr. Christoph F. Eick 1.
1 Changes in global net radiative imbalance Richard P. Allan, Chunlei Liu (University of Reading/NCAS Climate); Norman Loeb (NASA Langley); Matt.
Shortwave and longwave contributions to global warming under increased CO 2 Aaron Donohoe, University of Washington CLIVAR CONCEPT HEAT Meeting Exeter,
LIMITLESS POTENTIAL | LIMITLESS OPPORTUNITIES | LIMITLESS IMPACT Copyright University of Reading CURRENT CHANGES IN EARTH’S ENERGY IMBALANCE
Limitations of ’column physics’ for radiation computations in atmospheric models Bent H Sass Danish Meteorological Institute 1 May 2009 As the horizontal.
A New Climatology of Surface Energy Budget for the Detection and Modeling of Water and Energy Cycle Change across Sub-seasonal to Decadal Timescales Jingfeng.
Generalization Performance of Exchange Monte Carlo Method for Normal Mixture Models Kenji Nagata, Sumio Watanabe Tokyo Institute of Technology.
Markov Chain Monte Carlo in R
Introduction to Sampling based inference and MCMC
Reducing Photometric Redshift Uncertainties Through Galaxy Clustering
Investigating Cloud Inhomogeneity using CRM simulations.
Radiative biases in Met Office global NWP model
The Interannual variability of the Arctic energy budget
The absorption of solar radiation in the climate system
Energy accumulation and surface warming
Where has the warming gone?
Reconciling Ocean Heating and
Stochastic Methods.
Presentation transcript:

Advanced uncertainty evaluation of climate models and their future climate projections H Järvinen, P Räisänen, M Laine, J Tamminen, P Ollinaho Finnish Meteorological Institute A Ilin, E Oja Aalto University School of Science and Technology, Finland A Solonen, H Haario Lappeenranta University of Technology, Finland

Closure parameters Appear in physical parameterization schemes where some unresolved variables are expressed by predefined parameters rather than being explicitly modelled Span a low-dimensional non-linear estimation problem Currently: best expert knowledge is used to specify the optimal closure parameter values, based on observations, process studies, model simulations, etc. Important when: (1) Fine-tuning climate models to the present climate (2) Replacing parameterization schemes with new ones 2/19

3/19 Markov chain Monte Carlo (MCMC) Consecutive model simulations while updating the model parameters by Monte Carlo sampling Proposal step (parameter values drawn from a proposal distribution) Acceptance step (evaluate the objective function and accept/reject the proposal) “A random walk” in the parameter space (a Markov chain) and exploration of the Bayesian posterior distribution Not optimization... Instead, a full multi-dimensional parameter probability distribution is recovered

4/19 MH (non-adaptive) AM DRAM (adaptive)

ECHAM5 closure parameters CAULOC = influencing the autoconversion of cloud droplets (rain formation, stratiform clouds) CMFCTOP = relative cloud mass flux at level above non- buoyancy (in cumulus mass flux scheme) CPRCON = a coefficient for determining conversion from cloud water to rain (in convective clouds) ENTRSCV = entrainment rate for shallow convection 5/19

ECHAM5 simulations Markov chain in the 4-parameter space One year simulation with the T21L19 ECHAM5 model repeated many times with perturbed parameters Several objective function were tested All formulations: Top-of-Atmosphere (ToA) net radiative flux 6/19

7/19 Global-annual mean net flux in ECHAM5 Global-annual mean net flux in CERES data (0.9 W m -2 ) Interannual standard deviation In ERA40 reanalysis (0.53 Wm -2 ) Monthly zonal-mean values Interannual std. dev. of monthly zonal means

8/19 Global-annual mean net flux in ECHAM5 Global-annual mean net flux in CERES data (0.9 W m -2 ) Interannual standard deviation In ERA40 reanalysis (0.53 Wm -2 ) Monthly zonal-mean values Interannual std. dev. of monthly zonal means Small cost function implies model to be close to CERES data - global annual-mean net radiation - annual cycle of zonal mean net radiation

9/19 Longwave Shortwave Cost function CERES observations Global annual mean ToA radiative flux Net cost =cost GLOBAL + cost ZONAL

10/19 Longwave Shortwave Cost function Default model Net cost =cost GLOBAL + cost ZONAL

11/19 Longwave Shortwave The cost function only included net ToA radiation … both the LW and SW biases decreased Cost function Net

ECMWF seminar /46

ECMWF seminar /46 = default value

T42L31 :: Cloud ice particles, SW scattering 14/19 CAULOCCMFCTOPCPRCONENTRSCV CPRCONENTRSCVCMFCTOP ZASIC CAULOCZINPARZINHOMI

Uncertainty of future climate projections (principle) Climate sensitivity :: Change in T surf due to 2 × CO2 Sample from the closure parameter posterior PDF’s Perform a climate sensitivity run with each model Result: a proper PDF of climate sensitivity - conditional on the selected closure parameters and cost function 15/19

Practical problem: at T21L19, ECHAM5 is hypersensitive! 16/19 Warming  8.9 K when model crashes! Warming  9.6 K when model crashes!! Global-mean temperature (K)

Conclusions (so far) 17/19 Can we use MCMC for parameter estimation in climate models? Yes, we can!But … 2) It is computationally expensive - chain lengths of > 1000 model runs are needed 1) Choice of the cost function is critical

Means to fight the computational expense Adaptive MCMC parallel MCMC chains (  reduced wallclock time) re-use of chains (off-line tests of new cost functions through ”importance sampling”) Early rejection scheme … 18/19 Cumulative cost function Month Rejection limit

Many thanks 19/19