Intro to CMIP, the WHOI CMIP5 community server, and planning for CMIP6

Slides:



Advertisements
Similar presentations
CMIP6 and how observations can inform evaluation
Advertisements

CMIP5: Overview of the Coupled Model Intercomparison Project Phase 5
RAMADDA for Big Climate Data Don Murray NOAA/ESRL/PSD and CU-CIRES Boulder/Denver Big Data Meetup - June 18, 2014.
® OGC Web Services Initiative, Phase 9 (OWS-9): Innovations Thread - OPeNDAP James Gallagher and Nathan Potter, OPeNDAP © 2012 Open Geospatial Consortium.
CLIMATE SCIENTISTS’ BIG CHALLENGE: REPRODUCIBILITY USING BIG DATA Kyo Lee, Chris Mattmann, and RCMES team Jet Propulsion Laboratory (JPL), Caltech.
Overview of Coupled Model Intercomparison Project (CMIP) and IPCC AR5 Activities Ronald J Stouffer Karl Taylor, Jerry Meehl and many others June 2009.
TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.
HTML Comprehensive Concepts and Techniques Intro Project Introduction to HTML.
Week 11 Further Web Design Concepts and Tools FTP, CMS, Wordpress and Responsive Web Design.
CORDEX Scope, or What is CORDEX?  Provide a set of regional climate scenarios (including uncertainties) covering the period , for the majority.
The Decadal Climate Prediction Project (DCPP) G.J. Boer CANSISE WEST Victoria, May 9, 2014.
HOW WEB SERVER WORKS? By- PUSHPENDU MONDAL RAJAT CHAUHAN RAHUL YADAV RANJIT MEENA RAHUL TYAGI.
CORDEX South-Asia 2 nd Science and Training Workshop Katmandu, Nepal M. Rixen, WCRP JPS 27 August
Hour 7 The Application Layer 1. What Is the Application Layer? The Application layer is the top layer in TCP/IP's protocol suite Some of the components.
Climate Modeling Jamie Anderson May Monitoring tells us how the current climate has/is changing Climate Monitoring vs Climate Modeling Modeling.
R.Sutton RT4 coordinated experiments Rowan Sutton Centre for Global Atmospheric Modelling Department of Meteorology University of Reading.
The New Zealand Institute for Plant & Food Research Limited Use of Cloud computing in impact assessment of climate change Kwang Soo Kim and Doug MacKenzie.
(Mt/Ag/EnSc/EnSt 404/504 - Global Change) Future Directions (for the AR5) Future Directions in Globally Coordinated Climate Change Research Primary Sources:
© Crown copyright Met Office AR5 Proposed runs for CMIP5 John Mitchell, after Karl Taylor, Ron Stouffer and others ENES, arch 2009.
Climate Change Working Group (CCWG) July, 2004 Co-chairs: Gerald A. Meehl, Ben Santer, and Warren Washington.
ESG Observational Data Integration Presented by Feiyi Wang Technology Integration Group National Center of Computational Sciences.
IPCC TGICA and IPCC DDC for AR5 Data GO-ESSP Meeting, Seattle, Michael Lautenschlager World Data Center Climate Model and Data / Max-Planck-Institute.
Office of Research and Development National Exposure Research Laboratory, Atmospheric Modeling and Analysis Division Using Dynamical Downscaling to Project.
May 6, 2002Earth System Grid - Williams The Earth System Grid Presented by Dean N. Williams PI’s: Ian Foster (ANL); Don Middleton (NCAR); and Dean Williams.
1 Adventures in Web Services for Large Geophysical Datasets Joe Sirott PMEL/NOAA.
1 Accomplishments. 2 Overview of Accomplishments  Sustaining the Production Earth System Grid Serving the current needs of the climate modeling community.
SCD Research Data Archives; Availability Through the CDP About 500 distinct datasets, 12 TB Diverse in type, size, and format Serving 900 different investigators.
Welcome to the PRECIS training workshop
David M. Legler U.S. CLIVAR Office U.S. Climate Variability and Predictability Program usclivar.org CLIVAR Welcome Climate Diagnostics.
Data Discovery and Access to The International Surface Pressure Databank (ISPD) 1 Thomas Cram Gilbert P. Compo* Doug Schuster Chesley McColl* Steven Worley.
Distributed Data Servers and Web Interface in the Climate Data Portal Willa H. Zhu Joint Institute for the Study of Ocean and Atmosphere University of.
Support to scientific research on seasonal-to-decadal climate and air quality modelling Pierre-Antoine Bretonnière Francesco Benincasa IC3-BSC - Spain.
Regional Climate, Extremes, and Impacts presented by Andrew Wittenberg NOAA/GFDL Regional temperature trends, and the 2012 MAM warm anomaly over the eastern.
The Community Climate System Model (CCSM): An Overview Jim Hurrell Director Climate and Global Dynamics Division Climate and Ecosystem.
AOLI 2015 The NMME Experience: A Research Community Archive Lessons learned from Climate Model data archive and use AOLI Meeting 2015 Eric Nienhouse NCAR.
1. Gridded Data Sub-setting Services through the RDA at NCAR Doug Schuster, Steve Worley, Bob Dattore, Dave Stepaniak.
A41I-0105 Supporting Decadal and Regional Climate Prediction through NCAR’s EaSM Data Portal Doug Schuster and Steve Worley National Center for Atmospheric.
Desktop Database and Climate Analysis Steven Burian and Erfan Goharian Hydroinformatics Fall 2013.
RAL, 2012, May 11 Research behaviour Martin Juckes, 11 May, 2012.
1 This slide indicated the continuous cycle of creating raw data or derived data based on collections of existing data. Identify components that could.
1 Chapter 1 INTRODUCTION TO WEB. 2 Objectives In this chapter, you will: Become familiar with the architecture of the World Wide Web Learn about communication.
CMIP6 Catherine Senior C Senior, WGRC Montevideo, 14th March 2014
Data Browsing/Mining/Metadata
(Network Common Data Form)
Chapter 1 Introduction to HTML
NSIDC DAAC UWG Meeting August 9-10 Boulder, CO
World Conference on Climate Change October 24-26, 2016 Valencia, Spain
Evolution of Internet.
E-commerce | WWW World Wide Web - Concepts
E-commerce | WWW World Wide Web - Concepts
S2S sub-project on verification (and products)
MATLAB, netCDF, and OPeNDAP
Ronald J Stouffer Karl Taylor, Jerry Meehl and many others
Climate projections for the watershed of the Delaware Estuary
CCSM3’s IPCC Simulations and Lessons Learned
CLIVAR International Climate of the 20th Century (C20C) Project
National Center for Atmospheric Research
Discussion Session: FAMOS, Oct. 2013
Task 5 : Supporting CCI Contributions to Obs4MIPs
Around 10 Terabites have been already allocated to the CHFP dataserver at CIMA
Decadal prediction in the Pacific
School of Information Studies, Syracuse University, Syracuse, NY, USA
Proposed WCRP Grand Challenge on Near Term Climate Prediction
What is our Vision for Decadal
Beyond
Data Management Components for a Research Data Archive
What is our Vision for Decadal
Digital Object Management for ENES: Challenges and Opportunities
Process oriented evaluation of coupled climate-carbon cycle models
Presentation transcript:

Intro to CMIP, the WHOI CMIP5 community server, and planning for CMIP6 Caroline Ummenhofer, PO Overview Background on IPCC & CMIP WHOI CMIP5 server Available model output How to access files Planning for CMIP6

Intergovernmental Panel on Climate Change Panel of scientists that synthesizes published research on climate change including observations, modeling, and paleoclimate 1990 First Assessment Report (FAR) 1995 Second Assessment Report (SAR) 2001 Third Assessment Report (TAR) 2007 Fourth Assessment Report (AR4) 2013/14 Fifth Assessment Report (AR5) CMIP1 & CMIP2 CMIP3 CMIP5 Coupled Model Intercomparison Project Defines the set of standard experiments (with IPCC guidance) Coordinates with modeling groups around the world who choose to participate Groups run the specified set of experiments with their model and contribute the output to the CMIP data base following protocols for uniform data conventions

Evolution of climate models Courtesy of Kris Karnauskas

Evolution of climate models Courtesy of Kris Karnauskas

Evolution of climate models More complex climate models & finer resolution allows shift from physics of climate science to more impacts-driven research (focusing on end-users etc IPCC AR4

Computational resources – CMIP3-5 CMIP3: 17 institutes (groups) and 25 models (40 TB) Total years simulated: 70,000 Individual models simulated 500 to 8,400 years (mean: 2,800 yr) Individual groups simulated on average 70,000/17 = 4,100 yr CMIP5: 26 institutes (groups) and 60 models (2 PB) Total years simulated: 330,000 (estimate Oct 2014) Individual models simulated on average 330,000/60 = 5,500 yr Individual groups estimated on average 330,000/26 = 13,000 yr According to Taylor & Balaji (2015)

CMIP5 experiments Taylor et al. (2012)

Taylor et al. (2012)

http://cmip5.whoi.edu/ Selected model output available: √ All available models √ Experiments of broad interest to WHOI community (past, present, future) X Multiple ensemble members √ Comprehensive set of ocean variables (selected atmosphere, land, sea-ice, BGC) √ Monthly physical variables √ Annual selected BGC variables X high-frequency variables (e.g., daily) Storage requirements ultimately limiting factor at this stage Feedback from users about interest in additional data

Remind about the arbitrariness of time (interannual variability) in some of these experiments.

Available data paleo future

Available data

How to find data

Data access methods Advanced Dataset Search File Transfer Protocol (FTP) - host: ftp://cmip5.whoi.edu/ - username: anonymous or ftp Hypertext Transfer Protocol (HTTP) http://cmip5.whoi.edu/data/ Network File System (NFS) Mount - hostname: //cmip5.whoi.edu/ Copy files to local storage + Easy to access/search & download files + Ability to modify files - Local storage requirements Access files as if located locally, but without local storage requirement + No local storage requirements - Files are read-only Detailed step-by-step instructions on webpage Access only works internally (or via VPN)

CMIP6 experiments and beyond continuity through DECK simulations additional experiments to address specific scientific questions

• Diagnosis, Evaluation and Characterization of Klima (DECK) – benchmark CMIP runs  Include: - AMIP (~1979-2014) - Pre-industrial control - 1%/yr CO2 increase - Abrupt change to 4xCO2  Performed whenever a new model is developed (no deadlines)  “Entry card” for participation in CMIP • Historical run  Historical forcing updated for each CMIP phase  Required for CMIP6 participants • CMIP6-endorsed MIPs – addressing specific science issues  Modeling groups will choose to participate in a subset, depending on scientific interest and resources According to Taylor & Balaji (2015)

CMIP6 experiments and philosophy Courtesy of Denvil (2015)

Computational resources – CMIP6 CMIP3: 17 institutes (groups) and 25 models (40 TB) Total years simulated: 70,000 Individual models simulated 500 to 8,400 years (mean: 2,800 yr) Individual groups simulated on average 70,000/17 = 4,100 yr CMIP5: 26 institutes (groups) and 60 models (2 PB) Total years simulated: 330,000 (estimate Oct 2014) Individual models simulated on average 330,000/60 = 5,500 yr Individual groups estimated on average 330,000/26 = 13,000 yr CMIP6: length of simulations similar to CMIP5, but higher resolution models, larger ensemble sizes, more diverse experiment structure x50  4.3 Mio files Factor of 20: 36 PB in 86 Mio files Factor of 50: 90 PB in 215 Mio files Careful planning required to determine subset of CMIP6 model output to best serve WHOI community According to Taylor & Balaji (2015) and Denvil (2015)

Data access methods Advanced Dataset Search File Transfer Protocol (FTP) - host: ftp://cmip5.whoi.edu/ - username: anonymous or ftp - Via command line interface - Via ftp client (FileZilla, WinSCP…) - Via web browser

Data access methods Advanced Dataset Search File Transfer Protocol (FTP) - host: ftp://cmip5.whoi.edu/ - username: anonymous or ftp Hypertext Transfer Protocol (HTTP) http://cmip5.whoi.edu/data/

Data access methods Advanced Dataset Search File Transfer Protocol (FTP) - host: ftp://cmip5.whoi.edu/ - username: anonymous or ftp Hypertext Transfer Protocol (HTTP) http://cmip5.whoi.edu/data/ Network File System (NFS) Mount - hostname: \\cmip5.whoi.edu/ - sharename: data - domain: WORKGROUP

What does model output look like Data format: netCDF (network Common Data Format) platform independent data format particularly useful for array-oriented scientific data libraries for many different software products incorporates metadata

What does model output look like Data format: netCDF (network Common Data Format) platform independent data format particularly useful for array-oriented scientific data libraries for many different software products incorporates metadata Gridded (at varying resolution) Multi-dimensional: e.g. thetao (time, depth, lat, lon) Supported by Matlab, R, IDL, NCL (amongst many others)

How to read netcdf files in Matlab http://www.unidata.ucar.edu/software/netcdf/software.html CSIRO Matlab/netCDF Interface MEXNC and SNCTOOLS (a Matlab interface) - nctoolbox (a MATLAB common data model interface)

How to read netcdf files in Matlab MATLAB provides the following simple to use functions to read, write and create NetCDF data files. ncdisp - Display contents of a NetCDF file in the command window. ncread - Read data from a variable in a NetCDF file. ncreadatt - Read an attribute value from a NetCDF file. ncwrite - Write data to a NetCDF file. ncwriteatt - Write an attribute to a NetCDF file. ncinfo - Return information about a NetCDF file. nccreate - Create a variable in a NetCDF file. ncwriteschema - Add NetCDF schema definitions to a NetCDF file.

Assessing 21st century change with CMIP5 models – general approaches Assess how well do models reproduce a certain metric in present-day climate conditions? Compare to different observational/reanalysis products What might affect/cause certain biases? How does a metric change in future? In all models/those models with a better representation of current/past climatic conditions? Is the change consistent across models? (Multi-model mean vs individual models) What drives projected change in metric? What mechanisms can explain projected changes? How sensitive are projected changes to model physics?