IPCC WG II + III Requirements for AR5 Data Management GO-ESSP Meeting, Paris, 11.-13.06.07 Michael Lautenschlager, Hans Luthardt World Data Center Climate.

Slides:

Advertisements

Similar presentations

Std-doi Publication of Climate Data at WDCC DataCite Summer Meeting 7./8. June 2010 Publication of climate data Heinke Höck World Data Center for Climate.

Advertisements

Preservation and Long Term Access of Data at the World Data Centre for Climate Frank Toussaint N.P. Drakenberg, H. Höck, M. Lautenschlager, H. Luthardt,

Long-term Archiving of Climate Model Data at WDC Climate and DKRZ Michael Lautenschlager WDC Climate / Max-Planck-Institute for Meteorology, Hamburg Data.

Data Portal for the “Climate changes Spatial Planning” program Henk Klein Baltink (KNMI) Fred Bosveld (KNMI) Hans de Wolf (Dutch Space)

M.Lautenschlager (WDCC/MPI-M) / / 1 The CEOP Model Data Archive at the World Data Center for Climate as part of the CEOP Data Network CEOP / IGWCO.

CERA / WDCC Hannes Thiemann Max-Planck-Institut für Meteorologie Modelle und Daten zmaw.de NCAR, October 27th – 29th, 2008.

Integrating SeaDOG into RODIN T. Le Bas, F. Venuti, H. Snaith, and B. Soall.

M. Stockhause et al. Martina Stockhause, Michael Lautenschlager, Frank Toussaint Deutsches Klimarechenzentrum (DKRZ) World Data Centre for Climate (WDCC)

M.Lautenschlager (WDCC / MPI-M) / / 1 WS Spatiotemporal Databases for Geosciences, Biomedical sciences and Physical sciences Edinburgh, November.

Preservation and Long Term Access of Data at the World Data Centre for Climate Frank Toussaint N.P. Drakenberg, H. Höck, S. Kindermann, M. Lautenschlager,

M.Lautenschlager (WDCC / MPI-M) / / 1 GO-ESSP at LLNL Livermore, June 19th – 21st, 2006 World Data Center Climate: Status and Portal Integration.

Obtaining MISR Data and Information Jeff Walter Atmospheric Science Data Center April 17, 2009.

Overview of the ODP Data Provider Sergey Sukhonosov National Oceanographic Data Centre, Russia Expert training on the Ocean Data Portal technology, Buenos.

M. Lautenschlager (M&D/MPIM)1 The CERA Database Michael Lautenschlager Modelle und Daten Max-Planck-Institut für Meteorologie Workshop "Definition.

Experience of a low-maintenance distributed data management system W.Takase 1, Y.Matsumoto 1, A.Hasan 2, F.Di Lodovico 3, Y.Watase 1, T.Sasaki 1 1. High.

Z EGU Integration of external metadata into the Earth System Grid Federation (ESGF) K. Berger 1, G. Levavasseur 2, M. Stockhause 1, and M. Lautenschlager.

Coordinated Energy and water-cycle Observations Peroject A Well Organized Data Archive System Data Integrating/Archiving Center at University of Tokyo.

TIGGE Archive Highlights. First Service Date ECMWF – October 2006 NCAR – October 2006 CMA – June 2007.

AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center.

CIM – The Common Information Model in Climate Research

Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski

F. Toussaint (WDCC, Hamburg) / / 1 CERA : Data Structure and User Interface Frank Toussaint Michael Lautenschlager World Data Center for Climate.

Michael Lautenschlager World Data Center Climate Model and Data / Max-Planck-Institute for Meteorology German Climate Computing Centre (DKRZ)

Bulk Metadata Structures in CERA Frank Toussaint, Michael Lautenschlager Max-Planck-Institut für Meteorologie World Data Center for Climate.

M.Lautenschlager (WDCC, Hamburg) / / 1 Semantic Data Management for Organising Terabyte Data Archives Michael Lautenschlager World Data Center.

AR5 Data and Product Access Architecture Concepts for Discussion Steve Hankin (NOAA/PMEL) (Not including metadata architecture or security)

M.Lautenschlager (WDCC, Hamburg) / / 1 Semantic Data Management for Organising Terabyte Data Archives Michael Lautenschlager World Data Center.

Long-term Archiving of Climate Model Data at WDC Climate and DKRZ Michael Lautenschlager WDC Climate / Max-Planck-Institute for Meteorology, Hamburg Wolfgang.

Data Access to Marine Surface Observations and Products from COADS 29 January, 2002 Steven Worley National Center for Atmospheric Research.

M.Lautenschlager (WDCC, Hamburg) / / 1 Training-Workshop Facilities and Sevices for Earth System Modelling Integrated Model and Data Infrastructure.

Data Publication and Quality Control Procedure for CMIP5 / IPCC-AR5 Data WDC Climate / DKRZ:

M.Lautenschlager (WDCC, Hamburg) / / 1 ICSU World Data Center For Climate Semantic Data Management for Organising Terabyte Data Archives Michael.

ICOADS: Update Status and Data Distribution Steven J. Worley Scott D. Woodruff Sandra J. Lubker Ziahua Ji J. Eric Freeman NCAR, NOAA/ESRL, NOAA/NCDC CLIMAR-III,

Technical and social requirements for a putative AR5 distributed database of simulation and other data Bryan Lawrence (obviously et.al.)

ESIP Federation 2004 : L.B.Pham S. Berrick, L. Pham, G. Leptoukh, Z. Liu, H. Rui, S. Shen, W. Teng, T. Zhu NASA Goddard Earth Sciences (GES) Data & Information.

Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.

Data Discovery and Access to The International Surface Pressure Databank (ISPD) 1 Thomas Cram Gilbert P. Compo* Doug Schuster Chesley McColl* Steven Worley.

IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.

The CERA2 Data Base Data input – Data output Hans Luthardt Model & Data/MPI-M, Hamburg Services and Facilities of DKRZ and Model & Data Hamburg,

- Vendredi 27 mars PRODIGUER un nœud de distribution des données CMIP5 GIEC/IPCC Sébastien Denvil Pôle de Modélisation, IPSL.

Michael Lautenschlager, Hannes Thiemann, Frank Toussaint WDC Climate / Max-Planck-Institute for Meteorology, Hamburg Joachim Biercamp, Ulf Garternicht,

H. Thiemann (M&D) / / 1 Hannes Thiemann M&D Statusseminar, 22. April 2004.

IPCC TGICA and IPCC DDC for AR5 Data GO-ESSP Meeting, Seattle, Michael Lautenschlager World Data Center Climate Model and Data / Max-Planck-Institute.

Obtaining MISR Data and Information Nancy Ritchey Atmospheric Science Data Center March 20, 2006.

Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.

The Repository of the World Data Centre for Climate Frank Toussaint, Michael Lautenschlager Max-Planck-Institut für Meteorologie Repositories in Research.

PSI Meta Data meeting, Toulouse - 15 November The CERA C limate and E nvironment data R etrieval and A rchiving system at MPI-Met / M&D S. Legutke,

WP6/SA2: Access to IS-ENES Data Federation SA2 is a European distributed data infrastructure providing access to data from ESM simulations produced in.

H. Widmann (M&D) Data Discovery and Processing within C3Grid GO-ESSP/LLNL / June, 19 th 2006 / 1 Data Discovery and Basic Processing within the German.

Lautenschlager + Thiemann (M&D/MPI-M) / / 1 Introduction Course 2006 Services and Facilities of DKRZ and M&D Integrating Model and Data Infrastructure.

Welcome to the PRECIS training workshop

Create XML from a template Browse available records WDCC Metadata Generation with GeoNetwork Hans Ramthun, Michael Lautenschlager, Hans-Hermann Winter.

British Atmospheric Data Centre ( Searching: Whither NDG? Bryan Lawrence.

TIGGE Archive Access at NCAR Steven Worley Doug Schuster Dave Stepaniak Hannah Wilcox.

Data Discovery and Access to The International Surface Pressure Databank (ISPD) 1 Thomas Cram Gilbert P. Compo* Doug Schuster Chesley McColl* Steven Worley.

Hannes Thiemann Michael Lautenschlager Deutsches Klimarechenzentrum GmbH, Germany EGU 2010.

M. Lautenschlager (M&D/MPIM)1 WDC on Climate as Part of the CERA 1 Database System Michael Lautenschlager Modelle und Daten Max-Planck-Institut.

Obtaining MISR Data Nancy Ritchey Atmospheric Sciences Data Center May 16, 2004.

What was done for AR4. Software developed for ESG was modified for CMIP3 (IPCC AR4) Prerelease ESG version 1.0 Modified data search Advance search Pydap.

The British Atmospheric Data Centre Alison Pamment Kevin Marsh.

CAS2K11 in Annecy, France September 11 – 14, 2011 Data Infrastructures at DKRZ Michael Lautenschlager.

1. Gridded Data Sub-setting Services through the RDA at NCAR Doug Schuster, Steve Worley, Bob Dattore, Dave Stepaniak.

2005 – 06 – - ESSP1 WDC Climate : Web Access to Metadata and Data Frank Toussaint World Data Center for Climate (M&D/MPI-Met, Hamburg)

AP7/AP8: Long-Term Archival of CMIP6 Data

World Conference on Climate Change October 24-26, 2016 Valencia, Spain

Data Citation Service for CMIP6 and IPCC DDC Aspects

MERRA Data Access and Services

TIGGE Data Archive and Access System at NCAR

Summary for Policymakers: Key Points AR5 – WG II

Presentation transcript:

IPCC WG II + III Requirements for AR5 Data Management GO-ESSP Meeting, Paris, Michael Lautenschlager, Hans Luthardt World Data Center Climate Model and Data / Max-Planck-Institute for Meteorology

M.Lautenschlager (WDCC / MPI-M) / / 2 Content Data Management in AR4 Requirements for AR5 Possible Contribution of WDC Climate

M.Lautenschlager (WDCC / MPI-M) / / 3 Data management in AR4 Data management shared between WG I data archive at PCMDI  CMOR as NetCDF file archive interface  Data dissemination by Earth System Grid (ESG) IPCC Data Distribution Centre (DDC) at WDC Climate (WDCC)  In operation since the IPCC SAR  Database system of WDCC with searchable catalogue (based on CERA metadata model) and data storage in DB tables as time series of individual variables Both archives provide web-based data access WG II + III list of variables matches WG I archive for monthly means but not for daily data and climate indices

M.Lautenschlager (WDCC / MPI-M) / / 4 PCMDI AR4 data catalogue

M.Lautenschlager (WDCC / MPI-M) / / 5 PCMDI AR4 data access

M.Lautenschlager (WDCC / MPI-M) / / 6 IPCC DDC AR4 data list

M.Lautenschlager (WDCC / MPI-M) / / 7 IPCC DDC AR4 data catalogue summary

M.Lautenschlager (WDCC / MPI-M) / / 8 IPCC DDC AR4 data access Full CERA metadata

M.Lautenschlager (WDCC / MPI-M) / / 9 CERA-2 Data Model CERA Data Model of WDCC Entry Reference Status Distribution Contact Coverage Parameter Spatial Reference Local Adm. Data Access Data Org

M.Lautenschlager (WDCC / MPI-M) / / 10 WDCC data storage and access granularity Model variables Model Run Time 2 D: small BLOBS (180 KB) 3 D: large BLOBS (3 MB) Raw data file: direct model output (1.3 – 16.2 GB) Each columm is one BLOB Table in CERA-DB Raw data file inDKRZ Archive

M.Lautenschlager (WDCC / MPI-M) / / 11 WG II + III Data and Information Requirements DDC user requests for SAR, TAR and AR4: Reduced data size  Regional subsets  Temporal subsets ‘simple’ data formats (e.g. ASCII, EXCEL) Data dissemination on media (CD, DVD, hard disc) Data visualization Advice on data applicability and data usage Availability of data processing tools

M.Lautenschlager (WDCC / MPI-M) / / 12 WG II + III Data and Information Requirements Data usage in WG II+III environment: Application of model data for solving questions on mitigation of and adaptation to climate changes and for vulnerability studies Applications fields of adaptation: tourism, agriculture, forestry, transportation, insurance, architecture, alternative energies….. Climate model data are used as information in addition to observations. Interdisciplinary data access where we cannot assume extensive experience about model data production, data structures and data formats Forcing data for regional / local models and for process models

M.Lautenschlager (WDCC / MPI-M) / / 13 WG II + III Data and Information Requirements Requirements for model data: Data products are expected and not model raw data Complete daily / sub-daily time series of individual variables, climate indices, climate extremes Requirements for metadata (browse + use): Searchable data repository including information to decide on the usefulness of the data entity (e.g. scenario, model, variable, etc.) Complete information to allow for data processing and use the model data (e.g. grid, variable, unit, time) Requirements for services: Instructions how to use the data Data processing options for aggregation and extraction in time and space and for visualization Specific user support (FAQs and s requests)

M.Lautenschlager (WDCC / MPI-M) / / 14 Possible Contribution of WDC Climate to AR5 WDCC plans to operate as one of the IPCC AR5 model data archives. WDCC plans to offer limited archive space and catalogue resources (CERA metadata) to store and to disseminate IPCC AR5 metadata and/or time series additionally to the Hamburg climate model. WDCC will continue IPCC DDC operations in cooperation with BADC (central archive of selected monthly mean time series and specific user support for WG II+III) WDCC data catalogue can be part of an IPCC AR5 data repository

M.Lautenschlager (WDCC / MPI-M) / / 15 WDCC metadata ISO Experiment DatasetExternal 3 DatasetExternal 2 DatasetExternal 1 http, grid, ftp, … WDCC metadata Experiment DatasetInternal 3 DatasetInternal 2 DatasetInternal 1 ISO User A1 B1 Possible Contribution of WDC Climate to AR5 Data download via WWW (http) of via script/batch (jdbc)