CMIP6 use case and adoption of RDA outputs

Slides:

Advertisements

Similar presentations

ARROW Plus is a Best Practice Network selected under the ICT Policy Support Programme (ICT PSP) DEMO or How does the ARROW system look.

Advertisements

Collaboration on Large Datasets using Globus Rachana Ananthakrishnan University of Chicago.

CLIMATE SCIENTISTS’ BIG CHALLENGE: REPRODUCIBILITY USING BIG DATA Kyo Lee, Chris Mattmann, and RCMES team Jet Propulsion Laboratory (JPL), Caltech.

Putting it all together for Digital Assets Jon Morley Beck Locey.

FILING SYSTEMS Research Data Management. Filing is more than saving files, it’s making sure you can find them later in your project. Naming Directory.

EdReNe Workshop London, 8th – 9th January 2008 Enhancing the LOM application profiles using the DOI AIE – Italian Publishers Association.

Z EGU Integration of external metadata into the Earth System Grid Federation (ESGF) K. Berger 1, G. Levavasseur 2, M. Stockhause 1, and M. Lautenschlager.

Metadata Concepts / Use in Climate Research Stephan Kindermann, Martina Stockhause German Climate Computing Center (DKRZ) Hamburg, Germany.

TWC Adoption of RDA DTR and PID in Deep Carbon Observatory Data Portal Stephan Zednik, Xiaogang Ma, John Erickson, Patrick West, Peter Fox, & DCO-Data.

Describe workflows used to maintain and provide the RDA to users – Both are 24x7 operations Transition to the NWSC with zero downtime NWSC is new environment.

1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.

Data Publication and Quality Control Procedure for CMIP5 / IPCC-AR5 Data WDC Climate / DKRZ:

Adoption of RDA-DFT Terminology and Data Model to the Description and Structuring of Atmospheric Data Aaron Addison, Rudolf Husar, Cynthia Hudson-Vitale.

Opportunities and constraints for development and translation of digital learning resources How difficult is it to translate or adjust existing digital.

RDA Data Foundation and Terminology (DFT) WG: Overview  Prepared for Collab Chairs Meeting, NIST, Nov 13-14, 2014  Gary Berg-Cross, Raphael Ritz, Peter.

Data Discovery and Access to The International Surface Pressure Databank (ISPD) 1 Thomas Cram Gilbert P. Compo* Doug Schuster Chesley McColl* Steven Worley.

NIST Data Science SymposiumMarch 4, 2014 NIST Data Science SymposiumMarch 4, Climate Archives in NOAA: Challenges and Opportunities March 4, 2014.

TWC Adoption of RDA DTR and PID in Deep Carbon Observatory Data Portal Stephan Zednik, Xiaogang Ma, John Erickson, Patrick West, Peter Fox, & DCO-Data.

1 Earth System Modeling Framework Documenting and comparing models using Earth System Curator Sylvia Murphy: Julien Chastang:

Research Grants and Projects Discovery Service ANDS Webinar 12th August 2015 Monica Omodei, ANDS.

Deepcarbon.net Xiaogang Ma, Patrick West, John Erickson, Stephan Zednik, Yu Chen, Han Wang, Hao Zhong, Peter Fox Tetherless World Constellation Rensselaer.

29 March 2004 Steven Worley, NSF/NCAR/SCD 1 Research Data Stewardship and Access Steven Worley, CISL/SCD Cyberinfrastructure meeting with Priscilla Nelson.

FRErator – the Bridge between FRE and Curator DB.

The Research Data Archive at NCAR: A System Designed to Handle Diverse Datasets Bob Dattore and Steven Worley National Center for Atmospheric Research.

End-to-End Data Services A Few Personal Thoughts Unidata Staff Meeting 2 September 2009.

Copyright © 2007, Oracle. All rights reserved. Using Document Management and Collaboration Appendix B.

Data Citation Implementation Pilot Workshop

TWC Adoption* of RDA DTR and PIT in the Deep Carbon Observatory Data Portal Xiaogang Ma, John Erickson, Patrick West, Stephan Zednik, Peter Fox, & the.

Using a Simple Knowledge Organization System to facilitate Catalogue and Search for the ESA CCI Open Data Portal EGU, 21 April 2016 Antony Wilson, Victoria.

A41I-0105 Supporting Decadal and Regional Climate Prediction through NCAR’s EaSM Data Portal Doug Schuster and Steve Worley National Center for Atmospheric.

The Earth System Curator Metadata Infrastructure for Climate Modeling Rocky Dunlap Georgia Tech.

Weigel, Berger, Kindermann, Lautenschlager EGU Versioning for CMIP6 in the Earth System Grid Federation Data preparation Initial registration.

EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number Federated Cloud Update.

Electronic Document Management By Portford Solutions Group, Inc.

1 This slide indicated the continuous cycle of creating raw data or derived data based on collections of existing data. Identify components that could.

Intentions and Goals Comparison of core documents from DFIG and Publishing Workflow IG show that there is much overlap despite different starting points.

Data Type Registries #2 Co-Chairs: RDA Chairs’ Mtg Gothenburg

Workshop on Brokering in Data Fabrics - community perspectives -

RDA WG on Dynamic Data Citation

RDA 9th Plenary Breakout 3, 5 April :00-17:30

AP7/AP8: Long-Term Archival of CMIP6 Data

EUDAT’s engagement with the Earth Sciences

A User’s Perspective on Acquisition and Management of CMIP5 Data

HDF5 for Real-Time and/or Embedded Test Data

The How and Why of DOI Assigning DOI’s to IR content

Data Ingestion in ENES and collaboration with RDA

Data Type Registries Breakout

Xiaogang Ma, John Erickson, Patrick West, Stephan Zednik, Peter Fox,

Research Data Collections WG Plenary 9 Barcelona

RDA Plenary 9 Breakout Session

VI-SEEM Data Repository

T-TAP for climate data RDA P10 Montréal – September 2017

Task 5 : Supporting CCI Contributions to Obs4MIPs

Using the RDA Collections API to Shape Humanities Data

LOD reference architecture

Agenda (AM) 9:30-10:15 Introduction to RDA

Please send any images as a separate file

Prepared by Peter Boško, Luxembourg June 2012

TT-eWIS/2018: WIS Catalogue

School of Information Studies, Syracuse University, Syracuse, NY, USA

Using Mapping Relations to Semi Automatically Compose Web Services

Recitation on AdFisher

Long-Lived Data Collections

Data Management Components for a Research Data Archive

RDA uptake activities and plans: ESGF

The Bentley Digital Media Library

Digital Object Management for ENES: Challenges and Opportunities

Robert Dattore and Steven Worley

Leveraging PIDs for object management in data infrastructures RDA UK Node Workshop, July Tobias Weigel (DKRZ)

Preprints and literature provenance in Europe PMC

Presentation transcript:

CMIP6 use case and adoption of RDA outputs PITs, typing, collections, brokering, fabric, ... RDA chairs meeting, NIST, Dec 12, 2016

Coupled Model Intercomparison Project (CMIP) Run by the World Climate Research Program to compare climate models to assess their differences, quality and uniqueness Simulation of agreed experiments based on common forcing data Large-scale activity involving many research groups Modelling data – not observational data 2016/12/12

Each phase of CMIP runs for several years CMIP phase 6: Current effort: CMIP6 Each phase of CMIP runs for several years Interconnection between CMIP and IPCC ARs CMIP phase 6: Data production expected to begin in 2017 Lasts 3 to 4 years (plus further usage of archives) Data volume in excess of 50 PB All CMIP6 files receive Handles and PITs according to a profile (this is already in place) multiple 100 millions of Handles 2016/12/12

Interconnection / browsing of data objects The PIDs are interlinked to keep track of the relationships between data objects: 2016/12/12

2016/12/12

2016/12/12

CMIP6 PIDs + Copernicus + Processing + ... Copernicus: European Earth Obs programme Existing processing solution Data processing for Copernicus: PID-based pilot planned Modelling data + Observational data 2016/12/12

T-TAP: Type-Triggered Automatic Processing netCDF files Aggregates <Metadata> (xml) Observational data Processing service (WPS) output well-defined ways to publish it (automatically) possible repacking into a container format PID or metadata actions multiple types, e.g. netcdf, xml, images, text reports, PROV record described in DTR script Broker 2016/12/12

Backup slides 2016/12/12

Test Handles / Landing page demo access To play with the landing page, please check out the test handle hdl:21.14100/f21e70e8-beda-3561-85e7-af42440026ac using any DOI resolver… http://hdl.handle.net/21.14100/f21e70e8-beda-3561-85e7-af42440026ac To view the contents of a handle record, please checkout http://hdl.handle.net/21.14100/f21e70e8-beda-3561-85e7-af42440026ac?noredirect 23.02.2019

Publication demo (Video – 1 minute, please use Chrome) https://esgf-fedtest.dkrz.de/api/f2fvideo/ The publisher automatically assigns PIDs to datasets and sends messages to RabbitMQ (console output) Messages are received by RabbitMQ (monitoring GUI) Watch how a user gets a PID for a custom set of datasets 23.02.2019