CIM – The Common Information Model in Climate Research

Slides:



Advertisements
Similar presentations
OAForum – September 2003 Muriel Foulonneau Open Archives Initiatives Protocol for Metadata Harvesting Practices for the cultural heritage sector Muriel.
Advertisements

White Paper on Establishing an Infrastructure for Open Language Archiving Steven Bird and Gary Simons.
DRIVER Step One towards a Pan-European Digital Repository Infrastructure Norbert Lossau Bielefeld University, Germany Scientific coordinator of the Project.
Shoaib Sufi CCLRC e-Science Centre CCLRC Scientific Metadata (CSMD) Model April 2004 NESC.
UKOLN is supported by: JISC Information Environment update Repositories and Preservation Programme meeting, October 24-25, 2006 Rachel Heery UKOLN
ESGF and ES-DOC Documenting climate models and their simulations ES-DOC current and future plans Working with ESGF Eric Guilyardi, Balaji, Cecelia DeLuca,
Information Modelling MOLES Metadata Objects for Linking Environmental Sciences S. Ventouras Rutherford Appleton Laboratory.
Preservation and Long Term Access of Data at the World Data Centre for Climate Frank Toussaint N.P. Drakenberg, H. Höck, M. Lautenschlager, H. Luthardt,
M. Lautenschlager, H. Ramthun 1 Metafor Review 5 / 2010.
Bryan Lawrence on behalf of BADC, BODC, CCLRC, PML and SOC The British Atmospheric Data Centre and the NERC DataGrid (for) [ ]=
The Open Archives Initiative Simeon Warner (Cornell University) Symposium on “Scholarly Publishing and Archiving on the Web”, University.
NERC Data Grid Helen Snaith and the NDG consortium …
METAFOR and the role of standards To be presented at First DRIVER Summit SUB Göttingen, 16th-17th January th e-Infrastructure Concertation Event.
M.Lautenschlager (WDCC / MPI-M) / / 1 GO-ESSP at LLNL Livermore, June 19th – 21st, 2006 World Data Center Climate: Status and Portal Integration.
M. Lautenschlager (M&D/MPIM)1 The CERA Database Michael Lautenschlager Modelle und Daten Max-Planck-Institut für Meteorologie Workshop "Definition.
Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.
Z EGU Integration of external metadata into the Earth System Grid Federation (ESGF) K. Berger 1, G. Levavasseur 2, M. Stockhause 1, and M. Lautenschlager.
Eric Guilyardi (LOCEAN/IPSL and Univ. Reading) and the Metafor team Common Metadata for Climate Modelling Digital Repositories IS-ENES kick-off meeting.
1 Eric Guilyardi and the Metafor team Common Metadata for Climate Modelling Digital Repositories Metafor Dissemination Workshop Abingdon, 14 March 2011.
IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
Metafor Year 2 review: 29 th April 2010 Work Package 7 – Training and Dissemination.
NE II NOAA Environmental Software Infrastructure and Interoperability Program Cecelia DeLuca Sylvia Murphy V. Balaji GO-ESSP August 13, 2009 Germany NE.
Bryan Lawrence on behalf of BADC, BODC, CCLRC, PML and SOC An Introduction to NDG concepts [ ]=
Metadata Concepts / Use in Climate Research Stephan Kindermann, Martina Stockhause German Climate Computing Center (DKRZ) Hamburg, Germany.
ATMOSPHERIC SCIENCE DATA CENTER ‘Best’ Practices for Aggregating Subset Results from Archived Datasets Walter E. Baskin 1, Jennifer Perez 2 (1) Science.
NOCS, PML, STFC, BODC, BADC The NERC DataGrid = Bryan Lawrence Director of the STFC Centre for Environmental Data Archival (BADC, NEODC, IPCC-DDC.
Michael Lautenschlager World Data Center Climate Model and Data / Max-Planck-Institute for Meteorology German Climate Computing Centre (DKRZ)
Data Publication and Quality Control Procedure for CMIP5 / IPCC-AR5 Data WDC Climate / DKRZ:
WDC-MARE – World Data Center for Marine Environmental Sciences Data portal based on Open Archives Initiative Protocols and Apache Lucene Uwe Schindler,
Questionnaire Project Plan Alpha development Beta development Release for CMIP5 approval Production Phase After CMIP5 Questionnaire 01 Jan 2010 – 30 Dec.
Principle Investigator : Eric Guilyardi IPSL/Reading Lois Steenman-Clark NCAS, University of Reading Leader of METAFOR Work Package 2 GO-ESSP Seattle 2008.
Sarah Callaghan 1, Eric Guilyardi 2, Charlotte Pascoe 3 and the Metafor Project Team 1 BADC- UK, 2 University of Reading, UK.
- Vendredi 27 mars PRODIGUER un nœud de distribution des données CMIP5 GIEC/IPCC Sébastien Denvil Pôle de Modélisation, IPSL.
Page 1© Crown copyright 2004 FLUME Metadata Steve Mullerworth 3 rd -4 th October May 2006.
Portable Infrastructure for the Metafor Metadata System Charlotte Pascoe 1, Gerry Devine 2 1 NCAS-BADC, 2 NCAS-CMS University of Reading PIMMS provides.
IPCC TGICA and IPCC DDC for AR5 Data GO-ESSP Meeting, Seattle, Michael Lautenschlager World Data Center Climate Model and Data / Max-Planck-Institute.
Funded by: © AHDS Preservation in Institutional Repositories Preliminary conclusions of the SHERPA DP project Gareth Knight Digital Preservation Officer.
INFSO-RI Enabling Grids for E-sciencE Intelligent Distributed Data Management in Earth System Science S. Kindermann, DKRZ, Germany.
Metadata and OAI DLESE OAI Workshop April 29-30, 2002 Katy Ginger Presentation available at:
Metadata and OAI DLESE OAI Workshop June 29 to July 2, 2002 Katy Ginger Presentation available at:
Page 1© Crown copyright 2004 FLUME Marco Christoforou, Rupert Ford, Steve Mullerworth, Graham Riley, Allyn Treshansky, et. al. 19 October 2007.
Lautenschlager + Thiemann (M&D/MPI-M) / / 1 Introduction Course 2006 Services and Facilities of DKRZ and M&D Integrating Model and Data Infrastructure.
1 Accomplishments. 2 Overview of Accomplishments  Sustaining the Production Earth System Grid Serving the current needs of the climate modeling community.
Sarah Callaghan 1, Gerry Devine 2, Eric Guilyardi 3, Bryan Lawrence 1, Charlotte Pascoe 1, Lois Steenman-Clark 2 and the Metafor Project Team 1 NCAS-BADC;
1 Gateways. 2 The Role of Gateways  Generally associated with primary sites in ESG-CET  Provides a community-facing web presence  Can be branded as.
Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.
Curator: Gap Analysis (from a schema perspective) Rocky Dunlap Spencer Rugaber Georgia Tech.
Create XML from a template Browse available records WDCC Metadata Generation with GeoNetwork Hans Ramthun, Michael Lautenschlager, Hans-Hermann Winter.
WP4 - Strengthening the European Network on Earth System Modelling IS-ENES kick-off meeting – March 30-31, Paris Partners and general objectives CERFACS.
The Modeling Circle Courtesy M. Lautenschlager, DKRZ.
NESC Worshop – 07 September 2005 Development of a Marine Metadata Standard Greg Reed Executive Officer Australian Ocean Data Centre Joint Facility.
4 th WCRP Observations and Assimilation Panel Meeting Hamburg, Germany, March 29-31, Workshop on Ensuring Access and Trustworthiness of Climate.
IPCC WG II + III Requirements for AR5 Data Management GO-ESSP Meeting, Paris, Michael Lautenschlager, Hans Luthardt World Data Center Climate.
Application of RDF-OWL in the ESG Ontology Sylvia Murphy: Julien Chastang: Luca Cinquini:
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
1 Alison Pamment, 2 Calum Byrom, 1 Bryan Lawrence, 3 Roy Lowry 1 NCAS/BADC,Science and Technology Facilities Council, 2 Tessella plc, 3 British Oceanogrphic.
Using a Simple Knowledge Organization System to facilitate Catalogue and Search for the ESA CCI Open Data Portal EGU, 21 April 2016 Antony Wilson, Victoria.
ECMWF 24 th November 2008 Deploying secure OGC services in front of a heterogeneous data archive. Bryan Lawrence, Phil Kershaw, Dominic Lowe, and Stephen.
The Earth System Curator Metadata Infrastructure for Climate Modeling Rocky Dunlap Georgia Tech.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
Developing our Metadata: Technical Considerations & Approach Ray Plante NIST 4/14/16 NMI Registry Workshop BIPM, Paris 1 …don’t worry ;-) or How we concentrate.
Metafor Year 3 Meeting, March 2011 Governance. Metafor Year 3 Meeting, March 2011 What does metafor leave behind? The CIM –UML –XSD –Vocbularies (mindmaps)
Metafor Year 3 EU Review CIM Component Services. Of itself an Ontology is an inert artefact, i.e. a dictionary. CON-CIM Conceptual CIM.
NIST Office of Data and Informatics (ODI) of the Material Measurement Laboratory Robert Hanisch, director Ray Plante, interoperability expert ODI has responsibility.
AP7/AP8: Long-Term Archival of CMIP6 Data
Mapping the Network Landscape Ivette Serral
Common Framework for Earth Observation Data
VI-SEEM Data Repository
Session 2: Metadata and Catalogues
Presentation transcript:

CIM – The Common Information Model in Climate Research Michael Lautenschlager, Hans Ramthun (World Data Center Climate / Max-Planck-Institute for Meteorology) and METAFOR Project Team Networking Event for European Research Infrastructures + Standards Workshop October 1 – 2, 2009, Helsinki

Started March 2008, duration 3 years METAFOR Partner 11 partners Started March 2008, duration 3 years NCAS, University of Reading, UK (Coordinator) BADC, Science and Technology Facilities Council, UK CERFACS, France Model and Data, Max Planck Institute for Meteorology, Germany Institute Pierre-Simon Laplace, CNRS, France University of Manchester, UK Met Office, UK Administratia Nationala de Meterologie, Romania Météo France, CNRM, France CLIMPACT, France CICS, Princeton University, USA

METAFOR Objectives Create a standard metadata Common Information Model (CIM) to describe climate data and the models and experiments that produced those data Allows essential data, model and experiment distinctions to be understood Builds on existing metadata standards used internationally in climate (CF, CDML, CSML, Curator, NMM, FLUME, ISO etc.) Uses existing format and framework (XML, RDF, etc.)

METAFOR Objectives Develop, deploy, and evaluate a prototype infrastructure that will allow key data and models to be discovered and compared between distributed digital repositories single sign-on services to populate and manipulate, the CIM metadata services exploit NDG CSML to provide a common Geographic Markup Language interface to climate data centralized CIM content harvested from individual repositories using OAI-PMH (Open Archives Initiative Protocol for Metadata Harvesting).

METAFOR standards definition International Emerging Community Discovery metadata ISO 19139 ISO 19115 Climate Modelling gridspec - model discretisation Sensor ML - observations NMM - model description CERA2 - data management Data CF for netcdf Metafor will coordinate filling of metadata gaps mapping to different standards aggregating the metadata creating new standards (if necessary)

Identified Metadata Gaps Existing metadata models in Earth system modeling provide description of model output. This description is complete with respect to browse, search, identify and use Earth system model results. Identified gaps in existing metadata models for Earth system modelling are: Provennance information and Structured, searchable description of numerical models

METAFOR CIM schematic view Shared pkg Grids pkg Quality pkg Data pkg Software pkg Activity pkg CIM schema is found here: http://metaforclimate.eu/trac/browser/CIM

METAFOR Model, Experiment & Data Software / Model (ECHAM5, HiGEM, OASIS,...) is described by CIM stereotype Software / Model modelComponent processorComponent deployment Activity / Experiment dataProcessing ensemble numericalExperiment simulationComposite simulationRun Data dataObject gridSpec Activity / Experiments Data Relationship between all components

METAFOR CV, Software Class (CV types) modelComponent: Atmosphere AtmosphericChemistry LandIce SeaIce Ocean OceanBiogeochemistry LandSurface Coupling (Reggriding)

Metafor CV, Software Class, Athmosphere More complex vocabularies in subsequent hierachy layers

Method of CV Developement in METAFOR Application use case: CMIP5 / IPCC AR5 climate projections from Earth system models Methods of CV development for the CIM software classes Prototyping with selected Earth system model developing scientists (interviews) Structuring with METAFOR procject Presentation and discussion within wider Earth system modelling community Revised version is taken for the application use case Experience from application use will improve the CIM CV implementation (next iteration loop) Requirement: community agreement is needed for acceptance Missing: formalised process to expand CIM CV lists is yet not in place.

CMIP5/AR5 Metadata Capture Metadata sources METAFOR Questionnaire CMOR-2 GridSpec Transformation of output into CIM XML CIM intermediate XML

CMIP5/AR5 Data Repository CIM intermediate XML ESG (US) GUI for interactive completion GeoNetwork (MPI) IS-ENES (EU) other NO complete? XML DB / RDBMS (CIM repository) YES Upload

Essential METAFOR Links Homepage: http://metaforclimate.eu/ Prototype of CIM Human GUI: http://anticyclone.dkrz.de:8088/geonetwork/ Prototype of CMIP5 questionnaire: http://cmip5.metafor.ceda.ac.uk/cmip5/ METAFOR CV server: ‘Not Yet Available!’ Work in progress: List of so far captured CV entries http://metaforclimate.eu/trac/wiki/WP2/ControlledVocabulariesList