M. Lautenschlager, H. Ramthun 1 Metafor Review 5 / 2010.

Slides:



Advertisements
Similar presentations
2008 EPA and Partners Metadata Training Program: 2008 CAP Project Geospatial Metadata: Intermediate Course Module 3: Metadata Catalogs and Geospatial One.
Advertisements

Putting the Pieces Together Grace Agnew Slide User Description Rights Holder Authentication Rights Video Object Permission Administration.
Permanent Hosting, Archiving and Indexing of Digital Resources and Assets Raman Ganguly Computer Center University of Vienna.
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.
ESGF and ES-DOC Documenting climate models and their simulations ES-DOC current and future plans Working with ESGF Eric Guilyardi, Balaji, Cecelia DeLuca,
The CERIF-2000 Implementation. Andrei S. Lopatenko CERIF Implementation Guidelines Andrei Lopatenko Vienna University of Technology
June 22-23, 2005 Technology Infusion Team Committee1 High Performance Parallel Lucene search (for an OAI federation) K. Maly, and M. Zubair Department.
Meta Dater Metadata Management and Production System for surveys in Empirical Socio-economic Research A Project funded by EU under the 5 th Framework Programme.
ARCHIMÈDE Presented by Guy Teasdale Directeur, Services soutien et développement Bibliothèque de l’Université Laval CARL Workshop on Institutional Repositories.
Design of Web-based Systems IS Development: lecture 10.
PORTAL DEVELOPMENT ARTEM VORONTSOV. DISTINGUISHING FEATURES Distributed data providers with different archival legal system Distributed development teams.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
“This presentation is for informational purposes only and may not be incorporated into a contract or agreement.”
Z EGU Integration of external metadata into the Earth System Grid Federation (ESGF) K. Berger 1, G. Levavasseur 2, M. Stockhause 1, and M. Lautenschlager.
Rajashree Deka Tetherless World Constellation Rensselaer Polytechnic Institute.
1 Eric Guilyardi and the Metafor team Common Metadata for Climate Modelling Digital Repositories Metafor Dissemination Workshop Abingdon, 14 March 2011.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
CIM – The Common Information Model in Climate Research
1 CS 430 Database Theory Winter 2005 Lecture 1: Introduction.
Metadata Concepts / Use in Climate Research Stephan Kindermann, Martina Stockhause German Climate Computing Center (DKRZ) Hamburg, Germany.
1 Foundations V: Infrastructure and Architecture, Middleware Deborah McGuinness TA Weijing Chen Semantic eScience Week 10, November 7, 2011.
ESP workshop, Sept 2003 the Earth System Grid data portal presented by Luca Cinquini (NCAR/SCD/VETS) Acknowledgments: ESG.
UWG 2013 Meeting PO.DAAC Web Services Demo. What are PO.DAAC Web Services?
University of North Texas Libraries Building Search Systems for Digital Library Collections Mark E. Phillips Texas Conference on Digital Libraries May.
GRNET Greek Research & Education Network GRNET Simple Storage – GSS Ioannis Liabotis, Panos Louridas Amsterdam, June 2007.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
Design of a Search Engine for Metadata Search Based on Metalogy Ing-Xiang Chen, Che-Min Chen,and Cheng-Zen Yang Dept. of Computer Engineering and Science.
Data Publication and Quality Control Procedure for CMIP5 / IPCC-AR5 Data WDC Climate / DKRZ:
WDC-MARE – World Data Center for Marine Environmental Sciences Data portal based on Open Archives Initiative Protocols and Apache Lucene Uwe Schindler,
ALICE, ATLAS, CMS & LHCb joint workshop on
Questionnaire Project Plan Alpha development Beta development Release for CMIP5 approval Production Phase After CMIP5 Questionnaire 01 Jan 2010 – 30 Dec.
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Persistent Management of Distributed Data Reagan W. Moore.
Alexandria Digital Earth ProtoType DIGITAL LIBRARIES AND ENVIRONMENTAL INFORMATION Terence R. Smith Alexandria Digital Library Project.
INFSO-RI Enabling Grids for E-sciencE OGSA DAI Data Access and Integration Marek Ciglan Institute of Informatics, Slovac Academy.
Uwe SchindlerGES 2007 – May 2-4, 2007 Data Information Service based on Open Archives Initiative Protocols and Apache Lucene Uwe Schindler 1, Benny Bräuer.
Presented by Scientific Annotation Middleware Software infrastructure to support rich scientific records and the processes that produce them Jens Schwidder.
Using XML to store Descriptive Metadata Richard Murphy Rosarie O’Riordan Central Statistics Office Ireland.
Mike Jackson EPCC OGSA-DAI Architecture + Extensibility OGSA-DAI Tutorial GGF17, Tokyo.
Portable Infrastructure for the Metafor Metadata System Charlotte Pascoe 1, Gerry Devine 2 1 NCAS-BADC, 2 NCAS-CMS University of Reading PIMMS provides.
Presented by Jens Schwidder Tara D. Gibson James D. Myers Computing & Computational Sciences Directorate Oak Ridge National Laboratory Scientific Annotation.
What is HTTP? - the underlying communication protocol used by the www - common HTTP headers?
Create Content Capture Content Review Content Edit Content Version Content Version Content Translate Content Translate Content Format Content Transform.
Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.
© 2006 Altova GmbH. All Rights Reserved. Altova ® Product Line Overview.
S T A T I S T I C S A U S T R I A March SuperSTAR A joint development with STR D.Burget October 2007 © STATISTICS AUSTRIA I n f.
CORDEX P2P DKRZ Overview Configuration of data node and index node S. Kindermann / N. Balic / H. Ramthun DKRZ.
NeuroLOG ANR-06-TLOG-024 Software technologies for integration of process and data in medical imaging A transitional.
H. Widmann (M&D) Data Discovery and Processing within C3Grid GO-ESSP/LLNL / June, 19 th 2006 / 1 Data Discovery and Basic Processing within the German.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
1 Gateways. 2 The Role of Gateways  Generally associated with primary sites in ESG-CET  Provides a community-facing web presence  Can be branded as.
M. Stockhause 1, G. Levavasseur 2, K. Berger 1 1 Deutsches Klimarechenzentrum (DKRZ) 2 Institute Pierre Simon Laplace (IPSL) ESGF-QCWT Quality Control.
DSpace System Architecture 11 July 2002 DSpace System Architecture.
Permanent Hosting, Archiving and Indexing of Digital Resources and Assets Markus Höckner Computer Center University of Vienna.
2 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. BI Publisher: Technology and Architecture.
Create XML from a template Browse available records WDCC Metadata Generation with GeoNetwork Hans Ramthun, Michael Lautenschlager, Hans-Hermann Winter.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
LLNL-PRES-XXXXXX This work was performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under contract DE-AC52-07NA27344.
Steven Perry Dave Vieglais. W a s a b i Web Applications for the Semantic Architecture of Biodiversity Informatics Overview WASABI is a framework for.
©2007 Really Strategies, Inc. CONFIDENTIAL 1 Native XML Content Management Philadelphia XML Users’ Group.
Application Web Service Toolkit Allow users to quickly add new applications GGF5 Edinburgh Geoffrey Fox, Marlon Pierce, Ozgur Balsoy Indiana University.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
Interstage BPM v11.2 1Copyright © 2010 FUJITSU LIMITED INTERSTAGE BPM ARCHITECTURE BPMS.
uses of DB systems DB environment DB structure Codd’s rules current common RDBMs implementations.
Slide 1 © 2016, Lera Technologies. All Rights Reserved. SAP BO vs SPLUNK vs OBIEE By Lera Technologies.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
IBM - CVUT Student Research Projects Plugin and script generator for WebSphere Jakub Řezníček Tomáš Turek
The Earth System Curator Metadata Infrastructure for Climate Modeling Rocky Dunlap Georgia Tech.
Metafor Year 3 EU Review CIM Component Services. Of itself an Ontology is an inert artefact, i.e. a dictionary. CON-CIM Conceptual CIM.
Building Search Systems for Digital Library Collections
The Fedora Project April 28-29, 2003 CNI, Washington DC
Presentation transcript:

M. Lautenschlager, H. Ramthun 1 Metafor Review 5 / 2010

M. Lautenschlager, H. Ramthun 2 Metafor Review 5 / Metadata sources - community: - ESG Publisher database - CMIP5 questionnaire - local: - modelling environment (e.g. ESMF, IMDI) - legacy datamangement (e.g. CERA) - human - Metadata capture methods - access to legacy databases (e.g. ESG Publisher) - XML output of CMIP5 questionnaire - GeoNetwork (view and edit)

M. Lautenschlager, H. Ramthun 3 Metafor Review 5 / 2010 Activity: dataProcessing * from CMIP5 questionnaire ensemble * from ESG Publisher numericalExperiment simulationComposite * simulationRun * Software: deployment * modelComponent * processorComponent Data: dataObject * * Grid: gridSpec CIM objects: CIMRecordSet (some objects of the list) CIMRecord (one object of the list)

M. Lautenschlager, H. Ramthun 4 Metafor Review 5 / 2010 ESG publisher ESG Data Node Metadata Capture model environment datamanagement human CIM dataObject Questionnaire Completion / Repository for Metafor / IS-ENES / ESG CIM Model / SIM ESG Gateway CIM ingestion CIM population Database /THREDDS APIAPI Intermediate CIM XML

M. Lautenschlager, H. Ramthun 5 Metafor Review 5 / 2010 GUI for interactive CIM completion WP6 - CIM XML Architecture CIM XML (instance) - provided on OAI server - transfer with FTP/Atom Intermediate CIM XML CIM complete? YES NO CIM repository Metadata sources CIM correct? YES NO GeoNetwork (DKRZ/MPI) Create/Update CIM instances

M. Lautenschlager, H. Ramthun 6 Metafor Review 5 / 2010 CIM world CIM repository (Central CIM db) data files (archive) Metadata Capturing Metadata Database Intermediate CIM XML ESG publisher THREDDS rdb access GeoNetwork CMIP5 questionnaire portal viewer query compare GU I ESG (RDF)

M. Lautenschlager, H. Ramthun 7 Metafor Review 5 / 2010 … CF-Topic from ESG database default controlled vocabulary server aggregation from ESG database … data files (archive with CMIP5 structure) Intermediate CIM XML ESG Publisher model output Postgres RDBMS THREDDS Catalog THREDDS to CIM API - python script - access / transform with lxml - into intermediate CIM XML CMOR2 controlled by esg.ini CIM dataObject template

M. Lautenschlager, H. Ramthun 8 Metafor Review 5 / 2010 Technology Ajax (Asynchronous JavaScript Technology and XML) Implementation at: Advantages Java + JavaScript capability simple and advanced search (on Lucene index) CV implementation by XML / RDF file access database MySQL, Oracle, postgresSQL XML handling (with XSLT) document view types: flat, advanced, XML schematron rules OAI server included multiple schemas User administration (incl. LDAP and Shibboleth)

M. Lautenschlager, H. Ramthun 9 Metafor Review 5 / 2010 some text any Text to be searched in all text fields

M. Lautenschlager, H. Ramthun 10 Metafor Review 5 / 2010

M. Lautenschlager, H. Ramthun 11 Metafor Review 5 / 2010 incomplete mandatory field

M. Lautenschlager, H. Ramthun 12 Metafor Review 5 / 2010 incomplete mandatory field

M. Lautenschlager, H. Ramthun 13 Metafor Review 5 / 2010 incomplete mandatory field

M. Lautenschlager, H. Ramthun 14 Metafor Review 5 / 2010 performance of XML document loading implementation of: complete Metafor CV helptext (from questionnaire) Atom support OpenID support

M. Lautenschlager, H. Ramthun 15 Metafor Review 5 / 2010 WP6 - Next steps GeoNetwork issues: - complete integration of Metafor controlled vocabulary (CV) - complete integration of Metafor helptext - implementation of Atom - implementation of OpenID authentification CIM service: - tool / service to access THREDDS catalog CIM service: - tool / service for upload XML into questionnaire

M. Lautenschlager, H. Ramthun 16 Metafor Review 5 / 2010 WP6 –... Thank You!