H. Thiemann (M&D) / 02.12.2015 / 1 Hannes Thiemann M&D Statusseminar, 22. April 2004.

Slides:



Advertisements
Similar presentations
Std-doi Publication of Climate Data at WDCC DataCite Summer Meeting 7./8. June 2010 Publication of climate data Heinke Höck World Data Center for Climate.
Advertisements

DIGIDOC A web based tool to Manage Documents. System Overview DigiDoc is a web-based customizable, integrated solution for Business Process Management.
GTS MetaData Generation data GTS data bases GTS Switch Volume C1 Central Support Office Information Classes white-list Metadata Synchronization.
Preservation and Long Term Access of Data at the World Data Centre for Climate Frank Toussaint N.P. Drakenberg, H. Höck, M. Lautenschlager, H. Luthardt,
1 CEOS/WGISS20 – Kyiv – September 13, 2005 Paul Kopp SIPAD New Generation: Dominique Heulet CNES 18, Avenue E.Belin Toulouse Cedex 9 France
Radko Zhelev, IPP BAS Generic Resource Framework for Cloud Systems 1 Generic Resource Framework for Cloud Systems.
Summary Role of Software (1 slide) ARCS Software Architecture (4 slides) SNS -- Caltech Interactions (3 slides)
M.Lautenschlager (WDCC/MPI-M) / / 1 The CEOP Model Data Archive at the World Data Center for Climate as part of the CEOP Data Network CEOP / IGWCO.
CERA / WDCC Hannes Thiemann Max-Planck-Institut für Meteorologie Modelle und Daten zmaw.de NCAR, October 27th – 29th, 2008.
Metadata Server system software laboratory. Overview metadata service in Grid environment Grid environment Metadata server User query data search information.
Improving access to digital resources: a mandate for order mandate: managing digital assets in tertiary education craig green,
MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 7 Configuring File Services in Windows Server 2008.
Introduction to the course January 9, Points to Cover  What is GIS?  GIS and Geographic Information Science  Components of GIS Spatial data.
M.Lautenschlager (WDCC / MPI-M) / / 1 WS Spatiotemporal Databases for Geosciences, Biomedical sciences and Physical sciences Edinburgh, November.
M.Lautenschlager (WDCC / MPI-M) / / 1 GO-ESSP at LLNL Livermore, June 19th – 21st, 2006 World Data Center Climate: Status and Portal Integration.
Types of Software.  What is the software: ◦ System software refers to the programs designed to handle certain task.  System Software can be classified.
SOFTWARE.
CSCI ClearQuest 1 Rational ClearQuest Michel Izygon - Jim Helm.
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
WP6: Grid Authorization Service Review meeting in Berlin, March 8 th 2004 Marcin Adamski Michał Chmielewski Sergiusz Fonrobert Jarek Nabrzyski Tomasz Nowocień.
M. Lautenschlager (M&D/MPIM)1 The CERA Database Michael Lautenschlager Modelle und Daten Max-Planck-Institut für Meteorologie Workshop "Definition.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Z EGU Integration of external metadata into the Earth System Grid Federation (ESGF) K. Berger 1, G. Levavasseur 2, M. Stockhause 1, and M. Lautenschlager.
Database System Concepts and Architecture Lecture # 3 22 June 2012 National University of Computer and Emerging Sciences.
Database Systems COMSATS INSTITUTE OF INFORMATION TECHNOLOGY, VEHARI.
Technology Infusion for the Decadal Survey Era: Data Quality Capability Needs Based on information derived from the NASA Technology Infusion Working Group's.
Module Title? DBMS Introduction to Database Management System.
Section 2 Software.
F. Toussaint (WDCC, Hamburg) / / 1 CERA : Data Structure and User Interface Frank Toussaint Michael Lautenschlager World Data Center for Climate.
Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Bulk Metadata Structures in CERA Frank Toussaint, Michael Lautenschlager Max-Planck-Institut für Meteorologie World Data Center for Climate.
M.Lautenschlager (WDCC, Hamburg) / / 1 Semantic Data Management for Organising Terabyte Data Archives Michael Lautenschlager World Data Center.
M.Lautenschlager (WDCC, Hamburg) / / 1 Semantic Data Management for Organising Terabyte Data Archives Michael Lautenschlager World Data Center.
Chapter 10: File-System Interface 10.1 Silberschatz, Galvin and Gagne ©2011 Operating System Concepts – 8 th Edition 2014.
Operating Systems (CS 340 D) Dr. Abeer Mahmoud Princess Nora University Faculty of Computer & Information Systems Computer science Department.
Deutscher Wetterdienst DAR Metadata Catalog Markus Heene, DWD
Patent Information System of Georgia: Activities and Challenges David Gabunia Director General National Intellectual Property Centre of Georgia “SAKPATENTI”
M.Lautenschlager (WDCC, Hamburg) / / 1 ICSU World Data Center For Climate Semantic Data Management for Organising Terabyte Data Archives Michael.
The CERA2 Data Base Data input – Data output Hans Luthardt Model & Data/MPI-M, Hamburg Services and Facilities of DKRZ and Model & Data Hamburg,
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
INFSO-RI Enabling Grids for E-sciencE A service oriented framework to create, manage and update metadata for earth system science.
Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.
Introduction to Morpho RCN Workshop Samantha Romanello Long Term Ecological Research University of New Mexico.
PSI Meta Data meeting, Toulouse - 15 November The CERA C limate and E nvironment data R etrieval and A rchiving system at MPI-Met / M&D S. Legutke,
Workforce Scheduling Release 5.0 for Windows Implementation Overview OWS Development Team.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 – The Ganga Evolution Andrew Maier.
Application Software System Software.
TSS Database Inventory. CIRA has… Received and imported the 2002 and 2018 modeling data Decided to initially store only IMPROVE site-specific data Decided.
Lautenschlager + Thiemann (M&D/MPI-M) / / 1 Introduction Course 2006 Services and Facilities of DKRZ and M&D Integrating Model and Data Infrastructure.
MarLIN: a research data metadatabase for CSIRO Marine Research Tony Rees Divisional Data Centre CSIRO Marine Research, Hobart contact:
Types of Software Chapter 2.
1 « Luxembourg, 18 April 2007 « Virtual Library of Official Statistics « Dissemination Working Group.
IPCC WG II + III Requirements for AR5 Data Management GO-ESSP Meeting, Paris, Michael Lautenschlager, Hans Luthardt World Data Center Climate.
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
Hannes Thiemann Michael Lautenschlager Deutsches Klimarechenzentrum GmbH, Germany EGU 2010.
M. Lautenschlager (M&D/MPIM)1 WDC on Climate as Part of the CERA 1 Database System Michael Lautenschlager Modelle und Daten Max-Planck-Institut.
Registration The Registration system is a fully integrated solution for today's registration requirements in any country. Covering ID, Passports, Visa’s,
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
1 What Do You Find in Verde? Largest KnowledgeBase in the market Focal point for e-resource management in library Trials and evaluations Lifecycle workflows.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
2005 – 06 – - ESSP1 WDC Climate : Web Access to Metadata and Data Frank Toussaint World Data Center for Climate (M&D/MPI-Met, Hamburg)
AP7/AP8: Long-Term Archival of CMIP6 Data
European Network of e-Lexicography
SISAI STATISTICAL INFORMATION SYSTEMS ARCHITECTURE AND INTEGRATION
Lecture 2 Components of GIS
Background Prepared by: Mr. Mahmoud Rafeek Alfarra.
Geographical information system: Definition and components
Presentation transcript:

H. Thiemann (M&D) / / 1 Hannes Thiemann M&D Statusseminar, 22. April 2004

H. Thiemann (M&D) / / 2 CERA is the backbone ERA40 IPCC CEOP BALTEX HOAPS CARIBIC WOCE ERA15 NCEP GEBCO COSMOS MPI, GKSS,…

H. Thiemann (M&D) / / 3 CERA & DKRZ Strong interlink to DKRZ: The application CERA is based on an Oracle database. The Oracle software is supplied by DKRZ. The database itself is maintained by DKRZ (in theory). CERA uses DKRZ hardware (from HLRE) Major changes of CERA implementation within HLRE.

H. Thiemann (M&D) / / 4 CERA Hierarchy 1.Data catalogue – enable search and identification of data described in a unified way 2.Application oriented data storage within the CERA database. Typically time series of 2 dimensional variables. –Quicker access to data possible –Reduces user requirements 3.Pointer to (external) raw data. –All data can be documented

H. Thiemann (M&D) / / 5 Metadata Entry This is the central CERA Block, providing information on the entry's title type and relation to other entries the project the data belong to a summary of the entry a list of general keywords related to data creation and review dates of the metadata Additionally: Modules and Local Extensions Module DATA_ORGANIZATION (grid structure) Module DATA_ACCESS (physical storage) Local extension for specific information on (e.g.) data usage data access and data administration Coverage Information on the volume of space-time covered by the data Reference Any publication related to the data together with the publication form Status Status information like data quality, processing steps, etc. Distribution Distribution information including access restrictions, data format and fees if necessary Contact Data related to contact persons and institutes like distributor, investigator, and owner of copyright Parameter Block describes data topic, variable and unit Spatial Reference Information on the coordinate system used CERA-2 Data Model Blocks

H. Thiemann (M&D) / / 6 User Interface Two choices Web based Graphical User Interface * (GUI) –Search and retrieval of data Batch interface (jblob) * –retrieval of data Both give users the choice of data reduction within one dimension, typically selection based on time. * certain firewall requirements to be fulfilled by users.

H. Thiemann (M&D) / / 7

H. Thiemann (M&D) / / 8 Input to CERA 1.Creation of metadata – requires extensive cooperation of data producers with M&D 2.Preparation of input data according to user requirements Strong need for processing capacities at DKRZ for IPCC runs Typically preparation of data split into two parts (1 st level preparation (afterburner), 2 nd level preparation (pingos)). 3.Ingest of data into CERA, problems may arise from certain data formats.

H. Thiemann (M&D) / / 9 Processing Close cooperation with MPI Pingos: basic bug fixing but no new features. User support! CDOs: still not released. User support! Processing not yet incorporated into CERA environment. (underway).

H. Thiemann (M&D) / / 10 roblems Organization of workflow Quality of DKRZ data service, to be considered within HLRE 2 Processing capabilities for IPCC More disk space on database servers needed Ingest and retrieval (not storage) of arbitrary formats. GUI needs more flexibility – inclusion of data processing.