20 th CODATA International Conference, October 23 - 25, 2006; Beijing GFZ ISDC portal – Unique door to data and information B. Ritschel (1), ISDC Team.

Slides:



Advertisements
Similar presentations
The Cybercartographic Atlas of Antarctica Contribution from Wuhan University, China Dongcheng, E., Nengcheng, C.
Advertisements

National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.
ASIAES Project Overview Satellite Image Network for Natural Hazard Management in ASEAN+3 region Pakorn Apaphant Geo-Informatics and Space Technology Development.
CEOS Working Group on Information Systems and Services, WGISS-24, Oberpfaffenhofen, Oct , 2007 GFZ Representative Report Bernd Ritschel, GFZ ISDC.
DOIs for Tracking and Citing Scientific Data J. Klump, J. Wächter and M. Lautenschlager CODATA Conference 2006 Beijing, PR China.
Spatial Data Infrastructure: Concepts and Components Geog 458: Map Sources and Errors March 6, 2006.
The Documentum Team Lance Callaway, Brooke Durbin, Perry Koob, Lorie McMillin, Jennifer Song Missouri University of Science and Technology Rolla, Missouri.
1 CEOS/WGISS20 – Kyiv – September 13, 2005 Paul Kopp SIPAD New Generation: Dominique Heulet CNES 18, Avenue E.Belin Toulouse Cedex 9 France
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
1 NODC, Russia GISC & DCPC developers meeting Langen, 29 – 31 March E2EDM technology implementation for WIS GISC development S. Sukhonosov, S. Belov.
Metadata Server system software laboratory. Overview metadata service in Grid environment Grid environment Metadata server User query data search information.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.
Information and Communication Technologies in the field of general education in Armenia NATIONAL CENTER OF EDUCATIONAL TECHNOLOGIES.
Chinese-European Workshop on Digital Preservation, Beijing July 14 – Network of Expertise in Digital Preservation 1 Persistent Identifiers Reinhard.
Advances in Technology and CRIS Nikos Houssos National Documentation Centre / National Hellenic Research Foundation, Greece euroCRIS Task Group Leader.
Task AR-07-03: Global Geodetic Reference Frames Report to ADC-5 prepared by Hans-Peter Plag (IAG/GGOS) Nevada Bureau of Mines and Geology and Seismological.
Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.
SITools Enhanced Use of Laboratory Services and Data Romain Conseil
 DATABASE DATABASE  DATABASE ENVIRONMENT DATABASE ENVIRONMENT  WHY STUDY DATABASE WHY STUDY DATABASE  DBMS & ITS FUNCTIONS DBMS & ITS FUNCTIONS 
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
Tunis International Centre for Environmental Technologies Small Seminar on Networking Technology Information Centers UNFCCC secretariat offices Bonn, Germany.
Ms. Irene Onyancha ISTD/Library & Information Management Services United Nations Economic Commission for Africa The Second Session of the Committee on.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
BEN Architecture Isovera Consulting Feb Internet consulting for non-profits 2 BEN Architecture Diagram.
NKG Working Group for Geodynamics Copenhagen, 23 –24 April, Tasks of a new Working Group on Absolute Gravimetry Herbert Wilmes Federal Agency for.
Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK
World Data Center for Marine Environmental Sciences.
The DiVA System: Current Status and Ongoing Development Uwe Klosa Electronic Publishing Centre, Uppsala University, Sweden Eva Müller.
19/10/20151 Semantic WEB Scientific Data Integration Vladimir Serebryakov Computing Centre of the Russian Academy of Science Proposal: SkTech.RC/IT/Madnick.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
EGY General Meeting, Boulder, March 2007 GFZ Potsdam contribution to eGY Bernd Ritschel electronic Geophysical Year.
WDC-MARE – World Data Center for Marine Environmental Sciences Data portal based on Open Archives Initiative Protocols and Apache Lucene Uwe Schindler,
CBSOR,Indian Statistical Institute 30th March 07, ISI,Kokata 1 Digital Repository support for Consortium Dr. Devika P. Madalli Documentation Research &
@ 2008 Copyright NIC I Do not distribute without permission E-Services for Transforming to the Next Generation Government “A Case Study of India” Suchitra.
Metadata harvesting in regional digital libraries in PIONIER Network Cezary Mazurek, Maciej Stroiński, Marcin Werla, Jan Węglarz.
TPAC Tasmanian Partnership for Advanced Computing Partner in APAC (Australian Partnership for Advanced Computing) Expertise centre for Earth Systems Science.
Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.
PV 2007 CONFERENCE, Germany, Oberpfaffenhofen, October , 2007 The ISDC concept for long-term sustainability of geoscience data and information B.
Uwe SchindlerGES 2007 – May 2-4, 2007 Data Information Service based on Open Archives Initiative Protocols and Apache Lucene Uwe Schindler 1, Benny Bräuer.
Alternative Architecture for Information in Digital Libraries Onno W. Purbo
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
1-2-3 February 2006 –Page 1 Mersea Integrated System How to improve Access/Downloading services ? How far do we go in terms of standardization ?
Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.
Creating Good Documentation NOAA National Geophysical Data Center
Digital Libraries1 David Rashty. Digital Libraries2 “A library is an arsenal of liberty” Anonymous.
1 Registry Services Overview J. Steven Hughes (Deputy Chair) Principal Computer Scientist NASA/JPL 17 December 2015.
S T A T I S T I C S A U S T R I A March SuperSTAR A joint development with STR D.Burget October 2007 © STATISTICS AUSTRIA I n f.
Metadata and Meta tag. What is metadata? What does metadata do? Metadata schemes What is meta tag? Meta tag example Table of Content.
Fire Emissions Network Sept. 4, 2002 A white paper for the development of a NSF Digital Government Program proposal Stefan Falke Washington University.
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
Storing digital assets on Grid/EGI FedCloud with gLibrary Giuseppe La Rocca, INFN DARIAH ERIC.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
5/29/2001Y. D. Wu & M. Liu1 Content Management for Digital Library May 29, 2001.
Developing a Dark Archive for OJS Journals Yu-Hung Lin, Metadata Librarian for Continuing Resources, Scholarship and Data Rutgers University 1 10/7/2015.
Click to edit Master title style Click to edit Master text styles Second level Third level Fourth level Fifth level 1 SI O S Svalbard Integrated Arctic.
Metadata in the IERS Data and Information System Daniela Thaller, Wolfgang R. Dick, Allison Craddock.
IPDA Registry Definitions Project Dan Crichton Pedro Osuna Alain Sarkissian.
CEOS Working Group on Information Systems and Services, WGISS-32, Budapest, September 2011 “Agency” Report Helmholtz Centre Potsdam GFZ German.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
AIRS Meeting GSFC, February 1, 2002 ECS Data Pool Gregory Leptoukh.
CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May , 2007 Information System and Data Center for Earth Observation Data.
Flanders Marine Institute (VLIZ)
AMGA Web Interface Salvatore Scifo INFN sez. Catania
GSAF Grid Storage Access Framework
WGISS-41: IDN Report Michael Morahan CEOS WGISS-41 Meeting
AMGA Web Interface Vincenzo Milazzo
Objectives, activities, and results of the database Lituanistika
Data Management Components for a Research Data Archive
Presentation transcript:

20 th CODATA International Conference, October , 2006; Beijing GFZ ISDC portal – Unique door to data and information B. Ritschel (1), ISDC Team (1,2,3,4) (1)GFZ Potsdam, Data Center, Germany (Ph. Burges, R. Kopischke, St. Loos, H. Palm) (2)Universität Potsdam (S. Freiberg) (3)Hasso Plattner Institut Potsdam (L. Gericke) (4)Hochschule Neubrandenburg (O. Volgmann, St. Lowisch) International Association of Geodesy The Electronic Geophysical Year

20 th CODATA International Conference, October , 2006; Beijing Outline Business case – Management of scientific data Features and architecture of the ISDC portal ISDC portal user and archive statistics Presentation of the new portal ( ISDC product philosophy Definition of ISDC products ISDC product metadata (DIF standard) The future of the ISDC portal

20 th CODATA International Conference, October , 2006; Beijing Business Case Complete management of products (data + metadata) by providing different services for  data providers (scientists and engineers)  data users (scientists, pupils and students, decision makers, other interested parties, …)  project management (scientific and administrative staff) for grand geoscientific projects and missions => Information System and Data Center (ISDC portal,

20 th CODATA International Conference, October , 2006; Beijing ISDC portal – Product Types: isdc.gfz-potsdam.de/product_typesisdc.gfz-potsdam.de/product_types

20 th CODATA International Conference, October , 2006; Beijing ISDC user development statistics 1206 users (without providers), users since portal launch in March 2006

20 th CODATA International Conference, October , 2006; Beijing ISDC user - country statistics 1206 users (without providers),

20 th CODATA International Conference, October , 2006; Beijing ISDC data flow statistics app. 10 GB per day (last 60 days),

20 th CODATA International Conference, October , 2006; Beijing ISDC portal features (1) User registration and authentification Sign on/Login Data access grant management MyAdministration Personalisation (projects, products, RSS Feeds …) MyAccount Content and document management Documents (Meta)Information about product types in ISDC Product Types Data mining (product type specific query forms) MyRetrieval

20 th CODATA International Conference, October , 2006; Beijing ISDC portal features (2) Data provision monitoring MyRequests Directory browsing MyDirectory ISDC user and dataflow statistics Statistics Data visualisation* User forum Forum Portal and data management administration MyAdmin *planned

20 th CODATA International Conference, October , 2006; Beijing ISDC portal product search Search attributes -Time (start date, stop date of time series) -Space (longitude, latitude, altitude) -Location, station, instrument (product type dependent) -Very specific product type dependent parameter Search methods -Retrieval using query forms in MyRetrieval -Batch mode using PRL file (product id request listing) -Virtual product browser with Product Browser

20 th CODATA International Conference, October , 2006; Beijing ISDC architecture ISDC Products ISDC Products

20 th CODATA International Conference, October , 2006; Beijing ISDC server and storage systems PostNuke portal framework (open source) Sybase 12.5 and mySQL databases Apache WWW Server Wu FTP Server (1x Intranet, 1x Extranet) UMN-Map Server Application Server (product management) 12 TB raidsystem-based Online Product Archive (OPA) Longterm data archive based on Hierarchical Storage Management (HSM) system (> 100 TB) 1 TB high speed SAN connecting FTP server and OPA SUN workstations, UNIX Solaris 10 (zone architecture)

20 th CODATA International Conference, October , 2006; Beijing ISDC main system components deployment

20 th CODATA International Conference, October , 2006; Beijing ISDC collaboration projects: isdc.gfz-potsdam.de/projectsisdc.gfz-potsdam.de/projects

20 th CODATA International Conference, October , 2006; Beijing ISDC portal – CHAMP ISDC homepage: isdc.gfz-potsdam.de/champisdc.gfz-potsdam.de/champ

20 th CODATA International Conference, October , 2006; Beijing ISDC portal – GRACE ISDC homepage: isdc.gfz-potsdam.de/graceisdc.gfz-potsdam.de/grace

20 th CODATA International Conference, October , 2006; Beijing ISDC portal – GGSP ISDC homepage: isdc.gfz-potsdam.de/ggspisdc.gfz-potsdam.de/ggsp

20 th CODATA International Conference, October , 2006; Beijing ISDC portal – GGOS ISDC homepage: isdc.gfz-potsdam.de/ggosisdc.gfz-potsdam.de/ggos

20 th CODATA International Conference, October , 2006; Beijing ISDC portal – ICGEM ISDC homepage: isdc.gfz-potsdam.de/icgemisdc.gfz-potsdam.de/icgem

20 th CODATA International Conference, October , 2006; Beijing ISDC portal – TSX TOR ISDC homepage: isdc.gfz-potsdam.de/torisdc.gfz-potsdam.de/tor

20 th CODATA International Conference, October , 2006; Beijing ISDC portal – GGP ISDC homepage: isdc.gfz-potsdam.de/ggpisdc.gfz-potsdam.de/ggp

20 th CODATA International Conference, October , 2006; Beijing GGP SG minute data – MyRetrieval query form

20 th CODATA International Conference, October , 2006; Beijing GGP SG minute data – Spatial search

20 th CODATA International Conference, October , 2006; Beijing GGP SG minute data - MyRetrieval result page and request sent confirmation

20 th CODATA International Conference, October , 2006; Beijing ISDC portal – MyRequests

20 th CODATA International Conference, October , 2006; Beijing ISDC portal – MyDirectory details for GGP SG minute data (request-id: 19926)

20 th CODATA International Conference, October , 2006; Beijing GGP products - virtual Product Browser

20 th CODATA International Conference, October , 2006; Beijing ISDC portal – Input Monitor

20 th CODATA International Conference, October , 2006; Beijing ISDC portal – Data Delivery Monitor Top 25 users (amount of data),

20 th CODATA International Conference, October , 2006; Beijing ISDC portal - Education and public outreach

20 th CODATA International Conference, October , 2006; Beijing Students project (Gymnasium in Kleinmachnow): sfk.gfz-potsdam.desfk.gfz-potsdam.de

20 th CODATA International Conference, October , 2006; Beijing Earthquake Events GIS Application Diploma thesis of Stefan Lowisch (Hochschule Neubrandenburg)

20 th CODATA International Conference, October , 2006; Beijing ISDC Metadata Standard = Parent DIF (V. 9.0) + Extended Child DIF(s)* *in preparation Meta data Producer Data pump User

20 th CODATA International Conference, October , 2006; Beijing Metadata for Global Earth Gravity Field Models (GEGFM) List of possibly metadata attributes for GEGFM Entry_Id, Entry_Title (unique identifier and title) Personnal (Author of Model, Author of DIF) Science Keywords (Earth Gravity Field, ….) Temporal Coverage Spatial Coverage (global, regional, local) Temporal and Spatial Resolution (1 year, 1 month, … 1 °, ?) Data Source (satellite tracking data, gravity data, altimetry data) Quality (description) Reference (list of publications) Data Centres (IGFS, ICGEM, ISDC) Representation (Spherical Harmonic Coefficients, Maximum Degree of the Expansion) Grid (Geoid, Gravity Anomalies, Gravity Disturbances) Calculation Method, Software Package DOI (Digital Object Identifier) … Parent DIF V. 9.0 Child DIF (extended)

20 th CODATA International Conference, October , 2006; Beijing Metadata Example for GEGFM - unique models GRIM4S4 Metadata from the header of the data file Entry-Id, Entry-Title, Personnal, Data Source, Resolution, Quality, Reference, Data Center, Science Keywords, … => main information according to DIF metadata standard are available

20 th CODATA International Conference, October , 2006; Beijing DIF V. 9.0 Metadata Example for GEGFM - time series GX-OG-_2-GSM GX-OG-_2-GSM Metadata - Parent DIF V. 9.0 metadata file (xml version)

20 th CODATA International Conference, October , 2006; Beijing GX-OG-2_GSM Parent DIF V. 9.0 metadata file (xml version) (cont.) XML schema: dif.xsddif.xsd

20 th CODATA International Conference, October , 2006; Beijing The future of the ISDC portal Thematic product access using metadata onthologies (semantic web) derived from product type dependent parent and child DIF V. 9.0 metadata documents Implementation of standardized ISO/OGC web services (using DEGREE) for networking information systems, catalogue services and open access libraries (Open Access Initiative) Development of new ISDC applications (e.g. visiualisation, publication of data using DOI [unique identifier], …) Integration of new collaboration projects (e.g. ICGEM, TSX TOR, Galileo, GEOFON) and new products and services => To play an active role in the IAG GGOS project Integration of the ISDC system into the new GFZ web portal frame work and WDC Terra

20 th CODATA International Conference, October , 2006; Beijing

The Vision of GGOS* GGOS integrates different geodetic techniques, different models, different approaches in order to achieve better long-term consistency, reliability and understanding of geodetic, geodynamic and global change processes. GGOS provides the scientific and infrastructure basis for all global change research in Earth sciences. *H. Drewes, Ch. Reigber GG S

20 th CODATA International Conference, October , 2006; Beijing GGOS – Virtual Geodetic Observatory 1000 different geodetic product types (covering all geodetic techniques and level of processing) 100,000,000 data sets, 100 TB of data (all over the world distributed) Creating a standardized metadata catalog for describing –Products (time series … global models) –Scientific services (IGS, ILRS, IERS, …) –Projects, platforms, instruments, techniques, processing SW, persons, … –Usage of data by scientific keywords describing the content and use of data –References like related literature, applications, software, … –Different interfaces for data access Offering an ontology-based multi-domain metadata catalog for thematic search and OGC/ISO confrom Webservice interfaces Providing the access links (using DOI) to validated and tailored products in (near)realtime for all kind of usage and all interested users

20 th CODATA International Conference, October , 2006; Beijing Thank you very much for your attention! International Association of Geodesy The Electronic Geophysical Year