JADDS- Jülich Atmospheric Data Distribution Service

Slides:



Advertisements
Similar presentations
Managing Hardware and Software Assets
Advertisements

BADC Workshop 1: Data & Services from the BADC Royal Met. Soc. Conference – 12 September 2005 Kevin Marsh et al.
UNIVERSITY OF TWENTE - FACULTY OF GEO-INFORMATION SCIENCE AND EARTH OBSERVATION (ITC) Human Sensor Web project h2.0 Inform and Empower Initiative Human.
Centres of excellence and first choice for healthcare providers Digital Archival Program Neville Pinto Team Leader - Server & Storage Services.
® OGC Web Services Initiative, Phase 9 (OWS-9): Innovations Thread - OPeNDAP James Gallagher and Nathan Potter, OPeNDAP © 2012 Open Geospatial Consortium.
Web Caching Schemes1 A Survey of Web Caching Schemes for the Internet Jia Wang.
16 months…. The Visibility Information Exchange Web System is a database system and set of online tools originally designed to support the Regional Haze.
Axis Intelligent Video Intelligence where you need it.
Easy implementation, fast adaption Used centrally or in the branch office only.
Sergey Belov, Tatiana Goloskokova, Vladimir Korenkov, Nikolay Kutovskiy, Danila Oleynik, Artem Petrosyan, Roman Semenov, Alexander Uzhinskiy LIT JINR The.
October 16-18, Research Data Set Archives Steven Worley Scientific Computing Division Data Support Section.
AIRNow-International The future of the United States real-time air quality reporting and forecasting program and GEOSS participation John E. White U.S.
DATA COMMUNICATION DONE BY: ALVIN SAMPATH CARLVIN SAMPATH.
Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.
The National Center for Atmospheric Research is operated by the University Corporation for Atmospheric Research under sponsorship of the National Science.
material assembled from the web pages at
Nov 1, 2000Site report DESY1 DESY Site Report Wolfgang Friebel DESY Nov 1, 2000 HEPiX Fall
ITGS Case Study Theatre Booking System Ayushi Pradhan.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal MINCyT,
Page 1 Pacific THORPEX Predictability, 6-7 June 2005© Crown copyright 2005 The THORPEX Interactive Grand Global Ensemble David Richardson Met Office, Exeter.
1 Using the GEOSS Common Infrastructure in the Air Quality & Health SBA: Wildfire & Smoke Assessment Prepared by the GEOSS AIP-2 Air Quality & Health Working.
EMIRES Czech. 2 INSPIRE & its requirements Geographic information needed for good governance at all levels should be abundant and widely available under.
Company small business cloud solution Client UNIVERSITY OF BEDFORDSHIRE.
G-IDAS Richard Engelen.
Communications & Networks National 4 & 5 Computing Science.
Find Research Data b2find.eudat.eu B2FIND User Training How to find data objects and collections using EUDAT’s B2FIND This work is licensed.
Aalto Data Repository Keijo Heljanko and Mikko Hakala
1 SIMDAT Simdat Project –GTD. Meteo Activity – SIMDAT Meteo Activity OGF June 2008 Barcelona Marta Gutierrez, Baudouin Raoult, Cristina.
1 Using the GEOSS Common Infrastructure in the Air Quality & Health SBA: Wildfire & Smoke Assessment Prepared by the GEOSS AIP-2 Air Quality & Health Working.
The Earth Information Exchange. Portal Structure Portal Functions/Capabilities Portal Content ESIP Portal and Geospatial One-Stop ESIP Portal and NOAA.
Support to scientific research on seasonal-to-decadal climate and air quality modelling Pierre-Antoine Bretonnière Francesco Benincasa IC3-BSC - Spain.
Jost von Hardenberg ISAC-CNR, Torino, Italy with Paolo Davini, Susanna Corti, and many others EUDAT User Forum, Rome,Italy 3-4 February, 2016.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
CLARIN EUDAT2020 uptake plan Dieter Van Uytvanck CLARIN ERIC EUDAT User Forum, Rome.
BIG DATA. The information and the ability to store, analyze, and predict based on that information that is delivering a competitive advantage.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT Aalto Data.
Get Data to Computation eudat.eu/b2stage B2STAGE How to shift large amounts of data Version 4 February 2016 This work is licensed under the.
Store and exchange data with colleagues and team Synchronize multiple versions of data Ensure automatic desktop synchronization of large files B2DROP is.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal.
DataGrid France 12 Feb – WP9 – n° 1 WP9 Earth Observation Applications.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Aalto Data Repository.
Python Driven Sensor Observation Service Benjamin Welton NASA USRP.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No LTER- Europe &
E-Business Infrastructure PRESENTED BY IKA NOVITA DEWI, MCS.
MOBILE AND DISCONNECTED FIELD DATA COLLECTION
Data Browsing/Mining/Metadata
GeoNetwork OpenSource: Geographic data sharing for everyone
Accessing Data and Products
EUDAT’s engagement with the Earth Sciences
GSICS Collaboration Servers a Vehicle for International Collaboration Status 2011 Peter Miu EUMETSAT.
INSPIRE Network Services
Flanders Marine Institute (VLIZ)
Distributed Marine Data System:
Data Access and Re-use Carl Johan Håkansson EUDAT Service Area Manager
WELCOME TO DID Numbers for Local Presence in Foreign Regions.
DATA SPHINX & EUDAT Collaboration
Introduction to D4Science
EUDAT B2FIND A Cross-Discipline Metadata Service and Discovery Portal
AWS Cloud Computing Masaki.
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
Publishing data and metdata From iRODS to repositories
Steven Worley, NSF/NCAR/SCD
B2Anno – Linked Data service pilot
DATATURB Direct simulation data of turbulent flows
4/5 May 2009 The Palazzo dei Congressi di Stresa Stresa, Italy
Reportnet 3.0 Database Feasibility Study – Approach
Leveraging PIDs for object management in data infrastructures RDA UK Node Workshop, July Tobias Weigel (DKRZ)
STATEL an easy way to transfer data
Presentation transcript:

JADDS- Jülich Atmospheric Data Distribution Service LOGO of your Pilot – organisation / initiative O. Stein, L. Hoffmann, M. Schultz, D. Mallmann Research Centre Jülich, Germany o.stein@fz-juelich.de

Tailored global atmospheric composition model results from CAMS The scientific case Global model data of atmospheric composition from the Copernicus Atmospheric Monitoring System is collected since 2010 at FZ Jülich in near-realtime Data serves as boundary condition for regional air quality models word-wide A performant and easy-to-use web service for sharing individually tailored model results is demanded The technical challenge An existing server adheres to the Web Coverage Service (WCS) standard as defined by the Open Geospatial Consortium OGC, but based on a deprecated WCS version (1.1.2) The performance of the service is limited by the server hardware and by the file-based data storage The outdated WCS version prevents automatic harvesting of metadata for web catalogue services such as those offered by B2FIND Storage capacity on the existing server is limited and long-time support is not fully ensured CAMS offers reliable atmospheric composition analyses and forecasts which are well recepted by the RAQ communities. Nevertheless, currently limited options to access individual data sets hamper the further extension of Copernicus product use by modellers all over the world

JADDS and EUDAT Our plans for the EUDAT pilot the server shall migrate to the central storage site of the Jülich Supercomputing Centre (JSC) at FZ Jülich (JADDS) There, the expected growing data amount (about 25 TB/yr) can be optimally handled and made available for fast data access by external users the WCS protocol shall be upgraded to WCS2.0 and adapt the EUDAT service structure the current self-written WCS software package shall be replaced by a modernized and more efficient out of the box solution in order to improve efficiency and connectivity The WCS 2.0 service shall be harvested by the EUDAT B2FIND service Selected data products that are frequently requested shall be stored in B2SHARE users of our web interface (JOIN) have the opportunity to store their data selections with a PID in B2SHARE for referencing them in publications

The expected future impact Future prospectives CAMS data stored on the JADDS server are available much longer than at the originating centre ECMWF and can thus be used for scientific analyses such as interpretation of field campaign data or model intercomparison projects. Through the web interface Jülich OWS Interface (JOIN; https://join.fz-juelich.de) they can also be interactively visualized and compared to observational data JADDS can be expanded to distribute other datasets with similar properties, such as meteorological reanalyses or satellite data products This way, JADDS can serve as a prototype for other web services providing scientific data from the earth system