GSICS Data Management and Availability to Users

Slides:



Advertisements
Similar presentations
GSICS EP Meeting 2015 – GSICS Archiving Strategy 1 GSICS Archiving Strategy Peter Miu / Boulder, USA CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA,
Advertisements

GSICS EP Meeting 2015 – Report from the GSICS Data Management Working Group 1 Report from the GSICS Data Management Working Group Peter Miu / Masaya Takahashi.
Xiangqian Wu and Mitch Goldberg NOAA/NESDIS Center for Satellite Applications and Research (STAR) P1.16 GLOBAL SPACE-BASED INTER-CALIBRATION SYSTEM (GSICS)
The Global Space-based Inter- Calibration System Mitch Goldberg, NOAA/NESDIS GSICS Executive Panel chair NOAA/NESDIS.
GSICS 2015 GDWG Breakout Session 1 Repository For GSICS Work Code Peter Miu EUMETSAT CMA, CNES, EUMETSAT, ISRO, IMD, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET,
GSICS Data and Products Servers Volker Gärtner (EUMETSAT) For GSICS Data Working Group.
GSICS GDWG Report, Toulouse, 9 February GSICS Data Working Group Status Report V. Gaertner CMA, EUMETSAT, JMA, KMA, NOAA/NESDIS, WMO.
2015 GSCIS annual meeting, March, 2015, New Delhi, India 1 GDWG Agenda Item New GSICS Products Masaya Takahashi, JMA CMA, CNES, EUMETSAT, ISRO, IMD,
GSICS 2016 – Plenary Session, GDWG Report 1 GDWG Report 2015 / 2016 Peter Miu / Masaya Takahashi CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA,
2013 GSICS Joint Meeting, Williamsburg VA, USA, March GSICS Collaboration Servers Status: 2013 Peter Miu (EUMETSAT) CMA, CNES, EUMETSAT, ISRO,
GSICS 2015 GDWG Breakout Session 1 GSICS Collaboration Servers Peter Miu EUMETSAT CMA, CNES, EUMETSAT, ISRO, IMD, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET,
2015 GSCIS annual meeting, March, 2015, New Delhi, India 1 GSICS Products' Content Access Study Proposal Zhe(Thomas) Xu, CMA CMA, CNES, EUMETSAT,
GSICS Baseline Website Review
GSICS Reference Documents
CF Conventions Support
GSICS Baseline Review: Tools – e.g. GSICS Bias Plotting Tool
GSICS Data Management Working Group Report
GSICS Collaboration Servers Statuses and Updates
GDWG Agenda Item: Tools for GRWG activities
Jerome Lafeuille WMO Space Programme Office
GSICS Collaboration Servers a Vehicle for International Collaboration Status 2011 Peter Miu EUMETSAT.
Introducing Me, GSICS, and the UV Sub-Group
GDWG Agenda Item Existing netCDF Format Updates
Reviewing the GSICS Data Management Working Group Terms of Reference
GSICS Baseline Reviews - website, products metadata and structures
Sébastien Wagner, Tim Hewison In collaboration with D. Doelling (NASA)
DOI Overview to Support its Use in GSICS
GDWG Agenda Item THREDDS Directory Structure Updates
Introduction to the Global Space-based InterCalibration System
GDWG Agenda Item Repository for GSICS Work - Clarification on Archiving Masaya Takahashi, JMA CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA, NIST,
Rob Roebeling and Peter Miu
GSICS Data Management and Availability to Users
Improvement Suggestions to the Procedure for Product Acceptance
5g. Repository For GSICS Work Use of github for codes etc
GDWG Agenda Item Baseline Reviews: Website
Masaya Takahashi (JMA), Peter Miu (EUMETSAT) and Ashi Mitra (IMD)
Rob Roebeling, Viju John, Frank Ruethrich, Tim Hewison EUMETSAT
Report from the GSICS Data Management Working Group
YourOrganisation Agency Report Year
Masaya Takahashi (JMA)
GSICS Product Plotting Web Tool Status: 2013
GDWG Joint Meeting Summary and Actions 2017
ToR & Future Chairing of the GDWG
Summary of GDWG breakout session and Actions 2018
Technical aspects of the GIRO work: inputs from GRWG
DOI Overview and its Usage for EUMETSAT GSICS Objects
GDWG Meeting Summary 2016 and Work Plan 2016 / 2017
Brief Report of GSICS-EP-18 (June 2017 in Jeju, Korea)
GDWG Fact Sheet - Information Presentation
Rob Roebeling and Peter Miu
GDWG – Future Collaboration
Masaya Takahashi (JMA)
Masaya Takahashi (JMA), Ashim Mitra (IMD) and Peter Miu (EUMETSAT)
Chairing of the GDWG Peter Miu
Summary of 2019 GDWG breakout session
Hot summary of the Fourth GSICS Users Workshop
GSICS Baseline Review: Product meta-data and structures
EUMETSAT PathFinders Peter Miu
GSICS Collaboration Servers 2019
Masaya Takahashi Japan Meteorological Agency
GSICS Data Management Working Group Summary and Action Items
YourOrganisation Agency Report Year
GDWG Terms of Reference
6n. Use of gitHub for GSICS developments
Instrument Specifications and Calibration Information GDWG, March 2019
GRWG Chairing Dohyeong Kim GRWG Chair.
Masaya Takahashi Japan Meteorological Agency
Automated Validation Tool for GSICS Candidate Products (GPPA automation) Peter Miu CMA, CNES, ESA, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA, NIST, NOAA,
GSICS Existing Tools Updates
GSICS Documentation Discussion - classification and storage
Presentation transcript:

GSICS Data Management and Availability to Users 11 November 2018 GSICS Data Management and Availability to Users Peter Miu1 on Behalf of the GSICS Data Management Working Group EUMETSAT

Outline of Presentation Introduction to the GSICS Data Management Working Group Who We Are. What We Do. GDWG Developments Collaboration Servers; Each Partner’s GSICS Data and Products Server Accessing GSICS Products (Demo) Products Plotting Tool (Demo) Users Messaging Service Products Catalogue (Demo) Future Developments

GSICS Data Management Work Group (GDWG) The GSICS Executive Panel, consisting of representatives of the participating agencies who sets strategic priorities, and monitors and evaluates GSICS evolution and operations. Like the GSICS Research Working Group (GRWG), the GDWG comprises of at least one data management expert from each of the GSICS participating agencies. The GDWG advises the GSICS Executive Panel of the data management needs of the GSICS project as well assist in the planning and implementation of these activities. In other words, the GDWG is responsible for: Discussing and agreeing on GRWG & User requirements on how to support new Data Management and other technical needs of the project from software and hardware point of view. Discuss and agree on inter-operable elements such as formats, conventions and standards to adopt. Review the existing and developing GSICS system to ensure they still fulfil their requirements. Come to a census on priorities, responsibilities and agree on the work plan for this support. EUMETSAT CNES JMA NOAA CMA KMA ISRO NASA WMO USGS NIST JAXA ROSHYDROMET IMD ESA Well, what is GSICS? The Global Space-based Inter-Calibration System (GSICS) is an initiative of CGMS and WMO, which aims to ensure consistent calibration and inter-calibration of operational meteorological satellite instruments. One of the basic strategies of GSICS is to develop an integrated on-orbit cal/val system - initially by LEO-GEO Inter-satellite/inter-sensor calibration. This will then allow us to provide corrections to improve the consistency between instruments, produce less biased level 1, and therefore, level 2 data, and ultimately, retrospectively re-calibrate archive data, which is of great interest in the climate monitoring community

GDWG Developments: Collaboration Servers What are the GSICS Collaboration Servers? Individually, the servers are also known as Data and Products server provide a set of services for the GSICS user community to support data exchange and access to relevant products to support the calibration of satellite data. Who has implemented one of these servers? EUMETSAT has a fully operational server receiving comparable satellite data sets from the EUMETSAT and JMA. Pre-operational GSICS products are sent daily to the server for validation by experts in the GSICS community. These should be finalised this year and the products shall be archived by a participating agency (for example, the EUMETSAT Data Centre Archive). NOAA has implemented a GSICS server providing another operational node for the GSICS collaboration servers network. The server references source and Intermediate Data Sets from the EUMETSAT GSICS server as well as offer pre-operational GSICS Products. CMA are in the process of implementing their own GSICS servers to be part of the GSICS collaboration servers network.

GDWG Developments: Data and Products Server

GDWG Developments: Collaboration Servers

GDWG Developments: Accessing GSICS Products Currently: All products are accessed manually via one of the Collaboration Servers. http://gsics.eumetsat.int (Demo) http://gsics.nesdis.noaa.gov:8080/thredds/catalog.html Future: Real time products availability notification plus additional tools for automated download. Ordering of GSICS products from a participating partners’ data archive.

GDWG Developments: Products Plotting Tool The tool plots the contents of GSICS products. Its purpose is to allow product developers and users to quickly assess the GSICS products during their development. Once the products are operational, visually see the changes in the monitoring instruments.

GDWG Developments: Users Messaging Service Registering with the GSICS User Messaging Service to gain access to all official GSICS communication ; News letters, Product Updates, ... http://

GDWG Developments: GSICS Products Catalogue This catalogue lists information related to all GSICS products.

Future Developments Automating Products Distribution; to investigate how to efficiently distribute GSICS products to our users in a timely fashion. Archiving of the GSICS Products; who does it and what is archived. Instrument History Presentation: what attributes are to be recorded for an instrument and how to present these in the most useful manner for the user (visually, database search,...). Operations; investigate how to conduct in an efficient manner support to users’ requests and enquiries across different international agencies. Operations; investigate how to coordinate efficiently join developments across different international agencies.

Users Feedback GSICS is progressing towards an Operational system User feedback is very important to us, it helps with focusing on where to concentrate our resources. Tell us what products you would like to see. How we can improve our services to you. Users are encouraged to register with the User Messaging Service to receive the latest information; this will help with who to contact regarding support and requests. GSICS Home Website is: http://gsics.wmo.int/

11 November 2018 Thank You Any Questions?