GSICS Data Management Working Group Report

Slides:



Advertisements
Similar presentations
GSICS EP Meeting 2015 – Report from the GSICS Data Management Working Group 1 Report from the GSICS Data Management Working Group Peter Miu / Masaya Takahashi.
Advertisements

GSICS 2015 GDWG Breakout Session 1 Repository For GSICS Work Code Peter Miu EUMETSAT CMA, CNES, EUMETSAT, ISRO, IMD, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET,
GSICS Data and Products Servers Volker Gärtner (EUMETSAT) For GSICS Data Working Group.
GSICS GDWG Report, Toulouse, 9 February GSICS Data Working Group Status Report V. Gaertner CMA, EUMETSAT, JMA, KMA, NOAA/NESDIS, WMO.
GSICS web meeting on Planning for Annual GSICS WG meeting Agenda.
2015 GSCIS annual meeting, March, 2015, New Delhi, India 1 GDWG Agenda Item New GSICS Products Masaya Takahashi, JMA CMA, CNES, EUMETSAT, ISRO, IMD,
JMA GDWG Report 1 Masaya Takahashi Meteorological Satellite Center / Japan Meteorological Agency (visiting scientist at EUMETSAT from Mar to Feb.
GSICS 2016 – Plenary Session, GDWG Report 1 GDWG Report 2015 / 2016 Peter Miu / Masaya Takahashi CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA,
1.Bob Iacovazzi (NOAA) - Road to Pre-operational Phase Presentation 2.All – Discussion & Feedback 3.Tim Hewison (EUMETSAT) – Reminders: Korea, Conference,
2013 GSICS Joint Meeting, Williamsburg VA, USA, March GSICS Collaboration Servers Status: 2013 Peter Miu (EUMETSAT) CMA, CNES, EUMETSAT, ISRO,
GSICS 2015 GDWG Breakout Session 1 GSICS Collaboration Servers Peter Miu EUMETSAT CMA, CNES, EUMETSAT, ISRO, IMD, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET,
Highlights (Actions) of GSICS Exec Panel 30 October 2009 Volker Gärtner.
GSICS Baseline Website Review
Marianne König, Tim Hewison, Peter Miu
Manik Bali and Lori Brown Annual Meeting Madison, Wisconsin
GSICS Baseline Review: Tools – e.g. GSICS Bias Plotting Tool
DCC Product Requirements for GSICS Plotting Tool
GDWG Agenda Item: Tools for GRWG activities
Summary of GDWG breakout session
GSICS Collaboration Servers a Vehicle for International Collaboration Status 2011 Peter Miu EUMETSAT.
GSICS Instrument Event Logs: Rational and Draft Template
Review of EUMETSAT’s GEO-LEO Correction
CMA NSMC, Beijing, China 5-8 March 2012
GSICS Coordination Center (GCC) Report
GDWG Agenda Item Existing netCDF Format Updates
Reviewing the GSICS Data Management Working Group Terms of Reference
GSICS Baseline Reviews - website, products metadata and structures
GDWG Agenda Item THREDDS Directory Structure Updates
GDWG Agenda Item Repository for GSICS Work - Clarification on Archiving Masaya Takahashi, JMA CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA, NIST,
Rob Roebeling and Peter Miu
Requirements for GSICS Plotting Tool to support VIS/NIR products
Updates on GSICS Operation Plan
GSICS Data Management and Availability to Users
Improvement Suggestions to the Procedure for Product Acceptance
GDWG Agenda Item Baseline Reviews: Website
Manik Bali, Larry Flynn NOAA/STAR
GSICS Data Management Working Group: Break Out Session
Masaya Takahashi (JMA), Peter Miu (EUMETSAT) and Ashi Mitra (IMD)
Rob Roebeling, Viju John, Frank Ruethrich, Tim Hewison EUMETSAT
Drafting Requirements for Instrument Performance Monitoring Systems - Discussion from Data Management point of view Masaya Takahashi (JMA), Peter Miu (EUMETSAT),
GSICS Data Management and Availability to Users
Report from the GSICS Data Management Working Group
JMA Agency Report 2017 Arata Okuyama, Masaya Takahashi and Hidehiko Murata Meteorological Satellite Center, Japan Meteorological Agency.
Masaya Takahashi (JMA)
2b. GSICS Coordination Centre (GCC)
GSICS Product Plotting Web Tool Status: 2013
GDWG Joint Meeting Summary and Actions 2017
JMA Agency Report 2018 Masaya Takahashi, Yusuke Yogo and Hidehiko Murata Meteorological Satellite Center, Japan Meteorological Agency.
Special Issue of the IEEE TGRS on “Inter-Calibration of Satellite Instruments”: 01 January 2019 Report of GRWG: Aims of meeting Review of Actions Proposal.
Summary of GDWG breakout session and Actions 2018
GDWG Meeting Summary 2016 and Work Plan 2016 / 2017
Brief Report of GSICS-EP-18 (June 2017 in Jeju, Korea)
GDWG Fact Sheet - Information Presentation
Rob Roebeling and Peter Miu
GSICS Coordination Center (GCC) Report
Preparatory Web meeting for 2019 Annual Meeting in Frascati, Italy
Masaya Takahashi (JMA)
Masaya Takahashi (JMA), Ashim Mitra (IMD) and Peter Miu (EUMETSAT)
Summary of 2019 GDWG breakout session
Hot summary of the Fourth GSICS Users Workshop
GSICS Baseline Review: Product meta-data and structures
GSICS Server Upgrade - Requirements for New Deliverables
Bias Monitoring Web Page Design
GSICS Data Management Working Group Summary and Action Items
GDWG Terms of Reference
JMA Agency Report 2019 Masaya Takahashi, Yusuke Yogo and Kazuki Kodera
Instrument Specifications and Calibration Information GDWG, March 2019
Masaya Takahashi Japan Meteorological Agency
GSICS Existing Tools Updates
Lunar Calibration Workshop Status of the preparation
Presentation transcript:

GSICS Data Management Working Group Report Aleksandar Jelenak NOAA Satellite and Information Service 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

Outline Membership update GSICS User Messaging Service status update Review of the activities since the last meeting Highlights of the breakout session agenda 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

New JMA representative: Mr. Tetsuro Kurita Membership Update New JMA representative: Mr. Tetsuro Kurita 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

User Messaging Service Update 218 subscribers Since last meeting: 28 new subscribers added 14 messages sent Message open (blue) and click (red) rates: Scan to sign up! 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

Action Items Review 33 action items from the last Joint Meeting All completed! Not aware of any older action items still not completed or closed Given low participation by member organizations it is likely the working group will adopt a different approach from this year: a list of open-ended tasks inviting volunteers to take on 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

Achievements Product catalog GEO-LEO-IR netCDF template Support for the NOAA and EUMETSAT GEO-LEO IR products transitioning into the preoperational phase Special commendation to: EUMETSAT for providing the resources and Peter Miu for the leadership in developing the bias monitoring plotting web app 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

Breakout Session Highlights Common THREDDS configuration NetCDF format for new data sets Satellite instrument event log NetCDF metadata validation tool Official documents Preparation for 2013 users’ workshop Roadmap to 2014 and beyond 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

Common THREDDS Configuration How to organize correction products based on the algorithm type, instrument class, anything else… 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

Common THREDDS Configuration (cont) Represent third-part products Mirror products from other data servers Create virtual datasets by aggregating multi-file products along time dimension Dataset viewers Minimal common content on dataset pages 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

New Data Sets NetCDF Format If any new data sets are planned notify your GDWG representative or chairman as soon as possible Hint: this meeting is an excellent opportunity 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

Instrument Event Logging NOAA proposed an abstract data model but has no resources for an implementation The model can be used both for storing and exchanging event information That model is now in the joint NOAA/NASA draft ISO 19115-2 metadata standard revision proposal EUMETSAT seems to have the resources for an implementation NOAA and EUMETSAT will continue to collaborate towards a common concept 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

NetCDF Metadata Validation Tool Objective validation – takes humans out of the process Modular design allows for validation of both common and data producer specific content Works with local and remote netCDF files Executed as a typical UNIX command line program 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

Official Documents Use of the wiki as document preparation and hosting solution is deprecated Need to migrate a few wiki pages into documents At the last year’s meeting GDWG tasked to come up with a process for numbering official documents (standards, technical reports/notes, white papers, etc.) 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

2013 Users’ Workshop 15-min slot reserved for data management Live demonstration on how to find, plot, and use our data rather then a presentation Any feedback received from your users can help us plan 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.

Roadmap The data production and distribution framework is almost complete Long term data life cycle Processing history of each individual file Services for improving understanding of GSICS data Interfacing with SCOPE-CM 2013 GSICS Joint Working Groups Meeting, Williamsburg, Va., U.S.A.