Masaya Takahashi (JMA), Ashim Mitra (IMD) and Peter Miu (EUMETSAT)

Slides:



Advertisements
Similar presentations
GSICS EP Meeting 2015 – Report from the GSICS Data Management Working Group 1 Report from the GSICS Data Management Working Group Peter Miu / Masaya Takahashi.
Advertisements

GSICS 2015 GDWG Breakout Session 1 Repository For GSICS Work Code Peter Miu EUMETSAT CMA, CNES, EUMETSAT, ISRO, IMD, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET,
2015 GSCIS annual meeting, March, 2015, New Delhi, India 1 GDWG Agenda Item New GSICS Products Masaya Takahashi, JMA CMA, CNES, EUMETSAT, ISRO, IMD,
GSICS 2016 – Plenary Session, GDWG Report 1 GDWG Report 2015 / 2016 Peter Miu / Masaya Takahashi CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA,
2013 GSICS Joint Meeting, Williamsburg VA, USA, March GSICS Collaboration Servers Status: 2013 Peter Miu (EUMETSAT) CMA, CNES, EUMETSAT, ISRO,
GSICS 2015 GDWG Breakout Session 1 GSICS Collaboration Servers Peter Miu EUMETSAT CMA, CNES, EUMETSAT, ISRO, IMD, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET,
GSICS Baseline Website Review
GSICS Reference Documents
Manik Bali and Lori Brown Annual Meeting Madison, Wisconsin
CF Conventions Support
GSICS Baseline Review: Tools – e.g. GSICS Bias Plotting Tool
GSICS Data Management Working Group Report
GSICS Collaboration Servers Statuses and Updates
GSICS TC Calibration Event Logging December 2015 Darmstadt, Germany
GDWG Agenda Item: Tools for GRWG activities
Summary of GDWG breakout session
Rob Roebeling, Peter Miu, and Sebastien Wagner
GSICS Collaboration Servers a Vehicle for International Collaboration Status 2011 Peter Miu EUMETSAT.
Calibration Event Logging Status and Plans Presented to: CGMS-43 WGII/8 Paper: CGMS-43-EUMETSAT-WP-10.
Reviewing the GSICS Data Management Working Group Terms of Reference
GSICS Baseline Reviews - website, products metadata and structures
GDWG Agenda Item THREDDS Directory Structure Updates
Spectral Response Function netCDF towards “GSICS Standard netCDF”
GDWG Agenda Item Repository for GSICS Work - Clarification on Archiving Masaya Takahashi, JMA CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA, NIST,
Rob Roebeling and Peter Miu
JMA’s GSICS and SCOPE-CM activities Presented to CGMS-43 Working Group II session, agenda item 3 (from MTSAT-2) Japan Meteorological Agency.
GSICS Data Management and Availability to Users
Improvement Suggestions to the Procedure for Product Acceptance
GDWG Agenda Item Baseline Reviews: Website
Manik Bali, Larry Flynn NOAA/STAR
Masaya Takahashi (JMA), Peter Miu (EUMETSAT) and Ashi Mitra (IMD)
Peter Miu / Masaya Takahashi
Rob Roebeling, Viju John, Frank Ruethrich, Tim Hewison EUMETSAT
GSICS Data Management and Availability to Users
Report from the GSICS Data Management Working Group
JMA Agency Report 2017 Arata Okuyama, Masaya Takahashi and Hidehiko Murata Meteorological Satellite Center, Japan Meteorological Agency.
YourOrganisation Agency Report Year
Masaya Takahashi (JMA)
Annual GSICS Calibration Report for {Agency}
Masaya Takahashi (JMA), Dohyeong Kim (KMA),
2b. GSICS Coordination Centre (GCC)
GSICS Coordination Center GSICS EP- Debrief
Xiangqian WU and Fangfang YU with contributions from
GSICS Product Plotting Web Tool Status: 2013
GDWG Joint Meeting Summary and Actions 2017
JMA Agency Report 2018 Masaya Takahashi, Yusuke Yogo and Hidehiko Murata Meteorological Satellite Center, Japan Meteorological Agency.
Summary of GDWG breakout session and Actions 2018
GDWG Meeting Summary 2016 and Work Plan 2016 / 2017
Brief Report of GSICS-EP-18 (June 2017 in Jeju, Korea)
GDWG Fact Sheet - Information Presentation
Rob Roebeling and Peter Miu
Preparatory Web meeting for 2018 Annual Meeting in Shanghai, China
GDWG – Future Collaboration
Masaya Takahashi (JMA)
Summary of 2019 GDWG breakout session
GSICS Baseline Review: Product meta-data and structures
GSICS Server Upgrade - Requirements for New Deliverables
GSICS Collaboration Servers 2019
Masaya Takahashi Japan Meteorological Agency
GSICS Data Management Working Group Summary and Action Items
YourOrganisation Agency Report Year
GDWG Terms of Reference
JMA Agency Report 2019 Masaya Takahashi, Yusuke Yogo and Kazuki Kodera
6n. Use of gitHub for GSICS developments
Instrument Specifications and Calibration Information GDWG, March 2019
Infrared Sub-Group Report Tim Hewison
Masaya Takahashi Japan Meteorological Agency
Automated Validation Tool for GSICS Candidate Products (GPPA automation) Peter Miu CMA, CNES, ESA, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA, NIST, NOAA,
GSICS Existing Tools Updates
GSICS Documentation Discussion - classification and storage
Presentation transcript:

Masaya Takahashi (JMA), Ashim Mitra (IMD) and Peter Miu (EUMETSAT) GDWG Report 2019 Masaya Takahashi (JMA), Ashim Mitra (IMD) and Peter Miu (EUMETSAT)

Contents Brief introduction to GDWG Membership and recent GDWG activities Notable GDWG actions GSICS Collaboration Servers Use of GitHub for collaborative work Instrument Event Logging Action Tracking Agenda items at GDWG breakout session

GDWG? Advisory body of GSICS-EP for data management and exchange issues Composed of Data Management experts To coordinate/support specification of: data/metadata formats/procedures for data exchange among agencies GSICS systems/tools administered by GSICS (e.g. Wiki, Product Catalogue) To review/validate GSICS Deliverables from DM perspective To provide guidance to contents/appearance of GSICS websites

Membership and recent GDWG activities GSICS Collaboration Servers Mirroring products ISRO new server Defining GSICS Conventions for new GSICS Deliverables Updating GSICS Plotting Tool Use of GitHub for collaborative work Instrument Event Logging Action Tracking Tool (GCC+GDWG) GDWG Actions 20 actions at 2018 Annual Meeting 13 open actions at past meetings Affiliation First Name Last Name CMA Zhe Xu Yuan Li Min Di Xian EUMETSAT Peter Miu Simon Elliott IMD R.K. Giri ISRO Nitant Dube JMA Masaya  Takahashi KMA Jin Woo Hyunjong Oh NOAA Manik Bali ROSHYDROMET Sergey Uspensky WMO Toshiyuki Kurino

GSICS Collaboration Servers (1/2) GDWG Notable Actions GSICS Collaboration Servers (1/2) Collaboration Server: individually known as Data and Products server To provide a set of services for users to support data exchange/access to inter-calibration deliverables GSICS Inter-calibration Products (GSICS Correction, netCDF) Intermediate data to generate products (e.g. GEO-LEO-IR collocation netCDF) Source dataset (inputs to inter-calibration ATBD like LEO L1 data) 3 servers at CMA/EUM/NOAA KMA/JMA products: sent to EUM

GSICS Collaboration Servers (2/2) GDWG Notable Actions GSICS Collaboration Servers (2/2) Preservation of GSICS Products among Servers Products in Operational Phase (currently SEVIRI-IASI IR only) A way to get products has been discussed to overcome security constraints CMA/NOAA created/tested scripts to download products from Collaboration Servers New GSICS Sever at ISRO 2017: ISRO launched the server storing their GSICS Products EUMETSAT/ISRO collaboration for 4th Collaboration Server: underway

Use of GitHub for collaborative work GDWG Notable Actions Use of GitHub for collaborative work GDWG GitHub repository: created by KMA in 2017 To collaboratively maintain/develop GDWG relevant tools/software GSICS Plotting Tool: developed at EUMETSAT Visualizing GSICS products on GSICS Collaboration Server Very useful to compare multiple products, but IR Re-Analysis Correction are only supported ISRO updated Plotting Tool to support Near Real Time Correction as well Sharing codes in GitHub: to be discussed VNIR products: to be supported at EUMETSAT’s MICMICS and hopefully be shared with GSICS community in future (R.GDWG.2018.5g.1) MSG-3/SEVIRI IR10.8 MSG-4/SEVIRI IR10.8 Himawari-8/AHI B13 (10.4 μm)

Instrument Events Logging GDWG Notable Actions Instrument Events Logging CGMS Task Team on Calibration Events Logging Lead by Rob Roebeling (EUM), mainly composed of GDWG members Goal: to develop a uniform approach for presenting, logging, and monitoring calibration information across satellite operators A white paper was submitted to CGMS-45 (June 2017) 1st step: to create stable Landing Pages linked from WMO OSCAR/Space 2018: ROSHYDROMET launched their Landing Page Minor updates of OSCAR/Space to get more traffics to Landing Pages 2nd step: to adopt nomenclature and standards for instrument events Establishing sub-working group with technical/database experts needed Further tasks were back to CGMS-46 in 2018 due to difficulty of achieving the goal under the current GDWG

WMO OSCAR/Space Hyperlink to Satellite Operator’s Landing Page Landing Page at JMA Hyperlink to Satellite Operator’s Landing Page

Instrument Events Logging GDWG Notable Actions Instrument Events Logging CGMS Task Team on Calibration Events Logging Lead by Rob Roebeling (EUM), mainly composed of GDWG members Goal: to develop a uniform approach for presenting, logging, and monitoring calibration information across satellite operators A white paper was submitted to CGMS-45 (June 2017) 1st step: to create stable Landing Pages linked from WMO OSCAR/Space 2018: ROSHYDROMET launched their Landing Page Minor updates of OSCAR/Space to get more traffics to Landing Pages 2nd step: to adopt nomenclature and standards for instrument events Establishing sub-working group with technical/database experts needed Further tasks were back to CGMS-46 in 2018 due to difficulty of achieving the goal under the current GDWG

GSICS Action Tracking Actions until 2016: tracked on the Wiki Action Tracking Page on GCC Website Periodical updates by Manik Bali (GCC + NOAA GDWG) to improve usability Supporting GSICS-EP actions, reducing redundant columns, …

Lunch Break + Visit to the PHI-Experience GDWG Session (Wed) 08:30 Masaya Takahashi JMA Round Table Introduction + GDWG Actions Review 6a 0:30 9:00 Alexander Uspensky ROSHYDROMET New Russian Cal/Val portal on meteorological satellite instruments and products 6b 0:20 9:20 Jin Woo KMA GDWG Baseline Reviews - website, products metadata and structures 6c 9:50 Toshiyuki Kurino WMO New WMO GSICS Portal 6d  0:40 10:30 Coffee break 11:00 GSICS Convention for Spectral Response Function files 6e Peter Miu EUMETSAT How EUMETSAT’s pathfinder activities would benefit GSICS 6f 11:40 All Discussion 6g 12:00 Lunch Break + Visit to the PHI-Experience 2:00 14:00 Mirko Albani ESA CEOS Working Group on Information Systems and Services (WGISS) 6h 14:30 Andrea Della Vecchia / Damiano Guerrucci ESA Collaborative Environment for Cal/Val 6i 15:00 Rob Roebeling Event Logging 6j 15:30 Xiangqian (Fred) Wu NOAA GOES-16/-17 ABI Calibration Event Log 6k 15:50 16:20 Zhe (Thomas) Xu / Di Xian CMA FY historical Big Data Reprocessing system establishment and sharing 6l 16:50 Links from WMO OSCAR/Space to Calibration Landing Page 6m 17:20 Use of GitHub - updates 6n 17:50 6o

GDWG Session (Thu) 8:30 Peter Miu EUMETSAT GSICS Collaboration Servers - History, Updates 9a 0:20 8:50 Nitant Dube ISRO Status of THREDDS for GSICS Collaboration Servers 9b 0:40 9:30 Zhe (Thomas) Xu CMA Updates on GSICS Collaboration Servers 9c 9:50 Manik Bali NOAA Affiliate 9d 10:10 Coffee break 0:30 10:40 Lin Chen PICS/SNO data extraction function 9e 11:00 Data Dissemination 9f 11:20 Masaya Takahashi JMA Visualization of GSICS Products on GSICS Plotting Tool - Current Status and User Requirements 9g 11:40 Implementation of GSICS Plotting Tool at ISRO 9h All Discussion for future updates/collaboration on GSICS Collaboration Servers and Plotting Tool 9p 12:00 Lunch Break 1:00 13:00 Visualization of GSICS Products on GSICS Product Catalog 9i 13:30 Access for GSICS on Clouds 9j 14:00 Action tracking 9k 14:30 GSICS Wiki Migration 9l 15:00 15:30 EUMETAT Automated validation tool for candidate GSICS products 9m 16:30 Wrap-up: Plan activities for 2019/2020 9n 17:00 END

Thanks for your attention! Questions?