2015 GSCIS annual meeting, 16-20 March, 2015, New Delhi, India 1 GDWG Agenda Item New GSICS Products Masaya Takahashi, JMA CMA, CNES, EUMETSAT, ISRO, IMD,

Slides:



Advertisements
Similar presentations
GSICS EP Meeting 2015 – GSICS Archiving Strategy 1 GSICS Archiving Strategy Peter Miu / Boulder, USA CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA,
Advertisements

GSICS EP Meeting 2015 – Report from the GSICS Data Management Working Group 1 Report from the GSICS Data Management Working Group Peter Miu / Masaya Takahashi.
The Global Space-based Inter- Calibration System Mitch Goldberg, NOAA/NESDIS GSICS Executive Panel chair NOAA/NESDIS.
GSICS 2015 GDWG Breakout Session 1 Repository For GSICS Work Code Peter Miu EUMETSAT CMA, CNES, EUMETSAT, ISRO, IMD, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET,
GSICS Data and Products Servers Volker Gärtner (EUMETSAT) For GSICS Data Working Group.
16-20 March, GSICS Coordination Centre (GCC) Report Larry Flynn and Manik Bali 2015 GSICS Annual Meeting New Delhi, India March 16-20,
2015 GSCIS annual meeting, March, 2015, New Delhi, India 1 GRWG Requirements Summary on Data, Products, and Tools - for GDWG Understanding Masaya.
JMA GDWG Report 1 Masaya Takahashi Meteorological Satellite Center / Japan Meteorological Agency (visiting scientist at EUMETSAT from Mar to Feb.
GSICS Coordination Center Report Fangfang Yu, Fuzhong Weng, Fred Wu and George Ohring NOAA/Center for Satellite Applications and Research 8 April, 2013.
GSICS 2016 – Plenary Session, GDWG Report 1 GDWG Report 2015 / 2016 Peter Miu / Masaya Takahashi CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA,
2013 GSICS Joint Meeting, Williamsburg VA, USA, March GSICS Collaboration Servers Status: 2013 Peter Miu (EUMETSAT) CMA, CNES, EUMETSAT, ISRO,
GSICS 2015 GDWG Breakout Session 1 GSICS Collaboration Servers Peter Miu EUMETSAT CMA, CNES, EUMETSAT, ISRO, IMD, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET,
2015 GSCIS annual meeting, March, 2015, New Delhi, India 1 GSICS Products' Content Access Study Proposal Zhe(Thomas) Xu, CMA CMA, CNES, EUMETSAT,
GSICS Baseline Website Review
CF Conventions Support
Masaya Takahashi (JMA) and Sebastien Wagner (EUMETSAT)
Updating Action Tracking Way
GSICS Baseline Review: Tools – e.g. GSICS Bias Plotting Tool
DCC Product Requirements for GSICS Plotting Tool
GSICS Collaboration Servers Statuses and Updates
Strategy for combining corrections for VIS/NIR+IR channels and plotting tool S. Wagner, T. Hewison (EUM) M. Takahashi (JMA)
GDWG Agenda Item: Tools for GRWG activities
Summary of GDWG breakout session
GDWG Agenda Item Existing netCDF Format Updates
Reviewing the GSICS Data Management Working Group Terms of Reference
GSICS Baseline Reviews - website, products metadata and structures
DOI Overview to Support its Use in GSICS
GDWG Agenda Item THREDDS Directory Structure Updates
Spectral Response Function netCDF towards “GSICS Standard netCDF”
GDWG Agenda Item Repository for GSICS Work - Clarification on Archiving Masaya Takahashi, JMA CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA, NIST,
Requirements for GSICS Plotting Tool to support VIS/NIR products
GSICS Data Management and Availability to Users
Improvement Suggestions to the Procedure for Product Acceptance
5g. Repository For GSICS Work Use of github for codes etc
GDWG Agenda Item Baseline Reviews: Website
Manik Bali, Larry Flynn NOAA/STAR
Masaya Takahashi (JMA), Peter Miu (EUMETSAT) and Ashi Mitra (IMD)
GSICS Data Management and Availability to Users
Masaya Takahashi (JMA) and Sebastien Wagner (EUMETSAT)
Report from the GSICS Data Management Working Group
JMA Agency Report 2017 Arata Okuyama, Masaya Takahashi and Hidehiko Murata Meteorological Satellite Center, Japan Meteorological Agency.
YourOrganisation Agency Report Year
Masaya Takahashi (JMA)
Updating GSICS Plotting Tool to support VISNIR products
GSICS Product Plotting Web Tool Status: 2013
GDWG Joint Meeting Summary and Actions 2017
ToR & Future Chairing of the GDWG
Requirements on GSICS Plotting Tool to support VISNIR products
Summary of GDWG breakout session and Actions 2018
GDWG Meeting Summary 2016 and Work Plan 2016 / 2017
Brief Report of GSICS-EP-18 (June 2017 in Jeju, Korea)
GDWG Fact Sheet - Information Presentation
GDWG – Future Collaboration
Masaya Takahashi (JMA)
Chairing of the GDWG Peter Miu
Summary of 2019 GDWG breakout session
GSICS Baseline Review: Product meta-data and structures
GSICS Collaboration Servers 2019
Masaya Takahashi Japan Meteorological Agency
GSICS Data Management Working Group Summary and Action Items
YourOrganisation Agency Report Year
GDWG Terms of Reference
JMA Agency Report 2019 Masaya Takahashi, Yusuke Yogo and Kazuki Kodera
6n. Use of gitHub for GSICS developments
GRWG Chairing Dohyeong Kim GRWG Chair.
Masaya Takahashi Japan Meteorological Agency
Automated Validation Tool for GSICS Candidate Products (GPPA automation) Peter Miu CMA, CNES, ESA, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA, NIST, NOAA,
GSICS Existing Tools Updates
GSICS Documentation Discussion - classification and storage
Towards a GSICS DCC product...
Presentation transcript:

2015 GSCIS annual meeting, March, 2015, New Delhi, India 1 GDWG Agenda Item New GSICS Products Masaya Takahashi, JMA CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET, USGS, WMO

2015 GSCIS annual meeting, March, 2015, New Delhi, India Overview and Purpose  Overview  Forthcoming new GSICS products in 2015 GEO-LEO-VISNIR (multiple calibration methods blended product) –Masaya Takahashi and Sebastien Wagner showed the proposal in 2014 GSICS Prime correction for GEO-LEO-IR (multiple references blended product) –Masaya Takahashi and Tim Hewison showed the proposal in 2014  Long-term plan (discussion) One GSCIS Correction file for one instrument (e.g., merge the IR product with the VIS/NIR one)  All the future products require new file naming/netCDF conventions  Purpose of this presentation  To introduce the GRWG plans/discussions/proposal  To discuss the feasibility, and accept the proposal or provide alternative solutions to GRWG 2

2015 GSCIS annual meeting, March, 2015, New Delhi, India Requirements for updating the current file naming / netCDF conventions  Summary of issues on the new GSCIS products  GEO-LEO-VISNIR This algorithm type contains “multiple methods’ results” in one file Addition of the THREDDS directories is necessary GRWG requirements: GDWG to investigate the method to implement multiple calibration methods’ results in one netCDF file  GSICS Prime Correction for GEO-LEO-IR Change of file naming: slightly different file naming from existing GEO-LEO-IR This product contains “multiple references’ results” in one file Change of THREDDS directory structure is necessary GRWG requirements: GDWG to discuss whether the file naming is acceptable or not  One GSCIS Correction file for one target instrument The same issue as GEO-LEO-VISNIR product  Note  Once these variables are changed, the bias plotting tool should also be modified  Topics on the THREDDS configuration will be discussed on Thursday 6c 3 To be discussed in this session

2015 GSCIS annual meeting, March, 2015, New Delhi, India GDWG Proposed Solution for issued on the new GSCIS products 4  Topic 1: How to implement multiple methods/references results in one file  S1: Use netCDF-4 “grouping” functionality (enhanced format)  S2: Use different global attributes / dimensions / variables for each inter-calibration method  S3: Produce one file for one method / reference  Topic 2: Is multiple file naming for the same algorithm type acceptable?  S1: Accept GRWG proposal (accept multiple file naming)  S2: Reject the proposal and provide alternative solution

2015 GSCIS annual meeting, March, 2015, New Delhi, India Discussion topic 1: How to implement multiple methods/references results in one file 5  S1: Use netCDF-4 “grouping” functionality (enhanced format)  pros: convenient for users (?) easy-to-maintain for developers  cons: plotting tool does not support ? enhanced data model is not preferable? Why?  S2: Use different global attributes / dimensions / variables for each inter-calibration method  pros: no need to use enhanced model  cons: complicated global attributes / variables, inconvenient?  S3: Produce one file for one method / reference  pros: simple for developers  cons: inconvenient for users

2015 GSCIS annual meeting, March, 2015, New Delhi, India Discussion topic 1: How to implement multiple methods/references results in one file 6  S1: Use netCDF-4 “grouping” functionality (enhanced format) Combined result (DCC+Moon+…) Global attributes, Dimensions, Variables Method1 (Deep Convective Cloud) Global attributes, Dimensions, Variables Method2 (Moon) Global attributes, Dimensions, Variables SEVIRI vs. Aqua/MODIS VISNIR product... Method3 (Desert) Global attributes, Dimensions, Variables schematic image of usage of “grouping”  S2: Use different global attributes / dimensions / variables for each method float coeff(nmethod, ncoeff, date, chan) ; offset:_FillValue = " " ; offset:long_name = “Inter-calibration coefficients" ; offset:units = “W m-2 sr-1 um-1" ; double date(nmethod, date) ; standard_name: time; calendar: gregorian; units: seconds since T00:00:00Z; Common variables can be merged To put method-specific variables, additional information (e.g., prefix) is necessary for variable name float dcc_mon_mode_dc(date, chan) ; float dcc_ref_mode_dc(date, chan) ; float moon_mon_irr_obs(date, chan) ; float moon_mon_irr_rolo(date, chan) ; … Prefix to distinguish the inter-calibration method

2015 GSCIS annual meeting, March, 2015, New Delhi, India Discussion topic 2: Is multiple file naming for the same algorithm type acceptable? 7 1) Existing GEO-LEO-IR products One reference in one file (e.g., MSG3/SEVIRI-MetOpA/IASI, MSG3/SEVIRI-MetOpB/IASI) Need to specify the “Reference Instrument Name” in a filename e.g., W_XX-EUMETSAT-Darmstadt,SATCAL+RAC+GEOLEOIR,MSG2+SEVIRI-MetOpA+IASI_C_EUMG_ _preop_01.nc 2) GSICS Prime Correction (at that time, this is for GEO-LEO-IR) Multiple reference (blended results) in one file No need to specify the “Reference Instrument Name” in a filename e.g., W_XX-EUMETSAT-Darmstadt,SATCAL+RAC+GEOLEOIR,MSG2+SEVIRI_C_EUMG_ _preop_01.nc Each GPRC will continue producing 1) even if 2) is produced Any possible issues on the proposal from the GDWG point of view? If the proposal is NOT accepted, dummy reference instrument name would be added, but redundant! e.g., W_XX-EUMETSAT-Darmstadt,SATCAL+RAC+GEOLEOIR,MSG2+SEVIRI- PrimaryRef_C_EUMG_ _preop_01.nc

2015 GSCIS annual meeting, March, 2015, New Delhi, India GDWG discussion on the details on the proposed solution (to be updated in the discussion)  The GDWG accepted/rejected the GRWG proposal because…  Resources Needed:  Man Days Effort: Prepare a documentation to update the GSICS bias plotting tool– 1 week. Implementation – 1 week.  HW & SW Procurements: not applicable  Input Data Acquisition Effort: not applicable  Proposed Time Scale:  GEO-LEO-VISNIR product and GEO-LEO-IR Prime Correction will become available in 2015, so this change should be done by the 2016 GSICS annual meeting  Deliverables:  New GSCIS netCDF convention for GEO-LEO-VISNIR and GEO-LEO-IR Prime Correction (,and future GSCIS products)  Updated bias plotting tool  Priority of the Task: Medium – by the next GSCIS annual meeting 8

2015 GSCIS annual meeting, March, 2015, New Delhi, India Agenda item summary; assign action identifier, make EP recommendations and propose a lead for the action (to be updated in the discussion)  Action Identifier: GDWG_15.XX  Substantial effort if required by the GDWG, GDWG chair should inform this activity to GSICS Executive Panel, and ask for feedback regarding: Should GDWG resources be used to update the GSICS bias plotting tool for GSICS activities. The GDWG estimates 2 weeks of resources is needed to support this action.  Identify the Working Group Member Taking the Lead on this Action:  EUMETSAT for updating the bias plotting tool. The EP is invited to comment on this if the action is to be performed. 9

2015 GSCIS annual meeting, March, 2015, New Delhi, India 10 End of Presentation: Thank you for your attention WMO GSICS Portal GSICS Coordination Centre GSICS Product Catalog EUMETSAT’s Data and Management Server