2015 GSCIS annual meeting, 16-20 March, 2015, New Delhi, India 1 GSICS Products' Content Access Study Proposal Zhe(Thomas) Xu, CMA CMA, CNES, EUMETSAT,

Slides:



Advertisements
Similar presentations
GSICS EP Meeting 2015 – GSICS Archiving Strategy 1 GSICS Archiving Strategy Peter Miu / Boulder, USA CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA,
Advertisements

GSICS EP Meeting 2015 – Report from the GSICS Data Management Working Group 1 Report from the GSICS Data Management Working Group Peter Miu / Masaya Takahashi.
GSICS 2015 GDWG Breakout Session 1 Repository For GSICS Work Code Peter Miu EUMETSAT CMA, CNES, EUMETSAT, ISRO, IMD, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET,
GSICS Data and Products Servers Volker Gärtner (EUMETSAT) For GSICS Data Working Group.
GSICS GDWG Report, Toulouse, 9 February GSICS Data Working Group Status Report V. Gaertner CMA, EUMETSAT, JMA, KMA, NOAA/NESDIS, WMO.
2015 GSCIS annual meeting, March, 2015, New Delhi, India 1 GDWG Agenda Item New GSICS Products Masaya Takahashi, JMA CMA, CNES, EUMETSAT, ISRO, IMD,
2015 GSCIS annual meeting, March, 2015, New Delhi, India 1 GRWG Requirements Summary on Data, Products, and Tools - for GDWG Understanding Masaya.
JMA GDWG Report 1 Masaya Takahashi Meteorological Satellite Center / Japan Meteorological Agency (visiting scientist at EUMETSAT from Mar to Feb.
GSICS 2016 – Plenary Session, GDWG Report 1 GDWG Report 2015 / 2016 Peter Miu / Masaya Takahashi CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA,
2013 GSICS Joint Meeting, Williamsburg VA, USA, March GSICS Collaboration Servers Status: 2013 Peter Miu (EUMETSAT) CMA, CNES, EUMETSAT, ISRO,
GSICS 2015 GDWG Breakout Session 1 GSICS Collaboration Servers Peter Miu EUMETSAT CMA, CNES, EUMETSAT, ISRO, IMD, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET,
GSICS Baseline Website Review
CF Conventions Support
1. GSICS Collaboration Servers Synchronisation 2
Updating Action Tracking Way
GSICS Baseline Review: Tools – e.g. GSICS Bias Plotting Tool
GSICS Collaboration Servers Statuses and Updates
GDWG Agenda Item: Tools for GRWG activities
Summary of GDWG breakout session
GSICS Collaboration Servers a Vehicle for International Collaboration Status 2011 Peter Miu EUMETSAT.
GDWG Agenda Item Existing netCDF Format Updates
Reviewing the GSICS Data Management Working Group Terms of Reference
GSICS Baseline Reviews - website, products metadata and structures
DOI Overview to Support its Use in GSICS
GDWG Agenda Item THREDDS Directory Structure Updates
Spectral Response Function netCDF towards “GSICS Standard netCDF”
GDWG Agenda Item Repository for GSICS Work - Clarification on Archiving Masaya Takahashi, JMA CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA, NIST,
Requirements for GSICS Plotting Tool to support VIS/NIR products
GSICS Data Management and Availability to Users
Improvement Suggestions to the Procedure for Product Acceptance
5g. Repository For GSICS Work Use of github for codes etc
GDWG Agenda Item Baseline Reviews: Website
Manik Bali, Larry Flynn NOAA/STAR
GSICS Data Management Working Group: Break Out Session
Masaya Takahashi (JMA), Peter Miu (EUMETSAT) and Ashi Mitra (IMD)
Peter Miu / Masaya Takahashi
GSICS Data Management and Availability to Users
Report from the GSICS Data Management Working Group
YourOrganisation Agency Report Year
Masaya Takahashi (JMA)
Updating GSICS Plotting Tool to support VISNIR products
GSICS Product Plotting Web Tool Status: 2013
GDWG Joint Meeting Summary and Actions 2017
ToR & Future Chairing of the GDWG
Summary of GDWG breakout session and Actions 2018
DOI Overview and its Usage for EUMETSAT GSICS Objects
GDWG Meeting Summary 2016 and Work Plan 2016 / 2017
Brief Report of GSICS-EP-18 (June 2017 in Jeju, Korea)
GDWG Fact Sheet - Information Presentation
GDWG – Future Collaboration
Masaya Takahashi (JMA)
Chairing of the GDWG Peter Miu
Summary of 2019 GDWG breakout session
GSICS Baseline Review: Product meta-data and structures
EUMETSAT PathFinders Peter Miu
GSICS Collaboration Servers 2019
Masaya Takahashi Japan Meteorological Agency
Current Status and Update of CMA GSICS Collaboration Server
GSICS Data Management Working Group Summary and Action Items
The GSICS Lunar Observation Dataset
YourOrganisation Agency Report Year
GDWG Terms of Reference
6n. Use of gitHub for GSICS developments
Instrument Specifications and Calibration Information GDWG, March 2019
GRWG Chairing Dohyeong Kim GRWG Chair.
Masaya Takahashi Japan Meteorological Agency
Progress in CMA on GSICS Collaboration Servers Synchronisation
Automated Validation Tool for GSICS Candidate Products (GPPA automation) Peter Miu CMA, CNES, ESA, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA, NIST, NOAA,
GSICS Existing Tools Updates
GSICS Documentation Discussion - classification and storage
Presentation transcript:

2015 GSCIS annual meeting, March, 2015, New Delhi, India 1 GSICS Products' Content Access Study Proposal Zhe(Thomas) Xu, CMA CMA, CNES, EUMETSAT, ISRO, IMD, JAXA, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET, USGS, WMO

2015 GSCIS annual meeting, March, 2015, New Delhi, India Overview and Purpose  Overview  Existing GSICS products Now: GEO-LEO-IR (NRTC/RAC ) Future: More catalogue, Lunar/MW, etc. File Format: NetCDF (Structure content file)  Free Database Idea: Shall we use free database (like MySQL) as the container for GSICS product? Advantage and Disadvantage  Purpose of this presentation  To discuss the possibility of using MySQL to storage GSICS product as a parallel method to organize GSCIS products  Investigation Plan of CMA GDWG 2

2015 GSCIS annual meeting, March, 2015, New Delhi, India Existing GSICS Products Format  NC:NRTC Product  Attributes Metadata of the file Static information  Datasets Variables 1-2 dimension array 3 ………...

2015 GSCIS annual meeting, March, 2015, New Delhi, India Database Utilization  Possibility  NetCDF is Structure file format  Attributes→Static Table  Datasets→Records  Build relationship between static table and records.  Generate/Update new file → Insert Record Just like the updating of the RAC product 4

2015 GSCIS annual meeting, March, 2015, New Delhi, India Database Utilization  Advantage  Reduce the complicated of the product catalogue Existing Catalogue=Satellite*Instrument*Channel*Calibration method*Time attribute(NRTC or RAC)  Query the data by using standard SQL Get the time series data easier compare with RAC file  Easy to generate file format on demand NetCDF, HDF, CSV, etc  Archive Just backup the Database  Disadvantage  Can not access the data directly Plug in/Interface needed to provide to users  Data exchange  Database Maintain  Plotting tool need update 5

2015 GSCIS annual meeting, March, 2015, New Delhi, India CMA GDWG Investigation Plan  Continue the generation of GOE-LEO NRTC/RAC NetCDF product  Follow the convention of GSICS  Support the validation of GSICIS product generation framework developed by EUMETSAT  RAC product will be available soon  In parallel, investigate to use MySQL to storage CMA RAC product  Database tables structure design  CMA RAC product value insert to database  Develop value query tool under the requirement of CMA GRWG  Package insert/query tools and MySQL database together to delivery  Report to GDWG members when the investigation has result 6

2015 GSCIS annual meeting, March, 2015, New Delhi, India 7 End of Presentation: Thank you for your attention WMO GSICS Portal GSICS Coordination Centre GSICS Product Catalog CMA’s Data and Management Server