2013 GSICS Joint Meeting, Williamsburg VA, USA, March GSICS Collaboration Servers Status: 2013 Peter Miu (EUMETSAT) CMA, CNES, EUMETSAT, ISRO, IMD, JMA, KMA, NASA, NIST, NOAA, ROSHYDROMET, USGS, WMO

2013 GSICS Joint Meeting, Williamsburg VA, USA, March GSICS Collaboration Servers What are the GSICS Collaboration Servers?  Individually, the servers are also known as Data and Product servers provide a set of services for the GSICS user community to support data exchange and access to relevant products to support the calibration of satellite data. Who has implemented one of these servers?  EUMETSAT has an operational server receiving comparable satellite data sets from the EUMETSAT and JMA. Pre-operational and demonstration GSICS products are regularly received by the server for access by the GSICS community. Pre-operational GEO LEO IR products received are expected to be operational soon and archived by the EUMETSAT Data Centre.  NOAA has an operational server regularly receiving NESDIS-produced GSICS products. The metadata for these products following ISO standards, has links to the associated product documentation and human friendly data set information viewers. NRTC product files can either be accessed individually or as a virtual single dataset.  CMA is developing their server for operations. This server is scheduled to be available as part of the Collaboration Server Network in Work to be performed: Directory structures issues, standard look & feel, transfers of GSICS product across the collaboration server network and standardise THREDDS meta-data for the data sets.

2013 GSICS Joint Meeting, Williamsburg VA, USA, March GSICS Data and Product Server Design

2013 GSICS Joint Meeting, Williamsburg VA, USA, March 2013 GSICS Collaboration Server Network 4

2013 GSICS Joint Meeting, Williamsburg VA, USA, March EUMETSAT’s GSICS Server Updates  The EUMETSAT GSICS server has improved its look and feel of the THREDDS user interface.EUMETSAT GSICS server  In addition to this, its now offering addition services to access the data; HTTP server download, OpenDAP service, ISO, NCML and UDDC.  GSICS products following the agreed product schema can be viewed using the GSICS plotting tool accessible from the THREDDS meta-data web page for a product.  Additional disk space has been requested to store additional source data sets from EUMETSAT’s Meteosat10 and Metop-B satellites.  Preparation work is in progress to archive GSICS products into the EUMETSAT Data Centre Archive

2013 GSICS Joint Meeting, Williamsburg VA, USA, March 2013 EUMETSAT’s GSICS Server 6

2013 GSICS Joint Meeting, Williamsburg VA, USA, March What Data Sets are on the Servers  Source Data Sets from EUMETSAT:  MET7 MVIRI netCDF data sets (20 days rolling archive)  MSG1 SEVIRI netCDF data sets (20 days rolling archive)  MSG2 SEVIRI netCDF data sets (20 days rolling archive)  MSG3 SEVIRI netCDF data sets (20 days rolling archive)  MetOp-A IASI netCDF data sets (20 days rolling archive)  MetOp-B IASI netCDF data sets (20 days rolling archive) Hardware upgrades in 2013 for this server shall provide a 30 days rolling archive plus additional storage of intermediate data sets and GSICS products.  Intermediate Data Sets from JMA to support the comparisons:  MTSAT2 Imager – MetOpA IASI collocated netCDF data sets (Since )  MTSAT2 Imager – Aqua AIRS collocated netCDF data sets (Since )  GRWG input is needed to define some Data Management Requirements:  Is the 30 days rolling archive enough?  How long do we keep the intermediate data sets?  Do we need to archive the intermediate data sets?  Should all GSICS products be distributed amongst all collaboration servers?  Should all GSICS products remain on the collaboration server i.e. are never deleted?  Should the GSICS products be archived and if so, who is responsible for archiving these products?

2013 GSICS Joint Meeting, Williamsburg VA, USA, March 2013 What Products are on the Servers  NTRC and RAC Demo Products (Monitored Instrument – Reference Instrument):  MET7 MVIRI - MetOpA IASI NRTC demo product (since ).  MSG1 SEVIRI - MetOpA IASI NRTC demo product (since ).  MSG2 SEVIRI - MetOpA IASI NRTC demo product (since ).  MetOpA HIRS - MetOpA IASI NRTC demo product (since ).  MTSAT2 Imager - Aqua AIRS NRTC demo product (since ).  MTSAT2 Imager - Aqua AIRS - MetOpA IASI NRTC demo product (since ).  MTSAT2 Imager - MetOpA IASI NRTC demo product (since ).  MET7 MVIRI - MetOpA IASI RAC demo product (since ).  MSG1 SEVIRI - MetOpA IASI RAC demo product (since ).  MSG2 SEVIRI - MetOpA IASI RAC pre-operational product (since , preop ).  MetOp-A HIRS - MetOpA IASI RAC demo product (since ).  MTSAT2 Imager - Aqua AIRS RAC demo product (since ).  MTSAT2 Imager - Aqua AIRS - MetOpA IASI RAC demo product (since ).  MTSAT2 Imager - MetOpA IASI RAC demo product (since ). NRTC – Near Real Time Correction. RAC – Re-Analysis Correction.  Validation of these products is done according to the Procedure for Product Acceptance (finalised??). 8

2013 GSICS Joint Meeting, Williamsburg VA, USA, March 2013 GSICS Product Use  Once the EUMETSAT GSICS GEO LEO IR product is operational, the calibration information will be included in the operational High Rate SEVIRI Level 1.5 Image Data. 9

2013 GSICS Joint Meeting, Williamsburg VA, USA, March GDWG Servers Discussions 2013 Agenda items where actions are needed:  Fix the directory structures or not ?  Proposed standard look and feel of the server pages.  Standardise THREDDS metadata pages for:  Documentation  Access  Keywords  Creators/Publishers  Viewers  How Products can be regularly and securely transferred across the Collaboration Network.  Manual or automated implementation of these tasks.  GSICS Server Documentation.

2013 GSICS Joint Meeting, Williamsburg VA, USA, March Related Servers Issues 2013 Agenda items where actions are needed:  GSICS Product Schemas.  GSICS Product Plotting Tool; improvement?  GSICS Documentation; GSICS document format, GSICS logo, storage location, etc.  Procedure for Product Acceptance; improvements?  Product Catalogue; improvements?

2013 GSICS Joint Meeting, Williamsburg VA, USA, March New GDWG Discussion Points 2013 Agenda items:  GSICS Operations; service specification?  Satellite event history.  GSICS Climate and Forecast Standard Names and Units.  GSICS work plan definition.

2013 GSICS Joint Meeting, Williamsburg VA, USA, March End of Presentation: Thank you for your attention WMO GSICS Portal GSICS Coordination Centre GSICS Product Catalog EUMETSAT’s Data and Management Server

2013 GSICS Joint Meeting, Williamsburg VA, USA, March Backup GSICS document slide  The following documents have been presented on the GSICS mailing lists ( for some time:  GSICS Data Management Server User Guide, Draft.  GSICS Data Management Server Operations Service Specification (and supporting documentation) Action GDWG 03_22, Draft.  EUMETSAT Archive NetCDF Format Proposal, Draft. These are EUMETSAT documents, should be converted to GSICS documents.  Where should the Procedure for Procedure Acceptance document be located?  Where should the operational Algorithm Theoretical Baseline Documents (ATBDs) be located? A GSICS associated location should be available to store GSICS documents when GSICS logos etc.