CGMS WMO Task Force on Metadata Implementation Progress Presented to CGMS-44 Working Group IV, agenda item WGIV/3.1

Overview CGMS TFMI main tasks and last year deliverables 2016 deliverables and achievements Future work

CGMS-WMO Task Force on Metadata Implementation Membership (May 2016) Guillaume Aubert (EUMETSAT, chair) Virendra Singh (IMD, co-chair) Yasushi Izumikawa (JMA) Zoya Andreeva (ROSHYDROMET) Li Yuanjie (NOAA/NCDC) Byung-il Lee (KMA) Hidehiko Murata (JMA) Dongfeng Luo (CMA) Michael Schick (EUMETSAT) with contributions from Uwe Voges Conterra GmbH Toshiyuki Sakurai (JMA) Xu Zhe (CMA) Yoshito Yoshizaki (JMA) Daniele Biron (Italian Meterological Service, WMO ET-SUP member)

CGMS TF-MI Tasks Facilitate satellite products metadata management Define guidance documentation and template examples for WMO Core Profile 1.3 Improve user search experience for satellite products Define set of mandatory attributes to be present per satellite products to provide a meaningful discovery experience to users Consolidate Satellite providers/users community findings regarding the WIS discovery services Report resulting outcomes to WMO expert groups WMO IPET MDRD, ET-WISC

2015 Task Force Deliverables [Metadata Management] CGMS Information Model for satellite data (Level 1,2 and 3), including the set of mandatory attributes allowing a user to accurately find a satellite product and obtain from the catalogue a complete description for this product. Next Step: create XML WMO Core Profile 1.3 mapping and write Metadata guidance documentation. [Improve User Experience] WIS Discovery Portal Usability Report highlighting the WIS user interface focus on a specialized user community (GTS) and trouble for finding standard satellite product information out of the technical information. Recommendations provided to start improving the search discovery and user experience. Submitted to IPET-MDRD and ET-WISC for review.

WIS Portal Usability Report 2016 Outcomes Report supported by IPET-SUP and submitted to ET-WISC and IPET-MDRD Creation of a ET-WISC/IPET-MDRD Task Force to start from the CGMS TFMI recommendations and define evolutions on the WIS Discovery Portals Address how to improve WIS Discovery Services Focus on Products information presentation Improve Product metadata content CGMS TFMI useful to represent a user community in the WIS.

WIS Metadata Management WMO Core Profile 1.3 Mapping (1) Based on the Initial version of information model ,examples have been developed for a number of satellite data sets FY-3 VIRR Level-1, INSAT-3 AMV Level-2, Himawari-8 AHI Level-1, POES AVHRR SST Level-3, Meteor MTVZA-GY Level-1C Create a mapping of the full CGMS Information Model to the WMO Core Metadata Profile 1.3 Through this mapping exercise it became evident, that all the information model elements could not be unambiguously mapped to ISO elements.

WIS Metadata Management WMO Core Profile 1.3 Mapping (2) Select information from the model to provide the necessary level of information to create Discovery metadata. Create a simplified mapping and an initial XML template has been created An important issue discussed in the TF is whether to represent information directly related to the satellite and instrumentation in the simplified information model, Elements to be covered by the future WIGOS metadata Some recommendations of the TF are: To use the free text field “Abstract” in the ISO Discovery metadata to provide a sufficient level of information regarding the instrument and platform. Reference (link) additional more complete instrument and platform information from the metadata

Guidance Documentation on WIS Metadata Creation (1) With the mapping, the TFMI has created the Guidance Documentation Intended for a typical user involved in metadata creation: a product specialist Based on a Template-based approach where the user has to replace placeholders with the product information Templates can be used in editing/automatic generation tools Use Guidance Documentation for additional details TFMI recommends: to follow a structure for the Title and Abstracts, to link additional product information: calibration, detailed product definition, to reference the corresponding WMO OSCAR Platform and Instrument page.

Guidance Documentation on WIS Metadata Creation (2) Draft Guidance documentation & Template based approach presented during IPET-MDRD workshop in May 2016 IPET-MDRD to adopt the same approach to create the “non-expert” WIS metadata creation documentation Focus on the product information Hide the XML and ISO metadata structure has much as possible Use the CGMS TFMI Guidance Documentation as a basis and extend it with example for additional products: terrestrial stations, GTS bulletins, … Final IPET-MDRD Guidance documentation to be endorsed by ICT-CTS and published for CBS 16 Great achievement for CGMS TFMI to donate/contribute to the official WMO WIS metadata creation doc

Guidance Documentation Next Steps CGMS Guidance Documentation currently being reviewed/finalized. To be published in June 2016 Additional examples are being created. CGMS TFMI contribution to the official WMO metadata creation guidance documentation Until end of July 2016

Future Work (1) Metadata Management: Create additional product examples (Aug 2016) Create a web based version of the Guidance documentation (end of Q3 2016) To be discussed: Create a web based tool for validating CGMS-TFMI compliant metadata records

Future Work (2) The WIGOS Metadata standard has been endorsed and is in version 1.01 It is an abstract model that needs to be applied to and translated into an exchangeable format XML OGC Observations and Measurements used to create WIGOS metadata records OGC O&M XML mapping has now being published and is in review. WIGOS OGC O&M profile needs to be reviewed by Satellite product and metadata specialists Very active Terrestrial station/observation community Lower involvement from Satellite community

Future Work (3) CGMS TFMI has the expertise to review the WIGOS OGC O&M format Expertise in Satellite product Metadata specialist with ISO and OGC standard knowledge Propose TFMI to review the WIGOS OGC O&M XML format Create WIGOS Product examples and submit for review to IPET-SUP Analyze the format Produce a report with its findings and submit it to IPET-MDRD and the Task Team on WIGOS Metadata (TT-WMD) Work plan Sep 2016: Start analysis and product examples creation Jan 2017: Draft report delivered for review to IPET-SUP March 2017: Deliver WIGOS Report for comments to IPET-MDRD and TT-WMD

Actions/Recommendations CGMS TFMI to publish the “Guidance Documentation on WMO Core Profile Metadata Creation For Satellite Products” and submit it to IPET-MDRD and IPET-SUP.   CGMS to endorse the assessment of the WIGOS metadata OGC O&M mapping by the CGMS TFMI and reporting of its findings/recommendations to IPET-MDRD

Thank you Questions?