SCOPE-CM: IOGEO GSICS GRWG & GDWG, 19-23 March 2018, Shanghai, China Rob Roebeling, Viju John, Frank Ruethrich, Tim Hewison, and Joerg Schulz EUMETSAT

SCM-06 IOGEO* Towards a GEO ring Fundamental Climate Data Record (FCDR) of inter-calibrated Infrared, Water vapour and Visible radiances European Organisation for the Exploitation of Meteorological Satellites (Rob Roebeling, Tim Hewison) Japanese Meteorological Agency (Masaya Takahashi) National Oceanic and Atmospheric Administration (Kenneth Knapp, Anand Inamdar) Deutscher Wetterdienst (Marc Schroeder) China Meteorological Administration (Peng Zhang, Xiuqing Hu) Indian Meteorological Department (A.K. Sharma, Ashim Mitra) Korea Meteorological Administration (Dohyeong Kim, Hyesook Lee) *Inter-calibration of imager observations from time-series of geostationary satellites (IOGEO) We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan. However, we are only at the beginning. Systematic activities: NOAA CDR Program –SAF Network and CAF Infrastructure Elements: Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing; Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools; Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution. Sensor Intercalibration Level 2 and Level 3 data Records CDR Quality Assessment Interoperability of CDRs. Benefits of common actions for international activities would be: GSICS would fulfil the implementation plan items on climate; SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs; The latter also strengthens the link between GSICS and SCOPE-CM; International reanalysis activities will get a one stop shop for FCDRs from operational sensors; NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate; NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 2

SCM-06 IOGEO - Introduction Objective: Re-calibrate and Inter-calibrate Meteosat First Generation (MFG) and Meteosat Second Generation (MSG) IR, WV, and VIS radiances from 1982 till date. Project Activities: to share common re-calibration methods between the participating agencies; to re-calibrate geostationary data from all heritage instruments; to compare re-calibrated geostationary data in overlap regions; to prepare an FCDR of re-gridded radiances normalized to a reference instrument; We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan. However, we are only at the beginning. Systematic activities: NOAA CDR Program –SAF Network and CAF Infrastructure Elements: Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing; Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools; Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution. Sensor Intercalibration Level 2 and Level 3 data Records CDR Quality Assessment Interoperability of CDRs. Benefits of common actions for international activities would be: GSICS would fulfil the implementation plan items on climate; SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs; The latter also strengthens the link between GSICS and SCOPE-CM; International reanalysis activities will get a one stop shop for FCDRs from operational sensors; NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate; NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 3

SCM-06 IOGEO – Progress in 2017 Produced time-series of MVIRI and SEVIRI recalibrated radiances for the IR and WV channels covering the period 1982 – 2017, using HIRS/2, IASI and AIRS observations as a reference (common recalibration method developed at EUMETSAT). Produced, in collaboration with JMA’s visiting scientist Tasuku Tabata. time-series of GMS and MTSAT recalibrated radiances for the IR and WV channels covering the period 1978-2017, using EUMETSATs recalibration method. Produced pre-beta release of time-series of MVIRI recalibrated radiances for the VIS channel covering the period 1991 – 2017, using reconstructed spectral response functions from the FIDUCEO project. Produced pre-beta release of time-series of recalibrated and harmonized HIRS data within the FIDUCEO project in collaboration with the university of Reading. Collected data for joint GSICS and IOGEO comparison of recalibrated VIS/IR/WV radiances. We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan. However, we are only at the beginning. Systematic activities: NOAA CDR Program –SAF Network and CAF Infrastructure Elements: Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing; Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools; Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution. Sensor Intercalibration Level 2 and Level 3 data Records CDR Quality Assessment Interoperability of CDRs. Benefits of common actions for international activities would be: GSICS would fulfil the implementation plan items on climate; SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs; The latter also strengthens the link between GSICS and SCOPE-CM; International reanalysis activities will get a one stop shop for FCDRs from operational sensors; NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate; NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 4

Sensor Equivalent Calibration Reference Sensor Normalized Calibration Example ERA-CLIM2 Sensor Equivalent Calibration Reference Sensor Normalized Calibration

ERA-CLIM2 Sensor equivalent calibration Sensor equivalent calibration [GSICS definition] refers to the calibration where each sensor is calibrated in such a way that the spectral characteristics of that individual sensor are maintained. As a result of this process, the calibrated radiances represent the unique nature (e.g., spectral response function) of the monitored sensor. Time Radiances Sensor 1 Sensor X Calibration as it should be Actual Calibration Note, sensor equivalent calibrations are supposed to differ in their radiances (or counts) due to differences in the spectral characteristics of the sensors NRTC/RAC/ARC For example, I suggested he discussed with you the "Requirements for NRTC/RAC/ARC". As you know at present we generate Near-Real-Time-Corrections and Re-Analysis Corrections for GEO-LEO IR, based on single pairs of instruments (one monitored, one reference). I would like you to consider what the requirements could be a GSICS Archive Re-Calibration, which is the sort of thing you are doing in SCOPE-CM. E.g. Could these requirements be met by my proposed Prime GSICS Corrections? i.e. Merging together inter-calibration results from different reference instruments, after correcting them to a common datum (the "Primary Reference") using "delta Corrections" (the double-difference of their time series). 6

ERA-CLIM2 Sensor equivalent calibration Figure 5: Time-series of Meteosat First Generation Sensor Equivalent Calibrated radiances for the Water Vapor Channel (upper panel) and the infrared channel (lower panel)

ERA-CLIM2 Reference Sensor Normalized Calibration Reference sensor normalised calibration [GSICS definition] refers to the calibration that provides the best match to spectral characteristics of a predefined “reference*” sensor. As a result of this process, the calibrated radiances represent the unique nature (e.g., spectral response function) of the “reference” sensor. The normalised calibration includes information on uncertainty associated with adjusting the characteristics of the monitored sensor to those of the predefined “reference” sensor. Sensor 1 Reference Sensor used for normalization One sensor from a series or a hypothetical sensor Sensor X Radiances Sensor Equivalent Calibration Reference Sensor Normalized Calibration Time Uncertainty due to differences between the spectral characteristics of the reference sensor and the spectral characteristics of other sensors in the series NRTC/RAC/ARC For example, I suggested he discussed with you the "Requirements for NRTC/RAC/ARC". As you know at present we generate Near-Real-Time-Corrections and Re-Analysis Corrections for GEO-LEO IR, based on single pairs of instruments (one monitored, one reference). I would like you to consider what the requirements could be a GSICS Archive Re-Calibration, which is the sort of thing you are doing in SCOPE-CM. E.g. Could these requirements be met by my proposed Prime GSICS Corrections? i.e. Merging together inter-calibration results from different reference instruments, after correcting them to a common datum (the "Primary Reference") using "delta Corrections" (the double-difference of their time series). 8

ERA-CLIM2 Reference Sensor Normalized Calibration Figure 5: Reference Sensor Normalised time-series of Meteosat First Generation radiances for the Water Vapour Channel (upper panel) and the infrared channel (lower panel) NRTC/RAC/ARC For example, I suggested he discussed with you the "Requirements for NRTC/RAC/ARC". As you know at present we generate Near-Real-Time-Corrections and Re-Analysis Corrections for GEO-LEO IR, based on single pairs of instruments (one monitored, one reference). I would like you to consider what the requirements could be a GSICS Archive Re-Calibration, which is the sort of thing you are doing in SCOPE-CM. E.g. Could these requirements be met by my proposed Prime GSICS Corrections? i.e. Merging together inter-calibration results from different reference instruments, after correcting them to a common datum (the "Primary Reference") using "delta Corrections" (the double-difference of their time series). 9

on heritage geostationary satellites. Joint GSICS and IOGEO inter-comparison of reference sensor equivalent WV, IR (and VIS) radiances Objective Objective: IOGEO and GSICS partners to compare reference sensor equivalent (or re-calibrated) radiances from the water vapor (WV), infrared (IR), (and visible (VIS)) channels on heritage geostationary satellites. 10

IOGEO and GSICS inter-comparison - Introduction Method To collect re-calibrated data for a common test period: Channels: WV, IR (and VIS) Satellites: COMS, GOES, Feng-Yun, Himawari, Kalpana, METEOSAT Test days: 19 August 2015 and 21 July 2016 Test slots: 3 hourly images (00, 03, 06, 09, 12, 15, 18, 21 GMT) To encourage IOGEO partners to all use HIRS as reference instrument (Note -> EUMETSAT can provide HIRS record (1982-2014) in standard NetCDF format) To inter-compare re-calibrated data in overlapping regions; To compare re-calibrated data against IASI observations; To compare re-calibrated data against simulated radiances from ECMWF. Data Exchange An FTP site has been set up at EUMETSAT where all IOGEO and GSICS partners can upload their test data (details on the next slide) We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan. However, we are only at the beginning. Systematic activities: NOAA CDR Program –SAF Network and CAF Infrastructure Elements: Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing; Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools; Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution. Sensor Intercalibration Level 2 and Level 3 data Records CDR Quality Assessment Interoperability of CDRs. Benefits of common actions for international activities would be: GSICS would fulfil the implementation plan items on climate; SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs; The latter also strengthens the link between GSICS and SCOPE-CM; International reanalysis activities will get a one stop shop for FCDRs from operational sensors; NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate; NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 11

IOGEO and GSICS inter-comparison – FTP site details Site : ftp.eumetsat.int User accounts : CMA, EUMETSAT, GSICS, IMD, JMA, KMA, NOAA Password : Each user account has a personal password for details mail to Viju John (viju.john@eumetsat.int) Directories : Each user account has a personal directory with r/w/e permissions Sub Directories : Each personal directory contains the following sub-directories Reference data : IASI and HIRS reference data will be made available on the FTP site Calibrated data : Each user should but their calibrated data in their personal directory /rse_native reference sensor equivalent calibrated data original resolution /rse_resamp reference sensor equivalent calibrated data re-sampled (5x5 km2) /aux_native auxiliary data (e.g. geometry data) original resolution /aux_resamp auxiliary data (e.g. geometry data) re-sampled (5x5 km2) ftp.eumetsat.int EUMETSAT FTP Administration Account: Username: iogeo Password: 8L5ujAs78E Access rights: Read/Write/Delete   Suppliers: Login name and directory name 1. NOAA Username: noaa Password: 3qp3NR5Hwn Access rights: Read/Write/Delete to content of NOAA directory, read to other suppliers 2. JMA Username: jma Password: ccx8EbATA6 Access rights: Read/Write/Delete to content of JMA directory, read to other suppliers 3. CMA Username: cma Password: N9f246T5ju Access rights: Read/Write/Delete to content of CMA directory, read to other suppliers 4. IMD Username: imd Password: qNHFAxwg9v Access rights: Read/Write/Delete to content of IMD directory, read to other 5. GSICS Username: gsics Password: UqHrCc4jkV Access rights: Read/Write/Delete to content of GSICS directory, read to other 6. TBD Username: tbd Password: M4sR8q4Xh3 Access rights: Read/Write/Delete to content of TBD directory, read to other 12

IOGEO and GSICS inter-comparison – Status Data Uploads 2015-08-19 2016-07-21 00z 03z 06z 09z 12z 15z 18z 21z 24z 21 GOES-15 135°W  GOES-13 75°W Met-10 0°E  Met-7 57°E Kalpana 82°E  FY-2D 123°E FY-2G 105°E FY-2F 112°E COMS-1 128°E Himawari 145°E  : Ready and uploaded to the common FTP site  : Ready but not yet uploaded to the common FTP site  : Not ready  : Current status needs to be checked

Planning , using HIRS/2, IASI and AIRS observations as a reference. We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan. However, we are only at the beginning. Systematic activities: NOAA CDR Program –SAF Network and CAF Infrastructure Elements: Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing; Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools; Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution. Sensor Intercalibration Level 2 and Level 3 data Records CDR Quality Assessment Interoperability of CDRs. Benefits of common actions for international activities would be: GSICS would fulfil the implementation plan items on climate; SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs; The latter also strengthens the link between GSICS and SCOPE-CM; International reanalysis activities will get a one stop shop for FCDRs from operational sensors; NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate; NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 14

SCM-06: Project Plan 2018-2019 ALL: To complete inter-calibration for WV and IR channels of all GEO satellites; ALL: To inter-compare IOGEO and GSICS recalibrated IR/WV/VIS radiances from all GEOs for common test period; NOAA: To do matchups for a test period with calibrated IASI/AIRS/HIRS data NOAA: To compare for all GEOs ISCCP B1 (3hr) against EUMETSAT and JMA results ALL: To release pre- release of IR/WV inter-calibrated FCDR (or cal. coefficients) DWD: To utilize pre- release of IR/WV inter-calibrated FCDR and re-compute FTH. DWD: To compare new and old version, compare to ARSA and to UTH from HIRS. EUM: To release pre- release of VIS inter-calibrated FCDR (or cal. coefficients) ALL: To gather feedback from beta users; We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan. However, we are only at the beginning. Systematic activities: NOAA CDR Program –SAF Network and CAF Infrastructure Elements: Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing; Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools; Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution. Sensor Intercalibration Level 2 and Level 3 data Records CDR Quality Assessment Interoperability of CDRs. Benefits of common actions for international activities would be: GSICS would fulfil the implementation plan items on climate; SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs; The latter also strengthens the link between GSICS and SCOPE-CM; International reanalysis activities will get a one stop shop for FCDRs from operational sensors; NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate; NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 15

SCM-06 IOGEO - Planning beyond 2018 - 2019: recalibration geostationary satellites: to generate of IR/WV/VIS radiance FCDRs for the GEO satellites; to gather feedback from beta users. to seek for collaborative activities with other space agencies (e.g. visiting scientist activities) that help accomplish recalibration of the remaining GEO satellites, and provide these in a common format (as has been done now for all EUMETSAT and JMA satellites) 2020: Gridded FCDR (GEO ring) of inter-calibrated radiances to generation a combined product of gridded inter-calibrated radiances that is based on re-calibrated radiances from as many geostationary satellite data as possible. We started to explore a closer partnership on climate with NOAA aiming at the development of a joint action plan. However, we are only at the beginning. Systematic activities: NOAA CDR Program –SAF Network and CAF Infrastructure Elements: Analyse reprocessing environments, develop common requirements baseline for reprocessing and search for optimisation of processing; Increase commonalities on data archiving, data distribution and data post-processing such as, level-3 on demand, sub-setting in time and space, selection of parameters, etc. – develop and share tools; Analyse potential for further increase of stewardship level by exchanging raw and derived records to have a third copy; also enables improved distribution. Sensor Intercalibration Level 2 and Level 3 data Records CDR Quality Assessment Interoperability of CDRs. Benefits of common actions for international activities would be: GSICS would fulfil the implementation plan items on climate; SCOPE-CM could be further developed by becoming the international dominant producer of FCDRs; The latter also strengthens the link between GSICS and SCOPE-CM; International reanalysis activities will get a one stop shop for FCDRs from operational sensors; NOAA/EUM can develop a common approach to answer requests from the CEOS WG Climate; NOAA/EUM activities in GSICS and SCOPE-CM may appear as “the” science support with high visibility in the new WCRP-WDAC and the WCRP-JSC. 16

Questions