© GEO Secretariat 5.2 Monitoring and Evaluation John Adamec Co-Chair, M&E Working Group GEO-XI Plenary November 2014 Geneva, Switzerland

Overview Fifth Evaluation of GEOSS Implementation (Weather, Water, Climate) and Executive Committee Response (Plenary Document 10) (for approval) Progress on the sixth (final) Evaluation of GEOSS Implementation Progress in the Implementation of Recommendations of GEOSS Evaluations (Plenary Document 11) (for approval)

Fifth Evaluation of GEOSS Implementation (Weather, Water, Climate) and Executive Committee Response (Plenary Document 10) (for approval)

5 th Evaluation Team NorwayLars Ingolf EideCo-Chair United StatesMichael TannerCo-Chair IranAli Didevarasl GreeceEvangelos Gerasopoulos GermanyGuido Halbig AustraliaAgnes Lane CanadaJean Leclerc United StatesMeagan Singer JapanRyutaro Tateishi

5 th Evaluation Process Fifth GEOSS evaluation of Water, Weather and Climate SBAs commenced in late October 2013 Data collection and analysis from November 2013 to April 2014 Draft report submitted to GEO Secretariat for factual review April 9, 2014 Revised draft submitted to M&E WG May 9, 2014 Final Report to GEO Executive Committee June, 2014 Presentation to GEO Executive Committee July, 2014

5 th Evaluation: Key Messages Evaluation of progress was facilitated by improvements to reporting in GEO, in particular, the reports prepared by the Implementation Boards for Plenary. Current strategic targets are viewed by GEO participants as deeply ambiguous –Better targets would be: specific, measurable, and firmly achievable under the scope of GEO Organized around the users and societal sectors served, instead of the data provider communities

5 th Evaluation: Key Messages Need to consistently and clearly articulate a unique role and mission for GEO, especially with respect to other international organizations Opportunity to advocate support for in situ observation networks Challenge of securing appropriate forms and levels of support over the necessary time frames to achieve desired outcomes –Projects, as well as: communication, capacity building, administration, and evaluation functions © GEO Secretariat

5 th Evaluation: Proposed Responses From 15 findings, the ET made 13 recommendations ExCom has proposed the following responses –7 of 13 were already addressed in the IPWG report 1- cross SBA interaction, 3- clarifying role of GEOSS, 5- promoting in situ observations globally with developing countries emphasized, 6- concise and measureable targets for activities, 8- improving outreach and user engagement, 12- organizing around user domains, 13- using GEOSS as a platform to address observational gaps)

5 th Evaluation: Proposed Responses From 15 findings, the ET made 13 recommendations ExCom has proposed the following responses –6 of 13 request other actions 2- periodic confirmation of listed task contacts by Secretariat, and determine if this is necessary for all or only a subset of activities in the future, 4- requests capacity building activities adopt suitable impact assessment practices as part of the activity, 7- apply reasonable user experience monitoring to the GEO Portal, 9- renew effort to identify a component coordinator for the Cold Regions activities, 10- achieved in responding to recommendation 7, 11- review status of, and identify opportunities for GEO to advocate for, sustainability of the TIGGE archive.

Progress on the sixth (final) Evaluation of GEOSS Implementation

Unique Concepts from 6 th Evaluation Framework Evaluation Scope: Entire period of the first 10-Year Implementation Plan and full range of SBAs and Transverse Areas Strategy: Build on prior evaluations through synthesis of previous findings to guide further data collection and new analysis. Desired Outcome: Forward-looking recommendations applicable to the next implementation plan rather than advice specific to the current ( ) documents.

Final Evaluation Team CroatiaBojan Lipovscak JapanYukio Haruyama United StatesMatthew Druckenmiller Co-Chair GermanyGuido Halbig GreeceEvangelos Gerasopoulos NorwayLars Ingolf EideCo-Chair CanadaRima Ammouri European CommissionGilles Ollier

Final Evaluation Timeline Initial meeting of the Evaluation Team with the M&E WG July 2014 Data collectionJuly February 2015 Interim Report on initial findings for IPWG* End January 2015 Completed draft report provided to M&E WG and Secretariat for factual review End April 2015 Transmittal of the final evaluation report to M&E WG End May 2015 Presentation of final evaluation report to ExCom July 2015 *If resources allow.

The M&E WG and ET request you to: Please respond if contacted to provide input to the evaluation Please take part in the public evaluation survey Please share the survey and encourage others to participate too Visit: for further information or to contact the team.

Progress in the Implementation of Recommendations of GEOSS Evaluations (Plenary Document 11) (for approval)

Progress in the Implementation of Recommendations Context GEO-IX Plenary in November 2012 approved a process to track the implementation of recommendations from the series of evaluations. Progress was assessed by the M&E WG. Information collected via Secretariat experts. Structure

Progress in the Implementation of Recommendations Results