Independent Evaluation of the Swiss Contribution Annual Meetings 2016 Hugo Bruggmann and Ueli Stürzinger

Evaluation - Context Timeframe 2007 – 2015 Method Independent evaluation by GOPA consultants Documentation review EU-10 Interviews in HU, LV, PL, SK, CH Questionnaires EU-12 29 projects covering 20 thematic areas assessed in depth

Evaluation – Findings Relevance: Satisfactory Effectiveness: Satisfactory + complementary to other programmes + corresponds to national objectives - difficult to show impact + outputs exceeded + bilateral relations enhanced + flexible approach - difficult to measure effectiveness due to absence of core indicators/objectives - no systematic guidance for communication in partner states Efficiency: Satisfactory Sustainability: Satisfactory + functoning procedures delays (project approval, tenders, reporting) + commitment and ownership + strengthened capacities potential for follow-up monitoring up-scaling of pilot projects and long-term financing not always ensured

Highly Unsatisfactory Evaluation - Findings Rating of the 33 evaluation questions: Rating Criterion Highly Satisfactory Satisfactory Unsatisfactory Highly Unsatisfactory Relevance 2 5 Effectiveness 3 12 Efficiency 1 Sustainability

Highly Unsatisfactory Evaluation - Findings Rating of the 29 sample projects: Rating Criterion Highly Satisfactory Satisfactory Unsatisfactory Highly Unsatisfactory Relevance 16 10 3 Effectiveness 9 18 2 Efficiency 13 Sustainability 1 21 7

Possible future Swiss Contribution Evaluation – Main Recommendations Possible future Swiss Contribution Enhance efficiency and effectiveness of reporting: simplification and greater precision of reporting templates and guidance Strengthen the thematic, geographic and/or financial concentration in each partner state Provide guidance for a limited series of standard ‘core’ objectives and indicators per ‘specific objective’ Enhance efficiency of the ‘two-loop’ approach although not at the cost of good quality: Project Outline as a concise concept note and statement of project readiness

Current Swiss Contribution Evaluation – Main Recommendations Current Swiss Contribution Strengthen communication efforts: more actively communicate the results at the thematic, regional, geographic and country program levels Ensure sustainability: define how capacity building measures will be institutionalized Further enhance partnerships: through joint meetings where feasible and meaningful Measure in case of significant delays in reporting: Merge interim reports (submit one interim report for the entire outstanding period)

Evaluation – Follow-up 2016/2017 Discussion on the use of remaining funds in projects or TAF : Communication Professional pictures of beneficiaries and projects Thematic conferences Competitions Information campaigns → see ideas in the paper “Communication Measures 2016 / 2017 in the EU-10” The Swiss side would like to avoid additional project amendments and prolongations.

Evaluation – Follow-up 2016/2017 Discussion on the use of remaining funds in projects or TAF : Sustainability Reinforce in-house capacity (e-learning, trained trainers, manuals) Specific measures for projects where high risks of financial sustainability have been identified The Swiss side would like to avoid additional project amendments and prolongations.

Evaluation – Follow-up 2016/2017 Discussion on the use of remaining funds in projects or TAF : Partnership Additional joint meetings to exchange experience and enhance sustainability Invite Swiss experts to thematic closing events The Swiss side would like to avoid additional project amendments and prolongations.

Discussion and questions