1. Assessment of project proposals within EU grant schemes 17 & 18 December 2013 Government Office for Cooperation with NGOs Zagreb VLADA REPUBLIKE HRVATSKE Ured za udruge This project is financed by the European Union

2. Welcome – Day 1 Ana Ugrina 2

3. Purpose, Methodology, Contents Petrus Theunisz 3

4. Purpose Engaging public administration bodies in charge of managing Call for Proposals in developing, defining and applying a set of unified assessment Collecting feedback on the Guidelines for Assessors, Evaluation Matrices and other tools. 4

5. Methodology Welcomes, brief verbal presentations / reflections Introductions, brief verbal presentations Modules, lectures with questions and answers Exercises, small group work, reflections, questions and answers Closures, short brief summary 5

6. Contents: Modules Module 1 – Assessment of Project Proposals Module 2 – Unified Assessment Criteria Module 3 – From IPA to ESF Module 4 –Scoring, Commenting and Quality Assurance 6

7. Contents: Exercises Exercise 1 – Application Forms, Evaluation Grids and Unified Assessment Criteria Exercise 2 – From IPA to ESF 7

8. Materials Guidelines for Assessors Annex 1 – draft Evaluation Matrix Concept Note Annex 2 – draft Evaluation Matrix Full Application Annex 3 – concept ESF Evaluation Grid 8

9. Module 1 Assessment of Project Proposals 9

10. Assessment of Project Proposals Experiences Quality Attributes, Criteria and Standards 10

11. Assessment of Project Proposals Experiences 11

12. Assessment of Project Proposals Quality 12

13. Assessment of Project Proposals Attributes, Criteria and Standards 13

14. Attributes, Criteria & Standards 3 Attributes: – A - Relevance – B - Feasibility + Sustainability – C - Project Management 16 Criteria: – A 1 - A 5 – B 6 - B 11 – C 12 - C 16 64 Standards – A 1.1; A 1.2; A n – B 6.1; B 6.2; B n; – C 12.1; C 12.2 - C 16.5 EC PCM Guidelines Chapter 4, page 23 The EU PCM Quality Framework contains 3 Attributes, 16 Criteria and 64 Standards

15. Attributes, Criteria & Standards 5 + 1 Attributes: – A - Relevance – B – Efficiency – C – Effectiveness – D – Impact – E – Sustainability – F – Capacity 6 CN and 13 FA Evaluation Questions 19 CN and 48 FA Assessment Criteria N Indicators The project proposal assessment Quality Framework contains 6 Attributes, 19 Evaluation Questions (6 + 13), 77 (indicative) Assessment Criteria, n Indicators

16. Exercise 1 16

17. Exercise 1 (1 h 15 min + 15 min) Study the Application Form template Study the Concept Note and Full Application Evaluation Grid Check and comment on Unified Assessment Criteria for concept note section 1 and full application section 1 to 6 Present findings in a 15 minute plenary presentation 17

18. Module 2 Unified Assessment Criteria 18

19. Unified Assessment Criteria Relevance CN 1.1 Objectives of the CfP Priorities of the CfP 19

20. Unified Assessment Criteria Relevance CN 1.2: Geographic: Needs Geographic: Constraints Synergy Duplication? 20

21. Unified Assessment Criteria Relevance CN 1.3: Target Groups and Final Beneficiaries Quantitative and Qualitative Definition of Problems and Needs Addressing Problems and Needs 21

22. Unified Assessment Criteria Relevance CN 1.4: Cross Cutting Issues Innovation Good Practice 22

23. Unified Assessment Criteria Capacity – FA 1.1 - Project Management: Applicant Co-Applicant(s) Affiliate 23

24. Unified Assessment Criteria Capacity – FA 1.2 – Technical Expertise: Applicant Co-Applicant(s) Affiliate(s) 24

25. Unified Assessment Criteria Capacity – FA 1.3 – Management: Applicant Co-Applicant(s) Affiliate(s) 25

26. Unified Assessment Criteria Capacity – FA 1.4 – Financial: Sufficient Stable Diverse Co-Financing ! Only for the Applicant 26

27. Unified Assessment Criteria Feasibility – FA 3.1 - Activities Consistent Appropriate Practical 27

28. Unified Assessment Criteria Activities – FA 3.2 – Action Plan Format Consistency Realistic / Achievable 28

29. Unified Assessment Criteria Feasibility – FA 3.3 – PCM Logical Framework Objectively Verifiable Indicators Monitoring, Evaluation and Reporting 29

30. Unified Assessment Criteria Feasibility – FA 3.4 – Participation Partnership, sensible, balanced Roles, responsibilities, based on core competences Track Record 30

31. Unified Assessment Criteria Impact – FA 4.1 Target Groups > External Environment Final Beneficiaries > External Environment 31

32. Unified Assessment Criteria Sustainability – FA 4.2 – Multipliers Concrete Measures Applicant, Co-Applicants, Affiliates Target Groups, Final Beneficiaries 32

33. Unified Assessment Criteria Sustainability – FA 4.3 Ownership Sectoral Political Institutional Financial Environmental 33

34. Unified Assessment Criteria Budget – FA 5.1 – Appropriateness Format, by costs and NOT by activity Exclusion / Inclusion Calculations, Clarifications & Justifications Sources of Funding Contributions, Revenues Changes between CN and FA 34

35. Unified Assessment Criteria Budget – FA 5.2 – Cost / Benefit Ratios General Cost / Benefit Ratio Specific Cost / Benefit Ratios – HR – Travel – Equipment & Supplies – Local Office – Other Costs, Services – Other 35

36. Closure 36

37. Welcome – Day 2 Ana Ugrina 37

38. Module 3 From IPA to ESF 38

39. From IPA to ESF Guidelines for Assessors – General Guidelines – Specific Guidelines Unified Assessment Criteria 39

40. Feedback 40

41. From IPA to ESF Towards a unified and standardized ESF evaluation process? 41

42. Exercise 2 42

43. Exercise 2 (1 h 15 min + 15 min) Study the ESF Evaluation Grid Compare the EU Evaluation Grid with the ESF Evaluation Grid Develop and define Unified Assessment Criteria for all sections (1 to 6) Present findings in a 15 minute plenary presentation 43

44. Module 4 Scoring, Commenting and Quality Assurance 44

45. Scoring 1, 2, 3, 4, 5 45

46. Scoring Very good, good, adequate, poor, very poor 46

47. 47 Scoring

48. Commenting Concise, should provide a lot of information in a few words; brief and comprehensive Pertinent, applicable to the Evaluation Question; should not address a matter that the EQ does not cover 48

49. 49 Synthesis

50. score = 5, only positive comments score = 4, positive and negative comments, balance = 1 negative comment score = 3, positive and negative comments, balance = 2 negative comments score = 2, positive and negative comments, balance = 3 negative comments score = 1, only negative comments 50

51. Quality Assurance Overall Evaluation Process Individual Assessments 51

52. Closure 52