Analysis of the Impact and Effectiveness of Projects Structural Funds Programme for Malta Presentation of main findings and recommendations Evaluation Network Meeting 22 nd September 2009 Structural Funds Programme for Malta Event co-financed by the European Union European Regional Development Fund (ERDF) Co-financing rate: 75% EU Funds; 25% Government of Malta Funds 1

Objectives of the exercise The specific objectives of the contractor were as follows: To assess and verify the achievements registered by projects as identified by the Managing Authority; To conduct an analysis of the effectiveness and impact of the sample of projects; To propose recommendations for the future in terms of monitoring and collection of data. 2

General Information 13 projects that formed part of the Structural Funds Programme were analysed; Analysis reflects the situation as at the 31st October

Projects Analysed Measure 1.1 Improving the Environment Situation, ERDF Project ref. number Project Title ERDF 2Wied il-Mielaħ Restoration and Management of Storm Water ERDF 10Acquisition of Air Monitoring Equipment to Comply with Acquis Requirements ERDF 21Aerial Emissions for Maghtab, Qortin and Wied Fulija Landfills ERDF 22Establishing Civic Amenity and Bring-In Sites ERDF 23Marine Scientific Surveys around Filfla for its Conservation ERDF 28Drinking Water Quality Project 4

Projects Analysed Measure 4.1 Basic Infrastructure & Development of the Tourism Sector Project ref. number Project Title ERDF 32Extension of the Crafts School & Setting up of a Crafts Incubation Centre ERDF 34Gozo Museum of Archaeology Display Project ERDF 35The Upgrading of the TINA Network in Gozo ERDF 36Niche tourism for the Island of Gozo 5

Projects Analysed Measure 4.2 Human Resources - ESF Project ref. number Project Title ESF 27ETC Schemes and Courses ESF 28Crafts Courses for Sustainable Careers in Gozo ESF 29University of Malta Gozo Centre Courses 6

Research Methodology 7

The analysis of the Structural Funds interventions included: Desk research Literature review Fieldwork Interviews with key actors, beneficiaries and users

Analytical Tools Obtaining data – Stakeholder consultation, individual interviews, focus groups, secondary and administrative data, observational techniques. Analysing data – logic models, focus groups, institutional analysis, input/output analysis. Making judgements – SWOT analysis, sustainability / risk assessment plus impact assessment.

Approach Taken A Measure-specific and a project-specific approach were applied; Data and information concerning the Effectiveness and Impact at both Measure and Project level was collected and analyzed; Some observations on Priority 4 which provides a specific programme allocation to address the special development need facing Gozo as a whole were also included; Particular attention was also paid to the aspect of data collection. 10

Measure Specific Measure Implementation Measure 1.1 had a slow start in terms of disbursement of funds; However, improvement was registered by the end of 2007; Measure 4.1 and Measure second best performing and the best performing Measures respectively; 11

Data Collection Use of Common Minimum Indicators; Use of Mandatory Indicators; Establishing meaningful Baseline Indicators; Sourcing of data; Measuring of public awareness; Use of evaluation sheets; Presentation of data in a meaningful manner to the general public. 12

Recommendations Data needs analysis Ready availability of statistics from already established sources (e.g. National Statistics Office, Malta Resources Authority etc.) Public perception surveys Evaluation sheets of ESF-funded training programmes Common set of identical indicators Simple user surveys Purpose / intent of trainees applying to join the programme 13

Additional Outputs Course evaluation sheet Template for evaluating public awareness campaigns 14

Thank You for your kind attention 15