ESF Evaluation partnership Rome, 26 November 2014 “Monitoring and evaluation of Italian Youth Guarantee Implementation Plan” A joint project of Italian Ministry of Labour and Social Policies and ISFOL
Outline of this presentation Key elements of Italian YGIP Monitoring and evaluation activity and its output First evidences on the progress of YG scheme in Italy
Key elements of Italian YGIP - 1 Performance related pay system: a standard cost framework devised to reward most effective interventions Contestability: Services costs in charge of residence region but opportunity for clients to apply everywhere Standard profiling score to assess the risk of social exclusion and to modulate reimbursement to Employment Services
Key elements of Italian YGIP - 2 Subsidiarity: possible interventions supporting Regions not complying with effectiveness and management targets Monitoring and evaluation
The YG scheme: paths, measures, offers
Overall budget
Monitoring and evaluation i.Monitoring and evaluation of implementation process of YG Regional Action plans ii.Monitoring of services delivered, activation measures and of beneficiaries iii.Impact and efficiency evaluation of measures iv.Assessment of YG impact in a comparative macroeconomic perspective
i. Implementation process analysis Youth Guarantee policies: YEI funds role in Regional plans and complementarities between YEI and other resources Regional plans implementation: analysis of service delivering procedures and mechanisms at regional level; role of Social Partners and other stakeholders in the YG measures provisions; monitoring implementation and operational programming; in- depth focus on Community Services measure
ii. Monitoring of services, measures and beneficiaries Quasi real-time analysis of: registrations, take-ups, services and measures delivered. Outcomes: detailed data on participants, measures offered and regional models and performances list of indicators depicting implementation status and progress towards target(s) achievement Clients perception and satisfaction (ad-hoc CAWI survey)
YGIP list of indicators Implementation Coverage Immediate and long-term outcome Performance and process Service quality perception JAF (EMCO) indicators
Impact and effectiveness evaluation Assess the effectiveness of measures implemented in terms of activation of YG beneficiaries through: Employment (including apprenticeship), Vocational training, Continued education Outcomes and targets set according to measures’ characteristics and rationale Administrative data (2015) and survey data (including a longitudinal section of the sample – )
YG impact in a comparative macroeconomic perspective Assess the possible differentiated impact of YG program in European countries and explore possible success factors Macro-economic and simulation modelling to assess the impact of YG on LM indicators and productive systems.
Progress in budget allocation
A snapshot of YG implementation (as of November 19 th )
Monthly flow of registrations and take ups by Employment Services
Registered users by age
Take ups by profiling score index