1. Guidance on Evaluation of Youth Employment Initiative
Anna Galazka Impact Assessment and Evaluation Unit

2. Purpose of the Guidance
to complement the guidance papers already available and provide specific guidance on the evaluation of YEI
to provide a common understanding of the concepts used in CPR and ESF Regulations
to set out possible evaluation questions
to demonstrate the links with monitoring requirements
to encourage the use of CIE

3. Evaluation criteria Effectiveness
achievement of YEI general objective - the sustainable integration in the labour market of the NEETs
targeting those most in need of support
contibution to Youth Guarantee
achievement of the specific objectives set by the MA under the 'NEETs' investment priority
comparing the effectiveness of individual measures

4. Evaluation criteria Efficiency
assessment of costs of achieving the general and specific objectives (cost-effectiveness)
comparison of cost-effectiveness of individual measures

5. Evaluation criteria Impact (net) impact on the level of participants
systems and structures
impact on macro level
impact on policies

6. Evaluation criteria Quality of (employment) offers
Definition of an offer used for common indicators
4 approaches to the assessment
characteristics of the employment offer
contract duration, part-time/full-time, voluntary/involuntary part- time, remuneration, level/type of qualification, job-related training
relevance to the participant needs
age, LM status, level of skills/qualifications, previous professional experience, previous unemployment/inactivity spans, household composition (joblessness), caring situation (lone parent)
labour market outcomes produced by the offer
non-acceptance and early termination rates

7. Evaluation criteria
Progress in continuing education, finding sustainable and decent jobs, or moving into apprenticeships or quality traineeships
intermediate steps of participants progression towards full labour market integration
quality of jobs
for decency the same characteristics as for quality of offers
sustainability – remaining in employment with equal or higher earnings
quality of traineeships – in line with Recomm. on QFT
type of the traineeship, learning content, working conditions, rights and obligations, duration

8. Approach and methodology
process evaluation
relevant to provide context to the impact evaluation
applicable in particular in 2015 evaluation
questions related to strategy, implementation, and partly effectiveness and efficiency
impact evaluation
theory based evaluation
counterfactual impact evaluation
questions related to impact, and partly effectiveness and efficiency

9. Data
sources
microdata collected for Annex I and II
use of representative samples for longer-term result indicators
additional data from profiling systems
other administrative data
surveys
recommended triangulation of objective and subjective sources
need to collect microdata for non-participants for CIE

10. Procedural issues Evaluation plan availability to the public
title, subject and rationale, methods, data sets, duration of the evaluation, and estimated budget
availability to the public
sending to the Commission
after approval of the final report or together with the relevant AIR

11. Thank you for your attention!