ESF Leavers Survey 2010: Use of Counterfactual Impact Evaluation

Slides:



Advertisements
Similar presentations
Mainstreaming Transnationality into European Social Fund Programmes in Wales ( ) Neil Thomas (Welsh Assembly Government)
Advertisements

European Structural & Investment Funds: Update on Developments: 15 November 2013.
Evaluation at The Prince’s Trust Fire Service Prince's Trust Association meeting 18 th February 2010 Subtitle.
The French Youth Experimentation Fund (Fonds d’Expérimentation pour la Jeunesse – FEJ) Mathieu Valdenaire (DJEPVA - FEJ) International Workshop “Evidence-based.
European Transnational Programmes
Monitoring and Evaluation Strategy, Wales Kathryn Helliwell Research, Monitoring & Evaluation (RME) Team
WEFO’s Horizon 2020 Unit: supporting Welsh organisations Geraint Green Head of Horizon 2020 Unit Welsh European Funding Office.
Horizon 2020 Vanessa Davies, Horizon 2020 Unit Welsh European Funding Office.
The Cross Cutting Themes: Common Strategic Framework Equal Opportunities, Sustainable Development, Tackling Poverty and Social Exclusion Chriss.
Outputs and Outcomes Building Better Opportunities Neil King - Director – CERT Ltd.
Evaluating the employment impact of hiring incentives in Italy Pilot Projects to carry out ESF related Counterfactual Impact Evaluations Brussels, 7 th.
About OFFA Our role: To promote and safeguard fair access to higher education for lower income and other under-represented groups following the introduction.
Supported Employment and Social Enterprise Perfect Partners?
Counterfactual Impact Evaluation in the Framework of ESF
Feedback from Peer Review on 'Counterfactual Impact Evaluation' Tamara SMETANOVÁ Ministry of Labour and Social Affairs, Czech Republic Kamil VALICA DG.
Country: Mauritius Manufacturing and Services Development and Competitiveness Project CROSS-COUNTRY WORKSHOP FOR IMPACT EVALUATIONS IN FINANCE AND PRIVATE.
The rise of RCTs in education: statistical and practical challenges Kevan Collins.
Cronfeydd yr UE: Buddsoddi yng Nghymru EU Funds: Investing in Wales European Structural and Investment Funds ( ) Thomas Smithson, Welsh European.
Welsh European Funding Office (WEFO) Peter Ryland May 2012.
1 Health Needs Assessment Workshop Sue Cavanagh Keith Chadwick.
A Brave New World: Using the New Ofsted Framework on DWP Inspections Karen Adriaanse March 2010.
Kirstie Hickson Policy Officer (South)
EVALUATION OF THE AGRICULTURAL DEVELOPMENT PROGRAM SUPPORT PROJECT
Big Lottery Fund Learning from Social Impact Bonds and other outcomes based interventions Phil Messere Funding Manager Big Lottery fund.
Using Administrative Data for Federal Program Evaluation
Workshop on Strategic Programming, Monitoring and evaluation Focusing on Performance and REsults Madrid, 22 February 2013 Ines Hartwig DG Employment,
Conducting and interpreting feedback surveys
Danutė Burakienė, the Ministry of Finance
Head of Education British Film Institute
Identify stakeholders:
Lessons learned from the evaluation of the ESF
A Practical Example of Joined Up Working
Impact evaluations at IFAD-IOE
Conducting Efficacy Trials
Data in the third sector (Health Development Officer)
Emma Tate Investigating the implication of SERC applying to the call-out for applications to NI ESF Programme th December 2014.
Alison Hill, Deputy Chief Knowledge Officer
Unit assessment preparation
Title List your Team Members
ESF EVALUATION PARTNERSHIP MEETING – 15 MARCH 2013
QUALITY DEVELOPMENT IN COLOMBIA AND LATIN AMERICAN
Counterfactual impact evaluation: Czech experience with control groups
Future of the ESF ESF Committee Amsterdam, 15/06/2016.
Data collection, Data access and Data merging
Implementation Challenges
© 2010 Emerson Human Capital Consulting, Inc. All Rights Reserved.
Title List your Team Members
III. Practical Considerations in preparing a CIE
How the ESF supports implementation of the New Skills Agenda?
Evaluation of the Labour Market Activation Fund 2010
Experiences so far in Wales
Identify stakeholders:
ESF Evaluation Plan England
Evaluating ESF co-financed interventions using counterfactuals
Future Monitoring and Evaluation: Focus on results Antonella Schulte-Braucks Ines Hartwig ESF Evaluation Partnership Brussels 17 November 2011.
Claire Charlton – Housing 21 Sheila Watson – North Tyneside Council
Evaluating the effects of ESF programmes
01/05/2019 Consultancy Business Intelligence Insight and Analysis CoP Specialty Skills 1.
Conference Address John Graystone Chief Executive CollegesWales
Overview Organizational development is... organizational wide
Counterfactual impact evaluations - experience of EFS Managing Authority in Poland Expert hearing on MS experiences on using control groups in ESF evaluations.
Support Tools for ESF Evaluation
ESF EVALUATION PARTNERSHIP
Feedback from Peer Review on 'Counterfactual Impact Evaluation'
Evaluation and Impact Assessment Unit DG EMPL Ines Hartwig
Title List your Team Members
ESF Ex-post evaluation Finalisation and Dissemination
The Application of Statistical Matching to the 2010 ESF Leavers Survey
Evaluation of Youth Employment Initiative
Experiment or quasiexperiment: success and failure. Lithuanian case
Presentation transcript:

ESF Leavers Survey 2010: Use of Counterfactual Impact Evaluation

Why CIE and ESF interventions aimed at those out of work? Key Questions: Does participation in an ESF funded project increase the likelihood of those previously out of work gaining employment? What would participants have done in the absence of ESF? Ewrop & Chymru: Buddsoddi yn eich Dyfodol Europe and Wales: Investing in your future Ewrop & Chymru: Buddsoddi yn eich dyfodol Europe & Wales: Investing in your future

Main challenges No random allocation Preparatory work Choice of control group Choice of statistical matching technique Communication Contractor skill set Ewrop & Chymru: Buddsoddi yn eich Dyfodol Europe and Wales: Investing in your future Ewrop & Chymru: Buddsoddi yn eich dyfodol Europe & Wales: Investing in your future

Maximising use of CIE Monitoring data Developed participant database to match national datasets Consultants independently assessed feasibility of using CIE with the data WEFO holds Issue of consent for data linking Ewrop & Chymru: Buddsoddi yn eich Dyfodol Europe and Wales: Investing in your future Ewrop & Chymru: Buddsoddi yn eich dyfodol Europe & Wales: Investing in your future

Dissemination and use of results Evidence for Senior Management Team of effectiveness of match funding Evidence for Commission of effectiveness of ESF Evidence for projects of effectiveness of activity/delivery Use Results just in; will be used in negotiations for next programming round Ewrop & Chymru: Buddsoddi yn eich Dyfodol Europe and Wales: Investing in your future Ewrop & Chymru: Buddsoddi yn eich dyfodol Europe & Wales: Investing in your future