1. UK Vocational Qualification Reform Programme Research and Evaluation (Project 2): An overview 2nd Vocational Qualification Reform Conference 3 June 2010

2. Purpose Interactive session Raise awareness of P2 activities Encourage contribution into development of future activities and ensure NI requirements are met Highlight ways in which P2 work can be used in NI Discuss early findings Consider future work

3. Background One of five projects with UK remit Responsibility of UKCES since April 2009 Two full-time staff currently in post Role extends to March 2011 Independent / objective perspective on Programme

4. Objectives To assess the level, extent and nature of benefits for employers and learners (summative) To review progress towards benefits to inform Programme design and implementation (formative)

5. Learner benefits Learner LB1: More appropriately skilled LB2: Better understanding of career opportunities LB4: Improved understanding of qualifications LB3: Increased flexibility of learning I have skills that are aligned to the needs of my industry/sector/employer and that will help me in my current /future job I understand how this qualification will benefit me in my current job and how it can benefit me in future jobs I can take qualifications in a manner that suits my lifestyle & fits with my employers time demands. I can choose to mix and match the units that are applicable to me I understand what I will learn in my qualification and how it compares with other qualifications

6. Employer benefits My employees qualifications give them the skills that enable them to have an immediate impact on my companys bottom line I can influence or create a qualification that addresses the skills gaps in my organisation Qualifications are created in a timeline that is consistent with my needs My workforce can take the qualifications at a time and in a mode that suits my business I understand what my employees will learn in their qualifications, how these compare with other qualifications and how they will help my employees progress within my business Employer EB2: Demand responsive qualifications EB1: More appropriately skilled workforce EB3: More flexible qualification system EB4: Improved understanding of qualifications

7. Approach Monitoring and evaluation framework: Levers Process measures Immediate outcomes Benefits realisation, universal element Causality

8. LB3: Increased flexibility of learning I can take qualifications in a manner that suits my lifestyle & fits with my employer's time demands. I can choose to mix and match the units that are applicable to me

9. Current activities Programme outcomes baseline End-to-end VQ case studies Progress monitoring system (dashboard) Synthesis of project evaluation work Overarching report May 2010

10. KEY FINDINGS

11. LB1 / EB1: Relevance of content Progress in populating QCF Significant take-up of QCF VQs Some reformed VQs more relevant than predecessors Majority of content migrated without reform – tactical vs strategic development Commitment to ongoing development

12. LB2 –VQs and career development VQ development supports pathways in some sectors Not being communicated to learners yet Supporting elements not in place: LR/RTA, IAG readiness

13. LB3 / EB3 - Flexibility VQ development process showing increased engagement with QCF principles Much of potential flexibility remains notional Flexibilities generally not being realised through delivery at this stage Except for some cases of full cost provision to employers

14. LB4 / EB4 – understanding of QCF principles QCF titling conventions being applied Readiness at early stage Learners: little evidence of understanding of QCF principles Employers stress continuity; also some concerns

15. EB2 – Demand responsive VQs Employers feel they have had an influence when directly involved in VQ development Continued concerns over timeliness of development but long initial lead time may indicate good practice Providers often receive VQ information on just in time basis

16. Questions To what extent do initial findings reflect situation in NI? In which areas has NI seen greatest progress? What are the main barriers to progress in NI? What should priorities be for future evaluation work?