Evaluating and Measuring Impact Presented by – Date –

Workshop Aim To understand why evaluation and measuring impact are key to a ‘capacity to improve’ and the effective delivery of CLIAG

Objectives Describe the terms monitor, review, evaluation and quality improvement Identify what effective evaluation of CLIAG includes State what measuring impact includes Explore some different ways of measuring impact Identify external measures via Ofsted and the matrix Standard Identify what Ofsted judge as effective IAG – a case study approach By the end of the session, participants will be able to:

Monitoring, Review and Evaluation These are all evidence-gathering processes to identify the current position and inform continuous improvement Monitoring and review are the formative processes Evaluation is the summative process

Monitoring Activities Ask… ‘did it happen?’ Tracking Attendance Participation Curriculum coverage Assessment Retention and achievement Progression

Review Activities Ask……… what went well?’ Meetings Partnership agreement negotiations Feedback sheets

Evaluation Activities Ask…..’was it worth it?’ Focus groups Surveys Questionnaires

Drawing This Together Monitoring and review activities - Draw attention to successes Highlight areas that need changing Identify opportunities for development Evaluation activities – Generate information on impact and value Provide evidence against which you can make judgments relating to the quality of provision and practice Inform the continuous improvement plan and the organisation’s capacity to improve

Evaluation Frameworks Identify the qualitative and quantitative data that is going to be gathered Outline how the data is going to be used Reach – numbers and types of individuals affected by, or in contact with, the CLIAG intervention Reaction - Initial feedback from the learners Learning – What has been learnt as a result of the activity or information and can this be evidenced Impact – What does the individual do differently and how does this feed into the organisation’s effectiveness Based on Donald Kirkpatrick’s Learning Evaluation Model 1959

Completing the CLIAG Audit Activity Individually go through the audit tool and make judgments relating to CLIAG processes and practices within your organisation In fours, compare your assessments, noting similarities and differences

The Focus of Ofsted Capacity to Improve The ability of a provider to continue improving standards and progress based on what it has accomplished so far or to maintain exceptionally high standards. This is based on evidence of the impact of improvements implemented by the provider as shown in its track record and performance. Ofsted 2009 Activity Following from your audit, select one area that you need to improve and then identify a range of interventions that could be considered in order to make this improvement

Measuring Impact The impact that effective CLIAG has will reflect in the outcomes for the learner for example Attendance Participation Curriculum coverage Assessment Retention and achievement Progression Measuring Impact is about setting clear measures in each of these areas and being able to track this to the effectiveness of the CLIAG. Please remember that measures can be both quantitative and qualitative

External Measures Ofsted: How well do learners achieve and enjoy their learning? Learners’ attainment of their learning goals How well learners progress. Do learners feel safe How well do learners improve their economic and social wellbeing through learning and development Are learners able to make informed choices about their own health and wellbeing? How well do learners make a positive contribution to the community?

Quality awards Local quality awards The matrix Standard: the national quality standard for any organisation that delivers information, advice and/or guidance on learning and work

Revisiting the Workshop Objectives Describe the terms monitor, review, evaluation and quality improvement Identify what effective evaluation of CLIAG includes State what measuring impact includes Explore some different ways of measuring impact Identify external measures via Ofsted and the matrix Standard Identify what Ofsted judge as effective IAG – a case study approach approach