European Social Fund Promoting improvement Shirley Jones

Introduction Purpose of inspection Review of evaluation visits to date Key findings from evaluation visits Going forward Overview of the inspection process Reporting What happens after inspection

Purpose of inspection: Commissioned by DEL Builds on self- evaluation processes Identifies effective practice & key areas for development Informs quality improvement planning Promote improvement in the interest of all learners

Key messages of improvement from phase 1

Phase 1 - objectives To identify good practice, recognise how to build on this work and where improvement was needed to ensure the achievement of excellence To identify what can be done to make things better for young people, adults and the wider community To inform stakeholders, including providers and the Department about the quality of service provided – openness and transparency

Initial ETI visits Focused on the project’s own self- evaluation processes Evaluated how well the project: -identified their strengths and weaknesses and planned for improvement

Evidence base to date 79 organisations delivering 95 ESF projects All of the 24 CIF Projects –(18 of these projects were delivered by providers who also delivered ESF projects)

Examples of effective practice The strong advocacy roles on behalf of their participant groups and their commitment to social inclusion The experience and expertise of the project teams, including their knowledge and understanding of the target groups and their training and support needs The individualised and tailored programmes to meet the needs of the participants

Examples of effective practice The caring and inclusive ethos demonstrated in the mutually respectful relationships among the staff and participants The increased confidence and enthusiasm for learning expressed by most of the participants The collegial approach by the staff to meeting the needs of the participants, which is underpinned by their willingness to engage in appropriate and effective CPD

Examples of effective practice The strong focus on the employability needs of the participants and the development of the relevant skills, qualities and/or attributes needed to enhance their employability

Going forward Embed the culture and value of SE and QIP processes with staff at all levels across the projects Widen the evidence base used to inform SE and QIP processes Make more effective use of data, including the use of measurable outcomes to demonstrate more clearly the impact and value of the projects Include staff and other key stakeholders more fully in the SE process

Going forward Develop further the tracking of participants’ progress including the analysis of distance travelled based on their entry profiles, the qualifications they achieve, and their success in finding and sustaining employment Reflect more effectively on own practice and identify good practice more clearly Work with other projects to share examples of good practice more widely

Inspection process going forward

Going Forward – What will be different? Size and scale of inspection Longitudinal two phase inspection model Phase 1 - baseline inspection visit – main findings shared with the project and DEL Greater focus on first- hand evidence e,g talking to participants, visits to classes, talking to tutors and/or support staff

Going Forward – What will be different? Visiting participants in the workplace, talking to employers, etc Stronger emphasis on data, measuring progress and impact Direct observations of practice Second inspection visit within approximately12 months after the baseline will include performance levels and a published report The report from the second visit will be published on the ETI website

Going Forward – What will be the same? Self-evaluation report and quality improvement plan required as part of the overall process The inspection team will share their findings with you at both stages The interim period between visits is an opportunity to build on strengths and address areas for improvement

Performance levels Outstanding Very Good Good Important area(s) for improvement Requires significant improvement Requires urgent improvement Used to report on the quality of: Achievement and standards Provision for learning Leadership and management

One of four inspection outcomes for overall effectiveness Inspection reporting The organisation has a high level of capacity for sustained improvement in the interest of all the learners. The ETI will monitor the organisation’s progress in addressing any area(s) for improvement through its annual quality improvement planning.

One of four inspection outcomes for overall effectiveness Inspection reporting The organisation demonstrates the capacity to identify and bring about improvement in the interest of all the learners. The ETI will monitor the organisation’s progress in addressing the area(s) for improvement through its annual quality improvement planning.

One of four inspection outcomes for overall effectiveness The organisation needs to address (an) important area(s) for improvement in the interest of all the learners. The ETI will monitor and report on the organisation’s progress in addressing the area(s) for improvement, which includes the need to produce an improvement plan, which will be the basis for a formal follow-up inspection within months.

One of four inspection outcomes for overall effectiveness Inspection reporting The organisation needs to address urgently the significant areas for improvement identified in the interest of all the learners. The ETI will monitor and report on the organisation’s progress in addressing the areas for improvement, which includes the need to produce an improvement plan, which will be the basis for a formal follow-up inspection within months.

What happens before inspection? Letter of notification, 2 weeks prior to inspection Immediately, the reporting inspector will contact the organisation via phone call – direct them to ETI website RI will conduct a briefing, normally by phone to agree inspection requirements and arrangements Immediately prior to inspection, organisation to data and other inspection material to the ETI (RI)

NB: Updated annually

What happens during inspection? Inspection teamInspection activitiesInspection reporting

ETI: ETI team to include reporting/deputy reporting inspector Associate assessors, if required Organisation: BoG/M’c representatives Senior management Tutors, staff, participants & employers DEL Representative attends report back Inspection Team

The number of inspection days varies depending on the size and scale of the project Presentation by senior management Observation of sessions Scrutinise participants’ work/files/PTPs Meetings with key personnel Review of care, support and guidance Visit workplace training, meet employers Focus groups with learners Daily report backs to manager At the end of the inspection Moderation meeting, Report backs, DEL representative present

Baseline Inspection Visit Aim:To evaluate and baseline current practice to inform their interim QIP To provide a clear indication to the project as to what they need to do to enhance the overall quality of provision Will result in: Spoken report back of main findings for the organisation overall Written SOKF

Inspection Visit Aim: To evaluate impact, outcomes and to inform future developments Will result in: Spoken report back of main findings for the organisation overall Written SOKF One of six performance levels used for each of the three key questions Overall effectiveness paragraph.

WHAI

For ESF projects after their second visit Organisation (and DEL) receive a pre- publication copy of the report for factual accuracy check The RI considers any factual errors identified, and if necessary, discuss these with the organisation, making any required adjustments to the report prior to publication Report publishes on the ETI website, normally within 30 days of oral report back

If safeguarding is evaluated as unsatisfactory Safeguarding areas for improvement followed-up by the ETI within 6 working weeks Short letter publishes on the ETI website

Questions