Evaluation: what’s next? Heather Morgan on behalf of the Evaluation Team

Evaluation Team

Evaluation Components Formative evaluation Evaluability assessment Summative evaluation

What Worked Well Communications/meetings with project team at GRI during set up Working closely with Jane to co-ordinate scaling up project and evaluation activities Seeing InS:PIRE showcased at SICS/RRM Engaging with @InSPIREICU

What We Noticed/Learned We provided feedback on the driver diagram and logic model – these have been revised We need ethical approval for research (not service evaluation) – in progress Focus of evaluation – scaleability/QI

How Did It Feel Being a ‘critical friend’ is not straightforward – boundaries, bias, blur Working together with GRI, but working on different projects – opportunities and challenges Separate from scaling up sites – until now…

What We Plan To Do Next Observational work at national learning sessions Documentary analysis of site progress reports and social media/website materials Interviews with staff/stakeholders at all sites Interviews and focus groups with QI leads at all sites Independent evaluation of outcomes – effectiveness and cost effectiveness

What We Are Looking At What worked well Even better if Impact of context on intervention Changing driver diagram(s)/logic model Investigating theory of change

Inside the ‘black box’ OUTPUTS INPUTS

What We Need Help With

What We Need Help With SSIs – to be issued following ethical approval, please sign off – check emails with leads for each site Proposed dates for visits/numbers to interview staff/stakeholders Proposed interviews with QI leads Proposed focus groups with QI leads GRI/GGC – Jo McPeake (mat leave) – Tara? Crosshouse/A&A – Peter O’Brien Golden Jubilee/GJ – Isma Quasim Wishaw/Lanarkshire – Philip Lucie Victoria/Fife – Lucy Hogg Monklands/Lanarkshire – Laura Strachan

Staff/stakeholder – Interviews Site Dates n=10 (of total n=35) Crosshouse, NHS Ayrshire and Arran 26th June Cohort 4, week 6 Cohort 4 1 x staff 1 x patient/carer Victoria, NHS Fife ?? Cohort 3, week 6 Cohort 3 Glasgow Royal Infirmary, NHS Greater Glasgow and Clyde 25th May/6th July Cohort 13/Cohort 14, week 6 Cohort 13/Cohort 14 NHS Golden Jubilee Monklands and Wishaw, NHS Lanarkshire Cohort 2, week 6 Cohort 2 Logistics – re interviewing patient/carer – not attending in week 6

Staff/stakeholders – Interviews Site Dates n=15 (of total n=35) Crosshouse, NHS Ayrshire and Arran Late 2017 1 x staff 1 x patient/carer 1 x other stakeholder Victoria, NHS Fife Glasgow Royal Infirmary, NHS Greater Glasgow and Clyde NHS Golden Jubilee Monklands and Wishaw, NHS Lanarkshire

Staff/stakeholders – Interviews Site Dates n=10 (of total n=35) Crosshouse, NHS Ayrshire and Arran Early 2018 1 x staff 1 x other stakeholder Victoria, NHS Fife Glasgow Royal Infirmary, NHS Greater Glasgow and Clyde NHS Golden Jubilee Monklands and Wishaw, NHS Lanarkshire

QI leads – Individual ‘chats’ Site Dates Crosshouse, NHS Ayrshire and Arran Every cohort, week 6 Victoria, NHS Fife Glasgow Royal Infirmary, NHS Greater Glasgow and Clyde NHS Golden Jubilee Monklands and Wishaw, NHS Lanarkshire ?? – NHS Ayr and Arran Norma Beveridge – NHS Fife ?? – NHS Golden Jubilee Malcolm Daniel – NHS GGC Sanjiv Chohan – NHS Lanarkshire Shaun Maher – Scottish Government

QI leads – Focus groups At national learning sessions Participants: Geraldine Ovens – NHS Ayr and Arran Norma Beveridge – NHS Fife Christina MacLean – NHS Golden Jubilee Malcolm Daniel – NHS GGC Sanjiv Chohan – NHS Lanarkshire Shaun Maher – Scottish Government

What We Could Help With Be more visible/approachable now beyond setting up and into formative evaluation phase Engage on Twitter – @hm_morgan @marionkcampbell (How) would you like to receive our feedback?