1. Evaluation: what’s next?
Heather Morgan
on behalf of the Evaluation Team

2. Evaluation Team

3. Evaluation Components
Formative evaluation
Evaluability assessment
Summative evaluation

4. What Worked Well
Communications/meetings with project team at GRI during set up
Working closely with Jane to co-ordinate scaling up project and evaluation activities
Seeing InS:PIRE showcased at SICS/RRM
Engaging

5. What We Noticed/Learned
We provided feedback on the driver diagram and logic model – these have been revised
We need ethical approval for research (not service evaluation) – in progress
Focus of evaluation – scaleability/QI

6. How Did It Feel
Being a ‘critical friend’ is not straightforward – boundaries, bias, blur
Working together with GRI, but working on different projects – opportunities and challenges
Separate from scaling up sites – until now…

7. What We Plan To Do Next
Observational work at national learning sessions
Documentary analysis of site progress reports and social media/website materials
Interviews with staff/stakeholders at all sites
Interviews and focus groups with QI leads at all sites
Independent evaluation of outcomes – effectiveness and cost effectiveness

8. What We Are Looking At What worked well Even better if
Impact of context on intervention
Changing driver diagram(s)/logic model
Investigating theory of change

9. Inside the ‘black box’
OUTPUTS
INPUTS

10. What We Need Help With

11. What We Need Help With
SSIs – to be issued following ethical approval, please sign off – check s with leads for each site
Proposed dates for visits/numbers to interview staff/stakeholders
Proposed interviews with QI leads
Proposed focus groups with QI leads
GRI/GGC – Jo McPeake (mat leave) – Tara?
Crosshouse/A&A – Peter O’Brien
Golden Jubilee/GJ – Isma Quasim
Wishaw/Lanarkshire – Philip Lucie
Victoria/Fife – Lucy Hogg
Monklands/Lanarkshire – Laura Strachan

12. Staff/stakeholder – Interviews
Site
Dates
n=10 (of total n=35)
Crosshouse,
NHS Ayrshire and Arran
26th June
Cohort 4, week 6
Cohort 4
1 x staff
1 x patient/carer
Victoria,
NHS Fife ??
Cohort 3, week 6
Cohort 3
Glasgow Royal Infirmary, NHS Greater Glasgow and Clyde
25th May/6th July
Cohort 13/Cohort 14, week 6
Cohort 13/Cohort 14
NHS Golden Jubilee
Monklands and Wishaw,
NHS Lanarkshire
Cohort 2, week 6
Cohort 2
Logistics – re interviewing patient/carer – not attending in week 6

13. Staff/stakeholders – Interviews
Site
Dates
n=15 (of total n=35)
Crosshouse,
NHS Ayrshire and Arran
Late 2017
1 x staff
1 x patient/carer
1 x other stakeholder
Victoria,
NHS Fife
Glasgow Royal Infirmary, NHS Greater Glasgow and Clyde
NHS Golden Jubilee
Monklands and Wishaw,
NHS Lanarkshire

14. Staff/stakeholders – Interviews
Site
Dates
n=10 (of total n=35)
Crosshouse,
NHS Ayrshire and Arran
Early 2018
1 x staff
1 x other stakeholder
Victoria,
NHS Fife
Glasgow Royal Infirmary, NHS Greater Glasgow and Clyde
NHS Golden Jubilee
Monklands and Wishaw,
NHS Lanarkshire

15. QI leads – Individual ‘chats’
Site
Dates
Crosshouse,
NHS Ayrshire and Arran
Every cohort, week 6
Victoria,
NHS Fife
Glasgow Royal Infirmary, NHS Greater Glasgow and Clyde
NHS Golden Jubilee
Monklands and Wishaw,
NHS Lanarkshire
?? – NHS Ayr and Arran
Norma Beveridge – NHS Fife
?? – NHS Golden Jubilee
Malcolm Daniel – NHS GGC
Sanjiv Chohan – NHS Lanarkshire
Shaun Maher – Scottish Government

16. QI leads – Focus groups At national learning sessions Participants:
Geraldine Ovens – NHS Ayr and Arran
Norma Beveridge – NHS Fife
Christina MacLean – NHS Golden Jubilee
Malcolm Daniel – NHS GGC
Sanjiv Chohan – NHS Lanarkshire
Shaun Maher – Scottish Government

17. What We Could Help With
Be more visible/approachable now beyond setting up and into formative evaluation phase
Engage on
(How) would you like to receive our feedback?