Evaluating implementation of the IRF in Ayrshire & Arran, Highland, Lothian and Tayside IRF Clinical Event June 9, 2010 Presentation by Marian Craig

Integrated Resource Framework Evaluation The evaluation team Roddy Ferguson, Fortuno Consulting Marian Craig, Falcon Craig Consulting Dr Andrew Walker, University of Glasgow Professor Sally Wyke, University of Stirling Ailsa Stewart, Glasgow School of Social Work Janet Biggar & Ruth Bryan, George Street Research

Integrated Resource Framework Evaluation Opportunities from the evaluation Formative evaluation Action research Lessons for wider application Set up a database for monitoring impact beyond the lifetime of this evaluation

Integrated Resource Framework Evaluation Challenges for the evaluation Attribution Timescale for measuring change Different pace of change in different test sites Judging when to assess impact Capturing data on soft indicators

Integrated Resource Framework Evaluation The evaluation process Stage 1 – Clarifying the brief March-April 2010 Evaluation team and SG Integrated Resourcing Team meet to clarify brief and agree scope Stage 2 – Context analysis (March – May 2010) Learn from evidence review Meet IRF Programme Board – national stakeholders’ views & expectations Meet IRF Steering groups at each test site – local stakeholder views, local variation in approach, scope, focus

Integrated Resource Framework Evaluation The evaluation process Stage 3 – Framework development (May 2010) National programme evaluation framework Four local project evaluation frameworks Evaluation tools to collect data and information

Integrated Resource Framework Evaluation The evaluation process Stage 4 – Action research (June 2010 – August 2011) 3 phases: baseline, interim, final Gather quantitative and qualitative information from partners at each of the test sites Analyse and report back to test sites and SG at end of each phase

Integrated Resource Framework Evaluation The evaluation process Stage 5 – Reporting (August 2011 – November 2011) Build databank of evidence throughout the evaluation Local report for each test site based on baseline, interim and final measurement reports Feedback seminar in each test site Final report plus 4-page research summary Guidance notes on resource integration for: -NHS Boards -Local Authorities -Primary Care Providers -Elected members -Patients, families and carers

Integrated Resource Framework Evaluation Some key questions To what extent are pilots successful in developing capitated, risk-adjusted budgets? Are those who make resource-use decisions i.e. clinical and care staff, involved in planning and implementing the pilot projects? Are information systems able to support integrated working? Is there clear leadership from elected members and Health Board members as well as senior managers? In the absence of real budgets, do governance arrangements enable investment upstream? Are processes and systems in place to measure the impact of change in the medium- and long-term?