Evaluating the Impact of Research on Policy and Practice Case studies of HPD funded research in Ghana and Tanzania Sarah Hall

Why should research be evaluated? l Need for expenditure to be justified l Highlight good (and poor) practice l Provide justification for further funding

Methodology l Case study approach l Use of the Buxton input - output model

Buxton Input - Output Model l Stage 0Research needs assessment l Interface (a)Project specification, selection and commissioning l Stage IInputs l Stage IIProcesses l Stage IIIPrimary outputs l Interface (b)Dissemination l Stage IVSecondary outputs l Stage VApplications l Stage VIImpacts or final outcomes

l Vitamin A supplementation trial (LSHTM) l Multi-centre trial of magnesium sulphate for management of eclampsia (NEU, University of Oxford). l Obstetric Audit (University of Aberdeen) l Near Miss Audit Project (LSHTM) l Health Sector Reform and Malaria Control (local PIs supported by LSTM) Case Studies in Ghana

Case Studies in Tanzania l Field Trials of a “Dip it Yourself” kit for impregnation of bednets (LSHTM) l Comparison of house spraying and ITN for reduction of malaria incidence (LSHTM / NIMR) l School health programmes in primary schools (CICH / UKUMPTA) l Impact of deworming on among school age children (ICH / UKUMPTA) l Mwanza HIV / STD intervention trial (LSHTM / AMREF / NIMR / MoH)

Direct and indirect impacts found as a result of research l Direct health benefits to communities as a result of interventions introduced as part of the research study l Capacity building l Further development of the research agenda l The incorporation of research findings into policy and practice l Contributing to changes in social climate

Issues affecting the impact of research on policy and practice

Advantages of case studies l Provide comprehensive information about impact l Provide valuable examples of good practice and opportunities for lesson learning l Provide information about process as well as outcome l Provide feedback from a number of stakeholders

Practical and methodological considerations l Proportionality of effort l When should the case study be carried out? l Assessed impact of projects rather than programmes - could case studies be effectively used to assess the impact of programmes? l How much effort should be put into identifying final outcomes?

Further issues for HPD l What criteria should HPD use to assess impact? l What methods should be used?