Impact after REF: Issues and Opportunities Chris Hewson School of Environment, Education and Development / School of Social Sciences University of Manchester

Overview Models & Definitions (REF, ESRC, etc.) Lessons from REF Embedding Impact Supporting Impact Questions

The logic model of the Payback Framework Impact Model: Payback The logic model of the Payback Framework Hanney et al (2004)

Social Impact Assessment Methods through Productive Interactions Impact Model: SIAMPI Social Impact Assessment Methods through Productive Interactions (EU-FP7 2010)

Pathways to Impact: RCUK (2009-) Impact Model: RCUK Pathways to Impact: RCUK (2009-)

Impact Definition: ESRC Academic impact is the demonstrable contribution that excellent social and economic research makes to scientific advances, across and within disciplines, including significant advances in understanding, method, theory and application. Economic and societal impact is the demonstrable contribution that excellent social and economic research makes to society and the economy, of benefit to individuals, organisations and nations.

Impact Definition: ESRC Instrumental: influencing the development of policy, practice or service provision, shaping legislation, altering behaviour Conceptual: contributing to the understanding of policy issues, reframing debates Capacity building: through technical and personal skill development.

Impact Model: REF Why the REF Impact Case Studies are so difficult to write (especially in the social sciences and humanities) Dunleavy (2012)

Impact Model: REF Dunleavy (2012)

Impact Definition: REF (Panel C) “The main panel acknowledges that impact within its remit may take many forms and occur in a wide range of spheres. These may include (but are not restricted to): creativity, culture and society; the economy, commerce or organisations; the environment; health and welfare; practitioners and professional services; public policy, law and services.” “The categories used to define spheres of impact… inevitably overlap and should not be taken as restrictive. Case studies may describe impacts which have affected more than one sphere.”

Impact Definition: REF (Panel D)

Rules: REF Counterfactual? “‘Underpinned by’ means that the research made a distinct and material contribution to the impact taking place, such that the impact would not have occurred or would have been significantly reduced without the contribution of that research.” Disinterment? “Each case study must explain how (through what means) the research led to or contributed to the impact, and include appropriate sources of information external to the HEI to corroborate these claims.”

Evidence: REF (Panels C & D)

56 Indicators? Holbrook, Barr & Brown (2013)

REF: 6 Lessons Dissemination/pathways alone are not impact Difficult to tie impact to specific research Some impacts are direct, others mediated Impact is flexible – based on reach and significance, alongside a clear evidence trail New models of social engagement and measurement may be required Corroboration is the glue, not the icing

Embedding Impact Mapping relationships with stakeholders Reviewing traditional models of dissemination Charting subsidiary impacts through ongoing dialogue Balancing reach and significance Critiquing the relationship between research quality and impact Assessing support requirements Discipline specificity Assistance with bids Capturing data

Supporting Impact DA Level School Level Faculty Level University Level

Contact Chris Hewson chris.hewson@manchester.ac.uk Twitter: c_d_hewson