Impact: how academics and their work make a difference Jane

The Impact of the Social Sciences project Three-year HEFCE funded project, LSE working with the University of Leeds and Imperial College London. Looked at how academic work had impact on government, business and civil society. Book from the research: Simon Bastow, Patrick Dunleavy and Jane Tinkler (2014) The Impact of the Social Sciences: How academics and their research make a difference. London: Sage. Have just spent a year working in Parliament to see how closely trying to achieve impact in reality matched the theory!

1. What is impact and how does it happen?

Impact is defined as an effect on, change or benefit to the economy, society, culture, public policy or services, health, the environment or quality of life, beyond academia. Definition explicitly includes raising the level of public debate and public scrutiny, public engagement, changing policy and practices, use by professional bodies. But excludes impact on research or the advancement of academic knowledge within the HE sector. And acting as an expert or advisor to a public body does not itself equal impact. Panel criteria gives guidance on examples of impact and types of evidence that could be provided. Encourages the “submission of a wide range of types of impact” in case studies. REF2014’s definition of impact

Science Foundation Ireland classifies the impacts of scientific research according to 8 pillars

Knowledge currently in use Knowledge not in current use Applied knowledge and research Theory-based, abstract knowledge and research ‘Ordinary knowledge’ Dynamic Knowledge Inventory: a model of impact for the humanities and the social sciences

2. What did our research on impact show?

2. Connecting with an external organization 3. Identifying a quid pro quo in applying research 5. Building and extending a relationship 4. Finding traction for applying research within the organization 6. Demonstrating specific benefits to the organization 1. Identifying potentially interested external organizations The six stages of building relationships with external stakeholders

Academic work benefits from translation and mediation, so working with organisations to share research can be important

Journalists are key mediators of academic work for policymakers

Academics doing their own translating – via academic blogging

3. The UK Research Excellence Framework 2014

The rise of the ‘impact agenda’ Since the mid-2000s, all UK research councils have required an impact statement for each funding application submitted to them. In 2008, HEFCE announced details of the new Research Excellence Framework that from 2014 would include an impact element, making up 20% of funding. REF2014 is now completed so the debate on impact starts again as UK universities account for what the process cost them. And looking forward to REF2021, we expect changes to the definitions but also a potentially radically increased use of metrics.

“I think that is where the REF has been a force for good. I work in a department dominated by neuroscientists. And the kind of work that we do is probably seen at the bottom in terms of status. But suddenly when you see how much money is dependent on your REF impact statements, the clinical psychologists and myself suddenly seen to play a very important role in the department.” Responses to the REF 1: The REF is good for those already undertaking impact activities as incentives in universities previously didn’t support them

“I think impact is hugely important, but as always, the one-size-fits-all approach is just causing its problems.” “It is frankly chasing the end of the rainbow to try to identify change as the result of one piece of work. You have got to see it as part of a process.” Responses to the REF 2: But the model of impact used in the REF doesn’t sufficiently take into account the collective nature of academic research

The importance of building relationships of trust and giving wise counsel when it is requested. That is one thing where I have been critical of the REF process, how does it capture that? That wise advice. We rely on [academics] to get good, sound, expert advice at key stages Policymakers want... advice based on a range of evidence, the knowledge of the researcher rather than just a single individual project can be key in influencing policy thinking. It carries real weight because it is trusted advice. Responses to the REF 3: And does it measure what external users of research want? Policymakers are not sure

REF impact case studies showed the richness and diversity of academic work

Different types of impact are more common in different disciplines

REF evaluations found The societal impact of research from UK Higher Education Institutions is considerable, diverse and fascinating The research underpinning societal impacts is multidisciplinary, and the social benefit arising from research is multi-impactful There was no agreement on what evidence or metrics to use for impact As a result of REF, universities have changed their culture around impact, making fixed term posts permanent and including impact in promotion criteria They are implementing strategies and systems to capture evidence of impact on an ongoing basis

Most interesting for me is the culture change in universities that seems to have taken place Setting out an impact strategy Implementing systems to store evidence of impact Fixed-term posts becoming permanent Capturing evidence of impact on an ongoing basis Inclusion of impact as a criterion for promotion Building a plan for impact into projects

4. How will the impact agenda develop – REF2021 and beyond?

Around 70% of case studies included underlying research that was interdisciplinary All types of impact considered equal? Largest group of cases (40%) focused on impact on policy More analysis of the case studies is needed to identify methods that worked in creating impact e.g. building long-term partnerships What can we learn from what was judged excellent impact?

So where next for impact? Incentives for undertaking impact activities are still not well aligned especially for some groups of academics (early career researchers) More support needed on how to create impact (new skills, resources and sabbaticals) Metrics for impact are challenging and controversial More research is needed (!) Significant missed opportunity by the Research Councils not creating a funding stream to analyse the impact case studies as a source of learning on how impact is created

5. A hopeful final thought

solid middle 16% influential 9% communicator 7% invisible 25% applied researcher 17% publisher 27% Can academics both publish and be impactful? Social media effects

And results from the UK Research Excellence Framework in 2014 agree

Further information The Impact of the Social Sciences blog shares good practice from the research community on key topics of interest.Impact of the Social Sciences It has links to two guides that are freely available: Downloadable chapter from the book A handbook on maximising your own impact A guide to using twitter for academics Facebook: Impact of Social Sciences