In REF 2014 the impact must have occurred during the period 1 January 2008 to 31 July 2013, underpinned by research produced during the period 1 January 1993 to 31 December 2013. Impact within the higher education sector (whether in the UK or internationally) was previously excluded. For REF 2014 Outputs were assessed in terms of originality, significance and rigour; Impact in terms of reach and significance; Environment* in terms of vitality and sustainability. *Environment covers Research Strategy; People; Income, Infrastructure and Facilities; and Collaboration and Contribution to the Discipline or Research Base

Research Excellence Framework 2014: Overview report by Main Panel D and Sub-panels 27 to 36 “This process also called upon a significant number of organisations and institutions to provide testimonials and data in support of the impact case studies. Main Panel D sub-panels found evidence of many outstanding examples with 37 per cent judged to be outstanding (4*) and a further 44 per cent to be very considerable (3*). Whereas some impact case studies demonstrated that the underpinning research had been specifically undertaken to achieve the impacts there were many other instances where significant impacts had not been planned or anticipated when the research was first undertaken.”

Research Excellence Framework 2014: Overview report by Main Panel D and Sub-panels 27 to 36 “Sub-panels generally observed that the strongest impact templates provided evidence of activities and approaches to research that were outstanding in their engagement with external organisations and audiences. They also displayed a clear understanding of the need for institutional support when describing their strategy and plans”

Research Excellence Framework 2014: Overview report by Main Panel D and Sub-panels 27 to 36 “Strong impact case studies typically provided brief but detailed summaries of activities and impacts rather than long lists; and provided concrete evidence of the claims being made with regard to both reach and significance, including who benefitted and how. They clearly articulated substantial research imperatives in the ‘underpinning research’ section, which were then evidenced by research outputs and robust data that explicitly reflected the relationship between the research process, finding or product and the impact achieved in the public domain.”

Research Excellence Framework 2014: Overview report by Main Panel D and Sub-panels 27 to 36 “Some of the very best submissions to the sub-panel pointed to impact resulting from conversations and interaction between researchers and user groups, over sometimes considerable periods of time, demonstrating that outstanding impact is often a two-way and long-term process. Excellent examples of impact were also found among case studies that were determined by the needs of users responding to research (what might be termed the ‘consultancy’ model) or the imperatives of researchers (what might be termed the ‘discovery-dissemination’ model). Less convincing submissions tended to dwell on the esteem of the researcher(s)”

Research Excellence Framework 2014: Overview report by Main Panel D and Sub-panels 27 to 36 “A majority of case studies gave convincing and compelling examples of reach and significance in the UK and beyond, including: improving economic prospects, e.g. in supporting business, and enhancing economic opportunities and building capacity in developing countries enriching understanding of other cultures and faiths, e.g. among young learners, and among people working in or visiting cultural institutions informing the policy making process in the UK and beyond, e.g. contextualising and/or problematising the decisions debated and reached by governments and civil servants, NGOs, and other bodies providing expert advocacy and testimony, e.g. advising on legal cases involving asylum, migration, extradition or human rights issues.”

Who benefitted and How?

Professionals leading the conservation and presentation of our international cultural heritage, specifically museo-historical and critical practices, leading to improved visitor access, engagement and experience at, for example, Tate Britain and Tyne and Wear Archives and Museums.   Artists and performers seeking academic partnership within our regional and national festivals and events as support for their professional development, creative expression and global relevance. Service providers and policy makers seeking new perspectives on the future of design practice and interaction supporting innovation through science and technology in society. These include: the NHS; design research leads at Microsoft; professionals within the banking industry; and local government and charities, informing policy and practice around ageing (Newcastle City Council, Age Concern). Specialists leading the environmental and communicative enrichment of healthcare and clinical systems, including new approaches to curating artistic events in healthcare settings. SMEs in the healthcare sector, who do not have the resources to invest in their own knowledge development, but who benefit from our ERDF-funded Healthcare Technology Development Programme which enables design-led innovation in healthcare product and service development.

Developing the Educational Profile of Genre Film Festivals Summary of the impact The Case Study illustrates how research into cult, fantasy and horror films has been used to engage organisers of film festivals — most notably the `Abertoir' festival based in Wales and the `Offscreen' festival in Brussels — contributing to enhanced educational content which provided new audience experiences at both festivals. The primary activity was the incorporation of the presentation of research findings to audiences within festival programmes. The impact derives from the resulting changes in the way that the festivals were organised, programmed and contextualized for audiences and consequent changes in the profile of the festivals concerned. The main benefit relates primarily to the organizers; in particular, the enhancement of the educational content of the Abertoir Festival has enabled it to bid for additional funding from the Film Agency for Wales during the census period.

Looking ahead to REF 2021: Examples of areas of impact Not sufficiently detailed Sufficiently detailed Example 1 Impact on ‘policy development’ Impact on ‘child support policy’ or ‘rural housing policy’ Example 2 Impact on ‘health services’ or ‘clinical practice’ Impact on ‘treatment of diabetes’ or ‘stroke prevention’ Example 3 Impact on ‘business performance’ Impact on ‘the consumer electronics industry’ or ‘decision-making in the oil business’ Example 4 Impact on ‘cultural enrichment’ Impact on ‘preserving and presenting regional literary heritage’ or ‘public engagement with contemporary visual arts’

REF 2021: Weighting of outputs, impact and environment 60% Impact 25% Environment 15%

Impact Case Studies – REF 3b Questions drawn from HEFCE REF Guidance in line with structure of case study template: The impact The research The evidence The overall story

REF 3b – the Impact Is it clear who/what benefitted and how? Is it clear whether the impact would have been possible without the underpinning research? Does the summary of impact clearly capture the impacts stated in the case study?

REF 3b – the Research Does the underpinning research clearly relate to the impacts claimed? Are the research outputs relevant to the case study/impact? Is the research adequately explained and is the research set in context? Is there evidence that the research is of 2* and above quality?

REF 3b – the Evidence Is it clear how the research contributed? Is there strong evidence of who/what benefitted and how?

REF 3b – the overall ‘story’ Is the title of the case study appropriate? Does it accurately represent the case study? Does the case study tell a coherent story?