Cover: Guidance for standardising quantitative indicators of impact within REF case studies

Guidance for standardising quantitative indicators of impact within REF case studies

Published Jul 23, 2018

by Sarah Parks, Becky Ioppolo, Martin Stepanek, Salil Gunashekar

Download eBook for Free

FormatFile SizeNotes
PDF file 0.5 MB

Use Adobe Acrobat Reader version 10 or higher for the best experience.

The Higher Education Funding Council for England (HEFCE) (now Research England), on behalf of the four UK higher education funding bodies, asked RAND Europe to (i) identify quantitative indicators used as evidence of impact in the case studies submitted to the Research Excellence Framework (REF) 2014; and (ii) develop guidance for how these indicators could be standardised for potential use in REF 2021.

Using a mixed-methods approach involving a blend of text mining and qualitative methods, we analysed the non-redacted impact case studies that were submitted by UK higher education institutions to REF 2014 in order to develop the guidance.

The report proposes guidance for two broad categories of standards. First, a 'style guide' is proposed containing general stylistic items that could be standardised in order to make quantitative indicators of impact — and specific formulations of them — more discoverable in general. Second, 'specific guidance' is presented which addresses more specific and commonly occurring quantitative indicators that have been used as evidence of impact in the REF 2014 case studies. Both sets of guidance presented in this report are intended to inform the development of the guidance and criteria for the preparation of impact case studies in REF 2021. A more standardised 'reporting structure' of quantitative impact indicators will increase the ease of conducting any post-REF analysis of the data. This would enable more detailed analyses of the data to demonstrate evidence of the impact of academic research in the UK to a broad range of stakeholders.

Research conducted by

The research described in this report was prepared for Research England and conducted by RAND Europe.

This report is part of the RAND research report series. RAND reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND reports undergo rigorous peer review to ensure high standards for research quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.