It Worked: REF 2014 Was Successful in Assessing Research Impacts
Mar 25, 2015
|PDF file||1 MB|
|PDF file||0.6 MB|
The UK higher education bodies asked RAND Europe to evaluate the assessment process for the impact element of the Research Excellence Framework 2014, and to explore the strengths and weaknesses of the assessment process in delivering reliable, robust and fair outcomes, identify any unforeseen issues emerging during the assessment process and outline broad implications for the assessment proves of impact in future exercises.
This report provides a summary of our key findings, complemented by a details analysis of the parts of the assessment process. It complements a previous piece of research that RAND Europe undertook for the UK higher education funding councils to evaluation the preparation process HEIs undertook as part of the exercise.
Panel structure and membership
Allocation of impact case studies and impact templates
Review of impact case studies and individual scoring
Review of impact templates
Scoring agreement and moderation
Evidence checking and audit
Overview of the perceived benefits and challenges associated with the assessment process
Burden associated with the assessment of the impact element of REF 2014
List of panels and units of assessment for REF 2014
Semi-structured protocol for focus group interviews
NVivo code book for coding interviewee responses from the focus groups
Survey protocols for those involved in the assessment of the impact element of REF 2014
Protocol for individual interviews with panellists involved in the assessment of impact
The research described in this report was prepared for the Higher Education Funding Council for England (HEFCE), the Scottish Funding Council (SFC) and the Higher Education Funding Council for Wales (HEFCW) and was conducted by RAND Europe.
This report is part of the RAND Corporation Research report series. RAND reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND reports undergo rigorous peer review to ensure high standards for research quality and objectivity.
This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.
The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.