Mar 25, 2015
The UK higher education bodies asked RAND Europe to evaluate the assessment process for the impact element of the Research Excellence Framework 2014, and to explore the strengths and weaknesses of the assessment process in delivering reliable, robust and fair outcomes, identify any unforeseen issues emerging during the assessment process and outline broad implications for the assessment proves of impact in future exercises.
This report provides a summary of our key findings, complemented by a details analysis of the parts of the assessment process. It complements a previous piece of research that RAND Europe undertook for the UK higher education funding councils to evaluation the preparation process HEIs undertook as part of the exercise.
Panel structure and membership
Allocation of impact case studies and impact templates
Review of impact case studies and individual scoring
Review of impact templates
Scoring agreement and moderation
Evidence checking and audit
Overview of the perceived benefits and challenges associated with the assessment process
Burden associated with the assessment of the impact element of REF 2014
List of panels and units of assessment for REF 2014
Semi-structured protocol for focus group interviews
NVivo code book for coding interviewee responses from the focus groups
Survey protocols for those involved in the assessment of the impact element of REF 2014
Protocol for individual interviews with panellists involved in the assessment of impact