Developing a research evaluation framework
Jul 1, 2013
A guide to research evaluation frameworks and tools
|PDF file||1.6 MB|
|PDF file||0.1 MB|
Interest in and demand for the evaluation of research is increasing internationally. This is linked to a growing accountability agenda, driven by the demand for good governance and management growing in profile on national and international stages and fiscal austerity in a number of countries. There is a need to show that policymaking is evidence based and, particularly in the current economic climate, to demonstrate accountability for the investment of public funds in research. This is complemented by a shift in emphasis from purely summative evaluations, which have traditionally characterised the assessment of research, to more formative evaluations, as well as more comprehensive evaluations that cover wider outputs from research outside the standard measures, such as numbers and quality of publications.
Given this growing need for effective and appropriate evaluation of research, it is increasingly important to understand how research can and should be evaluated in different contexts and to meet different needs.
This report provides a guide to the key considerations in developing an approach to research evaluation. It outlines the trade-offs that have to be taken into account and the contextual factors that need to be understood, drawing on experience of international approaches to research evaluation. In addition, a detailed overview of six research evaluation frameworks is provided, along with a brief overview of a further eight frameworks, and discussion of the main tools used in research evaluation. The report is likely to be of interest to policymakers, research funders, institutional leaders and research managers.
Challenges and trade-offs in research evaluation
Building a new research evaluation framework
Summary tables for frameworks and tools reviewed
Finding out more: international examples of research evaluation frameworks
Finding out more: the tools available for research evaluation
Information on other reports and frameworks reviewed and consulted
The research described in this report was prepared for the Association of American Medical Colleges and conducted by RAND Europe.
This report is part of the RAND Corporation Monograph series. RAND monographs present major research findings that address the challenges facing the public and private sectors. All RAND monographs undergo rigorous peer review to ensure high standards for research quality and objectivity.
This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.
The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.