Making the Grade

Methodologies for Assessing and Evidencing Research Impact

Published in: 7 Essays on Impact. DESCRIBE Project Report for Jisc. University of Exeter / Dean et al. (eds.) (Exeter, UK: University of Exeter, 2013), p. 25-43

Posted on on January 01, 2013

by Molly Morgan Jones, Jonathan Grant

Read More

Access further information on this document at

This article was published outside of RAND. The full text of the article can be found at the link above.

The UK invested £27.4 billion in research in 2011; £7.1 billion from public sources and £17.4 billion from private sources, with the remainder of expenditure coming from abroad. This money funds a broad spectrum of 'basic' and 'applied' research, from improving our fundamental understanding of the cosmos to testing the effectiveness of new drugs on patient populations. But assessing the impact of any research remains challenging. Does it improve the wealth and wellbeing of societies? If so, what is the nature or size of that impact? This paper explores whether existing methodologies are up to the task of evaluating impact across different sectors, and different criteria for assessing research impact. We look at recent methodological developments that attempt to account for the complex interactions occurring within and between research disciplines and society. We analyse traditional and new methodologies and offer some thoughts for ways in which current standards of evidencing the impact of research can be strengthened and expanded. The paper is structured around four key messages: The choice of methodological approach must be informed by the objectives of the research impact assessment. There is a set of common methodological challenges that vary in importance depending on the objectives of the research impact assessment. Each method has its own strengths and weaknesses, and these vary in importance depending on the objectives of the research impact assessment. New methods are likely to face the same set of trade-offs. We conclude by reflecting on challenges for the future of research impact assessment.

Research conducted by

This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

Our mission to help improve policy and decisionmaking through research and analysis is enabled through our core values of quality and objectivity and our unwavering commitment to the highest level of integrity and ethical behavior. To help ensure our research and analysis are rigorous, objective, and nonpartisan, we subject our research publications to a robust and exacting quality-assurance process; avoid both the appearance and reality of financial and other conflicts of interest through staff training, project screening, and a policy of mandatory disclosure; and pursue transparency in our research engagements through our commitment to the open publication of our research findings and recommendations, disclosure of the source of funding of published research, and policies to ensure intellectual independence. For more information, visit

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.