Science of Science

  • Report


    Understanding perceptions of the Research Excellence Framework among UK researchers: The Real-Time REF Review

    RAND Europe, together with the University of Cardiff and the University of Sheffield, conducted a real-time evaluation to assess attitudes, perspectives and behaviours towards REF 2021 across the sector. The study aims to inform the future of the REF.

    Nov 24, 2021

  • Businessman hands searching information in Stack of papers files on work in office


    The Future of Research Assessments

    How do researchers expect the types of research they produce to change in the next 5 to 10 years? In this Expert Insights podcast, Catriona Manville and Susan Guthrie discuss the future of the research landscape and how changes may affect the nature of research assessment in the UK.

    Sep 17, 2021

  • Journal Article

    Journal Article

    "What We Have Here, Is a Failure to [Replicate]": Ways to Solve a Replication Crisis in Implementation Science

    This article reviews what is known about replication of implementation trials, and identifies the gaps and next steps to continue increasing the transparency, openness, and replicability of implementation research.

    Aug 13, 2021

  • Journal Article

    Journal Article

    Opinion: Why Institutional Review Boards Should Have a Role in the Open Science Movement

    Institutional review boards are not in sync with shifting research practices performed under the banner of open science.

    May 27, 2021

  • A laboratory classroom with a group of women science students working, photo by SolStock/Getty Images


    Culture, Performance, and Assessment in Research

    The unwritten, and often unsaid, concern in the debate about research culture in the UK is an apparent trade-off between excellence in research and a healthy research culture. But the evidence shows that this is a false dichotomy.

    May 25, 2021

  • Suggestion box attached to a wall, Photo by Hashir Milhan / CC BY 2.0


    Before Redesigning the REF, a New Survey Could Help in Understanding What Is and Isn’t Working

    September's call for more sustainable and agile research funding signaled a renewed push by research-intensive universities in the UK for a funding and assessment system with a lighter touch. Before embarking on a further round of changes, it is important to listen and learn from researchers and managers about what has and has not worked well.

    Oct 6, 2020

  • Journal Article

    Journal Article

    Evaluation of Initial Progress to Implement Common Metrics Across the NIH Clinical and Translational Science Awards (CTSA) Consortium

    Mixed-methods evaluation of the implementation of three Common Metrics and the performance improvement framework by The Clinical and Translational Science Awards (CTSA) Consortium.

    Oct 2, 2020

  • Hand holding a light bulb with cogs inside, photo by ipopba/Getty Images


    The Future of Research Outputs

    The changing nature of research outputs has the potential to affect a wide range of organizations and people. A proactive stance could help drive research towards better practices in information storage, sharing and communication, but requires early action and shared goals at a sector level.

    May 12, 2020

  • Four hands holding magnifying glasses, photo by solidcolours/Getty Images


    Leading with the Proper Use of Scientific Evidence Is Better Than Hiding Behind It

    Evidence only has scientific meaning when it is part of a body of disciplinary knowledge produced by a community of scientists. Leading with scientific evidence, coupled with a wider values framework, may result in better outcomes for all.

    May 5, 2020

  • Research Brief

    Research Brief

    Evolving the Practice of Evaluating Research-Portfolios

    Researchers appraised metrics that medical research entities use to evaluate research portfolios. The work can help organizations select, develop, and revise metrics for their portfolios. This brief summarizes the findings and recommendations.

    Nov 12, 2019

  • Composite image of several icon with sign


    Research-Portfolio Performance Metrics: Rapid Review

    Researchers reviewed metrics for evaluating research portfolios used by medical research organizations and appraised their characteristics. Organizations can use their results to help select, develop, and revise metrics for research portfolios.

    Nov 12, 2019

  • Scientists working with high tech equipment, photo by gorodenkoff/Getty Images


    What Is the Future of England's Research and Research Assessment?

    Rapid technological developments, changes in public policy, and shifts in the international environment all affect academia. To help understand these effects, RAND researchers asked more than 3,600 academics in England how they expect their research to evolve over the next decade.

    Nov 1, 2019

  • Research Brief

    Research Brief

    How Army Families Address Life's Challenges

    A survey of more than 8,500 Army spouses examining their problem-solving processes found that the most common problems involved work-life balance, military practices and culture, and spouses' own well-being. Spouses most often wanted social support.

    Oct 21, 2019

  • Public speaker at a research convention, photo by gremlin/Getty Images


    Outputs of the Future

    Are all types of research outputs of equal value? How do different outputs serve different purposes? Exploring these questions could benefit not only funders and universities, but also result in overall better use of research resources.

    Oct 11, 2019

  • Report


    The changing research landscape and reflections on national research assessment in the future

    RAND Europe conducted a study to explore current and future changes in the research landscape (shifting environment, rapid technological developments and public policy) and how this may affect the nature of national research assessment (REF).

    Oct 3, 2019

  • A man walks through floodwaters to survey damage from Hurricane Sandy in the New Dorp Beach neighborhood of Staten Island, New York, November 1, 2012, photo by Lucas Jackson/Reuters


    How Citizen Scientists Are Protecting Their Communities

    After Superstorm Sandy, residents of Brooklyn's Sunset Park neighborhood cleaned up debris, pumped out basements, and teamed up with researchers to find out what was in the floodwater. They established safety protocols to help local businesses prevent their chemicals from escaping and wrote a guide to help other communities.

    Aug 29, 2019

  • Periodical


    RAND Review: September-October 2019

    This issue spotlights a wargame designed for young women interested in national security; ethics in scientific research, particularly in areas such as artificial intelligence and machine learning; and community citizen science.

    Aug 26, 2019

  • May sitting with laptop and reading a report, photo by jacoblund/Getty Images


    Measuring Up: How to Ensure Peer Review for Grant Applications Remains Up to the Mark

    Expert peer review is considered the gold standard for assessing the validity, significance and originality of research. When it comes to grant applications, however, peer review is not without its shortcomings. Addressing some of the challenges that peer review poses could ensure that the best research receives the financial support it deserves.

    Jul 26, 2019

  • Researchers looking at data, photo by GaudiLab/Getty Images


    Research Rigor Is Undermined by Translating Into Years of Learning

    The research field increasingly recognizes that we need metrics that everyone can understand. Translating the result into years of learning has become a popular approach, but this metric has major flaws. There are better options.

    Jul 5, 2019

  • Blog

    DMZ Meeting, Students with Disabilities, Iran: RAND Weekly Recap

    This weekly recap focuses on Trump's meeting with Kim Jong Un, supporting students with disabilities, the flawed logic of a proportional response in Iran, and more.

    Jul 5, 2019