Skip to page content

Science of Science

Decisionmaking
commentary
Measuring Up: How to Ensure Peer Review for Grant Applications Remains Up to the Mark
Daniela Rodriguez-Rincon, Susan Guthrie
Jul 26, 2019
Research Fortnight
Expert peer review is considered the gold standard for assessing the validity, significance and originality of research. When it comes to grant applications, however, peer review is not without its shortcomings. Addressing some of the challenges that peer review poses could ensure that the best research receives the financial support it deserves.
Read More »

Educational Program Evaluation
commentary
Research Rigor Is Undermined by Translating Into Years of Learning
John F. Pane @JohnFPane, Matthew D. Baird
Jul 5, 2019
Education Week
The research field increasingly recognizes that we need metrics that everyone can understand. Translating the result into years of learning has become a popular approach, but this metric has major flaws. There are better options.
Read More »
Decisionmaking
commentary
Assessing Confidence in “What Works” in Social Policy
Yulia Shenderovich, Alex Sutherland, Sean Grant @GrantSeanP
Mar 21, 2019
The RAND Blog
Policy decisions are increasingly informed (or expected to be informed) by research evidence. Making the process as systematic, transparent and explicit as possible provides users with ways to understand, question and contribute to the eventual policy recommendation, and gives policymakers and practitioners confidence in its credibility.
Read More »
Science, Technology, and Innovation Policy
commentary
How to Design a Research Funder
Catriona Manville @CMManville, Catherine A. Lichten
Mar 11, 2019
Research Fortnight
Emerging challenges are leading to an increased emphasis on the impact of research beyond academia. At the same time, funders must adapt to changing expectations about what research can and should deliver, financial austerity, and developments in the topics and methods of research.
Read More »
Medical Ethics
commentary
CONSORT-SPI 2018: Announcing an Extension for Randomized Controlled Trials of Social and Psychological Interventions
Paul Montgomery, Evan Mayo-Wilson, Sean Grant @GrantSeanP
Aug 2, 2018
On Medicine (BioMed Central)
Complete and transparent reporting of randomized controlled trials is integral for replication, critical appraisal and understanding context. A new extension of the CONSORT Statement aims to improve the reporting of randomized controlled trials of social and psychological interventions.
Read More »
Health and Wellness Promotion
commentary
Open Science and a Culture of Health: You Two Should Talk
Sean Grant @GrantSeanP, Kathryn E. Bouskill @kebouskill
Mar 7, 2018
Berkeley Initiative for Transparency in the Social Sciences
By working together, the Culture of Health and Open Science movements could increase their potential to accelerate the use of scientific evidence to address impediments to population health and collective well-being.
Read More »
Decisionmaking
blog
Exploring Trust, Leadership, and 'Analytic Courage'
Nov 15, 2017
Leaders in business, government, academia, and philanthropy gathered at RAND's headquarters in Santa Monica to pay tribute to the seven-decade relationship between RAND and the U.S. Air Force. Panelists discussed the importance of trusted advice to inform national security descisonmaking.
Read More »
Program Evaluation
commentary
Tracking Global Trends in Open Peer Review
Sarah Parks, Salil Gunashekar
Oct 27, 2017
Publons
Open peer review is happening in a variety of forms, but it still accounts for a small percentage of reviews carried out, and it is not clear whether open peer review is increasing in usage. In the future, as the Publons dataset grows, it will be worth exploring the data in more detail.
Read More »
Science, Technology, and Innovation Policy
commentary
Can Open Science Help to Make Research More Accessible?
Anna Knack, Elta Smith @elta_smith, Catherine A. Lichten, Sarah Parks, Salil Gunashekar
Oct 13, 2017
Observatory for a Connected Society app
The leading principle of open science is that anyone, whether they are part of the research community or the public, should be able to access scientific knowledge. Free circulation of knowledge, the sharing of research results, and transparency of methodology are core tenets of the scientific method.
Read More »
Workforce Management
commentary
Professional Expectations, Families and Brexit Shape Future for UK International Researchers
Susan Guthrie, Catherine A. Lichten
May 5, 2017
Times Higher Education
Mobility has become an even higher priority for researchers since the results of the UK’s EU referendum, Brexit. To continue to attract and keep top talent, the UK needs to understand how and why researchers move between countries.
Read More »
Methodology
commentary
Why We Need to Experiment with Grant Peer Review
Steven Wooding, Susan Guthrie
Apr 4, 2017
Research Fortnight
More than 95 per cent of academic biomedical research funding is controlled by peer review of grant applications. It is generally cited as the gold standard for awarding funding, but it appears most effective when used conservatively.
Read More »
Mental Health and Illness
commentary
Who's Funding Mental Health Research Worldwide?
Steven Wooding, Alexandra Pollitt
Aug 17, 2016
Health Affairs Blog
The size and diversity of mental health research is significant, but it remains a loosely defined field in which funders tend not to spell out what counts as mental health. An outline of the current state of mental health research funding worldwide helps to address the huge challenges of mental illness.
Read More »
Science, Technology, and Innovation Policy
commentary
Why Research Funders Looking for Impact Need to Be 'DECISIVE'
Steven Wooding, Adam Kamenetzky
Apr 14, 2016
Research Fortnight
Funding decisions in the UK direct the flow of billions of pounds of public and philanthropic funding but there is little evidence to suggest how to allocate grants to researchers to increase the chances that the work they support changes lives and improves society. New research helps inform funders' strategies.
Read More »
Science, Technology, and Innovation Policy
commentary
What's Next for REF?
Catriona Manville @CMManville
Jul 8, 2015
Open Forum Events
In 2014, the research of 154 UK universities was evaluated, accounting for the efforts of 52,061 academic staff members. For the first time, the impact that the research had on wider society was part of the assessment. As we approach the next assessment period, there is opportunity for discussion to tweak and refine future measures of impact.
Read More »
Science, Technology, and Innovation Policy
commentary
Three Cheers for Research Users Engaging in REF 2014
Catriona Manville @CMManville
Mar 31, 2015
PolicyWonkers
In the UK, research outputs from universities are assessed every five years to determine future funding allocations from government. In 2014, for the first time, the Research Excellence Framework included an assessment of research impact. Research users played key roles throughout the process.
Read More »