Skip to page content

Delphi Method

Featured

The Delphi method was developed by RAND in the 1950s to forecast the effect of technology on warfare. It has since been applied to health care, education, management, and environmental science. Today, groups of experts or stakeholders use online tools such as ExpertLens to anonymously answer questionnaires, receive feedback that represents the “group response,” discuss, and revise their answers to see whether they can approach expert consensus.

Tool
ExpertLens: An Online Modified-Delphi Approach to Stakeholder Engagement and Expert Elicitation
When making complex decisions, researchers and policymakers often seek the input of many stakeholders and individuals with varied perspectives. ExpertLens is an online, modified-Delphi application developed by research and programming experts at the RAND Corporation to help achieve these goals easily and cost effectively.
Oct 25, 2021
Commentary
Engaging Different Types of Practitioners in the Complex Social Policy Area of Adverse Childhood Experiences
Understanding how stakeholders make sense of and prioritize available evidence can help improve the policies and practices that affect people's lives. A modified Delphi approach could engage with stakeholders with different, overlapping expertise and help open a way to this understanding.
Oct 21, 2021

Explore Delphi Method

Journal Article
Expert Views on State Policies to Improve Engagement and Retention in Treatment for Opioid Use Disorder: A Qualitative Analysis of an Online Modified Delphi Process
This study gathered expert consensus on the effectiveness and implementability of state policies to improve engagement and retention in treatment for opioid use disorder (OUD).
Dec 4, 2023
Commentary
Generating Evidence Using the Delphi Method
The Delphi method, developed at RAND in the 1950s, is a group-based process for eliciting and aggregating opinion on a topic with a goal of exploring the existence of consensus among a diverse group of experts. It's become best practice for quantifying the results of group elicitation processes.
Oct 17, 2023
Journal Article
Expert Consensus-Based Guidance on Approaches to Opioid Management in Individuals with Advanced Cancer-Related Pain and Nonmedical Stimulant Use
Palliative care and addiction experts considered continuing opioids, increasing monitoring, and avoiding opioid tapering in the context of cancer-related pain and nonmedical stimulant use to be appropriate.
Sep 13, 2023
Journal Article
Disciplinary Trends in the Use of the Delphi Method: A Bibliometric Analysis
The year 2023 marks the 60th anniversary of the first peer-reviewed journal article on the Delphi Method. We used a bibliometric analysis to describe general trends in the expansion of its use across disciplines, driven largely by the medical field.
Aug 17, 2023
Report
Elicitation of Climate Information to Support Water Agency Planning: Report of a Workshop with the San Francisco Public Utilities Commission
Expert elicitation can supplement information from climate models to support adaptation planning. This report describes how the San Francisco Public Utilities Commission used elicitation to identify climate impacts on the city's water supply.
May 8, 2023
Journal Article
The Impact of Panel Composition and Topic on Stakeholder Perspectives: Generating Hypotheses from Online Maternal and Child Health Modified-Delphi Panels
This study develops hypotheses about the impact of panel composition and topic on the propensity and meaningfulness of response changes in multistakeholder modified-Delphi panels.
Sep 21, 2022
Report
Securing U.S. Elections
Election systems across U.S. states and jurisdictions are diverse in terms of governance and technology. How can state and local officials effectively assess and prioritize cybersecurity risk in the systems they oversee?
Aug 16, 2022
Journal Article
Improving Mental Health Guardianship: From Prevention to Treatment
The authors sought to identify the most promising strategies for improving the mental health guardianship process in Los Angeles County for adults with mental illness who are gravely disabled.
Dec 7, 2021
Report
Engaging multi-disciplinary practitioners in a complex field of social policy: A methodological discussion paper
This paper shares lessons learnt from engaging multi-disciplinary practitioners in a complex field of social policy in a consensus building exercise using an adapted Delphi-method. It is written for other organisations or researchers considering a similar approach.
Oct 21, 2021
Journal Article
Consensus-based Approach to Managing Opioids, Including Opioid Misuse and Opioid Use Disorder, in Patients with Serious Illness: Protocol for a Modified Delphi Process
Using a modified Delphi approach, we created seven patient cases that capture important management challenges in individuals with serious illness prescribed opioid therapy.
Sep 22, 2021
Journal Article
Informing the Development of a Standardized Clinical Definition of Neonatal Abstinence Syndrome: Protocol for a Modified-Delphi Expert Panel
The goal of this paper is to describe a protocol for a systematic expert panel process to inform the development of a clinical definition of neonatal abstinence syndrome.
Jul 23, 2021
Report
Online Dispute Resolution: Perspectives to Support Successful Implementation and Outcomes in Court Proceedings
Online dispute resolution provides a forum for the resolution of court matters that was especially important during the COVID-19 pandemic. A panel of experts identified strategies to improve access to justice using these platforms.
May 14, 2021
Report
Informing the Development of Standardized Clinical Definitions of Neonatal Abstinence Syndrome and Neonatal Opioid Withdrawal Syndrome: Results of Two Modified-Delphi Expert Panels
The authors describe the results of two modified-Delphi expert panels used to inform the work of a federal steering committee on the development of clinical definitions of neonatal abstinence syndrome and neonatal opioid withdrawal syndrome.
May 3, 2021
Journal Article
Online Modified-Delphi: A Potential Method for Continuous Patient Engagement Across Stages of Clinical Practice Guideline Development
In this Perspective, we make the case for, and provide an approach to, using online Delphi approaches--particularly the online modified-Delphi--for engaging a panel of patients continuously throughout all stages of CPG development.
Mar 31, 2021
Journal Article
Priority-Setting to Address the Geriatric Pharmacoparadox for Pain Management: A Nursing Home Stakeholder Delphi Study
Our objective was to explore the extent of consensus among expert stakeholders regarding what analgesic issues should be prioritized for comparative-effectiveness studies of beneficial and adverse effects of analgesic regimens in nursing home residents.
Feb 25, 2021
Report
Measures and Methodology for International Comparisons of Health Care System Performance: Final Report
RAND researchers worked with 15 experts in quality measurement, clinical care, and health economics to generate potential measure constructs that could improve the U.S. ability to learn from international comparisons of health system performance.
Feb 24, 2021
Journal Article
ADAPT Study: Adaptation of Evidence-Informed Complex Population Health Interventions for Implementation And/Or Re-Evaluation in New Contexts: Protocol for a Delphi Consensus Exercise to Develop Guidance
A Delphi consensus exercise to gather expert opinion on the adaptation, implementation and re-evaluation of complex population health interventions in new contexts.
Jan 22, 2021
Journal Article
Nature and Predictors of Response Changes in Modified-Delphi Panels
This article describes the extent and direction of response changes between modified-Delphi rounds and identifies factors that affect participants' response changes.
Jan 7, 2021
Journal Article
Response Changes in Delphi Processes: Why Is It Important to Provide High-Quality Feedback to Delphi Participants?
Participants in Delphi studies change some of their responses after group feedback and discussion. The results support previous findings that suggest that even modest changes between Delphi rounds may affect the final study findings.
Sep 24, 2020

1
2
3
4
Next

RAND Topic:
Delphi Method

Topic Synonyms:
Delphi Technique

Research conducted by

Researcher Spotlight

Dmitry Khodyakov

Codirector, Center for Qualitative and Mixed Methods

Dmitry Khodyakov is a senior sociologist at the RAND Corporation, a codirector of the RAND Center for Qualitative and Mixed Methods, and a professor at the RAND Pardee Graduate School. His research focuses on methods of expert elicitation and stakeholder engagement, Medicare Advantage,…
Dulani Woods

Codirector, Center for Scalable Computing and Analysis

Dulani Woods is a data scientist at the RAND Corporation and codirector of the RAND Center for Scalable Computing and Analysis. He is adept at data acquisition, transformation, visualization, modeling, simulation, optimization, and other methods.

Explore Our People »