Participant Experiences with a New Online Modified-Delphi Approach for Engaging Patients and Caregivers in Developing Clinical Guidelines

Published in: European Journal for Person Centered Healthcare, Volume 7, Issue 3, pages 476-489 (2019). doi: 10.5750/ejpch.v7i3.1745

Posted on on November 21, 2019

by Courtney Armstrong, Sean Grant, Kathi Kinnett, Brian Denger, Ann Martin, Ian D. Coulter, Marika Booth, Dmitry Khodyakov

Read More

Access further information on this document at

This article was published outside of RAND. The full text of the article can be found at the link above.

Participants were satisfied with an online approach to participating in guideline development.


Patient engagement in clinical practice guideline (CPG) development has increased significantly in recent years. However, only a few patients and caregivers join CPG development groups.


To describe participant experiences with a novel online, scalable approach for patient and caregiver engagement in CPG development.


We developed and tested the RAND/PPMD Patient-Centeredness Method (RPM), a novel online modified-Delphi approach to patient engagement in CPG development that consists of an optional idea generation round and two rating rounds interspersed with an online discussion round.

Setting and Participants

Using the online ExpertLens™ system, we ran 2 concurrent panels of patients and caregivers of individuals with Duchenne Muscular Dystrophy (DMD).

Main Outcome Measures

We surveyed all 95 panel participants about their participation and satisfaction with the process. We also conducted telephone interviews with 25 participants.


Participants expressed satisfaction with various ExpertLens™ features, noting that the system fostered lively interaction among them. Panelists also appreciated participating in an educational, interactive and convenient discussion forum that allowed them to share their opinions on the importance and acceptability of different recommendations. The RPM was viewed as empowering by patients and their caregivers who felt it would be useful for CPG developers.

Discussion and Conclusion

The results of our study show the overall participant satisfaction with a novel, scalable, online approach to engaging patients and caregivers in CPG development, which allows them to share their perspectives and lived experiences using a rigorous, systematic and iterative way that is similar to how clinicians provide their input.

Research conducted by

This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

Our mission to help improve policy and decisionmaking through research and analysis is enabled through our core values of quality and objectivity and our unwavering commitment to the highest level of integrity and ethical behavior. To help ensure our research and analysis are rigorous, objective, and nonpartisan, we subject our research publications to a robust and exacting quality-assurance process; avoid both the appearance and reality of financial and other conflicts of interest through staff training, project screening, and a policy of mandatory disclosure; and pursue transparency in our research engagements through our commitment to the open publication of our research findings and recommendations, disclosure of the source of funding of published research, and policies to ensure intellectual independence. For more information, visit

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.