Cover: A Randomized, Controlled Trial of Team-Based Competition to Increase Learner Participation in Quality-Improvement Education

A Randomized, Controlled Trial of Team-Based Competition to Increase Learner Participation in Quality-Improvement Education

Published in: International Journal for Quality in Health Care, 2016

Posted on Feb 29, 2016

by Charles D. Scales, Tannaz Moin, Arlene Fink, Sandra H. Berry, Nasim Afsar-Manesh, Carol Mangione, B. Price Kerfoot

OBJECTIVE: Several barriers challenge resident engagement in learning quality improvement (QI). We investigated whether the incorporation of team-based game mechanics into an evidence-based online learning platform could increase resident participation in a QI curriculum. DESIGN: Randomized, controlled trial. SETTING: Tertiary-care medical center residency training programs. PARTICIPANTS: Resident physicians (n = 422) from nine training programs (anesthesia, emergency medicine, family medicine, internal medicine, ophthalmology, orthopedics, pediatrics, psychiatry and general surgery) randomly allocated to a team competition environment (n = 200) or the control group (n = 222). INTERVENTION: Specialty-based team assignment with leaderboards to foster competition, and alias assignment to de-identify individual participants. MAIN OUTCOME MEASURES: Participation in online learning, as measured by percentage of questions attempted (primary outcome) and additional secondary measures of engagement (i.e. response time). Changes in participation measures over time between groups were assessed with a repeated measures ANOVA framework. RESULTS: Residents in the intervention arm demonstrated greater participation than the control group. The percentage of questions attempted at least once was greater in the competition group (79% [SD ± 32] versus control, 68% [SD ± 37], P= 0.03). Median response time was faster in the competition group (P= 0.006). Differences in participation continued to increase over the duration of the intervention, as measured by average response time and cumulative percent of questions attempted (each P< 0.001). CONCLUSIONS: Team competition increases resident participation in an online course delivering QI content. Medical educators should consider game mechanics to optimize participation when designing learning experiences.

This report is part of the RAND external publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.