Shadow Coaching Improves Patient Experience With Care, But Gains Erode Later

Published in: Medical Care, Volume 59, Number 11, pages 950–960 (November 2021). doi: 10.1097/MLR.0000000000001629

Posted on RAND.org on December 07, 2022

by Denise D. Quigley, Marc N. Elliott, Mary Ellen Slaughter, Q. Burkhart, Alex Y. Chen, Efrain Talamantes, Ron D. Hays

Background

Health care organizations strive to improve patient care experiences. Some use one-on-one provider counseling (shadow coaching) to identify and target modifiable provider behaviors.

Objective

We examined whether shadow coaching improves patient experience across 44 primary care practices in a large urban Federally Qualified Health Center.

Research Design

Seventy-four providers with "medium" (ie, slightly below average) overall provider ratings received coaching and were compared with 246 uncoached providers. We fit mixed-effects regression models with random effects for provider (level of treatment assignment) and fixed effects for time (linear spline with a knot and "jump" at coaching date), patient characteristics and site indicators. By design, coached providers performed worse at selection; models account for the very small (0.2 point) regression-to-the-mean effects. We assessed differential effects by coach.

Subjects

A total of 46,452 patients (from 320 providers) who completed the Clinician and Group Consumer Assessment of Healthcare Providers and Systems (CG-CAHPS) Visit Survey 2.0.

Measures

CAHPS overall provider rating and provider communication composite (scaled 0–100).

Results

Providers not chosen for coaching had a nonsignificant change in performance during the period when selected providers were coached. We observed a statistically significant 2-point (small-to-medium) jump among coached providers after coaching on the CAHPS overall provider rating and provider communication score. However, these gains disappeared after 2.5 years; effects differed by coach.

Conclusions

Shadow coaching improved providers' overall performance and communication immediately after being coached. Regularly planned shadow coaching "booster" sessions might maintain or even increase the improvement gained in patient experience scores, but research examining additional coaching and optimal implementation is needed.

Research conducted by

This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.