Feasibility of Distinguishing Performance Among Provider Groups Using Patient-reported Outcome Measures in Older Adults with Multiple Chronic Conditions

Published in: Medical Care, Volume 57, Issue 3 (March 2019),  pages 180-186. doi: 10.1097/MLR.0000000000001013

Posted on RAND.org on March 01, 2019

by Adam J. Rose, Elizabeth Bayliss, Lesley Baseman, Emily Butcher, Wenjing Huang, Maria Orlando Edelen

Read More

Access further information on this document at Medical Care

This article was published outside of RAND. The full text of the article can be found at the link above.


To examine minimum sample sizes and follow-up times required for patient-reported outcome-based performance measures (PMs) to achieve acceptable reliability as PMs.


We used 2 groups of patients age 65+ with at least 2 of 13 chronic conditions. The first was a sample of Medicare Advantage beneficiaries, who reported health-related quality of life (HRQoL) at baseline and 2 years. The second was a sample of primary care patients, who reported HRQoL at baseline and 6 months.


Medicare Advantage beneficiaries completed the Veterans RAND 12-Item Short Form (VR-12), while the primary care sample completed the Patient-Reported Outcomes Measurement Information System 29-Item Profile Measure (PROMIS-29). We constructed binary candidate PMs indicating stable or improved physical or mental HRQoL at follow-up, and continuous PMs measuring mean change over time.


In the Medicare Advantage sample, with a sample size per entity profiled of 160, the most promising PM achieved a reliability of 0.32 as a PM. A sample size of 882 per entity would have been needed for this PM to achieve an acceptable reliability of 0.7. In the prospective sample, with a sample size of 27 per clinic, the most promising PM achieved a reliability of 0.16 as a PM. A sample size of 341 patients (at the clinic level) would have been needed for this PM to achieve a reliability of 0.7.


Achieving acceptable reliability for these PMs and conditions would have required minimum sample sizes of 341 at the clinic level or 880 at the health plan level. These estimates can guide the design of future patient-reported outcome-based PMs.

Research conducted by

This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

Our mission to help improve policy and decisionmaking through research and analysis is enabled through our core values of quality and objectivity and our unwavering commitment to the highest level of integrity and ethical behavior. To help ensure our research and analysis are rigorous, objective, and nonpartisan, we subject our research publications to a robust and exacting quality-assurance process; avoid both the appearance and reality of financial and other conflicts of interest through staff training, project screening, and a policy of mandatory disclosure; and pursue transparency in our research engagements through our commitment to the open publication of our research findings and recommendations, disclosure of the source of funding of published research, and policies to ensure intellectual independence. For more information, visit www.rand.org/about/principles.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.