Adjusting for Subgroup Differences in Extreme Response Tendency in Ratings of Health Care

Impact on Disparity Estimates

Published In: HSR: Health Services Research, v. 44, no. 2, pt. 1, Apr. 2009, p. 542-561

Posted on RAND.org on January 01, 2009

by Marc N. Elliott, Amelia Haviland, David E. Kanouse, Katrin Hambarsoomian, Ron D. Hays

Read More

Access further information on this document at Blackwell Publishing

This article was published outside of RAND. The full text of the article can be found at the link above.

OBJECTIVE: Adjust for subgroup differences in extreme response tendency (ERT) in ratings of health care, which otherwise obscure disparities in patient experience. DATA SOURCE: 117,102 respondents to the 2004 Consumer Assessment of Healthcare Providers and Systems (CAHPS) Medicare Fee-for-Service survey. STUDY DESIGN: Multinomial logistic regression is used to model respondents' use of extremes of the 0-10 CAHPS rating scales as a function of education. A new two-stage model adjusts for both standard case-mix effects and ERT. Ratings of subgroups are compared after these adjustments. PRINCIPAL FINDINGS: Medicare beneficiaries with greater educational attainment are less likely to use both extremes of the 0-10 rating scale than those with less attainment. Adjustments from the two-stage model may differ substantially from standard adjustments and resolve or attenuate several counterintuitive findings in subgroup comparisons. CONCLUSIONS: Addressing ERT may be important when estimating disparities or comparing providers if patient populations differ markedly in educational attainment. Failures to do so may result in misdirected resources for reducing disparities and inaccurate assessment of some providers. Depending upon the application, ERT may be addressed by the two-stage approach developed here or through specified categorical or stratified reporting

This report is part of the RAND Corporation external publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.