Impact on Hospital Ranking of Basing Readmission Measures on a Composite Endpoint of Death or Readmission Versus Readmissions Alone

Published in: BMC Health Services Research, Volume 17, Article number 327 (2017). doi: 10.1186/s12913-017-2266-4

Posted on RAND.org on January 14, 2021

by Laurent G. Glance, Yue Li, Andrew W. Dick

Read More

Access further information on this document at BMC Health Services Research

This article was published outside of RAND. The full text of the article can be found at the link above.

Background

Readmission penalties are central to the Centers for Medicare and Medicaid Services (CMS) efforts to improve patient outcomes and reduce health care spending. However, many clinicians believe that readmission metrics may unfairly penalize low-mortality hospitals because mortality and readmission are competing risks. The objective of this study is to compare hospital ranking based on a composite outcome of death or readmission versus readmission alone.

Methods

We performed a retrospective observational study of 344,565 admissions for acute myocardial infarction (AMI), congestive heart failure (CHF), or pneumoniae (PNEU) using population-based data from the New York State Inpatient Database (NY SID) between 2011 and 2013. Hierarchical logistic regression modeling was used to estimate separate risk-adjustment models for the (1) composite outcome (in-hospital death or readmission within 7-days), and (2) 7-day readmission. Hospital rankings based on the composite measure and the readmission measure were compared using the intraclass correlation coefficient and kappa analysis.

Results

Using data from all AMI, CHF, and PNEU admissions, there was substantial agreement between hospital adjusted odds ratio (AOR) based on the composite outcome versus the readmission outcome (intraclass correlation coefficient [ICC] 0.67; 95% CI: 0.56, 0.75). For patients admitted with AMI, there was moderate agreement (ICC 0.53; 95% CI: 0.41, 0.62); for CHF, substantial agreement (ICC 0.72; 95% CI: 0.66, 0.78); and for PNEU, substantial agreement (ICC 0.71; 95% CI: 0.61, 0.78). There was moderate agreement when the composite and readmission metrics were used to classify hospitals as high, average, and low-performance hospitals (κ = 0.54, SE = 0.050). For patients admitted with AMI, there was slight agreement (κ = 0.14, SE = 0.037) between the two metrics.

Conclusions

Hospital performance on readmissions is significantly different from hospital performance on a composite metric based on readmissions and mortality. CMS and policy makers should consider re-assessing the use of readmission metrics for measuring hospital performance.

Research conducted by

This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

Our mission to help improve policy and decisionmaking through research and analysis is enabled through our core values of quality and objectivity and our unwavering commitment to the highest level of integrity and ethical behavior. To help ensure our research and analysis are rigorous, objective, and nonpartisan, we subject our research publications to a robust and exacting quality-assurance process; avoid both the appearance and reality of financial and other conflicts of interest through staff training, project screening, and a policy of mandatory disclosure; and pursue transparency in our research engagements through our commitment to the open publication of our research findings and recommendations, disclosure of the source of funding of published research, and policies to ensure intellectual independence. For more information, visit www.rand.org/about/principles.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.