Download Free Electronic Document

FormatFile SizeNotes
PDF file 0.1 MB

Use Adobe Acrobat Reader version 10 or higher for the best experience.

In the summer of 2015, ProPublica published its Surgeon Scorecard, which displays "Adjusted Complication Rates" for individual, named surgeons for eight surgical procedures performed in hospitals. Public reports of provider performance have the potential to improve the quality of health care that patients receive. A valid performance report can drive quality improvement and usefully inform patients' choices of providers. However, performance reports with poor validity and reliability are potentially damaging to all involved. In September 2015, RAND released a critique of the Scorecard authored by a group of heath policy researchers from RAND and other institutions, and on October 7, 2015 ProPublica published a rebuttal of our critique. In this follow-on Perspective, we revisit the main points in our initial critique, summarize ProPublica's rebuttal, explain why this rebuttal fails to address our methodological concerns, provide suggestions on how to validate and improve the Scorecard, and explain why we continue to advise potential users of the Scorecard, as it is currently constructed, not to consider it a valid or reliable predictor of the health outcomes any individual surgeon is likely to provide.

The research described in this report was performed under the auspices of RAND Health.

This publication is part of the RAND Corporation Perspective series. RAND Perspectives present expert insights on timely policy issues. All RAND Perspectives undergo peer review to ensure high standards for quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.