Download Free Electronic Document

FormatFile SizeNotes
PDF file 0.1 MB

Use Adobe Acrobat Reader version 10 or higher for the best experience.

In the summer of 2015, ProPublica published its Surgeon Scorecard, which displays "Adjusted Complication Rates" for individual, named surgeons for eight surgical procedures performed in hospitals. Public reports of provider performance have the potential to improve the quality of health care that patients receive. A valid performance report can drive quality improvement and usefully inform patients' choices of providers. However, performance reports with poor validity and reliability are potentially damaging to all involved. In September 2015, RAND released a critique of the Scorecard authored by a group of heath policy researchers from RAND and other institutions, and on October 7, 2015 ProPublica published a rebuttal of our critique. In this follow-on Perspective, we revisit the main points in our initial critique, summarize ProPublica's rebuttal, explain why this rebuttal fails to address our methodological concerns, provide suggestions on how to validate and improve the Scorecard, and explain why we continue to advise potential users of the Scorecard, as it is currently constructed, not to consider it a valid or reliable predictor of the health outcomes any individual surgeon is likely to provide.

The research described in this report was performed under the auspices of RAND Health.

This report is part of the RAND Corporation perspective series. RAND perspectives present informed perspective on a timely topic that address the challenges facing the public and private sectors. All RAND perspectives undergo rigorous peer review to ensure high standards for research quality and objectivity.

Permission is given to duplicate this electronic document for personal use only, as long as it is unaltered and complete. Copies may not be duplicated for commercial purposes. Unauthorized posting of RAND PDFs to a non-RAND Web site is prohibited. RAND PDFs are protected under copyright law. For information on reprint and linking permissions, please visit the RAND Permissions page.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.