Public and private purchasers and health plans are demanding more information about the quality and relative costliness of U.S. physicians to increase physician accountability and aid in value-based purchasing. Although performance measurement has been in place for some time in hospitals and managed care organizations (MCOs), the focus on physician profiling is a relatively new development. The inherent limitations of the available data at the physician level have brought to the fore technical issues that were less important at higher levels of aggregation in hospitals and MCOs. One of these technical issues is the reliability of a physician's performance measurement. This technical report explains the use and implementation of reliability measurement for quality measures in provider profiling in health care. It provides details and a practical method of how to calculate reliability measures from the sort of data typically available. It also explains why reliability measurement is an important component of evaluating a profiling system.
The research described in this report was prepared for the National Committee for Quality Assurance and was conducted in RAND Health.
This report is part of the RAND Corporation Technical report series. RAND technical reports may include research findings on a specific topic that is limited in scope or intended for a narrow audience; present discussions of the methodology employed in research; provide literature reviews, survey instruments, modeling exercises, guidelines for practitioners and research professionals, and supporting documentation; or deliver preliminary findings. All RAND reports undergo rigorous peer review to ensure that they meet high standards for research quality and objectivity.
This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.
The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.