Physician Cost Profiling -- Reliability and Risk of Misclassification
Detailed Methodology and Sensitivity Analyses
This technical report describes the methods and sensitivity analyses used by the authors in an article published in the New England Journal of Medicine. Purchasers are experimenting with a variety of approaches to control health care costs, including limiting network contracts to lower-cost physicians and offering patients differential copayments to encourage them to visit “high-performance” (i.e., higher-quality, lower-cost) physicians. These approaches require a method for analyzing physicians' costs and a classification system for determining which physicians have lower relative costs. There has been little analysis of the reliability of such methods. Reliability is determined by three factors: the number of observations, the variation between physicians in their use of resources, and random variation in the scores. A study of claims data from four Massachusetts health plans demonstrates that, according to the current methods of physician cost profiling, the majority of physicians did not have cost profiles that met common reliability thresholds and, importantly, reliability varied significantly by specialty. Low reliability results in a substantial chance that a given physician will be misclassified as lower-cost when he or she is not, or vice versa. Such findings raise concerns about the use of cost profiling tools and the utility of their results.
- Full Document (pdf format)
- Summary Only (pdf format)
Use Adobe Acrobat Reader version 7.0 or higher for the best experience.
Document Details
- Copyright: RAND Corporation
- Availability: Web-Only
- Pages: 50
- Document Number: TR-799-DOL
- Year: 2010
- Series: Technical Reports
Contents
Chapter One
Introduction
Chapter Two
Data Sources and Criteria for Inclusion of Patients and Physicians
Chapter Three
Constructing Cost Profiles
Chapter Four
Calculating the Reliability of Cost Profiles
Chapter Five
The Relationship Between Reliability and Misclassification
Chapter Six
Sensitivity Analyses
This work was sponsored by the U.S. Department of Labor. The research was conducted in RAND Health, a division of the RAND Corporation.
This report is part of the RAND Corporation technical report series. RAND technical reports may include research findings on a specific topic that is limited in scope or intended for a narrow audience; present discussions of the methodology employed in research; provide literature reviews, survey instruments, modeling exercises, guidelines for practitioners and research professionals, and supporting documentation; or deliver preliminary findings. All RAND reports undergo rigorous peer review to ensure that they meet high standards for research quality and objectivity.
Permission is given to duplicate this electronic document for personal use only, as long as it is unaltered and complete. Copies may not be duplicated for commercial purposes. Unauthorized posting of RAND PDFs to a non-RAND Web site is prohibited. RAND PDFs are protected under copyright law. For information on reprint and linking permissions, please visit the RAND Permissions page.
The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.
RAND® is a registered trademark. Copyright © 1994-2012 RAND Corporation.