Physician Cost Profiling -- Reliability and Risk of Misclassification

Detailed Methodology and Sensitivity Analyses

by John L. Adams, Ateev Mehrotra, J. William Thomas, Elizabeth A. McGlynn

Download eBook for Free

Full Document

FormatFile SizeNotes
PDF file 1.5 MB

Use Adobe Acrobat Reader version 10 or higher for the best experience.

Summary Only

FormatFile SizeNotes
PDF file 0.1 MB

Use Adobe Acrobat Reader version 10 or higher for the best experience.

This technical report describes the methods and sensitivity analyses used by the authors in an article published in the New England Journal of Medicine. Purchasers are experimenting with a variety of approaches to control health care costs, including limiting network contracts to lower-cost physicians and offering patients differential copayments to encourage them to visit “high-performance” (i.e., higher-quality, lower-cost) physicians. These approaches require a method for analyzing physicians' costs and a classification system for determining which physicians have lower relative costs. There has been little analysis of the reliability of such methods. Reliability is determined by three factors: the number of observations, the variation between physicians in their use of resources, and random variation in the scores. A study of claims data from four Massachusetts health plans demonstrates that, according to the current methods of physician cost profiling, the majority of physicians did not have cost profiles that met common reliability thresholds and, importantly, reliability varied significantly by specialty. Low reliability results in a substantial chance that a given physician will be misclassified as lower-cost when he or she is not, or vice versa. Such findings raise concerns about the use of cost profiling tools and the utility of their results.

Table of Contents

  • Chapter One

    Introduction

  • Chapter Two

    Data Sources and Criteria for Inclusion of Patients and Physicians

  • Chapter Three

    Constructing Cost Profiles

  • Chapter Four

    Calculating the Reliability of Cost Profiles

  • Chapter Five

    The Relationship Between Reliability and Misclassification

  • Chapter Six

    Sensitivity Analyses

This work was sponsored by the U.S. Department of Labor. The research was conducted in RAND Health, a division of the RAND Corporation.

This report is part of the RAND Corporation technical report series. RAND technical reports may include research findings on a specific topic that is limited in scope or intended for a narrow audience; present discussions of the methodology employed in research; provide literature reviews, survey instruments, modeling exercises, guidelines for practitioners and research professionals, and supporting documentation; or deliver preliminary findings. All RAND reports undergo rigorous peer review to ensure that they meet high standards for research quality and objectivity.

Permission is given to duplicate this electronic document for personal use only, as long as it is unaltered and complete. Copies may not be duplicated for commercial purposes. Unauthorized posting of RAND PDFs to a non-RAND Web site is prohibited. RAND PDFs are protected under copyright law. For information on reprint and linking permissions, please visit the RAND Permissions page.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.