Consistency Across Panels of Ratings of Appropriateness of Dental Care Treatment Procedures

Published in: Community Dental Health, v. 15, no. 2, 1998, p. 97-104

Posted on on January 01, 1998

by Ian D. Coulter, Marvin Marcus, James Freed

This article reports on a study investigating the consistency across different consensus panels of ratings of appropriateness for dental procedures. The study conducted four consensus panels to determine, under various conditions, the appropriateness of five options for patients: no treatment; filling; crown; root canal with a filling or crown; extraction. The patients were categorized according to age; regular versus irregular use of dental care; degree of caries; degree of pain; degree of periodontal disease. The panelists were dentists enrolled in a continuing education program on assessing the quality of dental care. The panelists were all individuals employed by various dental plans to evaluate the quality of care plans operating in California. The results indicate that the method does distinguish the dimensions of appropriateness used by the panelists in making their decisions, and that it is possible to substantially increase consensus among a diverse group of dentists and across separate panels on some procedures. However, it also showed that the process is sensitive to varying panels and that different variables had different outcomes in the ratings from the various panels. The consensus panel method holds some promise for determining the appropriateness of dental care. However, the results of this study question whether it results in consistent ratings across different panels.

This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

Our mission to help improve policy and decisionmaking through research and analysis is enabled through our core values of quality and objectivity and our unwavering commitment to the highest level of integrity and ethical behavior. To help ensure our research and analysis are rigorous, objective, and nonpartisan, we subject our research publications to a robust and exacting quality-assurance process; avoid both the appearance and reality of financial and other conflicts of interest through staff training, project screening, and a policy of mandatory disclosure; and pursue transparency in our research engagements through our commitment to the open publication of our research findings and recommendations, disclosure of the source of funding of published research, and policies to ensure intellectual independence. For more information, visit

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.