Are Nonspecific Practice Guidelines Potentially Harmful? a Randomized Comparison of the Effect of Nonspecific Versus Specific Guidelines on Physician Decision Making

Published in: Health Services Research, v. 34, no. 7, Mar. 2000, p. 1429-1448

Posted on on December 31, 1999

by Paul G. Shekelle, Richard L. Kravitz, Jennifer Beart, Michael Marger, Mingming Wang, Martin L. Lee

Read More

Access further information on this document at

This article was published outside of RAND. The full text of the article can be found at the link above.

OBJECTIVE: To test the ability of two different clinical practice guideline formats to influence physician ordering of electrodiagnostic tests in low back pain. DATA SOURCES/STUDY DESIGN: Randomized controlled trial of the effect of practice guidelines on self-reported physician test ordering behavior in response to a series of 12 clinical vignettes. Data came from a national random sample of 900 U.S. neurologists, physical medicine physicians, and general internists. Intervention. Two different versions of a practice guideline for the use of electrodiagnostic tests (EDT) were developed by the U.S. Agency for Health Care Policy and Research Low Back Problems Panel. The two guidelines were similar in content but varied in the specificity of their recommendations. DATA COLLECTION: The proportion of clinical vignettes for which EDTs were ordered for appropriate and inappropriate clinical indications in each of three physician groups were randomly assigned to receive vignettes alone, vignettes plus the nonspecific version of the guideline, or vignettes plus the specific version of the guideline. PRINCIPAL FINDINGS: The response rate to the survey was 71 percent. The proportion of appropriate vignettes for which EDTs were ordered averaged 77 percent for the no guideline group, 71 percent for the nonspecific guideline group, and 79 percent for the specific guideline group (p = .002). The corresponding values for the number of EDTs ordered for inappropriate vignettes were 32 percent, 32 percent, and 26 percent respectively (p =.08). Pairwise comparisons showed that physicians receiving the nonspecific guidelines ordered fewer EDTs for appropriate clinical vignettes than did physicians receiving no guidelines (P = .02). Furthermore, compared to physicians receiving nonspecific guidelines, physicians receiving specific guidelines ordered significantly more EDTs for appropriate vignettes (p =.0007) and significantly fewer EDTs for inappropriate vignettes (p =.04). CONCLUSIONS: The clarity and clinical applicability of a guideline may be important attributes that contribute to the effects of practice guidelines.

Research conducted by

This report is part of the RAND Corporation external publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.