Validity of the Agency for Healthcare Research and Quality Clinical Practice Guidelines

How Quickly Do Guidelines Become Outdated?

Published in: JAMA, The Journal of the American Medical Association, v. 286, no. 12, Sep. 26, 2001, p. 1461-1467

Posted on RAND.org on December 31, 2000

by Paul G. Shekelle, Eduardo Ortiz, Shannon Rhodes, Sally C. Morton, Martin P. Eccles, Jeremy M. Grimshaw, Steven H. Woolf

Read More

Access further information on this document at jama.ama-assn.org

This article was published outside of RAND. The full text of the article can be found at the link above.

CONTEXT: Practice guidelines need to be up-to-date to be useful to clinicians. No published methods are available for assessing whether existing practice guidelines are still valid, nor does any empirical information exist regarding how often such assessments need to be made. OBJECTIVES: To assess the current validity of 17 clinical practice guidelines published by the US Agency for Healthcare Research and Quality (AHRQ) that are still in circulation, and to use this information to estimate how quickly guidelines become obsolete. DESIGN, SETTING, AND PARTICIPANTS: The authors developed criteria for defining when a guideline needs updating, mailed surveys to members of the original AHRQ guideline panels (n = 170; response rate, 71%), and searched the literature for evidence through March 2000 (n = 6994 titles yielding 173 articles plus 159 new guidelines on the same topics). MAIN OUTCOME MEASURES: Identification of new evidence calling for a major, minor, or no update of the 17 guidelines; survival analysis of the rate at which guidelines became outdated. RESULTS: For 7 guidelines, new evidence and expert judgment indicated that a major update is required; 6 were found to be in need of a minor update; 3 were judged as still valid; and for 1 guideline, we could reach no conclusion. Survival analysis indicated that about half the guidelines were outdated in 5.8 years (95% confidence interval [CI], 5.0-6.6 years). The point at which no more than 90% of the guidelines were still valid was 3.6 years (95% CI, 2.6-4.6 years). CONCLUSIONS: More than three quarters of the AHRQ guidelines need updating. As a general rule, guidelines should be reassessed for validity every 3 years.

Research conducted by

This report is part of the RAND Corporation external publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.