Evaluating Quality Indicators for Patients with Community-Acquired Pneumonia

Published in: Joint Commission Journal on Quality Improvement, v. 27, no. 11, Nov. 2001, p. 575-590

Posted on RAND.org on January 01, 2001

by David C. Rhew, Matthew Bidwell Goetz, Paul G. Shekelle

BACKGROUND: Several organizations have published evidence-based quality indicators for community-acquired pneumonia (CAP). However, there is variability in the types of indicators presented between organizations and the level of supporting evidence for each of the indicators. A systematic review of the literature and relevant Internet Web sites was performed to identify quality indicators for CAP that have been proposed or recommended by organizations, and each of the indicators was then critically appraised, using a well-defined set of criteria. METHODOLOGY: The MEDLINE, EMBASE, Best Evidence, and Cochrane Systematic Review databases and Internet Web sites were searched for articles and guidelines published between January 1980 and May 2001 to identify quality indicators for CAP and relevant evidence. Experts in the area of health services research were contacted to identify additional sources. A well-defined set of criteria was applied to evaluate each of the quality indicators. RESULTS: The systematic review of the literature and Internet Web sites yielded 44 CAP-specific quality indicators. The critical appraisal of these indicators yielded 16 indicators that were supported by a study that identified an association between quality of care and the process of care or outcome measure, were applied to enough patients to be able to detect clinically meaningful differences, were clinically and/or economically relevant, were measurable in a clinical practice setting, and were precise in their specifications. CONCLUSIONS: Many organizations recommend indicators for CAP. Indicators may serve as measures of clinical performance for clinicians and hospitals, may help in benchmarking, and may ultimately facilitate improvements in quality of care and cost reductions. However, CAP indicators often vary in their meaningfulness, scientific soundness, and interpretability of results. A set of five critical appraisal questions may assist in the evaluation of which quality indicators are most valid

This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

Our mission to help improve policy and decisionmaking through research and analysis is enabled through our core values of quality and objectivity and our unwavering commitment to the highest level of integrity and ethical behavior. To help ensure our research and analysis are rigorous, objective, and nonpartisan, we subject our research publications to a robust and exacting quality-assurance process; avoid both the appearance and reality of financial and other conflicts of interest through staff training, project screening, and a policy of mandatory disclosure; and pursue transparency in our research engagements through our commitment to the open publication of our research findings and recommendations, disclosure of the source of funding of published research, and policies to ensure intellectual independence. For more information, visit www.rand.org/about/principles.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.