An Observational Study of Antibiotic Prescribing Behavior and the Hawthorne Effect

Published in: Health Services Research, v. 37, no. 6, Dec. 2002, p. 1603-1623

Posted on on December 31, 2001

by Rita Mangione-Smith, Marc N. Elliott, Laurie L. McDonald, Elizabeth A. McGlynn

Read More

Access further information on this document at

This article was published outside of RAND. The full text of the article can be found at the link above.

OBJECTIVES: To assess whether prospective, observational study procedures, including questionnaires and audio recording, are associated with different patterns of physician diagnostic decision making and antibiotic prescribing. DATA SOURCES/SETTING: (1) Survey data from a prospective observational study of treatment patterns for children with acute upper respiratory illnesses (10/96-3/97) and (2) retrospective medical record abstraction data of nonobserved encounters for the same problems occurring during (10/96-3/97) and one year after (10/97-3/98) the observational study period. Ten pediatricians in two community practices were studied. STUDY DESIGN: Patterns of diagnoses recorded in the medical record and antibiotics ordered for visits occurring outside of the observational study (same time period and one year later) were compared with the pattern of diagnoses and antibiotics ordered during the observational study. DATA COLLECTION/EXTRACTION METHODS: For the observational study (10/96-2/97), diagnosis and treatment choices were obtained from questionnaires completed by physicians immediately following the visit. For the nonstudy encounters (10/96-3/97 and 10/97-3/98), data were abstracted from medical records one year after the observational study was completed. Principal Findings. The proportion of viral cases in which an antibiotic was prescribed was 29 percentage points lower for the observational study compared to the retrospective analysis (p<.05). In one of two study sites, the proportion of cases assigned a bacterial diagnosis was 29 percentage points lower in the observational study period compared to the retrospective study (p<.05). CONCLUSIONS: Observational study procedures including questionnaires and audio recording can affect antibiotic prescribing behavior. Future observational studies aimed at examining the frequency of inappropriate antibiotic prescribing should measure and adjust for the Hawthorne effect; without such adjustments, the results will likely underestimate the true degree of the problem. Future interventions aimed at decreasing inappropriate antibiotic prescribing should consider harnessing the Hawthorne effect through performance feedback to participating physicians.

This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

Our mission to help improve policy and decisionmaking through research and analysis is enabled through our core values of quality and objectivity and our unwavering commitment to the highest level of integrity and ethical behavior. To help ensure our research and analysis are rigorous, objective, and nonpartisan, we subject our research publications to a robust and exacting quality-assurance process; avoid both the appearance and reality of financial and other conflicts of interest through staff training, project screening, and a policy of mandatory disclosure; and pursue transparency in our research engagements through our commitment to the open publication of our research findings and recommendations, disclosure of the source of funding of published research, and policies to ensure intellectual independence. For more information, visit

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.