Systematic Self-Report Bias in Health Data

Impact on Estimating Cross-Sectional and Treatment Effects

Published in: Health Services and Outcomes Research Methodology, v. 11, no. 1-2, July 2011, p. 44-53

Posted on RAND.org on July 01, 2011

by Sebastian Bauhoff

Read More

Access further information on this document at rd.springer.com

This article was published outside of RAND. The full text of the article can be found at the link above.

This paper examines the effect of systematic self-report bias, the non-random deviation between the self-reported and true values of the same measure. This bias may be constant or variable, and can mislead empirical analyses based on descriptive statistics, program evaluation and instrumental variables estimation. I illustrate these issues with data on self-reported and measured overweight/obesity status, and BMI, height and weight z-scores of public school students in California from 2004 to 2006. I find that the prevalence of overweight/obesity is 2.4-7.6% points lower in self-reported data relative to measured data in the cross-section. A school nutrition policy changed the bias differentially in the treatment and control groups so that program evaluations could find spurious positive or null impacts of the intervention. Potential channels for this effect include improved information and stigma.

This report is part of the RAND Corporation External publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

Our mission to help improve policy and decisionmaking through research and analysis is enabled through our core values of quality and objectivity and our unwavering commitment to the highest level of integrity and ethical behavior. To help ensure our research and analysis are rigorous, objective, and nonpartisan, we subject our research publications to a robust and exacting quality-assurance process; avoid both the appearance and reality of financial and other conflicts of interest through staff training, project screening, and a policy of mandatory disclosure; and pursue transparency in our research engagements through our commitment to the open publication of our research findings and recommendations, disclosure of the source of funding of published research, and policies to ensure intellectual independence. For more information, visit www.rand.org/about/principles.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.