With Small Power, Comes Great Responsibility

Lessons Learned from an Evaluation of Veteran and Military Mental Health Public Awareness Campaigns

Joie D. Acosta, J. Scott Ashwood, Terry L. Schell, Jennifer L. Cerully

ResearchPosted on rand.org Oct 15, 2019Published in: Community Mental Health Journal, pages 1-4 (2019). doi: 10.1007/s10597-019-00419-3

This study was conducted to determine the feasibility of conducting a cost-benefit evaluation of federally-funded media campaigns encouraging mental health help-seeking among United States military personnel and veterans. To calculate the necessary sample size for the evaluation, we obtained campaign costs, and determined the number of treatment seekers needed for the campaign to break even with its cost and the associated population change that an evaluation would need to detect. The sample size needed for an evaluation with 80% power was greater than the total population of U.S. military personnel and veterans. Given that the necessary sample size exceeds the population to be sampled, an appropriately powered outcome evaluation is not feasible. Other programs that would be cost effective with extremely small effect sizes should not be subject to underpowered and thus inaccurate empirical outcome evaluation.

Topics

Document Details

  • Publisher: Springer Nature
  • Availability: Non-RAND
  • Year: 2019
  • Pages: 4
  • Document Number: EP-67977

Research conducted by

This publication is part of the RAND external publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.