A Framework for Assessing Models of the COVID-19 Pandemic to Inform Policymaking in Virginia

Carter C. Price, Adrienne M. Propp

ResearchPublished Jul 8, 2020

Models have been widely used to inform policymakers about the implications of coronavirus disease 2019 (COVID-19) and the effects of policy responses to it. The authors of this report reviewed available models and the relevant literature to produce a framework for assessing a model's suitability for policymakers in the Commonwealth of Virginia.

Virginia's government first announced the presence of a COVID-19 case on March 7, 2020. The first interventions were put in place with only a few dozen confirmed cases having been reported, and Virginia had just over 1,000 confirmed cases when the stay-at-home order was implemented.

When assessing whether a model is suitable for informing policy, it is important to consider whether the data being used are relevant, whether the model design is appropriate, how the model has performed in the past, and the degree of transparency in the model. In this report, the authors examine assessment criteria for early-stage and late-stage models, taking into account the effects of the COVID-19 pandemic on behavior, policy, health outcomes, and the economy.

Key Findings

  • In the early stage, before the peak in the spread, modeling generally focuses on the timing and level of the peak. Statistical models are most suitable for forecasting trends, rather than comparing policies. Systems dynamics models are well suited for comparing policies, as long as the policies in question operate through mechanisms that are captured by the model.
  • Some models will cease to be useful after the early phase, or after certain policy responses to the pandemic have been phased in or out. New models might be needed as the policy environment changes.
  • Late-stage models—those examining trends after the peak—should incorporate economic, social, and other concerns, in addition to the health risks, so that policymakers can have an understanding of potential trade-offs.
  • Late-stage models should account for the major components of available reopening plans, including the gradual relaxation of physical-distancing measures, widespread testing and contact tracing, and improved health care capacity.
  • The extent and efficacy of such measures as widespread testing and contact tracing need to be considered in any model, because these measures likely will play a key role in successful reopening.
  • If and when a vaccine is developed, models should help inform the dissemination of the vaccine to minimize the risk of death from COVID-19.

Topics

Document Details

Citation

RAND Style Manual
Price, Carter C. and Adrienne M. Propp, A Framework for Assessing Models of the COVID-19 Pandemic to Inform Policymaking in Virginia, RAND Corporation, RR-A323-1, 2020. As of October 12, 2024: https://www.rand.org/pubs/research_reports/RRA323-1.html
Chicago Manual of Style
Price, Carter C. and Adrienne M. Propp, A Framework for Assessing Models of the COVID-19 Pandemic to Inform Policymaking in Virginia. Santa Monica, CA: RAND Corporation, 2020. https://www.rand.org/pubs/research_reports/RRA323-1.html.
BibTeX RIS

This research was funded by the Virginia Department of Emergency Management and carried out jointly within the Access and Delivery Program in RAND Health Care and the Community Health and Environmental Policy Program within RAND Social and Economic Well-Being.

This publication is part of the RAND research report series. Research reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND research reports undergo rigorous peer review to ensure high standards for research quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.