Imperfect Synthetic Controls

Did the Massachusetts Health Care Reform Save Lives?

by David Powell

Download eBook for Free

FormatFile SizeNotes
PDF file 0.3 MB

Use Adobe Acrobat Reader version 10 or higher for the best experience.

The synthetic control method has become a valuable and widely-used technique to estimate causal effects even when more traditional fixed effects methods are inappropriate. This paper relaxes two critical assumptions required to implement the synthetic control estimator. First, the synthetic control estimator assumes that the outcomes of the treated unit are within the "convex hull" of the outcomes of the untreated units. In this paper, I show that estimation of the policy effect is possible when the treated unit composes part of the synthetic control for any of the untreated units, permitting the treated unit to be outside the convex hull of the other units. Instead of constructing a synthetic control only for the treated unit, this paper recommends creating a synthetic control for every unit. The difference in the post-treatment outcomes for each unit compared to its synthetic control is related to the corresponding difference in the policy variable, identifying the policy effect. Second, the synthetic control estimator assumes the existence of a "perfect" synthetic control, which only occurs if the outcome variable is not subject to transitory shocks. In this paper, I suggest a straightforward two-step approach which first generates predicted values of the outcome variables for each unit and uses these predicted values instead of the actual values of the outcome variable when constructing the synthetic control units. Together, these two modifications significantly reduce the restrictions imposed by the synthetic control estimator and provide asymptotically unbiased estimates of the policy effect. Simulations show that this approach outperforms the traditional synthetic control estimator. I apply the new estimator to study the mortality effects of the 2006 Massachusetts Health Care Reform and estimate that the reform reduced the mortality rate by 3%.

This research was conducted by RAND Labor and Population.

This report is part of the RAND Corporation working paper series. RAND working papers are intended to share researchers' latest findings and to solicit informal peer review. They have been approved for circulation by RAND but may not have been formally edited or peer reviewed.

Permission is given to duplicate this electronic document for personal use only, as long as it is unaltered and complete. Copies may not be duplicated for commercial purposes. Unauthorized posting of RAND PDFs to a non-RAND Web site is prohibited. RAND PDFs are protected under copyright law. For information on reprint and linking permissions, please visit the RAND Permissions page.

The RAND Corporation is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.