Cover: Imperfect Synthetic Controls

Imperfect Synthetic Controls

Did the Massachusetts Health Care Reform Save Lives?

Published May 16, 2018

by David Powell

Download eBook for Free

FormatFile SizeNotes
PDF file 0.3 MB

Use Adobe Acrobat Reader version 10 or higher for the best experience.

The synthetic control method has become a valuable and widely-used technique to estimate causal effects even when more traditional fixed effects methods are inappropriate. This paper relaxes two critical assumptions required to implement the synthetic control estimator. First, the synthetic control estimator assumes that the outcomes of the treated unit are within the "convex hull" of the outcomes of the untreated units. In this paper, I show that estimation of the policy effect is possible when the treated unit composes part of the synthetic control for any of the untreated units, permitting the treated unit to be outside the convex hull of the other units. Instead of constructing a synthetic control only for the treated unit, this paper recommends creating a synthetic control for every unit. The difference in the post-treatment outcomes for each unit compared to its synthetic control is related to the corresponding difference in the policy variable, identifying the policy effect. Second, the synthetic control estimator assumes the existence of a "perfect" synthetic control, which only occurs if the outcome variable is not subject to transitory shocks. In this paper, I suggest a straightforward two-step approach which first generates predicted values of the outcome variables for each unit and uses these predicted values instead of the actual values of the outcome variable when constructing the synthetic control units. Together, these two modifications significantly reduce the restrictions imposed by the synthetic control estimator and provide asymptotically unbiased estimates of the policy effect. Simulations show that this approach outperforms the traditional synthetic control estimator. I apply the new estimator to study the mortality effects of the 2006 Massachusetts Health Care Reform and estimate that the reform reduced the mortality rate by 3%.

This research was conducted by RAND Labor and Population.

This report is part of the RAND working paper series. RAND working papers are intended to share researchers' latest findings and to solicit informal peer review. They have been approved for circulation by RAND but may not have been formally edited or peer reviewed.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.