IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2210.05026.html
   My bibliography  Save this paper

Uncertainty Quantification in Synthetic Controls with Staggered Treatment Adoption

Author

Listed:
  • Matias D. Cattaneo
  • Yingjie Feng
  • Filippo Palomba
  • Rocio Titiunik

Abstract

We propose principled prediction intervals to quantify the uncertainty of a large class of synthetic control predictions (or estimators) in settings with staggered treatment adoption, offering precise non-asymptotic coverage probability guarantees. From a methodological perspective, we provide a detailed discussion of different causal quantities to be predicted, which we call `causal predictands', allowing for multiple treated units with treatment adoption at possibly different points in time. From a theoretical perspective, our uncertainty quantification methods improve on prior literature by (i) covering a large class of causal predictands in staggered adoption settings, (ii) allowing for synthetic control methods with possibly nonlinear constraints, (iii) proposing scalable robust conic optimization methods and principled data-driven tuning parameter selection, and (iv) offering valid uniform inference across post-treatment periods. We illustrate our methodology with an empirical application studying the effects of economic liberalization in the 1990s on GDP for emerging European countries. Companion general-purpose software packages are provided in Python, R and Stata.

Suggested Citation

  • Matias D. Cattaneo & Yingjie Feng & Filippo Palomba & Rocio Titiunik, 2022. "Uncertainty Quantification in Synthetic Controls with Staggered Treatment Adoption," Papers 2210.05026, arXiv.org, revised Sep 2023.
  • Handle: RePEc:arx:papers:2210.05026
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2210.05026
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Matias D. Cattaneo & Yingjie Feng & Rocio Titiunik, 2021. "Prediction Intervals for Synthetic Control Methods," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1865-1880, October.
    2. Andreas Billmeier & Tommaso Nannicini, 2013. "Assessing Economic Liberalization Episodes: A Synthetic Control Approach," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 983-1001, July.
    3. Matias D. Cattaneo & Yingjie Feng & Filippo Palomba & Rocio Titiunik, 2022. "scpi: Uncertainty Quantification for Synthetic Control Methods," Papers 2202.05984, arXiv.org, revised Oct 2022.
    4. Jeffrey D. Sachs & Andrew Warner, 1995. "Economic Reform and the Process of Global Integration," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 26(1, 25th A), pages 1-118.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Manuel Funke & Moritz Schularick & Christoph Trebesch, 2023. "Populist Leaders and the Economy," American Economic Review, American Economic Association, vol. 113(12), pages 3249-3288, December.
    2. Niklas Potrafke & Fabian Ruthardt & Kaspar Wuthrich, 2020. "Protectionism and economic growth: Causal evidence from the first era of globalization," Papers 2010.02378, arXiv.org, revised Mar 2022.
    3. Gründler, Klaus & Hillman, Arye L., 2021. "Ambiguous protection," European Journal of Political Economy, Elsevier, vol. 68(C).
    4. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    5. Tolga Aksoy, 2019. "Structural reforms and growth in developing countries," Journal of Economic Policy Reform, Taylor and Francis Journals, vol. 22(4), pages 325-350, October.
    6. Esteban Colla‐De‐Robertis & Rafael Garduno Rivera, 2021. "The effect of a free trade agreement with the United States on member countries' per capita GDP: A synthetic control analysis," Regional Science Policy & Practice, Wiley Blackwell, vol. 13(4), pages 1129-1145, August.
    7. Olper, Alessandro & Curzi, Daniele & Swinnen, Johan, 2018. "Trade liberalization and child mortality: A Synthetic Control Method," World Development, Elsevier, vol. 110(C), pages 394-410.
    8. Barlow, Pepita, 2018. "Does trade liberalization reduce child mortality in low- and middle-income countries? A synthetic control analysis of 36 policy experiments, 1963-2005," Social Science & Medicine, Elsevier, vol. 205(C), pages 107-115.
    9. Guillaume Allaire Pouliot & Zhen Xie, 2022. "Degrees of Freedom and Information Criteria for the Synthetic Control Method," Papers 2207.02943, arXiv.org.
    10. Wei Tian & Seojeong Lee & Valentyn Panchenko, 2023. "Synthetic Controls with Multiple Outcomes: Estimating the Effects of Non-Pharmaceutical Interventions in the COVID-19 Pandemic," Discussion Papers 2023-05, School of Economics, The University of New South Wales.
    11. Ursula Muench & Armin Nassehi & Joe Kaeser & Knut Bergmann & Matthias Diermeier & Florian Dorn & David Gstrein & Florian Neumeier & Manuel Funke & Moritz Schularick & Christoph Trebesch & Kerim Peren , 2024. "Wohlstand in Gefahr? Ursachen und Folgen von Populismus," ifo Schnelldienst, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 77(03), pages 03-32, March.
    12. Douglas A. Irwin, 2019. "Does Trade Reform Promote Economic Growth? A Review of Recent Evidence," Working Paper Series WP19-9, Peterson Institute for International Economics.
    13. Klaus Gründler & Niklas Potrafke & Timo Wochner, 2020. "Structural Reforms and Income Inequality: Who Benefits From Market-Oriented Reforms?," EconPol Policy Reports 18, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    14. Marrazzo, Marco & Terzi, Alessio, 2017. "Structural reform waves and economic growth," Working Paper Series 2111, European Central Bank.
    15. Sundar Ponnusamy, 2022. "Export specialization, trade liberalization and economic growth: a synthetic control analysis," Empirical Economics, Springer, vol. 63(2), pages 637-669, August.
    16. Nauro F. Campos & Paul De Grauwe & Yuemei Ji, 2017. "Structural Reforms, Growth and Inequality: An Overview of Theory, Measurement and Evidence," CESifo Working Paper Series 6812, CESifo.
    17. Emery Thomas J. & Kovac Mitja & Spruk Rok, 2023. "Estimating the Effects of Political Instability in Nascent Democracies," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 243(6), pages 599-642, December.
    18. Barlow, Pepita, 2018. "Does trade liberalization reduce child mortality in low- and middle-income countries? A synthetic control analysis of 36 policy experiments, 1963-2005," LSE Research Online Documents on Economics 102664, London School of Economics and Political Science, LSE Library.
    19. Furceri, Davide & Hannan, Swarnali A. & Ostry, Jonathan D. & Rose, Andrew K., 2020. "Are tariffs bad for growth? Yes, say five decades of data from 150 countries," Journal of Policy Modeling, Elsevier, vol. 42(4), pages 850-859.
    20. Philip Stevens & Jasson Urbach & Gabrielle Wills, 2013. "Healthy Trade: The Relationship Between Open Trade and Health," Foreign Trade Review, , vol. 48(1), pages 125-135, February.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2210.05026. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.