IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2312.05858.html
   My bibliography  Save this paper

Causal inference and policy evaluation without a control group

Author

Listed:
  • Augusto Cerqua
  • Marco Letta
  • Fiammetta Menchetti

Abstract

Without a control group, the most widespread methodologies for estimating causal effects cannot be applied. To fill this gap, we propose the Machine Learning Control Method, a new approach for causal panel analysis that estimates causal parameters without relying on untreated units. We formalize identification within the potential outcomes framework and then provide estimation based on machine learning algorithms. To illustrate the practical relevance of our method, we present simulation evidence, a replication study, and an empirical application on the impact of the COVID-19 crisis on educational inequality. We implement the proposed approach in the companion R package MachineControl

Suggested Citation

  • Augusto Cerqua & Marco Letta & Fiammetta Menchetti, 2023. "Causal inference and policy evaluation without a control group," Papers 2312.05858, arXiv.org, revised Oct 2024.
    • Handle: RePEc:arx:papers:2312.05858
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2312.05858
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dmitry Arkhangelsky & Susan Athey & David A. Hirshberg & Guido W. Imbens & Stefan Wager, 2021. "Synthetic Difference-in-Differences," American Economic Review, American Economic Association, vol. 111(12), pages 4088-4118, December.
    2. Alberto Abadie, 2021. "Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 391-425, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sadeghi, Ali & Kibler, Ewald, 2022. "Do bankruptcy laws matter for entrepreneurship? A Synthetic Control Method analysis of a bankruptcy reform in Finland," Journal of Business Venturing Insights, Elsevier, vol. 18(C).
    2. Pekka Malo & Juha Eskelinen & Xun Zhou & Timo Kuosmanen, 2024. "Computing Synthetic Controls Using Bilevel Optimization," Computational Economics, Springer;Society for Computational Economics, vol. 64(2), pages 1113-1136, August.
    3. Robert Messerle & Jonas Schreyögg, 2024. "Country-level effects of diagnosis-related groups: evidence from Germany’s comprehensive reform of hospital payments," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 25(6), pages 1013-1030, August.
    4. Ron Berman & Ayelet Israeli, 2022. "The Value of Descriptive Analytics: Evidence from Online Retailers," Marketing Science, INFORMS, vol. 41(6), pages 1074-1096, November.
    5. Stefano, Roberta di & Mellace, Giovanni, 2020. "The inclusive synthetic control method," Discussion Papers on Economics 14/2020, University of Southern Denmark, Department of Economics.
    6. Roy Cerqueti & Raffaella Coppier & Alessandro Girardi & Marco Ventura, 2022. "The sooner the better: lives saved by the lockdown during the COVID-19 outbreak. The case of Italy," The Econometrics Journal, Royal Economic Society, vol. 25(1), pages 46-70.
    7. Watzinger, Martin & Schnitzer, Monika, 2022. "The Breakup of the Bell System and its Impact on US Innovation," CEPR Discussion Papers 17635, C.E.P.R. Discussion Papers.
    8. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    9. Crudu, Federico & Di Stefano, Roberta & Mellace, Giovanni & Tiezzi, Silvia, 2024. "The gray zone: How not imposing a strict lockdown at the beginning of a pandemic can cost many lives," Labour Economics, Elsevier, vol. 89(C).
    10. Florian F Gunsilius, 2025. "A primer on optimal transport for causal inference with observational data," Papers 2503.07811, arXiv.org, revised Mar 2025.
    11. Francesco S. Bellelli & Ankai Xu, 2024. "The Impact of Environmental Measures on Trade and Innovation: Evidence from the WTO Environmental Database (EDB)," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 87(10), pages 2629-2682, October.
    12. Clair, Travis St., 2024. "The fiscal effects of immigration on local governments: Revisiting the Mariel Boatlift," Regional Science and Urban Economics, Elsevier, vol. 109(C).
    13. Songnian Chen & Junlong Feng, 2023. "Group-Heterogeneous Changes-in-Changes and Distributional Synthetic Controls," Papers 2307.15313, arXiv.org.
    14. Hobbs, Duncan & Strain, Michael R., 2024. "Do Reemployment Bonuses Increase Employment? Evidence from the Idaho Return to Work Bonus Program," IZA Discussion Papers 16924, Institute of Labor Economics (IZA).
    15. Justin C. Wiltshire, 2023. "Walmart Supercenters and Monopsony Power: How A Large, Low-Wage Employer Impacts Local Labor Markets," Department Discussion Papers 2304, Department of Economics, University of Victoria.
    16. Alberto Abadie & Jaume Vives-i-Bastida, 2022. "Synthetic Controls in Action," Papers 2203.06279, arXiv.org.
    17. Dovern, Jonas & Frank, Johannes & Glas, Alexander & Müller, Lena Sophia & Perico Ortiz, Daniel, 2023. "Estimating pass-through rates for the 2022 tax reduction on fuel prices in Germany," Energy Economics, Elsevier, vol. 126(C).
    18. Yang, Bingyan & Liu, Ruiming & Liu, Chuanbin & Shi, Yang, 2025. "Publish or perish: Up-or-out rules and research performance of universities," China Economic Review, Elsevier, vol. 89(C).
    19. Roberto Esposti, 2022. "The Coevolution of Policy Support and Farmers' Behaviour. An investigation on Italian agriculture over the 2008-2019 period," Working Papers 464, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
    20. Ko, Dong Gyun, 2025. "Did the American Rescue Plan cause inflation? A synthetic control approach," Economic Modelling, Elsevier, vol. 143(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2312.05858. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.