IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2312.05858.html

Causal inference and policy evaluation without a control group

Author

Listed:
  • Augusto Cerqua
  • Marco Letta
  • Fiammetta Menchetti

Abstract

Without a control group, the most widespread methodologies for estimating causal effects cannot be applied. To fill this gap, we propose the Machine Learning Control Method, a new approach for causal panel analysis that estimates causal parameters without relying on untreated units. We formalize identification within the potential outcomes framework and then provide estimation based on machine learning algorithms. To illustrate the practical relevance of our method, we present simulation evidence, a replication study, and an empirical application on the impact of the COVID-19 crisis on educational inequality. We implement the proposed approach in the companion R package MachineControl

Suggested Citation

  • Augusto Cerqua & Marco Letta & Fiammetta Menchetti, 2023. "Causal inference and policy evaluation without a control group," Papers 2312.05858, arXiv.org, revised Oct 2024.
    • Handle: RePEc:arx:papers:2312.05858
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2312.05858
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Alberto Abadie, 2021. "Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 391-425, June.
    2. Dmitry Arkhangelsky & Susan Athey & David A. Hirshberg & Guido W. Imbens & Stefan Wager, 2021. "Synthetic Difference-in-Differences," American Economic Review, American Economic Association, vol. 111(12), pages 4088-4118, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sadeghi, Ali & Kibler, Ewald, 2022. "Do bankruptcy laws matter for entrepreneurship? A Synthetic Control Method analysis of a bankruptcy reform in Finland," Journal of Business Venturing Insights, Elsevier, vol. 18(C).
    2. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    3. Zhentao Shi & Jin Xi & Haitian Xie, 2025. "A Synthetic Business Cycle Approach to Counterfactual Analysis with Nonstationary Macroeconomic Data," Papers 2505.22388, arXiv.org.
    4. Di, Wenhua & Pattison, Nathaniel, 2023. "Industry Specialization and Small Business Lending," Journal of Banking & Finance, Elsevier, vol. 149(C).
    5. Pekka Malo & Juha Eskelinen & Xun Zhou & Timo Kuosmanen, 2024. "Computing Synthetic Controls Using Bilevel Optimization," Computational Economics, Springer;Society for Computational Economics, vol. 64(2), pages 1113-1136, August.
    6. Robert Messerle & Jonas Schreyögg, 2024. "Country-level effects of diagnosis-related groups: evidence from Germany’s comprehensive reform of hospital payments," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 25(6), pages 1013-1030, August.
    7. Wallimann, Hannes, 2024. "Austria’s KlimaTicket: Assessing the short-term impact of a cheap nationwide travel pass on demand," Transport Policy, Elsevier, vol. 159(C), pages 201-214.
    8. Marisa Cameron & Bryan C. McCannon & Katherine Starr, 2023. "AACSB accreditation and student demand," Southern Economic Journal, John Wiley & Sons, vol. 90(2), pages 317-340, October.
    9. Rothenberg, Alexander D. & Wang, Yao & Chari, Amalavoyal, 2025. "When regional policies fail: An evaluation of Indonesia’s Integrated Economic Development Zones," Journal of Development Economics, Elsevier, vol. 176(C).
    10. Ben Deaner & Chen-Wei Hsiang & Andrei Zeleneev, 2025. "Inferring Treatment Effects in Large Panels by Uncovering Latent Similarities," Papers 2503.20769, arXiv.org, revised Mar 2025.
    11. Ron Berman & Ayelet Israeli, 2022. "The Value of Descriptive Analytics: Evidence from Online Retailers," Marketing Science, INFORMS, vol. 41(6), pages 1074-1096, November.
    12. Dylan Brewer & Samantha Cameron, 2025. "Habit and skill retention in recycling," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 44(2), pages 533-552, March.
    13. Cho, Sang-Wook (Stanley) & Wong, Sally, 2025. "Monetary regimes and regional economies: A counterfactual perspective from two euro opt-outs," Journal of Macroeconomics, Elsevier, vol. 85(C).
    14. Arjen van Lin & Kristopher Keller & Jonne Guyt, 2025. "Retiring the Store Flyer: Effects of Ceasing Print Store Flyers on Household Grocery Shopping Behavior," Tinbergen Institute Discussion Papers 25-028/XII, Tinbergen Institute.
    15. Wang, Z., 2025. "Patent Pledge and Technological Innovation: The "Good Faith" of Tesla," Cambridge Working Papers in Economics 2532, Faculty of Economics, University of Cambridge.
    16. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    17. Hannah Druckenmiller & Yanjun (Penny) Liao & Sophie Pesek & Margaret Walls & Shan Zhang, 2024. "Removing development incentives in risky areas promotes climate adaptation," Nature Climate Change, Nature, vol. 14(9), pages 936-942, September.
    18. Watzinger, Martin & Schnitzer, Monika, 2022. "The Breakup of the Bell System and its Impact on US Innovation," CEPR Discussion Papers 17635, C.E.P.R. Discussion Papers.
    19. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    20. Lutz Sager, 2025. "Estimating the Effect of China’s 2013 Air Pollution Prevention and Control Action Plan," CESifo Working Paper Series 11826, CESifo.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2312.05858. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.