IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2312.16307.html

Incentive-Aware Synthetic Control: Accurate Counterfactual Estimation via Incentivized Exploration

Author

Listed:
  • Daniel Ngo
  • Keegan Harris
  • Anish Agarwal
  • Vasilis Syrgkanis
  • Zhiwei Steven Wu

Abstract

We consider the setting of synthetic control methods (SCMs), a canonical approach used to estimate the treatment effect on the treated in a panel data setting. We shed light on a frequently overlooked but ubiquitous assumption made in SCMs of "overlap": a treated unit can be written as some combination -- typically, convex or linear combination -- of the units that remain under control. We show that if units select their own interventions, and there is sufficiently large heterogeneity between units that prefer different interventions, overlap will not hold. We address this issue by proposing a framework which incentivizes units with different preferences to take interventions they would not normally consider. Specifically, leveraging tools from information design and online learning, we propose a SCM that incentivizes exploration in panel data settings by providing incentive-compatible intervention recommendations to units. We establish this estimator obtains valid counterfactual estimates without the need for an a priori overlap assumption. We extend our results to the setting of synthetic interventions, where the goal is to produce counterfactual outcomes under all interventions, not just control. Finally, we provide two hypothesis tests for determining whether unit overlap holds for a given panel dataset.

Suggested Citation

  • Daniel Ngo & Keegan Harris & Anish Agarwal & Vasilis Syrgkanis & Zhiwei Steven Wu, 2023. "Incentive-Aware Synthetic Control: Accurate Counterfactual Estimation via Incentivized Exploration," Papers 2312.16307, arXiv.org, revised Feb 2024.
  • Handle: RePEc:arx:papers:2312.16307
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2312.16307
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Emir Kamenica, 2019. "Bayesian Persuasion and Information Design," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 249-272, August.
    2. Muhummad Amjad & Vishal Misra & Devavrat Shah & Dennis Shen, 2019. "mRSC: Multi-dimensional Robust Synthetic Control," Papers 1905.06400, arXiv.org, revised Sep 2019.
    3. Orley Ashenfelter & David Card, 1984. "Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs," Working Papers 554, Princeton University, Department of Economics, Industrial Relations Section..
    4. Jiafeng Chen, 2023. "Synthetic Control as Online Linear Regression," Econometrica, Econometric Society, vol. 91(2), pages 465-491, March.
    5. Arellano, Manuel & Honore, Bo, 2001. "Panel data models: some recent developments," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 53, pages 3229-3296, Elsevier.
    6. Ashenfelter, Orley & Card, David, 1985. "Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs," The Review of Economics and Statistics, MIT Press, vol. 67(4), pages 648-660, November.
    7. Stephen G. Donald & Kevin Lang, 2007. "Inference with Difference-in-Differences and Other Panel Data," The Review of Economics and Statistics, MIT Press, vol. 89(2), pages 221-233, May.
    8. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769.
    9. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
    10. Qiu Hongxiang & Carone Marco & Luedtke Alex, 2022. "Individualized treatment rules under stochastic treatment cost constraints," Journal of Causal Inference, De Gruyter, vol. 10(1), pages 480-493, January.
    11. Dirk Bergemann & Stephen Morris, 2019. "Information Design: A Unified Perspective," Journal of Economic Literature, American Economic Association, vol. 57(1), pages 44-95, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Keegan Harris & Anish Agarwal & Chara Podimata & Zhiwei Steven Wu, 2022. "Strategyproof Decision-Making in Panel Data Settings and Beyond," Papers 2211.14236, arXiv.org, revised Dec 2023.
    2. Anish Agarwal & Sukjin Han & Dwaipayan Saha & Vasilis Syrgkanis & Haeyeon Yoon, 2022. "Synthetic Blips: Generalizing Synthetic Controls for Dynamic Treatment Effects," Papers 2210.11003, arXiv.org, revised Oct 2025.
    3. Hicham El Ouazzani & Hicham Ouakil & Abdelhamid Moustabchir & Augustin Foster Chabossou, 2025. "Economic impact of the african continental free trade area: a combined propensity score matching and difference-in-differences approach to regional integration in Africa," International Journal of Economic Policy Studies, Springer, vol. 19(2), pages 377-399, August.
    4. Marco D. Huesch & Truls Østbye & Michael K. Ong, 2012. "Measuring The Effect Of Policy Interventions At The Population Level: Some Methodological Concerns," Health Economics, John Wiley & Sons, Ltd., vol. 21(10), pages 1234-1249, October.
    5. Wright, Austin L. & Sonin, Konstantin & Driscoll, Jesse & Wilson, Jarnickae, 2020. "Poverty and economic dislocation reduce compliance with COVID-19 shelter-in-place protocols," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 544-554.
    6. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    7. Lin, Boqiang & Li, Xuehui, 2011. "The effect of carbon tax on per capita CO2 emissions," Energy Policy, Elsevier, vol. 39(9), pages 5137-5146, September.
    8. Cammeraat, Emile & Jongen, Egbert L. W. & Koning, Pierre, 2017. "Preventing NEETs during the Great Recession: The Effects of a Mandatory Activation Program for Young Welfare Recipients," IZA Discussion Papers 11090, Institute of Labor Economics (IZA).
    9. Senftleben-König, Charlotte, 2014. "Product market deregulation and employment outcomes: Evidence from the German retail sector," SFB 649 Discussion Papers 2014-013, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    10. Ahlfeldt, Gabriel M. & Nitsch, Volker & Wendland, Nicolai, 2019. "Ease vs. noise: Long-run changes in the value of transport (dis)amenities," Journal of Environmental Economics and Management, Elsevier, vol. 98(C).
    11. Hansen, Bruce E. & Lee, Seojeong, 2019. "Asymptotic theory for clustered samples," Journal of Econometrics, Elsevier, vol. 210(2), pages 268-290.
    12. Rösner, Anja & Haucap, Justus & Heimeshoff, Ulrich, 2020. "The impact of consumer protection in the digital age: Evidence from the European Union," International Journal of Industrial Organization, Elsevier, vol. 73(C).
    13. René TAPSOBA & Alexandru MINEA & Jean-Louis COMBES, 2012. "Inflation Targeting and Fiscal Rules: Do Interactions and Sequence of Adoption Matter?," Working Papers 201223, CERDI.
    14. Daniel Kuehnle & Christoph Wunder, 2017. "The Effects of Smoking Bans on Self‐Assessed Health: Evidence from Germany," Health Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 321-337, March.
    15. Anish Agarwal & Keegan Harris & Justin Whitehouse & Zhiwei Steven Wu, 2023. "Adaptive Principal Component Regression with Applications to Panel Data," Papers 2307.01357, arXiv.org, revised Aug 2024.
    16. Jean-Louis Combes & Mr. Xavier Debrun & Alexandru Minea & Rene Tapsoba, 2014. "Inflation Targeting and Fiscal Rules: Do Interactions and Sequencing Matter?," IMF Working Papers 2014/089, International Monetary Fund.
    17. Jianzhao Liu & Na Li & Xueli Du, 2023. "Did place-based industrial policy promote regional economic growth? ---- Evidence from China," PLOS ONE, Public Library of Science, vol. 18(4), pages 1-21, April.
    18. Brady, Michael & Tantihkarkhana, Pitchayaporn, "undated". "Estimating the Value of Water from Property Sales in an Arid High Environmental Amenity Region: A Difference-in-Difference in Approach," 2015 AAEA & WAEA Joint Annual Meeting, July 26-28, San Francisco, California 205658, Agricultural and Applied Economics Association.
    19. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    20. Fernández-López, Reinier & Mardones, Cristian, 2025. "Impact evaluation of the carbon tax in Chile using the difference-in-differences method," Energy, Elsevier, vol. 318(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2312.16307. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.