IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2511.21977.html

Beyond Parallel Trends: An Identification-Strategy-Robust Approach to Causal Inference with Panel Data

Author

Listed:
  • Brantly Callaway
  • Derek Dyal
  • Pedro H. C. Sant'Anna
  • Emmanuel S. Tsyawo

Abstract

In this paper, we propose a new approach to causal inference with panel data. Instead of using panel data to adjust for differences in the distribution of unobserved heterogeneity between the treated and comparison groups, we instead use panel data to search for "close comparison groups" -- groups that are similar to the treated group in terms of pre-treatment outcomes. Then, we compare the outcomes of the treated group to the outcomes of these close comparison groups in post-treatment periods. We show that this approach is often identification-strategy-robust in the sense that our approach recovers the ATT under many different non-nested panel data identification strategies, including difference-in-differences, change-in-changes, or lagged outcome unconfoundedness, among several others. We provide related, though non-nested, results under "time homogeneity", where outcomes do not systematically change over time for any comparison group. Our strategy asks more out of the research design -- namely that there exist close comparison groups or time homogeneity (neither of which is required for most existing panel data approaches to causal inference) -- but, when available, leads to more credible inferences.

Suggested Citation

  • Brantly Callaway & Derek Dyal & Pedro H. C. Sant'Anna & Emmanuel S. Tsyawo, 2025. "Beyond Parallel Trends: An Identification-Strategy-Robust Approach to Causal Inference with Panel Data," Papers 2511.21977, arXiv.org.
  • Handle: RePEc:arx:papers:2511.21977
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2511.21977
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Xiaohong Chen & Pedro H. C. Sant'Anna & Haitian Xie, 2025. "Efficient Difference-in-Differences and Event Study Estimators," Papers 2506.17729, arXiv.org.
    2. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    3. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    4. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2009. "Dealing with limited overlap in estimation of average treatment effects," Biometrika, Biometrika Trust, vol. 96(1), pages 187-199.
    5. Victor Chernozhukov & Iván Fernández‐Val & Jinyong Hahn & Whitney Newey, 2013. "Average and Quantile Effects in Nonseparable Panel Models," Econometrica, Econometric Society, vol. 81(2), pages 535-580, March.
    6. Xu, Yiqing, 2017. "Generalized Synthetic Control Method: Causal Inference with Interactive Fixed Effects Models," Political Analysis, Cambridge University Press, vol. 25(1), pages 57-76, January.
    7. F. F. Gunsilius, 2023. "Distributional Synthetic Controls," Econometrica, Econometric Society, vol. 91(3), pages 1105-1117, May.
    8. Dmitry Arkhangelsky & Guido W. Imbens, 2019. "Doubly Robust Identification for Causal Panel Data Models," Papers 1909.09412, arXiv.org, revised Feb 2022.
    9. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    10. Dmitry Arkhangelsky & Guido W. Imbens & Lihua Lei & Xiaoman Luo, 2021. "Design-Robust Two-Way-Fixed-Effects Regression For Panel Data," Papers 2107.13737, arXiv.org, revised Mar 2024.
    11. Jeffrey M. Wooldridge, 2005. "Fixed-Effects and Related Estimators for Correlated Random-Coefficient and Treatment-Effect Panel Data Models," The Review of Economics and Statistics, MIT Press, vol. 87(2), pages 385-390, May.
    12. Xiaohong Chen & Pedro H. C. SantÕAnna & Haitian Xie, 2025. "Efficient Difference-in-Differences and Event Study Estimators," Cowles Foundation Discussion Papers 2470, Cowles Foundation for Research in Economics, Yale University.
    13. Brantly Callaway & Tong Li, 2025. "Evaluating Policies Early in a Pandemic: Bounding Policy Effects with Nonrandomly Missing Data," The Review of Economics and Statistics, MIT Press, vol. 107(3), pages 803-819, May.
    14. Ashesh Rambachan & Jonathan Roth, 2023. "A More Credible Approach to Parallel Trends," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 90(5), pages 2555-2591.
    15. Susan Athey & Guido Imbens & Zhaonan Qu & Davide Viviano, 2025. "Triply Robust Panel Estimators," Papers 2508.21536, arXiv.org, revised Feb 2026.
    16. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, November.
    17. Laurent Gobillon & Thierry Magnac, 2016. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 535-551, July.
    18. Yiqi Liu, 2025. "Synthetic Parallel Trends," Papers 2511.05870, arXiv.org.
    19. Yixiao Sun & Haitian Xie & Yuhang Zhang, 2025. "Difference-in-Differences Meets Synthetic Control: Doubly Robust Identification and Estimation," Papers 2503.11375, arXiv.org, revised Sep 2025.
    20. Brantly Callaway & Emmanuel Selorm Tsyawo, 2023. "Treatment Effects in Staggered Adoption Designs with Non-Parallel Trends," Papers 2308.02899, arXiv.org.
    21. Ding, Peng & Li, Fan, 2019. "A Bracketing Relationship between Difference-in-Differences and Lagged-Dependent-Variable Adjustment," Political Analysis, Cambridge University Press, vol. 27(4), pages 605-615, October.
    22. Michelle Marcus & Pedro H. C. Sant’Anna, 2021. "The Role of Parallel Trends in Event Study Settings: An Application to Environmental Economics," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 8(2), pages 235-275.
    23. Catherine Hausman & David S. Rapson, 2018. "Regression Discontinuity in Time: Considerations for Empirical Applications," Annual Review of Resource Economics, Annual Reviews, vol. 10(1), pages 533-552, October.
    24. Dmitry Arkhangelsky & Guido W. Imbens & Lihua Lei & Xiaoman Luo, 2024. "Design‐robust two‐way‐fixed‐effects regression for panel data," Quantitative Economics, Econometric Society, vol. 15(4), pages 999-1034, November.
    25. Maxwell Kellogg & Magne Mogstad & Guillaume A. Pouliot & Alexander Torgovitsky, 2021. "Combining Matching and Synthetic Control to Tradeoff Biases From Extrapolation and Interpolation," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1804-1816, October.
    26. Philip Marx & Elie Tamer & Xun Tang, 2024. "Heterogeneous Treatment Effects via Linear Dynamic Panel Data Models," Papers 2410.19060, arXiv.org, revised Sep 2025.
    27. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    28. Heckman, J.J. & Hotz, V.J., 1988. "Choosing Among Alternative Nonexperimental Methods For Estimating The Impact Of Social Programs: The Case Of Manpower Training," University of Chicago - Economics Research Center 88-12, Chicago - Economics Research Center.
    29. Dmitry Arkhangelsky & Guido W Imbens, 2022. "Doubly robust identification for causal panel data models [Sufficient statistics for unobserved heterogeneity in structural dynamic logit models]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 649-674.
    30. Ratzanyel Rinc'on & Kyungchul Song, 2025. "Causal Inference with Groupwise Matching," Papers 2510.26106, arXiv.org, revised Mar 2026.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.
    2. Ratzanyel Rinc'on & Kyungchul Song, 2025. "Causal Inference with Groupwise Matching," Papers 2510.26106, arXiv.org, revised Mar 2026.
    3. Callaway, Brantly & Karami, Sonia, 2023. "Treatment effects in interactive fixed effects models with a small number of time periods," Journal of Econometrics, Elsevier, vol. 233(1), pages 184-208.
    4. Kirill Borusyak & Xavier Jaravel & Jann Spiess, 2024. "Revisiting Event-Study Designs: Robust and Efficient Estimation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(6), pages 3253-3285.
    5. Christian Alemán-Pericón & Alexander Ludwig & Christopher Busch & Raül Santaeulàlia-Llopis, 2022. "A Stage-Based Identification of Policy Effects," Working Papers 1369, Barcelona School of Economics.
    6. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2024. "Estimating Causal Effects with Observational Data: Guidelines for Agricultural and Applied Economists," IFRO Working Paper 2024/03, University of Copenhagen, Department of Food and Resource Economics.
    7. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    8. Dalia Ghanem & Pedro H. C. Sant'Anna & Kaspar Wüthrich, 2022. "Selection and Parallel Trends," CESifo Working Paper Series 9910, CESifo.
    9. Brown, Nicholas L. & Butts, Kyle, 2025. "Dynamic treatment effect estimation with interactive fixed effects and short panels," Journal of Econometrics, Elsevier, vol. 250(C).
    10. Yixiao Sun & Haitian Xie & Yuhang Zhang, 2025. "Difference-in-Differences Meets Synthetic Control: Doubly Robust Identification and Estimation," Papers 2503.11375, arXiv.org, revised Sep 2025.
    11. Wang, Yimin, 2025. "Links between COVID-19 lockdowns and drug overdose deaths, evidence from panel data," Economics & Human Biology, Elsevier, vol. 58(C).
    12. Ben Deaner & Chen-Wei Hsiang & Andrei Zeleneev, 2025. "Inferring Treatment Effects in Large Panels by Uncovering Latent Similarities," Papers 2503.20769, arXiv.org, revised Mar 2025.
    13. Hao, Shiming, 2021. "True structure change, spurious treatment effect? A novel approach to disentangle treatment effects from structure changes," MPRA Paper 108679, University Library of Munich, Germany.
    14. Sandro Heiniger, 2024. "Data-driven model selection within the matrix completion method for causal panel data models," Papers 2402.01069, arXiv.org.
    15. Rafaty, Ryan & Dolphin, Geoffroy & Pretis, Felix, 2025. "Carbon pricing and the elasticity of CO2 emissions," Energy Economics, Elsevier, vol. 144(C).
    16. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    17. Ryan Rafaty & Geoffroy Dolphin & Felix Pretis, 2020. "Carbon pricing and the elasticity of CO2 emissions," Working Papers EPRG2035, Energy Policy Research Group, Cambridge Judge Business School, University of Cambridge.
    18. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    19. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    20. Luya Wang & Jeffrey S. Racine & Qiaoyu Wang, 2025. "Bootstrap inference on a factor model based average treatment effects estimator," Econometric Reviews, Taylor & Francis Journals, vol. 44(1), pages 80-89, January.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2511.21977. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.