IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2609.19081.html

Beyond Pretrends: A Discordance-Based Sensitivity Analysis for Difference-in-Differences

Author

Listed:
  • Thomas Leavitt

Abstract

In the canonical Difference-in-Differences design, the control group's post-treatment change serves as an imputation of the treated group's counterfactual change in the same period, an imputation justified by parallel trends. However, differences in group composition can produce between-group differences in how outcomes would evolve over time, rendering this imputation vulnerable to confounding. An alternative imputation -- such as one based on the treated group's pre-treatment change -- avoids such between-group confounding but introduces the risk of confounding from within-group temporal shifts. Ideally, both imputations, each vulnerable to different sources of confounding, would have concordant values, thereby yielding the same causal conclusions. When the imputations are discordant, conclusions under parallel trends hinge more critically on that assumption since alternative imputations would point to different results. Yet in these scenarios, existing pretrends-based sensitivity analyses can show low sensitivity because they ignore post-treatment deviations from pretrends in the control group. This paper therefore proposes a discordance-based sensitivity model in which parallel pretrends are necessary but not sufficient for low sensitivity. I formally justify this model in terms of the expected distance between the ATT under parallel trends and under alternative assumptions, weighted by the joint plausibility of those assumptions. I then provide a decision-theoretic rationale for benchmarking violations of parallel trends using the worst-case discordance between the parallel trends imputation and alternative imputations. Finally, I apply both pretrends- and discordance-based sensitivity models to assess how a labor supply shock influenced electoral support for apartheid-era policies in South Africa, showing how the two approaches yield different results.

Suggested Citation

  • Thomas Leavitt, 2026. "Beyond Pretrends: A Discordance-Based Sensitivity Analysis for Difference-in-Differences," Papers 2609.19081, arXiv.org, revised Oct 2026.
  • Handle: RePEc:arx:papers:2609.19081
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2609.19081
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Demetrescu, Matei & Frondel, Manuel & Tomberg, Lukas & Vance, Colin, 2025. "Fixed Effects, Lagged Dependent Variables, and Bracketing: Cautionary Remarks," Political Analysis, Cambridge University Press, vol. 33(4), pages 378-392, October.
    2. Taryn Dinkelman & Martine Mariotti, 2016. "The Long-Run Effects of Labor Migration on Human Capital Formation in Communities of Origin," American Economic Journal: Applied Economics, American Economic Association, vol. 8(4), pages 1-35, October.
    3. Ariella Kahn-Lang & Kevin Lang, 2020. "The Promise and Pitfalls of Differences-in-Differences: Reflections on 16 and Pregnant and Other Applications," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(3), pages 613-620, July.
    4. Charles F. Manski & John V. Pepper, 2018. "How Do Right-to-Carry Laws Affect Crime Rates? Coping with Ambiguity Using Bounded-Variation Assumptions," The Review of Economics and Statistics, MIT Press, vol. 100(2), pages 232-244, May.
    5. Ding, Peng & Li, Fan, 2019. "A Bracketing Relationship between Difference-in-Differences and Lagged-Dependent-Variable Adjustment," Political Analysis, Cambridge University Press, vol. 27(4), pages 605-615, October.
    6. Ting Ye & Luke Keele & Raiden Hasegawa & Dylan S. Small, 2024. "A Negative Correlation Strategy for Bracketing in Difference-in-Differences," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 119(547), pages 2256-2268, July.
    7. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    8. Jonathan Roth & Pedro H. C. Sant'Anna, 2023. "When Is Parallel Trends Sensitive to Functional Form?," Econometrica, Econometric Society, vol. 91(2), pages 737-747, March.
    9. Raiden Hasegawa & Dylan Small, 2017. "Sensitivity analysis for matched pair analysis of binary data: From worst case to average case analysis," Biometrics, The International Biometric Society, vol. 73(4), pages 1424-1432, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    2. Gregory Faletto, 2023. "Fused Extended Two-Way Fixed Effects for Difference-in-Differences With Staggered Adoptions," Papers 2312.05985, arXiv.org, revised Apr 2025.
    3. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.
    4. Elena Kotyrlo, 2024. "Simple and complex difference-in-differences approach," Applied Econometrics, Russian Academy of National Economy and Public Administration (RANEPA), vol. 73, pages 119-142.
    5. Ratzanyel Rinc'on & Kyungchul Song, 2025. "Causal Inference with Groupwise Matching," Papers 2510.26106, arXiv.org, revised Mar 2026.
    6. Kyunghoon Ban & D'esir'e K'edagni, 2022. "Robust Difference-in-differences Models," Papers 2211.06710, arXiv.org, revised Aug 2023.
    7. Clément de Chaisemartin & Xavier D’Haultfœuille, 2023. "Two-way fixed effects and differences-in-differences with heterogeneous treatment effects: a survey," The Econometrics Journal, Royal Economic Society, vol. 26(3), pages 1-30.
    8. Jonathan Roth & Pedro H. C. Sant’Anna, 2023. "Efficient Estimation for Staggered Rollout Designs," Journal of Political Economy Microeconomics, University of Chicago Press, vol. 1(4), pages 669-709.
    9. Young Ahn & Hiroyuki Kasahara, 2026. "Event-Study Designs for Discrete Outcomes with Latent Transition Heterogeneity," Papers 2603.07914, arXiv.org, revised Sep 2026.
    10. Jinghao Sun & Eric J. Tchetgen Tchetgen, 2025. "On a Debiased and Semiparametric Efficient Changes-in-Changes Estimator," Papers 2507.07228, arXiv.org, revised Aug 2025.
    11. Wang, Yimin, 2025. "Links between COVID-19 lockdowns and drug overdose deaths, evidence from panel data," Economics & Human Biology, Elsevier, vol. 58(C).
    12. Nieyan Cheng & Wendong Zhang & Tao Xiong, 2025. "Heterogenous impact of China's place‐based environmental regulations on its hog industry: A synthetic difference‐in‐differences approach," Canadian Journal of Agricultural Economics/Revue canadienne d'agroeconomie, Canadian Agricultural Economics Society/Societe canadienne d'agroeconomie, vol. 73(2), pages 203-223, June.
    13. Yechan Park & Yuya Sasaki, 2024. "Matching $\leq$ Hybrid $\leq$ Difference in Differences," Papers 2411.07952, arXiv.org, revised Feb 2025.
    14. Kaleb Abreha & Raymond Robertson, 2025. "Revisiting the Effects of Regional Trade Agreements Using Staggered Adoption Design," Atlantic Economic Journal, Springer;International Atlantic Economic Society, vol. 53(3), pages 113-124, September.
    15. Craig S Wright, 2026. "Design-Robust Event-Study Estimation under Staggered Adoption Diagnostics, Sensitivity, and Orthogonalisation," Papers 2601.18801, arXiv.org.
    16. Dunbar, Kwamie & Treku, Daniel & Sarnie, Robert & Hoover, Jack, 2023. "What does ESG risk premia tell us about mutual fund sustainability levels: A difference-in-differences analysis," Finance Research Letters, Elsevier, vol. 57(C).
    17. Ashesh Rambachan & Jonathan Roth, 2026. "Design-Based Uncertainty for Quasi-Experiments," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 121(553), pages 477-491, January.
    18. Ben Deaner & Chen-Wei Hsiang & Andrei Zeleneev, 2025. "Simple Specification-Free Causal Inference in Large Panels," Papers 2503.20769, arXiv.org, revised Sep 2026.
    19. Dong, Zhanyu & Cai, Jiayi & Li, Xuchao & Luan, Mengna, 2025. "Firm-level impacts and recovery dynamics following a public health crisis: Lessons from China’s SARS experience," Journal of Asian Economics, Elsevier, vol. 98(C).
    20. Doshi, Gaurav, 2026. "Chicken and egg: Electricity transmission and investment in renewable energy," Journal of Public Economics, Elsevier, vol. 256(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2609.19081. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.