IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2302.11505.html

Decomposition and Interpretation of Treatment Effects in Settings with Delayed Outcomes

Author

Listed:
  • Federico A. Bugni
  • Ivan A. Canay
  • Steve McBride

Abstract

This paper studies settings where the analyst is interested in identifying and estimating the average \emph{direct} causal effect of a binary treatment on an outcome. We consider a setup in which the outcome realization does not get immediately realized after the treatment assignment, a feature that is ubiquitous in empirical settings. The period between the treatment and the realization of the outcome allows other observed actions to occur and affect the outcome. In this context, we study several regression-based estimands routinely used in empirical work to capture the average treatment effect and shed light on interpreting them in terms of ceteris paribus effects, indirect causal effects, and selection terms. We obtain three main and related takeaways under a common set of assumptions. First, the three most popular estimands do not generally satisfy what we call \emph{strong sign preservation}, in the sense that these estimands may be negative even when the treatment positively affects the outcome conditional on any possible combination of other actions. Second, the most popular regression that includes the other actions as controls satisfies strong sign preservation \emph{if and only if} these actions are mutually exclusive binary variables. Finally, we show that a linear regression that fully stratifies the other actions leads to estimands that satisfy strong sign preservation.

Suggested Citation

  • Federico A. Bugni & Ivan A. Canay & Steve McBride, 2023. "Decomposition and Interpretation of Treatment Effects in Settings with Delayed Outcomes," Papers 2302.11505, arXiv.org, revised Jul 2025.
  • Handle: RePEc:arx:papers:2302.11505
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2302.11505
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Esther Duflo & Michael Kremer & Jonathan Robinson, 2011. "Nudging Farmers to Use Fertilizer: Theory and Experimental Evidence from Kenya," American Economic Review, American Economic Association, vol. 101(6), pages 2350-2390, October.
    2. Lori Beaman & Dean Karlan & Bram Thuysbaert & Christopher Udry, 2013. "Profitability of Fertilizer: Experimental Evidence from Female Rice Farmers in Mali," American Economic Review, American Economic Association, vol. 103(3), pages 381-386, May.
    3. Adam N. Glynn, 2012. "The Product and Difference Fallacies for Indirect Effects," American Journal of Political Science, John Wiley & Sons, vol. 56(1), pages 257-269, January.
    4. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    5. Kirill Borusyak & Xavier Jaravel & Jann Spiess, 2024. "Revisiting Event-Study Designs: Robust and Efficient Estimation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(6), pages 3253-3285.
    6. Paul Goldsmith-Pinkham & Peter Hull & Michal Kolesár, 2024. "Contamination Bias in Linear Regressions," American Economic Review, American Economic Association, vol. 114(12), pages 4015-4051, December.
    7. Suresh de Mel & David McKenzie & Christopher Woodruff, 2009. "Returns to Capital in Microenterprises: Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(1), pages 423-423.
    8. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    9. Federico A. Bugni & Ivan A. Canay & Azeem M. Shaikh, 2019. "Inference under covariate‐adaptive randomization with multiple treatments," Quantitative Economics, Econometric Society, vol. 10(4), pages 1747-1785, November.
    10. Federico A. Bugni & Ivan A. Canay & Azeem M. Shaikh, 2018. "Inference Under Covariate-Adaptive Randomization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(524), pages 1784-1796, October.
    11. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    12. Andreas Fagereng & Magne Mogstad & Marte Rønning, 2021. "Why Do Wealthy Parents Have Wealthy Children?," Journal of Political Economy, University of Chicago Press, vol. 129(3), pages 703-756.
    13. Anqi Zhao & Peng Ding, 2022. "Regression-based causal inference with factorial experiments: estimands, model specifications and design-based properties [Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination]," Biometrika, Biometrika Trust, vol. 109(3), pages 799-815.
    14. James J. Heckman, 2000. "Causal Parameters and Policy Analysis in Economics: A Twentieth Century Retrospective," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(1), pages 45-97.
    15. Chernozhukov, Victor & Kasahara, Hiroyuki & Schrimpf, Paul, 2021. "Causal impact of masks, policies, behavior on early covid-19 pandemic in the U.S," Journal of Econometrics, Elsevier, vol. 220(1), pages 23-62.
    16. Suresh de Mel & David McKenzie & Christopher Woodruff, 2009. "Returns to Capital in Microenterprises: Evidence from a Field Experiment," The Quarterly Journal of Economics, Oxford University Press, vol. 124(1), pages 423-423.
    17. Beaman, Lori & Karlan, Dean & Thuysbaert, Bram & Udry, Christopher, 2013. "Probability of Fertilizer: Experimental Evidence from Female Rice Farmers in Mali," Working Papers 111, Yale University, Department of Economics.
    18. Athey, Susan & Imbens, Guido W., 2022. "Design-based analysis in Difference-In-Differences settings with staggered adoption," Journal of Econometrics, Elsevier, vol. 226(1), pages 62-79.
    19. James Heckman & Rodrigo Pinto & Peter Savelyev, 2013. "Understanding the Mechanisms through Which an Influential Early Childhood Program Boosted Adult Outcomes," American Economic Review, American Economic Association, vol. 103(6), pages 2052-2086, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. De Lucio, Juan & Mínguez, Raúl & Minondo, Asier & Requena, Francisco, 2026. "Export Scarring After a Trade Ban: A Quasi-natural Experiment from the Algerian Embargo," Working Papers 2603, Department of Applied Economics II, Universidad de Valencia.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bugni, Federico A. & Canay, Ivan A. & McBride, Steve, 2026. "Decomposition and interpretation of treatment effects in settings with delayed outcomes," Journal of Econometrics, Elsevier, vol. 253(C).
    2. Vod Vilfort, 2026. "Robust Inference for Weighted Estimands," Papers 2607.07524, arXiv.org, revised Aug 2026.
    3. Hahm, Dong Woo, 2026. "From curriculum to career: Early-career labor market effects of the Common Core," Economics of Education Review, Elsevier, vol. 110(C).
    4. Coraggio, Luca & Pagano, Marco & Scognamiglio, Annalisa & Tåg, Joacim, 2025. "JAQ of all trades: Job mismatch, firm productivity and managerial quality," Journal of Financial Economics, Elsevier, vol. 164(C).
    5. Heuer, Felix & Sommer, Stephan, 2026. "Distance and intensity effects of renewable energy on property prices: A hedonic price analysis for Germany," Energy Economics, Elsevier, vol. 158(C).
    6. Jaworski, Krystian & Olipra, Jakub, 2025. "Cutting VAT rate on food products in a high-inflation environment. Does it work out?," Food Policy, Elsevier, vol. 131(C).
    7. Alexander Karaivanov & Dongwoo Kim & Shih En Lu & Hitoshi Shigeoka, 2022. "COVID-19 vaccination mandates and vaccine uptake," Nature Human Behaviour, Nature, vol. 6(12), pages 1615-1624, December.
    8. Su, Liangjun & Wang, Fa & Wang, Yiren, 2026. "Estimation and inference for unbalanced panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 255(C).
    9. Kim, Yoonjung, 2025. "The effects of universal free lunch provision on student achievement: Evidence from South Korea," Journal of Economic Behavior & Organization, Elsevier, vol. 238(C).
    10. Alexander Cuntz & Alessio Muscarnera & Prince C. Oguguo, 2026. "Are the best tunes played on the oldest fiddles? Music copyright and distribution as technology changes," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 50(1), pages 159-194, March.
    11. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2026. "Estimating Causal Effects With Observational Data: Guidelines for Agricultural and Applied Economists," Journal of Agricultural Economics, Wiley Blackwell, vol. 77(2), pages 356-382, June.
    12. Tuzel, Elcin & Kwak, Do Won & Tang, Kam Ki, 2026. "Do maltreated children think of suicide more? Evidence from South Korea," Economics & Human Biology, Elsevier, vol. 61(C).
    13. Gregory Faletto, 2023. "Fused Extended Two-Way Fixed Effects for Difference-in-Differences With Staggered Adoptions," Papers 2312.05985, arXiv.org, revised Apr 2025.
    14. Zhang, Xufei & Fang, Hongsheng, 2026. "Digital tax administration and conglomerates capital structure adjustment driven by tax planning," China Economic Review, Elsevier, vol. 98(C).
    15. Yu, Yantuan & Zhang, Ning, 2025. "Towards low-carbon development through integration of technology and finance: Quasi-experimental evidence from China," Research in International Business and Finance, Elsevier, vol. 80(C).
    16. Fabre, Brice & Sangnier, Marc, 2025. "Where and why do politicians send pork? Evidence from central government transfers to French municipalities," Journal of Public Economics, Elsevier, vol. 241(C).
    17. Shanxia Sun & Michael S. Delgado, 2024. "Local spatial difference-in-differences models: treatment correlations, response interactions, and expanded local models," Empirical Economics, Springer, vol. 67(5), pages 2077-2107, November.
    18. Cao, Hong & Han, Liyan & Li, Lei & Yin, Libo & Yin, Peng, 2026. "The impact of low-carbon pilots policy on health," Journal of Comparative Economics, Elsevier, vol. 54(2), pages 578-597.
    19. Lin, Xin & Hui, Eddie Chi-man & Cong, Zhenglong & Shen, Jianfu, 2026. "Solving coordination failures: Collective land transfer rights and rural entrepreneurship," Journal of Development Economics, Elsevier, vol. 178(C).
    20. Schindler, Yannick & Scott, Andrew J., 2025. "The macroeconomic impact of chronic disease in the United Kingdom," LSE Research Online Documents on Economics 128627, London School of Economics and Political Science, LSE Library.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2302.11505. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.