IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v253y2026ics0304407625002131.html

Decomposition and interpretation of treatment effects in settings with delayed outcomes

Author

Listed:
  • Bugni, Federico A.
  • Canay, Ivan A.
  • McBride, Steve

Abstract

This paper studies settings where the analyst is interested in identifying and estimating the average direct causal effect of a binary treatment on an outcome. We consider a setup in which the outcome realization does not get immediately realized after the treatment assignment, a feature that is ubiquitous in empirical settings. The period between the treatment and the realization of the outcome allows other observed actions to occur and affect the outcome. In this context, we study several regression-based estimands routinely used in empirical work to capture the average treatment effect and shed light on interpreting them in terms of ceteris paribus effects, indirect causal effects, and selection terms. We obtain three main and related takeaways under a common set of assumptions. First, the three most popular estimands do not generally satisfy what we call strong sign preservation, in the sense that these estimands may be negative even when the treatment positively affects the outcome conditional on any possible combination of other actions. Second, the most popular regression that includes the other actions as controls satisfies strong sign preservation if and only if these actions are mutually exclusive binary variables. Finally, we show that a linear regression that fully stratifies the other actions leads to estimands that satisfy strong sign preservation.

Suggested Citation

  • Bugni, Federico A. & Canay, Ivan A. & McBride, Steve, 2026. "Decomposition and interpretation of treatment effects in settings with delayed outcomes," Journal of Econometrics, Elsevier, vol. 253(C).
  • Handle: RePEc:eee:econom:v:253:y:2026:i:c:s0304407625002131
    DOI: 10.1016/j.jeconom.2025.106160
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407625002131
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2025.106160?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Esther Duflo & Michael Kremer & Jonathan Robinson, 2011. "Nudging Farmers to Use Fertilizer: Theory and Experimental Evidence from Kenya," American Economic Review, American Economic Association, vol. 101(6), pages 2350-2390, October.
    2. Lori Beaman & Dean Karlan & Bram Thuysbaert & Christopher Udry, 2013. "Profitability of Fertilizer: Experimental Evidence from Female Rice Farmers in Mali," American Economic Review, American Economic Association, vol. 103(3), pages 381-386, May.
    3. Charles F. Manski, 1997. "Monotone Treatment Response," Econometrica, Econometric Society, vol. 65(6), pages 1311-1334, November.
    4. Adam N. Glynn, 2012. "The Product and Difference Fallacies for Indirect Effects," American Journal of Political Science, John Wiley & Sons, vol. 56(1), pages 257-269, January.
    5. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    6. Nathan Nunn, 2008. "The Long-term Effects of Africa's Slave Trades," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 123(1), pages 139-176.
    7. Paul Goldsmith-Pinkham & Peter Hull & Michal Kolesár, 2024. "Contamination Bias in Linear Regressions," American Economic Review, American Economic Association, vol. 114(12), pages 4015-4051, December.
    8. Suresh de Mel & David McKenzie & Christopher Woodruff, 2009. "Returns to Capital in Microenterprises: Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(1), pages 423-423.
    9. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    10. Hua Chen & Zhi Geng & Jinzhu Jia, 2007. "Criteria for surrogate end points," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(5), pages 919-932, November.
    11. Federico A. Bugni & Ivan A. Canay & Azeem M. Shaikh, 2019. "Inference under covariate‐adaptive randomization with multiple treatments," Quantitative Economics, Econometric Society, vol. 10(4), pages 1747-1785, November.
    12. Federico A. Bugni & Ivan A. Canay & Azeem M. Shaikh, 2018. "Inference Under Covariate-Adaptive Randomization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(524), pages 1784-1796, October.
    13. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    14. Andreas Fagereng & Magne Mogstad & Marte Rønning, 2021. "Why Do Wealthy Parents Have Wealthy Children?," Journal of Political Economy, University of Chicago Press, vol. 129(3), pages 703-756.
    15. Tyler J. VanderWeele, 2013. "Surrogate Measures and Consistent Surrogates," Biometrics, The International Biometric Society, vol. 69(3), pages 561-565, September.
    16. Anqi Zhao & Peng Ding, 2022. "Regression-based causal inference with factorial experiments: estimands, model specifications and design-based properties [Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination]," Biometrika, Biometrika Trust, vol. 109(3), pages 799-815.
    17. James J. Heckman, 2000. "Causal Parameters and Policy Analysis in Economics: A Twentieth Century Retrospective," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(1), pages 45-97.
    18. Chernozhukov, Victor & Kasahara, Hiroyuki & Schrimpf, Paul, 2021. "Causal impact of masks, policies, behavior on early covid-19 pandemic in the U.S," Journal of Econometrics, Elsevier, vol. 220(1), pages 23-62.
    19. Suresh de Mel & David McKenzie & Christopher Woodruff, 2009. "Returns to Capital in Microenterprises: Evidence from a Field Experiment," The Quarterly Journal of Economics, Oxford University Press, vol. 124(1), pages 423-423.
    20. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    21. Joshua D. Angrist, 1998. "Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants," Econometrica, Econometric Society, vol. 66(2), pages 249-288, March.
    22. Nico Voigtländer & Hans-Joachim Voth, 2012. "Persecution Perpetuated: The Medieval Origins of Anti-Semitic Violence in Nazi Germany," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1339-1392.
    23. James Heckman & Rodrigo Pinto & Peter Savelyev, 2013. "Understanding the Mechanisms through Which an Influential Early Childhood Program Boosted Adult Outcomes," American Economic Review, American Economic Association, vol. 103(6), pages 2052-2086, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Federico A. Bugni & Ivan A. Canay & Steve McBride, 2023. "Decomposition and Interpretation of Treatment Effects in Settings with Delayed Outcomes," Papers 2302.11505, arXiv.org, revised Jul 2025.
    2. Art=uras Juodis & Martin Weidner, 2026. "Factor-Augmented Panel Regressions and Variance-Weighted Treatment Effects," Papers 2604.18078, arXiv.org.
    3. Soonwoo Kwon & Liyang Sun, 2025. "Estimating Treatment Effects Under Bounded Heterogeneity," Papers 2510.05454, arXiv.org, revised Apr 2026.
    4. Bernardus Van Doornik & David Schoenherr & Janis Skrastins, 2025. "Escaping Death: individual mobility and female mortality," Working Papers Series 621, Central Bank of Brazil, Research Department.
    5. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    6. Alexander Karaivanov & Dongwoo Kim & Shih En Lu & Hitoshi Shigeoka, 2022. "COVID-19 vaccination mandates and vaccine uptake," Nature Human Behaviour, Nature, vol. 6(12), pages 1615-1624, December.
    7. Mogstad, Magne & Torgovitsky, Alexander, 2024. "Instrumental variables with unobserved heterogeneity in treatment effects," Handbook of Labor Economics,, Elsevier.
    8. Lin, Xin & Hui, Eddie Chi-man & Cong, Zhenglong & Shen, Jianfu, 2026. "Solving coordination failures: Collective land transfer rights and rural entrepreneurship," Journal of Development Economics, Elsevier, vol. 178(C).
    9. Bhuller, Manudeep & Sigstad, Henrik, 2024. "2SLS with multiple treatments," Journal of Econometrics, Elsevier, vol. 242(1).
    10. Van Doornik, Bernardus & Fazio, Dimas & Ramadorai, Tarun & Skrastiņš, JÄ nis, 2024. "Housing and Fertility," CEPR Discussion Papers 19805, Centre for Economic Policy Research.
    11. Jean-Baptiste Bonnier, 2024. "A Split-Treatment Design," Working Papers 2024-11, CRESE.
    12. Miquel Oliu-Barton & Bary S. R. Pradelski & Nicolas Woloszko & Lionel Guetta-Jeanrenaud & Philippe Aghion & Patrick Artus & Arnaud Fontanet & Philippe Martin & Guntram B. Wolff, 2022. "The effect of COVID certificates on vaccine uptake, health outcomes, and the economy," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    13. Mensah, Justice Tei & Wankuru, Peter Chacha & Kirui, Benard K., 2026. "Public procurement and firms: Evidence from Kenya," Journal of Development Economics, Elsevier, vol. 180(C).
    14. Mensah, Justice Tei & Wankuru, Peter Chacha & Kirui, Benard K., 2025. "Public Procurement and Firms : Evidence from Kenya," Policy Research Working Paper Series 11227, The World Bank.
    15. Callaway, Brantly & Li, Tong, 2023. "Policy evaluation during a pandemic," Journal of Econometrics, Elsevier, vol. 236(1).
    16. Bas Scheer & Wiljan van den Berge & Maarten Goos & Alan Manning & Anna Salomons, 2022. "Alternative Work Arrangements and Worker Outcomes: Evidence from Payrolling," CPB Discussion Paper 435, CPB Netherlands Bureau for Economic Policy Analysis.
    17. Mac Clay, Pablo & Börner, Jan & Sellare, Jorge, 2023. "Institutional and macroeconomic stability mediate the effect of auctions on renewable energy capacity," Energy Policy, Elsevier, vol. 180(C).
    18. Nadja van 't Hoff & Giovanni Mellace & Seetha Menon, 2025. "Gender Differences in Healthcare Utilisation -- Evidence from Unexpected Adverse Health Shocks," Papers 2509.01310, arXiv.org.
    19. Stefan Bauernschuster & Michael Grimm & Cathy M. Hajo, 2023. "The Impact of Margaret Sanger’s Birth Control Clinics on Early 20th Century U.S. Fertility and Mortality," CESifo Working Paper Series 10421, CESifo.
    20. Cocco, Valentin & Chakir, Raja & Mouysset, Lauriane, 2025. "Guilty or scapegoat? Land consolidation and hedgerow decline," Journal of Environmental Economics and Management, Elsevier, vol. 133(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:253:y:2026:i:c:s0304407625002131. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.