IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2302.11505.html
   My bibliography  Save this paper

Decomposition and Interpretation of Treatment Effects in Settings with Delayed Outcomes

Author

Listed:
  • Federico A. Bugni
  • Ivan A. Canay
  • Steve McBride

Abstract

This paper studies settings where the analyst is interested in identifying and estimating the average causal effect of a binary treatment on an outcome. We consider a setup in which the outcome realization does not get immediately realized after the treatment assignment, a feature that is ubiquitous in empirical settings. The period between the treatment and the realization of the outcome allows other observed actions to occur and affect the outcome. In this context, we study several regression-based estimands routinely used in empirical work to capture the average treatment effect and shed light on interpreting them in terms of ceteris paribus effects, indirect causal effects, and selection terms. We obtain three main and related takeaways. First, the three most popular estimands do not generally satisfy what we call \emph{strong sign preservation}, in the sense that these estimands may be negative even when the treatment positively affects the outcome conditional on any possible combination of other actions. Second, the most popular regression that includes the other actions as controls satisfies strong sign preservation \emph{if and only if} these actions are mutually exclusive binary variables. Finally, we show that a linear regression that fully stratifies the other actions leads to estimands that satisfy strong sign preservation.

Suggested Citation

  • Federico A. Bugni & Ivan A. Canay & Steve McBride, 2023. "Decomposition and Interpretation of Treatment Effects in Settings with Delayed Outcomes," Papers 2302.11505, arXiv.org, revised Oct 2023.
  • Handle: RePEc:arx:papers:2302.11505
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2302.11505
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lori Beaman & Dean Karlan & Bram Thuysbaert & Christopher Udry, 2013. "Profitability of Fertilizer: Experimental Evidence from Female Rice Farmers in Mali," American Economic Review, American Economic Association, vol. 103(3), pages 381-386, May.
    2. Adam N. Glynn, 2012. "The Product and Difference Fallacies for Indirect Effects," American Journal of Political Science, John Wiley & Sons, vol. 56(1), pages 257-269, January.
    3. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    4. Federico A. Bugni & Ivan A. Canay & Azeem M. Shaikh, 2018. "Inference Under Covariate-Adaptive Randomization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(524), pages 1784-1796, October.
    5. Beaman, Lori & Karlan, Dean & Thuysbaert, Bram & Udry, Christopher, 2013. "Probability of Fertilizer: Experimental Evidence from Female Rice Farmers in Mali," Working Papers 111, Yale University, Department of Economics.
    6. Suresh de Mel & David McKenzie & Christopher Woodruff, 2009. "Returns to Capital in Microenterprises: Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(1), pages 423-423.
    7. James Heckman & Rodrigo Pinto & Peter Savelyev, 2013. "Understanding the Mechanisms through Which an Influential Early Childhood Program Boosted Adult Outcomes," American Economic Review, American Economic Association, vol. 103(6), pages 2052-2086, October.
    8. Kirill Borusyak & Xavier Jaravel & Jann Spiess, 2021. "Revisiting Event Study Designs: Robust and Efficient Estimation," Papers 2108.12419, arXiv.org, revised Jan 2024.
    9. Paul Goldsmith-Pinkham & Peter Hull & Michal Koles'ar, 2021. "Contamination Bias in Linear Regressions," Papers 2106.05024, arXiv.org, revised Feb 2024.
    10. Federico A. Bugni & Ivan A. Canay & Azeem M. Shaikh, 2019. "Inference under covariate‐adaptive randomization with multiple treatments," Quantitative Economics, Econometric Society, vol. 10(4), pages 1747-1785, November.
    11. Andreas Fagereng & Magne Mogstad & Marte Rønning, 2021. "Why Do Wealthy Parents Have Wealthy Children?," Journal of Political Economy, University of Chicago Press, vol. 129(3), pages 703-756.
    12. Chernozhukov, Victor & Kasahara, Hiroyuki & Schrimpf, Paul, 2021. "Causal impact of masks, policies, behavior on early covid-19 pandemic in the U.S," Journal of Econometrics, Elsevier, vol. 220(1), pages 23-62.
    13. James J. Heckman, 2000. "Causal Parameters and Policy Analysis in Economics: A Twentieth Century Retrospective," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(1), pages 45-97.
    14. Esther Duflo & Michael Kremer & Jonathan Robinson, 2011. "Nudging Farmers to Use Fertilizer: Theory and Experimental Evidence from Kenya," American Economic Review, American Economic Association, vol. 101(6), pages 2350-2390, October.
    15. Athey, Susan & Imbens, Guido W., 2022. "Design-based analysis in Difference-In-Differences settings with staggered adoption," Journal of Econometrics, Elsevier, vol. 226(1), pages 62-79.
    16. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    17. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    18. Anqi Zhao & Peng Ding, 2022. "Regression-based causal inference with factorial experiments: estimands, model specifications and design-based properties [Are Emily and Greg more employable than Lakisha and Jamal? A field experim," Biometrika, Biometrika Trust, vol. 109(3), pages 799-815.
    19. Suresh de Mel & David McKenzie & Christopher Woodruff, 2009. "Returns to Capital in Microenterprises: Evidence from a Field Experiment," The Quarterly Journal of Economics, Oxford University Press, vol. 124(1), pages 423-423.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cl'ement de Chaisemartin & Xavier D'Haultf{oe}uille, 2021. "Two-Way Fixed Effects and Differences-in-Differences with Heterogeneous Treatment Effects: A Survey," Papers 2112.04565, arXiv.org, revised Jun 2022.
    2. Alexander Karaivanov & Dongwoo Kim & Shih En Lu & Hitoshi Shigeoka, 2022. "COVID-19 vaccination mandates and vaccine uptake," Nature Human Behaviour, Nature, vol. 6(12), pages 1615-1624, December.
    3. Clément de Chaisemartin & Xavier D’Haultfœuille, 2023. "Two-way fixed effects and differences-in-differences with heterogeneous treatment effects: a survey," The Econometrics Journal, Royal Economic Society, vol. 26(3), pages 1-30.
    4. Rik Chakraborti & Gavin Roberts, 2023. "How price-gouging regulation undermined COVID-19 mitigation: county-level evidence of unintended consequences," Public Choice, Springer, vol. 196(1), pages 51-83, July.
    5. Miquel Oliu-Barton & Bary S. R. Pradelski & Nicolas Woloszko & Lionel Guetta-Jeanrenaud & Philippe Aghion & Patrick Artus & Arnaud Fontanet & Philippe Martin & Guntram B. Wolff, 2022. "The effect of COVID certificates on vaccine uptake, health outcomes, and the economy," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    6. Kayaoglu, Aysegul, 2022. "Do refugees cause crime?," World Development, Elsevier, vol. 154(C).
    7. Jean-Victor Alipour & Lindlacher Valentin, 2022. "No Surprises, Please: Voting Costs and Electoral Turnout," CESifo Working Paper Series 9759, CESifo.
    8. Peter Hull & Michal Kolesár & Christopher Walters, 2022. "Labor by design: contributions of David Card, Joshua Angrist, and Guido Imbens," Scandinavian Journal of Economics, Wiley Blackwell, vol. 124(3), pages 603-645, July.
    9. Paul Bingley & Lorenzo Cappellari & Marco Ovidi, 2023. "When it hurts the most: timing of parental job loss and a child’s education," LISER Working Paper Series 2023-12, Luxembourg Institute of Socio-Economic Research (LISER).
    10. Miguel Acosta & Andreas I. Mueller & Emi Nakamura & Jón Steinsson, 2023. "Macroeconomic Effects of UI Extensions at Short and Long Durations," NBER Working Papers 31784, National Bureau of Economic Research, Inc.
    11. Cl'ement de Chaisemartin & Xavier D'Haultfoeuille & F'elix Pasquier & Gonzalo Vazquez-Bare, 2022. "Difference-in-Differences Estimators for Treatments Continuously Distributed at Every Period," Papers 2201.06898, arXiv.org, revised Dec 2023.
    12. Ahn, Soojung & Steinbach, Sandro, 2022. "COVID-19 Trade Actions and Their Impact on the Agricultural and Food Sector," 2023 Allied Social Sciences Association (ASSA) Annual Meeting, January 6-8, 2023, New Orleans, Louisiana 316789, Agricultural and Applied Economics Association.
    13. OKUDAIRA Hiroko & TAKIZAWA Miho & YAMANOUCHI Kenta, 2022. "Does Employee Downsizing Work? Evidence from Product Innovation at Manufacturing Plants," Discussion papers 22015, Research Institute of Economy, Trade and Industry (RIETI).
    14. Luca Coraggio & Marco Pagano & Annalisa Scognamiglio & Joacim Tåg, 2022. "JAQ of All Trades: Job Mismatch, Firm Productivity and Managerial Quality," EIEF Working Papers Series 2205, Einaudi Institute for Economics and Finance (EIEF), revised Mar 2022.
    15. Mingxia Shi & Yibo Wang, 2023. "Do Green Transfer Payments Contribute to Carbon Emission Reduction?," Sustainability, MDPI, vol. 15(5), pages 1-18, February.
    16. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    17. Timo Schenk, 2023. "Time-Weighted Difference-in-Differences: Accounting for Common Factors in Short T Panels," Tinbergen Institute Discussion Papers 23-004/III, Tinbergen Institute.
    18. Mantovani, Andrea & Reggiani, Carlo & Broocks, Annette & Duch-Brown, Nestor & Ma, Peiyao, 2022. "The Price Effects of Banning Price Parity Clauses in the EU: Evidence from International Hotel Groups," TSE Working Papers 22-1371, Toulouse School of Economics (TSE).
    19. Joop Age Harm Adema & Cevat Giray Aksoy & Panu Poutvaara, 2021. "Mobile Internet Access and the Desire to Emigrate," ifo Working Paper Series 365, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    20. Elisa Facchetti & Lorenzo Neri & Marco Ovidi, 2021. "Should you Meet The Parents? The impact of information on non-test score attributes on school choice," DISCE - Working Papers del Dipartimento di Economia e Finanza def113, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2302.11505. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.