IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2309.05639.html

Forecasted Treatment Effects

Author

Listed:
  • Irene Botosaru
  • Raffaella Giacomini
  • Martin Weidner

Abstract

We consider estimation and inference of the effects of a policy in the absence of an untreated or control group. We obtain unbiased estimators of individual (heterogeneous) treatment effects and a consistent and asymptotically normal estimator of the average treatment effect. Our estimator averages, across individuals, the difference between observed post-treatment outcomes and unbiased forecasts of their counterfactuals, based on a (short) time series of pre-treatment data. The paper emphasizes the importance of focusing on forecast unbiasedness rather than accuracy when the end goal is estimation of average treatment effects. We show that simple basis function regressions ensure forecast unbiasedness for a broad class of data generating processes for the counterfactuals. In contrast, forecasting based on a specific parametric model requires stronger assumptions and is prone to misspecification and estimation bias. We show that our method can replicate the findings of some previous empirical studies but it does so without using an untreated or control group.

Suggested Citation

  • Irene Botosaru & Raffaella Giacomini & Martin Weidner, 2023. "Forecasted Treatment Effects," Papers 2309.05639, arXiv.org, revised Jan 2026.
  • Handle: RePEc:arx:papers:2309.05639
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2309.05639
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Brown, Stephen J. & Warner, Jerold B., 1985. "Using daily stock returns : The case of event studies," Journal of Financial Economics, Elsevier, vol. 14(1), pages 3-31, March.
    2. Katherine Baicker & Theodore Svoronos, 2019. "Testing the Validity of the Single Interrupted Time Series Design," NBER Working Papers 26080, National Bureau of Economic Research, Inc.
    3. Dufour, Jean-Marie, 1984. "Unbiasedness of Predictions from Estimated Autoregressions When the True Order Is Unknown," Econometrica, Econometric Society, vol. 52(1), pages 209-215, January.
    4. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    5. Thomas Cornelissen & Christian Dustmann & Anna Raute & Uta Schönberg, 2018. "Who Benefits from Universal Child Care? Estimating Marginal Returns to Early Child Care Attendance," Journal of Political Economy, University of Chicago Press, vol. 126(6), pages 2356-2409.
    6. Gallego, Francisco & Montero, Juan-Pablo & Salas, Christian, 2013. "The effect of transport policies on car use: A bundling model with applications," Energy Economics, Elsevier, vol. 40(S1), pages 85-97.
    7. Yihsu Chen & Alexander Whalley, 2012. "Green Infrastructure: The Effects of Urban Rail Transit on Air Quality," American Economic Journal: Economic Policy, American Economic Association, vol. 4(1), pages 58-97, February.
    8. Hugo Freeman & Martin Weidner, 2021. "Low-rank approximations of nonseparable panel models," The Econometrics Journal, Royal Economic Society, vol. 24(2), pages 40-77.
    9. Aguilar, Arturo & Gutierrez, Emilio & Seira, Enrique, 2021. "The effectiveness of sin food taxes: Evidence from Mexico," Journal of Health Economics, Elsevier, vol. 77(C).
    10. Philip Marx & Elie Tamer & Xun Tang, 2022. "Parallel Trends and Dynamic Choices," Papers 2207.06564, arXiv.org, revised Aug 2023.
    11. Li, Pei & Lu, Yi & Wang, Jin, 2020. "The effects of fuel standards on air pollution: Evidence from China," Journal of Development Economics, Elsevier, vol. 146(C).
    12. Susan Athey & Mohsen Bayati & Nikolay Doudchenko & Guido Imbens & Khashayar Khosravi, 2021. "Matrix Completion Methods for Causal Panel Data Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1716-1730, October.
    13. Laura Liu & Hyungsik Roger Moon & Frank Schorfheide, 2020. "Forecasting With Dynamic Panel Data Models," Econometrica, Econometric Society, vol. 88(1), pages 171-201, January.
    14. Marc K. Chan & Simon S. Kwok, 2022. "The PCDID Approach: Difference-in-Differences When Trends Are Potentially Unparallel and Stochastic," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1216-1233, June.
    15. Richard Blundell & Monica Costa Dias & Costas Meghir & John Van Reenen, 2004. "Evaluating the Employment Impact of a Mandatory Job Search Program," Journal of the European Economic Association, MIT Press, vol. 2(4), pages 569-606, June.
    16. Watson, Mark W., 1986. "Univariate detrending methods with stochastic trends," Journal of Monetary Economics, Elsevier, vol. 18(1), pages 49-75, July.
    17. Matias D. Cattaneo & Luke Keele & Rocio Titiunik, 2021. "Covariate Adjustment in Regression Discontinuity Designs," Papers 2110.08410, arXiv.org, revised Aug 2022.
    18. Fuller, Wayne A. & Hasza, David P., 1980. "Predictors for the first-order autoregressive process," Journal of Econometrics, Elsevier, vol. 13(2), pages 139-157, June.
    19. Jushan Bai & Serena Ng, 2021. "Matrix Completion, Counterfactuals, and Factor Analysis of Missing Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(536), pages 1746-1763, October.
    20. Daniel Trefler, 2004. "The Long and Short of the Canada-U. S. Free Trade Agreement," American Economic Review, American Economic Association, vol. 94(4), pages 870-895, September.
    21. Tymon S{l}oczy'nski, 2018. "Interpreting OLS Estimands When Treatment Effects Are Heterogeneous: Smaller Groups Get Larger Weights," Papers 1810.01576, arXiv.org, revised May 2020.
    22. Alberto Abadie, 2021. "Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 391-425, June.
    23. Michael Baker & Jonathan Gruber & Kevin Milligan, 2008. "Universal Child Care, Maternal Labor Supply, and Family Well-Being," Journal of Political Economy, University of Chicago Press, vol. 116(4), pages 709-745, August.
    24. Ashenfelter, Orley & Card, David, 1985. "Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs," The Review of Economics and Statistics, MIT Press, vol. 67(4), pages 648-660, November.
    25. Victor Chernozhukov & Iván Fernández‐Val & Jinyong Hahn & Whitney Newey, 2013. "Average and Quantile Effects in Nonseparable Panel Models," Econometrica, Econometric Society, vol. 81(2), pages 535-580, March.
    26. Baker, Andrew C. & Larcker, David F. & Wang, Charles C.Y., 2022. "How much should we trust staggered difference-in-differences estimates?," Journal of Financial Economics, Elsevier, vol. 144(2), pages 370-395.
    27. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    28. Peter Kuhn & Kailing Shen, 2023. "What Happens When Employers Can No Longer Discriminate in Job Ads?," American Economic Review, American Economic Association, vol. 113(4), pages 1013-1048, April.
    29. Kitagawa, Toru & Muris, Chris, 2016. "Model averaging in semiparametric estimation of treatment effects," Journal of Econometrics, Elsevier, vol. 193(1), pages 271-289.
    30. Joshua D. Angrist & Jörn-Steffen Pischke, 2009. "Mostly Harmless Econometrics: An Empiricist's Companion," Economics Books, Princeton University Press, edition 1, number 8769, December.
    31. Doruk Cengiz & Arindrajit Dube & Attila Lindner & Ben Zipperer, 2019. "The Effect of Minimum Wages on Low-Wage Jobs," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1405-1454.
    32. Katherine Baicker & Theodore Svoronos, 2019. "Testing the Validity of the Single Interrupted Time Series Design," CID Working Papers 364, Center for International Development at Harvard University.
    33. Mavroeidis, Sophocles & Sasaki, Yuya & Welch, Ivo, 2015. "Estimation of heterogeneous autoregressive parameters with short panel data," Journal of Econometrics, Elsevier, vol. 188(1), pages 219-235.
    34. Luke W. Miratrix, 2022. "Using Simulation to Analyze Interrupted Time Series Designs," Evaluation Review, , vol. 46(6), pages 750-778, December.
    35. Hal R. Varian, 2014. "Big Data: New Tricks for Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 3-28, Spring.
    36. A. Craig MacKinlay, 1997. "Event Studies in Economics and Finance," Journal of Economic Literature, American Economic Association, vol. 35(1), pages 13-39, March.
    37. Xu, Yiqing, 2017. "Generalized Synthetic Control Method: Causal Inference with Interactive Fixed Effects Models," Political Analysis, Cambridge University Press, vol. 25(1), pages 57-76, January.
    38. Dalia Ghanem & Pedro H. C. Sant'Anna & Kaspar Wuthrich, 2022. "Selection and parallel trends," Papers 2203.09001, arXiv.org, revised Jul 2026.
    39. Tu, Meng & Zhang, Bing & Xu, Jianhua & Lu, Fangwen, 2020. "Mass media, information and demand for environmental quality: Evidence from the “Under the Dome”," Journal of Development Economics, Elsevier, vol. 143(C).
    40. Jeffrey M. Wooldridge, 2005. "Fixed-Effects and Related Estimators for Correlated Random-Coefficient and Treatment-Effect Panel Data Models," The Review of Economics and Statistics, MIT Press, vol. 87(2), pages 385-390, May.
    41. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    42. Chelsea L. Shover & Corey S. Davis & Sanford C. Gordon & Keith Humphreys, 2019. "Association between medical cannabis laws and opioid overdose mortality has reversed over time," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 116(26), pages 12624-12626, June.
    43. Gallego, Francisco & Montero, Juan-Pablo & Salas, Christian, 2013. "The effect of transport policies on car use: Evidence from Latin American cities," Journal of Public Economics, Elsevier, vol. 107(C), pages 47-62.
    44. Rahi Abouk & Scott Adams, 2013. "Texting Bans and Fatal Accidents on Roadways: Do They Work? Or Do Drivers Just React to Announcements of Bans?," American Economic Journal: Applied Economics, American Economic Association, vol. 5(2), pages 179-199, April.
    45. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    46. Dinas, Elias & Matakos, Konstantinos & Xefteris, Dimitrios & Hangartner, Dominik, 2019. "Waking Up the Golden Dawn: Does Exposure to the Refugee Crisis Increase Support for Extreme-Right Parties?," Political Analysis, Cambridge University Press, vol. 27(2), pages 244-254, April.
    47. Nelson, Charles R. & Plosser, Charles I., 1982. "Trends and random walks in macroeconmic time series : Some evidence and implications," Journal of Monetary Economics, Elsevier, vol. 10(2), pages 139-162.
    48. Catherine Hausman & David S. Rapson, 2018. "Regression Discontinuity in Time: Considerations for Empirical Applications," Annual Review of Resource Economics, Annual Reviews, vol. 10(1), pages 533-552, October.
    49. Kosuke Imai & In Song Kim, 2019. "When Should We Use Unit Fixed Effects Regression Models for Causal Inference with Longitudinal Data?," American Journal of Political Science, John Wiley & Sons, vol. 63(2), pages 467-490, April.
    50. Matias D. Cattaneo & Rocío Titiunik, 2022. "Regression Discontinuity Designs," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 821-851, August.
    51. Òscar Jordà & Alan M. Taylor, 2016. "The Time for Austerity: Estimating the Average Treatment Effect of Fiscal Policy," Economic Journal, Royal Economic Society, vol. 126(590), pages 219-255, February.
    52. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    53. Andrew Gelman & Guido Imbens, 2019. "Why High-Order Polynomials Should Not Be Used in Regression Discontinuity Designs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 447-456, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gadea Rivas, María Dolores & Gonzalo, Jesús, 2025. "Global and regional long-term climate forecasts: a heterogeneous future," UC3M Working papers. Economics 45946, Universidad Carlos III de Madrid. Departamento de Economía.
    2. Philipp Weber & Laura A. Zell & Lars P. Feld & Christoph A. Schaltegger, 2024. "Functionality of Fiscal Rules in a Low Interest Rate Environment – New Empirical Results for Swiss Cantons," CESifo Working Paper Series 11351, CESifo.
    3. Dubé, Jean & Le Gallo, Julie & Des Rosiers, François & Legros, Diègo & Champagne, Marie-Pier, 2024. "An integrated causal framework to evaluate uplift value with an example on change in public transport supply," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 185(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arne Henningsen & Guy Low & David Wuepper & Tobias Dalhaus & Hugo Storm & Dagim Belay & Stefan Hirsch, 2026. "Estimating Causal Effects With Observational Data: Guidelines for Agricultural and Applied Economists," Journal of Agricultural Economics, Wiley Blackwell, vol. 77(2), pages 356-382, June.
    2. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    3. Ruei-Chi Lee, 2026. "Average Treatment Effect Localization: Projection Methods in Synthetic Control," Papers 2609.10617, arXiv.org.
    4. Anish Agarwal & Sukjin Han & Dwaipayan Saha & Vasilis Syrgkanis & Haeyeon Yoon, 2026. "Synthetic Blips: Generalizing Synthetic Controls for Dynamic Treatment Effects," Bristol Economics Discussion Papers 26/834, School of Economics, University of Bristol, UK.
    5. Gulzar, Saad & Ladino, Juan Felipe & Mehmood, Muhammad Zia & Rogger, Daniel, 2025. "Command and Can’t Control : Assessing Centralized Accountability in the Public Sector," Policy Research Working Paper Series 11200, The World Bank.
    6. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Jun 2024.
    7. Luya Wang & Jeffrey S. Racine & Qiaoyu Wang, 2025. "Bootstrap inference on a factor model based average treatment effects estimator," Econometric Reviews, Taylor & Francis Journals, vol. 44(1), pages 80-89, January.
    8. Dalia Ghanem & Pedro H. C. Sant'Anna & Kaspar Wüthrich, 2022. "Selection and Parallel Trends," CESifo Working Paper Series 9910, CESifo.
    9. Brown, Nicholas L. & Butts, Kyle, 2025. "Dynamic treatment effect estimation with interactive fixed effects and short panels," Journal of Econometrics, Elsevier, vol. 250(C).
    10. Peter Z. Schochet, 2021. "Statistical Power for Estimating Treatment Effects Using Difference-in-Differences and Comparative Interrupted Time Series Designs with Variation in Treatment Timing," Papers 2102.06770, arXiv.org, revised Oct 2021.
    11. Wright, Nicholas A. & Dorilas, Ernest, 2022. "Do Cellphone Bans Save Lives? Evidence From Handheld Laws on Traffic Fatalities," Journal of Health Economics, Elsevier, vol. 85(C).
    12. Wu, Libo & Zhou, Yang, 2025. "Social norms and energy conservation in China," Resource and Energy Economics, Elsevier, vol. 82(C).
    13. Ben Deaner & Chen-Wei Hsiang & Andrei Zeleneev, 2025. "Simple Specification-Free Causal Inference in Large Panels," Papers 2503.20769, arXiv.org, revised Sep 2026.
    14. Brantly Callaway & Derek Dyal & Pedro H. C. Sant'Anna & Emmanuel S. Tsyawo, 2025. "Beyond Parallel Trends: An Identification-Strategy-Robust Approach to Causal Inference with Panel Data," Papers 2511.21977, arXiv.org.
    15. Li, Pei & Liu, Kaihao & Lu, Yi & Peng, Lu, 2025. "Organizing regulatory structure and local air quality: Evidence from the environmental vertical management reform in China," Journal of Comparative Economics, Elsevier, vol. 53(1), pages 139-164.
    16. Zhu, Junjie & Guo, Hongfeng, 2025. "Does the development of high-speed rail benefit carbon emissions reduction?," Transport Policy, Elsevier, vol. 172(C).
    17. Melnik, Walter & Smyth, Andrew, 2024. "R&D tax credits and innovation," Journal of Public Economics, Elsevier, vol. 236(C).
    18. Zou, Tao & Li, Shasha & Dai, Yixin, 2025. "Does the pilot free trade zone promote “quality improvement and quantity increase” of the city’s export trade?," Economic Analysis and Policy, Elsevier, vol. 87(C), pages 1323-1341.
    19. Pfeifer, Gregor & Stockburger, Mirjam, 2023. "The morning after: Prescription-free access to emergency contraceptive pills," Journal of Health Economics, Elsevier, vol. 91(C).
    20. Gregory Faletto, 2023. "Fused Extended Two-Way Fixed Effects for Difference-in-Differences With Staggered Adoptions," Papers 2312.05985, arXiv.org, revised Apr 2025.

    More about this item

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2309.05639. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.