IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/17247.html
   My bibliography  Save this paper

Revisiting Event Study Designs: Robust and Efficient Estimation

Author

Listed:
  • Borusyak, Kirill
  • Jaravel, Xavier
  • Spiess, Jann

Abstract

We develop a framework for difference-in-differences designs with staggered treatment adoption and heterogeneous causal effects. We show that conventional regression-based estimators fail to provide unbiased estimates of relevant estimands absent strong restrictions on treatment-effect homogeneity. We then derive the efficient estimator addressing this challenge, which takes an intuitive “imputation†form when treatment-effect heterogeneity is unrestricted. We characterize the asymptotic behavior of the estimator, propose tools for inference, and develop tests for identifying assumptions. Extensions include time-varying controls, triple-differences, and certain non-binary treatments. We show the practical relevance of these insights in a simulation study and an application. Studying the consumption response to tax rebates in the United States, we find that the notional marginal propensity to consume is between 8 and 11 percent in the first quarter — about half as large as benchmark estimates used to calibrate macroeconomic models — and predominantly occurs in the first month after the rebate.

Suggested Citation

  • Borusyak, Kirill & Jaravel, Xavier & Spiess, Jann, 2022. "Revisiting Event Study Designs: Robust and Efficient Estimation," CEPR Discussion Papers 17247, C.E.P.R. Discussion Papers.
  • Handle: RePEc:cpr:ceprdp:17247
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP17247
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Patrick Bennett & Richard Blundell & Kjell G. Salvanes, 2020. "A second chance? Labor market returns to adult education using school reforms," IFS Working Papers W20/28, Institute for Fiscal Studies.
    2. Schmidheiny, Kurt & Siegloch, Sebastian, 2019. "On Event Study Designs and Distributed-Lag Models: Equivalence, Generalization and Practical Implications," IZA Discussion Papers 12079, Institute of Labor Economics (IZA).
    3. James H. Stock & Mark W. Watson, 2008. "Heteroskedasticity-Robust Standard Errors for Fixed Effects Panel Data Regression," Econometrica, Econometric Society, vol. 76(1), pages 155-174, January.
    4. Dmitry Arkhangelsky & Guido W. Imbens, 2019. "Doubly Robust Identification for Causal Panel Data Models," Papers 1909.09412, arXiv.org, revised Feb 2022.
    5. Mark Duggan & Craig Garthwaite & Aparajita Goyal, 2016. "The Market Impacts of Pharmaceutical Product Patents in Developing Countries: Evidence from India," American Economic Review, American Economic Association, vol. 106(1), pages 99-135, January.
    6. Laurent Gobillon & Thierry Magnac, 2016. "Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls," The Review of Economics and Statistics, MIT Press, vol. 98(3), pages 535-551, July.
    7. Jérôme Adda, 2016. "Economic Activity and the Spread of Viral Diseases: Evidence from High Frequency Data," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(2), pages 891-941.
    8. Hilary Hoynes & Diane Whitmore Schanzenbach & Douglas Almond, 2016. "Long-Run Impacts of Childhood Access to the Safety Net," American Economic Review, American Economic Association, vol. 106(4), pages 903-934, April.
    9. Bennett, Patrick & Blundell, Richard & Salvanes, Kjell Gunnar, 2020. "A Second Chance? Labor Market Returns to Adult Education Using School Reforms," Discussion Paper Series in Economics 14/2020, Norwegian School of Economics, Department of Economics.
    10. Justin Wolfers, 2006. "Did Unilateral Divorce Laws Raise Divorce Rates? A Reconciliation and New Results," American Economic Review, American Economic Association, vol. 96(5), pages 1802-1820, December.
    11. Athey, Susan & Imbens, Guido W., 2022. "Design-based analysis in Difference-In-Differences settings with staggered adoption," Journal of Econometrics, Elsevier, vol. 226(1), pages 62-79.
    12. Broda, Christian & Parker, Jonathan A., 2014. "The Economic Stimulus Payments of 2008 and the aggregate demand for consumption," Journal of Monetary Economics, Elsevier, vol. 68(S), pages 20-36.
    13. MacKinnon, James G. & White, Halbert, 1985. "Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties," Journal of Econometrics, Elsevier, vol. 29(3), pages 305-325, September.
    14. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    15. Natalie Bau, 2021. "Can Policy Change Culture? Government Pension Plans and Traditional Kinship Practices," American Economic Review, American Economic Association, vol. 111(6), pages 1880-1917, June.
    16. Andrew Goodman-Bacon, 2018. "Difference-in-Differences with Variation in Treatment Timing," NBER Working Papers 25018, National Bureau of Economic Research, Inc.
    17. Joshua D. Angrist, 1998. "Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants," Econometrica, Econometric Society, vol. 66(2), pages 249-288, March.
    18. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    19. Michelle Marcus & Pedro H. C. Sant’Anna, 2021. "The Role of Parallel Trends in Event Study Settings: An Application to Environmental Economics," Journal of the Association of Environmental and Resource Economists, University of Chicago Press, vol. 8(2), pages 235-275.
    20. Jaap H. Abbring & Gerard J. van den Berg, 2003. "The Nonparametric Identification of Treatment Effects in Duration Models," Econometrica, Econometric Society, vol. 71(5), pages 1491-1517, September.
    21. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    22. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Mar 2024.
    2. Athey, Susan & Imbens, Guido W., 2022. "Design-based analysis in Difference-In-Differences settings with staggered adoption," Journal of Econometrics, Elsevier, vol. 226(1), pages 62-79.
    3. Cl'ement de Chaisemartin & Xavier D'Haultf{oe}uille, 2021. "Two-Way Fixed Effects and Differences-in-Differences with Heterogeneous Treatment Effects: A Survey," Papers 2112.04565, arXiv.org, revised Jun 2022.
    4. Eli Ben‐Michael & Avi Feller & Jesse Rothstein, 2022. "Synthetic controls with staggered adoption," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 351-381, April.
    5. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    6. Clément de Chaisemartin & Xavier D’Haultfœuille, 2023. "Two-way fixed effects and differences-in-differences with heterogeneous treatment effects: a survey," The Econometrics Journal, Royal Economic Society, vol. 26(3), pages 1-30.
    7. Maclean, J. Catherine & Pichler, Stefan & Ziebarth, Nicolas R., 2020. "Mandated Sick Pay: Coverage, Utilization, and Welfare Effects," IZA Discussion Papers 13132, Institute of Labor Economics (IZA).
    8. Damian Clarke & Kathya Tapia-Schythe, 2021. "Implementing the panel event study," Stata Journal, StataCorp LP, vol. 21(4), pages 853-884, December.
    9. Hao, Shiming, 2021. "True structure change, spurious treatment effect? A novel approach to disentangle treatment effects from structure changes," MPRA Paper 108679, University Library of Munich, Germany.
    10. Kurt Schmidheiny & Sebastian Siegloch, 2023. "On event studies and distributed‐lags in two‐way fixed effects models: Identification, equivalence, and generalization," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(5), pages 695-713, August.
    11. Bhattacharjee, Arnab & Aravena, Claudia & Castillo, Natalia & Ehrlich, Marco & Taou, Nadia & Wagner, Thomas, 2022. "Agroforestry Programs in the Colombian Amazon: Selection, Treatment and Exposure Effects on Deforestation," National Institute of Economic and Social Research (NIESR) Discussion Papers 537, National Institute of Economic and Social Research.
    12. Diogo G. C. Britto & Paolo Pinotti & Breno Sampaio, 2022. "The Effect of Job Loss and Unemployment Insurance on Crime in Brazil," Econometrica, Econometric Society, vol. 90(4), pages 1393-1423, July.
    13. Bruno Ferman, 2023. "Inference in difference‐in‐differences: How much should we trust in independent clusters?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(3), pages 358-369, April.
    14. Jianfei Cao & Shirley Lu, 2019. "Synthetic Control Inference for Staggered Adoption: Estimating the Dynamic Effects of Board Gender Diversity Policies," Papers 1912.06320, arXiv.org.
    15. Philipp Breidenbach & Timo Mitze, 2022. "Large-scale sport events and COVID-19 infection effects: evidence from the German professional football ‘experiment’ [Semiparametric difference-in-differences estimators]," The Econometrics Journal, Royal Economic Society, vol. 25(1), pages 15-45.
    16. Huber, Martin, 2019. "An introduction to flexible methods for policy evaluation," FSES Working Papers 504, Faculty of Economics and Social Sciences, University of Freiburg/Fribourg Switzerland.
    17. Fiammetta Menchetti & Fabrizio Cipollini & Fabrizia Mealli, 2023. "Combining counterfactual outcomes and ARIMA models for policy evaluation," The Econometrics Journal, Royal Economic Society, vol. 26(1), pages 1-24.
    18. Tamara Bischof & Boris Kaiser, 2021. "Who cares when you close down? The effects of primary care practice closures on patients," Health Economics, John Wiley & Sons, Ltd., vol. 30(9), pages 2004-2025, September.
    19. Mensah, Edouard R. & Filipski, Mateusz J., 2022. "Saving for a rainy day: the impact of natural disasters on savings rates," 2022 Annual Meeting, July 31-August 2, Anaheim, California 322266, Agricultural and Applied Economics Association.
    20. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.

    More about this item

    Keywords

    Difference-in-differences; Event study; Imputation estimator; Panel data;
    All these keywords.

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • E62 - Macroeconomics and Monetary Economics - - Macroeconomic Policy, Macroeconomic Aspects of Public Finance, and General Outlook - - - Fiscal Policy; Modern Monetary Theory

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:17247. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.