IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2406.15288.html

Difference-in-Differences when Parallel Trends Holds Conditional on Covariates

Author

Listed:
  • Carolina Caetano
  • Brantly Callaway

Abstract

In this paper, we study difference-in-differences identification and estimation strategies when the parallel trends assumption holds after conditioning on covariates. We consider empirically relevant settings where the covariates can be time-varying, time-invariant, or both. We uncover a number of weaknesses of commonly used two-way fixed effects (TWFE) regressions in this context, even in applications with only two time periods. In addition to some weaknesses due to estimating linear regression models that are similar to cases with cross-sectional data, we also point out a collection of additional issues that we refer to as \textit{hidden linearity bias} that arise because the transformations used to eliminate the unit fixed effect also transform the covariates (e.g., taking first differences can result in the estimating equation only including the change in covariates over time, not their level, and also drop time-invariant covariates altogether). We provide simple diagnostics for assessing how susceptible a TWFE regression is to hidden linearity bias based on reformulating the TWFE regression as a weighting estimator. Finally, we propose simple alternative estimation strategies that can circumvent these issues.

Suggested Citation

  • Carolina Caetano & Brantly Callaway, 2024. "Difference-in-Differences when Parallel Trends Holds Conditional on Covariates," Papers 2406.15288, arXiv.org, revised Sep 2024.
  • Handle: RePEc:arx:papers:2406.15288
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2406.15288
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    2. Stéphane Bonhomme & Ulrich Sauder, 2011. "Recovering Distributions in Difference-in-Differences Models: A Comparison of Selective and Comprehensive Schooling," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 479-494, May.
    3. Hainmueller, Jens, 2012. "Entropy Balancing for Causal Effects: A Multivariate Reweighting Method to Produce Balanced Samples in Observational Studies," Political Analysis, Cambridge University Press, vol. 20(1), pages 25-46, January.
    4. Martha J. Bailey & Andrew Goodman-Bacon, 2015. "The War on Poverty's Experiment in Public Medicine: Community Health Centers and the Mortality of Older Americans," American Economic Review, American Economic Association, vol. 105(3), pages 1067-1104, March.
    5. Joshua D. Angrist, 1998. "Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants," Econometrica, Econometric Society, vol. 66(2), pages 249-288, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Martinez Cillero Maria & Napolitano Lorenzo & Rentocchini Francesco & Seri Cecilia & Zaurino Elena, 2025. "M&As, Innovation and Superstar Firms," JRC Working Papers on Corporate R&D and Innovation 2025-03, Joint Research Centre.
    2. Jeffrey M. Wooldridge, 2025. "Two-way fixed effects, the two-way mundlak regression, and difference-in-differences estimators," Empirical Economics, Springer, vol. 69(5), pages 2545-2587, November.
    3. Hörnig, Lukas & Schäfer, Max, 2024. "The value of school choice opportunities," Ruhr Economic Papers 1120, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    4. Hörnig, Lukas & Schäfer, Max, 2025. "The value of school choice opportunities," Labour Economics, Elsevier, vol. 95(C).
    5. Albarrán, Pedro & Robles, Antonio & Sanz-de-Galdeano, Anna, 2025. "The Aftermath of Peace: The Impact of the FARC’s Ceasefire on Forced Displacement in Colombia," IZA Discussion Papers 18087, IZA Network @ LISER.
    6. Andrew Baker & Brantly Callaway & Scott Cunningham & Andrew Goodman-Bacon & Pedro H. C. Sant'Anna, 2025. "Difference-in-Differences Designs: A Practitioner's Guide," Papers 2503.13323, arXiv.org, revised Jun 2025.
    7. Damen, Sven & Goeyvaerts, Geert, 2026. "Housing market responses to the mortgage interest deduction," Regional Science and Urban Economics, Elsevier, vol. 116(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    2. Jones, A.M.; & Pastore, C.; & Rice, N.;, 2018. "Tracking pupils into adulthood: selective schools and long-term well-being in the 1958 British cohort," Health, Econometrics and Data Group (HEDG) Working Papers 18/32, HEDG, c/o Department of Economics, University of York.
    3. Carolina Caetano & Brantly Callaway & Stroud Payne & Hugo Sant'Anna Rodrigues, 2022. "Difference in Differences with Time-Varying Covariates," Papers 2202.02903, arXiv.org, revised Jun 2024.
    4. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    5. Emanuela Galasso & Martin Ravallion, 2004. "Social Protection in a Crisis: Argentina's Plan Jefes y Jefas," The World Bank Economic Review, World Bank, vol. 18(3), pages 367-399.
    6. Pedro H. C. Sant'Anna & Xiaojun Song & Qi Xu, 2022. "Covariate distribution balance via propensity scores," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1093-1120, September.
    7. Augurzky, Boris & Kluve, Jochen, 2004. "Assessing the performance of matching algorithms when selection into treatment is strong," RWI Discussion Papers 21, RWI - Leibniz-Institut für Wirtschaftsforschung.
    8. Alberto Abadie & Guido W. Imbens, 2002. "Simple and Bias-Corrected Matching Estimators for Average Treatment Effects," NBER Technical Working Papers 0283, National Bureau of Economic Research, Inc.
    9. Malcolm Keswell & Michael R. Carter, 2011. "Poverty and Land Distribution: Evidence from a Natural Experiment," WIDER Working Paper Series wp-2011-046, World Institute for Development Economic Research (UNU-WIDER).
    10. Kluve, Jochen & Lehmann, Hartmut & Schmidt, Christoph M., 1999. "Active Labor Market Policies in Poland: Human Capital Enhancement, Stigmatization, or Benefit Churning?," Journal of Comparative Economics, Elsevier, vol. 27(1), pages 61-89, March.
    11. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2006. "Moving the Goalposts: Addressing Limited Overlap in the Estimation of Average Treatment Effects by Changing the Estimand," NBER Technical Working Papers 0330, National Bureau of Economic Research, Inc.
    12. Themann, Michael & Koch, Nicolas, 2021. "Catching up and falling behind: Cross-country evidence on the impact of the EU ETS on firm productivity," Ruhr Economic Papers 904, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    13. Everding, Jakob & Marcus, Jan, 2020. "The effect of unemployment on the smoking behavior of couples," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 29(2), pages 154-170.
    14. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2009. "Dealing with limited overlap in estimation of average treatment effects," Biometrika, Biometrika Trust, vol. 96(1), pages 187-199.
    15. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    16. Guo, Yuchen Mo & Falck, Oliver & Langer, Christina & Lindlacher, Valentin & Wiederhold, Simon, 2024. "Training, Automation, and Wages: Worker-Level Evidence," VfS Annual Conference 2024 (Berlin): Upcoming Labor Market Challenges 302366, Verein für Socialpolitik / German Economic Association.
    17. Mergele, Lukas & Weber, Michael, 2020. "Public employment services under decentralization: Evidence from a natural experiment," Journal of Public Economics, Elsevier, vol. 182(C).
    18. Pierre Chausse & George Luta, 2017. "Casual Inference using Generalized Empirical Likelihood Methods," Working Papers 1707, University of Waterloo, Department of Economics, revised Dec 2017.
    19. Schmid, Thomas & Ampenberger, Markus & Kaserer, Christoph & Achleitner, Ann-Kristin, 2010. "Controlling shareholders and payout policy: do founding families have a special 'taste for dividends'?," CEFS Working Paper Series 2010-01, Technische Universität München (TUM), Center for Entrepreneurial and Financial Studies (CEFS).
    20. Jochen Kluve & Boris Augurzky, 2007. "Assessing the performance of matching algorithms when selection into treatment is strong," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(3), pages 533-557.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2406.15288. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.