IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2103.13229.html
   My bibliography  Save this paper

Simple Diagnostics for Two-Way Fixed Effects

Author

Listed:
  • Pamela Jakiela

Abstract

Difference-in-differences estimation is a widely used method of program evaluation. When treatment is implemented in different places at different times, researchers often use two-way fixed effects to control for location-specific and period-specific shocks. Such estimates can be severely biased when treatment effects change over time within treated units. I review the sources of this bias and propose several simple diagnostics for assessing its likely severity. I illustrate these tools through a case study of free primary education in Sub-Saharan Africa.

Suggested Citation

  • Pamela Jakiela, 2021. "Simple Diagnostics for Two-Way Fixed Effects," Papers 2103.13229, arXiv.org.
    • Handle: RePEc:arx:papers:2103.13229
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2103.13229
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    2. Adrienne M. Lucas & Isaac M. Mbiti, 2012. "Does Free Primary Education Narrow Gender Differences in Schooling? Evidence from Kenya -super-†," Journal of African Economies, Centre for the Study of African Economies, vol. 21(5), pages -722, November.
    3. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    4. Andrew Goodman-Bacon, 2018. "Difference-in-Differences with Variation in Treatment Timing," NBER Working Papers 25018, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Freedman, Matthew & Khanna, Shantanu & Neumark, David, 2023. "Combining rules and discretion in economic development policy: Evidence on the impacts of the California Competes Tax Credit," Journal of Public Economics, Elsevier, vol. 217(C).
    2. Xie, Tingting & Yuan, Ye, 2023. "Go with the wind: Spatial impacts of environmental regulations on economic activities in China," Journal of Development Economics, Elsevier, vol. 164(C).
    3. Johan Rewilak, 2023. "The Designated Player Policy Rule and Attendance Demand in Major League Soccer," Journal of Sports Economics, , vol. 24(4), pages 475-496, May.
    4. Clément de Chaisemartin & Xavier D’Haultfœuille, 2023. "Two-way fixed effects and differences-in-differences with heterogeneous treatment effects: a survey," The Econometrics Journal, Royal Economic Society, vol. 26(3), pages 1-30.
    5. Herrera-Almanza, Catalina & Rosales-Rueda, Maria F., 2023. "Community-based health programs and child vaccinations: Evidence from Madagascar," World Development, Elsevier, vol. 170(C).
    6. Pragya Bhuwania & Kate Huh & Jody Heymann, 2023. "Impact of Tuition‐Free Education Policy on Child Marriage and Early Childbearing: Does Secondary Matter More?," Population and Development Review, The Population Council, Inc., vol. 49(1), pages 43-70, March.
    7. Zant, Wouter, 2023. "Mobile Phones and Mozambique Traders: Size, Composition and Distribution of Reduced Transaction Costs," Food Policy, Elsevier, vol. 116(C).
    8. Antonio Acconcia & Elisa Scarinzi, 2022. "The effects of local demand and supply restrictions on markup," Temi di discussione (Economic working papers) 1370, Bank of Italy, Economic Research and International Relations Area.
    9. Poignant, Adrian, 2023. "Small-scale mining and agriculture: Evidence from northwestern Tanzania," Resources Policy, Elsevier, vol. 83(C).
    10. William B. Hankins, 2022. "Revisiting the effect of supermajority requirements on fiscal outcomes," Southern Economic Journal, John Wiley & Sons, vol. 88(4), pages 1599-1625, April.
    11. Baker, Andrew C. & Larcker, David F. & Wang, Charles C.Y., 2022. "How much should we trust staggered difference-in-differences estimates?," Journal of Financial Economics, Elsevier, vol. 144(2), pages 370-395.
    12. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Mar 2024.
    13. Félix Jimenez & Marco Arroyo, 2022. "Perú 1990-2020: Heterogeneidad estructural y regímenes económicos regionales. ¿Persiste la desconexión entre la economía, la demografía y la geografía?," Documentos de Trabajo / Working Papers 2022-511, Departamento de Economía - Pontificia Universidad Católica del Perú.
    14. Doyle, Mary-Alice & Schurer, Stefanie & Silburn, Sven, 2022. "Unintended consequences of welfare reform: Evidence from birthweight of Aboriginal children in Australia," Journal of Health Economics, Elsevier, vol. 84(C).
    15. Cansu Oymak & Jean-François Maystadt, 2023. "Can refugees improve native children’s health?: Evidence from Turkey," LIDAM Discussion Papers IRES 2023017, Université catholique de Louvain, Institut de Recherches Economiques et Sociales (IRES).
    16. Pan, Yan & Zhong, Wen-fang & Yin, Rong & Zheng, Meng & Xie, Kun & Cheng, Shu-yuan & Ling, Li & Chen, Wen, 2022. "Does direct settlement of intra-province medical reimbursements improve financial protection among middle-aged and elderly population in China? Evidence based on CHARLS data," Social Science & Medicine, Elsevier, vol. 308(C).
    17. Xie, Tingting & Yuan, Ye & Zhang, Hui, 2023. "Information, awareness, and mental health: Evidence from air pollution disclosure in China," Journal of Environmental Economics and Management, Elsevier, vol. 120(C).
    18. Nemschoff, Danielle, 2022. "An evaluation of Crisis-Intervention Team (CIT) training," MPRA Paper 114948, University Library of Munich, Germany.
    19. Andersen, Jørgen Juel & Sørensen, Rune Jørgen, 2022. "The zero-rent society: Evidence from hydropower and petroleum windfalls in Norwegian local governments," Journal of Public Economics, Elsevier, vol. 209(C).
    20. Cepparulo, Brian & Jump, Robert Calvert, 2022. "The impact of Covid-19 restrictions on economic activity: evidence from the Italian regional system," Greenwich Papers in Political Economy 37801, University of Greenwich, Greenwich Political Economy Research Centre.
    21. Aaron Richterman & Harsha Thirumurthy, 2022. "The effects of cash transfer programmes on HIV-related outcomes in 42 countries from 1996 to 2019," Nature Human Behaviour, Nature, vol. 6(10), pages 1362-1371, October.
    22. Anti, Sebastian & Zhang, Zhihui, 2023. "Roads, women’s employment, and gender equity: Evidence from Cambodia," World Development, Elsevier, vol. 171(C).
    23. Ursina Schaede & Ville Mankki, 2022. "Quota vs Quality? Long-Term Gains from an Unusual Gender Quota," CESifo Working Paper Series 9811, CESifo.
    24. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    25. Shirin, Farzana, 2023. "Does Teacher Salary Support Improve Student Learning Outcomes," 2023 Annual Meeting, July 23-25, Washington D.C. 335793, Agricultural and Applied Economics Association.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maclean, J. Catherine & Pichler, Stefan & Ziebarth, Nicolas R., 2020. "Mandated Sick Pay: Coverage, Utilization, and Welfare Effects," IZA Discussion Papers 13132, Institute of Labor Economics (IZA).
    2. Kyle Butts, 2021. "Difference-in-Differences Estimation with Spatial Spillovers," Papers 2105.03737, arXiv.org, revised Jun 2023.
    3. Kurt Schmidheiny & Sebastian Siegloch, 2023. "On event studies and distributed‐lags in two‐way fixed effects models: Identification, equivalence, and generalization," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(5), pages 695-713, August.
    4. Bhattacharjee, Arnab & Aravena, Claudia & Castillo, Natalia & Ehrlich, Marco & Taou, Nadia & Wagner, Thomas, 2022. "Agroforestry Programs in the Colombian Amazon: Selection, Treatment and Exposure Effects on Deforestation," National Institute of Economic and Social Research (NIESR) Discussion Papers 537, National Institute of Economic and Social Research.
    5. Klauber, Hannah & Holub, Felix & Koch, Nicolas & Pestel, Nico & Ritter, Nolan & Rohlf, Alexander, 2021. "Killing Prescriptions Softly: Low Emission Zones and Child Health from Birth to School," IZA Discussion Papers 14376, Institute of Labor Economics (IZA).
    6. Diogo G. C. Britto & Paolo Pinotti & Breno Sampaio, 2022. "The Effect of Job Loss and Unemployment Insurance on Crime in Brazil," Econometrica, Econometric Society, vol. 90(4), pages 1393-1423, July.
    7. Rösner, Anja & Haucap, Justus & Heimeshoff, Ulrich, 2020. "The impact of consumer protection in the digital age: Evidence from the European Union," International Journal of Industrial Organization, Elsevier, vol. 73(C).
    8. Athey, Susan & Imbens, Guido W., 2022. "Design-based analysis in Difference-In-Differences settings with staggered adoption," Journal of Econometrics, Elsevier, vol. 226(1), pages 62-79.
    9. John Gardner, 2022. "Two-stage differences in differences," Papers 2207.05943, arXiv.org.
    10. Thompson, Paul N. & Ward, Jason, 2021. "Only a Matter of Time? The Role of Time in School on Four-Day School Week Achievement Impacts," IZA Discussion Papers 14461, Institute of Labor Economics (IZA).
    11. Sumit Agarwal & Slava Mikhed & Barry Scholnick & Man Zhang, 2022. "Reducing Strategic Default in a Financial Crisis," Working Papers 21-36, Federal Reserve Bank of Philadelphia.
    12. Christine Benesch & Rino L. Heim & Mark Schelker & Lukas D. Schmid, 2021. "Do Voting Advice Applications Change Political Behavior?," CESifo Working Paper Series 8868, CESifo.
    13. Bruno Ferman, 2023. "Inference in difference‐in‐differences: How much should we trust in independent clusters?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(3), pages 358-369, April.
    14. Pengju Zhang, 2023. "The fiscal and economic impacts of municipal dissolution: evidence from New York," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 30(4), pages 948-1001, August.
    15. Chareyron, Sylvain & Goffette-Nagot, Florence & Letrouit, Lucie, 2022. "Externalities from urban renewal: Evidence from a French program," Regional Science and Urban Economics, Elsevier, vol. 95(C).
    16. Capitán, Tabaré & Alpízar, Francisco & Madrigal-Ballestero, Róger & Pattanayak, Subhrendu K., 2021. "Time-varying pricing may increase total electricity consumption: Evidence from Costa Rica," Resource and Energy Economics, Elsevier, vol. 66(C).
    17. Scott Dallman & Anusha Nath & Filip Premik, 2021. "The Effect of Constitutional Provisions on Education Policy and Outcomes," Staff Report 623, Federal Reserve Bank of Minneapolis.
    18. Joop Age Harm Adema & Cevat Giray Aksoy & Panu Poutvaara, 2021. "Mobile Internet Access and the Desire to Emigrate," ifo Working Paper Series 365, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    19. Berry, Kevin & James, Alexander & Smith, Brock & Watson, Brett, 2022. "Geography, Geology, and Regional Economic Development," Journal of Environmental Economics and Management, Elsevier, vol. 115(C).
    20. Tamara Bischof & Boris Kaiser, 2021. "Who cares when you close down? The effects of primary care practice closures on patients," Health Economics, John Wiley & Sons, Ltd., vol. 30(9), pages 2004-2025, September.

    More about this item

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2103.13229. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.