IDEAS home Printed from https://ideas.repec.org/a/taf/japsta/v43y2016i11p2044-2052.html
   My bibliography  Save this article

Difference-in-difference estimation by FE and OLS when there is panel non-response

Author

Listed:
  • Michael Lechner
  • Nuria Rodriguez-Planas
  • Daniel Fernández Kranz

Abstract

We show that the ordinary least squares (OLS) and fixed-effects (FE) estimators of the popular difference-in-differences model may deviate when there is time-varying panel non-response. If such non-response does not affect the common-trend assumption, then OLS and FE are consistent, but OLS is more precise. However, if non-response is affecting the common-trend assumption, then FE estimation may still be consistent, while OLS will be inconsistent. We provide simulation as well as empirical evidence for this phenomenon to occur. We conclude that in case of unbalanced panels, deviating OLS and FE estimates should be considered as evidence that non-response is not ignorable for the differences-in-differences estimation.

Suggested Citation

  • Michael Lechner & Nuria Rodriguez-Planas & Daniel Fernández Kranz, 2016. "Difference-in-difference estimation by FE and OLS when there is panel non-response," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(11), pages 2044-2052, August.
    • Handle: RePEc:taf:japsta:v:43:y:2016:i:11:p:2044-2052
    DOI: 10.1080/02664763.2015.1126240
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/02664763.2015.1126240
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/02664763.2015.1126240?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. David H. Autor, 2003. "Outsourcing at Will: The Contribution of Unjust Dismissal Doctrine to the Growth of Employment Outsourcing," Journal of Labor Economics, University of Chicago Press, vol. 21(1), pages 1-42, January.
    2. Timothy Besley & Robin Burgess, 2004. "Can Labor Regulation Hinder Economic Performance? Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 91-134.
    3. Amuedo-Dorantes, Catalina & Serrano-Padial, Ricardo, 2007. "Wage Growth Implications of Fixed-Term Employment: An Analysis by Contract Duration and Job Mobility," Labour Economics, Elsevier, vol. 14(5), pages 829-847, October.
    4. Bedard, Kelly & Kuhn, Peter, 2015. "Micro-marketing healthier choices: Effects of personalized ordering suggestions on restaurant purchases," Journal of Health Economics, Elsevier, vol. 39(C), pages 106-122.
    5. Fernández-Kranz, Daniel & Rodríguez-Planas, Núria, 2013. "Can Parents' Right to Work Part-Time Hurt Childbearing-Aged Women? A Natural Experiment with Administrative Data," IZA Discussion Papers 7509, Institute of Labor Economics (IZA).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mari, Gabriele, 2020. "Working-time flexibility is (not the same) for all: Evidence from a right-to-request reform," SocArXiv bnp9r, Center for Open Science.
    2. Costa-Font, Joan & Raut, Nilesh & Van Houtven, Courtney, 2021. "Medicaid Expansion and the Mental Health of Spousal Caregivers," IZA Discussion Papers 14754, Institute of Labor Economics (IZA).
    3. Akabayashi, Hideo & Taguchi, Shimpei & Zvedelikova, Mirka, 2023. "Access to and demand for online school education during the COVID-19 pandemic in Japan," International Journal of Educational Development, Elsevier, vol. 96(C).
    4. Nattavudh Powdthavee & Anke C. Plagnol & Paul Frijters & Andrew E. Clark, 2019. "Who Got the Brexit Blues? The Effect of Brexit on Subjective Wellbeing in the UK," Economica, London School of Economics and Political Science, vol. 86(343), pages 471-494, July.
    5. Bruce Hollingsworth & Asako Ohinata & Matteo Picchio & Ian Walker, 2022. "The Impacts of Free Universal Elderly Care on the Supply of Informal Care and Labour Supply," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(4), pages 933-960, August.
    6. Schaff, Felix, 2020. "When ‘the state made war’, what happened to economic inequality? Evidence from preindustrial Germany (c.1400-1800)," LSE Research Online Documents on Economics 107046, London School of Economics and Political Science, LSE Library.
    7. David Grover & Swaroop Rao, 2020. "Inequality, unemployment, and poverty impacts of mitigation investment: evidence from the CDM in Brazil and implications for a post-2020 mechanism," Climate Policy, Taylor & Francis Journals, vol. 20(5), pages 609-625, May.
    8. Sano, Kazuaki & Miyawaki, Atsushi & Abe, Kazuhiro & Jin, Xueying & Watanabe, Taeko & Tamiya, Nanako & Kobayashi, Yasuki, 2022. "Effects of cost sharing on long-term care service utilization among home-dwelling older adults in Japan," Health Policy, Elsevier, vol. 126(12), pages 1310-1316.
    9. Lucas Hafner & Benjamin Lochner, 2022. "Do minimum wages improve self-rated health? Evidence from a natural experiment," Empirical Economics, Springer, vol. 62(6), pages 2989-3014, June.
    10. Padmaja Ayyagari, 2019. "Health Insurance and Early Retirement Plans: Evidence from the Affordable Care Act," American Journal of Health Economics, University of Chicago Press, vol. 5(4), pages 533-560, Fall.
    11. Schaff, Felix, 2020. "When ‘the state made war’, what happened to economic inequality? Evidence from preindustrial Germany (c.1400-1800)," Economic History Working Papers 107046, London School of Economics and Political Science, Department of Economic History.
    12. Egbert Jongen & Arjan Lejour & Gabriella Massenz, 2018. "Cheaper and More Haircuts After VAT Cut? Evidence from the Netherlands," De Economist, Springer, vol. 166(2), pages 135-154, June.
    13. Wesley Burnett, J. & Mothorpe, Christopher, 2021. "Human-induced earthquakes, risk salience, and housing values," Resource and Energy Economics, Elsevier, vol. 63(C).
    14. Marcus, Jan & Reif, Simon & Wuppermann, Amelie & Rouche, Amélie, 2020. "Increased instruction time and stress-related health problems among school children," Journal of Health Economics, Elsevier, vol. 70(C).
    15. Lea Toulemon, 2018. "The effect of group purchasing on prices hospitals pay for medicines," Health Economics, John Wiley & Sons, Ltd., vol. 27(9), pages 1380-1393, September.
    16. Alejandra Rodríguez Sánchez & Anette Fasang & Susan Harkness, 2021. "Gender division of housework during the COVID-19 pandemic: Temporary shocks or durable change?," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 45(43), pages 1297-1316.
    17. Matteo Alpino & Irene Di Marzio & Maurizio Lozzi & Vincenzo Mariani, 2022. "Labor market spillovers of a large plan opening. Evidence from the oil industry," Temi di discussione (Economic working papers) 1386, Bank of Italy, Economic Research and International Relations Area.
    18. Julia Bredtmann & Christina Vonnahme, 2019. "Less money after divorce – how the 2008 alimony reform in Germany affected spouses’ labor supply, leisure and marital stability," Review of Economics of the Household, Springer, vol. 17(4), pages 1191-1223, December.
    19. Thomas Bue Bjørner & Jacob Victor Hansen & Astrid Fanger Jakobsen, 2021. "Price cap regulation and water quality," Journal of Regulatory Economics, Springer, vol. 60(2), pages 95-116, December.
    20. Aljoscha Minnich & Holger A. Rau & Jan Christian Schlüter, 2022. "The effects of gift vouchers and environmental certificates on the demand for a collective DRT system," Transportation, Springer, vol. 49(6), pages 1683-1714, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fernández Kranz, Daniel & Lechner, Michael & Rodriguez-Planas, Nuria, 2015. "A note on difference-in-difference estimation by Fixed Effects and OLS when there is panel non-response," Economics Working Paper Series 1507, University of St. Gallen, School of Economics and Political Science.
    2. Vincent Vandenberghe, 2019. "Alternatives to polynomial trend-corrected differences-in-differences models," Applied Economics Letters, Taylor & Francis Journals, vol. 26(5), pages 358-361, March.
    3. Shu He & Jing Peng & Jianbin Li & Liping Xu, 2020. "Impact of Platform Owner’s Entry on Third-Party Stores," Information Systems Research, INFORMS, vol. 31(4), pages 1467-1484, December.
    4. Sofi Irfan Ahmad & Sharma Pritee, 2015. "Labour Laws and Informalisation of Employment: Panel Evidences from Indian Formal Manufacturing Sector," Asian Journal of Law and Economics, De Gruyter, vol. 6(1), pages 65-84, April.
    5. Pedro S. Martins, 2009. "Dismissals for Cause: The Difference That Just Eight Paragraphs Can Make," Journal of Labor Economics, University of Chicago Press, vol. 27(2), pages 257-279, April.
    6. Dang, Viet A. & De Cesari, Amedeo & Phan, Hieu V., 2021. "Employment protection and share repurchases: Evidence from wrongful discharge laws," Journal of Corporate Finance, Elsevier, vol. 69(C).
    7. Lechner, Michael, 2011. "The Estimation of Causal Effects by Difference-in-Difference Methods," Foundations and Trends(R) in Econometrics, now publishers, vol. 4(3), pages 165-224, November.
    8. Joop Age Harm Adema & Cevat Giray Aksoy & Panu Poutvaara, 2021. "Mobile Internet Access and the Desire to Emigrate," ifo Working Paper Series 365, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    9. Bhaskar Jyoti Neog & Bimal Kishore Sahoo, 2020. "Job Reallocation Dynamics in India: Evidence from Large Manufacturing Plants," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 82(4), pages 934-959, August.
    10. Shi, Lan & Zhang, Yan, 2018. "The effect of mortgage broker licensing under the originate-to-distribute model: Evidence from the U.S. mortgage market," Journal of Financial Intermediation, Elsevier, vol. 35(PA), pages 70-85.
    11. Hiroko Okudaira, 2009. "The Economic Costs of Court Decisions Concerning Dismissals in Japan: Identification by Judge Transfers," ISER Discussion Paper 0733r, Institute of Social and Economic Research, Osaka University, revised Sep 2015.
    12. Saha, Bibhas & Sen, Kunal & Maiti, Dibyendu, 2013. "Trade openness, labour institutions and flexibilisation: Theory and evidence from India," Labour Economics, Elsevier, vol. 24(C), pages 180-195.
    13. Robert C. Bird & John D. Knopf, 2009. "Do Wrongful-Discharge Laws Impair Firm Performance?," Journal of Law and Economics, University of Chicago Press, vol. 52(2), pages 197-222, May.
    14. Parsons, Donald O., 2011. "Mandated Severance Pay and Firing Cost Distortions: A Critical Review of the Evidence," IZA Discussion Papers 5776, Institute of Labor Economics (IZA).
    15. Serena Yu & David Peetz, 2019. "Non‐Standard Time Wage Premiums and Employment Effects: Evidence from an Australian Natural Experiment," British Journal of Industrial Relations, London School of Economics, vol. 57(1), pages 33-61, March.
    16. Michael Wyrwich, 2022. "Historical episodes and their legacies across space: A famous case revisited," Journal of Regional Science, Wiley Blackwell, vol. 62(4), pages 1048-1091, September.
    17. Savelkoul, Ruben, 2020. "Superstars vs the long tail: How does music piracy affect digital song sales for different segments of the industry?," Information Economics and Policy, Elsevier, vol. 50(C).
    18. Michele Campolieti & Robert Hebdon & Benjamin Dachis, 2014. "The Impact of Collective Bargaining Legislation on Strike Activity and Wage Settlements," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 53(3), pages 394-429, July.
    19. Simon Hartmann & Rok Spruk, 2023. "The impact of unilateral BIT terminations on FDI: Quasi-experimental evidence from India," The Review of International Organizations, Springer, vol. 18(2), pages 259-296, April.
    20. Paul Demeré, 2023. "Is tax return information useful to equity investors?," Review of Accounting Studies, Springer, vol. 28(3), pages 1413-1465, September.

    More about this item

    JEL classification:

    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:japsta:v:43:y:2016:i:11:p:2044-2052. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/CJAS20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.