IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2207.11890.html
   My bibliography  Save this paper

Misclassification in Difference-in-differences Models

Author

Listed:
  • Augustine Denteh
  • D'esir'e K'edagni

Abstract

The difference-in-differences (DID) design is one of the most popular methods used in empirical economics research. However, there is almost no work examining what the DID method identifies in the presence of a misclassified treatment variable. This paper studies the identification of treatment effects in DID designs when the treatment is misclassified. Misclassification arises in various ways, including when the timing of a policy intervention is ambiguous or when researchers need to infer treatment from auxiliary data. We show that the DID estimand is biased and recovers a weighted average of the average treatment effects on the treated (ATT) in two subpopulations -- the correctly classified and misclassified groups. In some cases, the DID estimand may yield the wrong sign and is otherwise attenuated. We provide bounds on the ATT when the researcher has access to information on the extent of misclassification in the data. We demonstrate our theoretical results using simulations and provide two empirical applications to guide researchers in performing sensitivity analysis using our proposed methods.

Suggested Citation

  • Augustine Denteh & D'esir'e K'edagni, 2022. "Misclassification in Difference-in-differences Models," Papers 2207.11890, arXiv.org, revised Jul 2022.
  • Handle: RePEc:arx:papers:2207.11890
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2207.11890
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Philippe Aghion & Mathias Dewatripont & Julian Kolev & Fiona Murray & Scott Stern, 2016. "Of Mice and Academics: Examining the Effect of Openness on Innovation," PSE-Ecole d'économie de Paris (Postprint) halshs-01496928, HAL.
    2. Aigner, Dennis J., 1973. "Regression with a binary independent variable subject to errors of observation," Journal of Econometrics, Elsevier, vol. 1(1), pages 49-59, March.
    3. Irene Botosaru & Federico H. Gutierrez, 2018. "Difference‐in‐differences when the treatment status is observed in only one period," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(1), pages 73-90, January.
    4. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    5. DiTraglia, Francis J. & García-Jimeno, Camilo, 2019. "Identifying the effect of a mis-classified, binary, endogenous regressor," Journal of Econometrics, Elsevier, vol. 209(2), pages 376-390.
    6. Chalak, Karim, 2017. "Instrumental Variables Methods With Heterogeneity And Mismeasured Instruments," Econometric Theory, Cambridge University Press, vol. 33(1), pages 69-104, February.
    7. Jeffrey A. Groen & Anne E. Polivka, 2008. "The Effect of Hurricane Katrina on the Labor Market Outcomes of Evacuees," American Economic Review, American Economic Association, vol. 98(2), pages 43-48, May.
    8. Thomas C. Buchmueller & John DiNardo & Robert G. Valletta, 2011. "The Effect of an Employer Health Insurance Mandate on Health Insurance Coverage and the Demand for Labor: Evidence from Hawaii," American Economic Journal: Economic Policy, American Economic Association, vol. 3(4), pages 25-51, November.
    9. Erich Battistin & Barbara Sianesi, 2011. "Misclassified Treatment Status and Treatment Effects: An Application to Returns to Education in the United Kingdom," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 495-509, May.
    10. Jeffrey A. Groen & Anne E. Polivka, 2008. "The Effect of Hurricane Katrina on the Labor Market Outcomes of Evacuees," Working Papers 415, U.S. Bureau of Labor Statistics.
    11. Fiona Murray & Philippe Aghion & Mathias Dewatripont & Julian Kolev & Scott Stern, 2016. "Of Mice and Academics: Examining the Effect of Openness on Innovation," American Economic Journal: Economic Policy, American Economic Association, vol. 8(1), pages 212-252, February.
    12. Battistin, Erich & De Nadai, Michele & Sianesi, Barbara, 2014. "Misreported schooling, multiple measures and returns to educational qualifications," Journal of Econometrics, Elsevier, vol. 181(2), pages 136-150.
    13. Brent Kreider & John V. Pepper & Craig Gundersen & Dean Jolliffe, 2012. "Identifying the Effects of SNAP (Food Stamps) on Child Health Outcomes When Participation Is Endogenous and Misreported," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(499), pages 958-975, September.
    14. Nguimkeu, Pierre & Denteh, Augustine & Tchernis, Rusty, 2019. "On the estimation of treatment effects with endogenous misreporting," Journal of Econometrics, Elsevier, vol. 208(2), pages 487-506.
    15. Bollinger, Christopher R. & van Hasselt, Martijn, 2017. "Bayesian moment-based inference in a regression model with misclassification error," Journal of Econometrics, Elsevier, vol. 200(2), pages 282-294.
    16. Frazis, Harley & Loewenstein, Mark A., 2003. "Estimating linear regressions with mismeasured, possibly endogenous, binary explanatory variables," Journal of Econometrics, Elsevier, vol. 117(1), pages 151-178, November.
    17. Takuya Ura, 2018. "Heterogeneous treatment effects with mismeasured endogenous treatment," Quantitative Economics, Econometric Society, vol. 9(3), pages 1335-1370, November.
    18. AIGNER, Dennis J., 1973. "Regression with a binary independent variable subject to errors of observation," LIDAM Reprints CORE 130, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    19. Zhichao Jiang & Peng Ding, 2020. "Measurement errors in the binary instrumental variable model," Biometrika, Biometrika Trust, vol. 107(1), pages 238-245.
    20. Donald Bruce & Lawrence M. Kessler, 2022. "A SALT on Real Estate? Housing Market and Migration Responses to the Limit on the State and Local Tax Deduction," Working Papers 2022-01, University of Tennessee, Department of Economics.
    21. Aprajit Mahajan, 2006. "Identification and Estimation of Regression Models with Misclassification," Econometrica, Econometric Society, vol. 74(3), pages 631-665, May.
    22. Kasahara, Hiroyuki & Shimotsu, Katsumi, 2022. "Identification Of Regression Models With A Misclassified And Endogenous Binary Regressor," Econometric Theory, Cambridge University Press, vol. 38(6), pages 1117-1139, December.
    23. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    24. Kalena E. Cortes, 2013. "Achieving the DREAM: The Effect of IRCA on Immigrant Youth Postsecondary Educational Access," American Economic Review, American Economic Association, vol. 103(3), pages 428-432, May.
    25. Alberto Galasso & Hong Luo, 2022. "When Does Product Liability Risk Chill Innovation? Evidence from Medical Implants," American Economic Journal: Economic Policy, American Economic Association, vol. 14(2), pages 366-401, May.
    26. Yanqin Fan & Carlos A. Manzanares, 2017. "Partial identification of average treatment effects on the treated through difference-in-differences," Econometric Reviews, Taylor & Francis Journals, vol. 36(6-9), pages 1057-1080, October.
    27. Miller, Sarah, 2012. "The effect of insurance on emergency room visits: An analysis of the 2006 Massachusetts health reform," Journal of Public Economics, Elsevier, vol. 96(11), pages 893-908.
    28. Evan Plous Kresch, 2020. "The Buck Stops Where? Federalism, Uncertainty, and Investment in the Brazilian Water and Sanitation Sector," American Economic Journal: Economic Policy, American Economic Association, vol. 12(3), pages 374-401, August.
    29. Anna Bindler & Randi Hjalmarsson, 2018. "How Punishment Severity Affects Jury Verdicts: Evidence from Two Natural Experiments," American Economic Journal: Economic Policy, American Economic Association, vol. 10(4), pages 36-78, November.
    30. Hausman, J. A. & Abrevaya, Jason & Scott-Morton, F. M., 1998. "Misclassification of the dependent variable in a discrete-response setting," Journal of Econometrics, Elsevier, vol. 87(2), pages 239-269, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Akanksha Negi & Digvijay Singh Negi, 2022. "Difference-in-Differences with a Misclassified Treatment," Papers 2208.02412, arXiv.org.
    2. Acerenza, Santiago & Ban, Kyunghoon & Kedagni, Desire, 2021. "Marginal Treatment Effects with Misclassified Treatment," ISU General Staff Papers 202106180700001132, Iowa State University, Department of Economics.
    3. Nguimkeu, Pierre & Denteh, Augustine & Tchernis, Rusty, 2019. "On the estimation of treatment effects with endogenous misreporting," Journal of Econometrics, Elsevier, vol. 208(2), pages 487-506.
    4. Francis J. DiTraglia & Camilo Garcia-Jimeno, 2020. "Identifying the effect of a mis-classified, binary, endogenous regressor," Papers 2011.07272, arXiv.org.
    5. DiTraglia, Francis J. & García-Jimeno, Camilo, 2019. "Identifying the effect of a mis-classified, binary, endogenous regressor," Journal of Econometrics, Elsevier, vol. 209(2), pages 376-390.
    6. Wossen, Tesfamicheal & Abay, Kibrom A. & Abdoulaye, Tahirou, 2022. "Misperceiving and misreporting input quality: Implications for input use and productivity," Journal of Development Economics, Elsevier, vol. 157(C).
    7. Kasahara, Hiroyuki & Shimotsu, Katsumi, 2022. "Identification Of Regression Models With A Misclassified And Endogenous Binary Regressor," Econometric Theory, Cambridge University Press, vol. 38(6), pages 1117-1139, December.
    8. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Third Version," PIER Working Paper Archive 15-040, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 24 Nov 2015.
    9. Steven J. Haider & Melvin Stephens Jr., 2020. "Correcting for Misclassified Binary Regressors Using Instrumental Variables," NBER Working Papers 27797, National Bureau of Economic Research, Inc.
    10. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    11. Francis J. DiTraglia & Camilo García-Jimeno, 2017. "Mis-classified, Binary, Endogenous Regressors: Identification and Inference," NBER Working Papers 23814, National Bureau of Economic Research, Inc.
    12. Lorenzo Almada & Ian McCarthy & Rusty Tchernis, 2016. "What Can We Learn about the Effects of Food Stamps on Obesity in the Presence of Misreporting?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(4), pages 997-1017.
    13. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Second Version," PIER Working Paper Archive 15-039, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 11 Nov 2015.
    14. Christian vom Lehn & Cache Ellsworth & Zachary Kroff, 2022. "Reconciling Occupational Mobility in the Current Population Survey," Journal of Labor Economics, University of Chicago Press, vol. 40(4), pages 1005-1051.
    15. Takahide Yanagi, 2019. "Inference on local average treatment effects for misclassified treatment," Econometric Reviews, Taylor & Francis Journals, vol. 38(8), pages 938-960, September.
    16. Orville Mondal & Rui Wang, 2024. "Partial Identification of Binary Choice Models with Misreported Outcomes," Papers 2401.17137, arXiv.org.
    17. Santiago Acerenza, 2021. "Partial Identification of Marginal Treatment Effects with discrete instruments and misreported treatment," Papers 2110.06285, arXiv.org, revised Mar 2023.
    18. Adele Bergin, 2015. "Employer Changes and Wage Changes: Estimation with Measurement Error in a Binary Variable," LABOUR, CEIS, vol. 29(2), pages 194-223, June.
    19. Zhang, Han, 2021. "How Using Machine Learning Classification as a Variable in Regression Leads to Attenuation Bias and What to Do About It," SocArXiv 453jk, Center for Open Science.
    20. Battistin, Erich & De Nadai, Michele & Vuri, Daniela, 2017. "Counting rotten apples: Student achievement and score manipulation in Italian elementary Schools," Journal of Econometrics, Elsevier, vol. 200(2), pages 344-362.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2207.11890. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.