IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2208.02412.html
   My bibliography  Save this paper

Difference-in-Differences with a Misclassified Treatment

Author

Listed:
  • Akanksha Negi
  • Digvijay Singh Negi

Abstract

This paper studies identification and estimation of the average treatment effect on the treated (ATT) in difference-in-difference (DID) designs when the variable that classifies individuals into treatment and control groups (treatment status, D) is endogenously misclassified. We show that misclassification in D hampers consistent estimation of ATT because 1) it restricts us from identifying the truly treated from those misclassified as being treated and 2) differential misclassification in counterfactual trends may result in parallel trends being violated with D even when they hold with the true but unobserved D*. We propose a solution to correct for endogenous one-sided misclassification in the context of a parametric DID regression which allows for considerable heterogeneity in treatment effects and establish its asymptotic properties in panel and repeated cross section settings. Furthermore, we illustrate the method by using it to estimate the insurance impact of a large-scale in-kind food transfer program in India which is known to suffer from large targeting errors.

Suggested Citation

  • Akanksha Negi & Digvijay Singh Negi, 2022. "Difference-in-Differences with a Misclassified Treatment," Papers 2208.02412, arXiv.org.
    • Handle: RePEc:arx:papers:2208.02412
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2208.02412
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Pande, Rohini, 2008. "Understanding Political Corruption in Low Income Countries," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 50, pages 3155-3184, Elsevier.
    2. Kaushal, Neeraj & Muchomba, Felix M., 2015. "How Consumer Price Subsidies affect Nutrition," World Development, Elsevier, vol. 74(C), pages 25-42.
    3. Brent Kreider, 2010. "Regression Coefficient Identification Decay in The Presence of Infrequent Classification Errors," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1017-1023, November.
    4. Aigner, Dennis J., 1973. "Regression with a binary independent variable subject to errors of observation," Journal of Econometrics, Elsevier, vol. 1(1), pages 49-59, March.
    5. Rossella Calvi & Arthur Lewbel & Denni Tommasi, 2022. "LATE With Missing or Mismeasured Treatment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(4), pages 1701-1717, October.
    6. M. Shahe Emran & Virginia Robano & Stephen C. Smith, 2014. "Assessing the Frontiers of Ultrapoverty Reduction: Evidence from Challenging the Frontiers of Poverty Reduction/Targeting the Ultra-poor, an Innovative Program in Bangladesh," Economic Development and Cultural Change, University of Chicago Press, vol. 62(2), pages 339-380.
    7. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    8. repec:fth:prinin:419 is not listed on IDEAS
    9. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    10. DiTraglia, Francis J. & García-Jimeno, Camilo, 2019. "Identifying the effect of a mis-classified, binary, endogenous regressor," Journal of Econometrics, Elsevier, vol. 209(2), pages 376-390.
    11. Jeffrey A. Groen & Anne E. Polivka, 2008. "The Effect of Hurricane Katrina on the Labor Market Outcomes of Evacuees," American Economic Review, American Economic Association, vol. 98(2), pages 43-48, May.
    12. César Martinelli & Susan Wendy Parker, 2009. "Deception and Misreporting in a Social Program," Journal of the European Economic Association, MIT Press, vol. 7(4), pages 886-908, June.
    13. Kochar, Anjini, 2005. "Can Targeted Food Programs Improve Nutrition? An Empirical Analysis of India's Public Distribution System," Economic Development and Cultural Change, University of Chicago Press, vol. 54(1), pages 203-235, October.
    14. Alberto Abadie, 2005. "Semiparametric Difference-in-Differences Estimators," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(1), pages 1-19.
    15. Giovanni Andrea Cornia & Frances Stewart, 1993. "Two errors of targeting," Journal of International Development, John Wiley & Sons, Ltd., vol. 5(5), pages 459-496, September.
      • Giovanni Andrea Cornia & Frances Stewart, 1993. "Two Errors of Targeting," Papers iopeps93/54, Innocenti Occasional Papers, Economic Policy Series.
    16. Thomas C. Buchmueller & John DiNardo & Robert G. Valletta, 2011. "The Effect of an Employer Health Insurance Mandate on Health Insurance Coverage and the Demand for Labor: Evidence from Hawaii," American Economic Journal: Economic Policy, American Economic Association, vol. 3(4), pages 25-51, November.
    17. Thomas J. Kane & Cecilia E. Rouse & Douglas Staiger, 1999. "Estimating Returns to Schooling When Schooling is Misreported," Working Papers 798, Princeton University, Department of Economics, Industrial Relations Section..
    18. Kerstin Bruckmeier & Regina T. Riphahn & Jürgen Wiemers, 2021. "Misreporting of program take-up in survey data and its consequences for measuring non-take-up: new evidence from linked administrative and survey data," Empirical Economics, Springer, vol. 61(3), pages 1567-1616, September.
    19. Molinari, Francesca, 2008. "Partial identification of probability distributions with misclassified data," Journal of Econometrics, Elsevier, vol. 144(1), pages 81-117, May.
    20. Digvijay S. Negi, 2022. "Global food price surge, in-kind transfers, and household welfare evidence from India," Indira Gandhi Institute of Development Research, Mumbai Working Papers 2022-006, Indira Gandhi Institute of Development Research, Mumbai, India.
    21. Erich Battistin & Barbara Sianesi, 2011. "Misclassified Treatment Status and Treatment Effects: An Application to Returns to Education in the United Kingdom," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 495-509, May.
    22. Jeffrey A. Groen & Anne E. Polivka, 2008. "The Effect of Hurricane Katrina on the Labor Market Outcomes of Evacuees," Working Papers 415, U.S. Bureau of Labor Statistics.
    23. Steven J. Haider & Melvin Stephens Jr., 2020. "Correcting for Misclassified Binary Regressors Using Instrumental Variables," NBER Working Papers 27797, National Bureau of Economic Research, Inc.
    24. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    25. Battistin, Erich & De Nadai, Michele & Sianesi, Barbara, 2014. "Misreported schooling, multiple measures and returns to educational qualifications," Journal of Econometrics, Elsevier, vol. 181(2), pages 136-150.
    26. Brent Kreider & John V. Pepper & Craig Gundersen & Dean Jolliffe, 2012. "Identifying the Effects of SNAP (Food Stamps) on Child Health Outcomes When Participation Is Endogenous and Misreported," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(499), pages 958-975, September.
    27. Nguimkeu, Pierre & Denteh, Augustine & Tchernis, Rusty, 2019. "On the estimation of treatment effects with endogenous misreporting," Journal of Econometrics, Elsevier, vol. 208(2), pages 487-506.
    28. Jha, Shikha & Kotwal, Ashok & Ramaswami, Bharat, 2013. "Safety Nets and Food Programs in Asia: A Comparative Perspective," ADB Economics Working Paper Series 371, Asian Development Bank.
    29. Arthur Lewbel, 2007. "Estimation of Average Treatment Effects with Misclassification," Econometrica, Econometric Society, vol. 75(2), pages 537-551, March.
    30. Vivi Alatas & Abhijit Banerjee & Rema Hanna & Benjamin A. Olken & Julia Tobias, 2012. "Targeting the Poor: Evidence from a Field Experiment in Indonesia," American Economic Review, American Economic Association, vol. 102(4), pages 1206-1240, June.
    31. Frazis, Harley & Loewenstein, Mark A., 2003. "Estimating linear regressions with mismeasured, possibly endogenous, binary explanatory variables," Journal of Econometrics, Elsevier, vol. 117(1), pages 151-178, November.
    32. Takahide Yanagi, 2019. "Inference on local average treatment effects for misclassified treatment," Econometric Reviews, Taylor & Francis Journals, vol. 38(8), pages 938-960, September.
    33. Meyer, Bruce D. & Mittag, Nikolas, 2017. "Misclassification in binary choice models," Journal of Econometrics, Elsevier, vol. 200(2), pages 295-311.
    34. AIGNER, Dennis J., 1973. "Regression with a binary independent variable subject to errors of observation," LIDAM Reprints CORE 130, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    35. Negi, Digvijay S., 2022. "Global food price surge, in-kind transfers and household welfare: Evidence from India," World Development, Elsevier, vol. 158(C).
    36. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    37. Card, David, 1996. "The Effect of Unions on the Structure of Wages: A Longitudinal Analysis," Econometrica, Econometric Society, vol. 64(4), pages 957-979, July.
    38. Lisa Cameron & Manisha Shah, 2014. "Can Mistargeting Destroy Social Capital and Stimulate Crime? Evidence from a Cash Transfer Program in Indonesia," Economic Development and Cultural Change, University of Chicago Press, vol. 62(2), pages 381-415.
    39. Prabhu Pingali & Anaka Aiyar & Mathew Abraham & Andaleeb Rahman, 2019. "Transforming Food Systems for a Rising India," Palgrave Studies in Agricultural Economics and Food Policy, Palgrave Macmillan, number 978-3-030-14409-8, August.
    40. Andrew Goodman-Bacon, 2018. "Difference-in-Differences with Variation in Treatment Timing," NBER Working Papers 25018, National Bureau of Economic Research, Inc.
    41. Aprajit Mahajan, 2006. "Identification and Estimation of Regression Models with Misclassification," Econometrica, Econometric Society, vol. 74(3), pages 631-665, May.
    42. Timothy Besley & Rohini Pande & Vijayendra Rao, 2012. "Just Rewards? Local Politics and Public Resource Allocation in South India," The World Bank Economic Review, World Bank, vol. 26(2), pages 191-216.
    43. Tohari, Achmad & Parsons, Christopher & Rammohan, Anu, 2019. "Targeting poverty under complementarities: Evidence from Indonesia's unified targeting system," Journal of Development Economics, Elsevier, vol. 140(C), pages 127-144.
    44. Sitakanta Panda, 2015. "Political Connections and Elite Capture in a Poverty Alleviation Programme in India," Journal of Development Studies, Taylor & Francis Journals, vol. 51(1), pages 50-65, January.
    45. Thomas J. Kane & Cecilia Rouse & Douglas Staiger, 1999. "Estimating Returns to Schooling When Schooling is Misreported," Working Papers 798, Princeton University, Department of Economics, Industrial Relations Section..
    46. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    47. Black, Dan & Sanders, Seth & Taylor, Lowell, 2003. "Measurement of Higher Education in the Census and Current Population Survey," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 545-554, January.
    48. Byker, Tanya & Gutierrez, Italo A., 2016. "Treatment Effects Using Inverse Probability Weighting and Contaminated Treatment Data: An Application to the Evaluation of a Government Female Sterilization Campaign in Peru," Working Papers 1118-1, RAND Corporation.
    49. Bollinger, Christopher R., 1996. "Bounding mean regressions when a binary regressor is mismeasured," Journal of Econometrics, Elsevier, vol. 73(2), pages 387-399, August.
    50. Poirier, Dale J., 1980. "Partial observability in bivariate probit models," Journal of Econometrics, Elsevier, vol. 12(2), pages 209-217, February.
    51. Tanya Byker & Italo A. Gutierrez, 2016. "Treatment Effects Using Inverse Probability Weighting and Contaminated Treatment Data An Application to the Evaluation of a Government Female Sterilization Campaign in Peru," Working Papers WR-1118-1, RAND Corporation.
    52. Hu, Yingyao, 2008. "Identification and estimation of nonlinear models with misclassification error using instrumental variables: A general solution," Journal of Econometrics, Elsevier, vol. 144(1), pages 27-61, May.
    53. Prabhu Pingali & Anaka Aiyar & Mathew Abraham & Andaleeb Rahman, 2019. "Reimagining Safety Net Programs," Palgrave Studies in Agricultural Economics and Food Policy, in: Transforming Food Systems for a Rising India, chapter 0, pages 135-164, Palgrave Macmillan.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    2. Acerenza, Santiago & Ban, Kyunghoon & Kedagni, Desire, 2021. "Marginal Treatment Effects with Misclassified Treatment," ISU General Staff Papers 202106180700001132, Iowa State University, Department of Economics.
    3. Steven J. Haider & Melvin Stephens Jr., 2020. "Correcting for Misclassified Binary Regressors Using Instrumental Variables," NBER Working Papers 27797, National Bureau of Economic Research, Inc.
    4. DiTraglia, Francis J. & García-Jimeno, Camilo, 2019. "Identifying the effect of a mis-classified, binary, endogenous regressor," Journal of Econometrics, Elsevier, vol. 209(2), pages 376-390.
    5. Wossen, Tesfamicheal & Abay, Kibrom A. & Abdoulaye, Tahirou, 2022. "Misperceiving and misreporting input quality: Implications for input use and productivity," Journal of Development Economics, Elsevier, vol. 157(C).
    6. Takahide Yanagi, 2019. "Inference on local average treatment effects for misclassified treatment," Econometric Reviews, Taylor & Francis Journals, vol. 38(8), pages 938-960, September.
    7. Francis J. DiTraglia & Camilo Garcia-Jimeno, 2020. "Identifying the effect of a mis-classified, binary, endogenous regressor," Papers 2011.07272, arXiv.org.
    8. Augustine Denteh & D'esir'e K'edagni, 2022. "Misclassification in Difference-in-differences Models," Papers 2207.11890, arXiv.org, revised Jul 2022.
    9. Nguimkeu, Pierre & Denteh, Augustine & Tchernis, Rusty, 2019. "On the estimation of treatment effects with endogenous misreporting," Journal of Econometrics, Elsevier, vol. 208(2), pages 487-506.
    10. Francis J. DiTraglia & Camilo García-Jimeno, 2017. "Mis-classified, Binary, Endogenous Regressors: Identification and Inference," NBER Working Papers 23814, National Bureau of Economic Research, Inc.
    11. Battistin, Erich & De Nadai, Michele & Sianesi, Barbara, 2014. "Misreported schooling, multiple measures and returns to educational qualifications," Journal of Econometrics, Elsevier, vol. 181(2), pages 136-150.
    12. Kasahara, Hiroyuki & Shimotsu, Katsumi, 2022. "Identification Of Regression Models With A Misclassified And Endogenous Binary Regressor," Econometric Theory, Cambridge University Press, vol. 38(6), pages 1117-1139, December.
    13. Denni Tommasi & Arthur Lewbel & Rossella Calvi, 2017. "LATE with Mismeasured or Misspecified Treatment: An application to Women's Empowerment in India," Working Papers ECARES ECARES 2017-27, ULB -- Universite Libre de Bruxelles.
    14. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Third Version," PIER Working Paper Archive 15-040, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 24 Nov 2015.
    15. Erich Battistin & Barbara Sianesi, 2006. "Misreported schooling and returns to education: evidence from the UK," CeMMAP working papers CWP07/06, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    16. Battistin, Erich & De Nadai, Michele & Vuri, Daniela, 2017. "Counting rotten apples: Student achievement and score manipulation in Italian elementary Schools," Journal of Econometrics, Elsevier, vol. 200(2), pages 344-362.
    17. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Second Version," PIER Working Paper Archive 15-039, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 11 Nov 2015.
    18. Orville Mondal & Rui Wang, 2024. "Partial Identification of Binary Choice Models with Misreported Outcomes," Papers 2401.17137, arXiv.org.
    19. Kyung Min Kang & Robert A. Moffitt, 2019. "The Effect of SNAP and School Food Programs on Food Security, Diet Quality, and Food Spending: Sensitivity to Program Reporting Error," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 156-201, July.
    20. Zhang, Han, 2021. "How Using Machine Learning Classification as a Variable in Regression Leads to Attenuation Bias and What to Do About It," SocArXiv 453jk, Center for Open Science.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2208.02412. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.