IDEAS home Printed from https://ideas.repec.org/a/spr/empeco/v61y2021i3d10.1007_s00181-020-01921-4.html
   My bibliography  Save this article

Misreporting of program take-up in survey data and its consequences for measuring non-take-up: new evidence from linked administrative and survey data

Author

Listed:
  • Kerstin Bruckmeier

    (IAB)

  • Regina T. Riphahn

    (Friedrich-Alexander-University Erlangen-Nürnberg)

  • Jürgen Wiemers

    (IAB)

Abstract

The international literature studies non-take-up behavior of eligible populations to evaluate the effectiveness of government programs. A major challenge in this literature is the measurement error regarding benefit take-up. In our data, we observe both actual welfare receipt and respondents’ survey information on their program take-up. This allows us to observe the measurement errors that other researchers must estimate. We describe survey misreporting and investigate how it biases the estimates of the magnitude and patterns of benefit take-up among eligible households. Our findings suggest that the extent of measurement error can be substantial. It varies with the characteristics of the misreporting population and is associated with the drivers of misreporting. This indicates that survey-based analyses of take-up behavior are likely subject to severe biases.

Suggested Citation

  • Kerstin Bruckmeier & Regina T. Riphahn & Jürgen Wiemers, 2021. "Misreporting of program take-up in survey data and its consequences for measuring non-take-up: new evidence from linked administrative and survey data," Empirical Economics, Springer, vol. 61(3), pages 1567-1616, September.
    • Handle: RePEc:spr:empeco:v:61:y:2021:i:3:d:10.1007_s00181-020-01921-4
    DOI: 10.1007/s00181-020-01921-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00181-020-01921-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00181-020-01921-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hernandez, Monica & Pudney, Stephen, 2007. "Measurement error in models of welfare participation," Journal of Public Economics, Elsevier, vol. 91(1-2), pages 327-341, February.
    2. Stephen Pudney & Monica Hernandez & Ruth Hancock, 2007. "The welfare cost of means-testing: pensioner participation in income support," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 22(3), pages 581-598.
    3. Bruce Meyer & Robert Goerge, 2011. "Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation," Working Papers 11-14, Center for Economic Studies, U.S. Census Bureau.
    4. repec:iab:iabfda:201206(en is not listed on IDEAS
    5. David Card & Andrew K. G. Hildreth & Lara D. Shore-Sheppard, 2001. "The Measurement of Medicaid Coverage in the SIPP: Evidence from California, 1990-1996," NBER Working Papers 8514, National Bureau of Economic Research, Inc.
    6. Bruce D. Meyer & Nikolas Mittag, 2015. "Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness and Holes in the Safety Net," Upjohn Working Papers 15-242, W.E. Upjohn Institute for Employment Research.
    7. Joachim R. Frick & Olaf Groh-Samberg, 2007. "To Claim or Not to Claim: Estimating Non-take-up of Social Assistance in Germany and the Role of Measurement Error," Discussion Papers of DIW Berlin 734, DIW Berlin, German Institute for Economic Research.
    8. Mittag, Nikolas, 2016. "Correcting for Misreporting of Government Benefits," IZA Discussion Papers 10266, Institute of Labor Economics (IZA).
    9. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    10. repec:iab:iabfda:201402(en is not listed on IDEAS
    11. Berg, Marco & Cramer, Ralph & Dickmann, Christian & Gilberg, Reiner & Jesske, Birgit & Kleudgen, Martin & Bethmann, Arne & Fuchs, Benjamin & Trappmann, Mark & Wurdack, Anja, 2014. "Codebook and documentation of the panel study 'Labour Market and Social Security' (PASS) : Datenreport wave 5," FDZ Datenreport. Documentation on Labour Market Data 201206_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    12. Regina T. Riphahn & Salwan Saif, 2019. "Naturalization and labor market performance of immigrants in Germany," LABOUR, CEIS, vol. 33(1), pages 48-76, March.
    13. Mike Brewer & Ben Etheridge & Cormac O’Dea, 2017. "Why are Households that Report the Lowest Incomes So Well‐off?," Economic Journal, Royal Economic Society, vol. 127(605), pages 24-49, October.
    14. J.J. Heckman & E.E. Leamer (ed.), 2001. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 5, number 5.
    15. Antoni, Manfred & Ganzer, Andreas & Vom Berge, Philipp, 2016. "Sample of integrated labour market biographies (SIAB) 1975-2014," FDZ Datenreport. Documentation on Labour Market Data 201604_en, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    16. Meyer, Bruce D. & Goerge, Robert M., 2011. "Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation," Contractor and Cooperator Reports 312394, United States Department of Agriculture, Economic Research Service.
    17. Stephen Whelan, 2010. "The take-up of means-tested income support," Empirical Economics, Springer, vol. 39(3), pages 847-875, December.
    18. Bruce Meyer & Nikolas Mittag, 2013. "Misclassification In Binary Choice Models," Working Papers 13-27, Center for Economic Studies, U.S. Census Bureau.
    19. Mike Brewer & Ben Etheridge & Cormac O’Dea, 2017. "Why are Households that Report the Lowest Incomes So Well‐off?," Economic Journal, Royal Economic Society, vol. 127(605), pages 24-49, October.
    20. Bruce Meyer & Nikolas Mittag, 2017. "Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness and Holes in the Safety Net," Working Papers 2017-075, Human Capital and Economic Opportunity Working Group.
    21. Zachary Parolin, 2019. "The Effect of Benefit Underreporting on Estimates of Poverty in the United States," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 869-898, July.
    22. Christopher L. Skeels & Larry W. Taylor, 2015. "Prediction in linear index models with endogenous regressors," Stata Journal, StataCorp LP, vol. 15(3), pages 627-644, September.
    23. Meyer, Bruce D. & Mittag, Nikolas, 2017. "Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness and Holes in the Safety Net," IZA Discussion Papers 10943, Institute of Labor Economics (IZA).
    24. repec:iab:iabfda:201604(en is not listed on IDEAS
    25. Meyer, Bruce D. & Mittag, Nikolas & Goerge, Robert M., 2018. "Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation," IZA Discussion Papers 11776, Institute of Labor Economics (IZA).
    26. Hug, Simon, 2010. "The Effect of Misclassifications in Probit Models: Monte Carlo Simulations and Applications," Political Analysis, Cambridge University Press, vol. 18(1), pages 78-102, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Akanksha Negi & Digvijay Singh Negi, 2022. "Difference-in-Differences with a Misclassified Treatment," Papers 2208.02412, arXiv.org.
    2. Jennifer Feichtmayer & Regina T. Riphahn, 2023. "Intergenerational Transmission of Welfare Benefit Receipt: Evidence from Germany," SOEPpapers on Multidisciplinary Panel Data Research 1201, DIW Berlin, The German Socio-Economic Panel (SOEP).
    3. Jennifer Feichtmayer & Regina T. Riphahn, 2023. "Intergenerational Transmission of Welfare Benefit Receipt: Evidence from Germany," CESifo Working Paper Series 10835, CESifo.
    4. Warwick, Ross & Harris, Tom & Phillips, David & Goldman, Maya & Jellema, Jon & Inchauste, Gabriela & Goraus-Tańska, Karolina, 2022. "The redistributive power of cash transfers vs VAT exemptions: A multi-country study," World Development, Elsevier, vol. 151(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bruckmeier, Kerstin & Riphahn, Regina T. & Wiemers, Jürgen, 2019. "Benefit underreporting in survey data and its consequences for measuring non-take-up: new evidence from linked administrative and survey data," IAB-Discussion Paper 201906, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    2. Vitor Possebom, 2021. "Crime and Mismeasured Punishment: Marginal Treatment Effect with Misclassification," Papers 2106.00536, arXiv.org, revised Jul 2023.
    3. James X. Sullivan, 2020. "A Cautionary Tale of Using Data From the Tail," Demography, Springer;Population Association of America (PAA), vol. 57(6), pages 2361-2368, December.
    4. Charles Courtemanche & Augustine Denteh & Rusty Tchernis, 2019. "Estimating the Associations between SNAP and Food Insecurity, Obesity, and Food Purchases with Imperfect Administrative Measures of Participation," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 202-228, July.
    5. Bruce D. Meyer & Derek Wu, 2018. "The Poverty Reduction of Social Security and Means-Tested Transfers," NBER Working Papers 24567, National Bureau of Economic Research, Inc.
    6. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    7. Nguimkeu, Pierre & Denteh, Augustine & Tchernis, Rusty, 2019. "On the estimation of treatment effects with endogenous misreporting," Journal of Econometrics, Elsevier, vol. 208(2), pages 487-506.
    8. Meyer, Bruce D. & Mittag, Nikolas, 2019. "Combining Administrative and Survey Data to Improve Income Measurement," IZA Discussion Papers 12266, Institute of Labor Economics (IZA).
    9. Bruce D. Meyer & Derek Wu & Victoria R. Mooers & Carla Medalia, 2019. "The use and misuse of income data and extreme poverty in the United States," AEI Economics Working Papers 1018925, American Enterprise Institute.
    10. Benjamin Cerf Harris, 2014. "Within and Across County Variation in SNAP Misreporting: Evidence from Linked ACS and Administrative Records," CARRA Working Papers 2014-05, Center for Economic Studies, U.S. Census Bureau.
    11. Zachary H. Seeskin, 2016. "Evaluating the Use of Commercial Data to Improve Survey Estimates of Property Taxes," CARRA Working Papers 2016-06, Center for Economic Studies, U.S. Census Bureau.
    12. Lidia Ceriani & Vladimir Hlasny & Paolo Verme, 2021. "Bottom Incomes and the Measurement of Poverty: A Brief Assessment of the Literature," Working Papers 589, ECINEQ, Society for the Study of Economic Inequality.
    13. Lorenzo Almada & Ian McCarthy & Rusty Tchernis, 2016. "What Can We Learn about the Effects of Food Stamps on Obesity in the Presence of Misreporting?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(4), pages 997-1017.
    14. Zachary Parolin, 2019. "The Effect of Benefit Underreporting on Estimates of Poverty in the United States," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 869-898, July.
    15. Meyer, Bruce D. & Mittag, Nikolas, 2017. "Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness and Holes in the Safety Net," IZA Discussion Papers 10943, Institute of Labor Economics (IZA).
    16. Herber, Stefanie P. & Kalinowski, Michael, 2016. "Non-take-up of Student Financial Aid: A Microsimulation for Germany," VfS Annual Conference 2016 (Augsburg): Demographic Change 145727, Verein für Socialpolitik / German Economic Association.
    17. Andrew S. Green, 2017. "Hours Off the Clock," Working Papers 17-44, Center for Economic Studies, U.S. Census Bureau.
    18. Bruce D. Meyer & Nikolas Mittag, 2019. "Combining Administrative and Survey Data to Improve Income Measurement," NBER Working Papers 25738, National Bureau of Economic Research, Inc.
    19. Herber, Stefanie P. & Kalinowski, Michael, 2016. "Non-take-up of student financial aid: A microsimulation for Germany," BERG Working Paper Series 109, Bamberg University, Bamberg Economic Research Group.
    20. Mark Brooks & Rattiya S. Lippe & Hermann Waibel, 2020. "Comprehensive data quality studies as a component of poverty assessments," TVSEP Working Papers wp-019, Leibniz Universitaet Hannover, Institute of Development and Agricultural Economics, Project TVSEP.

    More about this item

    Keywords

    Take-up; Welfare; Misreporting; Survey data; Administrative data; Data linkage;
    All these keywords.

    JEL classification:

    • I32 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Measurement and Analysis of Poverty
    • H75 - Public Economics - - State and Local Government; Intergovernmental Relations - - - State and Local Government: Health, Education, and Welfare
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:empeco:v:61:y:2021:i:3:d:10.1007_s00181-020-01921-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.