IDEAS home Printed from https://ideas.repec.org/p/cen/wpaper/11-14.html
   My bibliography  Save this paper

Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation

Author

Listed:
  • Bruce Meyer
  • Robert Goerge

Abstract

Benefit receipt in major household surveys is often underreported. This misreporting leads to biased estimates of the economic circumstances of disadvantaged populations, program takeup, and the distributional effects of government programs, and other program effects. We use administrative data on Food Stamp Program (FSP) participation matched to American Community Survey (ACS) and Current Population Survey (CPS) household data. We show that nearly thirty-five percent of true recipient households do not report receipt in the ACS and fifty percent do not report receipt in the CPS. Misreporting, both false negatives and false positives, varies with individual characteristics, leading to complicated biases in FSP analyses. We then directly examine the determinants of program receipt using our combined administrative and survey data. The combined data allow us to examine accurate participation using individual characteristics missing in administrative data. Our results differ from conventional estimates using only survey data, as such estimates understate participation by single parents, non-whites, low income households, and other groups. To evaluate the use of Census Bureau imputed ACS and CPS data, we also examine whether our estimates using survey data alone are closer to those using the accurate combined data when imputed survey observations are excluded. Interestingly, excluding the imputed observations leads to worse ACS estimates, but has less effect on the CPS estimates.

Suggested Citation

  • Bruce Meyer & Robert Goerge, 2011. "Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation," Working Papers 11-14, Center for Economic Studies, U.S. Census Bureau.
  • Handle: RePEc:cen:wpaper:11-14
    as

    Download full text from publisher

    File URL: https://www2.census.gov/ces/wp/2011/CES-WP-11-14.pdf
    File Function: First version, 2011
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bruce D. Meyer & James X. Sullivan, 2003. "Measuring the Well-Being of the Poor Using Income and Consumption," NBER Working Papers 9760, National Bureau of Economic Research, Inc.
    2. Guell, Maia & Hu, Luojia, 2006. "Estimating the probability of leaving unemployment using uncompleted spells from repeated cross-section data," Journal of Econometrics, Elsevier, vol. 133(1), pages 307-341, July.
    3. Keane, Michael & Moffitt, Robert, 1998. "A Structural Model of Multiple Welfare Program Participation and Labor Supply," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(3), pages 553-589, August.
    4. Lorenzo Almada & Ian McCarthy & Rusty Tchernis, 2016. "What Can We Learn about the Effects of Food Stamps on Obesity in the Presence of Misreporting?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(4), pages 997-1017.
    5. Bruce D. Meyer & James X. Sullivan, 2006. "Consumption, Income, and Material Well-Being After Welfare Reform," NBER Working Papers 11976, National Bureau of Economic Research, Inc.
    6. Bishop, John A & Formby, John P & Zeager, Lester A, 1996. "The Impact of Food Stamps on US Poverty in the 1980s: A Marginal Dominance Analysis," Economica, London School of Economics and Political Science, vol. 63(250), pages 141-162, Suppl..
    7. repec:mpr:mprres:6095 is not listed on IDEAS
    8. Fraker, Thomas & Moffitt, Robert, 1988. "The effect of food stamps on labor supply : A bivariate selection model," Journal of Public Economics, Elsevier, vol. 35(1), pages 25-56, February.
    9. Rebecca M. Blank & Patricia Ruggles, 1993. "When Do Women Use AFDC & Food Stamps? The Dynamics of Eligibility vs. Participation," NBER Working Papers 4429, National Bureau of Economic Research, Inc.
    10. Bruce D. Meyer & Wallace K. C. Mok & James X. Sullivan, 2009. "The Under-Reporting of Transfers in Household Surveys: Its Nature and Consequences," NBER Working Papers 15181, National Bureau of Economic Research, Inc.
    11. repec:mpr:mprres:5136 is not listed on IDEAS
    12. David Card & Andrew K. G. Hildreth & Lara D. Shore-Sheppard, 2001. "The Measurement of Medicaid Coverage in the SIPP: Evidence from California, 1990-1996," NBER Working Papers 8514, National Bureau of Economic Research, Inc.
    13. Karen E. Cunnyngham, "undated". "Reaching Those in Need: State Supplemental Nutrition Assistance Program Participation Rates in 2010," Mathematica Policy Research Reports 53f19dadfd8c4b80ac3b6fd51, Mathematica Policy Research.
    14. Bollinger, Christopher R & David, Martin H, 2001. "Estimation with Response Error and Nonresponse: Food-Stamp Participation in the SIPP," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(2), pages 129-141, April.
    15. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    16. Douglas Almond & Hilary W. Hoynes & Diane Whitmore Schanzenbach, 2011. "Inside the War on Poverty: The Impact of Food Stamps on Birth Outcomes," The Review of Economics and Statistics, MIT Press, vol. 93(2), pages 387-403, May.
    17. Dean Jolliffe & Craig Gundersen & Laura Tiehen & Joshua Winicki, 2005. "Food Stamp Benefits and Child Poverty," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(3), pages 569-581.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bruce D. Meyer & Wallace K. C. Mok & James X. Sullivan, 2009. "The Under-Reporting of Transfers in Household Surveys: Its Nature and Consequences," NBER Working Papers 15181, National Bureau of Economic Research, Inc.
    2. Meyer, Bruce D. & Mittag, Nikolas & Goerge, Robert M., 2018. "Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation," IZA Discussion Papers 11776, Institute of Labor Economics (IZA).
    3. Tiehen, Laura & Jolliffe, Dean & Gundersen, Craig, 2012. "How State Policies Influence the Efficacy of the Supplemental Nutrition Assistance Program in Reducing Poverty," 2012 Annual Meeting, August 12-14, 2012, Seattle, Washington 124937, Agricultural and Applied Economics Association.
    4. Cathleen Li, 2013. "Bias In Food Stamps Participation Estimates In The Presence Of Misreporting Error," Working Papers 13-13, Center for Economic Studies, U.S. Census Bureau.
    5. Mittag, Nikolas, 2016. "Correcting for Misreporting of Government Benefits," IZA Discussion Papers 10266, Institute of Labor Economics (IZA).
    6. Bruckmeier, Kerstin & Riphahn, Regina T. & Wiemers, Jürgen, 2019. "Benefit underreporting in survey data and its consequences for measuring non-take-up: new evidence from linked administrative and survey data," IAB-Discussion Paper 201906, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    7. Helen H. Jensen & Brent Kreider & Oleksandr Zhylyevskyy, 2019. "Investigating Treatment Effects of Participating Jointly in SNAP and WIC when the Treatment Is Validated Only for SNAP," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 124-155, July.
    8. Hilary W. Hoynes & Diane Whitmore Schanzenbach, 2009. "Consumption Responses to In-Kind Transfers: Evidence from the Introduction of the Food Stamp Program," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 109-139, October.
    9. Janet Currie & Firouz Gahvari, 2008. "Transfers in Cash and In-Kind: Theory Meets the Data," Journal of Economic Literature, American Economic Association, vol. 46(2), pages 333-383, June.
    10. Timothy F. Harris, 2021. "Do Snap Work Requirements Work?," Economic Inquiry, Western Economic Association International, vol. 59(1), pages 72-94, January.
    11. Ha Trong Nguyen & Huong Thu Le & Luke Connelly & Francis Mitrou, 2023. "Accuracy of self‐reported private health insurance coverage," Health Economics, John Wiley & Sons, Ltd., vol. 32(12), pages 2709-2729, December.
    12. P. A. Smith, "undated". "The Effect of the 1981 Welfare Reforms on AFDC Participation and Labor Supply," Institute for Research on Poverty Discussion Papers 1117-97, University of Wisconsin Institute for Research on Poverty.
    13. Dickert, Stacy & Houser, Scott & Scholz, John Karl, 1994. "Taxes and the Poor: A Microsimulation Study of Implicit and Explicit Taxes," National Tax Journal, National Tax Association;National Tax Journal, vol. 47(3), pages 621-638, September.
    14. Atasoy, Sibel & Mills, Bradford F. & Mykerezi, Elton, 2008. "Intensity of Food Stamp Use and Transient and Chronic Poverty: Evidence from the Panel Study of Income Dynamics," 2008 Annual Meeting, July 27-29, 2008, Orlando, Florida 6541, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    15. East, Chloe N., 2018. "Immigrants’ labor supply response to Food Stamp access," Labour Economics, Elsevier, vol. 51(C), pages 202-226.
    16. Mykerezi, Elton & Mills, Bradford F., 2009. "On Intra-Annual Poverty in the U.S.: Prevalence, Causes and Response to Food Stamp Program Use," Staff Papers 49095, University of Minnesota, Department of Applied Economics.
    17. Ilyar Heydari Barardehi & Patryk Babiarz & Teresa Mauldin, 2020. "Child Support, Consumption, and Labor Supply Decisions of Single-Mother Families," Journal of Family and Economic Issues, Springer, vol. 41(3), pages 530-541, September.
    18. Bharadwaj, Prashant & Pai, Mallesh M. & Suziedelyte, Agne, 2017. "Mental health stigma," Economics Letters, Elsevier, vol. 159(C), pages 57-60.
    19. Christopher Wimer & Liana Fox & Irwin Garfinkel & Neeraj Kaushal & JaeHyun Nam & Jane Waldfogel, 2021. "Trends in the Economic Wellbeing of Unmarried-Parent Families with Children: New Estimates Using an Improved Measure of Poverty," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 40(6), pages 1253-1276, December.
    20. Fayaz Farkhad, Bita & Meyerhoefer, Chad D., 2018. "The Impact of Participation in SNAP on Labor Force Decisions," 2018 Annual Meeting, August 5-7, Washington, D.C. 274180, Agricultural and Applied Economics Association.

    More about this item

    Keywords

    Measurement error; Survey errors; program takeup; food stamps; underreporting; imputation; poverty;
    All these keywords.

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • D31 - Microeconomics - - Distribution - - - Personal Income and Wealth Distribution
    • I32 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Measurement and Analysis of Poverty
    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cen:wpaper:11-14. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dawn Anderson (email available below). General contact details of provider: https://edirc.repec.org/data/cesgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.