IDEAS home Printed from https://ideas.repec.org/p/cen/wpaper/13-28.html
   My bibliography  Save this paper

A Method Of Correcting For Misreporting Applied To The Food Stamp Program

Author

Listed:
  • Nikolas Mittag

Abstract

Survey misreporting is known to be pervasive and bias common statistical analyses. In this paper, I first use administrative data on SNAP receipt and amounts linked to American Community Survey data from New York State to show that survey data can misrepresent the program in important ways. For example, more than 1.4 billion dollars received are not reported in New York State alone. 46 percent of dollars received by house- holds with annual income above the poverty line are not reported in the survey data, while only 19 percent are missing below the poverty line. Standard corrections for measurement error cannot remove these biases. I then develop a method to obtain consistent estimates by combining parameter estimates from the linked data with publicly available data. This conditional density method recovers the correct estimates using public use data only, which solves the problem that access to linked administrative data is usually restricted. I examine the degree to which this approach can be used to extrapolate across time and geography, in order to solve the problem that validation data is often based on a convenience sample. I present evidence from within New York State that the extent of heterogeneity is small enough to make extrapolation work well across both time and geography. Extrapolation to the entire U.S. yields substantive differences to survey data and reduces deviations from official aggregates by a factor of 4 to 9 compared to survey aggregates.

Suggested Citation

  • Nikolas Mittag, 2013. "A Method Of Correcting For Misreporting Applied To The Food Stamp Program," Working Papers 13-28, Center for Economic Studies, U.S. Census Bureau.
  • Handle: RePEc:cen:wpaper:13-28
    as

    Download full text from publisher

    File URL: https://www2.census.gov/ces/wp/2013/CES-WP-13-28.pdf
    File Function: First version, 2013
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Hilary W. Hoynes & Diane Whitmore Schanzenbach, 2009. "Consumption Responses to In-Kind Transfers: Evidence from the Introduction of the Food Stamp Program," American Economic Journal: Applied Economics, American Economic Association, vol. 1(4), pages 109-139, October.
    2. Bruce D. Meyer & James X. Sullivan, 2003. "Measuring the Well-Being of the Poor Using Income and Consumption," NBER Working Papers 9760, National Bureau of Economic Research, Inc.
    3. Li, Tong, 2000. "Estimation of nonlinear errors-in-variables models: a simulated minimum distance estimator," Statistics & Probability Letters, Elsevier, vol. 47(3), pages 243-248, April.
    4. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    5. Bound, John & Krueger, Alan B, 1991. "The Extent of Measurement Error in Longitudinal Earnings Data: Do Two Wrongs Make a Right?," Journal of Labor Economics, University of Chicago Press, vol. 9(1), pages 1-24, January.
    6. John Abowd & Martha Stinson, 2011. "Estimating Measurement Error in SIPP Annual Job Earnings: A Comparison of Census Bureau Survey and SSA Administrative Data," Working Papers 11-20, Center for Economic Studies, U.S. Census Bureau.
    7. Craig Gundersen & Brent Kreider, 2008. "Food Stamps and Food Insecurity: What Can Be Learned in the Presence of Nonclassical Measurement Error?," Journal of Human Resources, University of Wisconsin Press, vol. 43(2), pages 352-382.
    8. Stéphane Bonhomme & Jean-Marc Robin, 2010. "Generalized Non-Parametric Deconvolution with an Application to Earnings Dynamics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 77(2), pages 491-533.
    9. Guido W. Imbens & Tony Lancaster, 1994. "Combining Micro and Macro Data in Microeconometric Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(4), pages 655-680.
    10. Christopher R. Bollinger, 2003. "Measurement Error in Human Capital and the Black-White Wage Gap," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 578-585, August.
    11. Martin H. David & Christopher R. Bollinger, 2005. "I didn't tell, and I won't tell: dynamic response error in the SIPP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(4), pages 563-569.
    12. Black, Dan & Sanders, Seth & Taylor, Lowell, 2003. "Measurement of Higher Education in the Census and Current Population Survey," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 545-554, January.
    13. Brownstone, David & Valletta, Robert G, 1996. "Modeling Earnings Measurement Error: A Multiple Imputation Approach," The Review of Economics and Statistics, MIT Press, vol. 78(4), pages 705-717, November.
    14. Hsiao, Cheng, 1989. "Consistent estimation for some nonlinear errors-in-variables models," Journal of Econometrics, Elsevier, vol. 41(1), pages 159-185, May.
    15. Dan A. Black & Jeffrey A. Smith, 2006. "Estimating the Returns to College Quality with Multiple Proxies for Quality," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 701-728, July.
    16. Yingyao Hu & Geert Ridder, 2012. "Estimation of nonlinear models with mismeasured regressors using marginal information," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(3), pages 347-385, April.
    17. Susanne M. Schennach, 2004. "Estimation of Nonlinear Models with Measurement Error," Econometrica, Econometric Society, vol. 72(1), pages 33-75, January.
    18. Paul A. Hagstrom, 1996. "The Food Stamp Participation and Labor Supply of Married Couples: An Empirical Analysis of Joint Decisions," Journal of Human Resources, University of Wisconsin Press, vol. 31(2), pages 383-403.
    19. Diane Whitmore, 2002. "What Are Food Stamps Worth?," Working Papers 847, Princeton University, Department of Economics, Industrial Relations Section..
    20. Janet Currie & Firouz Gahvari, 2008. "Transfers in Cash and In-Kind: Theory Meets the Data," Journal of Economic Literature, American Economic Association, vol. 46(2), pages 333-383, June.
    21. Bollinger, Christopher R, 1998. "Measurement Error in the Current Population Survey: A Nonparametric Look," Journal of Labor Economics, University of Chicago Press, vol. 16(3), pages 576-594, July.
    22. Tiehen, Laura & Jolliffe, Dean & Gundersen, Craig, 2012. "Alleviating Poverty in the United States: The Critical Role of SNAP Benefits," Economic Research Report 262233, United States Department of Agriculture, Economic Research Service.
    23. Drechsler, Jörg & Reiter, Jerome P., 2010. "Sampling With Synthesis: A New Approach for Releasing Public Use Census Microdata," Journal of the American Statistical Association, American Statistical Association, vol. 105(492), pages 1347-1357.
    24. Li, Tong, 2002. "Robust and consistent estimation of nonlinear errors-in-variables models," Journal of Econometrics, Elsevier, vol. 110(1), pages 1-26, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Surveys in Crisis
      by noreply@blogger.com (Carola) in Quantitative Ease on 2015-08-01 00:31:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bruce D. Meyer & Nikolas Mittag, 2015. "Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness and Holes in the Safety Net," Upjohn Working Papers 15-242, W.E. Upjohn Institute for Employment Research.
    2. Charles Courtemanche & Augustine Denteh & Rusty Tchernis, 2019. "Estimating the Associations between SNAP and Food Insecurity, Obesity, and Food Purchases with Imperfect Administrative Measures of Participation," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 202-228, July.
    3. Benjamin Cerf Harris, 2014. "Within and Across County Variation in SNAP Misreporting: Evidence from Linked ACS and Administrative Records," CARRA Working Papers 2014-05, Center for Economic Studies, U.S. Census Bureau.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mittag, Nikolas, 2016. "Correcting for Misreporting of Government Benefits," IZA Discussion Papers 10266, Institute of Labor Economics (IZA).
    2. Song, Suyong, 2015. "Semiparametric estimation of models with conditional moment restrictions in the presence of nonclassical measurement errors," Journal of Econometrics, Elsevier, vol. 185(1), pages 95-109.
    3. Susanne M. Schennach, 2012. "Measurement error in nonlinear models - a review," CeMMAP working papers 41/12, Institute for Fiscal Studies.
    4. Yingyao Hu & Geert Ridder, 2012. "Estimation of nonlinear models with mismeasured regressors using marginal information," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(3), pages 347-385, April.
    5. Xiaohong Chen & Yingyao Hu, 2006. "Identification and Inference of Nonlinear Models Using Two Samples with Arbitrary Measurement Errors," Cowles Foundation Discussion Papers 1590, Cowles Foundation for Research in Economics, Yale University.
    6. Schennach, Susanne M., 2019. "Convolution without independence," Journal of Econometrics, Elsevier, vol. 211(1), pages 308-318.
    7. Xiaohong Chen & Han Hong & Alessandro Tarozzi, 2008. "Semiparametric Efficiency in GMM Models of Nonclassical Measurement Errors, Missing Data and Treatment Effects," Cowles Foundation Discussion Papers 1644, Cowles Foundation for Research in Economics, Yale University.
    8. Yingyao Hu & Susanne M. Schennach, 2008. "Instrumental Variable Treatment of Nonclassical Measurement Error Models," Econometrica, Econometric Society, vol. 76(1), pages 195-216, January.
    9. Geert Ridder & Yingyao Hu, 2004. "Estimation of Nonlinear Models with Measurement Error Using Marginal Information," Econometric Society 2004 North American Summer Meetings 21, Econometric Society.
    10. Xiaohong Chen & Han Hong & Denis Nekipelov, 2011. "Nonlinear Models of Measurement Errors," Journal of Economic Literature, American Economic Association, vol. 49(4), pages 901-937, December.
    11. Tiehen, Laura & Jolliffe, Dean & Gundersen, Craig, 2012. "How State Policies Influence the Efficacy of the Supplemental Nutrition Assistance Program in Reducing Poverty," 2012 Annual Meeting, August 12-14, 2012, Seattle, Washington 124937, Agricultural and Applied Economics Association.
    12. Meyer, Bruce D. & Mittag, Nikolas, 2019. "Combining Administrative and Survey Data to Improve Income Measurement," IZA Discussion Papers 12266, Institute of Labor Economics (IZA).
    13. Fisher, Jonathan D. & Houseworth, Christina A., 2013. "Occupation inflation in the Current Population Survey," Journal of Economic and Social Measurement, IOS Press, issue 3, pages 243-261.
    14. Engzell, Per, 2017. "What Do Books in the Home Proxy For? A Cautionary Tale," Working Paper Series 1/2016, Stockholm University, Swedish Institute for Social Research.
    15. Li, Tong, 2002. "Robust and consistent estimation of nonlinear errors-in-variables models," Journal of Econometrics, Elsevier, vol. 110(1), pages 1-26, September.
    16. Hu, Yingyao, 2017. "The Econometrics of Unobservables -- Latent Variable and Measurement Error Models and Their Applications in Empirical Industrial Organization and Labor Economics [The Econometrics of Unobservables]," Economics Working Paper Archive 64578, The Johns Hopkins University,Department of Economics, revised 2021.
    17. Yonghong An & Wang Le & Ruli Xiao, 2015. "Your American Dream is Not Mine! A New Approach to Estimating Intergenerational Mobility Elasticities," CAEPR Working Papers 2015-016, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    18. Hu, Yingyao & Schennach, Susanne & Shiu, Ji-Liang, 2022. "Identification of nonparametric monotonic regression models with continuous nonclassical measurement errors," Journal of Econometrics, Elsevier, vol. 226(2), pages 269-294.
    19. Li, Tong & Hsiao, Cheng, 2004. "Robust estimation of generalized linear models with measurement errors," Journal of Econometrics, Elsevier, vol. 118(1-2), pages 51-65.
    20. An, Yonghong & Hu, Yingyao, 2012. "Well-posedness of measurement error models for self-reported data," Journal of Econometrics, Elsevier, vol. 168(2), pages 259-269.

    More about this item

    Keywords

    measurement error; survey errors; misreporting; food stamps; poverty.;
    All these keywords.

    JEL classification:

    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • I32 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Measurement and Analysis of Poverty
    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cen:wpaper:13-28. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dawn Anderson (email available below). General contact details of provider: https://edirc.repec.org/data/cesgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.