IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp11412.html
   My bibliography  Save this paper

Estimating the Associations between SNAP and Food Insecurity, Obesity, and Food Purchases with Imperfect Administrative Measures of Participation

Author

Listed:
  • Courtemanche, Charles

    () (Georgia State University)

  • Denteh, Augustine

    () (Georgia State University)

  • Tchernis, Rusty

    () (Georgia State University)

Abstract

Administrative data are considered the "gold standard" when measuring program participation, but little evidence exists on the potential problems with administrative records or their implications for econometric estimates. We explore issues with administrative data using the FoodAPS, a unique dataset that contains two different administrative measures of Supplemental Nutrition Assistance Pro-gram (SNAP) participation as well as a survey-based measure. We first document substantial ambiguity in the two administrative participation variables and show that they disagree with each other almost as often as they disagree with self-reported participation.Estimated participation and misreporting rates can be meaningfully sensitive to choices made to resolve this ambiguity and disagreement. We then document similar sensitivity in regression estimates of the associations between SNAP and food insecurity, obesity, and the Healthy Eating Index. These results serve as a cautionary tale about uncritically relying on linked administrative records when conducting program evaluation research.

Suggested Citation

  • Courtemanche, Charles & Denteh, Augustine & Tchernis, Rusty, 2018. "Estimating the Associations between SNAP and Food Insecurity, Obesity, and Food Purchases with Imperfect Administrative Measures of Participation," IZA Discussion Papers 11412, Institute for the Study of Labor (IZA).
  • Handle: RePEc:iza:izadps:dp11412
    as

    Download full text from publisher

    File URL: http://ftp.iza.org/dp11412.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Aigner, Dennis J., 1973. "Regression with a binary independent variable subject to errors of observation," Journal of Econometrics, Elsevier, vol. 1(1), pages 49-59, March.
    2. Bruce D. Meyer & Wallace K. C. Mok & James X. Sullivan, 2015. "Household Surveys in Crisis," Journal of Economic Perspectives, American Economic Association, vol. 29(4), pages 199-226, Fall.
    3. Brent Kreider, 2010. "Regression Coefficient Identification Decay in The Presence of Infrequent Classification Errors," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1017-1023, November.
    4. Lorenzo Almada & Ian McCarthy & Rusty Tchernis, 2016. "What Can We Learn about the Effects of Food Stamps on Obesity in the Presence of Misreporting?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(4), pages 997-1017.
    5. Huffman, Sonya Kostova & Jensen, Helen H., 2003. "Do Food Assistance Programs Improve Household Food Security?: Recent Evidence From The United States," 2003 Annual meeting, July 27-30, Montreal, Canada 22219, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    6. repec:mpr:mprres:7859 is not listed on IDEAS
    7. Mittag, Nikolas, 2016. "Correcting for Misreporting of Government Benefits," IZA Discussion Papers 10266, Institute for the Study of Labor (IZA).
    8. Rusty Tchernis & Lorenzo N. Almada, 2016. "Measuring Effects of SNAP on Obesity at the Intensive Margin," Working Papers 2016-019, Human Capital and Economic Opportunity Working Group.
    9. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics,in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843 Elsevier.
    10. Arthur Lewbel, 2007. "Estimation of Average Treatment Effects with Misclassification," Econometrica, Econometric Society, vol. 75(2), pages 537-551, March.
    11. Craig Gundersen & Victor Oliveira, 2001. "The Food Stamp Program and Food Insufficiency," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 83(4), pages 875-887.
    12. Richard Volpe & Abigail Okrent & Ephraim Leibtag, 2013. "The Effect of Supercenter-format Stores on the Healthfulness of Consumers' Grocery Purchases," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 95(3), pages 568-589.
    13. Brent Kreider & John V. Pepper & Craig Gundersen & Dean Jolliffe, 2012. "Identifying the Effects of SNAP (Food Stamps) on Child Health Outcomes When Participation Is Endogenous and Misreported," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(499), pages 958-975, September.
    14. repec:oup:revage:v:27:y:2005:i:3:p:425-432. is not listed on IDEAS
    15. Charles J. Courtemanche & Joshua C. Pinkston & Christopher J. Ruhm & George L. Wehby, 2016. "Can Changing Economic Factors Explain the Rise in Obesity?," Southern Economic Journal, Southern Economic Association, vol. 82(4), pages 1266-1310, April.
    16. Lucie Schmidt & Lara Shore-Sheppard & Tara Watson, 2016. "The Effect of Safety-Net Programs on Food Insecurity," Journal of Human Resources, University of Wisconsin Press, vol. 51(3), pages 589-614.
    17. Parke Wilde & Mark Nord, 2005. "The Effect of Food Stamps on Food Security: A Panel Data Approach ," Review of Agricultural Economics, Agricultural and Applied Economics Association, vol. 27(3), pages 425-432.
    18. Pierre Nguimkeu & Augustine Denteh & Rusty Tchernis, 2017. "On the Estimation of Treatment Effects with Endogenous Misreporting," NBER Working Papers 24117, National Bureau of Economic Research, Inc.
    19. Meyerhoefer, Chad D. & Pylypchuk, Vuriy, 2008. "AJAE Appendix: Does Participation in the Food Stamp Program Increase the Prevalence of Obesity and Health Care Spending?," American Journal of Agricultural Economics APPENDICES, Agricultural and Applied Economics Association, vol. 0(Number 2), pages 1-6.
    20. AIGNER, Dennis J., 1973. "Regression with a binary independent variable subject to errors of observation," CORE Discussion Papers RP 130, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    21. Marianne P. Bitler & Janet Currie, 2005. "Does WIC work? The effects of WIC on pregnancy and birth outcomes," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 24(1), pages 73-91.
    22. James Mabli & Jim Ohls & Lisa Dragoset & Laura Castner & Betsy Santos, 2013. "Measuring the Effect of Supplemental Nutrition Assistance Program (SNAP) Participation on Food Security," Mathematica Policy Research Reports 69d901432c7a46779666a240a, Mathematica Policy Research.
    23. repec:mpr:mprres:8081 is not listed on IDEAS
    24. repec:mpr:mprres:7860 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    Supplemental Nutrition Assistance Program; food stamps; SNAP; food insecurity; obesity; body mass index; food purchases; food expenditures; healthy eating index; misreporting; measurement error;

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • H51 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Health
    • I12 - Health, Education, and Welfare - - Health - - - Health Behavior
    • I18 - Health, Education, and Welfare - - Health - - - Government Policy; Regulation; Public Health

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp11412. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mark Fallak). General contact details of provider: http://www.iza.org .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.