IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/24412.html
   My bibliography  Save this paper

Estimating the Associations between SNAP and Food Insecurity, Obesity, and Food Purchases with Imperfect Administrative Measures of Participation

Author

Listed:
  • Charles J. Courtemanche
  • Augustine Denteh
  • Rusty Tchernis

Abstract

Administrative data are considered the “gold standard” when measuring program participation, but little evidence exists on the potential problems with administrative records or their implications for econometric estimates. We explore issues with administrative data using the FoodAPS, a unique dataset that contains two different administrative measures of Supplemental Nutrition Assistance Program (SNAP) participation as well as a survey-based measure. We first document substantial ambiguity in the two administrative participation variables and show that they disagree with each other almost as often as they disagree with self-reported participation. Estimated participation and misreporting rates can be meaningfully sensitive to choices made to resolve this ambiguity and disagreement. We then document similar sensitivity in regression estimates of the associations between SNAP and food insecurity, obesity, and the Healthy Eating Index. These results serve as a cautionary tale about uncritically relying on linked administrative records when conducting program evaluation research.

Suggested Citation

  • Charles J. Courtemanche & Augustine Denteh & Rusty Tchernis, 2018. "Estimating the Associations between SNAP and Food Insecurity, Obesity, and Food Purchases with Imperfect Administrative Measures of Participation," NBER Working Papers 24412, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:24412
    Note: HE PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w24412.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Aigner, Dennis J., 1973. "Regression with a binary independent variable subject to errors of observation," Journal of Econometrics, Elsevier, vol. 1(1), pages 49-59, March.
    2. Bruce D. Meyer & Wallace K. C. Mok & James X. Sullivan, 2015. "Household Surveys in Crisis," Journal of Economic Perspectives, American Economic Association, vol. 29(4), pages 199-226, Fall.
    3. Brent Kreider, 2010. "Regression Coefficient Identification Decay in The Presence of Infrequent Classification Errors," The Review of Economics and Statistics, MIT Press, vol. 92(4), pages 1017-1023, November.
    4. Lorenzo Almada & Ian McCarthy & Rusty Tchernis, 2016. "What Can We Learn about the Effects of Food Stamps on Obesity in the Presence of Misreporting?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(4), pages 997-1017.
    5. Huffman, Sonya Kostova & Jensen, Helen H., 2003. "Do Food Assistance Programs Improve Household Food Security?: Recent Evidence From The United States," 2003 Annual meeting, July 27-30, Montreal, Canada 22219, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    6. repec:mpr:mprres:7859 is not listed on IDEAS
    7. Mittag, Nikolas, 2016. "Correcting for Misreporting of Government Benefits," IZA Discussion Papers 10266, Institute of Labor Economics (IZA).
    8. Almada, Lorenzo N. & Tchernis, Rusty, 2018. "Measuring effects of SNAP on obesity at the intensive margin," Economics & Human Biology, Elsevier, vol. 31(C), pages 150-163.
    9. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    10. Nguimkeu, Pierre & Denteh, Augustine & Tchernis, Rusty, 2019. "On the estimation of treatment effects with endogenous misreporting," Journal of Econometrics, Elsevier, vol. 208(2), pages 487-506.
    11. Arthur Lewbel, 2007. "Estimation of Average Treatment Effects with Misclassification," Econometrica, Econometric Society, vol. 75(2), pages 537-551, March.
    12. Charles J. Courtemanche & Joshua C. Pinkston & Christopher J. Ruhm & George L. Wehby, 2016. "Can Changing Economic Factors Explain the Rise in Obesity?," Southern Economic Journal, Southern Economic Association, vol. 82(4), pages 1266-1310, April.
    13. Craig Gundersen & Victor Oliveira, 2001. "The Food Stamp Program and Food Insufficiency," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 83(4), pages 875-887.
    14. Richard Volpe & Abigail Okrent & Ephraim Leibtag, 2013. "The Effect of Supercenter-format Stores on the Healthfulness of Consumers' Grocery Purchases," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 95(3), pages 568-589.
    15. Brent Kreider & John V. Pepper & Craig Gundersen & Dean Jolliffe, 2012. "Identifying the Effects of SNAP (Food Stamps) on Child Health Outcomes When Participation Is Endogenous and Misreported," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(499), pages 958-975, September.
    16. Parke Wilde & Mark Nord, 2005. "The Effect of Food Stamps on Food Security: A Panel Data Approach ," Review of Agricultural Economics, Agricultural and Applied Economics Association, vol. 27(3), pages 425-432.
    17. Lucie Schmidt & Lara Shore-Sheppard & Tara Watson, 2016. "The Effect of Safety-Net Programs on Food Insecurity," Journal of Human Resources, University of Wisconsin Press, vol. 51(3), pages 589-614.
    18. Meyer, Bruce D. & Mittag, Nikolas, 2018. "Misreporting of Government Transfers: How Important Are Survey Design and Geography?," IZA Discussion Papers 12038, Institute of Labor Economics (IZA).
    19. Meyerhoefer, Chad D. & Pylypchuk, Vuriy, 2008. "AJAE Appendix: Does Participation in the Food Stamp Program Increase the Prevalence of Obesity and Health Care Spending?," American Journal of Agricultural Economics APPENDICES, Agricultural and Applied Economics Association, vol. 90(2), pages 1-6.
    20. AIGNER, Dennis J., 1973. "Regression with a binary independent variable subject to errors of observation," LIDAM Reprints CORE 130, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    21. Marianne P. Bitler & Janet Currie, 2005. "Does WIC work? The effects of WIC on pregnancy and birth outcomes," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 24(1), pages 73-91.
    22. James Mabli & Jim Ohls & Lisa Dragoset & Laura Castner & Betsy Santos, "undated". "Measuring the Effect of Supplemental Nutrition Assistance Program (SNAP) Participation on Food Security," Mathematica Policy Research Reports 69d901432c7a46779666a240a, Mathematica Policy Research.
    23. repec:mpr:mprres:8081 is not listed on IDEAS
    24. repec:mpr:mprres:7860 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Meyer, Bruce D. & Mittag, Nikolas, 2018. "Misreporting of Government Transfers: How Important Are Survey Design and Geography?," IZA Discussion Papers 12038, Institute of Labor Economics (IZA).
    2. Wu, Kaidi, 2020. "The Effect of SNAP on Dietary Quality: Evidence from FoodAPS," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304462, Agricultural and Applied Economics Association.
    3. Sarah Tahamont & Zubin Jelveh & Aaron Chalfin & Shi Yan & Benjamin Hansen, 2019. "Administrative Data Linking and Statistical Power Problems in Randomized Experiments," NBER Working Papers 25657, National Bureau of Economic Research, Inc.
    4. Helen H. Jensen & Brent Kreider & Oleksandr Zhylyevskyy, 2019. "Investigating Treatment Effects of Participating Jointly in SNAP and WIC when the Treatment Is Validated Only for SNAP," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 124-155, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nguimkeu, Pierre & Denteh, Augustine & Tchernis, Rusty, 2019. "On the estimation of treatment effects with endogenous misreporting," Journal of Econometrics, Elsevier, vol. 208(2), pages 487-506.
    2. DiTraglia, Francis J. & García-Jimeno, Camilo, 2019. "Identifying the effect of a mis-classified, binary, endogenous regressor," Journal of Econometrics, Elsevier, vol. 209(2), pages 376-390.
    3. Helen H. Jensen & Brent Kreider & Oleksandr Zhylyevskyy, 2019. "Investigating Treatment Effects of Participating Jointly in SNAP and WIC when the Treatment Is Validated Only for SNAP," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 124-155, July.
    4. Susan Chen & Le Wang, 0. "SNAP participation, diet quality, and obesity: robust evidence with estimation techniques without external instrumental variables," Empirical Economics, Springer, vol. 0, pages 1-27.
    5. Hiroyuki Kasahara & Katsumi Shimotsu, 2019. "Identification of Regression Models with a Misclassified and Endogenous Binary Regressor," Papers 1904.11143, arXiv.org, revised Dec 2020.
    6. Francis J. DiTraglia & Camilo Garcia-Jimeno, 2020. "Identifying the effect of a mis-classified, binary, endogenous regressor," Papers 2011.07272, arXiv.org.
    7. Lorenzo Almada & Ian McCarthy & Rusty Tchernis, 2016. "What Can We Learn about the Effects of Food Stamps on Obesity in the Presence of Misreporting?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 98(4), pages 997-1017.
    8. Francis J. DiTraglia & Camilo García-Jimeno, 2017. "Mis-classified, Binary, Endogenous Regressors: Identification and Inference," NBER Working Papers 23814, National Bureau of Economic Research, Inc.
    9. Swann, Christopher A., 2017. "Household history, SNAP participation, and food insecurity," Food Policy, Elsevier, vol. 73(C), pages 1-9.
    10. Battistin, Erich & De Nadai, Michele & Sianesi, Barbara, 2014. "Misreported schooling, multiple measures and returns to educational qualifications," Journal of Econometrics, Elsevier, vol. 181(2), pages 136-150.
    11. Brent Kreider & Richard J. Manski & John Moeller & John Pepper, 2015. "The Effect of Dental Insurance on the Use of Dental Care for Older Adults: A Partial Identification Analysis," Health Economics, John Wiley & Sons, Ltd., vol. 24(7), pages 840-858, July.
    12. Takahide Yanagi, 2019. "Inference on local average treatment effects for misclassified treatment," Econometric Reviews, Taylor & Francis Journals, vol. 38(8), pages 938-960, September.
    13. Gundersen, Craig & Kreider, Brent, 2009. "Bounding the effects of food insecurity on children's health outcomes," Journal of Health Economics, Elsevier, vol. 28(5), pages 971-983, September.
    14. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Second Version," PIER Working Paper Archive 15-039, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 11 Nov 2015.
    15. Francis DiTraglia & Camilo Garcia-Jimeno, 2015. "On Mis-measured Binary Regressors: New Results And Some Comments on the Literature, Third Version," PIER Working Paper Archive 15-040, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 24 Nov 2015.
    16. Wossen, Tesfamicheal & Alene, Arega & Abdoulaye, Tahirou & Feleke, Shiferaw & Manyong, Victor, 2019. "Agricultural technology adoption and household welfare: Measurement and evidence," Food Policy, Elsevier, vol. 87(C), pages 1-1.
    17. Fayaz Farkhad, Bita & Meyerhoefer, Chad D., 2018. "The Impact of Participation in SNAP on Labor Force Decisions," 2018 Annual Meeting, August 5-7, Washington, D.C. 274180, Agricultural and Applied Economics Association.
    18. Kone, Zovanga L., 2018. "Intergenerational assimilation of UK immigrants in the labour market: A minor assumption with enormous implications for inference," Economics Letters, Elsevier, vol. 164(C), pages 94-99.
    19. Ranney, Christine K. & Gomez, Miguel I., 2010. "Food Stamps, Food Insufficiency and Health of the Elderly," Working Papers 126968, Cornell University, Department of Applied Economics and Management.
    20. Tiehen, Laura & Jolliffe, Dean & Gundersen, Craig, 2012. "Alleviating Poverty in the United States: The Critical Role of SNAP Benefits," Economic Research Report 262233, United States Department of Agriculture, Economic Research Service.

    More about this item

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • H51 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Health
    • I12 - Health, Education, and Welfare - - Health - - - Health Behavior
    • I18 - Health, Education, and Welfare - - Health - - - Government Policy; Regulation; Public Health

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:24412. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (). General contact details of provider: http://edirc.repec.org/data/nberrus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.