IDEAS home Printed from https://ideas.repec.org/p/ags/aaea26/404883.html

Applying Natural Language Processing to U.S. Food Retail Data to Categorize Foods by Level of Processing

Author

Listed:
  • Ehmke, Mariah
  • Okrent, Abigail
  • Awad, Koroles
  • McCluskey, Jill
  • Restrepo, Brandon

Abstract

Differentiating food products by level of industrial food processing is essential to measuring relationships among food processing, food demand, and public health. The Circana (formerly known as IRI) scanner data lacks identified measures of food product processing, but contains other food product descriptors that can be used to predict the processing of food products. This report specifies procedures to use Natural Language Processing with a Naïve Bayes model in Python’s scikit-learn to efficiently classify retail food purchases by level of food processing according to the NOVA food classification system. This method accurately predicts NOVA classification 94 percent using only the food item descriptions as predictors. Based on this classification we find 60 percent of retail food sales to be ultraprocessed in 2023, an increase from 55 percent in 2020.

Suggested Citation

  • Ehmke, Mariah & Okrent, Abigail & Awad, Koroles & McCluskey, Jill & Restrepo, Brandon, 2026. "Applying Natural Language Processing to U.S. Food Retail Data to Categorize Foods by Level of Processing," 2026 Annual Meeting, July 26 - 28, 2026, Kansas City, Missouri 404883, Agricultural and Applied Economics Association.
  • Handle: RePEc:ags:aaea26:404883
    DOI: 10.22004/ag.econ.404883
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/404883/files/AAEA_July82026.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.22004/ag.econ.404883?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Muth, Mary K. & Sweitzer, Megan & Brown, Derick & Capogrossi, Kristen & Karns, Shawn A. & Levin, David & Okrent, Abigail & Siegel, Peter & Zhen, Chen, 2016. "Understanding IRI Household-Based and Store-Based Scanner Data," Technical Bulletins 234905, United States Department of Agriculture, Economic Research Service.
    2. Okrent, Abigail & Zeballos, Eliana, 2025. "U.S. Household Food Spending Post COVID-19 and the Implications for Diet Quality," Economic Research Report 358660, United States Department of Agriculture, Economic Research Service.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Awad, Koroles & Ehmke, Mariah D. & McCluskey, Jill J. & Okrent, Abigail M., 2024. "Ultra-processed Food Demand across the Lifecycle: Implications for Obesity in the United States," 2024 Annual Meeting, July 28-30, New Orleans, LA 343976, Agricultural and Applied Economics Association.
    2. Dong, Diansheng & Stewart, Hayden & Dong, Xiao & Hahn, William, . "Quantifying Consumer Welfare Impacts of Higher Meat Prices During the COVID-19 Pandemic," Amber Waves:The Economics of Food, Farming, Natural Resources, and Rural America, United States Department of Agriculture, Economic Research Service, vol. 2022(Economic ).
    3. Ghazaryan, Armen & Bonanno, Alessandro & Carlson, Andrea, 2023. "I Say Milk, You Say Mylk: Demand Separability in a Broadened Milk Category," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 48(2), May.
    4. Elina T Page & Elizabeth Larimore & John A Kirlin & Mark Denbaly, 2019. "The National Household Food Acquisition and Purchase Survey: Innovations and Research Insights," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 41(2), pages 215-234, June.
    5. Carlson, Andrea C. & Waldrop, Megan, "undated". "Estimating Retail Organic Price Premiums for Snack Foods Using Scanner Data from 2013 to 2016," 2018 Annual Meeting, August 5-7, Washington, D.C. 274053, Agricultural and Applied Economics Association.
    6. Gill, Mackenzie & Bonanno, Alessandro, 2025. "How Fears and COVID-19 Mitigation Policies Influenced Stockpiling of Various Food Categories," 2025 AAEA & WAEA Joint Annual Meeting, July 27-29, 2025, Denver, CO 360940, Agricultural and Applied Economics Association.
    7. Lauren Chenarides & Edward C. Jaenicke, 2019. "Documenting the Link Between Poor Food Access and Less Healthy Product Assortment Across the U.S," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 41(3), pages 434-474, September.
    8. Matthew Freedman & Annemarie Kuhns, 2018. "Supply-side subsidies to improve food access and dietary outcomes: Evidence from the New Markets Tax Credit," Urban Studies, Urban Studies Journal Limited, vol. 55(14), pages 3234-3251, November.
    9. Chenarides, Lauren & Jaenicke, Edward C., 2016. "Store Choice and Consumer Behavior in Food Deserts: An Empirical Application of the Distance Metric Method," 2017 Allied Social Sciences Association (ASSA) Annual Meeting, January 6-8, 2017, Chicago, Illinois 250118, Agricultural and Applied Economics Association.
    10. Chen, Danhong & Jaenicke, Edward C., "undated". "Composition of Food-at-Home Expenditures and Childhood Obesity," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258343, Agricultural and Applied Economics Association.
    11. repec:ags:aaea22:343976 is not listed on IDEAS
    12. Kirli, Desen & Couraud, Benoit & Robu, Valentin & Salgado-Bravo, Marcelo & Norbu, Sonam & Andoni, Merlinda & Antonopoulos, Ioannis & Negrete-Pincetic, Matias & Flynn, David & Kiprakis, Aristides, 2022. "Smart contracts in energy systems: A systematic review of fundamental approaches and implementations," Renewable and Sustainable Energy Reviews, Elsevier, vol. 158(C).
    13. Chenarides, Lauren & Jaenicke, Edward C. & Li, Jing, "undated". "Welfare Impacts from Store Attribute-Based Policy Interventions in an Urban Setting: An Application to Philadelphia," 2017 Annual Meeting, July 30-August 1, Chicago, Illinois 258270, Agricultural and Applied Economics Association.
    14. Stewart, Hayden & Hyman, Jeffrey & McLaughlin, Patrick W. & Dong, Diansheng, 2019. "USDA Special Supplemental Nutrition Program for Women, Infants, and Children (WIC): A New Look at Key Questions 10 Years After USDA Added Whole-Grain Bread to WIC Food Packages in 2009," Economic Research Report 335303, United States Department of Agriculture, Economic Research Service.
    15. Okrent, Abigail M. & Zhen, Chen & Wang, Shaonan, 2024. "Demand for Farmed and Wild-caught Fish and Seafood," 2024 Annual Meeting, July 28-30, New Orleans, LA 343838, Agricultural and Applied Economics Association.
    16. Chen Zhen & Mary Muth & Abigail Okrent & Shawn Karns & Derick Brown & Peter Siegel, 2019. "Do differences in reported expenditures between household scanner data and expenditure surveys matter in health policy research?," Health Economics, John Wiley & Sons, Ltd., vol. 28(6), pages 782-800, June.
    17. McLaughlin, Patrick W. & Stevens, Alexander & Dong, Xiao & Chelius, Carolyn & Marchesi, Keenan & MacLachlan, Matthew, "undated". "COVID-19 Working Paper National Trends in Food Retail Sales During the COVID-19 Pandemic: Findings from information Resources, Inc. (IRI) Retail-Based Scanner Data," USDA Miscellaneous 333527, United States Department of Agriculture.
    18. Cleary, Rebecca & Liu, Yizao & Carlson, Andrea C., 2022. "Differences in the Distribution of Nutrition Between Households Above and Below Poverty," 2022 Annual Meeting, July 31-August 2, Anaheim, California 322267, Agricultural and Applied Economics Association.
    19. Okrent, Abigail, 2025. "U.S. Food Assistance Participation and Demand for Food," 2025 AAEA & WAEA Joint Annual Meeting, July 27-29, 2025, Denver, CO 360888, Agricultural and Applied Economics Association.
    20. F. Kuchler & M. Bowman & M. Sweitzer & C. Greene, 2020. "Evidence from Retail Food Markets That Consumers Are Confused by Natural and Organic Food Labels," Journal of Consumer Policy, Springer, vol. 43(2), pages 379-395, June.
    21. Justin S White & Sanjay Basu & Scott Kaplan & Kristine A Madsen & Sofia B Villas-Boas & Dean Schillinger, 2023. "Evaluation of the sugar-sweetened beverage tax in Oakland, United States, 2015–2019: A quasi-experimental and cost-effectiveness study," PLOS Medicine, Public Library of Science, vol. 20(4), pages 1-20, April.

    More about this item

    Keywords

    ;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:aaea26:404883. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/aaeaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.