IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v19y2022i2p923-d724878.html
   My bibliography  Save this article

Healthy vs. Unhealthy Food Images: Image Classification of Twitter Images

Author

Listed:
  • Tejaswini Oduru

    (Department of Software and Information, Systems College of Computing and Informatics, University of North Carolina Charlotte, Charlotte, NC 28223, USA)

  • Alexis Jordan

    (Department of Software and Information, Systems College of Computing and Informatics, University of North Carolina Charlotte, Charlotte, NC 28223, USA)

  • Albert Park

    (Department of Software and Information, Systems College of Computing and Informatics, University of North Carolina Charlotte, Charlotte, NC 28223, USA)

Abstract

Obesity is a modern public health problem. Social media images can capture eating behavior and the potential implications to health, but research for identifying the healthiness level of the food image is relatively under-explored. This study presents a deep learning architecture that transfers features from a 152 residual layer network (ResNet) for predicting the level of healthiness of food images that were built using images from the Google images search engine gathered in 2020. Features learned from the ResNet 152 were transferred to a second network to train on the dataset. The trained SoftMax layer was stacked on top of the layers transferred from ResNet 152 to build our deep learning model. We then evaluate the performance of the model using Twitter images in order to better understand the generalizability of the methods. The results show that the model is able to predict the images into their respective classes, including Definitively Healthy, Healthy, Unhealthy and Definitively Unhealthy at an F1-score of 78.8%. This finding shows promising results for classifying social media images by healthiness, which could contribute to maintaining a balanced diet at the individual level and also understanding general food consumption trends of the public.

Suggested Citation

  • Tejaswini Oduru & Alexis Jordan & Albert Park, 2022. "Healthy vs. Unhealthy Food Images: Image Classification of Twitter Images," IJERPH, MDPI, vol. 19(2), pages 1-12, January.
  • Handle: RePEc:gam:jijerp:v:19:y:2022:i:2:p:923-:d:724878
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/19/2/923/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1660-4601/19/2/923/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Adela Hruby & Frank Hu, 2015. "The Epidemiology of Obesity: A Big Picture," PharmacoEconomics, Springer, vol. 33(7), pages 673-689, July.
    2. Nutbeam, Don, 2008. "The evolving concept of health literacy," Social Science & Medicine, Elsevier, vol. 67(12), pages 2072-2078, December.
    3. Maximilian Tremmel & Ulf-G. Gerdtham & Peter M. Nilsson & Sanjib Saha, 2017. "Economic Burden of Obesity: A Systematic Literature Review," IJERPH, MDPI, vol. 14(4), pages 1-18, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christoph Höchsmann & Shengping Yang & José M. Ordovás & James L. Dorling & Catherine M. Champagne & John W. Apolzan & Frank L. Greenway & Michelle I. Cardel & Gary D. Foster & Corby K. Martin, 2023. "The Personalized Nutrition Study (POINTS): evaluation of a genetically informed weight loss approach, a Randomized Clinical Trial," Nature Communications, Nature, vol. 14(1), pages 1-13, December.
    2. Jongnam Hwang & Eun-Young Lee & Chung Gun Lee, 2019. "Measuring Socioeconomic Inequalities in Obesity among Korean Adults, 1998–2015," IJERPH, MDPI, vol. 16(9), pages 1-14, May.
    3. Maricel G. Santos & Anu L. Gorukanti & Lina M. Jurkunas & Margaret A. Handley, 2018. "The Health Literacy of U.S. Immigrant Adolescents: A Neglected Research Priority in a Changing World," IJERPH, MDPI, vol. 15(10), pages 1-18, September.
    4. Awaworyi Churchill, Sefa & Asante, Augustine, 2023. "Neighbourhood crime and obesity: Longitudinal evidence from Australia," Social Science & Medicine, Elsevier, vol. 337(C).
    5. Fatin Hanani Mazri & Zahara Abdul Manaf & Suzana Shahar & Arimi Fitri Mat Ludin & Siti Munirah Abdul Basir, 2022. "Development and Evaluation of Integrated Chrono-Nutrition Weight Reduction Program among Overweight/Obese with Morning and Evening Chronotypes," IJERPH, MDPI, vol. 19(8), pages 1-20, April.
    6. Chiao Ling Huang & Shu-Ching Yang & Chia-Hsun Chiang, 2020. "The Associations between Individual Factors, eHealth Literacy, and Health Behaviors among College Students," IJERPH, MDPI, vol. 17(6), pages 1-13, March.
    7. Cezary Wojtyla & Pawel Stanirowski & Pawel Gutaj & Michal Ciebiera & Andrzej Wojtyla, 2021. "Perinatal Outcomes in a Population of Diabetic and Obese Pregnant Women—The Results of the Polish National Survey," IJERPH, MDPI, vol. 18(2), pages 1-14, January.
    8. Yuji Kanejima & Kazuhiro P. Izawa & Masahiro Kitamura & Kodai Ishihara & Asami Ogura & Ikko Kubo & Hitomi Nagashima & Hideto Tawa & Daisuke Matsumoto & Ikki Shimizu, 2022. "Health Literacy Is Associated with Activities of Daily Living of Patients Participating in Cardiac Rehabilitation: A Multicenter Clinical Study," IJERPH, MDPI, vol. 19(24), pages 1-10, December.
    9. Arnulf Josef Hartl & Johanna Freidl & Daniela Huber, 2023. "Effects of Alpine Natural Health Resources on Human Health and Wellbeing," IJERPH, MDPI, vol. 20(12), pages 1-3, June.
    10. Rafael M. Tassitano & Robert G. Weaver & Maria Cecília M. Tenório & Keith Brazendale & Michael W. Beets, 2020. "Clusters of non-dietary obesogenic behaviors among adolescents in Brazil: a latent profile analysis," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 65(6), pages 881-891, July.
    11. Ivan Parise & Penelope Abbott & Steven Trankle, 2021. "Drivers to Obesity—A Study of the Association between Time Spent Commuting Daily and Obesity in the Nepean Blue Mountains Area," IJERPH, MDPI, vol. 19(1), pages 1-14, December.
    12. Setti Rais Ali & Paul Dourgnon & Lise Rochaix, 2018. "Social Capital or Education: What Matters Most to Cut Time to Diagnosis?," Working Papers halshs-01703170, HAL.
    13. Samuel G Smith & Laura M Curtis & Jane Wardle & Christian von Wagner & Michael S Wolf, 2013. "Skill Set or Mind Set? Associations between Health Literacy, Patient Activation and Health," PLOS ONE, Public Library of Science, vol. 8(9), pages 1-7, September.
    14. Ying Wu & Lu Wang & Zhongyuan Cai & Luqi Bao & Pu Ai & Zisheng Ai, 2017. "Prevalence and Risk Factors of Low Health Literacy: A Community-Based Study in Shanghai, China," IJERPH, MDPI, vol. 14(6), pages 1-10, June.
    15. Mitja Vrdelja & Sanja Vrbovšek & Vito Klopčič & Kevin Dadaczynski & Orkan Okan, 2021. "Facing the Growing COVID-19 Infodemic: Digital Health Literacy and Information-Seeking Behaviour of University Students in Slovenia," IJERPH, MDPI, vol. 18(16), pages 1-16, August.
    16. Patrizio Zanobini & Chiara Lorini & Alberto Baldasseroni & Claudia Dellisanti & Guglielmo Bonaccorsi, 2020. "A Scoping Review on How to Make Hospitals Health Literate Healthcare Organizations," IJERPH, MDPI, vol. 17(3), pages 1-16, February.
    17. repec:plo:pone00:0161485 is not listed on IDEAS
    18. Sinead O’Mahony & Clare B. O’Donovan & Nuala Collins & Kevin Burke & Gerardine Doyle & Eileen R. Gibney, 2023. "Reformulation of Processed Yogurt and Breakfast Cereals over Time: A Scoping Review," IJERPH, MDPI, vol. 20(4), pages 1-15, February.
    19. Yoon K Loke & Ina Hinz & Xia Wang & Gill Rowlands & David Scott & Charlotte Salter, 2012. "Impact of Health Literacy in Patients with Chronic Musculoskeletal Disease–Systematic Review," PLOS ONE, Public Library of Science, vol. 7(7), pages 1-8, July.
    20. Padmore Adusei Amoah, 2019. "The Relationship between Functional Health Literacy, Self-Rated Health, and Social Support between Younger and Older Adults in Ghana," IJERPH, MDPI, vol. 16(17), pages 1-14, August.
    21. Veronika Anselmann & Simone Halder & Sophie Sauer, 2024. "Nursing Students’ Health Literacy and Strategies to Foster Patients’ Health Literacy," IJERPH, MDPI, vol. 21(8), pages 1-9, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:19:y:2022:i:2:p:923-:d:724878. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.