IDEAS home Printed from https://ideas.repec.org/a/eee/ehbiol/v59y2025ics1570677x25000851.html

Measuring and testing vulnerability to food insecurity for prediction and targeting

Author

Listed:
  • Letta, Marco
  • Montalbano, Pierluigi
  • Morales Opazo, Cristian
  • Petruccelli, Federica

Abstract

Taking advantage of the exogenous nature of the COVID-19 shock, we present an empirical test to assess the validity of theory-based methods for targeting household vulnerability to food insecurity. Specifically, we test the performance of an applied measure of vulnerability to food insecurity using the World Bank’s multi-topic longitudinal survey data for Nigeria collected between 2010 and 2020, covering the period before and after the pandemic. The results show that this vulnerability measure severely underperforms in predicting food-insecure households out of sample relative to a simple, data-driven routine. Sensitivity tests using only the pre-pandemic data reveal that the poor forecasting performance is not simply due to the discontinuity in the data-generating process brought about by mobility restrictions. This evidence carries two important implications: i) from the methodological point of view, there is a need to enhance the effectiveness of targeting approaches employed by policymakers to identify vulnerability hotspots; ii) from a data-oriented perspective, this work underscores that predictive vulnerability models, regardless of their theoretical soundness or computational power, are constrained by data availability in data-scarce environments. Overall, we argue that greater methodological effort is required to address the limitations of current approaches in anticipating vulnerability to shocks.

Suggested Citation

  • Letta, Marco & Montalbano, Pierluigi & Morales Opazo, Cristian & Petruccelli, Federica, 2025. "Measuring and testing vulnerability to food insecurity for prediction and targeting," Economics & Human Biology, Elsevier, vol. 59(C).
  • Handle: RePEc:eee:ehbiol:v:59:y:2025:i:c:s1570677x25000851
    DOI: 10.1016/j.ehb.2025.101552
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1570677X25000851
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ehb.2025.101552?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Cesar Calvo & Stefan Dercon, 2005. "Measuring Individual Vulnerability," Economics Series Working Papers 229, University of Oxford, Department of Economics.
    2. Alexis H. Villacis & Syed Badruddoza & Ashok K. Mishra, 2024. "A machine learning‐based exploration of resilience and food security," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 46(4), pages 1479-1505, December.
    3. repec:ags:aaea22:343542 is not listed on IDEAS
    4. Christiaensen, Luc J.M. & Boisvert, Richard N., 2000. "On Measuring Household Food Vulnerability: Case Evidence from Northern Mali," Working Papers 127676, Cornell University, Department of Applied Economics and Management.
    5. Cesar Calvo & Stefan Dercon, 2013. "Vulnerability to individual and aggregate poverty," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 41(4), pages 721-740, October.
    6. Barriga-Cabanillas, Oscar & Blumenstock, Joshua E. & Lybbert, Travis J. & Putman, Daniel S., 2025. "Probing the limits of mobile phone metadata for poverty prediction and impact evaluation," Journal of Development Economics, Elsevier, vol. 174(C).
    7. Michael Carter & Christopher Barrett, 2006. "The economics of poverty traps and persistent poverty: An asset-based approach," Journal of Development Studies, Taylor & Francis Journals, vol. 42(2), pages 178-199.
    8. Vu, Khoa & Vuong, Nguyen Dinh Tuan & Vu-Thanh, Tu-Anh & Nguyen, Anh Ngoc, 2022. "Income shock and food insecurity prediction Vietnam under the pandemic," World Development, Elsevier, vol. 153(C).
    9. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    10. Melissa Dell & Benjamin F. Jones & Benjamin A. Olken, 2014. "What Do We Learn from the Weather? The New Climate-Economy Literature," Journal of Economic Literature, American Economic Association, vol. 52(3), pages 740-798, September.
    11. Aiken, Emily L. & Bedoya, Guadalupe & Blumenstock, Joshua E. & Coville, Aidan, 2023. "Program targeting with machine learning and mobile phone data: Evidence from an anti-poverty intervention in Afghanistan," Journal of Development Economics, Elsevier, vol. 161(C).
    12. Linden McBride & Austin Nichols, 2018. "Retooling Poverty Targeting Using Out-of-Sample Validation and Machine Learning," The World Bank Economic Review, World Bank, vol. 32(3), pages 531-550.
    13. World Bank, 2020. "Nigeria Development Update, June 2020," World Bank Publications - Reports 34046, The World Bank Group.
    14. Alberto Zezza & Kevin McGee & Philip Wollburg & Thomas Assefa & Sydney Gourlay, 2023. "From necessity to opportunity: lessons for integrating phone and in-person data collection," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 50(4), pages 1364-1400.
    15. Chris Browne & David S Matteson & Linden McBride & Leiqiu Hu & Yanyan Liu & Ying Sun & Jiaming Wen & Christopher B Barrett, 2021. "Multivariate random forest prediction of poverty and malnutrition prevalence," PLOS ONE, Public Library of Science, vol. 16(9), pages 1-23, September.
    16. Upton, Joanna & Constenla-Villoslada, Susana & Barrett, Christopher B., 2022. "Caveat utilitor: A comparative assessment of resilience measurement approaches," Journal of Development Economics, Elsevier, vol. 157(C).
    17. Villacis, Alexis H. & Badruddoza, Syed & Mishra, Ashok K., 2024. "A Machine Learning-based Exploration of Resilience through the Lens of Food Security," 2024 Annual Meeting, July 28-30, New Orleans, LA 343542, Agricultural and Applied Economics Association.
    18. Egger, Dennis & Miguel, Edward & Warren, Shana S. & Shenoy, Ashish & Collins, Elliott & Karlan, Dean & Parkerson, Doug & Mobarak, A. Mushfiq & Fink, Günther & Udry, Christopher & Walker, Michael & Hau, 2021. "Falling living standards during the COVID-19 crisis: Quantitative evidence from nine developing countries," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 7(6), pages 1-1.
    19. Sileshi, Million & Kadigi, Reuben & Mutabazi, Khamaldin & Sieber, Stefan, 2019. "Analysis of households' vulnerability to food insecurity and its influencing factors in east Hararghe, Ethiopia," 2019 Sixth International Conference, September 23-26, 2019, Abuja, Nigeria 295896, African Association of Agricultural Economists (AAAE).
    20. Deaton, Angus, 1992. "Understanding Consumption," OUP Catalogue, Oxford University Press, number 9780198288244.
    21. Montalbano, Pierluigi, 2011. "Trade Openness and Developing Countries' Vulnerability: Concepts, Misconceptions, and Directions for Research," World Development, Elsevier, vol. 39(9), pages 1489-1502, September.
    22. Echevin, Damien & Fotso, Guy & Bouroubi, Yacine & Coulombe, Harold & Li, Qing, 2025. "Combining survey and census data for improved poverty prediction using semi-supervised deep learning," Journal of Development Economics, Elsevier, vol. 172(C).
    23. Amare, Mulubrhan & Jensen, Nathaniel D. & Shiferaw, Bekele & Cissé, Jennifer Denno, 2018. "Rainfall shocks and agricultural productivity: Implication for rural household consumption," Agricultural Systems, Elsevier, vol. 166(C), pages 79-89.
    24. World Bank, 2020. "Nigeria Development Update, December 2020," World Bank Publications - Reports 34921, The World Bank Group.
    25. Johannes Haushofer & Paul Niehaus & Carlos Paramo & Edward Miguel & Michael Walker, 2025. "Targeting Impact versus Deprivation," American Economic Review, American Economic Association, vol. 115(6), pages 1936-1974, June.
    26. Anderson, Ellen & Lybbert, Travis J. & Shenoy, Ashish & Singh, Rupika & Stein, Daniel, 2024. "Does survey mode matter? Comparing in-person and phone agricultural surveys in India," Journal of Development Economics, Elsevier, vol. 166(C).
    27. Baez, Javier E. & Kshirsagar, Varun & Skoufias, Emmanuel, 2024. "Drought-sensitive targeting and child growth faltering in Southern Africa," World Development, Elsevier, vol. 182(C).
    28. Million Sileshi & Reuben Kadigi & Khamaldin Mutabazi & Stefan Sieber, 2019. "Analysis of households’ vulnerability to food insecurity and its influencing factors in East Hararghe, Ethiopia," Journal of Economic Structures, Springer;Pan-Pacific Association of Input-Output Studies (PAPAIOS), vol. 8(1), pages 1-17, December.
    29. Lentz, E.C. & Michelson, H. & Baylis, K. & Zhou, Y., 2019. "A data-driven approach improves food insecurity crisis prediction," World Development, Elsevier, vol. 122(C), pages 399-409.
    30. Susana Constenla-Villoslada & Yanyan Liu & Linden McBride & Clinton Ouma & Nelson Mutanda & Christopher B. Barrett, 2025. "High-frequency monitoring enables machine learning–based forecasting of acute child malnutrition for early warning," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 122(23), pages 2416161122-, June.
    31. Christopher B. Barrett & Michael R. Carter, 2013. "The Economics of Poverty Traps and Persistent Poverty: Empirical and Policy Implications," Journal of Development Studies, Taylor & Francis Journals, vol. 49(7), pages 976-990, July.
    32. Emily Aiken & Suzanne Bellue & Dean Karlan & Chris Udry & Joshua E. Blumenstock, 2022. "Machine learning and phone data can improve targeting of humanitarian aid," Nature, Nature, vol. 603(7903), pages 864-870, March.
    33. Magrini, Emiliano & Montalbano, Pierluigi & Winters, L. Alan, 2018. "Households’ vulnerability from trade in Vietnam," World Development, Elsevier, vol. 112(C), pages 46-58.
    34. Povel, Felix, 2015. "Measuring Exposure to Downside Risk with an Application to Thailand and Vietnam," World Development, Elsevier, vol. 71(C), pages 4-24.
    35. Ibok, Otu W. & Osbahr, Henny & Srinivasan, Chittur, 2019. "Advancing a new index for measuring household vulnerability to food insecurity," Food Policy, Elsevier, vol. 84(C), pages 10-20.
    36. Aiken, Emily & Bellue, Suzanne & Blumenstock, Joshua E. & Karlan, Dean & Udry, Christopher, 2025. "Estimating impact with surveys versus digital traces: Evidence from randomized cash transfers in Togo," Journal of Development Economics, Elsevier, vol. 175(C).
    37. Linden McBride & Christopher B. Barrett & Christopher Browne & Leiqiu Hu & Yanyan Liu & David S. Matteson & Ying Sun & Jiaming Wen, 2022. "Predicting poverty and malnutrition for targeting, mapping, monitoring, and early warning," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 44(2), pages 879-892, June.
    38. Katsushi Imai & Raghav Gaiha & Woojin Kang, 2011. "Vulnerability and poverty dynamics in Vietnam," Applied Economics, Taylor & Francis Journals, vol. 43(25), pages 3603-3618.
    39. Hossain, Marup & Mullally, Conner & Asadullah, M. Niaz, 2019. "Alternatives to calorie-based indicators of food security: An application of machine learning methods," Food Policy, Elsevier, vol. 84(C), pages 77-91.
    40. Benson, Todd & Amare, Mulubrhan & Ogunniyi, Adebayo, 2020. "The relative commercial orientation of smallholder farmers in Nigeria: Household and crop value-chain analyses," NSSP working papers 66, International Food Policy Research Institute (IFPRI).
    41. Robert Garlick & Kate Orkin & Simon Quinn, 2020. "Call Me Maybe: Experimental Evidence on Frequency and Medium Effects in Microenterprise Surveys," The World Bank Economic Review, World Bank, vol. 34(2), pages 418-443.
    42. Alessandra Garbero & Marco Letta, 2022. "Predicting household resilience with machine learning: preliminary cross-country tests," Empirical Economics, Springer, vol. 63(4), pages 2057-2070, October.
    43. Mousumi Das, 2021. "Vulnerability to Food Insecurity: A Decomposition Exercise for Rural India using the Expected Utility Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 156(1), pages 167-199, July.
    44. Amare, Mulubrhan & Abay, Kibrom A. & Tiberti, Luca & Chamberlin, Jordan, 2021. "COVID-19 and food security: Panel data evidence from Nigeria," Food Policy, Elsevier, vol. 101(C).
    45. Mauricio Gallardo, 2018. "Identifying Vulnerability To Poverty: A Critical Survey," Journal of Economic Surveys, Wiley Blackwell, vol. 32(4), pages 1074-1105, September.
    46. Knippenberg, Erwin & Jensen, Nathaniel & Constas, Mark, 2019. "Quantifying household resilience with high frequency data: Temporal dynamics and methodological options," World Development, Elsevier, vol. 121(C), pages 1-15.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kilic, Talip & Letta, Marco & Montalbano, Pierluigi & Petruccelli, Federica, 2026. "CLARE : A Causal machine Learning Approach to Resilience Estimation," Policy Research Working Paper Series 11292, The World Bank.
    2. Mousumi Das, 2021. "Vulnerability to Food Insecurity: A Decomposition Exercise for Rural India using the Expected Utility Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 156(1), pages 167-199, July.
    3. Baez, Javier E. & Kshirsagar, Varun & Skoufias, Emmanuel, 2024. "Drought-sensitive targeting and child growth faltering in Southern Africa," World Development, Elsevier, vol. 182(C).
    4. de Blasio, Guido & D'Ignazio, Alessio & Letta, Marco, 2022. "Gotham city. Predicting ‘corrupted’ municipalities with machine learning," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    5. Sandeep Kumar & S. Chakraverty & Narayan Sethi, 2026. "Application of ANNs for predicting poverty levels with interval estimation: a case study of Odisha, India," Journal of Computational Social Science, Springer, vol. 9(1), pages 1-20, February.
    6. Alessandra Garbero & Marco Letta, 2022. "Predicting household resilience with machine learning: preliminary cross-country tests," Empirical Economics, Springer, vol. 63(4), pages 2057-2070, October.
    7. Emiliano Magrini & Pierluigi Montalbano, 2012. "Trade openness and vulnerability to poverty: Vietnam in the long-run (1992-2008)," Working Paper Series 3512, Department of Economics, University of Sussex Business School.
    8. Emiliano Magrini & Pierluigi Montalbano & L. Alan Winters, 2017. "Vulnerability from trade in Vietnam," Working Papers 12/17, Sapienza University of Rome, DISS.
    9. Lee, Seungmin & Abay, Kibrom A. & Barrett, Christopher B. & Hoddinott, John, 2026. "Estimating multidimensional development resilience," Journal of Development Economics, Elsevier, vol. 178(C).
    10. Linden McBride & Christopher B. Barrett & Christopher Browne & Leiqiu Hu & Yanyan Liu & David S. Matteson & Ying Sun & Jiaming Wen, 2022. "Predicting poverty and malnutrition for targeting, mapping, monitoring, and early warning," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 44(2), pages 879-892, June.
    11. Tennant, Elizabeth J. & Michuda, Aleksandr & Upton, Joanna B. & Chamorro, Andres & Engstrom, Ryan & Mann, Michael L. & Newhouse, David & Weber, Michael & Barrett, Christopher B., 2025. "Nowcasting Disruptions to Human Capital Formation : Evidence from High-Frequency Household and Geospatial Data in Rural Malawi," Policy Research Working Paper Series 11202, The World Bank.
    12. Magrini, Emiliano & Montalbano, Pierluigi & Winters, L. Alan, 2018. "Households’ vulnerability from trade in Vietnam," World Development, Elsevier, vol. 112(C), pages 46-58.
    13. Antonio Acconcia & Maria Carannante & Michelangelo Misuraca & Germana Scepi, 2020. "Measuring Vulnerability to Poverty with Latent Transition Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 151(1), pages 1-31, August.
    14. Guido de Blasio & Alessio D'Ignazio & Marco Letta, 2020. "Predicting Corruption Crimes with Machine Learning. A Study for the Italian Municipalities," Working Papers 16/20, Sapienza University of Rome, DISS.
    15. Barituka Bekee & Corinne Valdivia, 2023. "Resilience of Rural Households: Insights from a Multidisciplinary Literature," Sustainability, MDPI, vol. 15(6), pages 1-15, March.
    16. Marco Letta & Pierluigi Montalbano & Adriana Paolantonio, 2024. "Climate Immobility Traps: A Household-Level Test," Papers 2403.09470, arXiv.org.
    17. Aiken, Emily & Bellue, Suzanne & Blumenstock, Joshua E. & Karlan, Dean & Udry, Christopher, 2025. "Estimating impact with surveys versus digital traces: Evidence from randomized cash transfers in Togo," Journal of Development Economics, Elsevier, vol. 175(C).
    18. Barriga Cabanillas, Oscar & Bossuroy, Thomas & Corral Rodas, Paul Andres & Rodriguez Castelan, Carlos & Skoufias, Emmanuel, 2024. "Sustaining Poverty Gains: A Vulnerability Map to Guide Social Policy," IZA Discussion Papers 17193, IZA Network @ LISER.
    19. Bapu Vaitla & Jennifer Denno Cissé & Joanna Upton & Girmay Tesfay & Nigussie Abadi & Daniel Maxwell, 2020. "How the choice of food security indicators affects the assessment of resilience—an example from northern Ethiopia," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 12(1), pages 137-150, February.
    20. Mauricio Gallardo & María Emma Santos & Pablo Villatoro & Vicky Pizarro, 2024. "Measuring Vulnerability to Multidimensional Poverty in Latin America," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 70(3), pages 661-696, September.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ehbiol:v:59:y:2025:i:c:s1570677x25000851. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622964 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.