IDEAS home Printed from https://ideas.repec.org/p/ags/cudawp/316614.html
   My bibliography  Save this paper

A Comparative Assessment of Resilience Measuremen tApproaches

Author

Listed:
  • Upton, Joanna
  • Tennant, Elizabeth
  • Florella, Kathryn J.
  • Barrett, Christopher B.

Abstract

As development and humanitarian agencies increasingly advance the objective of 'building resilience', three resilience measurement methods have come into especially widespread use: the Resilience Indicators for Measurement and Analysis approach developed by FAO, the multi-dimensional index approach developed by TANGO International, and the probabilistic approach of Cissé and Barrett. We compare performance across those three methods using nationally representative panel data from Ethiopia and Niger. We find that the three measures exhibit significantly different distributions and orderings among households, and they vary significantly in the households they identify as resilient or least resilient. All three measures exhibit only modest out-of-sample predictive accuracy, generating many false negatives and false positives relative to the food security outcome measure whose resilience they are meant to reflect. It remains unclear what these measures capture and what value they add beyond more established wellbeing measures such as the food consumption score or real expenditures. Significant room exists for improvement in resilience measurement to better guide and evaluate development resilience interventions

Suggested Citation

  • Upton, Joanna & Tennant, Elizabeth & Florella, Kathryn J. & Barrett, Christopher B., 2021. "A Comparative Assessment of Resilience Measuremen tApproaches," Working Papers 316614, Cornell University, Department of Applied Economics and Management.
  • Handle: RePEc:ags:cudawp:316614
    DOI: 10.22004/ag.econ.316614
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/316614/files/WP%202021-18%20Caveat.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.22004/ag.econ.316614?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Premand, Patrick & Stoeffler, Quentin, 2022. "Cash transfers, climatic shocks and resilience in the Sahel," Journal of Environmental Economics and Management, Elsevier, vol. 116(C).
    2. Ethan Ligon & Laura Schechter, 2003. "Measuring Vulnerability," Economic Journal, Royal Economic Society, vol. 113(486), pages 95-102, March.
    3. Martin Ravallion, 2020. "On Measuring Global Poverty," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 167-188, August.
    4. Foster, James & Greer, Joel & Thorbecke, Erik, 1984. "A Class of Decomposable Poverty Measures," Econometrica, Econometric Society, vol. 52(3), pages 761-766, May.
    5. Smith, Lisa C. & Frankenberger, Timothy R., 2018. "Does Resilience Capacity Reduce the Negative Impact of Shocks on Household Food Security? Evidence from the 2014 Floods in Northern Bangladesh," World Development, Elsevier, vol. 102(C), pages 358-376.
    6. Hai‐Anh H. Dang & Peter F. Lanjouw, 2017. "Welfare Dynamics Measurement: Two Definitions of a Vulnerability Line and Their Empirical Application," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 63(4), pages 633-660, December.
    7. Hauke Jan & Kossowski Tomasz, 2011. "Comparison of Values of Pearson's and Spearman's Correlation Coefficients on the Same Sets of Data," Quaestiones Geographicae, Sciendo, vol. 30(2), pages 87-93, June.
    8. Lipton, Michael & Ravallion, Martin, 1995. "Poverty and policy," Handbook of Development Economics, in: Hollis Chenery & T.N. Srinivasan (ed.), Handbook of Development Economics, edition 1, volume 3, chapter 41, pages 2551-2657, Elsevier.
    9. Marco d’Errico & Donato Romano & Rebecca Pietrelli, 2018. "Household resilience to food insecurity: evidence from Tanzania and Uganda," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 10(4), pages 1033-1054, August.
    10. Joanna B. Upton & Jennifer Denno Cissé & Christopher B. Barrett, 2016. "Food security as resilience: reconciling definition and measurement," Agricultural Economics, International Association of Agricultural Economists, vol. 47(S1), pages 135-147, November.
    11. Phadera, Lokendra & Michelson, Hope & Winter-Nelson, Alex & Goldsmith, Peter, 2019. "Do asset transfers build household resilience?," Journal of Development Economics, Elsevier, vol. 138(C), pages 205-227.
    12. Marco d'Errico & Francesca Grazioli & Rebecca Pietrelli, 2018. "Cross‐country Evidence of the Relationship Between Resilience and the Subjective Perception of Well‐being and Social Inclusion: Evidence from the Regions of Matam (Senegal) and the Triangle of Hope (M," Journal of International Development, John Wiley & Sons, Ltd., vol. 30(8), pages 1339-1368, November.
    13. Ravallion, Martin & Chen, Shaohua, 2019. "Global poverty measurement when relative income matters," Journal of Public Economics, Elsevier, vol. 177(C), pages 1-1.
    14. Cissé, Jennifer Denno & Barrett, Christopher B., 2018. "Estimating development resilience: A conditional moments-based approach," Journal of Development Economics, Elsevier, vol. 135(C), pages 272-284.
    15. Vaitla, Bapu & Coates, Jennifer & Glaeser, Laura & Hillbruner, Christopher & Biswal, Preetish & Maxwell, Daniel, 2017. "The measurement of household food security: Correlation and latent variable analysis of alternative indicators in a large multi-country dataset," Food Policy, Elsevier, vol. 68(C), pages 193-205.
    16. Knippenberg, Erwin & Jensen, Nathaniel & Constas, Mark, 2019. "Quantifying household resilience with high frequency data: Temporal dynamics and methodological options," World Development, Elsevier, vol. 121(C), pages 1-15.
    17. Wiesmann, Doris & Bassett, Lucy & Benson, Todd & Hoddinott, John, 2009. "Validation of the world food programme's food consumption score and alternative indicators of household food security:," IFPRI discussion papers 870, International Food Policy Research Institute (IFPRI).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Upton, Joanna & Constenla-Villoslada, Susana & Barrett, Christopher B., 2022. "Caveat utilitor: A comparative assessment of resilience measurement approaches," Journal of Development Economics, Elsevier, vol. 157(C).
    2. Premand, Patrick & Stoeffler, Quentin, 2022. "Cash transfers, climatic shocks and resilience in the Sahel," Journal of Environmental Economics and Management, Elsevier, vol. 116(C).
    3. Bapu Vaitla & Jennifer Denno Cissé & Joanna Upton & Girmay Tesfay & Nigussie Abadi & Daniel Maxwell, 2020. "How the choice of food security indicators affects the assessment of resilience—an example from northern Ethiopia," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 12(1), pages 137-150, February.
    4. Premand, Patrick & Stoeffler, Quentin, 2022. "Cash transfers, climatic shocks and resilience in the Sahel," Journal of Environmental Economics and Management, Elsevier, vol. 116(C).
    5. Barrett, Christopher B. & Ghezzi-Kopel, Kate & Hoddinott, John & Homami, Nima & Tennant, Elizabeth & Upton, Joanna & Wu, Tong, 2021. "A scoping review of the development resilience literature: Theory, methods and evidence," World Development, Elsevier, vol. 146(C).
    6. Scognamillo, Antonio & Song, Chun & Ignaciuk, Adriana, 2023. "No man is an Island: A spatially explicit approach to measure development resilience," World Development, Elsevier, vol. 171(C).
    7. Abay, Kibrom A. & Abay, Mehari H. & Berhane, Guush & Chamberlin, Jordan, 2022. "Social protection and resilience: The case of the productive safety net program in Ethiopia," Food Policy, Elsevier, vol. 112(C).
    8. Lee, Seungmin & Barrett, Christopher B. & Hoddinott, John F., 2021. "Food Security Dynamics in the United States, 2001-2017," Working Papers 316604, Cornell University, Department of Applied Economics and Management.
    9. Knippenberg, Erwin & Jensen, Nathaniel & Constas, Mark, 2019. "Quantifying household resilience with high frequency data: Temporal dynamics and methodological options," World Development, Elsevier, vol. 121(C), pages 1-15.
    10. Marco d’Errico & Jeanne Pinay & Ellestina Jumbe & Anh Hong Luu, 2023. "Drivers and stressors of resilience to food insecurity: evidence from 35 countries," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 15(5), pages 1161-1183, October.
    11. Amrita Saha & Rachel Sabates-Wheeler & John Thompson, 2022. "Insights into smallholder capacity for agricultural commercialisation: Evidence from four African contexts," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 34(4), pages 1757-1802, August.
    12. Ansah, Isaac Gershon K. & Kotu, Bekele Hundie & Manda, Julius & Muthoni, Francis & Azzarri, Carlo, 2023. "Mediation and moderation roles of resilience capacity in the shock–food-security nexus in northern Ghana," Ecological Economics, Elsevier, vol. 211(C).
    13. Demissie, Birhan S. & Kasie, Tesfahun A. & Upton, Joanna B. & Blom, Sylvia A., 2021. "Climate Shocks And Resilience: Evidence From Rural Ethiopia," PRCI Research Papers 320707, Michigan State University, Department of Agricultural, Food and Resource Economics, Food Security Group.
    14. Isaac Gershon Kodwo Ansah & Cornelis Gardebroek & Rico Ihle, 2019. "Resilience and household food security: a review of concepts, methodological approaches and empirical evidence," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 11(6), pages 1187-1203, December.
    15. Tesfahun, Birhan S. & Kasie, A. & Upton, Joanna B. & Blom, Sylvia A., 2021. "Climate Shocks And Resilience: Evidence From Rural Ethiopia," PRCI Research Papers 321060, Michigan State University, Department of Agricultural, Food and Resource Economics, Food Security Group.
    16. Randell, Heather & Gray, Clark & Shayo, Elizabeth H., 2022. "Climatic conditions and household food security: Evidence from Tanzania," Food Policy, Elsevier, vol. 112(C).
    17. Alessandra Garbero & Marco Letta, 2022. "Predicting household resilience with machine learning: preliminary cross-country tests," Empirical Economics, Springer, vol. 63(4), pages 2057-2070, October.
    18. Cissé, Jennifer Denno & Barrett, Christopher B., 2018. "Estimating development resilience: A conditional moments-based approach," Journal of Development Economics, Elsevier, vol. 135(C), pages 272-284.
    19. Joanna Upton, 2019. "Working Paper 316 - Resilience to Diverse Shocks and Stressors in Niger and Ethiopia," Working Paper Series 2442, African Development Bank.
    20. Duclos, Jean-Yves & Araar, Abdelkrim & Giles, John, 2010. "Chronic and transient poverty: Measurement and estimation, with evidence from China," Journal of Development Economics, Elsevier, vol. 91(2), pages 266-277, March.

    More about this item

    Keywords

    Food Consumption/Nutrition/Food Safety;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:cudawp:316614. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/dacorus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.