IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v161y2023ics0304387822001584.html

Program targeting with machine learning and mobile phone data: Evidence from an anti-poverty intervention in Afghanistan

Author

Listed:
  • Aiken, Emily L.
  • Bedoya, Guadalupe
  • Blumenstock, Joshua E.
  • Coville, Aidan

Abstract

Can mobile phone data improve program targeting? By combining rich survey data from a “big push” anti-poverty program in Afghanistan with detailed mobile phone logs from program beneficiaries, we study the extent to which machine learning methods can accurately differentiate ultra-poor households eligible for program benefits from ineligible households. We show that machine learning methods leveraging mobile phone data can identify ultra-poor households nearly as accurately as survey-based measures of consumption and wealth; and that combining survey-based measures with mobile phone data produces classifications more accurate than those based on a single data source.

Suggested Citation

  • Aiken, Emily L. & Bedoya, Guadalupe & Blumenstock, Joshua E. & Coville, Aidan, 2023. "Program targeting with machine learning and mobile phone data: Evidence from an anti-poverty intervention in Afghanistan," Journal of Development Economics, Elsevier, vol. 161(C).
  • Handle: RePEc:eee:deveco:v:161:y:2023:i:c:s0304387822001584
    DOI: 10.1016/j.jdeveco.2022.103016
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304387822001584
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jdeveco.2022.103016?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Guanghua Chi & Han Fang & Sourav Chatterjee & Joshua E. Blumenstock, 2022. "Microestimates of wealth for all low- and middle-income countries," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 119(3), pages 2113658119-, January.
    2. Rema Hanna & Benjamin A. Olken, 2018. "Universal Basic Incomes versus Targeted Transfers: Anti-Poverty Programs in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 32(4), pages 201-226, Fall.
    3. Joshua E. Blumenstock, 2018. "Estimating Economic Characteristics with Phone Data," AEA Papers and Proceedings, American Economic Association, vol. 108, pages 72-76, May.
    4. Grosh, M.E. & Baker, J.L., 1995. "Proxy Means Tests for Targetting Social Programs. Simulations and Speculation," Papers 118, World Bank - Living Standards Measurement.
    5. Banerjee, Abhijit & Hanna, Rema & Olken, Benjamin A. & Sumarto, Sudarno, 2018. "The (Lack of) Distortionary Effects of Proxy-Means Tests: Results from a Nationwide Experiment in Indonesia," Working Paper Series rwp18-041, Harvard University, John F. Kennedy School of Government.
    6. Dean Karlan & Bram Thuysbaert, 2019. "Targeting Ultra-Poor Households in Honduras and Peru," The World Bank Economic Review, World Bank, vol. 33(1), pages 63-94.
    7. Ryan Engstrom & Jonathan Hersh & David Newhouse, 2022. "Poverty from Space: Using High Resolution Satellite Imagery for Estimating Economic Well-being," The World Bank Economic Review, World Bank, vol. 36(2), pages 382-412.
    8. David Coady, 2004. "Targeting Outcomes Redux," The World Bank Research Observer, World Bank, vol. 19(1), pages 61-85.
    9. Sabina Alkire, James E. Foster, Suman Seth, Maria Emma Santos, Jose M. Roche and Paola Ballon, 2015. "Multidimensional Poverty Measurement and Analysis: Chapter 9 - Distribution and Dynamics," OPHI Working Papers ophiwp090_ch9.pdf, Queen Elizabeth House, University of Oxford.
    10. Deon Filmer & Lant Pritchett, 2001. "Estimating Wealth Effects Without Expenditure Data—Or Tears: An Application To Educational Enrollments In States Of India," Demography, Springer;Population Association of America (PAA), vol. 38(1), pages 115-132, February.
    11. Sabina Alkire, James E. Foster, Suman Seth, Maria Emma Santos, José M. Roche and Paola Ballon, 2015. "Multidimensional Poverty Measurement and Analysis: Chapter 7 - Data and Analysis," OPHI Working Papers ophiwp088_ch7.pdf, Queen Elizabeth House, University of Oxford.
    12. Emily Aiken & Suzanne Bellue & Dean Karlan & Chris Udry & Joshua E. Blumenstock, 2022. "Machine learning and phone data can improve targeting of humanitarian aid," Nature, Nature, vol. 603(7903), pages 864-870, March.
    13. Daniel Bjorkegren & Joshua E. Blumenstock & Samsun Knight, 2020. "Manipulation-Proof Machine Learning," Papers 2004.03865, arXiv.org.
    14. repec:qeh:ophiwp:ophiwp090 is not listed on IDEAS
    15. Sabina Alkire, James E. Foster, Suman Seth, Maria Emma Santos, José M. Roche and Paola Ballon, 2015. "Multidimensional Poverty Measurement and Analysis: Chapter 2 - The Framework," OPHI Working Papers ophiwp083_ch2.pdf, Queen Elizabeth House, University of Oxford.
    16. Bedoya Arguelles,Guadalupe & Coville,Aidan & Haushofer,Johannes & Isaqzadeh,Mohammad Razaq & Shapiro,Jeremy, 2019. "No Household Left Behind : Afghanistan Targeting the Ultra Poor Impact Evaluation," Policy Research Working Paper Series 8877, The World Bank.
    17. repec:qeh:ophiwp:ophiwp088 is not listed on IDEAS
    18. repec:qeh:ophiwp:ophiwp083 is not listed on IDEAS
    19. Hernandez,Marco & Hong,Lingzi & Frias-Martinez,Vanessa & Frias-Martinez,Enrique, 2017. "Estimating poverty using cell phone data : evidence from Guatemala," Policy Research Working Paper Series 7969, The World Bank.
    20. Kathy Lindert & Tina George Karippacheril & Inés Rodriguez Caillava & Kenichi Nishikawa Chavez, 2020. "Sourcebook on the Foundations of Social Protection Delivery Systems [Les Systèmes de Mise en Œuvre de la Protection Sociale : Un Manuel de Référence]," World Bank Publications - Books, The World Bank Group, number 34044, April.
    21. Vivi Alatas & Abhijit Banerjee & Rema Hanna & Benjamin A. Olken & Julia Tobias, 2012. "Targeting the Poor: Evidence from a Field Experiment in Indonesia," American Economic Review, American Economic Association, vol. 102(4), pages 1206-1240, June.
    22. Brown, Caitlin & Ravallion, Martin & van de Walle, Dominique, 2018. "A poor means test? Econometric targeting in Africa," Journal of Development Economics, Elsevier, vol. 134(C), pages 109-124.
    23. Angus Deaton, 2016. "Measuring and Understanding Behavior, Welfare, and Poverty," American Economic Review, American Economic Association, vol. 106(6), pages 1221-1243, June.
    24. Alkire, Sabina & Foster, James & Seth, Suman & Santos, Maria Emma & Roche, Jose Manuel & Ballon, Paola, 2015. "Multidimensional Poverty Measurement and Analysis," OUP Catalogue, Oxford University Press, number 9780199689491.
    25. Adriana Camacho & Emily Conover, 2011. "Manipulation of Social Program Eligibility," American Economic Journal: Economic Policy, American Economic Association, vol. 3(2), pages 41-65, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Beuermann, Diether W. & Hoffmann, Bridget & Stampini, Marco & Vargas, David L. & Vera-Cossio, Diego, 2025. "Shooting a moving target: Evaluating targeting tools for social programs when income fluctuates," Journal of Development Economics, Elsevier, vol. 172(C).
    2. Barriga-Cabanillas, Oscar & Blumenstock, Joshua E. & Lybbert, Travis J. & Putman, Daniel S., 2025. "Probing the limits of mobile phone metadata for poverty prediction and impact evaluation," Journal of Development Economics, Elsevier, vol. 174(C).
    3. Beuermann, Diether & Hoffmann, Bridget & Stampini, Marco & Vargas, David & Vera-Cossio, Diego A., 2024. "Shooting a Moving Target: Choosing Targeting Tools for Social Programs," IDB Publications (Working Papers) 13359, Inter-American Development Bank.
    4. Al Kez, Dlzar & Foley, Aoife & Abdul, Zrar Khald & Del Rio, Dylan Furszyfer, 2024. "Energy poverty prediction in the United Kingdom: A machine learning approach," Energy Policy, Elsevier, vol. 184(C).
    5. Ginevra Buratti & Alessio D'Ignazio, 2024. "Improving the effectiveness of financial education programs. A targeting approach," Journal of Consumer Affairs, Wiley Blackwell, vol. 58(2), pages 451-485, June.
    6. Aiken, Emily & Bellue, Suzanne & Blumenstock, Joshua E. & Karlan, Dean & Udry, Christopher, 2025. "Estimating impact with surveys versus digital traces: Evidence from randomized cash transfers in Togo," Journal of Development Economics, Elsevier, vol. 175(C).
    7. Lyons, Angela C. & Montoya Castano, Alejandro & Kass-Hanna, Josephine & Zhang, Yifang & Soliman, Aiman, 2025. "A machine learning approach to assessing multidimensional poverty and targeting assistance among forcibly displaced populations," World Development, Elsevier, vol. 192(C).
    8. Dang, Hai-Anh & Kilic, Talip & Hlasny, Vladimir & Abanokova, Kseniya & Carletto, Calogero, 2024. "Using Survey-to-Survey Imputation to Fill Poverty Data Gaps at a Low Cost: Evidence from a Randomized Survey Experiment," GLO Discussion Paper Series 1392, Global Labor Organization (GLO).
    9. Ligon, Ethan & Trachtman, Carly, 2024. "Assessing Targeting Peformance: The Case of Ghana’s LEAP Program," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt2zk0m608, Department of Agricultural & Resource Economics, UC Berkeley.
    10. Bossavie, Laurent Loic Yves & Rozo, Sandra & Urbina Florez, Maria Jose, 2023. "Impacts of Extremist Ideologies on Refugees' Integration : Evidence from Afghan Refugees in Tajikistan," Policy Research Working Paper Series 10612, The World Bank.
    11. Emily Aiken & Anik Ashraf & Joshua E. Blumenstock & Raymond P. Guiteras & Ahmed Mushfiq Mobarak, 2025. "Scalable Targeting of Social Protection: When Do Algorithms Out-Perform Surveys and Community Knowledge?," Cowles Foundation Discussion Papers 2443, Cowles Foundation for Research in Economics, Yale University.
    12. Paolo Verme, 2025. "Predicting Poverty," Papers 2505.05958, arXiv.org.
    13. Chowdhury, Shyamal & Hasan, Syed & Sharma, Uttam, 2024. "The Role of Trainee Selection in the Effectiveness of Vocational Training: Evidence from a Randomized Controlled Trial in Nepal," IZA Discussion Papers 16705, Institute of Labor Economics (IZA).
    14. Letta, Marco & Montalbano, Pierluigi & Paolantonio, Adriana, 2024. "Climate Immobility Traps : A Household-Level Test," Policy Research Working Paper Series 10724, The World Bank.
    15. Verme, Paolo, 2023. "Predicting Poverty with Missing Incomes," GLO Discussion Paper Series 1260, Global Labor Organization (GLO).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Blumenstock, Joshua & Aiken, Emily & Bellue, Suzanne & Udry, Christopher & Karlan, Dean, 2021. "Machine Learning and Mobile Phone Data Can Improve the Targeting of Humanitarian Assistance," CEPR Discussion Papers 16385, C.E.P.R. Discussion Papers.
    2. Emily Aiken & Guadalupe Bedoya & Joshua Blumenstock & Aidan Coville, 2022. "Program Targeting with Machine Learning and Mobile Phone Data: Evidence from an Anti-Poverty Intervention in Afghanistan," Papers 2206.11400, arXiv.org.
    3. repec:wbk:wbrwps:10252 is not listed on IDEAS
    4. Hai‐Anh H. Dang, 2021. "To impute or not to impute, and how? A review of poverty‐estimation methods in the absence of consumption data," Development Policy Review, Overseas Development Institute, vol. 39(6), pages 1008-1030, November.
    5. Schleicher, Michael & Souares, Aurélia & Pacere, Athanase Narangoro & Sauerborn, Rainer & Klonner, Stefan, 2016. "Decentralized versus Statistical Targeting of Anti-Poverty Programs: Evidence from Burkina Faso," Working Papers 0623, University of Heidelberg, Department of Economics.
    6. Isabella S. Smythe & Joshua E. Blumenstock, 2022. "Geographic microtargeting of social assistance with high-resolution poverty maps," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 119(32), pages 2120025119-, August.
    7. Dutta, Indranil & Nogales, Ricardo & Yalonetzky, Gaston, 2021. "Endogenous weights and multidimensional poverty: A cautionary tale," Journal of Development Economics, Elsevier, vol. 151(C).
    8. Guberney Muñetón-Santa & Daniel Escobar-Grisales & Felipe Orlando López-Pabón & Paula Andrea Pérez-Toro & Juan Rafael Orozco-Arroyave, 2022. "Classification of Poverty Condition Using Natural Language Processing," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 162(3), pages 1413-1435, August.
    9. Baez, Javier E. & Kshirsagar, Varun & Skoufias, Emmanuel, 2024. "Drought-sensitive targeting and child growth faltering in Southern Africa," World Development, Elsevier, vol. 182(C).
    10. Sabina Alkire, 2018. "Multidimensional Poverty Measures as Relevant Policy Tools," OPHI Working Papers ophiwp118.pdf, Queen Elizabeth House, University of Oxford.
    11. Maitra, Sudeshna, 2024. "On the theory and measurement of relative poverty using durable ownership data," Journal of Economic Behavior & Organization, Elsevier, vol. 225(C), pages 153-169.
    12. Hai‐Anh Dang & Dean Jolliffe & Calogero Carletto, 2019. "Data Gaps, Data Incomparability, And Data Imputation: A Review Of Poverty Measurement Methods For Data‐Scarce Environments," Journal of Economic Surveys, Wiley Blackwell, vol. 33(3), pages 757-797, July.
    13. Schnitzer,Pascale & Stoeffler,Quentin, 2021. "Targeting for Social Safety Nets : Evidence from Nine Programs in the Sahel," Policy Research Working Paper Series 9816, The World Bank.
    14. Hope Michelson, 2025. "Navigating the Measurement Frontier: New Insights Into Small Farm Realities," Agricultural Economics, International Association of Agricultural Economists, vol. 56(3), pages 526-542, May.
    15. Han, Huawei & Gao, Qin, 2019. "Community-based welfare targeting and political elite capture: Evidence from rural China," World Development, Elsevier, vol. 115(C), pages 145-159.
    16. Beuermann, Diether W. & Hoffmann, Bridget & Stampini, Marco & Vargas, David L. & Vera-Cossio, Diego, 2025. "Shooting a moving target: Evaluating targeting tools for social programs when income fluctuates," Journal of Development Economics, Elsevier, vol. 172(C).
    17. Haseeb, Muhammad & Vyborny, Kate, 2022. "Data, discretion and institutional capacity: Evidence from cash transfers in Pakistan," Journal of Public Economics, Elsevier, vol. 206(C).
    18. Jacob Katuva & Rob Hope & Tim Foster & Johanna Koehler & Patrick Thomson, 2020. "Modelling Welfare Transitions to Prioritise Sustainable Development Interventions in Coastal Kenya," Sustainability, MDPI, vol. 12(17), pages 1-22, August.
    19. Dang,Hai-Anh H., 2018. "To impute or not to impute ? a review of alternative poverty estimation methods in the context of unavailable consumption data," Policy Research Working Paper Series 8403, The World Bank.
    20. Vollmer, Frank & Alkire, Sabina, 2022. "Consolidating and improving the assets indicator in the global Multidimensional Poverty Index," World Development, Elsevier, vol. 158(C).
    21. Rodrigo García Arancibia & Ignacio Girela, 2024. "Graphical Representation of Multidimensional Poverty: Insights for Index Construction and Policy Making," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 172(2), pages 595-634, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • I32 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Measurement and Analysis of Poverty
    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:161:y:2023:i:c:s0304387822001584. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.