IDEAS home Printed from https://ideas.repec.org/a/spr/jcsosc/v8y2025i3d10.1007_s42001-025-00405-8.html
   My bibliography  Save this article

Evaluating area-level features for proxy means test models: evidence from rural, semi-urban and urban districts in poverty targeting

Author

Listed:
  • Siti Mariyah

    (University of New South Wales
    Politeknik Statistika STIS)

  • Wayne Wobcke

    (University of New South Wales)

Abstract

While satellite imagery and administrative records have been widely used for poverty mapping, their role in poverty targeting, particularly within the Proxy Means Test (PMT) framework, remains underexplored. This study evaluates the usefulness of area-level features, such as Night-Time Light intensity, vegetation and built-up indices (NDVI, NDWI, NDBI), land cover types and the number of schools and health facilities, in improving household-level expenditure estimates and reducing targeting errors in PMT models. Using household data from a variety of district types in Indonesia, including rural, semi-urban and urban districts, we assess how these features affect model performance in terms of inclusion and exclusion errors under both 20% and 40% poverty thresholds. Our findings show that area-level features improve PMT model performance primarily in districts with a high number of sub-districts, particularly in semi-urban settings. In contrast, in urban and rural districts with limited sub-district granularity, these features often introduce noise or degrade accuracy. We also observe systematic misclassification patterns: poor households in more developed sub-districts tend to be wrongly excluded, while non-poor households in lower resource areas are wrongly included. Using the Shapley value approach, we show that the predictive effect of features such as NDVI varies by context, for instance, in some districts, NDVI positively correlates with expenditure due to productive croplands, diverging from broader trends. These results underscore the importance of spatial granularity, threshold sensitivity and local context when integrating area-level data into poverty targeting systems.

Suggested Citation

  • Siti Mariyah & Wayne Wobcke, 2025. "Evaluating area-level features for proxy means test models: evidence from rural, semi-urban and urban districts in poverty targeting," Journal of Computational Social Science, Springer, vol. 8(3), pages 1-28, August.
  • Handle: RePEc:spr:jcsosc:v:8:y:2025:i:3:d:10.1007_s42001-025-00405-8
    DOI: 10.1007/s42001-025-00405-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s42001-025-00405-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s42001-025-00405-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Abhijit Banerjee & Rema Hanna & Benjamin A. Olken & Elan Satriawan & Sudarno Sumarto, 2023. "Electronic Food Vouchers: Evidence from an At-Scale Experiment in Indonesia," American Economic Review, American Economic Association, vol. 113(2), pages 514-547, February.
    2. Abhijit Banerjee & Rema Hanna & Jordan Kyle & Benjamin A. Olken & Sudarno Sumarto, 2018. "Tangible Information and Citizen Empowerment: Identification Cards and Food Subsidy Programs in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 126(2), pages 451-491.
    3. Vivi Alatas & Abhijit Banerjee & Rema Hanna & Benjamin A. Olken & Julia Tobias, 2012. "Targeting the Poor: Evidence from a Field Experiment in Indonesia," American Economic Review, American Economic Association, vol. 102(4), pages 1206-1240, June.
    4. Roth, Alvin E, 1977. "The Shapley Value as a von Neumann-Morgenstern Utility," Econometrica, Econometric Society, vol. 45(3), pages 657-664, April.
    5. Vivi Alatas & Abhijit Banerjee & Rema Hanna & Benjamin A. Olken & Ririn Purnamasari & Matthew Wai-Poi, 2016. "Self-Targeting: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 124(2), pages 371-427.
    6. Edward B. Barbier & Jacob P. Hochard, 2019. "Poverty-Environment Traps," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 74(3), pages 1239-1271, November.
    7. Yongming Xu & Yaping Mo & Shanyou Zhu, 2021. "Poverty Mapping in the Dian-Gui-Qian Contiguous Extremely Poor Area of Southwest China Based on Multi-Source Geospatial Data," Sustainability, MDPI, vol. 13(16), pages 1-14, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bergstrom, Katy & Dodds, William, 2021. "The targeting benefit of conditional cash transfers," Journal of Public Economics, Elsevier, vol. 194(C).
    2. Tohari, Achmad & Parsons, Christopher & Rammohan, Anu, 2019. "Targeting poverty under complementarities: Evidence from Indonesia's unified targeting system," Journal of Development Economics, Elsevier, vol. 140(C), pages 127-144.
    3. Tohari, Achmad & Parsons, Christopher & Rammohan, Anu, 2017. "Targeting Poverty under Complementarities: Evidence from Indonesia's Unified Targeting System," IZA Discussion Papers 10968, Institute of Labor Economics (IZA).
    4. Björkegren, Daniel & Karaca, Burak Ceyhun, 2022. "Network adoption subsidies: A digital evaluation of a rural mobile phone program in Rwanda," Journal of Development Economics, Elsevier, vol. 154(C).
    5. Emily Aiken & Suzanne Bellue & Dean Karlan & Christopher R. Udry & Joshua Blumenstock, 2021. "Machine Learning and Mobile Phone Data Can Improve the Targeting of Humanitarian Assistance," NBER Working Papers 29070, National Bureau of Economic Research, Inc.
    6. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    7. Marianne Bertrand & Bruno Crépon & Alicia Marguerie & Patrick Premand, 2021. "Do Workfare Programs Live Up to Their Promises? Experimental Evidence from Cote D’Ivoire," NBER Working Papers 28664, National Bureau of Economic Research, Inc.
    8. Pushkar Maitra & Sandip Mitra & Dilip Mookherjee & Sujata Visaria, 2024. "Decentralized Targeting of Agricultural Credit Programs: Private Versus Political Intermediaries," Journal of the European Economic Association, European Economic Association, vol. 22(6), pages 2648-2699.
    9. Altındağ, Onur & O'Connell, Stephen D. & Şaşmaz, Aytuğ & Balcıoğlu, Zeynep & Cadoni, Paola & Jerneck, Matilda & Foong, Aimee Kunze, 2021. "Targeting humanitarian aid using administrative data: Model design and validation," Journal of Development Economics, Elsevier, vol. 148(C).
    10. Alix-Garcia, Jennifer M. & Sims, Katharine R.E. & Costica, Laura, 2021. "Better to be indirect? Testing the accuracy and cost-savings of indirect surveys," World Development, Elsevier, vol. 142(C).
    11. Anu Rammohan & Achmad Tohari, 2024. "Food vouchers and dietary diversity: evidence from social protection reform in Indonesia," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 16(1), pages 161-184, February.
    12. Beuermann, Diether W. & Hoffmann, Bridget & Stampini, Marco & Vargas, David L. & Vera-Cossio, Diego, 2025. "Shooting a moving target: Evaluating targeting tools for social programs when income fluctuates," Journal of Development Economics, Elsevier, vol. 172(C).
    13. Haseeb, Muhammad & Vyborny, Kate, 2022. "Data, discretion and institutional capacity: Evidence from cash transfers in Pakistan," Journal of Public Economics, Elsevier, vol. 206(C).
    14. ZHANG, Yangyang & ZHENG, Xinye & XIE, Lunyu, 2021. "How do poverty alleviation coordinators help the impoverished in rural China? -- Evidence from the Chinese poor population tracking dataset," China Economic Review, Elsevier, vol. 69(C).
    15. Phillippe Leite & Tina George & Changqing Sun & Theresa Jones & Kathy Lindert, 2017. "Social Registries for Social Assistance and Beyond," World Bank Publications - Reports 28284, The World Bank Group.
    16. repec:agg:journl:3557 is not listed on IDEAS
    17. Gadenne, Lucie, "undated". "Do Ration Shop Systems Increase Welfare? Theory and an Application to India," Economic Research Papers 269083, University of Warwick - Department of Economics.
    18. Esther Duflo, 2017. "The Economist as Plumber," NBER Working Papers 23213, National Bureau of Economic Research, Inc.
    19. Hillebrecht, Michael & Klonner, Stefan & Pacere, Noraogo A., 2023. "The dynamics of poverty targeting," Journal of Development Economics, Elsevier, vol. 161(C).
    20. Callejas, Jerónimo & Mohapatra, Debi Prasad, 2021. "Welfare effects of public procurement of medicines: Evidence from Ecuador," International Journal of Industrial Organization, Elsevier, vol. 75(C).
    21. Lucie Gadenne, 2020. "Can Rationing Increase Welfare? Theory and an Application to India's Ration Shop System," American Economic Journal: Economic Policy, American Economic Association, vol. 12(4), pages 144-177, November.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jcsosc:v:8:y:2025:i:3:d:10.1007_s42001-025-00405-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.