IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v142y2021ics0305750x21000310.html
   My bibliography  Save this article

Better to be indirect? Testing the accuracy and cost-savings of indirect surveys

Author

Listed:
  • Alix-Garcia, Jennifer M.
  • Sims, Katharine R.E.
  • Costica, Laura

Abstract

We test the validity of indirect surveying as a method to collect household data. We compare household and informant reports of assets, develop poverty indices from both, test their performance as regression covariates, and examine errors in reporting and targeting resulting from using indirectly reported variables. Informant-based targeting indices are highly correlated with household measures and can be reasonable substitutes for self-reported indices in simple regressions. They can also be used to assign a simulated anti-poverty program with similar error rates to related methods. In our setting, eliminating direct household surveys would have reduced survey costs by 50%.

Suggested Citation

  • Alix-Garcia, Jennifer M. & Sims, Katharine R.E. & Costica, Laura, 2021. "Better to be indirect? Testing the accuracy and cost-savings of indirect surveys," World Development, Elsevier, vol. 142(C).
    • Handle: RePEc:eee:wdevel:v:142:y:2021:i:c:s0305750x21000310
    DOI: 10.1016/j.worlddev.2021.105419
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X21000310
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.worlddev.2021.105419?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anderson, Michael L, 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt15n8j26f, Department of Agricultural & Resource Economics, UC Berkeley.
    2. Caldes, Natalia & Coady, David & Maluccio, John A., 2006. "The cost of poverty alleviation transfer programs: A comparative analysis of three programs in Latin America," World Development, Elsevier, vol. 34(5), pages 818-837, May.
    3. Brown, Caitlin & Ravallion, Martin & van de Walle, Dominique, 2018. "A poor means test? Econometric targeting in Africa," Journal of Development Economics, Elsevier, vol. 134(C), pages 109-124.
    4. Florence Kondylis & Valerie Mueller & S. Zhu, 2015. "Measuring agricultural knowledge and adoption," Agricultural Economics, International Association of Agricultural Economists, vol. 46(3), pages 449-462, May.
    5. Vivi Alatas & Abhijit Banerjee & Rema Hanna & Benjamin A. Olken & Julia Tobias, 2012. "Targeting the Poor: Evidence from a Field Experiment in Indonesia," American Economic Review, American Economic Association, vol. 102(4), pages 1206-1240, June.
    6. Deon Filmer & Kinnon Scott, 2012. "Assessing Asset Indices," Demography, Springer;Population Association of America (PAA), vol. 49(1), pages 359-392, February.
    7. Garrett, James L. & Downen, Jeanne, 2001. "Rapid assessments in urban areas," FCND discussion papers 107, International Food Policy Research Institute (IFPRI).
    8. Koen Decancq & María Ana Lugo, 2013. "Weights in Multidimensional Indices of Wellbeing: An Overview," Econometric Reviews, Taylor & Francis Journals, vol. 32(1), pages 7-34, January.
    9. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    10. Vivi Alatas & Abhijit Banerjee & Rema Hanna & Benjamin A. Olken & Ririn Purnamasari & Matthew Wai-Poi, 2016. "Self-Targeting: Evidence from a Field Experiment in Indonesia," Journal of Political Economy, University of Chicago Press, vol. 124(2), pages 371-427.
    11. Elbers, Chris & Fujii, Tomoki & Lanjouw, Peter & Ozler, Berk & Yin, Wesley, 2007. "Poverty alleviation through geographic targeting: How much does disaggregation help?," Journal of Development Economics, Elsevier, vol. 83(1), pages 198-213, May.
    12. Alderman, Harold, 2002. "Do local officials know something we don't? Decentralization of targeted transfers in Albania," Journal of Public Economics, Elsevier, vol. 83(3), pages 375-404, March.
    13. Basurto, Maria Pia & Dupas, Pascaline & Robinson, Jonathan, 2020. "Decentralization and efficiency of subsidy targeting: Evidence from chiefs in rural Malawi," Journal of Public Economics, Elsevier, vol. 185(C).
    14. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    15. David McKenzie, 2005. "Measuring inequality with asset indicators," Journal of Population Economics, Springer;European Society for Population Economics, vol. 18(2), pages 229-260, June.
    16. Skoufias, Emmanuel & Diamond, Alexis & Vinha, Katja & Gill, Michael & Dellepiane, Miguel Rebolledo, 2020. "Estimating poverty rates in subnational populations of interest: An assessment of the Simple Poverty Scorecard," World Development, Elsevier, vol. 129(C).
    17. John M. Abowd & Martha H. Stinson, 2013. "Estimating Measurement Error in Annual Job Earnings: A Comparison of Survey and Administrative Data," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1451-1467, December.
    18. Guy Stecklov & Paul Winters & Jessica Todd & Ferdinando Regalia, 2006. "Demographic Externalities from Poverty Programs in Developing Countries: Experimental Evidence from Latin America," Working Papers 2006-01, American University, Department of Economics.
    19. Deon Filmer & Lant Pritchett, 2001. "Estimating Wealth Effects Without Expenditure Data—Or Tears: An Application To Educational Enrollments In States Of India," Demography, Springer;Population Association of America (PAA), vol. 38(1), pages 115-132, February.
    20. Bigman, David & Fofack, Hippolyte, 2000. "Geographical Targeting for Poverty Alleviation: An Introduction to the Special Issue," The World Bank Economic Review, World Bank, vol. 14(1), pages 129-145, January.
    21. Garance Genicot & Debraj Ray, 2003. "Group Formation in Risk-Sharing Arrangements," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 70(1), pages 87-113.
    22. Stoeffler, Quentin & Mills, Bradford & del Ninno, Carlo, 2016. "Reaching the Poor: Cash Transfer Program Targeting in Cameroon," World Development, Elsevier, vol. 83(C), pages 244-263.
    23. Jere R. Behrman & Susan W. Parker & Petra E. Todd, 2011. "Do Conditional Cash Transfers for Schooling Generate Lasting Benefits?: A Five-Year Followup of PROGRESA/Oportunidades," Journal of Human Resources, University of Wisconsin Press, vol. 46(1), pages 93-122.
    24. Galasso, Emanuela & Ravallion, Martin, 2005. "Decentralized targeting of an antipoverty program," Journal of Public Economics, Elsevier, vol. 89(4), pages 705-727, April.
    25. Chambers, Robert, 1994. "Participatory rural appraisal (PRA): Analysis of experience," World Development, Elsevier, vol. 22(9), pages 1253-1268, September.
    26. Chambers, Robert, 1994. "Participatory rural appraisal (PRA): Challenges, potentials and paradigm," World Development, Elsevier, vol. 22(10), pages 1437-1454, October.
    27. Chambers, Robert, 1994. "The origins and practice of participatory rural appraisal," World Development, Elsevier, vol. 22(7), pages 953-969, July.
    28. Takasaki, Yoshito & Barham, Bradford L. & Coomes, Oliver T., 2000. "Rapid Rural Appraisal in Humid Tropical Forests: An Asset Possession-Based Approach and Validation Methods for Wealth Assessment Among Forest Peasant Households," World Development, Elsevier, vol. 28(11), pages 1961-1977, November.
    29. Bergeron, Gilles & Morris, Saul Sutkover & Medina Banegas, Juan Manuel, 1998. "How reliable are group informant ratings? A test of food security ratings in Honduras," World Development, Elsevier, vol. 26(10), pages 1893-1902, October.
    30. Fox, Jonathan A., 2007. "Accountability Politics: Power and Voice in Rural Mexico," OUP Catalogue, Oxford University Press, number 9780199208852, Decembrie.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Emily Aiken & Suzanne Bellue & Dean Karlan & Christopher R. Udry & Joshua Blumenstock, 2021. "Machine Learning and Mobile Phone Data Can Improve the Targeting of Humanitarian Assistance," NBER Working Papers 29070, National Bureau of Economic Research, Inc.
    2. Schleicher, Michael & Souares, Aurélia & Pacere, Athanase Narangoro & Sauerborn, Rainer & Klonner, Stefan, 2016. "Decentralized versus Statistical Targeting of Anti-Poverty Programs: Evidence from Burkina Faso," Working Papers 0623, University of Heidelberg, Department of Economics.
    3. Haseeb, Muhammad & Vyborny, Kate, 2022. "Data, discretion and institutional capacity: Evidence from cash transfers in Pakistan," Journal of Public Economics, Elsevier, vol. 206(C).
    4. Hillebrecht, Michael & Klonner, Stefan & Pacere, Noraogo A., 2023. "The dynamics of poverty targeting," Journal of Development Economics, Elsevier, vol. 161(C).
    5. Lendie Follett & Heath Henderson, 2022. "A hybrid approach to targeting social assistance," Papers 2201.01356, arXiv.org.
    6. Follett, Lendie & Henderson, Heath, 2023. "A hybrid approach to targeting social assistance," Journal of Development Economics, Elsevier, vol. 160(C).
    7. Henderson, Heath & Follett, Lendie, 2022. "Targeting social safety net programs on human capabilities," World Development, Elsevier, vol. 151(C).
    8. Alix-Garcia, Jennifer M. & Sims, Katharine R.E. & Phaneuf, Daniel J., 2019. "Using referenda to improve targeting and decrease costs of conditional cash transfers," Journal of Public Economics, Elsevier, vol. 176(C), pages 179-194.
    9. Kashi Kafle & Rui Benfica & Paul Winters, 2020. "Does relative deprivation induce migration? Evidence from Sub‐Saharan Africa," American Journal of Agricultural Economics, John Wiley & Sons, vol. 102(3), pages 999-1019, May.
    10. Tohari, Achmad & Parsons, Christopher & Rammohan, Anu, 2019. "Targeting poverty under complementarities: Evidence from Indonesia's unified targeting system," Journal of Development Economics, Elsevier, vol. 140(C), pages 127-144.
    11. Elsa Valli, 2017. "Essays on social protection," Economics PhD Theses 1017, Department of Economics, University of Sussex Business School.
    12. Schnitzer,Pascale & Stoeffler,Quentin, 2021. "Targeting for Social Safety Nets : Evidence from Nine Programs in the Sahel," Policy Research Working Paper Series 9816, The World Bank.
    13. Han, Huawei & Gao, Qin, 2019. "Community-based welfare targeting and political elite capture: Evidence from rural China," World Development, Elsevier, vol. 115(C), pages 145-159.
    14. Awaworyi Churchill, Sefa & Iqbal, Nasir & Nawaz, Saima & Yew, Siew Ling, 2021. "Unconditional cash transfers, child labour and education: theory and evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 437-457.
    15. González-Flores, Mario & Heracleous, Maria & Winters, Paul, 2012. "Leaving the Safety Net: An Analysis of Dropouts in an Urban Conditional Cash Transfer Program," World Development, Elsevier, vol. 40(12), pages 2505-2521.
    16. Ham, Andrés & Michelson, Hope C., 2018. "Does the form of delivering incentives in conditional cash transfers matter over a decade later?," Journal of Development Economics, Elsevier, vol. 134(C), pages 96-108.
    17. Hillebrecht, Michael & Klonner, Stefan & Pacere, Noraogo A., 2020. "Dynamic Properties of Poverty Targeting," Working Papers 0696, University of Heidelberg, Department of Economics.
    18. Pushkar Maitra & Sandip Mitra & Dilip Mookherjee & Sujata Visaria, 2020. "Decentralized Targeting of Agricultural Credit Programs: Private versus Political Intermediaries," HKUST IEMS Working Paper Series 2020-70, HKUST Institute for Emerging Market Studies, revised Jan 2020.
    19. Altındağ, Onur & O'Connell, Stephen D. & Şaşmaz, Aytuğ & Balcıoğlu, Zeynep & Cadoni, Paola & Jerneck, Matilda & Foong, Aimee Kunze, 2021. "Targeting humanitarian aid using administrative data: Model design and validation," Journal of Development Economics, Elsevier, vol. 148(C).
    20. Xavier Giné & Shreena Patel & Bernardo Ribeiro & Ildrim Valley, 2022. "Efficiency and equity of input subsidies: Experimental evidence from Tanzania†," American Journal of Agricultural Economics, John Wiley & Sons, vol. 104(5), pages 1625-1655, October.

    More about this item

    Keywords

    Indirect survey; Survey design; Targeting;
    All these keywords.

    JEL classification:

    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development
    • I32 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Measurement and Analysis of Poverty
    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:142:y:2021:i:c:s0305750x21000310. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.