IDEAS home Printed from https://ideas.repec.org/p/zbw/glodps/1392.html
   My bibliography  Save this paper

Using Survey-to-Survey Imputation to Fill Poverty Data Gaps at a Low Cost: Evidence from a Randomized Survey Experiment

Author

Listed:
  • Dang, Hai-Anh
  • Kilic, Talip
  • Hlasny, Vladimir
  • Abanokova, Kseniya
  • Carletto, Calogero

Abstract

Survey data on household consumption are often unavailable or incomparable over time in many low- and middle-income countries. Based on a unique randomized survey experiment implemented in Tanzania, this study offers new and rigorous evidence demonstrating that survey-to-survey imputation can fill consumption data gaps and provide low-cost and reliable poverty estimates. Basic imputation models featuring utility expenditures, together with a modest set of predictors on demographics, employment, household assets and housing, yield accurate predictions. Imputation accuracy is robust to varying survey questionnaire length; the choice of base surveys for estimating the imputation model; different poverty lines; and alternative (quarterly or monthly) CPI deflators. The proposed approach to imputation also performs better than multiple imputation and a range of machine learning techniques. In the case of a target survey with modified (e.g., shortened or aggregated) food or non-food consumption modules, imputation models including food or non-food consumption as predictors do well only if the distributions of the predictors are standardized vis-à-vis the base survey. For best-performing models to reach acceptable levels of accuracy, the minimum-required sample size should be 1,000 for both base and target surveys. The discussion expands on the implications of the findings for the design of future surveys.

Suggested Citation

  • Dang, Hai-Anh & Kilic, Talip & Hlasny, Vladimir & Abanokova, Kseniya & Carletto, Calogero, 2024. "Using Survey-to-Survey Imputation to Fill Poverty Data Gaps at a Low Cost: Evidence from a Randomized Survey Experiment," GLO Discussion Paper Series 1392, Global Labor Organization (GLO).
  • Handle: RePEc:zbw:glodps:1392
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/281990/1/GLO-DP-1392.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Talip Kilic & Thomas Pave Sohnesen, 2019. "Same Question But Different Answer: Experimental Evidence on Questionnaire Design's Impact on Poverty Measured by Proxies," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 65(1), pages 144-165, March.
    2. Tarozzi, Alessandro, 2007. "Calculating Comparable Statistics From Incomparable Surveys, With an Application to Poverty in India," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 314-336, July.
    3. Altındağ, Onur & O'Connell, Stephen D. & Şaşmaz, Aytuğ & Balcıoğlu, Zeynep & Cadoni, Paola & Jerneck, Matilda & Foong, Aimee Kunze, 2021. "Targeting humanitarian aid using administrative data: Model design and validation," Journal of Development Economics, Elsevier, vol. 148(C).
    4. Joachim De Weerdt & John Gibson & Kathleen Beegle, 2020. "What Can We Learn from Experimenting with Survey Methods?," Annual Review of Resource Economics, Annual Reviews, vol. 12(1), pages 431-447, October.
    5. Arthi, Vellore & Beegle, Kathleen & De Weerdt, Joachim & Palacios-López, Amparo, 2018. "Not your average job: Measuring farm labor in Tanzania," Journal of Development Economics, Elsevier, vol. 130(C), pages 160-172.
    6. Hai-Anh H. Dang & Peter F. Lanjouw & Umar Serajuddin, 2017. "Updating poverty estimates in the absence of regular and comparable consumption data: methods and illustration with reference to a middle-income country," Oxford Economic Papers, Oxford University Press, vol. 69(4), pages 939-962.
    7. Stephen P. Jenkins & Richard V. Burkhauser & Shuaizhang Feng & Jeff Larrimore, 2011. "Measuring inequality using censored data: a multiple‐imputation approach to estimation and inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(1), pages 63-81, January.
    8. Dang,Hai-Anh H. & Kilic,Talip & Carletto,Calogero & Abanokova,Kseniya, 2021. "Poverty Imputation in Contexts without Consumption Data : A Revisit with Further Refinements," Policy Research Working Paper Series 9838, The World Bank.
    9. Kilic, Talip & Moylan, Heather & Ilukor, John & Mtengula, Clement & Pangapanga-Phiri, Innocent, 2021. "Root for the tubers: Extended-harvest crop production and productivity measurement in surveys," Food Policy, Elsevier, vol. 102(C).
    10. Ravallion, Martin, 2016. "The Economics of Poverty: History, Measurement, and Policy," OUP Catalogue, Oxford University Press, number 9780190212773.
    11. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    12. Deaton,Angus & Muellbauer,John, 1980. "Economics and Consumer Behavior," Cambridge Books, Cambridge University Press, number 9780521296762.
    13. Aiken, Emily L. & Bedoya, Guadalupe & Blumenstock, Joshua E. & Coville, Aidan, 2023. "Program targeting with machine learning and mobile phone data: Evidence from an anti-poverty intervention in Afghanistan," Journal of Development Economics, Elsevier, vol. 161(C).
    14. Hai‐Anh Dang & Dean Jolliffe & Calogero Carletto, 2019. "Data Gaps, Data Incomparability, And Data Imputation: A Review Of Poverty Measurement Methods For Data‐Scarce Environments," Journal of Economic Surveys, Wiley Blackwell, vol. 33(3), pages 757-797, July.
    15. Athey, Susan & Imbens, Guido W., 2019. "Machine Learning Methods Economists Should Know About," Research Papers 3776, Stanford University, Graduate School of Business.
    16. Hai-Anh H. Dang & Paolo Verme, 2023. "Estimating poverty for refugees in data-scarce contexts: an application of cross-survey imputation," Journal of Population Economics, Springer;European Society for Population Economics, vol. 36(2), pages 653-679, April.
    17. Beegle, Kathleen & De Weerdt, Joachim & Friedman, Jed & Gibson, John, 2012. "Methods of household consumption measurement through surveys: Experimental results from Tanzania," Journal of Development Economics, Elsevier, vol. 98(1), pages 3-18.
    18. Chris Elbers & Jean O. Lanjouw & Peter Lanjouw, 2003. "Micro--Level Estimation of Poverty and Inequality," Econometrica, Econometric Society, vol. 71(1), pages 355-364, January.
    19. Susan Athey & Guido W. Imbens, 2019. "Machine Learning Methods That Economists Should Know About," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 685-725, August.
    20. Kathleen Beegle & Luc Christiaensen & Andrew Dabalen & Isis Gaddis, 2016. "Poverty in a Rising Africa," World Bank Publications - Books, The World Bank Group, number 22575, December.
    21. David Stifel & Luc Christiaensen, 2007. "Tracking Poverty Over Time in the Absence of Comparable Consumption Data," The World Bank Economic Review, World Bank, vol. 21(2), pages 317-341, June.
    22. Mohamed Douidich & Abdeljaouad Ezzrari & Roy Van der Weide & Paolo Verme, 2016. "Estimating Quarterly Poverty Rates Using Labor Force Surveys: A Primer," The World Bank Economic Review, World Bank, vol. 30(3), pages 475-500.
    23. Astrid Mathiassen, 2009. "A model based approach for predicting annual poverty rates without expenditure data," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 7(2), pages 117-135, June.
    24. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    25. Gourlay, Sydney & Kilic, Talip & Lobell, David B., 2019. "A new spin on an old debate: Errors in farmer-reported production and their implications for inverse scale - Productivity relationship in Uganda," Journal of Development Economics, Elsevier, vol. 141(C).
    26. Luc Christiaensen & Ethan Ligon & Thomas Pave Sohnesen, 2022. "Consumption Subaggregates Should Not Be Used to Measure Poverty," The World Bank Economic Review, World Bank, vol. 36(2), pages 413-432.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dang,Hai-Anh H. & Kilic,Talip & Carletto,Calogero & Abanokova,Kseniya, 2021. "Poverty Imputation in Contexts without Consumption Data : A Revisit with Further Refinements," Policy Research Working Paper Series 9838, The World Bank.
    2. Dang, Hai-Anh & Lanjouw, Peter F., 2021. "Data Scarcity and Poverty Measurement," IZA Discussion Papers 14631, Institute of Labor Economics (IZA).
    3. Hai-Anh H. Dang & Peter F. Lanjouw, 2023. "Regression-based imputation for poverty measurement in data-scarce settings," Chapters, in: Jacques Silber (ed.), Research Handbook on Measuring Poverty and Deprivation, chapter 13, pages 141-150, Edward Elgar Publishing.
    4. Theresa Beltramo & Hai-Anh H. Dang & Ibrahima Sarr & Paolo Verme, 2020. "Estimating Poverty among Refugee Populations: A Cross-Survey Imputation Exercise for Chad," Working Papers 536, ECINEQ, Society for the Study of Economic Inequality.
    5. Hai‐Anh H. Dang, 2021. "To impute or not to impute, and how? A review of poverty‐estimation methods in the absence of consumption data," Development Policy Review, Overseas Development Institute, vol. 39(6), pages 1008-1030, November.
    6. Dang, Hai-Anh & Carletto, Calogero, 2022. "Recall Bias Revisited: Measure Farm Labor Using Mixed-Mode Surveys and Multiple Imputation," IZA Discussion Papers 14997, Institute of Labor Economics (IZA).
    7. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    8. Dang,Hai-Anh H., 2018. "To impute or not to impute ? a review of alternative poverty estimation methods in the context of unavailable consumption data," Policy Research Working Paper Series 8403, The World Bank.
    9. Hai-Anh H. Dang & Peter F. Lanjouw & Umar Serajuddin, 2017. "Updating poverty estimates in the absence of regular and comparable consumption data: methods and illustration with reference to a middle-income country," Oxford Economic Papers, Oxford University Press, vol. 69(4), pages 939-962.
    10. Hai-Anh H. Dang & Paolo Verme, 2023. "Estimating poverty for refugees in data-scarce contexts: an application of cross-survey imputation," Journal of Population Economics, Springer;European Society for Population Economics, vol. 36(2), pages 653-679, April.
    11. Hai‐Anh Dang & Dean Jolliffe & Calogero Carletto, 2019. "Data Gaps, Data Incomparability, And Data Imputation: A Review Of Poverty Measurement Methods For Data‐Scarce Environments," Journal of Economic Surveys, Wiley Blackwell, vol. 33(3), pages 757-797, July.
    12. Dang,Hai-Anh H. & Lanjouw,Peter F. & Serajuddin,Umar & Dang,Hai-Anh H. & Lanjouw,Peter F. & Serajuddin,Umar, 2014. "Updating poverty estimates at frequent intervals in the absence of consumption data : methods and illustration with reference to a middle-income country," Policy Research Working Paper Series 7043, The World Bank.
    13. Paolo Verme, 2020. "Which Model for Poverty Predictions?," Working Papers 521, ECINEQ, Society for the Study of Economic Inequality.
    14. Hai-Anh H. Dang, 2019. "To impute or not to impute, and how? A review of alternative poverty estimation methods in the context of unavailable consumption data," Working Papers 507, ECINEQ, Society for the Study of Economic Inequality.
    15. Luc Christiaensen & Peter Lanjouw & Jill Luoto & David Stifel, 2012. "Small area estimation-based prediction methods to track poverty: validation and applications," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 10(2), pages 267-297, June.
    16. World Bank, 2016. "Tunisia Poverty Assessment 2015," World Bank Publications - Reports 24410, The World Bank Group.
    17. Talip Kilic & Thomas Pave Sohnesen, 2019. "Same Question But Different Answer: Experimental Evidence on Questionnaire Design's Impact on Poverty Measured by Proxies," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 65(1), pages 144-165, March.
    18. Wollburg, Philip & Tiberti, Marco & Zezza, Alberto, 2021. "Recall length and measurement error in agricultural surveys," Food Policy, Elsevier, vol. 100(C).
    19. F. Clementi & A. L. Dabalen & V. Molini & F. Schettino, 2017. "When the Centre Cannot Hold: Patterns of Polarization in Nigeria," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 63(4), pages 608-632, December.
    20. Dang,Hai-Anh H. & Verme,Paolo, 2019. "Estimating Poverty for Refugee Populations : Can Cross-Survey Imputation Methods Substitute for Data Scarcity ?," Policy Research Working Paper Series 9076, The World Bank.

    More about this item

    Keywords

    consumption; poverty; survey-to-survey imputation; household surveys; Tanzania;
    All these keywords.

    JEL classification:

    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • I32 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Measurement and Analysis of Poverty
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:glodps:1392. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/glabode.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.