IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/11192.html
   My bibliography  Save this paper

Stress Testing Survey to Survey Imputation: Understanding When Poverty Predictions Can Fail

Author

Listed:
  • Corral Rodas, Paul Andres
  • Ham, Andres
  • Lanjouw, Peter
  • Lucchetti, Leonardo Ramiro
  • Stemmler, Henry

Abstract

Accurate and timely poverty measurement is central to development policy, yet the availability of up-to-date high-quality household survey data remains limited—particularly in countries where poverty is most concentrated. Survey-to-survey imputation has emerged as a practical response to this challenge, allowing practitioners to update poverty estimates using recent surveys that lack direct welfare measures by borrowing information from other comprehensive surveys. A critical review of the method is provided, revisiting its statistical underpinnings and testing its limitations through extensive model-based simulations. Through these simulations, the analysis demonstrates how violations of parameter stability, omitted variable bias, and shifts in survey design can introduce substantial errors—particularly when imputing across time or under economic and structural change. Results show that standard corrections such as re-weighting or covariate standardization may fail to eliminate these biases, especially when imputing across time or under structural change. The performance of alternative model specifications is also evaluated under various methods, including performance under heteroskedastic errors, non-normality. The findings offer practical guidance for practitioners on when survey-to-survey imputation is likely to succeed, when it should be reconsidered, and how to communicate its limitations transparently in the context of poverty monitoring and policy design.

Suggested Citation

  • Corral Rodas, Paul Andres & Ham, Andres & Lanjouw, Peter & Lucchetti, Leonardo Ramiro & Stemmler, Henry, 2025. "Stress Testing Survey to Survey Imputation: Understanding When Poverty Predictions Can Fail," Policy Research Working Paper Series 11192, The World Bank.
  • Handle: RePEc:wbk:wbrwps:11192
    as

    Download full text from publisher

    File URL: https://documents.worldbank.org/curated/en/099410408192539779/pdf/IDU-c0bbe9ec-0297-4f7b-860e-c366b4c785f1.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Tomoki Fujii & Roy van der Weide, 2020. "Is Predicted Data a Viable Alternative to Real Data?," The World Bank Economic Review, World Bank, vol. 34(2), pages 485-508.
    2. François Bourguignon & Francisco Ferreira & Phillippe Leite, 2008. "Beyond Oaxaca–Blinder: Accounting for differences in household income distributions," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 6(2), pages 117-148, June.
    3. Hai‐Anh H. Dang & Talip Kilic & Kseniya Abanokova & Calogero Carletto, 2025. "Poverty Imputation in Contexts Without Consumption Data: A Revisit With Further Refinements," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 71(1), February.
    4. Sinha Roy, Sutirtha & van der Weide, Roy, 2025. "Estimating poverty for India after 2011 using private-sector survey data," Journal of Development Economics, Elsevier, vol. 172(C).
    5. Luc Christiaensen & Peter Lanjouw & Jill Luoto & David Stifel, 2012. "Small area estimation-based prediction methods to track poverty: validation and applications," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 10(2), pages 267-297, June.
    6. repec:pri:rpdevs:deaton_grosh_consumption is not listed on IDEAS
    7. Corral Rodas,Paul Andres & Kastelic,Kristen Himelein & Mcgee,Kevin Robert & Molina,Isabel, 2021. "A Map of the Poor or a Poor Map ?," Policy Research Working Paper Series 9620, The World Bank.
    8. Betti, Gianni & Molini, Vasco & Mori, Lorenzo, 2024. "An attempt to correct the underestimation of inequality measures in cross-survey imputation through generalized additive models for location, scale and shape," Socio-Economic Planning Sciences, Elsevier, vol. 91(C).
    9. Harvey, A C, 1976. "Estimating Regression Models with Multiplicative Heteroscedasticity," Econometrica, Econometric Society, vol. 44(3), pages 461-465, May.
    10. Yolanda Marhuenda & Isabel Molina & Domingo Morales & J. N. K. Rao, 2017. "Poverty mapping in small areas under a twofold nested error regression model," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(4), pages 1111-1136, October.
    11. World Bank, 2024. "Poverty, Prosperity, and Planet Report 2024," World Bank Publications - Books, The World Bank Group, number 42211, April.
    12. Martin Wittenberg, 2010. "An introduction to maximum entropy and minimum cross-entropy estimation using Stata," Stata Journal, StataCorp LLC, vol. 10(3), pages 315-330, September.
    13. Rude, Britta Laurin & Robayo, Monica, 2024. "Statistical Matching for Combining the European Survey on Income and Living Conditions and the Household Budget Surveys: An Evaluation of Energy Expenditures in Bulgaria," Policy Research Working Paper Series 10818, The World Bank.
    14. Hai‐Anh Dang & Dean Jolliffe & Calogero Carletto, 2019. "Data Gaps, Data Incomparability, And Data Imputation: A Review Of Poverty Measurement Methods For Data‐Scarce Environments," Journal of Economic Surveys, Wiley Blackwell, vol. 33(3), pages 757-797, July.
    15. Roy, Preeti & Ahmad, Wasim & Sadorsky, Perry & Phani, B.V., 2022. "What do we know about the idiosyncratic risk of clean energy equities?," Energy Economics, Elsevier, vol. 112(C).
    16. Paul Corral & Kristen Himelein & Kevin McGee & Isabel Molina, 2021. "A Map of the Poor or a Poor Map?," Mathematics, MDPI, vol. 9(21), pages 1-40, November.
    17. Beegle, Kathleen & De Weerdt, Joachim & Friedman, Jed & Gibson, John, 2012. "Methods of household consumption measurement through surveys: Experimental results from Tanzania," Journal of Development Economics, Elsevier, vol. 98(1), pages 3-18.
    18. Rubin, Donald B, 1986. "Statistical Matching Using File Concatenation with Adjusted Weights and Multiple Imputations," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 87-94, January.
    19. Angus Deaton & Margaret Grosh, 1998. "Designing Household Survey Questionnaires for Developing Countries Lessons from Ten Years of LSMS Experience, Chapter 17: Consumption," Working Papers 218, Princeton University, Woodrow Wilson School of Public and International Affairs, Research Program in Development Studies..
    20. Manuel Arellano & Costas Meghir, 1992. "Female Labour Supply and On-the-Job Search: An Empirical Model Estimated Using Complementary Data Sets," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 59(3), pages 537-559.
    21. Astrid Mathiassen, 2013. "Testing Prediction Performance of Poverty Models: Empirical Evidence from U ganda," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 59(1), pages 91-112, March.
    22. Edochie, Ifeanyi Nzegwu, Freije-Rodriguez, Samuel, Lakner, Christoph, Moreno Herrera, Laura Liliana, Newhouse, David Locke, Roy, Sutirtha Sinha, Yonzan, Nishant, 2022. "What Do We Know about Poverty in India in 2017/18 ?," Policy Research Working Paper Series 9931, The World Bank.
    23. Jonathan Lain & Marta Schoch & Tara Vishwanath, 2024. "Making Data Count: Estimating a Poverty Trend for Nigeria between 2009 and 2019," The World Bank Economic Review, World Bank, vol. 38(3), pages 647-668.
    24. Natalia Rojas‐Perilla & Sören Pannier & Timo Schmid & Nikos Tzavidis, 2020. "Data‐driven transformations in small area estimation," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(1), pages 121-148, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hai‐Anh H. Dang & Talip Kilic & Kseniya Abanokova & Calogero Carletto, 2025. "Poverty Imputation in Contexts Without Consumption Data: A Revisit With Further Refinements," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 71(1), February.
    2. Dang, Hai-Anh H & Lanjouw, Peter F., 2021. "Data Scarcity and Poverty Measurement," IZA Discussion Papers 14631, Institute of Labor Economics (IZA).
    3. Betti,Gianni & Molini,Vasco & Mori,Lorenzo, 2022. "New Algorithm to Estimate Inequality Measures in Cross-Survey Imputation : An Attemptto Correct the Underestimation of Extreme Values," Policy Research Working Paper Series 10013, The World Bank.
    4. Luc Christiaensen & Ethan Ligon & Thomas Pave Sohnesen, 2022. "Consumption Subaggregates Should Not Be Used to Measure Poverty," The World Bank Economic Review, World Bank, vol. 36(2), pages 413-432.
    5. Hai-Anh H. Dang & Peter F. Lanjouw, 2023. "Regression-based imputation for poverty measurement in data-scarce settings," Chapters, in: Jacques Silber (ed.), Research Handbook on Measuring Poverty and Deprivation, chapter 13, pages 141-150, Edward Elgar Publishing.
    6. Talip Kilic & Thomas Pave Sohnesen, 2019. "Same Question But Different Answer: Experimental Evidence on Questionnaire Design's Impact on Poverty Measured by Proxies," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 65(1), pages 144-165, March.
    7. Ligon, Ethan & Christiaensen, Luc & Sohnesen, Thomas P, 2020. "Should Consumption Sub-Aggregates be Used to Measure Poverty?," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt9b9929jh, Department of Agricultural & Resource Economics, UC Berkeley.
    8. Sinha Roy, Sutirtha & van der Weide, Roy, 2025. "Estimating poverty for India after 2011 using private-sector survey data," Journal of Development Economics, Elsevier, vol. 172(C).
    9. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    10. Daniel Gerszon Mahler & Elizabeth Foster & Christoph Lakner & Zander Prinsloo & Rostand Tchouakam Mbouendeu & Samuel K. Tetteh-Baah, 2025. "Constructing Comparable Global Poverty Trends," Global Poverty Monitoring Technical Note Series 45, The World Bank.
    11. Elbers,Chris & Roy Van der Weide, 2025. "Non-Normal Empirical Bayes Prediction of Local Welfare," Policy Research Working Paper Series 11107, The World Bank.
    12. Hai-Anh H. Dang & Peter F. Lanjouw & Umar Serajuddin, 2017. "Updating poverty estimates in the absence of regular and comparable consumption data: methods and illustration with reference to a middle-income country," Oxford Economic Papers, Oxford University Press, vol. 69(4), pages 939-962.
    13. Ibrahima Sarr & Hai-Anh H. Dang & Carlos Santiago Guzman Gutierrez & Theresa Beltramo & Paolo Verme, 2025. "Using Cross-Survey Imputation to Estimate Poverty for Venezuelan Refugees in Colombia," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 177(1), pages 207-251, March.
    14. Dang, Hai-Anh H & Kilic, Talip & Hlasny, Vladimir & Abanokova, Kseniya & Carletto, Calogero, 2024. "Using Survey-to-Survey Imputation to Fill Poverty Data Gaps at a Low Cost: Evidence from a Randomized Survey Experiment," IZA Discussion Papers 16792, Institute of Labor Economics (IZA).
    15. Pape,Utz Johann, 2021. "Measuring Poverty Rapidly Using Within-Survey Imputations," Policy Research Working Paper Series 9530, The World Bank.
    16. Hai-Anh H. Dang & Paolo Verme, 2023. "Estimating poverty for refugees in data-scarce contexts: an application of cross-survey imputation," Journal of Population Economics, Springer;European Society for Population Economics, vol. 36(2), pages 653-679, April.
    17. Jonathan Lain & Marta Schoch & Tara Vishwanath, 2024. "Making Data Count: Estimating a Poverty Trend for Nigeria between 2009 and 2019," The World Bank Economic Review, World Bank, vol. 38(3), pages 647-668.
    18. Dang, Hai-Anh H & Carletto, Calogero, 2022. "Recall Bias Revisited: Measure Farm Labor Using Mixed-Mode Surveys and Multiple Imputation," IZA Discussion Papers 14997, Institute of Labor Economics (IZA).
    19. Hai‐Anh Dang & Dean Jolliffe & Calogero Carletto, 2019. "Data Gaps, Data Incomparability, And Data Imputation: A Review Of Poverty Measurement Methods For Data‐Scarce Environments," Journal of Economic Surveys, Wiley Blackwell, vol. 33(3), pages 757-797, July.
    20. Astrid Mathiassen & Bjørn K. Getz Wold, 2021. "Predicting poverty trends by survey-to-survey imputation: the challenge of comparability," Oxford Economic Papers, Oxford University Press, vol. 73(3), pages 1153-1174.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:11192. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.