IDEAS home Printed from https://ideas.repec.org/p/tvs/wpaper/wp-019.html
   My bibliography  Save this paper

Comprehensive data quality studies as a component of poverty assessments

Author

Listed:
  • Mark Brooks
  • Rattiya S. Lippe
  • Hermann Waibel

Abstract

Realistic poverty assessments necessitate high-quality household survey data. Such data provide the foundation for designing sound policies to sustainably reduce poverty. Despite of this, welfare measures from household surveys are often plagued by non-sampling errors in the form of non-response and measurement error. Current research, while generating important lessons, is often limited in scope and the majority of studies on determinants of data quality deal with quantifiable interviewer and respondent characteristics. A comprehensive study on data quality of an ongoing long-term household panel survey in Thailand and Vietnam is presented in this paper. Determinants drawn from respondent and interviewer characteristics, the interview and survey environment and interview paradata are found to have a significant effect on the overall quality of income-related data. We suggest that survey managers utilizing computerized questionnaires further develop and optimize validation and plausibility guidelines in order to minimize non-sampling errors. Furthermore, referring to validation data (e.g. from administrative records) during data processing is likely to be a promising approach in improving the identification of such errors.

Suggested Citation

  • Mark Brooks & Rattiya S. Lippe & Hermann Waibel, 2020. "Comprehensive data quality studies as a component of poverty assessments," TVSEP Working Papers wp-019, Leibniz Universitaet Hannover, Institute of Development and Agricultural Economics, Project TVSEP.
  • Handle: RePEc:tvs:wpaper:wp-019
    as

    Download full text from publisher

    File URL: http://wp-tvsep.ifgb.uni-hannover.de/RePEc/tvs/pdfbib/wp-019.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bruce D. Meyer & Nikolas Mittag, 2019. "Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness, and Holes in the Safety Net," American Economic Journal: Applied Economics, American Economic Association, vol. 11(2), pages 176-204, April.
    2. Fisher, Monica & Reimer, Jeffrey J. & Carr, Edward R., 2010. "Who Should be Interviewed in Surveys of Household Income?," World Development, Elsevier, vol. 38(7), pages 966-973, July.
    3. John Gibson, 2016. "Poverty Measurement: We Know Less than Policy Makers Realize," Asia and the Pacific Policy Studies, Wiley Blackwell, vol. 3(3), pages 430-442, September.
    4. Bruce Meyer & Robert Goerge, 2011. "Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation," Working Papers 11-14, Center for Economic Studies, U.S. Census Bureau.
    5. Ivar Krumpal, 2013. "Determinants of social desirability bias in sensitive surveys: a literature review," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(4), pages 2025-2047, June.
    6. Bruce D. Meyer & Wallace K. C. Mok & James X. Sullivan, 2015. "Household Surveys in Crisis," Journal of Economic Perspectives, American Economic Association, vol. 29(4), pages 199-226, Fall.
    7. Bruce D. Meyer & Nikolas Mittag, 2015. "Using Linked Survey and Administrative Data to Better Measure Income: Implications for Poverty, Program Effectiveness and Holes in the Safety Net," Upjohn Working Papers 15-242, W.E. Upjohn Institute for Employment Research.
    8. Pamela Campanelli & Colm O'Muircheartaigh, 1999. "Interviewers, Interviewer Continuity, and Panel Survey Nonresponse," Quality & Quantity: International Journal of Methodology, Springer, vol. 33(1), pages 59-76, February.
    9. Nicoletti, Cheti & Peracchi, Franco & Foliano, Francesca, 2011. "Estimating Income Poverty in the Presence of Missing Data and Measurement Error," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 61-72.
    10. Frick, Joachim R. & Grabka, Markus M., 2007. "Item Non-Response and Imputation of Annual Labor Income in Panel Surveys from a Cross-National Perspective," IZA Discussion Papers 3043, Institute of Labor Economics (IZA).
    11. Lynn, Peter & Jäckle, Annette & Tipping, Sarah & Sinibaldi, Jennifer, 2011. "The effect of interviewer personality, skills and attitudes on respondent co-operation with face-to-face surveys," ISER Working Paper Series 2011-14, Institute for Social and Economic Research.
    12. Buehler, Dorothee & Sharma, Rasadhika & Stein, Wiebke, 2019. "Personality traits in Southeast Asia - Evidence from rural Thailand and Vietnam," TVSEP Working Papers wp-014, Leibniz Universitaet Hannover, Institute of Development and Agricultural Economics, Project TVSEP.
    13. Nguyen, Giang & Nguyen, Trung Thanh, 2020. "Exposure to weather shocks: A comparison between self-reported record and extreme weather data," Economic Analysis and Policy, Elsevier, vol. 65(C), pages 117-138.
    14. Phung, T.D. & Hardeweg, B. & Praneetvatakul, S. & Waibel, H., 2015. "Non-Sampling Error and Data Quality: What Can We Learn from Surveys to Collect Data for Vulnerability Measurements?," World Development, Elsevier, vol. 71(C), pages 25-35.
    15. Baird, Sarah & Hamory, Joan & Miguel, Edward, 2008. "Tracking, Attrition and Data Quality in the Kenyan Life Panel Survey Round 1 (KLPS-1)," Center for International and Development Economics Research, Working Paper Series qt3cw7p1hx, Center for International and Development Economics Research, Institute for Business and Economic Research, UC Berkeley.
    16. World Bank Group, 2015. "A Measured Approach to Ending Poverty and Boosting Shared Prosperity : Concepts, Data, and the Twin Goals," World Bank Publications - Books, The World Bank Group, number 20384, December.
    17. Hai-Anh H. Dang & Calogero (Gero) Carletto, 2018. "The Seemingly Underappreciated Role of Panel Data in Measuring Poverty and Economic Transformation," World Economics, World Economics, 1 Ivory Square, Plantation Wharf, London, United Kingdom, SW11 3UE, vol. 19(3), pages 45-60, July.
    18. Jesús Crespo Cuaresma & Wolfgang Fengler & Homi Kharas & Karim Bekhtiar & Michael Brottrager & Martin Hofer, 2018. "Will the Sustainable Development Goals be fulfilled? Assessing present and future global poverty," Palgrave Communications, Palgrave Macmillan, vol. 4(1), pages 1-8, December.
    19. Townsend, Robert M. & Sakunthasathien, Sombat & Jordan, Rob, 2013. "Chronicles from the Field: The Townsend Thai Project," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262019078, December.
    20. Mick P. Couper & Frauke Kreuter, 2013. "Using paradata to explore item level response times in surveys," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(1), pages 271-286, January.
    21. Parvathi, Priyanka & Nguyen, Trung Thanh, 2018. "Is Environmental Income Reporting Evasive in Household Surveys? Evidence From Rural Poor in Laos," Ecological Economics, Elsevier, vol. 143(C), pages 218-226.
    22. Caeyers, Bet & Chalmers, Neil & De Weerdt, Joachim, 2012. "Improving consumption measurement and other survey data through CAPI: Evidence from a randomized experiment," Journal of Development Economics, Elsevier, vol. 98(1), pages 19-33.
    23. Meyer, Bruce D. & Mittag, Nikolas & Goerge, Robert M., 2018. "Errors in Survey Reporting and Imputation and Their Effects on Estimates of Food Stamp Program Participation," IZA Discussion Papers 11776, Institute of Labor Economics (IZA).
    24. Janet E. Squires & Alison M. Hutchinson & Anne-Marie Bostrom & Kelly Deis & Peter G. Norton & Greta G. Cummings & Carole A. Estabrooks, 2012. "A Data Quality Control Program for Computer-Assisted Personal Interviews," Nursing Research and Practice, Hindawi, vol. 2012, pages 1-8, December.
    25. Liebenehm, Sabine & Degener, Nele & Strobl, Eric, 2018. "Rainfall shocks and risk aversion: Evidence from Southeast Asia," TVSEP Working Papers wp-006, Leibniz Universitaet Hannover, Institute of Development and Agricultural Economics, Project TVSEP.
    26. Anne Booth, 2019. "Measuring poverty and income distribution in Southeast Asia," Asian-Pacific Economic Literature, The Crawford School, The Australian National University, vol. 33(1), pages 3-20, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brooks, Mark & Lippe, Rattiya S. & Waibel, Hermann, 2021. "PAPI is gone, but errors remain: Non-sampling errors in household surveys," 2021 Conference, August 17-31, 2021, Virtual 315277, International Association of Agricultural Economists.
    2. James X. Sullivan, 2020. "A Cautionary Tale of Using Data From the Tail," Demography, Springer;Population Association of America (PAA), vol. 57(6), pages 2361-2368, December.
    3. Meyer, Bruce D. & Mittag, Nikolas, 2019. "Combining Administrative and Survey Data to Improve Income Measurement," IZA Discussion Papers 12266, Institute of Labor Economics (IZA).
    4. Vitor Possebom, 2021. "Crime and Mismeasured Punishment: Marginal Treatment Effect with Misclassification," Papers 2106.00536, arXiv.org, revised Jul 2023.
    5. Colleen Heflin & Michah W. Rothbart & Mattie Mackenzie-Liu, 2022. "Below the Tip of the Iceberg: Examining Early Childhood Participation in SNAP and TANF from Birth to Age Six," Population Research and Policy Review, Springer;Southern Demographic Association (SDA), vol. 41(2), pages 729-755, April.
    6. Bruce D. Meyer & Nikolas Mittag, 2019. "Combining Administrative and Survey Data to Improve Income Measurement," NBER Working Papers 25738, National Bureau of Economic Research, Inc.
    7. Bruce D. Meyer & Nikolas Mittag, 2019. "Misreporting of Government Transfers: How Important Are Survey Design and Geography?," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 230-253, July.
    8. Meyer, Bruce D. & Mittag, Nikolas, 2018. "Misreporting of Government Transfers: How Important Are Survey Design and Geography?," IZA Discussion Papers 12038, Institute of Labor Economics (IZA).
    9. Charles Courtemanche & Augustine Denteh & Rusty Tchernis, 2019. "Estimating the Associations between SNAP and Food Insecurity, Obesity, and Food Purchases with Imperfect Administrative Measures of Participation," Southern Economic Journal, John Wiley & Sons, vol. 86(1), pages 202-228, July.
    10. Bruckmeier, Kerstin & Riphahn, Regina T. & Wiemers, Jürgen, 2019. "Benefit underreporting in survey data and its consequences for measuring non-take-up: new evidence from linked administrative and survey data," IAB-Discussion Paper 201906, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    11. Adrian Chadi, 2019. "Dissatisfied with life or with being interviewed? Happiness and the motivation to participate in a survey," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 53(3), pages 519-553, October.
    12. Martijn van Hasselt & Christopher R. Bollinger & Jeremy W. Bray, 2022. "A Bayesian approach to account for misclassification in prevalence and trend estimation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 351-367, March.
    13. Bronchetti, Erin T. & Christensen, Garret & Hoynes, Hilary W., 2019. "Local food prices, SNAP purchasing power, and child health," Journal of Health Economics, Elsevier, vol. 68(C).
    14. Michele Lalla & Maddalena Cavicchioli, 2020. "Nonresponse and measurement errors in income: matching individual survey data with administrative tax data," Department of Economics 0170, University of Modena and Reggio E., Faculty of Economics "Marco Biagi".
    15. Pourya Valizadeh & Travis A Smith, 2020. "How Did The American Recovery and Reinvestment Act Affect the Material Well‐Being of SNAP Participants? A Distributional Approach," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 42(3), pages 455-476, September.
    16. Tommasi, Denni & Zhang, Lina, 2024. "Bounding program benefits when participation is misreported," Journal of Econometrics, Elsevier, vol. 238(1).
    17. Kerstin Bruckmeier & Regina T. Riphahn & Jürgen Wiemers, 2021. "Misreporting of program take-up in survey data and its consequences for measuring non-take-up: new evidence from linked administrative and survey data," Empirical Economics, Springer, vol. 61(3), pages 1567-1616, September.
    18. Amy O’Hara & Rachel M. Shattuck & Robert M. Goerge, 2017. "Linking Federal Surveys with Administrative Data to Improve Research on Families," The ANNALS of the American Academy of Political and Social Science, , vol. 669(1), pages 63-74, January.
    19. Nguimkeu, Pierre & Denteh, Augustine & Tchernis, Rusty, 2019. "On the estimation of treatment effects with endogenous misreporting," Journal of Econometrics, Elsevier, vol. 208(2), pages 487-506.
    20. Sansone, Dario, 2019. "Pink work: Same-sex marriage, employment and discrimination," Journal of Public Economics, Elsevier, vol. 180(C).

    More about this item

    Keywords

    Non-sampling error; Paradata; Household survey; Poverty assessments; Southeast Asia; TVSEP;
    All these keywords.

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • I3 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tvs:wpaper:wp-019. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Nguyen, Trung Thanh (email available below). General contact details of provider: https://edirc.repec.org/data/iehande.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.