IDEAS home Printed from https://ideas.repec.org/p/zbw/glodps/1020.html
   My bibliography  Save this paper

Recall Bias Revisited: Measure Farm Labor Using Mixed-Mode Surveys and Multiple Imputation

Author

Listed:
  • Dang, Hai-Anh H.
  • Carletto, Calogero

Abstract

Smallholder farming dominates agriculture in poorer countries. Yet, traditional recall-based surveys on smallholder farming in these countries face challenges with seasonal variations, high survey costs, poor record-keeping, and technical capacity constraints resulting in significant recall bias. We offer the first study that employs a less-costly, imputation-based alternative using mixed modes of data collection to obtain estimates on smallholder farm labor. Using data from Tanzania, we find that parsimonious imputation models based on small samples of a benchmark weekly in-person survey can offer reasonably accurate estimates. Furthermore, we also show how less accurate, but also less resource-intensive, imputation-based measures using a weekly phone survey may provide a viable alternative for the more costly weekly in-person survey. If replicated in other contexts, including for other types of variables that suffer from similar recall bias, these results could open up a new and cost-effective way to collect more accurate data at scale.

Suggested Citation

  • Dang, Hai-Anh H. & Carletto, Calogero, 2022. "Recall Bias Revisited: Measure Farm Labor Using Mixed-Mode Surveys and Multiple Imputation," GLO Discussion Paper Series 1020, Global Labor Organization (GLO).
  • Handle: RePEc:zbw:glodps:1020
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/248832/1/GLO-DP-1020.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Tarozzi, Alessandro, 2007. "Calculating Comparable Statistics From Incomparable Surveys, With an Application to Poverty in India," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 314-336, July.
    2. Joachim De Weerdt & John Gibson & Kathleen Beegle, 2020. "What Can We Learn from Experimenting with Survey Methods?," Annual Review of Resource Economics, Annual Reviews, vol. 12(1), pages 431-447, October.
    3. Gaaitzen de Vries & Marcel Timmer & Klaas de Vries, 2015. "Structural Transformation in Africa: Static Gains, Dynamic Losses," Journal of Development Studies, Taylor & Francis Journals, vol. 51(6), pages 674-688, June.
    4. Beegle, Kathleen & Carletto, Calogero & Himelein, Kristen, 2012. "Reliability of recall in agricultural data," Journal of Development Economics, Elsevier, vol. 98(1), pages 34-41.
    5. Carletto, Calogero & Savastano, Sara & Zezza, Alberto, 2013. "Fact or artifact: The impact of measurement errors on the farm size–productivity relationship," Journal of Development Economics, Elsevier, vol. 103(C), pages 254-261.
    6. Arthi, Vellore & Beegle, Kathleen & De Weerdt, Joachim & Palacios-López, Amparo, 2018. "Not your average job: Measuring farm labor in Tanzania," Journal of Development Economics, Elsevier, vol. 130(C), pages 160-172.
    7. Katharine G. Abraham & John Haltiwanger & Kristin Sandusky & James R. Spletzer, 2013. "Exploring Differences in Employment between Household and Establishment Data," Journal of Labor Economics, University of Chicago Press, vol. 31(S1), pages 129-172.
    8. John Gibson & Jikun Huang & Scott Rozelle, 2003. "Improving Estimates of Inequality and Poverty from Urban China's Household Income and Expenditure Survey," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 49(1), pages 53-68, March.
    9. Stephen P. Jenkins & Richard V. Burkhauser & Shuaizhang Feng & Jeff Larrimore, 2011. "Measuring inequality using censored data: a multiple‐imputation approach to estimation and inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(1), pages 63-81, January.
    10. Serajuddin,Umar & Uematsu,Hiroki & Wieser,Christina & Yoshida,Nobuo & Dabalen,Andrew L., 2015. "Data deprivation : another deprivation to end," Policy Research Working Paper Series 7252, The World Bank.
    11. repec:oup:qjecon:v:129:y:2014:i:2:p:939-993. is not listed on IDEAS
    12. Grant J. Cameron & Hai‐Anh H. Dang & Mustafa Dinc & James Foster & Michael M. Lokshin, 2021. "Measuring the Statistical Capacity of Nations," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(4), pages 870-896, August.
    13. Margaret Grosh & Paul Glewwe, 2000. "Designing Household Survey Questionnaires for Developing Countries," World Bank Publications - Books, The World Bank Group, number 25338, December.
    14. Justin Sandefur & Amanda Glassman, 2015. "The Political Economy of Bad Data: Evidence from African Survey and Administrative Statistics," Journal of Development Studies, Taylor & Francis Journals, vol. 51(2), pages 116-132, February.
    15. Little, Roderick J A, 1988. "Missing-Data Adjustments in Large Surveys: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 6(3), pages 300-301, July.
    16. Hai‐Anh Dang & Dean Jolliffe & Calogero Carletto, 2019. "Data Gaps, Data Incomparability, And Data Imputation: A Review Of Poverty Measurement Methods For Data‐Scarce Environments," Journal of Economic Surveys, Wiley Blackwell, vol. 33(3), pages 757-797, July.
    17. McCullough, Ellen B., 2017. "Labor productivity and employment gaps in Sub-Saharan Africa," Food Policy, Elsevier, vol. 67(C), pages 133-152.
    18. Susan Godlonton & Manuel A Hernandez & Mike Murphy, 2018. "Anchoring Bias in Recall Data: Evidence from Central America," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 100(2), pages 479-501.
    19. Shantayanan Devarajan, 2013. "Africa's Statistical Tragedy," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 59, pages 9-15, October.
    20. Angrist, Joshua D. & Krueger, Alan B., 1999. "Empirical strategies in labor economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366, Elsevier.
    21. Beegle, Kathleen & De Weerdt, Joachim & Friedman, Jed & Gibson, John, 2012. "Methods of household consumption measurement through surveys: Experimental results from Tanzania," Journal of Development Economics, Elsevier, vol. 98(1), pages 3-18.
    22. Little, Roderick J A, 1988. "Missing-Data Adjustments in Large Surveys," Journal of Business & Economic Statistics, American Statistical Association, vol. 6(3), pages 287-296, July.
    23. Dang, Hai-Anh & Lanjouw, Peter & Luoto, Jill & McKenzie, David, 2014. "Using repeated cross-sections to explore movements into and out of poverty," Journal of Development Economics, Elsevier, vol. 107(C), pages 112-128.
    24. Gourlay, Sydney & Kilic, Talip & Lobell, David B., 2019. "A new spin on an old debate: Errors in farmer-reported production and their implications for inverse scale - Productivity relationship in Uganda," Journal of Development Economics, Elsevier, vol. 141(C).
    25. Adam Davey & Michael J. Shanahan & Joseph L. Schafer, 2001. "Correcting for Selective Nonresponse in the National Longitudinal Survey of Youth Using Multiple Imputation," Journal of Human Resources, University of Wisconsin Press, vol. 36(3), pages 500-519.
    26. Douglas Gollin & David Lagakos & Michael E. Waugh, 2014. "The Agricultural Productivity Gap," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(2), pages 939-993.
    27. Lowder, Sarah K. & Skoet, Jakob & Raney, Terri, 2016. "The Number, Size, and Distribution of Farms, Smallholder Farms, and Family Farms Worldwide," World Development, Elsevier, vol. 87(C), pages 16-29.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hai-Anh H. Dang & Peter F. Lanjouw & Umar Serajuddin, 2017. "Updating poverty estimates in the absence of regular and comparable consumption data: methods and illustration with reference to a middle-income country," Oxford Economic Papers, Oxford University Press, vol. 69(4), pages 939-962.
    2. Hai‐Anh Dang & Dean Jolliffe & Calogero Carletto, 2019. "Data Gaps, Data Incomparability, And Data Imputation: A Review Of Poverty Measurement Methods For Data‐Scarce Environments," Journal of Economic Surveys, Wiley Blackwell, vol. 33(3), pages 757-797, July.
    3. Dang,Hai-Anh H. & Kilic,Talip & Carletto,Calogero & Abanokova,Kseniya, 2021. "Poverty Imputation in Contexts without Consumption Data : A Revisit with Further Refinements," Policy Research Working Paper Series 9838, The World Bank.
    4. Dang, Hai-Anh & Kilic, Talip & Hlasny, Vladimir & Abanokova, Kseniya & Carletto, Calogero, 2024. "Using Survey-to-Survey Imputation to Fill Poverty Data Gaps at a Low Cost: Evidence from a Randomized Survey Experiment," IZA Discussion Papers 16792, Institute of Labor Economics (IZA).
    5. Dang,Hai-Anh H., 2018. "To impute or not to impute ? a review of alternative poverty estimation methods in the context of unavailable consumption data," Policy Research Working Paper Series 8403, The World Bank.
    6. Wollburg, Philip & Tiberti, Marco & Zezza, Alberto, 2021. "Recall length and measurement error in agricultural surveys," Food Policy, Elsevier, vol. 100(C).
    7. Hai-Anh H. Dang & Peter F. Lanjouw, 2018. "Poverty Dynamics in India between 2004 and 2012: Insights from Longitudinal Analysis Using Synthetic Panel Data," Economic Development and Cultural Change, University of Chicago Press, vol. 67(1), pages 131-170.
    8. Dang,Hai-Anh H. & Lanjouw,Peter F. & Serajuddin,Umar & Dang,Hai-Anh H. & Lanjouw,Peter F. & Serajuddin,Umar, 2014. "Updating poverty estimates at frequent intervals in the absence of consumption data : methods and illustration with reference to a middle-income country," Policy Research Working Paper Series 7043, The World Bank.
    9. Hai‐Anh H. Dang, 2021. "To impute or not to impute, and how? A review of poverty‐estimation methods in the absence of consumption data," Development Policy Review, Overseas Development Institute, vol. 39(6), pages 1008-1030, November.
    10. Johanna Choumert-Nkolo & Pascale Phelinas, 2018. "New paradigms for household surveys in low and middle income countries [Nouveaux paradigmes d'élaboration des enquêtes ménages dans les pays du Sud]," CERDI Working papers halshs-01888609, HAL.
    11. Dang, Hai-Anh & Lanjouw, Peter F., 2021. "Data Scarcity and Poverty Measurement," IZA Discussion Papers 14631, Institute of Labor Economics (IZA).
    12. Godlonton, Susan & Hernandez, Manuel A. & Paz, Cynthia, 2021. "Can survey design reduce anchoring bias in recall data? Evidence from Malawi," IFPRI discussion papers 2055, International Food Policy Research Institute (IFPRI).
    13. Zezza,Alberto & Mcgee,Kevin Robert & Wollburg,Philip Randolph & Assefa,Thomas Woldu & Gourlay,Sydney, 2022. "From Necessity to Opportunity : Lessons for Integrating Phone and In-Person Data Collectionfor Agricultural Statistics in a Post-Pandemic World," Policy Research Working Paper Series 10168, The World Bank.
    14. Dang, Hai-Anh H. & Serajuddin, Umar, 2020. "Tracking the sustainable development goals: Emerging measurement challenges and further reflections," World Development, Elsevier, vol. 127(C).
    15. Chaoran Chen & Diego Restuccia & Raül Santaeulàlia-Llopis, 2023. "Land Misallocation and Productivity," American Economic Journal: Macroeconomics, American Economic Association, vol. 15(2), pages 441-465, April.
    16. Hai-Anh H. Dang & Peter F. Lanjouw, 2023. "Regression-based imputation for poverty measurement in data-scarce settings," Chapters, in: Jacques Silber (ed.), Research Handbook on Measuring Poverty and Deprivation, chapter 13, pages 141-150, Edward Elgar Publishing.
    17. Abay,Kibrom A. & Barrett,Christopher B. & Kilic,Talip & Moylan,Heather G. & Ilukor,John & Vundru,Wilbert Drazi, 2022. "Nonclassical Measurement Error and Farmers’ Response to Information Reveal Behavioral Anomalies," Policy Research Working Paper Series 9908, The World Bank.
    18. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    19. De Magalhães, Leandro & Santaeulàlia-Llopis, Raül, 2018. "The consumption, income, and wealth of the poorest: An empirical analysis of economic inequality in rural and urban Sub-Saharan Africa for macroeconomists," Journal of Development Economics, Elsevier, vol. 134(C), pages 350-371.
    20. Sam Desiere & Lotte Staelens & Marijke D’Haese, 2016. "When the Data Source Writes the Conclusion: Evaluating Agricultural Policies," Journal of Development Studies, Taylor & Francis Journals, vol. 52(9), pages 1372-1387, September.

    More about this item

    Keywords

    farm labor; agricultural productivity; multiple imputation; missing data; survey data; Tanzania;
    All these keywords.

    JEL classification:

    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • J2 - Labor and Demographic Economics - - Demand and Supply of Labor
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development
    • Q12 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Micro Analysis of Farm Firms, Farm Households, and Farm Input Markets

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:glodps:1020. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/glabode.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.