IDEAS home Printed from https://ideas.repec.org/p/fpr/ifprid/1980.html
   My bibliography  Save this paper

Are we done yet? Response fatigue and rural livelihoods

Author

Listed:
  • Ambler, Kate
  • Herskowitz, Sylvan
  • Maredia, Mywish

Abstract

Accurate understanding of peoples’ livelihoods activities is needed to inform effective policy. Existing evidence relies heavily on studies that use designated respondents to provide information about their household members, imposing significant costs on these respondents along with possible distortions in the data. In rural Ghana, we randomize the order that household members are asked about and estimate that response fatigue leads to undercounting of labor activities by 8% on average. Women are twice as impacted as men while youth are four times as impacted as older adults, distorting both within-household and population wide comparisons. These biases result from women and youth being listed systematically later in rosters and stronger effects of fatigue for them, conditional on roster position. The implications of our results extend to other topics of enquiry as well, wherever similar repetitive survey structures are deployed, such as birth records, plot-level inputs, and household consumption and expenditures.

Suggested Citation

  • Ambler, Kate & Herskowitz, Sylvan & Maredia, Mywish, 2020. "Are we done yet? Response fatigue and rural livelihoods," IFPRI discussion papers 1980, International Food Policy Research Institute (IFPRI).
  • Handle: RePEc:fpr:ifprid:1980
    as

    Download full text from publisher

    File URL: https://www.ifpri.org/cdmref/p15738coll2/id/134183/filename/134394.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Peter Lanjouw & Rinku Murgai & Nicholas Stern, 2013. "Nonfarm diversification, poverty, economic mobility, and income inequality: a case study in village India," Agricultural Economics, International Association of Agricultural Economists, vol. 44(4-5), pages 461-473, July.
    2. Haggblade, Steven & Hazell, Peter & Reardon, Thomas, 2010. "The Rural Non-farm Economy: Prospects for Growth and Poverty Reduction," World Development, Elsevier, vol. 38(10), pages 1429-1441, October.
    3. Beegle, Kathleen & Carletto, Calogero & Himelein, Kristen, 2012. "Reliability of recall in agricultural data," Journal of Development Economics, Elsevier, vol. 98(1), pages 34-41.
    4. Arthi, Vellore & Beegle, Kathleen & De Weerdt, Joachim & Palacios-López, Amparo, 2018. "Not your average job: Measuring farm labor in Tanzania," Journal of Development Economics, Elsevier, vol. 130(C), pages 160-172.
    5. Fox, Louise & Pimhidzai, Obert, 2013. "Different dreams, same bed : collecting, using, and interpreting employment statistics in Sub-Saharan Africa -- the case of Uganda," Policy Research Working Paper Series 6436, The World Bank.
    6. Fafchamps, Marcel & McKenzie, David & Quinn, Simon & Woodruff, Christopher, 2012. "Using PDA consistency checks to increase the precision of profits and sales measurement in panels," Journal of Development Economics, Elsevier, vol. 98(1), pages 51-57.
    7. Van den Broeck, Goedele & Kilic, Talip, 2019. "Dynamics of off-farm employment in Sub-Saharan Africa: A gender perspective," World Development, Elsevier, vol. 119(C), pages 81-99.
    8. Serneels, Pieter & Beegle, Kathleen & Dillon, Andrew, 2017. "Do returns to education depend on how and whom you ask?," Economics of Education Review, Elsevier, vol. 60(C), pages 5-19.
    9. Lynn, Peter & Roberts, Caroline & Allum, Nick & Eva, Gillian, 2010. "Data quality in telephone surveys and the effect of questionnaire length: a cross- national experiment," ISER Working Paper Series 2010-36, Institute for Social and Economic Research.
    10. Michele Di Maio & Nathan Fiala, 0. "Be Wary of Those Who Ask: A Randomized Experiment on the Size and Determinants of the Enumerator Effect," The World Bank Economic Review, World Bank, vol. 34(3), pages 654-669.
    11. Ambler, Kate & de Brauw, Alan & Murphy, Mike, 2020. "Increasing the adoption of conservation agriculture: A framed field experiment in Northern Ghana," IFPRI discussion papers 1932, International Food Policy Research Institute (IFPRI).
    12. Margaret Grosh & Paul Glewwe, 2000. "Designing Household Survey Questionnaires for Developing Countries," World Bank Publications - Books, The World Bank Group, number 25338, December.
    13. Imai, Katsushi S. & Gaiha, Raghav & Thapa, Ganesh, 2015. "Does non-farm sector employment reduce rural poverty and vulnerability? Evidence from Vietnam and India," Journal of Asian Economics, Elsevier, vol. 36(C), pages 47-61.
    14. Das, Jishnu & Hammer, Jeffrey & Sánchez-Paramo, Carolina, 2012. "The impact of recall periods on reported morbidity and health seeking behavior," Journal of Development Economics, Elsevier, vol. 98(1), pages 76-88.
    15. Dillon, Andrew & Bardasi, Elena & Beegle, Kathleen & Serneels, Pieter, 2012. "Explaining variation in child labor statistics," Journal of Development Economics, Elsevier, vol. 98(1), pages 136-147.
    16. Abay,Kibrom A. & Berhane,Guush & Hoddinott,John & Hirfrfot,Kibrom Tafere, 2021. "Assessing Response Fatigue in Phone Surveys : Experimental Evidence on Dietary Diversity in Ethiopia," Policy Research Working Paper Series 9636, The World Bank.
    17. Ray Langsten & Rania Salen, 2008. "Two Approaches to Measuring Women's Work in Developing Countries: A Comparison of Survey Data from Egypt," Population and Development Review, The Population Council, Inc., vol. 34(2), pages 283-305, June.
    18. Davis, Benjamin & Winters, Paul & Carletto, Gero & Covarrubias, Katia & Quiñones, Esteban J. & Zezza, Alberto & Stamoulis, Kostas & Azzarri, Carlo & DiGiuseppe, Stefania, 2010. "A Cross-Country Comparison of Rural Income Generating Activities," World Development, Elsevier, vol. 38(1), pages 48-63, January.
    19. Beaman, Lori & Dillon, Andrew, 2012. "Do household definitions matter in survey design? Results from a randomized survey experiment in Mali," Journal of Development Economics, Elsevier, vol. 98(1), pages 124-135.
    20. Deininger, Klaus & Carletto, Calogero & Savastano, Sara & Muwonge, James, 2012. "Can diaries help in improving agricultural production statistics? Evidence from Uganda," Journal of Development Economics, Elsevier, vol. 98(1), pages 42-50.
    21. Frank Ellis & H Ade Freeman, 2004. "Rural Livelihoods and Poverty Reduction Strategies in Four African Countries," Journal of Development Studies, Taylor & Francis Journals, vol. 40(4), pages 1-30.
    22. Andersson Djurfeldt, Agnes, 2013. "African Re-Agrarianization? Accumulation or Pro-Poor Agricultural Growth?," World Development, Elsevier, vol. 41(C), pages 217-231.
    23. Beegle, Kathleen & De Weerdt, Joachim & Friedman, Jed & Gibson, John, 2012. "Methods of household consumption measurement through surveys: Experimental results from Tanzania," Journal of Development Economics, Elsevier, vol. 98(1), pages 3-18.
    24. Felix Kwame Yeboah & Thomas S. Jayne, 2018. "Africa’s Evolving Employment Trends," Journal of Development Studies, Taylor & Francis Journals, vol. 54(5), pages 803-832, May.
    25. Frank Ellis, 1998. "Household strategies and rural livelihood diversification," Journal of Development Studies, Taylor & Francis Journals, vol. 35(1), pages 1-38.
    26. Virginie Comblon & Anne-Sophie Robilliard, 2015. "Are female employment statistics more sensitive than male ones to questionnaire design? Evidence from Cameroon, Mali and Senegal," Working Papers DT/2015/22, DIAL (Développement, Institutions et Mondialisation).
    27. Sarah Bridges & David Lawson & Sharifa Begum, 2011. "Labour Market Outcomes in Bangladesh: The Role of Poverty and Gender Norms," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 23(3), pages 459-487, July.
    28. Fred Mawunyo Dzanku, 2020. "Poverty Reduction And Economic Livelihood Mobility In Rural Sub‐Saharan Africa," Journal of International Development, John Wiley & Sons, Ltd., vol. 32(5), pages 636-683, July.
    29. Hess, Stephane & Hensher, David A. & Daly, Andrew, 2012. "Not bored yet – Revisiting respondent fatigue in stated choice experiments," Transportation Research Part A: Policy and Practice, Elsevier, vol. 46(3), pages 626-644.
    30. Desiere,Sam & Costa,Valentina, 2019. "Employment Data in Household Surveys : Taking Stock, Looking Ahead," Policy Research Working Paper Series 8882, The World Bank.
    31. Stephan Klasen & Francesca Lamanna, 2009. "The Impact of Gender Inequality in Education and Employment on Economic Growth: New Evidence for a Panel of Countries," Feminist Economics, Taylor & Francis Journals, vol. 15(3), pages 91-132.
    32. Gordon Betcherman & Themrise Khan, 2018. "Jobs for Africa’s expanding youth cohort: a stocktaking of employment prospects and policy interventions," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-20, December.
    33. Caeyers, Bet & Chalmers, Neil & De Weerdt, Joachim, 2012. "Improving consumption measurement and other survey data through CAPI: Evidence from a randomized experiment," Journal of Development Economics, Elsevier, vol. 98(1), pages 19-33.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gourlay,Sydney & Maggio,Giuseppe & Safyan,Anahit & Zezza,Alberto, 2022. "Measuring Land Tenure at the Individual Level : Lessons from Methodological Research in Armenia," Policy Research Working Paper Series 10140, The World Bank.
    2. Delavallade, Clara & Godlonton, Susan, 2023. "Locking crops to unlock investment: Experimental evidence on warrantage in Burkina Faso," Journal of Development Economics, Elsevier, vol. 160(C).
    3. Talip Kilic & Goedele Van den & Gayatri Koolwal & Heather Moylan, 2023. "Are You Being Asked? Impacts of Respondent Selection on Measuring Employment in Malawi," Journal of African Economies, Centre for the Study of African Economies, vol. 32(5), pages 495-522.
    4. Jeong, Dahyeon & Aggarwal, Shilpa & Robinson, Jonathan & Kumar, Naresh & Spearot, Alan & Park, David Sungho, 2023. "Exhaustive or exhausting? Evidence on respondent fatigue in long surveys," Journal of Development Economics, Elsevier, vol. 161(C).
    5. Carletto,Calogero & Dillon,Andrew S. & Zezza,Alberto, 2021. "Agricultural Data Collection to Minimize Measurement Error and Maximize Coverage," Policy Research Working Paper Series 9745, The World Bank.
    6. Tilman Brück & Mekdim D. Regassa, 2023. "Usefulness and misrepresentation of phone surveys on COVID-19 and food security in Africa," Food Security: The Science, Sociology and Economics of Food Production and Access to Food, Springer;The International Society for Plant Pathology, vol. 15(2), pages 423-453, April.
    7. Abay, Kibrom A. & Berhane, Guush & Hoddinott, John F. & Tafere, Kibrom, 2021. "Assessing response fatigue in phone surveys: Experimental evidence on dietary diversity in Ethiopia," IFPRI discussion papers 2017, International Food Policy Research Institute (IFPRI).
    8. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    9. Fitzpatrick, Anne, 2023. "Which price is right? A comparison of three standard approaches to measuring prices," Journal of Development Economics, Elsevier, vol. 163(C).
    10. Nakamura, Nobuyuki & Suzuki, Aya, 2022. "How Altruism Works during a Pandemic: Examining the Roles of Financial Support and Degrees of Individual Altruism on International Remittance," 2022 Annual Meeting, July 31-August 2, Anaheim, California 322073, Agricultural and Applied Economics Association.
    11. Fiala, Nathan & Masselus, Lise, 2022. "Whom to ask? Testing respondent effects in household surveys," Ruhr Economic Papers 935, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    12. Akramov, Kamiljon & Carrillo, Lucia & Kosec, Katrina, 2021. "Covid-19, Rural Poverty, and Women’s Role in Decision-Making: Evidence from Khatlon Province in Tajikistan," OSF Preprints j7vrm, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ambler, Kate & Herskowitz, Sylvan & Maredia, Mywish K., 2021. "Rural Labor and Long Recall Loss," Staff Paper Series 316616, Michigan State University, Department of Agricultural, Food, and Resource Economics.
    2. Joachim De Weerdt & John Gibson & Kathleen Beegle, 2020. "What Can We Learn from Experimenting with Survey Methods?," Annual Review of Resource Economics, Annual Reviews, vol. 12(1), pages 431-447, October.
    3. Fiala, Nathan & Masselus, Lise, 2022. "Whom to ask? Testing respondent effects in household surveys," Ruhr Economic Papers 935, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    4. Kilic,Talip & Van den Broeck,Goedele & Koolwal,Gayatri B. & Moylan,Heather G., 2020. "Are You Being Asked ? Impacts of Respondent Selection on Measuring Employment," Policy Research Working Paper Series 9152, The World Bank.
    5. Wollburg, Philip & Tiberti, Marco & Zezza, Alberto, 2021. "Recall length and measurement error in agricultural surveys," Food Policy, Elsevier, vol. 100(C).
    6. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    7. Fitzpatrick, Anne, 2023. "Which price is right? A comparison of three standard approaches to measuring prices," Journal of Development Economics, Elsevier, vol. 163(C).
    8. Zezza,Alberto & Mcgee,Kevin Robert & Wollburg,Philip Randolph & Assefa,Thomas Woldu & Gourlay,Sydney, 2022. "From Necessity to Opportunity : Lessons for Integrating Phone and In-Person Data Collectionfor Agricultural Statistics in a Post-Pandemic World," Policy Research Working Paper Series 10168, The World Bank.
    9. Zeeshan & Geetilaxmi Mohapatra & Arun Kumar Giri, 2022. "How Farm Household Spends Their Non-farm Incomes in Rural India? Evidence from Longitudinal Data," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 34(4), pages 1967-1996, August.
    10. Vaiknoras, Kate A. & Larochelle, Catherine & Alwang, Jeffrey, 2021. "How the adoption of drought-tolerant rice varieties impacts households in a non-drought year: Evidence from Nepal," 2021 Annual Meeting, August 1-3, Austin, Texas 313877, Agricultural and Applied Economics Association.
    11. Koolwal, Gayatri B., 2021. "Improving the measurement of rural women's employment: Global momentum and survey priorities," World Development, Elsevier, vol. 147(C).
    12. Dang, Hai-Anh & Carletto, Calogero, 2022. "Recall Bias Revisited: Measure Farm Labor Using Mixed-Mode Surveys and Multiple Imputation," IZA Discussion Papers 14997, Institute of Labor Economics (IZA).
    13. Chaoran Chen & Diego Restuccia & Raül Santaeulàlia-Llopis, 2023. "Land Misallocation and Productivity," American Economic Journal: Macroeconomics, American Economic Association, vol. 15(2), pages 441-465, April.
    14. Vaiknoras, Kate & Larochelle, Catherine & Alwang, Jeffrey, 2020. "IFAD RESERACH SERIES 64 - How the adoption of drought-tolerant rice varieties impacts households in a non-drought year: Evidence from Nepal," IFAD Research Series 308809, International Fund for Agricultural Development (IFAD).
    15. Zezza, Alberto & Federighi, Giovanni & Kalilou, Amadou Adamou & Hiernaux, Pierre, 2016. "Milking the data: Measuring milk off-take in extensive livestock systems. Experimental evidence from Niger," Food Policy, Elsevier, vol. 59(C), pages 174-186.
    16. De Magalhães, Leandro & Santaeulàlia-Llopis, Raül, 2018. "The consumption, income, and wealth of the poorest: An empirical analysis of economic inequality in rural and urban Sub-Saharan Africa for macroeconomists," Journal of Development Economics, Elsevier, vol. 134(C), pages 350-371.
    17. Ragui Assaad & Caroline Krafft & Shaimaa Yassin, 2018. "Comparing retrospective and panel data collection methods to assess labor market dynamics," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-34, December.
    18. Jose Galdo & Ana C Dammert & Degnet Abebaw, 2021. "Gender Bias in Agricultural Child Labor: Evidence from Survey Design Experiments," The World Bank Economic Review, World Bank, vol. 35(4), pages 872-891.
    19. Ugo Pica-Ciamarra & Derek Baker & Nancy Morgan & Alberto Zezza & Carlo Azzarri & Cheikh Ly & Longin Nsiima & Simplice Nouala & Patrick Okello & Joseph Sserugga, 2014. "Investing in the Livestock Sector : Why Good Numbers Matter, A Sourcebook for Decision Makers on How to Improve Livestock Data," World Bank Publications - Reports 17830, The World Bank Group.
    20. Gamel Abdul-Nasser Salifu, 2019. "The Political Economy Dynamics of Rural Household Income Diversification: A Review of the International Literature," Research in World Economy, Research in World Economy, Sciedu Press, vol. 10(3), pages 273-290, December.

    More about this item

    Keywords

    GHANA; WEST AFRICA; AFRICA SOUTH OF SAHARA; AFRICA; labour; gender; youth; surveys; methodology; livelihoods; rural areas; households; employment; response fatigue;
    All these keywords.

    JEL classification:

    • O1 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development
    • J2 - Labor and Demographic Economics - - Demand and Supply of Labor
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • Q1 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fpr:ifprid:1980. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/ifprius.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.