IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v166y2024ics0304387823001542.html
   My bibliography  Save this article

Respondent biases in agricultural household surveys

Author

Listed:
  • Dillon, Andrew
  • Mensah, Edouard

Abstract

Two sources of respondent bias introduce measurement error into household statistics: asymmetric information between the proxy respondent and the individual on whom they report; and aggregation bias when a proxy respondent reports on a household-level outcome across multiple individuals. We estimate the effects of respondent biases in a survey experiment in Burkina Faso by varying who reports on the agricultural production of household members. We find respondent biases are not solely attributable to asymmetric information. Choosing a household head proxy lowers aggregation biases, but results in both over and under-estimates of agricultural variables relative to random proxies. Random proxies systematically under report agricultural statistics. Self-reporting protocols increase enumerator work days by only 5% indicating a high bias-cost tradeoff in choosing proxy response over self-reports. Survey designers should weight whether proxy bias magnitude or direction of bias are more significant threats to parameter estimation when determining their proxy response protocol.

Suggested Citation

  • Dillon, Andrew & Mensah, Edouard, 2024. "Respondent biases in agricultural household surveys," Journal of Development Economics, Elsevier, vol. 166(C).
  • Handle: RePEc:eee:deveco:v:166:y:2024:i:c:s0304387823001542
    DOI: 10.1016/j.jdeveco.2023.103198
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304387823001542
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jdeveco.2023.103198?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kibrom A. Abay & Leah E. M. Bevis & Christopher B. Barrett, 2021. "Measurement Error Mechanisms Matter: Agricultural Intensification with Farmer Misperceptions and Misreporting," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(2), pages 498-522, March.
    2. Talip Kilic & Thomas Pave Sohnesen, 2019. "Same Question But Different Answer: Experimental Evidence on Questionnaire Design's Impact on Poverty Measured by Proxies," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 65(1), pages 144-165, March.
    3. Dillon, Andrew & Bardasi, Elena & Beegle, Kathleen & Serneels, Pieter, 2012. "Explaining variation in child labor statistics," Journal of Development Economics, Elsevier, vol. 98(1), pages 136-147.
    4. Calogero Carletto & Sydney Gourlay & Paul Winters, 2015. "Editor's choice From Guesstimates to GPStimates: Land Area Measurement and Implications for Agricultural Analysis," Journal of African Economies, Centre for the Study of African Economies, vol. 24(5), pages 593-628.
    5. Kate Ambler & Cheryl Doss & Caitlin Kieran & Simone Passarelli, 2021. "He Says, She Says: Spousal Disagreement in Survey Measures of Bargaining Power," Economic Development and Cultural Change, University of Chicago Press, vol. 69(2), pages 765-788.
    6. Andrew Dillon & Sydney Gourlay & Kevin McGee & Gbemisola Oseni, 2019. "Land Measurement Bias and Its Empirical Implications: Evidence from a Validation Exercise," Economic Development and Cultural Change, University of Chicago Press, vol. 67(3), pages 595-624.
    7. Udry, Christopher, 1996. "Gender, Agricultural Production, and the Theory of the Household," Journal of Political Economy, University of Chicago Press, vol. 104(5), pages 1010-1046, October.
    8. Gourlay, Sydney & Kilic, Talip & Lobell, David B., 2019. "A new spin on an old debate: Errors in farmer-reported production and their implications for inverse scale - Productivity relationship in Uganda," Journal of Development Economics, Elsevier, vol. 141(C).
    9. Alberto Abadie & Susan Athey & Guido W Imbens & Jeffrey M Wooldridge, 2023. "When Should You Adjust Standard Errors for Clustering?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 138(1), pages 1-35.
    10. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    11. Kazianga, Harounan & Wahhaj, Zaki, 2017. "Intra-household resource allocation and familial ties," Journal of Development Economics, Elsevier, vol. 127(C), pages 109-132.
    12. Brian Dillon, 2012. "Using mobile phones to collect panel data in developing countries," Journal of International Development, John Wiley & Sons, Ltd., vol. 24(4), pages 518-527, May.
    13. Alex Cohen, 2019. "Estimating Farm Production Parameters with Measurement Error in Land Area," Economic Development and Cultural Change, University of Chicago Press, vol. 68(1), pages 305-334.
    14. Carletto,Calogero & Dillon,Andrew S. & Zezza,Alberto, 2021. "Agricultural Data Collection to Minimize Measurement Error and Maximize Coverage," Policy Research Working Paper Series 9745, The World Bank.
    15. Dillon, Andrew & Karlan, Dean & Udry, Christopher & Zinman, Jonathan, 2020. "Good identification, meet good data," World Development, Elsevier, vol. 127(C).
    16. Cheryl R. Doss & Agnes R. Quisumbing, 2020. "Understanding rural household behavior: Beyond Boserup and Becker," Agricultural Economics, International Association of Agricultural Economists, vol. 51(1), pages 47-58, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mensah, Edouard R. & Kostandini, Genti, 2020. "The inverse farm size-productivity relationship under land size mis-measurement and in the presence of weather and price risks: Panel data evidence from Uganda," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304477, Agricultural and Applied Economics Association.
    2. Carletto,Calogero & Dillon,Andrew S. & Zezza,Alberto, 2021. "Agricultural Data Collection to Minimize Measurement Error and Maximize Coverage," Policy Research Working Paper Series 9745, The World Bank.
    3. Joachim De Weerdt & John Gibson & Kathleen Beegle, 2020. "What Can We Learn from Experimenting with Survey Methods?," Annual Review of Resource Economics, Annual Reviews, vol. 12(1), pages 431-447, October.
    4. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    5. Masselus, Lise & Fiala, Nathan, 2024. "Whom to ask? Testing respondent effects in household surveys," Journal of Development Economics, Elsevier, vol. 168(C).
    6. Abay, Kibrom A. & Barrett, Christopher B. & Kilic, Talip & Moylan, Heather & Ilukor, John & Vundru, Wilbert Drazi, 2023. "Nonclassical measurement error and farmers’ response to information treatment," Journal of Development Economics, Elsevier, vol. 164(C).
    7. Fiala, Nathan & Masselus, Lise, 2022. "Whom to ask? Testing respondent effects in household surveys," Ruhr Economic Papers 935, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    8. William J. Burke & Stephen N. Morgan & Thelma Namonje & Milu Muyanga & Nicole M. Mason, 2023. "Beyond the “inverse relationship”: Area mismeasurement may affect actual productivity, not just how we understand it," Agricultural Economics, International Association of Agricultural Economists, vol. 54(4), pages 557-569, July.
    9. Kibrom A. Abay & Tesfamicheal Wossen & Jordan Chamberlin, 2023. "Mismeasurement and efficiency estimates: Evidence from smallholder survey data in Africa," Journal of Agricultural Economics, Wiley Blackwell, vol. 74(2), pages 413-434, June.
    10. Fernando Aragon & Diego Restuccia & Juan Pablo Rud, 2022. "Assessing misallocation in agriculture: plots versus farms," Working Papers tecipa-718, University of Toronto, Department of Economics.
    11. Helfand, Steven M. & Taylor, Matthew P.H., 2021. "The inverse relationship between farm size and productivity: Refocusing the debate," Food Policy, Elsevier, vol. 99(C).
    12. Kibrom A. Abay & Leah E. M. Bevis & Christopher B. Barrett, 2021. "Measurement Error Mechanisms Matter: Agricultural Intensification with Farmer Misperceptions and Misreporting," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(2), pages 498-522, March.
    13. Abay,Kibrom A. & Barrett,Christopher B. & Kilic,Talip & Moylan,Heather G. & Ilukor,John & Vundru,Wilbert Drazi, 2022. "Nonclassical Measurement Error and Farmers’ Response to Information Reveal Behavioral Anomalies," Policy Research Working Paper Series 9908, The World Bank.
    14. Maue, Casey C. & Burke, Marshall & Emerick, Kyle, 2020. "Productivity dispersion and persistence among the world's most numerous firms," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304287, Agricultural and Applied Economics Association.
    15. Kibrom A. Abay, 2020. "Measurement errors in agricultural data and their implications on marginal returns to modern agricultural inputs," Agricultural Economics, International Association of Agricultural Economists, vol. 51(3), pages 323-341, May.
    16. Kosmowski, Frederic & Chamberlin, Jordan & Ayalew, Hailemariam & Sida, Tesfaye & Abay, Kibrom & Craufurd, Peter, 2021. "How accurate are yield estimates from crop cuts? Evidence from smallholder maize farms in Ethiopia," Food Policy, Elsevier, vol. 102(C).
    17. Kibrom A. Abay & Lina Abdelfattah & Hoda El‐Enbaby & Mai Mahmoud & Clemens Breisinger, 2022. "Plot size and sustainable input intensification in smallholder irrigated agriculture: Evidence from Egypt," Agricultural Economics, International Association of Agricultural Economists, vol. 53(5), pages 792-810, September.
    18. Zezza,Alberto & Mcgee,Kevin Robert & Wollburg,Philip Randolph & Assefa,Thomas Woldu & Gourlay,Sydney, 2022. "From Necessity to Opportunity : Lessons for Integrating Phone and In-Person Data Collectionfor Agricultural Statistics in a Post-Pandemic World," Policy Research Working Paper Series 10168, The World Bank.
    19. Emerick, Kyle & Burke, Marshall & Maue, Casey, 2020. "Productivity dispersion and persistence among the world’s most numerous firms," CEPR Discussion Papers 14553, C.E.P.R. Discussion Papers.
    20. Abay, Kibrom A. & Abate, Gashaw T. & Barrett, Christopher B. & Bernard, Tanguy, 2019. "Correlated non-classical measurement errors, ‘Second best’ policy inference, and the inverse size-productivity relationship in agriculture," Journal of Development Economics, Elsevier, vol. 139(C), pages 171-184.

    More about this item

    Keywords

    Household survey; Measurement; Gender; Production surveys;
    All these keywords.

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • D13 - Microeconomics - - Household Behavior - - - Household Production and Intrahouse Allocation
    • Q12 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Micro Analysis of Farm Firms, Farm Households, and Farm Input Markets

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:166:y:2024:i:c:s0304387823001542. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.