IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/7208.html
   My bibliography  Save this paper

Interviewer effects in subjective survey questions: evidence from Timor-Leste

Author

Listed:
  • Himelein,Kristen

Abstract

There is an inherent tension between traditional norms and survey protocols for quantitative data collected in the developing world. Unexpected interactions between the interviewer and respondent can lead to interviewer effects in the data, particularly in the case of subjective or sensitive questions. This paper makes use of a unique data set available from Timor-Leste containing subjective and objective questions to study these effects. In addition to their age and gender, data were collected from the interviewers regarding their opinions on the subjective questions prior to fieldwork. Fixed effects and mixed effects logit models are used to examine the main effects and interactions between interviewer and respondent characteristics. More objective measures serve as a pseudo control group. The paper finds interviewer effects in the both subjective and objective data, but the magnitude is considerably stronger for subjective questions. The paper also finds that female respondents are more susceptible to influence based on the interviewer's beliefs. Despite methodological shortcomings, the study highlights the need to consider more fully the impact of traditional cultural norms when conducting quantitative surveys in the developing world on topics that are outside the standard objective questions.

Suggested Citation

  • Himelein,Kristen, 2015. "Interviewer effects in subjective survey questions: evidence from Timor-Leste," Policy Research Working Paper Series 7208, The World Bank.
    • Handle: RePEc:wbk:wbrwps:7208
    as

    Download full text from publisher

    File URL: http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2015/03/09/090224b082beb16d/1_0/Rendered/PDF/Interviewer0ef0nce0from0Timor0Leste.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Su-Hao Tu & Pei-Shan Liao, 2007. "Social Distance, Respondent Cooperation and Item Nonresponse in Sex Survey," Quality & Quantity: International Journal of Methodology, Springer, vol. 41(2), pages 177-199, April.
    2. Martin H. David & Christopher R. Bollinger, 2005. "I didn't tell, and I won't tell: dynamic response error in the SIPP," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(4), pages 563-569.
    3. Phung, T.D. & Hardeweg, B. & Praneetvatakul, S. & Waibel, H., 2015. "Non-Sampling Error and Data Quality: What Can We Learn from Surveys to Collect Data for Vulnerability Measurements?," World Development, Elsevier, vol. 71(C), pages 25-35.
    4. Nora Cate Schaeffer, 1980. "Evaluating Race-of-Interviewer Effects In a National Survey," Sociological Methods & Research, , vol. 8(4), pages 400-419, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brizmohun, Roshini & Duffy, Patricia A., 2016. "Do Personal Attitudes about Welfare Influence Food Stamp Participation?," 2016 Annual Meeting, July 31-August 2, Boston, Massachusetts 235698, Agricultural and Applied Economics Association.
    2. Craig Gundersen & Brent Kreider, 2008. "Food Stamps and Food Insecurity: What Can Be Learned in the Presence of Nonclassical Measurement Error?," Journal of Human Resources, University of Wisconsin Press, vol. 43(2), pages 352-382.
    3. Fisher, Jonathan D. & Houseworth, Christina A., 2013. "Occupation inflation in the Current Population Survey," Journal of Economic and Social Measurement, IOS Press, issue 3, pages 243-261.
    4. Benjamin Cerf Harris, 2014. "Within and Across County Variation in SNAP Misreporting: Evidence from Linked ACS and Administrative Records," CARRA Working Papers 2014-05, Center for Economic Studies, U.S. Census Bureau.
    5. Ian Brunton-Smith & Patrick Sturgis & George Leckie, 2017. "Detecting and understanding interviewer effects on survey data by using a cross-classified mixed effects location–scale model," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 180(2), pages 551-568, February.
    6. Harris, J. Andrew & van der Windt, Peter, 2023. "Empowering women or increasing response bias? Experimental evidence from Congo," Journal of Development Economics, Elsevier, vol. 164(C).
    7. Erik Scherpf & Benjamin Cerf, 2019. "Local Labor Demand and Program Participation Dynamics: Evidence from New York SNAP Administrative Records," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 38(2), pages 394-425, March.
    8. Nguyen, Trung Thanh & Nguyen, Loc Duc & Lippe, Rattiya Suddeephong & Grote, Ulrike, 2017. "Determinants of Farmers’ Land Use Decision-Making: Comparative Evidence From Thailand and Vietnam," World Development, Elsevier, vol. 89(C), pages 199-213.
    9. Bonaccolto-Töpfer, Marina & Briel, Stephanie, 2022. "The gender pay gap revisited: Does machine learning offer new insights?," Labour Economics, Elsevier, vol. 78(C).
    10. Eugenio Paglino & Tom Emery, 2020. "Evaluating interviewer manipulation in the new round of the Generations and Gender Survey," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 43(50), pages 1461-1494.
    11. Charles L. Baum & Shin-Yi Chou, 2011. "The Socio-Economic Causes of Obesity," NBER Working Papers 17423, National Bureau of Economic Research, Inc.
    12. Brooks, Mark & Lippe, Rattiya S. & Waibel, Hermann, 2021. "PAPI is gone, but errors remain: Non-sampling errors in household surveys," 2021 Conference, August 17-31, 2021, Virtual 315277, International Association of Agricultural Economists.
    13. Jonathan A. Parker & Nicholas S. Souleles & Christopher D. Carroll, 2014. "The Benefits of Panel Data in Consumer Expenditure Surveys," NBER Chapters, in: Improving the Measurement of Consumer Expenditures, pages 75-99, National Bureau of Economic Research, Inc.
    14. Thomas F. Crossley & Joachim K. Winter, 2014. "Asking Households about Expenditures: What Have We Learned?," NBER Chapters, in: Improving the Measurement of Consumer Expenditures, pages 23-50, National Bureau of Economic Research, Inc.
    15. Charles L. Baum II, 2010. "The Effects of Food Stamps on Obesity," Working Papers 201003, Middle Tennessee State University, Department of Economics and Finance.
    16. Kruppe, Thomas & Matthes, Britta & Unger, Stefanie, 2014. "Effectiveness of data correction rules in process-produced data : the case of educational attainment," IAB-Discussion Paper 201415, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    17. Erik Scherpf & Benjamin Cerf, 2016. "Local Labor Demand and Program Participation Dynamics," CARRA Working Papers 2016-10, Center for Economic Studies, U.S. Census Bureau.
    18. Bollinger, Christopher R. & Hirsch, Barry & Hokayem, Charles M. & Ziliak, James P., 2018. "Trouble in the Tails? What We Know about Earnings Nonresponse Thirty Years after Lillard, Smith, and Welch," IZA Discussion Papers 11710, Institute of Labor Economics (IZA).
    19. Phillips Angelica & Stenger Rachel, 2022. "The Effect of Burdensome Survey Questions on Data Quality in an Omnibus Survey," Journal of Official Statistics, Sciendo, vol. 38(4), pages 1019-1050, December.
    20. Charles Baum, 2012. "The effects of food stamp receipt on weight gained by expectant mothers," Journal of Population Economics, Springer;European Society for Population Economics, vol. 25(4), pages 1307-1340, October.

    More about this item

    Keywords

    Gender and Law; Science Education; Housing&Human Habitats; Labor Policies; Scientific Research&Science Parks;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:7208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.