IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v164y2023ics0304387823000524.html
   My bibliography  Save this article

Empowering women or increasing response bias? Experimental evidence from Congo

Author

Listed:
  • Harris, J. Andrew
  • van der Windt, Peter

Abstract

Women’s empowerment interventions are an important component of many development programs; surveys are a popular tool to measure how such programs affect gender-related attitudes. We consider how differences in gender response bias between the treatment and control groups complicate the use of attitudinal questions to evaluate women’s empowerment interventions. We examine data from two experiments: a randomized development program aimed to empower women in 1,250 Congolese villages and a follow-up survey experiment. After demonstrating strong response biases in gender-related questions as a function of interviewer gender, we show that these biases vary as a function of program treatment status. These findings mean that the estimated average treatment effects of women’s empowerment programs are sensitive to both the gender composition of the respondent sample as well as the interviewer pool. We conclude with lessons for survey implementation and pre-analysis plans.

Suggested Citation

  • Harris, J. Andrew & van der Windt, Peter, 2023. "Empowering women or increasing response bias? Experimental evidence from Congo," Journal of Development Economics, Elsevier, vol. 164(C).
    • Handle: RePEc:eee:deveco:v:164:y:2023:i:c:s0304387823000524
    DOI: 10.1016/j.jdeveco.2023.103097
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304387823000524
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jdeveco.2023.103097?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lori Beaman & Raghabendra Chattopadhyay & Esther Duflo & Rohini Pande & Petia Topalova, 2009. "Powerful Women: Does Exposure Reduce Bias?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 124(4), pages 1497-1540.
    2. Aleksandra An, 2012. "The Role of Social Space in Municipal Formations," Public administration issues, Higher School of Economics, issue 1, pages 174-184.
    3. Anderson, Michael L, 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt15n8j26f, Department of Agricultural & Resource Economics, UC Berkeley.
    4. Esther Duflo, 2012. "Women Empowerment and Economic Development," Journal of Economic Literature, American Economic Association, vol. 50(4), pages 1051-1079, December.
    5. Humphreys, Macartan & de la Sierra, Raúl Sánchez & der Windt, Peter Van, 2019. "Exporting democratic practices: Evidence from a village governance intervention in Eastern Congo," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 140, pages 279-301.
    6. Guirkinger, Catherine & Platteau, Jean-Philippe & Goetghebuer, Tatiana, 2015. "Productive inefficiency in extended agricultural households: Evidence from Mali," Journal of Development Economics, Elsevier, vol. 116(C), pages 17-27.
    7. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    8. van der Windt, Peter & Humphreys, Macartan & de la Sierra, Raul Sanchez, 2018. "Gender quotas in development programming: Null results from a field experiment in Congo," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 133, pages 326-345.
    9. Jayachandran, Seema & Biradavolu, Monica & Cooper, Jan, 2021. "Using Machine Learning and Qualitative Interviews to Design a Five-Question Women's Agency Index," IZA Discussion Papers 14221, Institute of Labor Economics (IZA).
    10. Mummolo, Jonathan & Peterson, Erik, 2019. "Demand Effects in Survey Experiments: An Empirical Assessment," American Political Science Review, Cambridge University Press, vol. 113(2), pages 517-529, May.
    11. Alex Armand & Alexander Coutts & Pedro C. Vicente & Inês Vilela, 2020. "Does Information Break the Political Resource Curse? Experimental Evidence from Mozambique," American Economic Review, American Economic Association, vol. 110(11), pages 3431-3453, November.
    12. Kean Siang & CH’NG, 2012. "Social comparison in deterrence policy," Advances in Management and Applied Economics, SCIENPRESS Ltd, vol. 2(1), pages 1-2.
    13. Bhavnani, Rikhil R., 2009. "Do Electoral Quotas Work after They Are Withdrawn? Evidence from a Natural Experiment in India," American Political Science Review, Cambridge University Press, vol. 103(1), pages 23-35, February.
    14. Clayton, Amanda, 2018. "Do Gender Quotas Really Reduce Bias? Evidence from a Policy Experiment in Southern Africa," Journal of Experimental Political Science, Cambridge University Press, vol. 5(3), pages 182-194, December.
    15. Luís Cavique & Armando B. Mendes & Jorge M.A. Santos, 2012. "Clique Communities In Social Networks," World Scientific Book Chapters, in: Luiz Moutinho & Kun-Huang Huarng (ed.), Quantitative Modelling In Marketing And Management, chapter 20, pages 469-490, World Scientific Publishing Co. Pte. Ltd..
    16. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, January.
    17. Su-Hao Tu & Pei-Shan Liao, 2007. "Social Distance, Respondent Cooperation and Item Nonresponse in Sex Survey," Quality & Quantity: International Journal of Methodology, Springer, vol. 41(2), pages 177-199, April.
    18. Raghabendra Chattopadhyay & Esther Duflo, 2004. "Women as Policy Makers: Evidence from a Randomized Policy Experiment in India," Econometrica, Econometric Society, vol. 72(5), pages 1409-1443, September.
    19. Diva Dhar & Tarun Jain & Seema Jayachandran, 2022. "Reshaping Adolescents' Gender Attitudes: Evidence from a School-Based Experiment in India," American Economic Review, American Economic Association, vol. 112(3), pages 899-927, March.
    20. Usdin, S. & Scheepers, E. & Goldstein, Susan & Japhet, Garth, 2005. "Achieving social change on gender-based violence: A report on the impact evaluation of Soul City's fourth series," Social Science & Medicine, Elsevier, vol. 61(11), pages 2434-2445, December.
    21. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    22. Baird, Sarah & Özler, Berk, 2012. "Examining the reliability of self-reported data on school participation," Journal of Development Economics, Elsevier, vol. 98(1), pages 89-93.
    23. Jonathan de Quidt & Johannes Haushofer & Christopher Roth, 2018. "Measuring and Bounding Experimenter Demand," American Economic Review, American Economic Association, vol. 108(11), pages 3266-3302, November.
    24. D'Espallier, Bert & Guérin, Isabelle & Mersland, Roy, 2011. "Women and Repayment in Microfinance: A Global Analysis," World Development, Elsevier, vol. 39(5), pages 758-772, May.
    25. Beath, Andrew & Christia, Fotini & Enikolopov, Ruben, 2013. "Empowering Women through Development Aid: Evidence from a Field Experiment in Afghanistan," American Political Science Review, Cambridge University Press, vol. 107(3), pages 540-557, August.
    26. Blair, Graeme & Coppock, Alexander & Moor, Margaret, 2020. "When to Worry about Sensitivity Bias: A Social Reference Theory and Evidence from 30 Years of List Experiments," American Political Science Review, Cambridge University Press, vol. 114(4), pages 1297-1315, November.
    27. D. James Greiner & Donald B. Rubin, 2011. "Causal Effects of Perceived Immutable Characteristics," The Review of Economics and Statistics, MIT Press, vol. 93(3), pages 775-785, August.
    28. Humphreys, Macartan & Sánchez de la Sierra, Raúl & Van der Windt, Peter, 2019. "Exporting democratic practices: Evidence from a village governance intervention in Eastern Congo," Journal of Development Economics, Elsevier, vol. 140(C), pages 279-301.
    29. Prina, Silvia, 2015. "Banking the poor via savings accounts: Evidence from a field experiment," Journal of Development Economics, Elsevier, vol. 115(C), pages 16-31.
    30. Vitrenko A., 2012. "Social and economical meaning of modern Advertising activity," Bulletin of Taras Shevchenko National University of Kyiv. Economics. Вісник Киiвського нацiонального унiверситету iм. Тараса Шевченка. Серiя: Економiка, CyberLeninka;Издательско-полиграфический центр «Киевский университет», issue 137, pages 56-59.
    31. Harris, J. Andrew & Posner, Daniel N., 2019. "(Under What Conditions) Do Politicians Reward Their Supporters? Evidence from Kenya’s Constituencies Development Fund," American Political Science Review, Cambridge University Press, vol. 113(1), pages 123-139, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger, 2020. "Educational inequality and public policy preferences: Evidence from representative survey experiments," Journal of Public Economics, Elsevier, vol. 188(C).
    2. van der Windt, Peter & Humphreys, Macartan & Sanchez de la Sierra, Raul, 2018. "Gender quotas in development programming: Null results from a field experiment in Congo," Journal of Development Economics, Elsevier, vol. 133(C), pages 326-345.
    3. Siwan Anderson, 2022. "Unbundling female empowerment," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 55(4), pages 1671-1701, November.
    4. Alexis Grigorieff & Christopher Roth & Diego Ubfal, 2020. "Does Information Change Attitudes Toward Immigrants?," Demography, Springer;Population Association of America (PAA), vol. 57(3), pages 1117-1143, June.
    5. Perrotta Berlin, Maria & Bonnier, Evelina & Olofsgård, Anders, 2023. "Foreign Aid and Female Empowerment," SITE Working Paper Series 62, Stockholm School of Economics, Stockholm Institute of Transition Economics.
    6. Gottlieb, Jessica, 2016. "Why Might Information Exacerbate the Gender Gap in Civic Participation? Evidence from Mali," World Development, Elsevier, vol. 86(C), pages 95-110.
    7. Garcia-Hernandez, Ana & Grossman, Guy & Michelitch, Kristin Grace, 2022. "Networks and the Size of the Gender Gap in Politician Performance Across Job Duties," OSF Preprints j7zg2, Center for Open Science.
    8. Kosec, Katrina & Mo, Cecilia Hyunjung & Schmidt, Emily & Song, Jie, 2021. "Perceptions of relative deprivation and women’s empowerment," World Development, Elsevier, vol. 138(C).
    9. Michael L. Anderson & Fangwen Lu, 2017. "Learning to Manage and Managing to Learn: The Effects of Student Leadership Service," Management Science, INFORMS, vol. 63(10), pages 3246-3261, October.
    10. Lergetporer, Philipp & Piopiunik, Marc & Simon, Lisa, 2021. "Does the education level of refugees affect natives’ attitudes?," European Economic Review, Elsevier, vol. 134(C).
    11. Steinert, Janina I. & Zenker, Juliane & Filipiak, Ute & Movsisyan, Ani & Cluver, Lucie D. & Shenderovich, Yulia, 2018. "Do saving promotion interventions increase household savings, consumption, and investments in Sub-Saharan Africa? A systematic review and meta-analysis," World Development, Elsevier, vol. 104(C), pages 238-256.
    12. Bjorn Van Campenhout & David J. Spielman & Els Lecoutere, 2021. "Information and Communication Technologies to Provide Agricultural Advice to Smallholder Farmers: Experimental Evidence from Uganda," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(1), pages 317-337, January.
    13. Lubega, Patrick & Nakakawa, Frances & Narciso, Gaia & Newman, Carol & Kaaya, Archileo N. & Kityo, Cissy & Tumuhimbise, Gaston A., 2021. "Body and mind: Experimental evidence from women living with HIV," Journal of Development Economics, Elsevier, vol. 150(C).
    14. Gautam Nair & Kyle Peyton, 2022. "Building Mass Support for Global Pandemic Recovery Efforts in the United States," CID Working Papers 408, Center for International Development at Harvard University.
    15. Abhijit V. Banerjee & Esther Duflo, 2014. "Under the Thumb of History? Political Institutions and the Scope for Action," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 951-971, August.
    16. Bhalotra, Sonia & Clots-Figueras, Irma & Iyer, Lakshmi, 2013. "Path-Breakers: How Does Women’s Political Participation Respond to Electoral Success?," Economics Discussion Papers 9008, University of Essex, Department of Economics.
    17. Diva Dhar & Tarun Jain & Seema Jayachandran, 2022. "Reshaping Adolescents' Gender Attitudes: Evidence from a School-Based Experiment in India," American Economic Review, American Economic Association, vol. 112(3), pages 899-927, March.
    18. Oriana Bandiera & Niklas Buehren & Robin Burgess & Markus Goldstein & Selim Gulesci & Imran Rasul & Munshi Sulaiman, 2020. "Women's Empowerment in Action: Evidence from a Randomized Control Trial in Africa," American Economic Journal: Applied Economics, American Economic Association, vol. 12(1), pages 210-259, January.
    19. Nathan Fiala & Ana Garcia-Hernandez & Kritika Narula & Nishith Prakash, 2022. "Wheels of Change: Transforming Girls’ Lives with Bicycles," Working papers 2022-04, University of Connecticut, Department of Economics.
    20. Bhalotra, Sonia R. & Clarke, Damian & Gomes, Joseph & Venkataramani, Atheendar, 2018. "Maternal Mortality and Women's Political Participation," IZA Discussion Papers 11590, Institute of Labor Economics (IZA).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:164:y:2023:i:c:s0304387823000524. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.