IDEAS home Printed from https://ideas.repec.org/a/sae/joupea/v58y2021i4p623-639.html
   My bibliography  Save this article

Survey participation effects in conflict research

Author

Listed:
  • Alexander De Juan

    (Institute for Social Sciences, 64335University of Osnabrück)

  • Carlo Koos

    (1655Chr. Michelsen Institute)

Abstract

Do survey participants in conflict zones respond differently if they have been interviewed before? Academic and policy interest in postwar political opinion has increased tremendously. One unexpected consequence of this surge of survey research is a growing probability that individuals will be interviewed multiple times. However, if participating in one survey causes respondents to change their attitudes or behavior, their subsequent survey responses may be biased in comparison to the rest of the sample population. Our article aims to investigate such ‘survey participation effects’ in conflict contexts. We draw on original survey data collected in the eastern Democratic Republic of Congo (DRC). In our representative sample, 18% of respondents report that they have been interviewed before. Multivariate analyses demonstrate that their stated attitudes on social relations, political institutions, gender norms, and wartime victimization differ substantively from the responses of first-time interviewees. Moreover, our analyses indicate that experienced respondents have specific response styles – in particular, a tendency to support extreme response options. While substantive bias in multivariate analyses seems to be rather rare, our findings indicate that researchers should be aware of the footprints of data collection efforts in areas frequently targeted by household and opinion surveys.

Suggested Citation

  • Alexander De Juan & Carlo Koos, 2021. "Survey participation effects in conflict research," Journal of Peace Research, Peace Research Institute Oslo, vol. 58(4), pages 623-639, July.
  • Handle: RePEc:sae:joupea:v:58:y:2021:i:4:p:623-639
    DOI: 10.1177/0022343320971034
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0022343320971034
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0022343320971034?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bauer, Michal & Blattman, Christopher & Chytilová, Julie & Henrich, Joseph & Miguel, Edward & Mitts, Tamar, 2016. "Can War Foster Cooperation?," Department of Economics, Working Paper Series qt4pk561tn, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    2. Bartels, Larry M., 1999. "Panel Effects in the American National Election Studies," Political Analysis, Cambridge University Press, vol. 8(1), pages 1-20, January.
    3. Damian Clarke & Joseph P. Romano & Michael Wolf, 2020. "The Romano–Wolf multiple-hypothesis correction in Stata," Stata Journal, StataCorp LP, vol. 20(4), pages 812-843, December.
    4. Tilman Brück & Patricia Justino & Philip Verwimp & Alexandra Avdeenko & Andrew Tedesco, 2016. "Measuring Violent Conflict in Micro-level Surveys: Current Practices and Methodological Challenges," The World Bank Research Observer, World Bank, vol. 31(1), pages 29-58.
    5. Ivar Krumpal, 2013. "Determinants of social desirability bias in sensitive surveys: a literature review," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(4), pages 2025-2047, June.
    6. Blattman, Christopher, 2009. "From Violence to Voting: War and Political Participation in Uganda," American Political Science Review, Cambridge University Press, vol. 103(2), pages 231-247, May.
    7. Michal Bauer & Christopher Blattman & Julie Chytilová & Joseph Henrich & Edward Miguel & Tamar Mitts, 2016. "Can War Foster Cooperation?," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 249-274, Summer.
    8. Iacus, Stefano M. & King, Gary & Porro, Giuseppe, 2012. "Causal Inference without Balance Checking: Coarsened Exact Matching," Political Analysis, Cambridge University Press, vol. 20(1), pages 1-24, January.
    9. Sacks, Audrey & Larizza, Marco, 2012. "Why quality matters : rebuilding trustworthy local government in post-conflict Sierra Leone," Policy Research Working Paper Series 6021, The World Bank.
    10. Matthew Blackwell & Stefano Iacus & Gary King & Giuseppe Porro, 2009. "cem: Coarsened exact matching in Stata," Stata Journal, StataCorp LP, vol. 9(4), pages 524-546, December.
    11. Bullock, Will & Imai, Kosuke & Shapiro, Jacob N., 2011. "Statistical Analysis of Endorsement Experiments: Measuring Support for Militant Groups in Pakistan," Political Analysis, Cambridge University Press, vol. 19(4), pages 363-384.
    12. Blair, Graeme & Imai, Kosuke, 2012. "Statistical Analysis of List Experiments," Political Analysis, Cambridge University Press, vol. 20(1), pages 47-77, January.
    13. Alan Gerber & Anton Orlich & Jennifer Smith, 2003. "Self-prophecy effects and voter turnout: An experimental replication," Natural Field Experiments 00333, The Field Experiments Website.
    14. Iacus, Stefano & King, Gary & Porro, Giuseppe, 2009. "cem: Software for Coarsened Exact Matching," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 30(i09).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Torrisi, Orsola, 2024. "Violent instability and modern contraception: Evidence from Mali," World Development, Elsevier, vol. 177(C).
    2. De Juan, Alexander & Hoffmann, Lisa & Lay, Jann, 2022. "Large-scale agricultural investments, employment opportunities and communal conflict," OSF Preprints j5vmh, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Travers Barclay Child & Elena Nikolova, 2020. "War and social attitudes," Conflict Management and Peace Science, Peace Science Society (International), vol. 37(2), pages 152-171, March.
    2. Travers Barclay Child & Elena Nikolova, 2017. "War and Social Attitudes," UCL SSEES Economics and Business working paper series 2017-5, UCL School of Slavonic and East European Studies (SSEES).
    3. Tellez,Juan Fernando & Balcells,Laia, 2022. "Social Cohesion, Economic Security, and Forced Displacement in the Long-Run : Evidencefrom Rural Colombia," Policy Research Working Paper Series 10019, The World Bank.
    4. Olivia Bertelli & Thomas Calvo & Emmanuelle Lavallée & Marion Mercier & Sandrine Mesplé-Somps, 2023. "Measuring insecurity-related experiences and preferences in a fragile State. A list experiment in Mali," Working Papers DT/2023/01, DIAL (Développement, Institutions et Mondialisation).
    5. Muhsin Ali & Karim Khan, 2023. "Violent Conflict and Informal Institutions: Evidence from a Civil Conflict in Pakistan (Article)," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 62(2), pages 235-264.
    6. Stefano Amato & Alessia Patuelli & Rodrigo Basco & Nicola Lattanzi, 2023. "Family Firms Amidst the Global Financial Crisis: A Territorial Embeddedness Perspective on Downsizing," Journal of Business Ethics, Springer, vol. 183(1), pages 213-236, February.
    7. Stojetz, Wolfgang & Brück, Tilman, 2023. "Exposure to collective gender-based violence causes intimate partner violence," Journal of Development Economics, Elsevier, vol. 164(C).
    8. Qin, Wei & Liang, Quanxi & Jiao, Yan & Lu, Meiting & Shan, Yaowen, 2022. "Social trust and dividend payouts: Evidence from China," Pacific-Basin Finance Journal, Elsevier, vol. 72(C).
    9. Sergio Afcha & Jose García-Quevedo, 2016. "The impact of R&D subsidies on R&D employment composition," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 25(6), pages 955-975.
    10. Jing Wang & Gen Li & Kai-Lung Hui, 2022. "Monetary Incentives and Knowledge Spillover: Evidence from a Natural Experiment," Management Science, INFORMS, vol. 68(5), pages 3549-3572, May.
    11. Denny,Elaine Kathryn & Dow,David & Levy,Gabriella & Villamizar-Chaparro,Mateo, 2022. "Extortion and Civic Engagement among Guatemalan Deportees," Policy Research Working Paper Series 10020, The World Bank.
    12. Guignet, Dennis & Jenkins, Robin R. & Belke, James & Mason, Henry, 2023. "The property value impacts of industrial chemical accidents," Journal of Environmental Economics and Management, Elsevier, vol. 120(C).
    13. Philipp vom Berge & Achim Schmillen, 2023. "Effects of mass layoffs on local employment—evidence from geo-referenced data," Journal of International Economic Law, Oxford University Press, vol. 23(3), pages 509-539.
    14. Matteo Aquilina & Giulio Cornelli & Marina Sanchez del Villar, 2024. "Regulation, information asymmetries and the funding of new ventures," BIS Working Papers 1162, Bank for International Settlements.
    15. Katharina Werner & Ahmed Skali, 2023. "Violent Conflict and Parochial Trust: Lab-in-the-Field and Survey Evidence," HiCN Working Papers 404, Households in Conflict Network.
    16. John Beshears & James J. Choi & David Laibson & Brigitte C. Madrian & William L. Skimmyhorn, 2022. "Borrowing to Save? The Impact of Automatic Enrollment on Debt," Journal of Finance, American Finance Association, vol. 77(1), pages 403-447, February.
    17. Alacevich, Caterina & Zejcirovic, Dijana, 2020. "Does violence against civilians depress voter turnout? Evidence from Bosnia and Herzegovina," Journal of Comparative Economics, Elsevier, vol. 48(4), pages 841-865.
    18. Granja, Cintia & Visentin, Fabiana & Carneiro, Ana Maria, 2023. "Can international mobility shape students' attitudes toward inequality?," MERIT Working Papers 2023-001, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    19. Sarah Bridges & Douglas Scott, 2022. "Early Childhood Health During Conflict: The Legacy of the Lord’s Resistance Army in Northern Uganda," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(4), pages 694-718, August.
    20. Davidson Heath & Giorgo Sertsios, 2022. "Profitability and Financial Leverage: Evidence from a Quasi-Natural Experiment," Management Science, INFORMS, vol. 68(11), pages 8386-8410, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:joupea:v:58:y:2021:i:4:p:623-639. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: http://www.prio.no/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.