IDEAS home Printed from https://ideas.repec.org/a/sae/jocore/v70y2026i1p140-169.html

Knowing What We Don’t: The Fundamental Problem of Data Quality in Conflict Research—and Methodological Solutions

Author

Listed:
  • Rachel Sweet

Abstract

Conflict researchers face an unresolved dilemma: the underlying data are often unreliable. When it comes to covert relationships, killings, and illicit markets that organized violence entails, there are simply more incentives to alter information than to tell it straight. How confident can scholars be that on-the-ground events, rather than strategic or omitted information, drive research findings? Despite the evident need for accurate views into clandestine processes, existing work rarely applies systematic checks to verify the seeming “facts†of conflict. This article proposes a methodological toolkit to fill this gap. A first step develops systematic checks to report numerical credibility scores of source quality and corresponding error estimates. A second leverages data of varied strengths for distinct purposes: high-quality sources to triangulate facts and low-quality data to discern strategic images and mis/disinformation. The article tests these standards against major datasets and integrates the protocols into an interactive Data Evaluation Dashboard available for scholarly and policy use.

Suggested Citation

  • Rachel Sweet, 2026. "Knowing What We Don’t: The Fundamental Problem of Data Quality in Conflict Research—and Methodological Solutions," Journal of Conflict Resolution, Peace Science Society (International), vol. 70(1), pages 140-169, January.
  • Handle: RePEc:sae:jocore:v:70:y:2026:i:1:p:140-169
    DOI: 10.1177/00220027251325877
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/00220027251325877
    Download Restriction: no

    File URL: https://libkey.io/10.1177/00220027251325877?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Sweet, Rachel, 2021. "Concealing Conflict Markets: How Rebels and Firms Use State Institutions to Launder Wartime Trade," International Organization, Cambridge University Press, vol. 75(4), pages 1109-1132, April.
    2. Corstange, Daniel, 2009. "Sensitive Questions, Truthful Answers? Modeling the List Experiment with LISTIT," Political Analysis, Cambridge University Press, vol. 17(1), pages 45-63, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sohns, Franziska & Ghinoi, Stefano & Langosch, Magdalena, 2025. "Corrigendum to “The effect of public tolerance towards corruptive behaviour on healthcare efficiency and equity – The case of the UK's COVID-19 vaccination programme” [Soc. Sci. Med. Volume 361, November 2024, 117180]," Social Science & Medicine, Elsevier, vol. 369(C).
    2. Irfan Nooruddin, 2014. "Making Surveys Work Better: Experiments in Public Opinion Research," Studies in Indian Politics, , vol. 2(1), pages 105-108, June.
    3. Jamison, Julian & Karlan, Dean & Raffler, Pia, 2013. "Mixed Method Evaluation of a Passive mHealth Sexual Information Texting Service in Uganda," Working Papers 116, Yale University, Department of Economics.
    4. De Cao, Elisabetta & Lutz, Clemens, 2014. "Sensitive survey questions," Research Report 14017-EEF, University of Groningen, Research Institute SOM (Systems, Organisations and Management).
    5. Lai, Yufeng & Minegishi, Kota & Boaitey, Albert K., 2020. "Social Desirability Bias in Farm Animal Welfare Preference Research," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304375, Agricultural and Applied Economics Association.
    6. Tobias H. Stark & Floor M. van Maaren & Jon A. Krosnick & Gaurav Sood, 2022. "The Impact of Social Desirability Pressures on Whites’ Endorsement of Racial Stereotypes: A Comparison Between Oral and ACASI Reports in a National Survey," Sociological Methods & Research, , vol. 51(2), pages 605-631, May.
    7. S. Rinken & S. Pasadas-del-Amo & M. Rueda & B. Cobo, 2021. "No magic bullet: estimating anti-immigrant sentiment and social desirability bias with the item-count technique," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(6), pages 2139-2159, December.
    8. Leopoldo Fergusson & Carlos Molina & Juan Felipe Ria�o, 2019. "Consumers as VAT “Evaders”: Incidence, Social Bias, and Correlates in Colombia," Economía Journal, The Latin American and Caribbean Economic Association - LACEA, vol. 0(Spring 20), pages 21-67.
    9. Gallego, Jorge & Wantchekon, Leonard, 2012. "Experiments on Clientelism and Vote Buying," MPRA Paper 97060, University Library of Munich, Germany.
    10. Urtuzuastigui, Jerry & Koren, Ore, 2024. "Targeted sanctions, resource substitution, and violence against civilians: Localized evidence from African states," World Development, Elsevier, vol. 179(C).
    11. James G. Gimpel & Iris Hui, 2017. "Inadvertent and intentional partisan residential sorting," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 58(3), pages 441-468, May.
    12. repec:dgr:rugsom:14017-eef is not listed on IDEAS
    13. Julian Jamison, Dean Karlan, Pia Raffler, 2013. "Mixed Method Evaluation of a Passive Health Sexual Information Texting Service in Uganda-Working Paper 332," Working Papers 332, Center for Global Development.
    14. Shu-Hui Hsieh & Shen-Ming Lee & Chin-Shang Li, 2022. "A Two-stage Multilevel Randomized Response Technique With Proportional Odds Models and Missing Covariates," Sociological Methods & Research, , vol. 51(1), pages 439-467, February.
    15. Richard Traunmüller & Sara Kijewski & Markus Freitag, 2019. "The Silent Victims of Sexual Violence during War: Evidence from a List Experiment in Sri Lanka," Journal of Conflict Resolution, Peace Science Society (International), vol. 63(9), pages 2015-2042, October.
    16. Ravanilla, Nico & Hicken, Allen, 2023. "Poverty, social networks, and clientelism," World Development, Elsevier, vol. 162(C).
    17. Jouni Kuha & Jonathan Jackson, 2014. "The item count method for sensitive survey questions: modelling criminal behaviour," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 63(2), pages 321-341, February.
    18. Cullen,Claire Alexis, 2020. "Method Matters : Underreporting of Intimate Partner Violence in Nigeria and Rwanda," Policy Research Working Paper Series 9274, The World Bank.
    19. Leopoldo Fergusson & Carlos Molina & Juan Felipe Ria�o, 2018. "I Sell My Vote, and So What? Incidence, Social Bias, and Correlates of Clientelism in Colombia," Economía Journal, The Latin American and Caribbean Economic Association - LACEA, vol. 0(Fall 2018), pages 181-218.
    20. Ursula Daxecker & Annekatrin Deglow & Hanne Fjelde, 2025. "Voter Intimidation as a Tool of Mobilization or Demobilization? Evidence from West Bengal, India," Journal of Conflict Resolution, Peace Science Society (International), vol. 69(7-8), pages 1232-1257, September.
    21. Tadesse, Getaw & Abate, Gashaw T. & Zewdie, Tadiwos, 2020. "Biases in self-reported food insecurity measurement: A list experiment approach," Food Policy, Elsevier, vol. 92(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jocore:v:70:y:2026:i:1:p:140-169. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: http://pss.la.psu.edu/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.