IDEAS home Printed from https://ideas.repec.org/a/sae/somere/v51y2022i2p632-666.html
   My bibliography  Save this article

How Events Enter (or Not) Data Sets: The Pitfalls and Guidelines of Using Newspapers in the Study of Conflict

Author

Listed:
  • Leila Demarest
  • Arnim Langer

Abstract

While conflict event data sets are increasingly used in contemporary conflict research, important concerns persist regarding the quality of the collected data. Such concerns are not necessarily new. Yet, because the methodological debate and evidence on potential errors remains scattered across different subdisciplines of social sciences, there is little consensus concerning proper reporting practices in codebooks, how best to deal with the different types of errors, and which types of errors should be prioritised. In this article, we introduce a new analytical framework—that is, the Total Event Error (TEE) framework—which aims to elucidate the methodological challenges and errors that may affect whether and how events are entered into conflict event data sets, drawing on different fields of study. Potential errors are diverse and may range from errors arising from the rationale of the media source (e.g., selection of certain types of events into the news) to errors occurring during the data collection process or the analysis phase. Based on the TEE framework, we propose a set of strategies to mitigate errors associated with the construction and use of conflict event data sets. We also identify a number of important avenues for future research concerning the methodology of creating conflict event data sets.

Suggested Citation

  • Leila Demarest & Arnim Langer, 2022. "How Events Enter (or Not) Data Sets: The Pitfalls and Guidelines of Using Newspapers in the Study of Conflict," Sociological Methods & Research, , vol. 51(2), pages 632-666, May.
  • Handle: RePEc:sae:somere:v:51:y:2022:i:2:p:632-666
    DOI: 10.1177/0049124119882453
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0049124119882453
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0049124119882453?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. King, Gary & Lowe, Will, 2003. "An Automated Information Extraction Tool for International Conflict Data with Performance as Good as Human Coders: A Rare Events Evaluation Design," International Organization, Cambridge University Press, vol. 57(3), pages 617-642, July.
    2. Cullen S. Hendrix & Idean Salehyan, 2015. "No News Is Good News: Mark and Recapture for Event Data When Reporting Probabilities Are Less Than One," International Interactions, Taylor & Francis Journals, vol. 41(2), pages 392-406, March.
    3. Nils B. Weidmann, 2016. "A Closer Look at Reporting Bias in Conflict Event Data," American Journal of Political Science, John Wiley & Sons, vol. 60(1), pages 206-218, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Daniel Karell & Andrew Linke & Edward Holland & Edward Hendrickson, 2023. "“Born for a Storm†: Hard-Right Social Media and Civil Unrest," American Sociological Review, , vol. 88(2), pages 322-349, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. von Borzyskowski, Inken & Wahman, Michael, 2018. "Systematic measurement error in election violence data: causes and consequences," LSE Research Online Documents on Economics 90450, London School of Economics and Political Science, LSE Library.
    2. Cullen S. Hendrix & Idean Salehyan, 2017. "A House Divided," Journal of Conflict Resolution, Peace Science Society (International), vol. 61(8), pages 1653-1681, September.
    3. Anita R. Gohdes, 2020. "Repression Technology: Internet Accessibility and State Violence," American Journal of Political Science, John Wiley & Sons, vol. 64(3), pages 488-503, July.
    4. Mengyang Zhao, 2019. "Media Freedom and Protest Events in the Global South," Social Science Quarterly, Southwestern Social Science Association, vol. 100(4), pages 1254-1267, June.
    5. Natalini, Davide & Bravo, Giangiacomo & Newman, Edward, 2020. "Fuel riots: definition, evidence and policy implications for a new type of energy-related conflict," Energy Policy, Elsevier, vol. 147(C).
    6. Leopoldo Fergusson & Carlos Molina, 2020. "Facebook Causes Protests," HiCN Working Papers 323, Households in Conflict Network.
    7. Pearce Edwards & Patrick Pierson, 2023. "Incumbent-Aligned Terrorism and Voting Behavior: Evidence from Argentina’s 1973 Elections," Journal of Conflict Resolution, Peace Science Society (International), vol. 67(4), pages 672-700, April.
    8. Mueller, Hannes & Rauh, Christopher, 2018. "Reading Between the Lines: Prediction of Political Violence Using Newspaper Text," American Political Science Review, Cambridge University Press, vol. 112(2), pages 358-375, May.
    9. Sam R. Bell & K. Chad Clay & Amanda Murdie, 2019. "Join the Chorus, Avoid the Spotlight: The Effect of Neighborhood and Social Dynamics on Human Rights Organization Shaming," Journal of Conflict Resolution, Peace Science Society (International), vol. 63(1), pages 167-193, January.
    10. Desbordes, Rodolphe & Vicard, Vincent, 2009. "Foreign direct investment and bilateral investment treaties: An international political perspective," Journal of Comparative Economics, Elsevier, vol. 37(3), pages 372-386, September.
    11. Sarah A. V. Ellington & Benjamin E. Bagozzi & Daniel Berliner & Brian Palmer-Rubin & Aaron Erlich, 2022. "Measuring Human Rights Abuse from Access to Information Requests," Journal of Conflict Resolution, Peace Science Society (International), vol. 66(2), pages 357-384, February.
    12. Jule Krüger & Ragnhild Nordås, 2020. "A latent variable approach to measuring wartime sexual violence," Journal of Peace Research, Peace Research Institute Oslo, vol. 57(6), pages 728-739, November.
    13. Kikuta,Kyosuke & Hanayama,Manaho, 2023. "Does the Nobel Peace Prize Improve Women’s Rights? Prize and Praise in International Relations," IDE Discussion Papers 903, Institute of Developing Economies, Japan External Trade Organization(JETRO).
    14. Leonardo Becchetti & Andrew E. Clark & Elena Giachin Ricco, 2011. "The value of diplomacy: Bilateral relations and immigrant well-being," Working Papers halshs-00580907, HAL.
    15. Ulrich Petersohn & Vanessa Gottwick & Charlotte Penel & Leila Kellgren-Parker, 2022. "The Commercial Military Actor Database," Journal of Conflict Resolution, Peace Science Society (International), vol. 66(4-5), pages 899-923, May.
    16. Borbáth, Endre & Hutter, Swen, 2020. "Are Political Parties Recapturing the Streets of Europe?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, pages 251-272.
    17. Svend-Erik Skaaning, 2018. "Different Types of Data and the Validity of Democracy Measures," Politics and Governance, Cogitatio Press, vol. 6(1), pages 105-116.
    18. Lamprini Rori & Vasiliki Georgiadou & Costas Roumanias, 2022. "Political violence in Greece through the PVGR database: evidence from the far right and the far left," GreeSE – Hellenic Observatory Papers on Greece and Southeast Europe 167, Hellenic Observatory, LSE.
    19. Witold J. Henisz & Sinziana Dorobantu & Lite J. Nartey, 2014. "Spinning gold: The financial returns to stakeholder engagement," Strategic Management Journal, Wiley Blackwell, vol. 35(12), pages 1727-1748, December.
    20. Rafat Mahmood & Michael Jetter, 2020. "Communications Technology and Terrorism," Journal of Conflict Resolution, Peace Science Society (International), vol. 64(1), pages 127-166, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:somere:v:51:y:2022:i:2:p:632-666. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.