IDEAS home Printed from https://ideas.repec.org/a/sae/joupea/v62y2025i6p2070-2087.html

The 2023/24 VIEWS Prediction challenge: Predicting the number of fatalities in armed conflict, with uncertainty

Author

Listed:
  • HÃ¥vard Hegre
  • Paola Vesco
  • Michael Colaresi
  • Jonas Vestby
  • Alexa Timlick
  • Noorain Syed Kazmi
  • Angelica Lindqvist-McGowan
  • Friederike Becker
  • Marco Binetti
  • Tobias Bodentien
  • Tobias Bohne
  • Patrick T. Brandt
  • Thomas Chadefaux
  • Simon Drauz
  • Christoph Dworschak
  • Vito D’Orazio
  • Hannah Frank
  • Cornelius Fritz
  • Kristian Skrede Gleditsch
  • Sonja Häffner
  • Martin Hofer
  • Finn L Klebe
  • Luca Macis
  • Alexandra Malaga
  • Marius Mehrl
  • Nils W Metternich
  • Daniel Mittermaier
  • David Muchlinski
  • Hannes Mueller
  • Christian Oswald
  • Paola Pisano
  • David Randahl
  • Christopher Rauh
  • Lotta Rüter
  • Thomas Schincariol
  • Benjamin Seimon
  • Elena Siletti
  • Marco Tagliapietra
  • Chandler Thornhill
  • Johan Vegelius
  • Julian Walterskirchen

Abstract

Governmental and nongovernmental organizations have increasingly relied on early-warning systems of conflict to support their decisionmaking. Predictions of war intensity as probability distributions prove closer to what policymakers need than point estimates, as they encompass useful representations of both the most likely outcome and the lower-probability risk that conflicts escalate catastrophically. Point-estimate predictions, by contrast, fail to represent the inherent uncertainty in the distribution of conflict fatalities. Yet, current early warning systems are preponderantly focused on providing point estimates, while efforts to forecast conflict fatalities as a probability distribution remain sparse. Building on the predecessor VIEWS competition, we organize a prediction challenge to encourage endeavours in this direction. We invite researchers across multiple disciplinary fields, from conflict studies to computer science, to forecast the number of fatalities in state-based armed conflicts, in the form of the UCDP ‘best’ estimates aggregated to two units of analysis (country-months and PRIO-GRID-months), with estimates of uncertainty. This article introduces the goal and motivation behind the prediction challenge, presents a set of evaluation metrics to assess the performance of the forecasting models, describes the benchmark models which the contributions are evaluated against, and summarizes the salient features of the submitted contributions.

Suggested Citation

  • HÃ¥vard Hegre & Paola Vesco & Michael Colaresi & Jonas Vestby & Alexa Timlick & Noorain Syed Kazmi & Angelica Lindqvist-McGowan & Friederike Becker & Marco Binetti & Tobias Bodentien & Tobias Bohne & , 2025. "The 2023/24 VIEWS Prediction challenge: Predicting the number of fatalities in armed conflict, with uncertainty," Journal of Peace Research, Peace Research Institute Oslo, vol. 62(6), pages 2070-2087, November.
  • Handle: RePEc:sae:joupea:v:62:y:2025:i:6:p:2070-2087
    DOI: 10.1177/00223433241300862
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/00223433241300862
    Download Restriction: no

    File URL: https://libkey.io/10.1177/00223433241300862?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Arthur Carvalho, 2016. "An Overview of Applications of Proper Scoring Rules," Decision Analysis, INFORMS, vol. 13(4), pages 223-242, December.
    2. Fabian Krüger & Sebastian Lerch & Thordis Thorarinsdottir & Tilmann Gneiting, 2021. "Predictive Inference Based on Markov Chain Monte Carlo Output," International Statistical Review, International Statistical Institute, vol. 89(2), pages 274-301, August.
    3. Kristian S. Gleditsch & Michael D. Ward, 1999. "A revised list of independent states since the congress of Vienna," International Interactions, Taylor & Francis Journals, vol. 25(4), pages 393-413, October.
    4. Håvard Hegre & Paola Vesco & Michael Colaresi, 2022. "Lessons from an escalation prediction competition," International Interactions, Taylor & Francis Journals, vol. 48(4), pages 521-554, July.
    5. Paola Vesco & Håvard Hegre & Michael Colaresi & Remco Bastiaan Jansen & Adeline Lo & Gregor Reisch & Nils B. Weidmann, 2022. "United they stand: Findings from an escalation prediction competition," International Interactions, Taylor & Francis Journals, vol. 48(4), pages 860-896, July.
    6. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268, April.
    7. Claudia Czado & Tilmann Gneiting & Leonhard Held, 2009. "Predictive Model Assessment for Count Data," Biometrics, The International Biometric Society, vol. 65(4), pages 1254-1261, December.
    8. Brandt, Patrick T. & Freeman, John R. & Schrodt, Philip A., 2014. "Evaluating forecasts of political conflict dynamics," International Journal of Forecasting, Elsevier, vol. 30(4), pages 944-962.
    9. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    10. Jack A. Goldstone & Robert H. Bates & David L. Epstein & Ted Robert Gurr & Michael B. Lustik & Monty G. Marshall & Jay Ulfelder & Mark Woodward, 2010. "A Global Model for Forecasting Political Instability," American Journal of Political Science, John Wiley & Sons, vol. 54(1), pages 190-208, January.
    11. Smith, Leonard A. & Suckling, Emma B. & Thompson, Erica L. & Maynard, Trevor & Du, Hailiang, 2015. "Towards improving the framework for probabilistic forecast evaluation," LSE Research Online Documents on Economics 62949, London School of Economics and Political Science, LSE Library.
    12. Leonard Smith & Emma Suckling & Erica Thompson & Trevor Maynard & Hailiang Du, 2015. "Towards improving the framework for probabilistic forecast evaluation," Climatic Change, Springer, vol. 132(1), pages 31-45, September.
    13. Kolassa, Stephan, 2016. "Evaluating predictive count data distributions in retail sales forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 788-803.
    14. Samuel Bazzi & Robert A. Blair & Christopher Blattman & Oeindrila Dube & Matthew Gudgeon & Richard Peck, 2022. "The Promise and Pitfalls of Conflict Prediction: Evidence from Colombia and Indonesia," The Review of Economics and Statistics, MIT Press, vol. 104(4), pages 764-779, October.
    15. Mueller, Hannes & Rauh, Christopher, 2018. "Reading Between the Lines: Prediction of Political Violence Using Newspaper Text," American Political Science Review, Cambridge University Press, vol. 112(2), pages 358-375, May.
    16. Shawn Davies & Garoun Engström & Therése Pettersson & Magnus Öberg, 2024. "Organized violence 1989–2023, and the prevalence of organized crime groups," Journal of Peace Research, Peace Research Institute Oslo, vol. 61(4), pages 673-693, July.
    17. Håvard Hegre & Curtis Bell & Michael Colaresi & Mihai Croicu & Frederick Hoyles & Remco Jansen & Maxine Ria Leis & Angelica Lindqvist-McGowan & David Randahl & Espen Geelmuyden Rød & Paola Vesco, 2021. "ViEWS2020: Revising and evaluating the ViEWS political Violence Early-Warning System," Journal of Peace Research, Peace Research Institute Oslo, vol. 58(3), pages 599-611, May.
    18. Johannes Bracher & Evan L Ray & Tilmann Gneiting & Nicholas G Reich, 2021. "Evaluating epidemic forecasts in an interval format," PLOS Computational Biology, Public Library of Science, vol. 17(2), pages 1-15, February.
    19. Nils B. Weidmann & Doreen Kuse & Kristian Skrede Gleditsch, 2010. "The Geography of the International System: The CShapes Dataset," International Interactions, Taylor & Francis Journals, vol. 36(1), pages 86-106, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Racek, Daniel & Thurner, Paul W. & Davidson, Brittany I. & Zhu, Xiao Xiang & Kauermann, Göran, 2024. "Conflict forecasting using remote sensing data: An application to the Syrian civil war," International Journal of Forecasting, Elsevier, vol. 40(1), pages 373-391.
    3. Graziani, Carlo & Rosner, Robert & Adams, Jennifer M. & Machete, Reason L., 2021. "Probabilistic recalibration of forecasts," International Journal of Forecasting, Elsevier, vol. 37(1), pages 1-27.
    4. Malte C. Tichy & Illia Babounikau & Nikolas Wolke & Stefan Ulbrich & Michael Feindt, 2026. "Scaling‐Aware Rating of Poisson‐Limited Demand Forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 45(2), pages 787-805, March.
    5. Montgomery, Jacob M. & Hollenbach, Florian M. & Ward, Michael D., 2015. "Calibrating ensemble forecasting models with sparse data in the social sciences," International Journal of Forecasting, Elsevier, vol. 31(3), pages 930-942.
    6. Warne, Anders, 2023. "DSGE model forecasting: rational expectations vs. adaptive learning," Working Paper Series 2768, European Central Bank.
    7. Rød, Espen Geelmuyden & Gåsste, Tim & Hegre, Håvard, 2024. "A review and comparison of conflict early warning systems," International Journal of Forecasting, Elsevier, vol. 40(1), pages 96-112.
    8. repec:osf:osfxxx:q59dr_v1 is not listed on IDEAS
    9. Antonio Bracale & Pasquale De Falco, 2015. "An Advanced Bayesian Method for Short-Term Probabilistic Forecasting of the Generation of Wind Power," Energies, MDPI, vol. 8(9), pages 1-22, September.
    10. David Harris & Gael M. Martin & Indeewara Perera & Don S. Poskitt, 2017. "Construction and visualization of optimal confidence sets for frequentist distributional forecasts," Monash Econometrics and Business Statistics Working Papers 9/17, Monash University, Department of Econometrics and Business Statistics.
    11. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    12. Espen Geelmuyden Rød & Håvard Hegre & Maxine Leis, 2025. "Predicting armed conflict using protest data," Journal of Peace Research, Peace Research Institute Oslo, vol. 62(1), pages 3-20, January.
    13. Braun, Julia & Sabanés Bové, Daniel & Held, Leonhard, 2014. "Choice of generalized linear mixed models using predictive crossvalidation," Computational Statistics & Data Analysis, Elsevier, vol. 75(C), pages 190-202.
    14. Taillardat, Maxime & Fougères, Anne-Laure & Naveau, Philippe & de Fondeville, Raphaël, 2023. "Evaluating probabilistic forecasts of extremes using continuous ranked probability score distributions," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1448-1459.
    15. Malte Knuppel & Fabian Kruger & Marc-Oliver Pohle, 2022. "Score-based calibration testing for multivariate forecast distributions," Papers 2211.16362, arXiv.org, revised Dec 2023.
    16. Borgonovo, Emanuele & Jose, Victor Richmond R. & Knowlton, Morgan & Shachter, Ross & Siebert, Johannes Ulrich & Ulu, Canan, 2026. "Fifty years of decision analysis in operational research: A review," European Journal of Operational Research, Elsevier, vol. 329(2), pages 355-377.
    17. Ng, Jason & Forbes, Catherine S. & Martin, Gael M. & McCabe, Brendan P.M., 2013. "Non-parametric estimation of forecast distributions in non-Gaussian, non-linear state space models," International Journal of Forecasting, Elsevier, vol. 29(3), pages 411-430.
    18. Ray, Evan L. & Brooks, Logan C. & Bien, Jacob & Biggerstaff, Matthew & Bosse, Nikos I. & Bracher, Johannes & Cramer, Estee Y. & Funk, Sebastian & Gerding, Aaron & Johansson, Michael A. & Rumack, Aaron, 2023. "Comparing trained and untrained probabilistic ensemble forecasts of COVID-19 cases and deaths in the United States," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1366-1383.
    19. László Martinek, 2019. "Analysis of Stochastic Reserving Models By Means of NAIC Claims Data," Risks, MDPI, vol. 7(2), pages 1-27, June.
    20. repec:cam:camjip:2402 is not listed on IDEAS
    21. Onno Kleen, 2024. "Scaling and measurement error sensitivity of scoring rules for distribution forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(5), pages 833-849, August.
    22. Mueller, H. & Rauh, C. & Seimon, B., 2024. "Introducing a Global Dataset on Conflict Forecasts and News Topics," Cambridge Working Papers in Economics 2404, Faculty of Economics, University of Cambridge.

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:joupea:v:62:y:2025:i:6:p:2070-2087. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: http://www.prio.no/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.