IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v42y2026i1p112-125.html

Kairosis: A method for dynamical probability forecast aggregation informed by Bayesian change-point detection

Author

Listed:
  • Hassoun, Zane
  • MacKay, Niall
  • Powell, Ben

Abstract

We present a new method, ‘kairosis’, for aggregating probability forecasts made over a time period of a single outcome determined at the end of that period. Informed by work on Bayesian change-point detection, we begin by constructing for each time during the period a posterior probability that the forecasts before and after this time are distributed differently. The resulting posterior probability mass function is integrated to give a cumulative mass function, which is used to create a weighted median forecast. The effect is to construct an aggregate in which the most heavily weighted forecasts are those which have been made since the probable most recent change in the forecasts’ distribution. Kairosis outperforms standard methods, and is especially suitable for geopolitical forecasting tournaments because it is observed to be robust across disparate questions and forecaster distributions.

Suggested Citation

  • Hassoun, Zane & MacKay, Niall & Powell, Ben, 2026. "Kairosis: A method for dynamical probability forecast aggregation informed by Bayesian change-point detection," International Journal of Forecasting, Elsevier, vol. 42(1), pages 112-125.
    • Handle: RePEc:eee:intfor:v:42:y:2026:i:1:p:112-125
    DOI: 10.1016/j.ijforecast.2025.03.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207025000299
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijforecast.2025.03.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. David V. Budescu & Eva Chen, 2015. "Identifying Expertise to Extract the Wisdom of Crowds," Management Science, INFORMS, vol. 61(2), pages 267-280, February.
    2. Himmelstein, Mark & Atanasov, Pavel & Budescu, David V., 2021. "Forecasting forecaster accuracy: Contributions of past performance and individual differences," Judgment and Decision Making, Cambridge University Press, vol. 16(2), pages 323-362, March.
    3. Jonathan Baron & Barbara A. Mellers & Philip E. Tetlock & Eric Stone & Lyle H. Ungar, 2014. "Two Reasons to Make Aggregated Probability Forecasts More Extreme," Decision Analysis, INFORMS, vol. 11(2), pages 133-145, June.
    4. Roopesh Ranjan & Tilmann Gneiting, 2010. "Combining probability forecasts," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(1), pages 71-91, January.
    5. Pavel Atanasov & Phillip Rescober & Eric Stone & Samuel A. Swift & Emile Servan-Schreiber & Philip Tetlock & Lyle Ungar & Barbara Mellers, 2017. "Distilling the Wisdom of Crowds: Prediction Markets vs. Prediction Polls," Management Science, INFORMS, vol. 63(3), pages 691-706, March.
    6. Keppo, Jussi & Satopää, Ville A., 2024. "Bayesian herd detection for dynamic data," International Journal of Forecasting, Elsevier, vol. 40(1), pages 285-301.
    7. Robert L. Winkler & Yael Grushka-Cockayne & Kenneth C. Lichtendahl Jr. & Victor Richmond R. Jose, 2019. "Probability Forecasts and Their Combination: A Research Perspective," Decision Analysis, INFORMS, vol. 16(4), pages 239-260, December.
    8. Gregory J. Wawro & Ira Katznelson, 2014. "Designing Historical Social Scientific Inquiry: How Parameter Heterogeneity Can Bridge the Methodological Divide between Quantitative and Qualitative Approaches," American Journal of Political Science, John Wiley & Sons, vol. 58(2), pages 526-546, April.
    9. Clements, Michael P. & Harvey, David I., 2011. "Combining probability forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 208-223, April.
    10. Schuler, Benedikt Alexander & Murmann, Johann Peter & Beisemann, Marie & Satopää, Ville, 2025. "Individual foresight: Concept, operationalization, and correlates," International Journal of Forecasting, Elsevier, vol. 41(4), pages 1521-1538.
    11. Satopää, Ville A. & Baron, Jonathan & Foster, Dean P. & Mellers, Barbara A. & Tetlock, Philip E. & Ungar, Lyle H., 2014. "Combining multiple probability predictions using a simple logit model," International Journal of Forecasting, Elsevier, vol. 30(2), pages 344-356.
    12. Eva Regnier, 2018. "Probability Forecasts Made at Multiple Lead Times," Management Science, INFORMS, vol. 64(5), pages 2407-2426, May.
    13. Mark Himmelstein & David V. Budescu & Ying Han, 2023. "The Wisdom of Timely Crowds," International Series in Operations Research & Management Science, in: Matthias Seifert (ed.), Judgment in Predictive Analytics, chapter 0, pages 215-242, Springer.
    14. Ned Augenblick & Matthew Rabin, 2021. "Belief Movement, Uncertainty Reduction, and Rational Updating," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 136(2), pages 933-985.
    15. Mark Himmelstein & Pavel Atanasov & David V. Budescu, 2021. "Forecasting forecaster accuracy: Contributions of past performance and individual differences," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 16(2), pages 323-362, March.
    16. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    17. Asa B. Palley & Jack B. Soll, 2019. "Extracting the Wisdom of Crowds When Information Is Shared," Management Science, INFORMS, vol. 67(5), pages 2291-2309, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Schuler, Benedikt Alexander & Murmann, Johann Peter & Beisemann, Marie & Satopää, Ville, 2025. "Individual foresight: Concept, operationalization, and correlates," International Journal of Forecasting, Elsevier, vol. 41(4), pages 1521-1538.
    2. Peker, Cem & Wilkening, Tom, 2025. "Robust recalibration of aggregate probability forecasts using meta-beliefs," International Journal of Forecasting, Elsevier, vol. 41(2), pages 613-630.
    3. Satopää, Ville A. & Salikhov, Marat & Tetlock, Philip E. & Mellers, Barbara, 2023. "Decomposing the effects of crowd-wisdom aggregators: The bias–information–noise (BIN) model," International Journal of Forecasting, Elsevier, vol. 39(1), pages 470-485.
    4. Borgonovo, Emanuele & Jose, Victor Richmond R. & Knowlton, Morgan & Shachter, Ross & Siebert, Johannes Ulrich & Ulu, Canan, 2026. "Fifty years of decision analysis in operational research: A review," European Journal of Operational Research, Elsevier, vol. 329(2), pages 355-377.
    5. Satopää, Ville A., 2021. "Improving the wisdom of crowds with analysis of variance of predictions of related outcomes," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1728-1747.
    6. Robert L. Winkler & Yael Grushka-Cockayne & Kenneth C. Lichtendahl Jr. & Victor Richmond R. Jose, 2019. "Probability Forecasts and Their Combination: A Research Perspective," Decision Analysis, INFORMS, vol. 16(4), pages 239-260, December.
    7. Siddarth Srinivasan & Ezra Karger & Michiel Bakker & Yiling Chen, 2025. "Tell Me Why: Incentivizing Explanations," Papers 2502.13410, arXiv.org.
    8. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    9. Cem Peker, 2023. "Extracting the collective wisdom in probabilistic judgments," Theory and Decision, Springer, vol. 94(3), pages 467-501, April.
    10. Ho, Emily H. & Budescu, David V. & Himmelstein, Mark, 2025. "Measuring probabilistic coherence to identify superior forecasters," International Journal of Forecasting, Elsevier, vol. 41(2), pages 596-612.
    11. Taylor, James W. & Taylor, Kathryn S., 2023. "Combining probabilistic forecasts of COVID-19 mortality in the United States," European Journal of Operational Research, Elsevier, vol. 304(1), pages 25-41.
    12. Atanasov, Pavel & Witkowski, Jens & Mellers, Barbara & Tetlock, Philip, 2025. "Crowd prediction systems: Markets, polls, and elite forecasters," International Journal of Forecasting, Elsevier, vol. 41(2), pages 580-595.
    13. Jens Witkowski & Rupert Freeman & Jennifer Wortman Vaughan & David M. Pennock & Andreas Krause, 2023. "Incentive-Compatible Forecasting Competitions," Management Science, INFORMS, vol. 69(3), pages 1354-1374, March.
    14. Patrick Afflerbach & Christopher Dun & Henner Gimpel & Dominik Parak & Johannes Seyfried, 2021. "A Simulation-Based Approach to Understanding the Wisdom of Crowds Phenomenon in Aggregating Expert Judgment," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 63(4), pages 329-348, August.
    15. Ville A. Satopää & Robin Pemantle & Lyle H. Ungar, 2016. "Modeling Probability Forecasts via Information Diversity," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(516), pages 1623-1633, October.
    16. Yang, Dazhi & van der Meer, Dennis, 2021. "Post-processing in solar forecasting: Ten overarching thinking tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 140(C).
    17. Marcellin Martinie & Tom Wilkening & Piers D L Howe, 2020. "Using meta-predictions to identify experts in the crowd when past performance is unknown," PLOS ONE, Public Library of Science, vol. 15(4), pages 1-11, April.
    18. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    19. Martin, Gael M. & Loaiza-Maya, Rubén & Maneesoonthorn, Worapree & Frazier, David T. & Ramírez-Hassan, Andrés, 2022. "Optimal probabilistic forecasts: When do they work?," International Journal of Forecasting, Elsevier, vol. 38(1), pages 384-406.
    20. Keppo, Jussi & Satopää, Ville A., 2024. "Bayesian herd detection for dynamic data," International Journal of Forecasting, Elsevier, vol. 40(1), pages 285-301.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:42:y:2026:i:1:p:112-125. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.