IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v72y2026i3p2111-2133.html

Angular Combining of Forecasts of Probability Distributions

Author

Listed:
  • James W. Taylor

    (Saïd Business School, University of Oxford, Oxford OX1 1HP, United Kingdom)

  • Xiaochun Meng

    (School of Management, University of Bath, Claverton Down, Bath BA2 7AY, United Kingdom)

Abstract

When multiple forecasts are available for a probability distribution, forecast combining enables a pragmatic synthesis of the information to extract the wisdom of the crowd. The linear opinion pool has been widely used, whereby the combining is applied to the probabilities of the distributional forecasts. However, it has been argued that this will tend to deliver overdispersed distributions, prompting the combination to be applied instead to the quantiles of the distributional forecasts. Results from different applications are mixed, leaving it as an empirical question whether to combine probabilities or quantiles. In this paper, we present an alternative approach. Looking at the distributional forecasts, combining the probabilities can be viewed as vertical combining, with quantile combining seen as horizontal combining. Our proposal is to allow combining to take place on an angle between the extreme cases of vertical and horizontal combining. We term this angular combining. The angle is a parameter that can be optimized using a proper scoring rule. For implementation, we provide a pragmatic numerical approach and a simulation algorithm. Among our theoretical results, we show that, as with vertical and horizontal averaging, angular averaging results in a distribution with mean equal to the average of the means of the distributions that are being combined. We also show that angular averaging produces a distribution with lower variance than vertical averaging, and, under certain assumptions, greater variance than horizontal averaging. We provide empirical results for distributional forecasts of COVID mortality, macroeconomic survey data, and electricity prices.

Suggested Citation

  • James W. Taylor & Xiaochun Meng, 2026. "Angular Combining of Forecasts of Probability Distributions," Management Science, INFORMS, vol. 72(3), pages 2111-2133, March.
  • Handle: RePEc:inm:ormnsc:v:72:y:2026:i:3:p:2111-2133
    DOI: 10.1287/mnsc.2024.05558
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2024.05558
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2024.05558?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Stephen C. Hora & Benjamin R. Fransen & Natasha Hawkins & Irving Susel, 2013. "Median Aggregation of Distribution Functions," Decision Analysis, INFORMS, vol. 10(4), pages 279-291, December.
    2. Stephen C. Hora, 2004. "Probability Judgments for Continuous Quantities: Linear Combinations and Calibration," Management Science, INFORMS, vol. 50(5), pages 597-604, May.
    3. Ray, Evan L. & Brooks, Logan C. & Bien, Jacob & Biggerstaff, Matthew & Bosse, Nikos I. & Bracher, Johannes & Cramer, Estee Y. & Funk, Sebastian & Gerding, Aaron & Johansson, Michael A. & Rumack, Aaron, 2023. "Comparing trained and untrained probabilistic ensemble forecasts of COVID-19 cases and deaths in the United States," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1366-1383.
    4. Taylor, James W., 2021. "Evaluating quantile-bounded and expectile-bounded interval forecasts," International Journal of Forecasting, Elsevier, vol. 37(2), pages 800-811.
    5. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios & Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "The M5 uncertainty competition: Results, findings and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1365-1385.
    6. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    7. Brownlees, Christian & Souza, André B.M., 2021. "Backtesting global Growth-at-Risk," Journal of Monetary Economics, Elsevier, vol. 118(C), pages 312-330.
    8. Taylor, James W. & Taylor, Kathryn S., 2023. "Combining probabilistic forecasts of COVID-19 mortality in the United States," European Journal of Operational Research, Elsevier, vol. 304(1), pages 25-41.
    9. Hall, Stephen G. & Mitchell, James, 2007. "Combining density forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 1-13.
    10. Fabio Busetti, 2017. "Quantile Aggregation of Density Forecasts," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 79(4), pages 495-512, August.
    11. Roger M. Cooke, 2023. "Averaging quantiles, variance shrinkage, and overconfidence," Futures & Foresight Science, John Wiley & Sons, vol. 5(1), March.
    12. Victor Richmond R. Jose & Yael Grushka-Cockayne & Kenneth C. Lichtendahl, 2014. "Trimmed Opinion Pools and the Crowd's Calibration Problem," Management Science, INFORMS, vol. 60(2), pages 463-475, February.
    13. Ruodu Wang & Ričardas Zitikis, 2021. "An Axiomatic Foundation for the Expected Shortfall," Management Science, INFORMS, vol. 67(3), pages 1413-1429, March.
    14. van der Meer, Dennis & Pinson, Pierre & Camal, Simon & Kariniotakis, Georges, 2024. "CRPS-based online learning for nonlinear probabilistic forecast combination," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1449-1466.
    15. Cooke, Roger M. & Marti, Deniz & Mazzuchi, Thomas, 2021. "Expert forecasting with and without uncertainty quantification and weighting: What do the data say?," International Journal of Forecasting, Elsevier, vol. 37(1), pages 378-387.
    16. Victor Richmond R. Jose & Robert L. Winkler, 2009. "Evaluating Quantile Assessments," Operations Research, INFORMS, vol. 57(5), pages 1287-1297, October.
    17. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    18. Kenneth C. Lichtendahl & Yael Grushka-Cockayne & Robert L. Winkler, 2013. "Is It Better to Average Probabilities or Quantiles?," Management Science, INFORMS, vol. 59(7), pages 1594-1611, July.
    19. Ying Han & David V. Budescu, 2022. "Recalibrating probabilistic forecasts to improve their accuracy," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 17(1), pages 91-123, January.
    20. Han, Ying & Budescu, David V., 2022. "Recalibrating probabilistic forecasts to improve their accuracy," Judgment and Decision Making, Cambridge University Press, vol. 17(1), pages 91-123, January.
    21. David Adam, 2020. "Special report: The simulations driving the world’s response to COVID-19," Nature, Nature, vol. 580(7803), pages 316-318, April.
    22. Kapetanios, G. & Mitchell, J. & Price, S. & Fawcett, N., 2015. "Generalised density forecast combinations," Journal of Econometrics, Elsevier, vol. 188(1), pages 150-165.
    23. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    24. Han Ye & James Luedtke & Haipeng Shen, 2019. "Call Center Arrivals: When to Jointly Forecast Multiple Streams?," Production and Operations Management, Production and Operations Management Society, vol. 28(1), pages 27-42, January.
    25. Taylor, James W. & Jeon, Jooyoung, 2018. "Probabilistic forecasting of wave height for offshore wind turbine maintenance," European Journal of Operational Research, Elsevier, vol. 267(3), pages 877-890.
    26. Kathryn S Taylor & James W Taylor, 2022. "Interval forecasts of weekly incident and cumulative COVID-19 mortality in the United States: A comparison of combining methods," PLOS ONE, Public Library of Science, vol. 17(3), pages 1-25, March.
    27. Robert L. Winkler & Yael Grushka-Cockayne & Kenneth C. Lichtendahl Jr. & Victor Richmond R. Jose, 2019. "Probability Forecasts and Their Combination: A Research Perspective," Decision Analysis, INFORMS, vol. 16(4), pages 239-260, December.
    28. Johannes Bracher & Evan L Ray & Tilmann Gneiting & Nicholas G Reich, 2021. "Evaluating epidemic forecasts in an interval format," PLOS Computational Biology, Public Library of Science, vol. 17(2), pages 1-15, February.
    29. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    30. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    31. Clements, Michael P., 2018. "Are macroeconomic density forecasts informative?," International Journal of Forecasting, Elsevier, vol. 34(2), pages 181-198.
    32. James H. Stock & Mark W. Watson, 1998. "A Comparison of Linear and Nonlinear Univariate Models for Forecasting Macroeconomic Time Series," NBER Working Papers 6607, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    3. Taylor, James W. & Taylor, Kathryn S., 2023. "Combining probabilistic forecasts of COVID-19 mortality in the United States," European Journal of Operational Research, Elsevier, vol. 304(1), pages 25-41.
    4. Taylor, James W., 2026. "Probabilistic forecast aggregation with statistical depth," European Journal of Operational Research, Elsevier, vol. 328(2), pages 460-476.
    5. Uniejewski, Bartosz, 2025. "Smoothing quantile regression averaging: A new approach to probabilistic forecasting of electricity prices," Journal of Commodity Markets, Elsevier, vol. 39(C).
    6. Xiaochun Meng & James W. Taylor & Souhaib Ben Taieb & Siran Li, 2025. "Scores for Multivariate Distributions and Level Sets," Operations Research, INFORMS, vol. 73(1), pages 344-362, January.
    7. Knut Are Aastveit & James Mitchell & Francesco Ravazzolo & Herman van Dijk, 2018. "The Evolution of Forecast Density Combinations in Economics," Tinbergen Institute Discussion Papers 18-069/III, Tinbergen Institute.
    8. van der Meer, Dennis & Pinson, Pierre & Camal, Simon & Kariniotakis, Georges, 2024. "CRPS-based online learning for nonlinear probabilistic forecast combination," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1449-1466.
    9. Lipiecki, Arkadiusz & Uniejewski, Bartosz & Weron, Rafał, 2024. "Postprocessing of point predictions for probabilistic forecasting of day-ahead electricity prices: The benefits of using isotonic distributional regression," Energy Economics, Elsevier, vol. 139(C).
    10. Wang, Shengjie & Kang, Yanfei & Petropoulos, Fotios, 2024. "Combining probabilistic forecasts of intermittent demand," European Journal of Operational Research, Elsevier, vol. 315(3), pages 1038-1048.
    11. Weronika Nitka & Rafał Weron, 2023. "Combining predictive distributions of electricity prices. Does minimizing the CRPS lead to optimal decisions in day-ahead bidding?," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 33(3), pages 105-118.
    12. Borgonovo, Emanuele & Jose, Victor Richmond R. & Knowlton, Morgan & Shachter, Ross & Siebert, Johannes Ulrich & Ulu, Canan, 2026. "Fifty years of decision analysis in operational research: A review," European Journal of Operational Research, Elsevier, vol. 329(2), pages 355-377.
    13. Anil Gaba & Ilia Tsetlin & Robert L. Winkler, 2017. "Combining Interval Forecasts," Decision Analysis, INFORMS, vol. 14(1), pages 1-20, March.
    14. Ray, Evan L. & Brooks, Logan C. & Bien, Jacob & Biggerstaff, Matthew & Bosse, Nikos I. & Bracher, Johannes & Cramer, Estee Y. & Funk, Sebastian & Gerding, Aaron & Johansson, Michael A. & Rumack, Aaron, 2023. "Comparing trained and untrained probabilistic ensemble forecasts of COVID-19 cases and deaths in the United States," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1366-1383.
    15. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    16. Stephen Haben & Julien Caudron & Jake Verma, 2021. "Probabilistic Day-Ahead Wholesale Price Forecast: A Case Study in Great Britain," Forecasting, MDPI, vol. 3(3), pages 1-37, August.
    17. Xiaojia Guo & Kenneth C. Lichtendahl & Yael Grushka-Cockayne, 2025. "Bayesian Ensembles of Exponentially Smoothed Life-Cycle Forecasts," Manufacturing & Service Operations Management, INFORMS, vol. 27(1), pages 230-248, January.
    18. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    19. Tomasz Serafin & Bartosz Uniejewski & Rafał Weron, 2019. "Averaging Predictive Distributions Across Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 12(13), pages 1-12, July.
    20. Malte Knüppel & Fabian Krüger, 2022. "Forecast uncertainty, disagreement, and the linear pool," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(1), pages 23-41, January.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:72:y:2026:i:3:p:2111-2133. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.