Beyond forecast leaderboards: Measuring individual model importance based on contribution to ensemble accuracy
Author
Abstract
Suggested Citation
DOI: 10.1016/j.ijforecast.2025.12.006
Download full text from publisher
As the access to this document is restricted, you may want to
for a different version of it.References listed on IDEAS
- Capistrán, Carlos & Timmermann, Allan, 2009.
"Forecast Combination With Entry and Exit of Experts,"
Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
- Timmermann Allan & Capistrán Carlos, 2006. "Forecast Combination with Entry and Exit of Experts," Working Papers 2006-08, Banco de México.
- Carlos Capistrán & Allan Timmermann, 2008. "Forecast Combination With Entry and Exit of Experts," CREATES Research Papers 2008-55, Department of Economics and Business Economics, Aarhus University.
- Daniel Borup & Philippe Goulet Coulombe & Erik Christian Montes Schütte & David E. Rapach & Sander Schwenk-Nebbe, 2022.
"The Anatomy of Out-of-Sample Forecasting Accuracy,"
FRB Atlanta Working Paper
2022-16, Federal Reserve Bank of Atlanta.
- Daniel Borup & Philippe Goulet Coulombe & Erik Christian Montes Schütte & David E. Rapach & Sander Schwenk-Nebbe, 2024. "The Anatomy of Out-of-Sample Forecasting Accuracy," FRB Atlanta Working Paper 2022-16b, Federal Reserve Bank of Atlanta.
- Roy Batchelor & Pami Dua, 1995. "Forecaster Diversity and the Benefits of Combining Forecasts," Management Science, INFORMS, vol. 41(1), pages 68-75, January.
- Kang, Yanfei & Cao, Wei & Petropoulos, Fotios & Li, Feng, 2022. "Forecast with forecasts: Diversity matters," European Journal of Operational Research, Elsevier, vol. 301(1), pages 180-190.
- Paolo Giudici & Emanuela Raffinetti, 2025. "RGA: a unified measure of predictive accuracy," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 19(1), pages 67-93, March.
- Ray, Evan L. & Brooks, Logan C. & Bien, Jacob & Biggerstaff, Matthew & Bosse, Nikos I. & Bracher, Johannes & Cramer, Estee Y. & Funk, Sebastian & Gerding, Aaron & Johansson, Michael A. & Rumack, Aaron, 2023. "Comparing trained and untrained probabilistic ensemble forecasts of COVID-19 cases and deaths in the United States," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1366-1383.
- Thomson, Mary E. & Pollock, Andrew C. & Önkal, Dilek & Gönül, M. Sinan, 2019. "Combining forecasts: Performance and coherence," International Journal of Forecasting, Elsevier, vol. 35(2), pages 474-484.
- Emily Howerton & Lucie Contamin & Luke C. Mullany & Michelle Qin & Nicholas G. Reich & Samantha Bents & Rebecca K. Borchering & Sung-mok Jung & Sara L. Loo & Claire P. Smith & John Levander & Jessica , 2023. "Evaluation of the US COVID-19 Scenario Modeling Hub for informing pandemic response under uncertainty," Nature Communications, Nature, vol. 14(1), pages 1-15, December.
- Sarabeth M. Mathis & Alexander E. Webber & Tomás M. León & Erin L. Murray & Monica Sun & Lauren A. White & Logan C. Brooks & Alden Green & Addison J. Hu & Roni Rosenfeld & Dmitry Shemetov & Ryan J. Ti, 2024. "Evaluation of FluSight influenza forecasting in the 2021–22 and 2022–23 seasons with a new target laboratory-confirmed influenza hospitalizations," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
- Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
- Timmermann, Allan, 2006.
"Forecast Combinations,"
Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196,
Elsevier.
- Timmermann, Allan, 2005. "Forecast Combinations," CEPR Discussion Papers 5361, Centre for Economic Policy Research.
- Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," CREATES Research Papers 2010-21, Department of Economics and Business Economics, Aarhus University.
- Aiolfi Marco & Capistrán Carlos & Timmermann Allan, 2010. "Forecast Combinations," Working Papers 2010-04, Banco de México.
- P. J. Lamberson & Scott E. Page, 2012. "Optimal Forecasting Groups," Management Science, INFORMS, vol. 58(4), pages 805-810, April.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
- Zhenni Ding & Huayou Chen & Ligang Zhou, 2023. "Using shapely values to define subgroups of forecasts for combining," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(4), pages 905-923, July.
- Tae-Hwy Lee & Ekaterina Seregina, 2020.
"Learning from Forecast Errors: A New Approach to Forecast Combination,"
Working Papers
202024, University of California at Riverside, Department of Economics.
- Tae-Hwy Lee & Ekaterina Seregina, 2020. "Learning from Forecast Errors: A New Approach to Forecast Combinations," Papers 2011.02077, arXiv.org, revised May 2021.
- Athanasopoulos, George & Hyndman, Rob J. & Kourentzes, Nikolaos & Petropoulos, Fotios, 2017.
"Forecasting with temporal hierarchies,"
European Journal of Operational Research, Elsevier, vol. 262(1), pages 60-74.
- George Athanasopoulos & Rob J Hyndman & Nikolaos Kourentzes & Fotios Petropoulos, 2015. "Forecasting with Temporal Hierarchies," Monash Econometrics and Business Statistics Working Papers 16/15, Monash University, Department of Econometrics and Business Statistics.
- Athanasopoulos, George & Hyndman, Rob J. & Kourentzes, Nikolaos & Petropoulos, Fotios, 2015. "Forecasting with Temporal Hierarchies," MPRA Paper 66362, University Library of Munich, Germany.
- Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
- Fernando M. Duarte & Carlo Rosa, 2015.
"The equity risk premium: a review of models,"
Economic Policy Review, Federal Reserve Bank of New York, issue 2, pages 39-57.
- Fernando M. Duarte & Carlo Rosa, 2015. "The equity risk premium: a review of models," Staff Reports 714, Federal Reserve Bank of New York.
- Lahiri, Kajal & Yang, Liu, 2013.
"Forecasting Binary Outcomes,"
Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1025-1106,
Elsevier.
- Kajal Lahiri & Liu Yang, 2012. "Forecasting Binary Outcomes," Discussion Papers 12-09, University at Albany, SUNY, Department of Economics.
- Mauro Costantini & Ulrich Gunter & Robert M. Kunst, 2017.
"Forecast Combinations in a DSGE‐VAR Lab,"
Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(3), pages 305-324, April.
- Costantini, Mauro & Gunter, Ulrich & Kunst, Robert M., 2014. "Forecast combinations in a DSGE-VAR lab," Economics Series 309, Institute for Advanced Studies.
- Li, Li & Kang, Yanfei & Li, Feng, 2023.
"Bayesian forecast combination using time-varying features,"
International Journal of Forecasting, Elsevier, vol. 39(3), pages 1287-1302.
- Li Li & Yanfei Kang & Feng Li, 2021. "Bayesian forecast combination using time-varying features," Papers 2108.02082, arXiv.org, revised Jun 2022.
- Samuels, Jon D. & Sekkel, Rodrigo M., 2017. "Model Confidence Sets and forecast combination," International Journal of Forecasting, Elsevier, vol. 33(1), pages 48-60.
- Yang, Dazhi & van der Meer, Dennis, 2021. "Post-processing in solar forecasting: Ten overarching thinking tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 140(C).
- Wilson, Kevin J., 2017. "An investigation of dependence in expert judgement studies with multiple experts," International Journal of Forecasting, Elsevier, vol. 33(1), pages 325-336.
- Cheng, Gang & Yang, Yuhong, 2015. "Forecast combination with outlier protection," International Journal of Forecasting, Elsevier, vol. 31(2), pages 223-237.
- Ma, Feng & Liu, Jing & Wahab, M.I.M. & Zhang, Yaojie, 2018. "Forecasting the aggregate oil price volatility in a data-rich environment," Economic Modelling, Elsevier, vol. 72(C), pages 320-332.
- Huck, Nicolas, 2009. "Pairs selection and outranking: An application to the S&P 100 index," European Journal of Operational Research, Elsevier, vol. 196(2), pages 819-825, July.
- Lyócsa, Štefan & Todorova, Neda & Výrost, Tomáš, 2021. "Predicting risk in energy markets: Low-frequency data still matter," Applied Energy, Elsevier, vol. 282(PA).
- Bjørnland, Hilde C. & Ravazzolo, Francesco & Thorsrud, Leif Anders, 2017.
"Forecasting GDP with global components: This time is different,"
International Journal of Forecasting, Elsevier, vol. 33(1), pages 153-173.
- Hilde C. Bjørnland & Francesco Ravazzolo & Leif Anders Thorsrud, 2015. "Forecasting GDP with global components. This time is different," Working Paper 2015/05, Norges Bank.
- Hilde C. Bjørnland & Francesco Ravazzolo & Leif Anders Thorsrud, 2015. "Forecasting GDP with global components. This time is different," Working Papers No 1/2015, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
- Hilde C. Bjornland & Francesco Ravazzolo & Leif Anders Thorsrud, 2016. "Forecasting GDP with Global Components. This Time Is Different," CAMA Working Papers 2016-26, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Zhang, Hongwei & Zhao, Xinyi & Gao, Wang & Niu, Zibo, 2023. "The role of higher moments in predicting China's oil futures volatility: Evidence from machine learning models," Journal of Commodity Markets, Elsevier, vol. 32(C).
- Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
- Timmermann, Allan, 2006.
"Forecast Combinations,"
Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196,
Elsevier.
- Timmermann, Allan, 2005. "Forecast Combinations," CEPR Discussion Papers 5361, Centre for Economic Policy Research.
- Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," CREATES Research Papers 2010-21, Department of Economics and Business Economics, Aarhus University.
- Aiolfi Marco & Capistrán Carlos & Timmermann Allan, 2010. "Forecast Combinations," Working Papers 2010-04, Banco de México.
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:42:y:2026:i:3:p:924-936. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.
Printed from https://ideas.repec.org/a/eee/intfor/v42y2026i3p924-936.html