IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v38y2022i4p1519-1525.html
   My bibliography  Save this article

Fathoming empirical forecasting competitions’ winners

Author

Listed:
  • Alroomi, Azzam
  • Karamatzanis, Georgios
  • Nikolopoulos, Konstantinos
  • Tilba, Anna
  • Xiao, Shujun

Abstract

The M5 forecasting competition has provided strong empirical evidence that machine learning methods can outperform statistical methods: in essence, complex methods can be more accurate than simple ones. Regardless, this result challenges the flagship empirical result that led the forecasting discipline for the last four decades: keep methods sophisticatedly simple. Nevertheless, this was a first, and we can argue that this will not happen again. There has been a different winner in each forecasting competition. This inevitably raises the question: can a method win more than once (and should it be expected to)? Furthermore, we argue for the need to elaborate on the perks of competing methods, and what makes them winners?

Suggested Citation

  • Alroomi, Azzam & Karamatzanis, Georgios & Nikolopoulos, Konstantinos & Tilba, Anna & Xiao, Shujun, 2022. "Fathoming empirical forecasting competitions’ winners," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1519-1525.
    • Handle: RePEc:eee:intfor:v:38:y:2022:i:4:p:1519-1525
    DOI: 10.1016/j.ijforecast.2022.03.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207022000504
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ijforecast.2022.03.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Sonali K. Shah & Kevin G. Corley, 2006. "Building Better Theory by Bridging the Quantitative–Qualitative Divide," Journal of Management Studies, Wiley Blackwell, vol. 43(8), pages 1821-1835, December.
    3. Green, Kesten C. & Armstrong, J. Scott, 2015. "Simple versus complex forecasting: The evidence," Journal of Business Research, Elsevier, vol. 68(8), pages 1678-1685.
    4. Hudson, Laurel Anderson & Ozanne, Julie L, 1988. "Alternative Ways of Seeking Knowledge in Consumer Research," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 14(4), pages 508-521, March.
    5. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    2. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    3. Kang, Yanfei & Cao, Wei & Petropoulos, Fotios & Li, Feng, 2022. "Forecast with forecasts: Diversity matters," European Journal of Operational Research, Elsevier, vol. 301(1), pages 180-190.
    4. Wang, Xiaoqian & Kang, Yanfei & Hyndman, Rob J. & Li, Feng, 2023. "Distributed ARIMA models for ultra-long time series," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1163-1184.
    5. Katsikopoulos, Konstantinos V. & Şimşek, Özgür & Buckmann, Marcus & Gigerenzer, Gerd, 2022. "Transparent modeling of influenza incidence: Big data or a single data point from psychological theory?," International Journal of Forecasting, Elsevier, vol. 38(2), pages 613-619.
    6. Kwas, Marek & Paccagnini, Alessia & Rubaszek, Michał, 2022. "Common factors and the dynamics of cereal prices. A forecasting perspective," Journal of Commodity Markets, Elsevier, vol. 28(C).
    7. Grossmann, Igor & Rotella, Amanda A. & Hutcherson, Cendri & Sharpinskyi, Konstantyn & Varnum, Michael E. W. & Achter, Sebastian K. & Dhami, Mandeep & Guo, Xinqi Evie & Kara-Yakoubian, Mane R. & Mandel, 2023. "Insights into the accuracy of social scientists' forecasts of societal change," Other publications TiSEM c14f4a4a-b105-46b3-90f7-f, Tilburg University, School of Economics and Management.
    8. Büttner, Daniel & Scheidler, Anne Antonia & Rabe, Markus, 2021. "A reference model for data-driven sales planning: Development of the model's framework and functionality," Chapters from the Proceedings of the Hamburg International Conference of Logistics (HICL), in: Kersten, Wolfgang & Ringle, Christian M. & Blecker, Thorsten (ed.), Adapting to the Future: How Digitalization Shapes Sustainable Logistics and Resilient Supply Chain Management. Proceedings of the Hamburg Internationa, volume 31, pages 441-476, Hamburg University of Technology (TUHH), Institute of Business Logistics and General Management.
    9. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    10. Nghia Chu & Binh Dao & Nga Pham & Huy Nguyen & Hien Tran, 2022. "Predicting Mutual Funds' Performance using Deep Learning and Ensemble Techniques," Papers 2209.09649, arXiv.org, revised Jul 2023.
    11. Qi, Lingzhi & Li, Xixi & Wang, Qiang & Jia, Suling, 2023. "fETSmcs: Feature-based ETS model component selection," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1303-1317.
    12. Ulrich Gunter & Irem Önder & Egon Smeral, 2020. "Are Combined Tourism Forecasts Better at Minimizing Forecasting Errors?," Forecasting, MDPI, vol. 2(3), pages 1-19, June.
    13. Elalem, Yara Kayyali & Maier, Sebastian & Seifert, Ralf W., 2023. "A machine learning-based framework for forecasting sales of new products with short life cycles using deep neural networks," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1874-1894.
    14. Armstrong, J. Scott & Green, Kesten C. & Graefe, Andreas, 2015. "Golden rule of forecasting: Be conservative," Journal of Business Research, Elsevier, vol. 68(8), pages 1717-1731.
    15. Kazadi, Kande & Lievens, Annouk & Mahr, Dominik, 2016. "Stakeholder co-creation during the innovation process: Identifying capabilities for knowledge creation among multiple stakeholders," Journal of Business Research, Elsevier, vol. 69(2), pages 525-540.
    16. H. Mahesh Prabhu & Amit Kumar Srivastava, 2023. "CEO Transformational Leadership, Supply Chain Agility and Firm Performance: A TISM Modeling among SMEs," Global Journal of Flexible Systems Management, Springer;Global Institute of Flexible Systems Management, vol. 24(1), pages 51-65, March.
    17. Litsiou, Konstantia & Polychronakis, Yiannis & Karami, Azhdar & Nikolopoulos, Konstantinos, 2022. "Relative performance of judgmental methods for forecasting the success of megaprojects," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1185-1196.
    18. Spiliotis, Evangelos & Makridakis, Spyros & Kaltsounis, Anastasios & Assimakopoulos, Vassilios, 2021. "Product sales probabilistic forecasting: An empirical evaluation using the M5 competition data," International Journal of Production Economics, Elsevier, vol. 240(C).
    19. Wesley Marcos Almeida & Claudimar Pereira Veiga, 2023. "Does demand forecasting matter to retailing?," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(2), pages 219-232, June.
    20. Bala Mulloth & Andreas Antonopoulos, 2014. "Developing Central And Eastern Europe As A Hub For Global Entrepreneurship: Budapest and Prague As Cases In Point (Rozwoj Europy Srodkowo-Wschodniej jako centrum globalnej przedsiebiorczosci - przykla," Research Reports, University of Warsaw, Faculty of Management, vol. 1(17), pages 7-18.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:38:y:2022:i:4:p:1519-1525. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.