IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v322y2025i2p414-426.html
   My bibliography  Save this article

Forecast accuracy and inventory performance: Insights on their relationship from the M5 competition data

Author

Listed:
  • Theodorou, Evangelos
  • Spiliotis, Evangelos
  • Assimakopoulos, Vassilios

Abstract

Although it is generally accepted that more accurate forecasts contribute towards better inventory performance, this relationship may often be weak, also depending on the structural characteristics of the products being forecast, the inventory policy considered, and the underlying expenses, among others. To empirically explore the connection between forecast accuracy and key costs associated with inventory control, namely holding, ordering, and lost sales costs, we consider the data set of the M5 competition and conduct detailed simulations using popular methods to generate quantile forecasts. Our results are analyzed for various setups of the order-up-to policy and for series of different demand patterns. We find that forecast accuracy is more relevant when holding cost is similar or larger than that associated with lost sales. Therefore, in applications where the latter cost exceeds the former, the preferable forecasting method may not be the most accurate one, especially for relatively short review periods and lead times, as well as products characterized by intermittency. Based on our results we discuss some practical concerns for decision making.

Suggested Citation

  • Theodorou, Evangelos & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2025. "Forecast accuracy and inventory performance: Insights on their relationship from the M5 competition data," European Journal of Operational Research, Elsevier, vol. 322(2), pages 414-426.
  • Handle: RePEc:eee:ejores:v:322:y:2025:i:2:p:414-426
    DOI: 10.1016/j.ejor.2024.12.033
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221724009755
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2024.12.033?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. A A Syntetos & J E Boylan & J D Croston, 2005. "On the categorization of demand patterns," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(5), pages 495-503, May.
    2. Petropoulos, Fotios & Kourentzes, Nikolaos & Nikolopoulos, Konstantinos, 2016. "Another look at estimators for intermittent demand," International Journal of Production Economics, Elsevier, vol. 181(PA), pages 154-161.
    3. Fotios Petropoulos & Nikolaos Kourentzes, 2015. "Forecast combinations for intermittent demand," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(6), pages 914-924, June.
    4. Hyndman, Rob J. & Koehler, Anne B. & Snyder, Ralph D. & Grose, Simone, 2002. "A state space framework for automatic forecasting using exponential smoothing methods," International Journal of Forecasting, Elsevier, vol. 18(3), pages 439-454.
    5. Prak, Dennis & Teunter, Ruud & Babai, Mohamed Zied & Boylan, John E. & Syntetos, Aris, 2021. "Robust compound Poisson parameter estimation for inventory control," Omega, Elsevier, vol. 104(C).
    6. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    7. Everette S. Gardner, 1990. "Evaluating Forecast Performance in an Inventory Control System," Management Science, INFORMS, vol. 36(4), pages 490-499, April.
    8. Stephan Kolassa, 2023. "Using Simulation to Determine When Forecast Accuracy Matters," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 68, pages 20-24, Q1.
    9. Spiliotis, Evangelos & Petropoulos, Fotios, 2024. "On the update frequency of univariate forecasting models," European Journal of Operational Research, Elsevier, vol. 314(1), pages 111-121.
    10. Diamantis Koutsandreas & Evangelos Spiliotis & Fotios Petropoulos & Vassilios Assimakopoulos, 2022. "On the selection of forecasting accuracy measures," Journal of the Operational Research Society, Taylor & Francis Journals, vol. 73(5), pages 937-954, May.
    11. Syntetos, A.A. & Babai, M.Z. & Davies, J. & Stephenson, D., 2010. "Forecasting and stock control: A study in a wholesaling context," International Journal of Production Economics, Elsevier, vol. 127(1), pages 103-111, September.
    12. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207.
    13. John Boylan & Aris Syntetos, 2023. "Why Does Forecast Accuracy Matter?," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 68, pages 36-39, Q1.
    14. K Nikolopoulos & A A Syntetos & J E Boylan & F Petropoulos & V Assimakopoulos, 2011. "An aggregate–disaggregate intermittent demand approach (ADIDA) to forecasting: an empirical proposition and analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(3), pages 544-554, March.
    15. Petropoulos, Fotios & Wang, Xun & Disney, Stephen M., 2019. "The inventory performance of forecasting methods: Evidence from the M3 competition data," International Journal of Forecasting, Elsevier, vol. 35(1), pages 251-265.
    16. Barrow, Devon K. & Kourentzes, Nikolaos, 2016. "Distributions of forecasting errors of forecast combinations: Implications for inventory management," International Journal of Production Economics, Elsevier, vol. 177(C), pages 24-33.
    17. Fildes, Robert & Kolassa, Stephan & Ma, Shaohui, 2022. "Post-script—Retail forecasting: Research and practice," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1319-1324.
    18. Kourentzes, Nikolaos, 2013. "Intermittent demand forecasts with neural networks," International Journal of Production Economics, Elsevier, vol. 143(1), pages 198-206.
    19. Huber, Jakob & Müller, Sebastian & Fleischmann, Moritz & Stuckenschmidt, Heiner, 2019. "A data-driven newsvendor problem: From data to decision," European Journal of Operational Research, Elsevier, vol. 278(3), pages 904-915.
    20. Fildes, Robert & Ma, Shaohui & Kolassa, Stephan, 2022. "Retail forecasting: Research and practice," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1283-1318.
    21. Wang, Wenbin & Syntetos, Aris A., 2011. "Spare parts demand: Linking forecasting to equipment maintenance," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 47(6), pages 1194-1209.
    22. Peter Maurice Catt, 2007. "Assessing the Cost of Forecast Error: A Practical Example," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 7, pages 5-10, Summer.
    23. Teunter, Ruud H. & Syntetos, Aris A. & Zied Babai, M., 2011. "Intermittent demand: Linking forecasting to inventory obsolescence," European Journal of Operational Research, Elsevier, vol. 214(3), pages 606-615, November.
    24. Warren Liao, T. & Chang, P.C., 2010. "Impacts of forecast, inventory policy, and lead time on supply chain inventory--A numerical study," International Journal of Production Economics, Elsevier, vol. 128(2), pages 527-537, December.
    25. Teunter, Ruud & Sani, Babangida, 2009. "Calculating order-up-to levels for products with intermittent demand," International Journal of Production Economics, Elsevier, vol. 118(1), pages 82-86, March.
    26. Liao, Yi & Banerjee, Avijit & Yan, Changyuan, 2011. "A distribution-free newsvendor model with balking and lost sales penalty," International Journal of Production Economics, Elsevier, vol. 133(1), pages 224-227, September.
    27. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    28. Zied Babai, M. & Syntetos, Aris A. & Teunter, Ruud, 2010. "On the empirical performance of (T, s, S) heuristics," European Journal of Operational Research, Elsevier, vol. 202(2), pages 466-472, April.
    29. Evangelos Theodorou & Evangelos Spilioti, 2023. "Better Forecasts or More Appropriate Stock Control Policies?," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 68, pages 40-44, Q1.
    30. Wellens, Arnoud P. & Boute, Robert N. & Udenio, Maximiliano, 2024. "Simplifying tree-based methods for retail sales forecasting with explanatory variables," European Journal of Operational Research, Elsevier, vol. 314(2), pages 523-539.
    31. Tashman, Leonard J., 2000. "Out-of-sample tests of forecasting accuracy: an analysis and review," International Journal of Forecasting, Elsevier, vol. 16(4), pages 437-450.
    32. Syntetos, A. A. & Boylan, J. E., 2001. "On the bias of intermittent demand estimates," International Journal of Production Economics, Elsevier, vol. 71(1-3), pages 457-466, May.
    33. Kevin H. Shang & Sean X. Zhou, 2010. "Optimal and Heuristic Echelon ( r, nQ, T ) Policies in Serial Inventory Systems with Fixed Costs," Operations Research, INFORMS, vol. 58(2), pages 414-427, April.
    34. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "The M5 competition: Background, organization, and implementation," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1325-1336.
    35. Peter Berling & Kaj Rosling, 2005. "The Effects of Financial Risks on Inventory Policy," Management Science, INFORMS, vol. 51(12), pages 1804-1815, December.
    36. Carbonneau, Real & Laframboise, Kevin & Vahidov, Rustam, 2008. "Application of machine learning techniques for supply chain demand forecasting," European Journal of Operational Research, Elsevier, vol. 184(3), pages 1140-1154, February.
    37. Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207, April.
    38. In, YeonJun & Jung, Jae-Yoon, 2022. "Simple averaging of direct and recursive forecasts via partial pooling using machine learning," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1386-1399.
    39. Syntetos, Aris A. & Zied Babai, M. & Gardner, Everette S., 2015. "Forecasting intermittent inventory demands: simple parametric methods vs. bootstrapping," Journal of Business Research, Elsevier, vol. 68(8), pages 1746-1752.
    40. Spiliotis, Evangelos & Makridakis, Spyros & Kaltsounis, Anastasios & Assimakopoulos, Vassilios, 2021. "Product sales probabilistic forecasting: An empirical evaluation using the M5 competition data," International Journal of Production Economics, Elsevier, vol. 240(C).
    41. Theodorou, Evangelos & Wang, Shengjie & Kang, Yanfei & Spiliotis, Evangelos & Makridakis, Spyros & Assimakopoulos, Vassilios, 2022. "Exploring the representativeness of the M5 competition data," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1500-1506.
    42. Spyros Makridakis & Chris Fry & Fotios Petropoulos & Evangelos Spiliotis, 2022. "The Future of Forecasting Competitions: Design Attributes and Principles," INFORMS Joural on Data Science, INFORMS, vol. 1(1), pages 96-113, April.
    43. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    44. Altay, Nezih & Litteral, Lewis A. & Rudisill, Frank, 2012. "Effects of correlation on intermittent demand forecasting and stock control," International Journal of Production Economics, Elsevier, vol. 135(1), pages 275-283.
    45. Pinçe, Çerağ & Turrini, Laura & Meissner, Joern, 2021. "Intermittent demand forecasting for spare parts: A Critical review," Omega, Elsevier, vol. 105(C).
    46. A V Kostenko & R J Hyndman, 2006. "A note on the categorization of demand patterns," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(10), pages 1256-1257, October.
    47. Kourentzes, Nikolaos, 2014. "On intermittent demand model optimisation and selection," International Journal of Production Economics, Elsevier, vol. 156(C), pages 180-190.
    48. Syntetos, Aris A. & Boylan, John E., 2006. "On the stock control performance of intermittent demand estimators," International Journal of Production Economics, Elsevier, vol. 103(1), pages 36-47, September.
    49. Strijbosch, Leo W.G. & Syntetos, Aris A. & Boylan, John E. & Janssen, Elleke, 2011. "On the interaction between forecasting and stock control: The case of non-stationary demand," International Journal of Production Economics, Elsevier, vol. 133(1), pages 470-480, September.
    50. R H Teunter & L Duncan, 2009. "Forecasting intermittent demand: a comparative study," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(3), pages 321-329, March.
    51. A H C Eaves & B G Kingsman, 2004. "Forecasting for the ordering and stock-holding of spare parts," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(4), pages 431-437, April.
    52. Lagodimos, A.G. & Christou, I.T. & Skouri, K., 2012. "Computing globally optimal (s,S,T) inventory policies," Omega, Elsevier, vol. 40(5), pages 660-671.
    53. Babai, M. Zied & Ali, Mohammad M. & Nikolopoulos, Konstantinos, 2012. "Impact of temporal aggregation on stock control performance of intermittent demand estimators: Empirical analysis," Omega, Elsevier, vol. 40(6), pages 713-721.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Petropoulos, Fotios & Wang, Xun & Disney, Stephen M., 2019. "The inventory performance of forecasting methods: Evidence from the M3 competition data," International Journal of Forecasting, Elsevier, vol. 35(1), pages 251-265.
    3. Pinçe, Çerağ & Turrini, Laura & Meissner, Joern, 2021. "Intermittent demand forecasting for spare parts: A Critical review," Omega, Elsevier, vol. 105(C).
    4. Kourentzes, Nikolaos & Athanasopoulos, George, 2021. "Elucidate structure in intermittent demand series," European Journal of Operational Research, Elsevier, vol. 288(1), pages 141-152.
    5. Wang, Shengjie & Kang, Yanfei & Petropoulos, Fotios, 2024. "Combining probabilistic forecasts of intermittent demand," European Journal of Operational Research, Elsevier, vol. 315(3), pages 1038-1048.
    6. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios & Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "The M5 uncertainty competition: Results, findings and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1365-1385.
    7. Kourentzes, Nikolaos, 2014. "On intermittent demand model optimisation and selection," International Journal of Production Economics, Elsevier, vol. 156(C), pages 180-190.
    8. Hu, Qiwei & Boylan, John E. & Chen, Huijing & Labib, Ashraf, 2018. "OR in spare parts management: A review," European Journal of Operational Research, Elsevier, vol. 266(2), pages 395-414.
    9. Spiliotis, Evangelos & Petropoulos, Fotios, 2024. "On the update frequency of univariate forecasting models," European Journal of Operational Research, Elsevier, vol. 314(1), pages 111-121.
    10. Tian, Xin & Wang, Haoqing & E, Erjiang, 2021. "Forecasting intermittent demand for inventory management by retailers: A new approach," Journal of Retailing and Consumer Services, Elsevier, vol. 62(C).
    11. Kourentzes, Nikolaos & Trapero, Juan R. & Barrow, Devon K., 2020. "Optimising forecasting models for inventory planning," International Journal of Production Economics, Elsevier, vol. 225(C).
    12. Evangelos Spiliotis & Spyros Makridakis & Artemios-Anargyros Semenoglou & Vassilios Assimakopoulos, 2022. "Comparison of statistical and machine learning methods for daily SKU demand forecasting," Operational Research, Springer, vol. 22(3), pages 3037-3061, July.
    13. Li, Chongshou & Lim, Andrew, 2018. "A greedy aggregation–decomposition method for intermittent demand forecasting in fashion retailing," European Journal of Operational Research, Elsevier, vol. 269(3), pages 860-869.
    14. Zhu, Sha & Dekker, Rommert & van Jaarsveld, Willem & Renjie, Rex Wang & Koning, Alex J., 2017. "An improved method for forecasting spare parts demand using extreme value theory," European Journal of Operational Research, Elsevier, vol. 261(1), pages 169-181.
    15. Fotios Petropoulos & Evangelos Spiliotis, 2021. "The Wisdom of the Data: Getting the Most Out of Univariate Time Series Forecasting," Forecasting, MDPI, vol. 3(3), pages 1-20, June.
    16. Kourentzes, Nikolaos, 2013. "Intermittent demand forecasts with neural networks," International Journal of Production Economics, Elsevier, vol. 143(1), pages 198-206.
    17. Pennings, Clint L.P. & van Dalen, Jan & van der Laan, Erwin A., 2017. "Exploiting elapsed time for managing intermittent demand for spare parts," European Journal of Operational Research, Elsevier, vol. 258(3), pages 958-969.
    18. Nikolopoulos, Konstantinos, 2021. "We need to talk about intermittent demand forecasting," European Journal of Operational Research, Elsevier, vol. 291(2), pages 549-559.
    19. Jože Martin Rožanec & Blaž Fortuna & Dunja Mladenić, 2022. "Reframing Demand Forecasting: A Two-Fold Approach for Lumpy and Intermittent Demand," Sustainability, MDPI, vol. 14(15), pages 1-21, July.
    20. Syntetos, Aris A. & Zied Babai, M. & Gardner, Everette S., 2015. "Forecasting intermittent inventory demands: simple parametric methods vs. bootstrapping," Journal of Business Research, Elsevier, vol. 68(8), pages 1746-1752.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:322:y:2025:i:2:p:414-426. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.