IDEAS home Printed from https://ideas.repec.org/a/spr/operea/v22y2022i3d10.1007_s12351-020-00605-2.html
   My bibliography  Save this article

Comparison of statistical and machine learning methods for daily SKU demand forecasting

Author

Listed:
  • Evangelos Spiliotis

    (National Technical University of Athens)

  • Spyros Makridakis

    (University of Nicosia)

  • Artemios-Anargyros Semenoglou

    (National Technical University of Athens
    University of Nicosia)

  • Vassilios Assimakopoulos

    (National Technical University of Athens)

Abstract

Daily SKU demand forecasting is a challenging task as it usually involves predicting irregular series that are characterized by intermittency and erraticness. This is particularly true when forecasting at low cross-sectional levels, such as at a store or warehouse level, or dealing with slow-moving items. Yet, accurate forecasts are necessary for supporting inventory holding and replenishment decisions. This task is typically addressed by utilizing well-established statistical methods, such as the Croston’s method and its variants. More recently, Machine Learning (ML) methods have been proposed as an alternative to statistical ones, but their superiority remains under question. This paper sheds some light in that direction by comparing the forecasting performance of various ML methods, trained both in a series-by-series and a cross-learning fashion, to that of statistical methods using a large set of real daily SKU demand data. Our results indicate that some ML methods do provide better forecasts, both in terms of accuracy and bias. Cross-learning across multiple SKUs has also proven to be beneficial for some of the ML methods.

Suggested Citation

  • Evangelos Spiliotis & Spyros Makridakis & Artemios-Anargyros Semenoglou & Vassilios Assimakopoulos, 2022. "Comparison of statistical and machine learning methods for daily SKU demand forecasting," Operational Research, Springer, vol. 22(3), pages 3037-3061, July.
  • Handle: RePEc:spr:operea:v:22:y:2022:i:3:d:10.1007_s12351-020-00605-2
    DOI: 10.1007/s12351-020-00605-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12351-020-00605-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s12351-020-00605-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Smyl, Slawek, 2020. "A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting," International Journal of Forecasting, Elsevier, vol. 36(1), pages 75-85.
    2. A A Syntetos & J E Boylan & J D Croston, 2005. "On the categorization of demand patterns," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(5), pages 495-503, May.
    3. Fotios Petropoulos & Nikolaos Kourentzes, 2015. "Forecast combinations for intermittent demand," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(6), pages 914-924, June.
    4. Hyndman, Rob J. & Koehler, Anne B. & Snyder, Ralph D. & Grose, Simone, 2002. "A state space framework for automatic forecasting using exponential smoothing methods," International Journal of Forecasting, Elsevier, vol. 18(3), pages 439-454.
    5. F R Johnston & J E Boylan & E A Shale, 2003. "An examination of the size of orders from customers, their characterisation and the implications for inventory control of slow moving items," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(8), pages 833-837, August.
    6. Montero-Manso, Pablo & Athanasopoulos, George & Hyndman, Rob J. & Talagala, Thiyanga S., 2020. "FFORMA: Feature-based forecast model averaging," International Journal of Forecasting, Elsevier, vol. 36(1), pages 86-92.
    7. Seaman, Brian, 2018. "Considerations of a retail forecasting practitioner," International Journal of Forecasting, Elsevier, vol. 34(4), pages 822-829.
    8. Ivan Svetunkov & Fotios Petropoulos, 2018. "Old dog, new tricks: a modelling view of simple moving averages," International Journal of Production Research, Taylor & Francis Journals, vol. 56(18), pages 6034-6047, September.
    9. Syntetos, Aris A. & Nikolopoulos, Konstantinos & Boylan, John E., 2010. "Judging the judges through accuracy-implication metrics: The case of inventory forecasting," International Journal of Forecasting, Elsevier, vol. 26(1), pages 134-143, January.
    10. K Nikolopoulos & A A Syntetos & J E Boylan & F Petropoulos & V Assimakopoulos, 2011. "An aggregate–disaggregate intermittent demand approach (ADIDA) to forecasting: an empirical proposition and analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(3), pages 544-554, March.
    11. Bergmeir, Christoph & Benítez, José M., 2012. "Neural Networks in R Using the Stuttgart Neural Network Simulator: RSNNS," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 46(i07).
    12. E A Shale & J E Boylan & F R Johnston, 2006. "Forecasting for intermittent demand: the estimation of an unbiased average," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(5), pages 588-592, May.
    13. Maryam Mohammadipour & John Boylan & Aris Syntetos, 2012. "The Application of Product-Group Seasonal Indexes to Individual Products," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 26, pages 20-26, Summer.
    14. Salinas, David & Flunkert, Valentin & Gasthaus, Jan & Januschowski, Tim, 2020. "DeepAR: Probabilistic forecasting with autoregressive recurrent networks," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1181-1191.
    15. Kourentzes, Nikolaos, 2013. "Intermittent demand forecasts with neural networks," International Journal of Production Economics, Elsevier, vol. 143(1), pages 198-206.
    16. Gutierrez, Rafael S. & Solis, Adriano O. & Mukhopadhyay, Somnath, 2008. "Lumpy demand forecasting using neural networks," International Journal of Production Economics, Elsevier, vol. 111(2), pages 409-420, February.
    17. Syntetos, Aris A. & Boylan, John E., 2005. "The accuracy of intermittent demand estimates," International Journal of Forecasting, Elsevier, vol. 21(2), pages 303-314.
    18. Babai, M.Z. & Dallery, Y. & Boubaker, S. & Kalai, R., 2019. "A new method to forecast intermittent demand in the presence of inventory obsolescence," International Journal of Production Economics, Elsevier, vol. 209(C), pages 30-41.
    19. Friedman, Jerome H., 2002. "Stochastic gradient boosting," Computational Statistics & Data Analysis, Elsevier, vol. 38(4), pages 367-378, February.
    20. Petropoulos, Fotios & Makridakis, Spyros & Assimakopoulos, Vassilios & Nikolopoulos, Konstantinos, 2014. "‘Horses for Courses’ in demand forecasting," European Journal of Operational Research, Elsevier, vol. 237(1), pages 152-163.
    21. Spiliotis, Evangelos & Kouloumos, Andreas & Assimakopoulos, Vassilios & Makridakis, Spyros, 2020. "Are forecasting competitions data representative of the reality?," International Journal of Forecasting, Elsevier, vol. 36(1), pages 37-53.
    22. Somnath Mukhopadhyay & Adriano O. Solis & Rafael S. Gutierrez, 2012. "The Accuracy of Non‐traditional versus Traditional Methods of Forecasting Lumpy Demand," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 31(8), pages 721-735, December.
    23. Davydenko, Andrey & Fildes, Robert, 2013. "Measuring forecasting accuracy: The case of judgmental adjustments to SKU-level demand forecasts," International Journal of Forecasting, Elsevier, vol. 29(3), pages 510-522.
    24. Teunter, Ruud H. & Syntetos, Aris A. & Zied Babai, M., 2011. "Intermittent demand: Linking forecasting to inventory obsolescence," European Journal of Operational Research, Elsevier, vol. 214(3), pages 606-615, November.
    25. Tashman, Leonard J., 2000. "Out-of-sample tests of forecasting accuracy: an analysis and review," International Journal of Forecasting, Elsevier, vol. 16(4), pages 437-450.
    26. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    27. Hasni, M. & Aguir, M.S. & Babai, M.Z. & Jemai, Z., 2019. "On the performance of adjusted bootstrapping methods for intermittent demand forecasting," International Journal of Production Economics, Elsevier, vol. 216(C), pages 145-153.
    28. Willemain, Thomas R. & Smart, Charles N. & Schwarz, Henry F., 2004. "A new approach to forecasting intermittent demand for service parts inventories," International Journal of Forecasting, Elsevier, vol. 20(3), pages 375-387.
    29. Lolli, F. & Gamberini, R. & Regattieri, A. & Balugani, E. & Gatos, T. & Gucci, S., 2017. "Single-hidden layer neural networks for forecasting intermittent demand," International Journal of Production Economics, Elsevier, vol. 183(PA), pages 116-128.
    30. Gardner, Everette Jr., 2006. "Exponential smoothing: The state of the art--Part II," International Journal of Forecasting, Elsevier, vol. 22(4), pages 637-666.
    31. Spyros Makridakis & Evangelos Spiliotis & Vassilios Assimakopoulos, 2018. "Statistical and Machine Learning forecasting methods: Concerns and ways forward," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-26, March.
    32. Boutselis, Petros & McNaught, Ken, 2019. "Using Bayesian Networks to forecast spares demand from equipment failures in a changing service logistics context," International Journal of Production Economics, Elsevier, vol. 209(C), pages 325-333.
    33. Zhang, Guoqiang & Eddy Patuwo, B. & Y. Hu, Michael, 1998. "Forecasting with artificial neural networks:: The state of the art," International Journal of Forecasting, Elsevier, vol. 14(1), pages 35-62, March.
    34. Kourentzes, Nikolaos, 2014. "On intermittent demand model optimisation and selection," International Journal of Production Economics, Elsevier, vol. 156(C), pages 180-190.
    35. Franses, Philip Hans, 2016. "A note on the Mean Absolute Scaled Error," International Journal of Forecasting, Elsevier, vol. 32(1), pages 20-22.
    36. Nikolopoulos, Konstantinos I. & Babai, M. Zied & Bozos, Konstantinos, 2016. "Forecasting supply chain sporadic demand with nearest neighbor approaches," International Journal of Production Economics, Elsevier, vol. 177(C), pages 139-148.
    37. Kolassa, Stephan, 2016. "Evaluating predictive count data distributions in retail sales forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 788-803.
    38. Chen, Huijing & Boylan, John E., 2008. "Empirical evidence on individual, group and shrinkage seasonal indices," International Journal of Forecasting, Elsevier, vol. 24(3), pages 525-534.
    39. J E Boylan & A A Syntetos & G C Karakostas, 2008. "Classification for forecasting and stock control: a case study," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(4), pages 473-481, April.
    40. Teunter, R.H. & Syntetos, A.A. & Babai, M.Z., 2010. "Determining order-up-to levels under periodic review for compound binomial (intermittent) demand," European Journal of Operational Research, Elsevier, vol. 203(3), pages 619-624, June.
    41. R H Teunter & L Duncan, 2009. "Forecasting intermittent demand: a comparative study," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(3), pages 321-329, March.
    42. Alireza Pooya & Morteza Pakdaman & Lotfi Tadj, 2019. "Exact and approximate solution for optimal inventory control of two-stock with reworking and forecasting of demand," Operational Research, Springer, vol. 19(2), pages 333-346, June.
    43. Koning, Alex J. & Franses, Philip Hans & Hibon, Michele & Stekler, H.O., 2005. "The M3 competition: Statistical tests of the results," International Journal of Forecasting, Elsevier, vol. 21(3), pages 397-409.
    44. A H C Eaves & B G Kingsman, 2004. "Forecasting for the ordering and stock-holding of spare parts," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(4), pages 431-437, April.
    45. Fildes, Robert, 1992. "The evaluation of extrapolative forecasting methods," International Journal of Forecasting, Elsevier, vol. 8(1), pages 81-98, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Pinçe, Çerağ & Turrini, Laura & Meissner, Joern, 2021. "Intermittent demand forecasting for spare parts: A Critical review," Omega, Elsevier, vol. 105(C).
    3. Spiliotis, Evangelos & Makridakis, Spyros & Kaltsounis, Anastasios & Assimakopoulos, Vassilios, 2021. "Product sales probabilistic forecasting: An empirical evaluation using the M5 competition data," International Journal of Production Economics, Elsevier, vol. 240(C).
    4. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "M5 accuracy competition: Results, findings, and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1346-1364.
    5. Sarlo, Rodrigo & Fernandes, Cristiano & Borenstein, Denis, 2023. "Lumpy and intermittent retail demand forecasts with score-driven models," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1146-1160.
    6. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "Predicting/hypothesizing the findings of the M5 competition," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1337-1345.
    7. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios & Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "The M5 uncertainty competition: Results, findings and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1365-1385.
    8. Kang, Yanfei & Spiliotis, Evangelos & Petropoulos, Fotios & Athiniotis, Nikolaos & Li, Feng & Assimakopoulos, Vassilios, 2021. "Déjà vu: A data-centric forecasting approach through time series cross-similarity," Journal of Business Research, Elsevier, vol. 132(C), pages 719-731.
    9. Jože Martin Rožanec & Blaž Fortuna & Dunja Mladenić, 2022. "Reframing Demand Forecasting: A Two-Fold Approach for Lumpy and Intermittent Demand," Sustainability, MDPI, vol. 14(15), pages 1-21, July.
    10. Kourentzes, Nikolaos, 2013. "Intermittent demand forecasts with neural networks," International Journal of Production Economics, Elsevier, vol. 143(1), pages 198-206.
    11. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    12. Kourentzes, Nikolaos, 2014. "On intermittent demand model optimisation and selection," International Journal of Production Economics, Elsevier, vol. 156(C), pages 180-190.
    13. Kourentzes, Nikolaos & Athanasopoulos, George, 2021. "Elucidate structure in intermittent demand series," European Journal of Operational Research, Elsevier, vol. 288(1), pages 141-152.
    14. Li, Chongshou & Lim, Andrew, 2018. "A greedy aggregation–decomposition method for intermittent demand forecasting in fashion retailing," European Journal of Operational Research, Elsevier, vol. 269(3), pages 860-869.
    15. Prak, Dennis & Rogetzer, Patricia, 2022. "Timing intermittent demand with time-varying order-up-to levels," European Journal of Operational Research, Elsevier, vol. 303(3), pages 1126-1136.
    16. Hu, Qiwei & Boylan, John E. & Chen, Huijing & Labib, Ashraf, 2018. "OR in spare parts management: A review," European Journal of Operational Research, Elsevier, vol. 266(2), pages 395-414.
    17. Pennings, Clint L.P. & van Dalen, Jan & van der Laan, Erwin A., 2017. "Exploiting elapsed time for managing intermittent demand for spare parts," European Journal of Operational Research, Elsevier, vol. 258(3), pages 958-969.
    18. Petropoulos, Fotios & Wang, Xun & Disney, Stephen M., 2019. "The inventory performance of forecasting methods: Evidence from the M3 competition data," International Journal of Forecasting, Elsevier, vol. 35(1), pages 251-265.
    19. Tian, Xin & Wang, Haoqing & E, Erjiang, 2021. "Forecasting intermittent demand for inventory management by retailers: A new approach," Journal of Retailing and Consumer Services, Elsevier, vol. 62(C).
    20. Syntetos, Aris A. & Zied Babai, M. & Gardner, Everette S., 2015. "Forecasting intermittent inventory demands: simple parametric methods vs. bootstrapping," Journal of Business Research, Elsevier, vol. 68(8), pages 1746-1752.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:operea:v:22:y:2022:i:3:d:10.1007_s12351-020-00605-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.