IDEAS home Printed from https://ideas.repec.org/a/eee/proeco/v240y2021ics0925527321002139.html
   My bibliography  Save this article

Product sales probabilistic forecasting: An empirical evaluation using the M5 competition data

Author

Listed:
  • Spiliotis, Evangelos
  • Makridakis, Spyros
  • Kaltsounis, Anastasios
  • Assimakopoulos, Vassilios

Abstract

Supply chain management depends heavily on uncertain point forecasts of product sales. In order to deal with such uncertainty and optimize safety stock levels, methods that can estimate the right part of the sales distribution are required. Given the limited work that has been done in the field of probabilistic product sales forecasting, we propose and test some novel methods to estimate uncertainty, utilizing empirical computations and simulations to determine quantiles. To do so, we use the M5 competition data to empirically evaluate the forecasting and inventory performance of these methods by making comparisons both with established statistical approaches and advanced machine learning methods. Our results indicate that different methods should be employed based on the quantile of interest and the characteristics of the series being forecast, concluding that methods that employ relatively simple and faster to compute empirical estimations result in better inventory performance than more sophisticated and computer intensive approaches.

Suggested Citation

  • Spiliotis, Evangelos & Makridakis, Spyros & Kaltsounis, Anastasios & Assimakopoulos, Vassilios, 2021. "Product sales probabilistic forecasting: An empirical evaluation using the M5 competition data," International Journal of Production Economics, Elsevier, vol. 240(C).
  • Handle: RePEc:eee:proeco:v:240:y:2021:i:c:s0925527321002139
    DOI: 10.1016/j.ijpe.2021.108237
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0925527321002139
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijpe.2021.108237?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fildes, Robert & Ma, Shaohui & Kolassa, Stephan, 2019. "Retail forecasting: research and practice," MPRA Paper 89356, University Library of Munich, Germany.
    2. Spiliotis, Evangelos & Assimakopoulos, Vassilios & Nikolopoulos, Konstantinos, 2019. "Forecasting with a hybrid method utilizing data smoothing, a variation of the Theta method and shrinkage of seasonal factors," International Journal of Production Economics, Elsevier, vol. 209(C), pages 92-102.
    3. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    4. Smyl, Slawek, 2020. "A hybrid method of exponential smoothing and recurrent neural networks for time series forecasting," International Journal of Forecasting, Elsevier, vol. 36(1), pages 75-85.
    5. Gianluca Bontempi & Souhaib Ben Taieb & Yann-Aël Le Borgne, 2013. "Machine learning strategies for time series forecasting," ULB Institutional Repository 2013/167761, ULB -- Universite Libre de Bruxelles.
    6. Petropoulos, Fotios & Kourentzes, Nikolaos & Nikolopoulos, Konstantinos, 2016. "Another look at estimators for intermittent demand," International Journal of Production Economics, Elsevier, vol. 181(PA), pages 154-161.
    7. A V Kostenko & R J Hyndman, 2006. "A note on the categorization of demand patterns," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(10), pages 1256-1257, October.
    8. Rego, José Roberto do & Mesquita, Marco Aurélio de, 2015. "Demand forecasting and inventory control: A simulation study on automotive spare parts," International Journal of Production Economics, Elsevier, vol. 161(C), pages 1-16.
    9. Salinas, David & Flunkert, Valentin & Gasthaus, Jan & Januschowski, Tim, 2020. "DeepAR: Probabilistic forecasting with autoregressive recurrent networks," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1181-1191.
    10. Syntetos, Aris A. & Boylan, John E., 2005. "The accuracy of intermittent demand estimates," International Journal of Forecasting, Elsevier, vol. 21(2), pages 303-314.
    11. Spyros Makridakis & Evangelos Spiliotis & Vassilios Assimakopoulos, 2018. "Statistical and Machine Learning forecasting methods: Concerns and ways forward," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-26, March.
    12. Hyndman, Rob J. & Koehler, Anne B. & Snyder, Ralph D. & Grose, Simone, 2002. "A state space framework for automatic forecasting using exponential smoothing methods," International Journal of Forecasting, Elsevier, vol. 18(3), pages 439-454.
    13. Kourentzes, Nikolaos & Trapero, Juan R. & Barrow, Devon K., 2020. "Optimising forecasting models for inventory planning," International Journal of Production Economics, Elsevier, vol. 225(C).
    14. Tashman, Leonard J., 2000. "Out-of-sample tests of forecasting accuracy: an analysis and review," International Journal of Forecasting, Elsevier, vol. 16(4), pages 437-450.
    15. Friedman, Jerome H., 2002. "Stochastic gradient boosting," Computational Statistics & Data Analysis, Elsevier, vol. 38(4), pages 367-378, February.
    16. Roger Koenker & Kevin F. Hallock, 2001. "Quantile Regression," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 143-156, Fall.
    17. Trapero, Juan R. & Cardós, Manuel & Kourentzes, Nikolaos, 2019. "Quantile forecast optimal combination to enhance safety stock estimation," International Journal of Forecasting, Elsevier, vol. 35(1), pages 239-250.
    18. Spiliotis, Evangelos & Kouloumos, Andreas & Assimakopoulos, Vassilios & Makridakis, Spyros, 2020. "Are forecasting competitions data representative of the reality?," International Journal of Forecasting, Elsevier, vol. 36(1), pages 37-53.
    19. Somnath Mukhopadhyay & Adriano O. Solis & Rafael S. Gutierrez, 2012. "The Accuracy of Non‐traditional versus Traditional Methods of Forecasting Lumpy Demand," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 31(8), pages 721-735, December.
    20. Seaman, Brian, 2018. "Considerations of a retail forecasting practitioner," International Journal of Forecasting, Elsevier, vol. 34(4), pages 822-829.
    21. Teunter, Ruud & Sani, Babangida, 2009. "On the bias of Croston's forecasting method," European Journal of Operational Research, Elsevier, vol. 194(1), pages 177-183, April.
    22. Van der Auweraer, Sarah & Boute, Robert N. & Syntetos, Aris A., 2019. "Forecasting spare part demand with installed base information: A review," International Journal of Forecasting, Elsevier, vol. 35(1), pages 181-196.
    23. Zotteri, Giulio & Kalchschmidt, Matteo & Caniato, Federico, 2005. "The impact of aggregation level on forecasting performance," International Journal of Production Economics, Elsevier, vol. 93(1), pages 479-491, January.
    24. Willemain, Thomas R. & Smart, Charles N. & Schwarz, Henry F., 2004. "A new approach to forecasting intermittent demand for service parts inventories," International Journal of Forecasting, Elsevier, vol. 20(3), pages 375-387.
    25. Teunter, Ruud H. & Syntetos, Aris A. & Zied Babai, M., 2011. "Intermittent demand: Linking forecasting to inventory obsolescence," European Journal of Operational Research, Elsevier, vol. 214(3), pages 606-615, November.
    26. Bahman Rostami‐Tabar & M. Zied Babai & Aris Syntetos & Yves Ducq, 2013. "Demand forecasting by temporal aggregation," Naval Research Logistics (NRL), John Wiley & Sons, vol. 60(6), pages 479-498, September.
    27. Koning, Alex J. & Franses, Philip Hans & Hibon, Michele & Stekler, H.O., 2005. "The M3 competition: Statistical tests of the results," International Journal of Forecasting, Elsevier, vol. 21(3), pages 397-409.
    28. Berling, Peter, 2008. "Holding cost determination: An activity-based cost approach," International Journal of Production Economics, Elsevier, vol. 112(2), pages 829-840, April.
    29. K Nikolopoulos & A A Syntetos & J E Boylan & F Petropoulos & V Assimakopoulos, 2011. "An aggregate–disaggregate intermittent demand approach (ADIDA) to forecasting: an empirical proposition and analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(3), pages 544-554, March.
    30. Trapero, Juan R. & Cardós, Manuel & Kourentzes, Nikolaos, 2019. "Empirical safety stock estimation based on kernel and GARCH models," Omega, Elsevier, vol. 84(C), pages 199-211.
    31. E A Shale & J E Boylan & F R Johnston, 2006. "Forecasting for intermittent demand: the estimation of an unbiased average," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(5), pages 588-592, May.
    32. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios & Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "The M5 uncertainty competition: Results, findings and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1365-1385.
    2. Spiliotis, Evangelos & Petropoulos, Fotios, 2024. "On the update frequency of univariate forecasting models," European Journal of Operational Research, Elsevier, vol. 314(1), pages 111-121.
    3. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "M5 accuracy competition: Results, findings, and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1346-1364.
    4. Romanus, Eduardo E. & Silva, Eugênio & Goldschmidt, Ronaldo R., 2024. "Empirical probabilistic forecasting: An approach solely based on deterministic explanatory variables for the selection of past forecast errors," International Journal of Forecasting, Elsevier, vol. 40(1), pages 184-201.
    5. Udenio, Maximiliano & Vatamidou, Eleni & Fransoo, Jan C., 2023. "Exponential smoothing forecasts: Taming the Bullwhip Effect when demand is seasonal," Other publications TiSEM 8fca6329-83b9-4a49-a2aa-e, Tilburg University, School of Economics and Management.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Evangelos Spiliotis & Spyros Makridakis & Artemios-Anargyros Semenoglou & Vassilios Assimakopoulos, 2022. "Comparison of statistical and machine learning methods for daily SKU demand forecasting," Operational Research, Springer, vol. 22(3), pages 3037-3061, July.
    3. Fotios Petropoulos & Evangelos Spiliotis, 2021. "The Wisdom of the Data: Getting the Most Out of Univariate Time Series Forecasting," Forecasting, MDPI, vol. 3(3), pages 1-20, June.
    4. Wang, Shengjie & Kang, Yanfei & Petropoulos, Fotios, 2024. "Combining probabilistic forecasts of intermittent demand," European Journal of Operational Research, Elsevier, vol. 315(3), pages 1038-1048.
    5. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios & Chen, Zhi & Gaba, Anil & Tsetlin, Ilia & Winkler, Robert L., 2022. "The M5 uncertainty competition: Results, findings and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1365-1385.
    6. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "M5 accuracy competition: Results, findings, and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1346-1364.
    7. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "Predicting/hypothesizing the findings of the M5 competition," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1337-1345.
    8. Pinçe, Çerağ & Turrini, Laura & Meissner, Joern, 2021. "Intermittent demand forecasting for spare parts: A Critical review," Omega, Elsevier, vol. 105(C).
    9. Kang, Yanfei & Spiliotis, Evangelos & Petropoulos, Fotios & Athiniotis, Nikolaos & Li, Feng & Assimakopoulos, Vassilios, 2021. "Déjà vu: A data-centric forecasting approach through time series cross-similarity," Journal of Business Research, Elsevier, vol. 132(C), pages 719-731.
    10. Kourentzes, Nikolaos & Athanasopoulos, George, 2021. "Elucidate structure in intermittent demand series," European Journal of Operational Research, Elsevier, vol. 288(1), pages 141-152.
    11. Wellens, Arnoud P. & Boute, Robert N. & Udenio, Maximiliano, 2024. "Simplifying tree-based methods for retail sales forecasting with explanatory variables," European Journal of Operational Research, Elsevier, vol. 314(2), pages 523-539.
    12. Semenoglou, Artemios-Anargyros & Spiliotis, Evangelos & Makridakis, Spyros & Assimakopoulos, Vassilios, 2021. "Investigating the accuracy of cross-learning time series forecasting methods," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1072-1084.
    13. Spiliotis, Evangelos & Assimakopoulos, Vassilios & Makridakis, Spyros, 2020. "Generalizing the Theta method for automatic forecasting," European Journal of Operational Research, Elsevier, vol. 284(2), pages 550-558.
    14. Fildes, Robert & Ma, Shaohui & Kolassa, Stephan, 2022. "Retail forecasting: Research and practice," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1283-1318.
    15. Jože Martin Rožanec & Blaž Fortuna & Dunja Mladenić, 2022. "Reframing Demand Forecasting: A Two-Fold Approach for Lumpy and Intermittent Demand," Sustainability, MDPI, vol. 14(15), pages 1-21, July.
    16. Li, Chongshou & Lim, Andrew, 2018. "A greedy aggregation–decomposition method for intermittent demand forecasting in fashion retailing," European Journal of Operational Research, Elsevier, vol. 269(3), pages 860-869.
    17. Spiliotis, Evangelos & Petropoulos, Fotios, 2024. "On the update frequency of univariate forecasting models," European Journal of Operational Research, Elsevier, vol. 314(1), pages 111-121.
    18. Zhu, Sha & Dekker, Rommert & van Jaarsveld, Willem & Renjie, Rex Wang & Koning, Alex J., 2017. "An improved method for forecasting spare parts demand using extreme value theory," European Journal of Operational Research, Elsevier, vol. 261(1), pages 169-181.
    19. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    20. Fildes, Robert & Ma, Shaohui & Kolassa, Stephan, 2019. "Retail forecasting: research and practice," MPRA Paper 89356, University Library of Munich, Germany.

    More about this item

    Keywords

    Probabilistic forecasting; Sales forecasting; Time series; Empirical evaluation; M5 competition;
    All these keywords.

    JEL classification:

    • M5 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Personnel Economics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:proeco:v:240:y:2021:i:c:s0925527321002139. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijpe .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.