IDEAS home Printed from https://ideas.repec.org/a/gam/jforec/v3y2021i3p29-497d580455.html
   My bibliography  Save this article

The Wisdom of the Data: Getting the Most Out of Univariate Time Series Forecasting

Author

Listed:
  • Fotios Petropoulos

    (School of Management, University of Bath, Bath BA2 7AY, UK)

  • Evangelos Spiliotis

    (Forecasting and Strategy Unit, School of Electrical and Computer Engineering, National Technical University of Athens, 15780 Athens, Greece)

Abstract

Forecasting is a challenging task that typically requires making assumptions about the observed data but also the future conditions. Inevitably, any forecasting process will result in some degree of inaccuracy. The forecasting performance will further deteriorate as the uncertainty increases. In this article, we focus on univariate time series forecasting and we review five approaches that one can use to enhance the performance of standard extrapolation methods. Much has been written about the “wisdom of the crowds” and how collective opinions will outperform individual ones. We present the concept of the “wisdom of the data” and how data manipulation can result in information extraction which, in turn, translates to improved forecast accuracy by aggregating (combining) forecasts computed on different perspectives of the same data. We describe and discuss approaches that are based on the manipulation of local curvatures (theta method), temporal aggregation, bootstrapping, sub-seasonal and incomplete time series. We compare these approaches with regards to how they extract information from the data, their computational cost, and their performance.

Suggested Citation

  • Fotios Petropoulos & Evangelos Spiliotis, 2021. "The Wisdom of the Data: Getting the Most Out of Univariate Time Series Forecasting," Forecasting, MDPI, vol. 3(3), pages 1-20, June.
  • Handle: RePEc:gam:jforec:v:3:y:2021:i:3:p:29-497:d:580455
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2571-9394/3/3/29/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2571-9394/3/3/29/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Spiliotis, Evangelos & Assimakopoulos, Vassilios & Nikolopoulos, Konstantinos, 2019. "Forecasting with a hybrid method utilizing data smoothing, a variation of the Theta method and shrinkage of seasonal factors," International Journal of Production Economics, Elsevier, vol. 209(C), pages 92-102.
    2. Konstantinos Nikolopoulos & Dimitrios Thomakos & Fotios Petropoulos & Vassilis Assimakopoulos, 2009. "Theta Model Forecasts for Financial Time Series: A Case Study in the S&P500," Working Papers 0033, University of Peloponnese, Department of Economics.
    3. Fotios Petropoulos & Nikolaos Kourentzes, 2015. "Forecast combinations for intermittent demand," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(6), pages 914-924, June.
    4. Hyndman, Rob J. & Koehler, Anne B. & Snyder, Ralph D. & Grose, Simone, 2002. "A state space framework for automatic forecasting using exponential smoothing methods," International Journal of Forecasting, Elsevier, vol. 18(3), pages 439-454.
    5. Kourentzes, Nikolaos & Athanasopoulos, George, 2019. "Cross-temporal coherent forecasts for Australian tourism," Annals of Tourism Research, Elsevier, vol. 75(C), pages 393-409.
    6. Dimitrios D. Thomakos & Konstantinos Nikolopoulos, 2015. "Forecasting Multivariate Time Series with the Theta Method," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 34(3), pages 220-229, April.
    7. Jeon, Jooyoung & Panagiotelis, Anastasios & Petropoulos, Fotios, 2019. "Probabilistic forecast reconciliation with applications to wind power and electric load," European Journal of Operational Research, Elsevier, vol. 279(2), pages 364-379.
    8. Athanasopoulos, George & Hyndman, Rob J. & Song, Haiyan & Wu, Doris C., 2011. "The tourism forecasting competition," International Journal of Forecasting, Elsevier, vol. 27(3), pages 822-844, July.
    9. Montero-Manso, Pablo & Athanasopoulos, George & Hyndman, Rob J. & Talagala, Thiyanga S., 2020. "FFORMA: Feature-based forecast model averaging," International Journal of Forecasting, Elsevier, vol. 36(1), pages 86-92.
    10. Seaman, Brian, 2018. "Considerations of a retail forecasting practitioner," International Journal of Forecasting, Elsevier, vol. 34(4), pages 822-829.
    11. Fotios Petropoulos & Konstantinos Nikolopoulos, 2017. "The Theta Method," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 46, pages 11-17, Summer.
    12. Kourentzes, Nikolaos & Petropoulos, Fotios & Trapero, Juan R., 2014. "Improving forecasting by estimating time series structural components across multiple frequencies," International Journal of Forecasting, Elsevier, vol. 30(2), pages 291-302.
    13. Syntetos, Aris A. & Nikolopoulos, Konstantinos & Boylan, John E., 2010. "Judging the judges through accuracy-implication metrics: The case of inventory forecasting," International Journal of Forecasting, Elsevier, vol. 26(1), pages 134-143, January.
    14. K Nikolopoulos & A A Syntetos & J E Boylan & F Petropoulos & V Assimakopoulos, 2011. "An aggregate–disaggregate intermittent demand approach (ADIDA) to forecasting: an empirical proposition and analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(3), pages 544-554, March.
    15. Fildes, Robert & Ma, Shaohui & Kolassa, Stephan, 2019. "Retail forecasting: research and practice," MPRA Paper 89356, University Library of Munich, Germany.
    16. Bergmeir, Christoph & Hyndman, Rob J. & Benítez, José M., 2016. "Bagging exponential smoothing methods using STL decomposition and Box–Cox transformation," International Journal of Forecasting, Elsevier, vol. 32(2), pages 303-312.
    17. Petropoulos, Fotios & Wang, Xun & Disney, Stephen M., 2019. "The inventory performance of forecasting methods: Evidence from the M3 competition data," International Journal of Forecasting, Elsevier, vol. 35(1), pages 251-265.
    18. Athanasopoulos, George & Ahmed, Roman A. & Hyndman, Rob J., 2009. "Hierarchical forecasts for Australian domestic tourism," International Journal of Forecasting, Elsevier, vol. 25(1), pages 146-166.
    19. Athanasopoulos, George & Hyndman, Rob J. & Kourentzes, Nikolaos & Petropoulos, Fotios, 2017. "Forecasting with temporal hierarchies," European Journal of Operational Research, Elsevier, vol. 262(1), pages 60-74.
    20. Syntetos, Aris A. & Boylan, John E., 2005. "The accuracy of intermittent demand estimates," International Journal of Forecasting, Elsevier, vol. 21(2), pages 303-314.
    21. Timothy L. McMurry & Dimitris N. Politis, 2010. "Banded and tapered estimates for autocovariance matrices and the linear process bootstrap," Journal of Time Series Analysis, Wiley Blackwell, vol. 31(6), pages 471-482, November.
    22. Spiliotis, Evangelos & Assimakopoulos, Vassilios & Makridakis, Spyros, 2020. "Generalizing the Theta method for automatic forecasting," European Journal of Operational Research, Elsevier, vol. 284(2), pages 550-558.
    23. Hollyman, Ross & Petropoulos, Fotios & Tipping, Michael E., 2021. "Understanding forecast reconciliation," European Journal of Operational Research, Elsevier, vol. 294(1), pages 149-160.
    24. Spiliotis, Evangelos & Kouloumos, Andreas & Assimakopoulos, Vassilios & Makridakis, Spyros, 2020. "Are forecasting competitions data representative of the reality?," International Journal of Forecasting, Elsevier, vol. 36(1), pages 37-53.
    25. Dantas, Tiago Mendes & Cyrino Oliveira, Fernando Luiz, 2018. "Improving time series forecasting: An approach combining bootstrap aggregation, clusters and exponential smoothing," International Journal of Forecasting, Elsevier, vol. 34(4), pages 748-761.
    26. Nystrup, Peter & Lindström, Erik & Pinson, Pierre & Madsen, Henrik, 2020. "Temporal hierarchies with autocorrelation for load forecasting," European Journal of Operational Research, Elsevier, vol. 280(3), pages 876-888.
    27. Pesaran, M. Hashem & Timmermann, Allan, 2007. "Selection of estimation window in the presence of breaks," Journal of Econometrics, Elsevier, vol. 137(1), pages 134-161, March.
    28. Teunter, Ruud H. & Syntetos, Aris A. & Zied Babai, M., 2011. "Intermittent demand: Linking forecasting to inventory obsolescence," European Journal of Operational Research, Elsevier, vol. 214(3), pages 606-615, November.
    29. Hyndman, Rob J. & Billah, Baki, 2003. "Unmasking the Theta method," International Journal of Forecasting, Elsevier, vol. 19(2), pages 287-290.
    30. Bahman Rostami‐Tabar & M. Zied Babai & Aris Syntetos & Yves Ducq, 2013. "Demand forecasting by temporal aggregation," Naval Research Logistics (NRL), John Wiley & Sons, vol. 60(6), pages 479-498, September.
    31. Kourentzes, Nikolaos & Athanasopoulos, George, 2021. "Elucidate structure in intermittent demand series," European Journal of Operational Research, Elsevier, vol. 288(1), pages 141-152.
    32. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    33. Hyndman, Rob J. & Ahmed, Roman A. & Athanasopoulos, George & Shang, Han Lin, 2011. "Optimal combination forecasts for hierarchical time series," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2579-2589, September.
    34. Evangelos Spiliotis & Fotios Petropoulos & Vassilios Assimakopoulos, 2019. "Improving the forecasting performance of temporal hierarchies," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-21, October.
    35. Meira, Erick & Cyrino Oliveira, Fernando Luiz & Jeon, Jooyoung, 2021. "Treating and Pruning: New approaches to forecasting model selection and combination using prediction intervals," International Journal of Forecasting, Elsevier, vol. 37(2), pages 547-568.
    36. Fiorucci, Jose A. & Pellegrini, Tiago R. & Louzada, Francisco & Petropoulos, Fotios & Koehler, Anne B., 2016. "Models for optimising the theta method and their relationship to state space models," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1151-1161.
    37. Assimakopoulos, V. & Nikolopoulos, K., 2000. "The theta model: a decomposition approach to forecasting," International Journal of Forecasting, Elsevier, vol. 16(4), pages 521-530.
    38. Kourentzes, Nikolaos & Petropoulos, Fotios, 2016. "Forecasting with multivariate temporal aggregation: The case of promotional modelling," International Journal of Production Economics, Elsevier, vol. 181(PA), pages 145-153.
    39. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    40. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    41. Fotios Petropoulos & Nikolaos Kourentzes, 2014. "Improving Forecasting via Multiple Temporal Aggregation," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 34, pages 12-17, Summer.
    42. Petropoulos, Fotios & Hyndman, Rob J. & Bergmeir, Christoph, 2018. "Exploring the sources of uncertainty: Why does bagging for time series forecasting work?," European Journal of Operational Research, Elsevier, vol. 268(2), pages 545-554.
    43. A V Kostenko & R J Hyndman, 2006. "A note on the categorization of demand patterns," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 57(10), pages 1256-1257, October.
    44. Spiliotis, Evangelos & Petropoulos, Fotios & Kourentzes, Nikolaos & Assimakopoulos, Vassilios, 2020. "Cross-temporal aggregation: Improving the forecast accuracy of hierarchical electricity consumption," Applied Energy, Elsevier, vol. 261(C).
    45. Dantas, Tiago Mendes & Cyrino Oliveira, Fernando Luiz & Varela Repolho, Hugo Miguel, 2017. "Air transportation demand forecast through Bagging Holt Winters methods," Journal of Air Transport Management, Elsevier, vol. 59(C), pages 116-123.
    46. de Oliveira, Erick Meira & Cyrino Oliveira, Fernando Luiz, 2018. "Forecasting mid-long term electric energy consumption through bagging ARIMA and exponential smoothing methods," Energy, Elsevier, vol. 144(C), pages 776-788.
    47. McMurry, Timothy L & Politis, D N, 2010. "Banded and Tapered Estimates for Autocovariance Matrices and the Linear Process Bootstrap," University of California at San Diego, Economics Working Paper Series qt5h9259mb, Department of Economics, UC San Diego.
    48. Babai, M. Zied & Ali, Mohammad M. & Nikolopoulos, Konstantinos, 2012. "Impact of temporal aggregation on stock control performance of intermittent demand estimators: Empirical analysis," Omega, Elsevier, vol. 40(6), pages 713-721.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fangze Zhou & Hui Zhou & Zhaoyan Li & Kai Zhao, 2022. "Multi-Step Ahead Short-Term Electricity Load Forecasting Using VMD-TCN and Error Correction Strategy," Energies, MDPI, vol. 15(15), pages 1-18, July.
    2. Min Cao & Jinfeng Wang & Xiaochen Sun & Zhengmou Ren & Haokai Chai & Jie Yan & Ning Li, 2022. "Short-Term and Medium-Term Electricity Sales Forecasting Method Based on Deep Spatio-Temporal Residual Network," Energies, MDPI, vol. 15(23), pages 1-15, November.
    3. Aida Boudhaouia & Patrice Wira, 2021. "A Real-Time Data Analysis Platform for Short-Term Water Consumption Forecasting with Machine Learning," Forecasting, MDPI, vol. 3(4), pages 1-13, September.
    4. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    5. Sonia Leva, 2022. "Editorial for Special Issue: “Feature Papers of Forecasting 2021”," Forecasting, MDPI, vol. 4(1), pages 1-3, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "Predicting/hypothesizing the findings of the M5 competition," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1337-1345.
    3. Kang, Yanfei & Spiliotis, Evangelos & Petropoulos, Fotios & Athiniotis, Nikolaos & Li, Feng & Assimakopoulos, Vassilios, 2021. "Déjà vu: A data-centric forecasting approach through time series cross-similarity," Journal of Business Research, Elsevier, vol. 132(C), pages 719-731.
    4. Spiliotis, Evangelos & Petropoulos, Fotios & Kourentzes, Nikolaos & Assimakopoulos, Vassilios, 2020. "Cross-temporal aggregation: Improving the forecast accuracy of hierarchical electricity consumption," Applied Energy, Elsevier, vol. 261(C).
    5. Kourentzes, Nikolaos & Athanasopoulos, George, 2021. "Elucidate structure in intermittent demand series," European Journal of Operational Research, Elsevier, vol. 288(1), pages 141-152.
    6. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    7. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "M5 accuracy competition: Results, findings, and conclusions," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1346-1364.
    8. Hollyman, Ross & Petropoulos, Fotios & Tipping, Michael E., 2021. "Understanding forecast reconciliation," European Journal of Operational Research, Elsevier, vol. 294(1), pages 149-160.
    9. Spiliotis, Evangelos & Makridakis, Spyros & Kaltsounis, Anastasios & Assimakopoulos, Vassilios, 2021. "Product sales probabilistic forecasting: An empirical evaluation using the M5 competition data," International Journal of Production Economics, Elsevier, vol. 240(C).
    10. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2022. "Forecasting natural gas consumption using Bagging and modified regularization techniques," Energy Economics, Elsevier, vol. 106(C).
    11. Kourentzes, Nikolaos & Saayman, Andrea & Jean-Pierre, Philippe & Provenzano, Davide & Sahli, Mondher & Seetaram, Neelu & Volo, Serena, 2021. "Visitor arrivals forecasts amid COVID-19: A perspective from the Africa team," Annals of Tourism Research, Elsevier, vol. 88(C).
    12. George Athanasopoulos & Rob J Hyndman & Nikolaos Kourentzes & Anastasios Panagiotelis, 2023. "Forecast Reconciliation: A Review," Monash Econometrics and Business Statistics Working Papers 8/23, Monash University, Department of Econometrics and Business Statistics.
    13. Nystrup, Peter & Lindström, Erik & Møller, Jan K. & Madsen, Henrik, 2021. "Dimensionality reduction in forecasting with temporal hierarchies," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1127-1146.
    14. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    15. Sbrana, Giacomo & Silvestrini, Andrea, 2023. "The RWDAR model: A novel state-space approach to forecasting," International Journal of Forecasting, Elsevier, vol. 39(2), pages 922-937.
    16. Spiliotis, Evangelos & Assimakopoulos, Vassilios & Makridakis, Spyros, 2020. "Generalizing the Theta method for automatic forecasting," European Journal of Operational Research, Elsevier, vol. 284(2), pages 550-558.
    17. Petropoulos, Fotios & Makridakis, Spyros & Assimakopoulos, Vassilios & Nikolopoulos, Konstantinos, 2014. "‘Horses for Courses’ in demand forecasting," European Journal of Operational Research, Elsevier, vol. 237(1), pages 152-163.
    18. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    19. Spiliotis, Evangelos & Petropoulos, Fotios & Kourentzes, Nikolaos & Assimakopoulos, Vassilios, 2018. "Cross-temporal aggregation: Improving the forecast accuracy of hierarchical electricity consumption," MPRA Paper 91762, University Library of Munich, Germany.
    20. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2021. "Point and interval forecasting of electricity supply via pruned ensembles," Energy, Elsevier, vol. 232(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jforec:v:3:y:2021:i:3:p:29-497:d:580455. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.