IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v37y2021i2p547-568.html
   My bibliography  Save this article

Treating and Pruning: New approaches to forecasting model selection and combination using prediction intervals

Author

Listed:
  • Meira, Erick
  • Cyrino Oliveira, Fernando Luiz
  • Jeon, Jooyoung

Abstract

We propose a new way of selecting among model forms in automated exponential smoothing routines, consequently enhancing their predictive power. The procedure, here addressed as treating, operates by selectively subsetting the ensemble of competing models based on information from their prediction intervals. By the same token, we set forth a pruning strategy to improve the accuracy of both point forecasts and prediction intervals in forecast combination methods. The proposed approaches are respectively applied to automated exponential smoothing routines and Bagging algorithms, to demonstrate their potential. An empirical experiment is conducted on a wide range of series from the M-Competitions. The results attest that the proposed approaches are simple, without requiring much additional computational cost, but capable of substantially improving forecasting accuracy for both point forecasts and prediction intervals, outperforming important benchmarks and recently developed forecast combination methods.

Suggested Citation

  • Meira, Erick & Cyrino Oliveira, Fernando Luiz & Jeon, Jooyoung, 2021. "Treating and Pruning: New approaches to forecasting model selection and combination using prediction intervals," International Journal of Forecasting, Elsevier, vol. 37(2), pages 547-568.
  • Handle: RePEc:eee:intfor:v:37:y:2021:i:2:p:547-568
    DOI: 10.1016/j.ijforecast.2020.07.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207020301096
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2020.07.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Peter R. Winters, 1960. "Forecasting Sales by Exponentially Weighted Moving Averages," Management Science, INFORMS, vol. 6(3), pages 324-342, April.
    2. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    3. Inoue, Atsushi & Kilian, Lutz, 2008. "How Useful Is Bagging in Forecasting Economic Time Series? A Case Study of U.S. Consumer Price Inflation," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 511-522, June.
    4. Hyndman, Rob J. & Koehler, Anne B. & Snyder, Ralph D. & Grose, Simone, 2002. "A state space framework for automatic forecasting using exponential smoothing methods," International Journal of Forecasting, Elsevier, vol. 18(3), pages 439-454.
    5. Taylor, James W., 2003. "Exponential smoothing with a damped multiplicative trend," International Journal of Forecasting, Elsevier, vol. 19(4), pages 715-725.
    6. de Menezes, Lilian M. & W. Bunn, Derek & Taylor, James W., 2000. "Review of guidelines for the use of combined forecasts," European Journal of Operational Research, Elsevier, vol. 120(1), pages 190-204, January.
    7. Deepak Gupta & Mahardhika Pratama & Zhenyuan Ma & Jun Li & Mukesh Prasad, 2019. "Financial time series forecasting using twin support vector regression," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-27, March.
    8. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    9. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    10. Bergmeir, Christoph & Hyndman, Rob J. & Benítez, José M., 2016. "Bagging exponential smoothing methods using STL decomposition and Box–Cox transformation," International Journal of Forecasting, Elsevier, vol. 32(2), pages 303-312.
    11. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    12. Lee, Tae-Hwy & Yang, Yang, 2006. "Bagging binary and quantile predictors for time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 465-497.
    13. Kolassa, Stephan, 2011. "Combining exponential smoothing forecasts using Akaike weights," International Journal of Forecasting, Elsevier, vol. 27(2), pages 238-251, April.
    14. Petropoulos, Fotios & Hyndman, Rob J. & Bergmeir, Christoph, 2018. "Exploring the sources of uncertainty: Why does bagging for time series forecasting work?," European Journal of Operational Research, Elsevier, vol. 268(2), pages 545-554.
    15. Kourentzes, Nikolaos & Barrow, Devon & Petropoulos, Fotios, 2019. "Another look at forecast selection and combination: Evidence from forecast pooling," International Journal of Production Economics, Elsevier, vol. 209(C), pages 226-235.
    16. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2018. "The M4 Competition: Results, findings, conclusion and way forward," International Journal of Forecasting, Elsevier, vol. 34(4), pages 802-808.
    17. David F. Hendry & Michael P. Clements, 2004. "Pooling of forecasts," Econometrics Journal, Royal Economic Society, vol. 7(1), pages 1-31, June.
    18. Dantas, Tiago Mendes & Cyrino Oliveira, Fernando Luiz, 2018. "Improving time series forecasting: An approach combining bootstrap aggregation, clusters and exponential smoothing," International Journal of Forecasting, Elsevier, vol. 34(4), pages 748-761.
    19. Inoue, Atsushi & Kilian, Lutz, 2004. "Bagging Time Series Models," CEPR Discussion Papers 4333, C.E.P.R. Discussion Papers.
    20. Aiolfi, Marco & Timmermann, Allan, 2006. "Persistence in forecasting performance and conditional combination strategies," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 31-53.
    21. Dantas, Tiago Mendes & Cyrino Oliveira, Fernando Luiz & Varela Repolho, Hugo Miguel, 2017. "Air transportation demand forecast through Bagging Holt Winters methods," Journal of Air Transport Management, Elsevier, vol. 59(C), pages 116-123.
    22. de Oliveira, Erick Meira & Cyrino Oliveira, Fernando Luiz, 2018. "Forecasting mid-long term electric energy consumption through bagging ARIMA and exponential smoothing methods," Energy, Elsevier, vol. 144(C), pages 776-788.
    23. Koning, Alex J. & Franses, Philip Hans & Hibon, Michele & Stekler, H.O., 2005. "The M3 competition: Statistical tests of the results," International Journal of Forecasting, Elsevier, vol. 21(3), pages 397-409.
    24. Matsypura, Dmytro & Thompson, Ryan & Vasnev, Andrey L., 2018. "Optimal selection of expert forecasts with integer programming," Omega, Elsevier, vol. 78(C), pages 165-175.
    25. Lei Dong & Peng Wang & Fang Yan, 2019. "Damage forecasting based on multi-factor fuzzy time series and cloud model," Journal of Intelligent Manufacturing, Springer, vol. 30(2), pages 521-538, February.
    26. Kolassa, Stephan, 2011. "Combining exponential smoothing forecasts using Akaike weights," International Journal of Forecasting, Elsevier, vol. 27(2), pages 238-251.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sen, Doruk & Tunç, K.M. Murat & Günay, M. Erdem, 2021. "Forecasting electricity consumption of OECD countries: A global machine learning modeling approach," Utilities Policy, Elsevier, vol. 70(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kang, Yanfei & Spiliotis, Evangelos & Petropoulos, Fotios & Athiniotis, Nikolaos & Li, Feng & Assimakopoulos, Vassilios, 2021. "Déjà vu: A data-centric forecasting approach through time series cross-similarity," Journal of Business Research, Elsevier, vol. 132(C), pages 719-731.
    2. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    3. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    4. Kourentzes, Nikolaos & Barrow, Devon & Petropoulos, Fotios, 2019. "Another look at forecast selection and combination: Evidence from forecast pooling," International Journal of Production Economics, Elsevier, vol. 209(C), pages 226-235.
    5. Kourentzes, Nikolaos & Petropoulos, Fotios & Trapero, Juan R., 2014. "Improving forecasting by estimating time series structural components across multiple frequencies," International Journal of Forecasting, Elsevier, vol. 30(2), pages 291-302.
    6. Dantas, Tiago Mendes & Cyrino Oliveira, Fernando Luiz, 2018. "Improving time series forecasting: An approach combining bootstrap aggregation, clusters and exponential smoothing," International Journal of Forecasting, Elsevier, vol. 34(4), pages 748-761.
    7. Spiliotis, Evangelos & Nikolopoulos, Konstantinos & Assimakopoulos, Vassilios, 2019. "Tales from tails: On the empirical distributions of forecasting errors and their implication to risk," International Journal of Forecasting, Elsevier, vol. 35(2), pages 687-698.
    8. Spiliotis, Evangelos & Assimakopoulos, Vassilios & Makridakis, Spyros, 2020. "Generalizing the Theta method for automatic forecasting," European Journal of Operational Research, Elsevier, vol. 284(2), pages 550-558.
    9. Svetunkov, Ivan & Kourentzes, Nikolaos, 2015. "Complex Exponential Smoothing," MPRA Paper 69394, University Library of Munich, Germany.
    10. Petropoulos, Fotios & Hyndman, Rob J. & Bergmeir, Christoph, 2018. "Exploring the sources of uncertainty: Why does bagging for time series forecasting work?," European Journal of Operational Research, Elsevier, vol. 268(2), pages 545-554.
    11. Villegas, Marco A. & Pedregal, Diego J., 2019. "Automatic selection of unobserved components models for supply chain forecasting," International Journal of Forecasting, Elsevier, vol. 35(1), pages 157-169.
    12. Theodosiou, Marina, 2011. "Forecasting monthly and quarterly time series using STL decomposition," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1178-1195, October.
    13. Barrow, Devon K. & Kourentzes, Nikolaos, 2016. "Distributions of forecasting errors of forecast combinations: Implications for inventory management," International Journal of Production Economics, Elsevier, vol. 177(C), pages 24-33.
    14. Fotios Petropoulos & Evangelos Spiliotis, 2021. "The Wisdom of the Data: Getting the Most Out of Univariate Time Series Forecasting," Forecasting, MDPI, Open Access Journal, vol. 3(3), pages 1-20, June.
    15. Hollyman, Ross & Petropoulos, Fotios & Tipping, Michael E., 2021. "Understanding forecast reconciliation," European Journal of Operational Research, Elsevier, vol. 294(1), pages 149-160.
    16. Petropoulos, Fotios & Makridakis, Spyros & Assimakopoulos, Vassilios & Nikolopoulos, Konstantinos, 2014. "‘Horses for Courses’ in demand forecasting," European Journal of Operational Research, Elsevier, vol. 237(1), pages 152-163.
    17. Jaganathan, Srihari & Prakash, P.K.S., 2020. "A combination-based forecasting method for the M4-competition," International Journal of Forecasting, Elsevier, vol. 36(1), pages 98-104.
    18. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    19. Rendon-Sanchez, Juan F. & de Menezes, Lilian M., 2019. "Structural combination of seasonal exponential smoothing forecasts applied to load forecasting," European Journal of Operational Research, Elsevier, vol. 275(3), pages 916-924.
    20. Bergmeir, Christoph & Hyndman, Rob J. & Benítez, José M., 2016. "Bagging exponential smoothing methods using STL decomposition and Box–Cox transformation," International Journal of Forecasting, Elsevier, vol. 32(2), pages 303-312.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:37:y:2021:i:2:p:547-568. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.