IDEAS home Printed from https://ideas.repec.org/a/eee/eneeco/v106y2022ics0140988321006034.html
   My bibliography  Save this article

Forecasting natural gas consumption using Bagging and modified regularization techniques

Author

Listed:
  • Meira, Erick
  • Cyrino Oliveira, Fernando Luiz
  • de Menezes, Lilian M.

Abstract

This paper develops a new approach to forecast natural gas consumption via ensembles. It combines Bootstrap Aggregation (Bagging), univariate time series forecasting methods and modified regularization routines. A new variant of Bagging is introduced, which uses Maximum Entropy Bootstrap (MEB) and a modified regularization routine that ensures that the data generating process is kept in the ensemble. Monthly natural gas consumption time series from 18 European countries are considered. A comparative, out-of-sample evaluation is conducted up to 12 steps (a year) ahead, using a comprehensive set of competing forecasting approaches. These range from statistical benchmarks to machine learning methods and state-of-the-art ensembles. Several performance (accuracy) metrics are used, and a sensitivity analysis is undertaken. Overall, the new variant of Bagging is flexible, reliable, and outperforms well-established approaches. Consequently, it is suitable to support decision making in the energy and other sectors.

Suggested Citation

  • Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2022. "Forecasting natural gas consumption using Bagging and modified regularization techniques," Energy Economics, Elsevier, vol. 106(C).
  • Handle: RePEc:eee:eneeco:v:106:y:2022:i:c:s0140988321006034
    DOI: 10.1016/j.eneco.2021.105760
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0140988321006034
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.eneco.2021.105760?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Peter R. Winters, 1960. "Forecasting Sales by Exponentially Weighted Moving Averages," Management Science, INFORMS, vol. 6(3), pages 324-342, April.
    2. Kwiatkowski, Denis & Phillips, Peter C. B. & Schmidt, Peter & Shin, Yongcheol, 1992. "Testing the null hypothesis of stationarity against the alternative of a unit root : How sure are we that economic time series have a unit root?," Journal of Econometrics, Elsevier, vol. 54(1-3), pages 159-178.
    3. Hyndman, Rob J. & Koehler, Anne B. & Snyder, Ralph D. & Grose, Simone, 2002. "A state space framework for automatic forecasting using exponential smoothing methods," International Journal of Forecasting, Elsevier, vol. 18(3), pages 439-454.
    4. Bastianin, Andrea & Galeotti, Marzio & Polo, Michele, 2019. "Convergence of European natural gas prices," Energy Economics, Elsevier, vol. 81(C), pages 793-811.
    5. Guo‐Feng Fan & Yan‐Hui Guo & Jia‐Mei Zheng & Wei‐Chiang Hong, 2020. "A generalized regression model based on hybrid empirical mode decomposition and support vector regression with back‐propagation neural network for mid‐short‐term load forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(5), pages 737-756, August.
    6. Vondrácek, Jirí & Pelikán, Emil & Konár, Ondrej & Cermáková, Jana & Eben, Krystof & Malý, Marek & Brabec, Marek, 2008. "A statistical model for the estimation of natural gas consumption," Applied Energy, Elsevier, vol. 85(5), pages 362-370, May.
    7. Adeodato, Paulo J.L. & Arnaud, Adrian L. & Vasconcelos, Germano C. & Cunha, Rodrigo C.L.V. & Monteiro, Domingos S.M.P., 2011. "MLP ensembles improve long term prediction accuracy over single networks," International Journal of Forecasting, Elsevier, vol. 27(3), pages 661-671.
    8. Bergmeir, Christoph & Hyndman, Rob J. & Benítez, José M., 2016. "Bagging exponential smoothing methods using STL decomposition and Box–Cox transformation," International Journal of Forecasting, Elsevier, vol. 32(2), pages 303-312.
    9. Petropoulos, Fotios & Wang, Xun & Disney, Stephen M., 2019. "The inventory performance of forecasting methods: Evidence from the M3 competition data," International Journal of Forecasting, Elsevier, vol. 35(1), pages 251-265.
    10. Theodosiou, Marina, 2011. "Forecasting monthly and quarterly time series using STL decomposition," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1178-1195, October.
    11. Potočnik, Primož & Soldo, Božidar & Šimunović, Goran & Šarić, Tomislav & Jeromen, Andrej & Govekar, Edvard, 2014. "Comparison of static and adaptive models for short-term residential natural gas forecasting in Croatia," Applied Energy, Elsevier, vol. 129(C), pages 94-103.
    12. Wang, Bin & Wang, Jun, 2020. "Energy futures and spots prices forecasting by hybrid SW-GRU with EMD and error evaluation," Energy Economics, Elsevier, vol. 90(C).
    13. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2018. "The M4 Competition: Results, findings, conclusion and way forward," International Journal of Forecasting, Elsevier, vol. 34(4), pages 802-808.
    14. Ahmad M Awajan & Mohd Tahir Ismail & S AL Wadi, 2018. "Improving forecasting accuracy for stock market data using EMD-HW bagging," PLOS ONE, Public Library of Science, vol. 13(7), pages 1-20, July.
    15. Adeodato, Paulo J.L. & Arnaud, Adrian L. & Vasconcelos, Germano C. & Cunha, Rodrigo C.L.V. & Monteiro, Domingos S.M.P., 2011. "MLP ensembles improve long term prediction accuracy over single networks," International Journal of Forecasting, Elsevier, vol. 27(3), pages 661-671, July.
    16. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2021. "Point and interval forecasting of electricity supply via pruned ensembles," Energy, Elsevier, vol. 232(C).
    17. Holt, Charles C., 2004. "Forecasting seasonals and trends by exponentially weighted moving averages," International Journal of Forecasting, Elsevier, vol. 20(1), pages 5-10.
    18. Dantas, Tiago Mendes & Cyrino Oliveira, Fernando Luiz, 2018. "Improving time series forecasting: An approach combining bootstrap aggregation, clusters and exponential smoothing," International Journal of Forecasting, Elsevier, vol. 34(4), pages 748-761.
    19. Paul Goodwin, 2010. "The Holt-Winters Approach to Exponential Smoothing: 50 Years Old and Going Strong," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 19, pages 30-33, Fall.
    20. Azadeh, A. & Asadzadeh, S.M. & Saberi, M. & Nadimi, V. & Tajvidi, A. & Sheikalishahi, M., 2011. "A Neuro-fuzzy-stochastic frontier analysis approach for long-term natural gas consumption forecasting and behavior analysis: The cases of Bahrain, Saudi Arabia, Syria, and UAE," Applied Energy, Elsevier, vol. 88(11), pages 3850-3859.
    21. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    22. Yalta, A. Talha, 2011. "Analyzing energy consumption and GDP nexus using maximum entropy bootstrap: The case of Turkey," Energy Economics, Elsevier, vol. 33(3), pages 453-460, May.
    23. Rendon-Sanchez, Juan F. & de Menezes, Lilian M., 2019. "Structural combination of seasonal exponential smoothing forecasts applied to load forecasting," European Journal of Operational Research, Elsevier, vol. 275(3), pages 916-924.
    24. Evangelos Spiliotis & Fotios Petropoulos & Vassilios Assimakopoulos, 2019. "Improving the forecasting performance of temporal hierarchies," PLOS ONE, Public Library of Science, vol. 14(10), pages 1-21, October.
    25. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    26. Meira, Erick & Cyrino Oliveira, Fernando Luiz & Jeon, Jooyoung, 2021. "Treating and Pruning: New approaches to forecasting model selection and combination using prediction intervals," International Journal of Forecasting, Elsevier, vol. 37(2), pages 547-568.
    27. Assimakopoulos, V. & Nikolopoulos, K., 2000. "The theta model: a decomposition approach to forecasting," International Journal of Forecasting, Elsevier, vol. 16(4), pages 521-530.
    28. Vinod, Hrishikesh D. & Lopez-de-Lacalle, Javier, 2009. "Maximum Entropy Bootstrap for Time Series: The meboot R Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 29(i05).
    29. Liebensteiner, Mario & Wrienz, Matthias, 2020. "Do Intermittent Renewables Threaten the Electricity Supply Security?," Energy Economics, Elsevier, vol. 87(C).
    30. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    31. Barrow, Devon K. & Crone, Sven F., 2016. "Cross-validation aggregation for combining autoregressive neural network forecasts," International Journal of Forecasting, Elsevier, vol. 32(4), pages 1120-1137.
    32. Vinod, H. D., 2004. "Ranking mutual funds using unconventional utility theory and stochastic dominance," Journal of Empirical Finance, Elsevier, vol. 11(3), pages 353-377, June.
    33. Szafranek, Karol, 2019. "Bagged neural networks for forecasting Polish (low) inflation," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1042-1059.
    34. Zhang, Jin-Liang & Zhang, Yue-Jun & Zhang, Lu, 2015. "A novel hybrid method for crude oil price forecasting," Energy Economics, Elsevier, vol. 49(C), pages 649-659.
    35. Panapakidis, Ioannis P. & Dagoumas, Athanasios S., 2017. "Day-ahead natural gas demand forecasting based on the combination of wavelet transform and ANFIS/genetic algorithm/neural network model," Energy, Elsevier, vol. 118(C), pages 231-245.
    36. Makridakis, Spyros & Hibon, Michele, 2000. "The M3-Competition: results, conclusions and implications," International Journal of Forecasting, Elsevier, vol. 16(4), pages 451-476.
    37. Petropoulos, Fotios & Hyndman, Rob J. & Bergmeir, Christoph, 2018. "Exploring the sources of uncertainty: Why does bagging for time series forecasting work?," European Journal of Operational Research, Elsevier, vol. 268(2), pages 545-554.
    38. Sanchez-Ubeda, Eugenio Fco. & Berzosa, Ana, 2007. "Modeling and forecasting industrial end-use natural gas consumption," Energy Economics, Elsevier, vol. 29(4), pages 710-742, July.
    39. Holt, Charles C., 2004. "Author's retrospective on 'Forecasting seasonals and trends by exponentially weighted moving averages'," International Journal of Forecasting, Elsevier, vol. 20(1), pages 11-13.
    40. Vinod, Hrishikesh D., 2006. "Maximum entropy ensembles for time series inference in economics," Journal of Asian Economics, Elsevier, vol. 17(6), pages 955-978, December.
    41. Chen, Jiandong & Yu, Jie & Ai, Bowei & Song, Malin & Hou, Wenxuan, 2019. "Determinants of global natural gas consumption and import–export flows," Energy Economics, Elsevier, vol. 83(C), pages 588-602.
    42. Dantas, Tiago Mendes & Cyrino Oliveira, Fernando Luiz & Varela Repolho, Hugo Miguel, 2017. "Air transportation demand forecast through Bagging Holt Winters methods," Journal of Air Transport Management, Elsevier, vol. 59(C), pages 116-123.
    43. de Oliveira, Erick Meira & Cyrino Oliveira, Fernando Luiz, 2018. "Forecasting mid-long term electric energy consumption through bagging ARIMA and exponential smoothing methods," Energy, Elsevier, vol. 144(C), pages 776-788.
    44. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    45. Koning, Alex J. & Franses, Philip Hans & Hibon, Michele & Stekler, H.O., 2005. "The M3 competition: Statistical tests of the results," International Journal of Forecasting, Elsevier, vol. 21(3), pages 397-409.
    46. Özmen, Ayşe & Yılmaz, Yavuz & Weber, Gerhard-Wilhelm, 2018. "Natural gas consumption forecast with MARS and CMARS models for residential users," Energy Economics, Elsevier, vol. 70(C), pages 357-381.
    47. Beyca, Omer Faruk & Ervural, Beyzanur Cayir & Tatoglu, Ekrem & Ozuyar, Pinar Gokcin & Zaim, Selim, 2019. "Using machine learning tools for forecasting natural gas consumption in the province of Istanbul," Energy Economics, Elsevier, vol. 80(C), pages 937-949.
    48. Agrawal, Rahul Kumar & Muchahary, Frankle & Tripathi, Madan Mohan, 2019. "Ensemble of relevance vector machines and boosted trees for electricity price forecasting," Applied Energy, Elsevier, vol. 250(C), pages 540-548.
    49. Sun, Shaolong & Sun, Yuying & Wang, Shouyang & Wei, Yunjie, 2018. "Interval decomposition ensemble approach for crude oil price forecasting," Energy Economics, Elsevier, vol. 76(C), pages 274-287.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pala, Zeydin, 2023. "Comparative study on monthly natural gas vehicle fuel consumption and industrial consumption using multi-hybrid forecast models," Energy, Elsevier, vol. 263(PC).
    2. Xu, Guangyue & Chen, Yaqiang & Yang, Mengge & Li, Shuang & Marma, Kyaw Jaw Sine, 2023. "An outlook analysis on China's natural gas consumption forecast by 2035: Applying a seasonal forecasting method," Energy, Elsevier, vol. 284(C).
    3. Wen, Kai & Jiao, Jianfeng & Zhao, Kang & Yin, Xiong & Liu, Yuan & Gong, Jing & Li, Cuicui & Hong, Bingyuan, 2023. "Rapid transient operation control method of natural gas pipeline networks based on user demand prediction," Energy, Elsevier, vol. 264(C).
    4. Meira, Erick & Lila, Maurício Franca & Cyrino Oliveira, Fernando Luiz, 2023. "A novel reconciliation approach for hierarchical electricity consumption forecasting based on resistant regression," Energy, Elsevier, vol. 269(C).
    5. Sen, Doruk & Hamurcuoglu, K. Irem & Ersoy, Melisa Z. & Tunç, K.M. Murat & Günay, M. Erdem, 2023. "Forecasting long-term world annual natural gas production by machine learning," Resources Policy, Elsevier, vol. 80(C).
    6. Lila, Maurício Franca & Meira, Erick & Cyrino Oliveira, Fernando Luiz, 2022. "Forecasting unemployment in Brazil: A robust reconciliation approach using hierarchical data," Socio-Economic Planning Sciences, Elsevier, vol. 82(PB).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2021. "Point and interval forecasting of electricity supply via pruned ensembles," Energy, Elsevier, vol. 232(C).
    3. Meira, Erick & Cyrino Oliveira, Fernando Luiz & Jeon, Jooyoung, 2021. "Treating and Pruning: New approaches to forecasting model selection and combination using prediction intervals," International Journal of Forecasting, Elsevier, vol. 37(2), pages 547-568.
    4. Fotios Petropoulos & Evangelos Spiliotis, 2021. "The Wisdom of the Data: Getting the Most Out of Univariate Time Series Forecasting," Forecasting, MDPI, vol. 3(3), pages 1-20, June.
    5. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2020. "The M4 Competition: 100,000 time series and 61 forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(1), pages 54-74.
    6. Kang, Yanfei & Spiliotis, Evangelos & Petropoulos, Fotios & Athiniotis, Nikolaos & Li, Feng & Assimakopoulos, Vassilios, 2021. "Déjà vu: A data-centric forecasting approach through time series cross-similarity," Journal of Business Research, Elsevier, vol. 132(C), pages 719-731.
    7. Theodosiou, Marina, 2011. "Forecasting monthly and quarterly time series using STL decomposition," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1178-1195, October.
    8. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    9. Kang, Yanfei & Cao, Wei & Petropoulos, Fotios & Li, Feng, 2022. "Forecast with forecasts: Diversity matters," European Journal of Operational Research, Elsevier, vol. 301(1), pages 180-190.
    10. Spiliotis, Evangelos & Nikolopoulos, Konstantinos & Assimakopoulos, Vassilios, 2019. "Tales from tails: On the empirical distributions of forecasting errors and their implication to risk," International Journal of Forecasting, Elsevier, vol. 35(2), pages 687-698.
    11. Jaganathan, Srihari & Prakash, P.K.S., 2020. "A combination-based forecasting method for the M4-competition," International Journal of Forecasting, Elsevier, vol. 36(1), pages 98-104.
    12. Fotios Petropoulos & Enno Siemsen, 2023. "Forecast Selection and Representativeness," Management Science, INFORMS, vol. 69(5), pages 2672-2690, May.
    13. Li, Li & Kang, Yanfei & Li, Feng, 2023. "Bayesian forecast combination using time-varying features," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1287-1302.
    14. Karamaziotis, Panagiotis I. & Raptis, Achilleas & Nikolopoulos, Konstantinos & Litsiou, Konstantia & Assimakopoulos, Vassilis, 2020. "An empirical investigation of water consumption forecasting methods," International Journal of Forecasting, Elsevier, vol. 36(2), pages 588-606.
    15. Kourentzes, Nikolaos & Barrow, Devon & Petropoulos, Fotios, 2019. "Another look at forecast selection and combination: Evidence from forecast pooling," International Journal of Production Economics, Elsevier, vol. 209(C), pages 226-235.
    16. Spiliotis, Evangelos & Kouloumos, Andreas & Assimakopoulos, Vassilios & Makridakis, Spyros, 2020. "Are forecasting competitions data representative of the reality?," International Journal of Forecasting, Elsevier, vol. 36(1), pages 37-53.
    17. Spiliotis, Evangelos & Assimakopoulos, Vassilios & Makridakis, Spyros, 2020. "Generalizing the Theta method for automatic forecasting," European Journal of Operational Research, Elsevier, vol. 284(2), pages 550-558.
    18. de Oliveira, Erick Meira & Cyrino Oliveira, Fernando Luiz, 2018. "Forecasting mid-long term electric energy consumption through bagging ARIMA and exponential smoothing methods," Energy, Elsevier, vol. 144(C), pages 776-788.
    19. Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).
    20. Rajapaksha, Dilini & Bergmeir, Christoph & Hyndman, Rob J., 2023. "LoMEF: A framework to produce local explanations for global model time series forecasts," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1424-1447.

    More about this item

    Keywords

    Forecasting; Natural gas demand; Ensembles; Bagging; Regularization;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • Q41 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Demand and Supply; Prices
    • Q47 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Energy - - - Energy Forecasting

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:eneeco:v:106:y:2022:i:c:s0140988321006034. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eneco .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.