IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v246y2022ics0360544222002699.html
   My bibliography  Save this article

Forecasting energy prices using a novel hybrid model with variational mode decomposition

Author

Listed:
  • Lin, Yu
  • Lu, Qin
  • Tan, Bin
  • Yu, Yuanyuan

Abstract

Forecasting energy prices accurately has always played the important role in the country's energy security and environmental impacts of policies. This paper proposes a novel decomposition-ensemble model to predict the energy prices which fluctuate wildly. The several steps process as follows: (1) The original energy prices are decomposed into sublayers with different frequencies by variational mode decomposition (VMD). (2) The autoregression model (AR) predicts the first low frequency component and Elman neural network (ELMAN) forecasts the last high frequency component. Besides, the improved bidirectional long short-term memory (IBiLSTM, the attention-based convolutional neural network and bidirectional long short-term memory) predicts other sublayers. (3) The prediction of the sublayers with different models is reconstructed as final predicted results with the non-linear integration approach. Combining econometric and artificial intelligence methods with the asymmetric feature makes the forecasting performance more accurate. The novel model outperforms other related comparative models under different training sets lengths. In general, experiments on two cases of energy prices: natural gas and carbon futures prices demonstrate the validity and reliability of the proposed model AR-IBiLSTM-ELMAN with VMD. The advanced model could simultaneously exploit the unique advantages of each model which provides an effective forecasting tool for governments and enterprises.

Suggested Citation

  • Lin, Yu & Lu, Qin & Tan, Bin & Yu, Yuanyuan, 2022. "Forecasting energy prices using a novel hybrid model with variational mode decomposition," Energy, Elsevier, vol. 246(C).
  • Handle: RePEc:eee:energy:v:246:y:2022:i:c:s0360544222002699
    DOI: 10.1016/j.energy.2022.123366
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544222002699
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2022.123366?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Guo, Zhenhai & Zhao, Weigang & Lu, Haiyan & Wang, Jianzhou, 2012. "Multi-step forecasting for wind speed using a modified EMD-based artificial neural network model," Renewable Energy, Elsevier, vol. 37(1), pages 241-249.
    2. Ji, Qiang & Zhang, Hai-Ying & Geng, Jiang-Bo, 2018. "What drives natural gas prices in the United States? – A directed acyclic graph approach," Energy Economics, Elsevier, vol. 69(C), pages 79-88.
    3. Cao, Jian & Li, Zhi & Li, Jian, 2019. "Financial time series forecasting model based on CEEMDAN and LSTM," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 519(C), pages 127-139.
    4. Abramson, Bruce & Finizza, Anthony, 1995. "Probabilistic forecasts from probabilistic models: A case study in the oil market," International Journal of Forecasting, Elsevier, vol. 11(1), pages 63-72, March.
    5. Deepak Gupta & Mahardhika Pratama & Zhenyuan Ma & Jun Li & Mukesh Prasad, 2019. "Financial time series forecasting using twin support vector regression," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-27, March.
    6. Potts, Todd B. & Yerger, David B., 2016. "Marcellus Shale and structural breaks in oil and gas markets: The case of Pennsylvania," Energy Economics, Elsevier, vol. 57(C), pages 50-58.
    7. Sun, Wei & Huang, Chenchen, 2020. "A novel carbon price prediction model combines the secondary decomposition algorithm and the long short-term memory network," Energy, Elsevier, vol. 207(C).
    8. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    9. Li, Yanfei & Shi, Huipeng & Han, Fengze & Duan, Zhu & Liu, Hui, 2019. "Smart wind speed forecasting approach using various boosting algorithms, big multi-step forecasting strategy," Renewable Energy, Elsevier, vol. 135(C), pages 540-553.
    10. Nedellec, Raphael & Cugliari, Jairo & Goude, Yannig, 2014. "GEFCom2012: Electric load forecasting and backcasting with semi-parametric models," International Journal of Forecasting, Elsevier, vol. 30(2), pages 375-381.
    11. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    12. E, Jianwei & Ye, Jimin & He, Lulu & Jin, Haihong, 2019. "Energy price prediction based on independent component analysis and gated recurrent unit neural network," Energy, Elsevier, vol. 189(C).
    13. Peng, Tian & Zhang, Chu & Zhou, Jianzhong & Nazir, Muhammad Shahzad, 2021. "An integrated framework of Bi-directional long-short term memory (BiLSTM) based on sine cosine algorithm for hourly solar radiation forecasting," Energy, Elsevier, vol. 221(C).
    14. Hirotugu Akaike, 1969. "Fitting autoregressive models for prediction," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 21(1), pages 243-247, December.
    15. Sabiruzzaman, Md. & Monimul Huq, Md. & Beg, Rabiul Alam & Anwar, Sajid, 2010. "Modeling and forecasting trading volume index: GARCH versus TGARCH approach," The Quarterly Review of Economics and Finance, Elsevier, vol. 50(2), pages 141-145, May.
    16. Wang, Deyun & Luo, Hongyuan & Grunder, Olivier & Lin, Yanbing & Guo, Haixiang, 2017. "Multi-step ahead electricity price forecasting using a hybrid model based on two-layer decomposition technique and BP neural network optimized by firefly algorithm," Applied Energy, Elsevier, vol. 190(C), pages 390-407.
    17. Li, Chuan & Tao, Ying & Ao, Wengang & Yang, Shuai & Bai, Yun, 2018. "Improving forecasting accuracy of daily enterprise electricity consumption using a random forest based on ensemble empirical mode decomposition," Energy, Elsevier, vol. 165(PB), pages 1220-1227.
    18. Makridakis, Spyros, 1993. "Accuracy measures: theoretical and practical concerns," International Journal of Forecasting, Elsevier, vol. 9(4), pages 527-529, December.
    19. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    20. Harvey, David I. & Leybourne, Stephen J. & Whitehouse, Emily J., 2017. "Forecast evaluation tests and negative long-run variance estimates in small samples," International Journal of Forecasting, Elsevier, vol. 33(4), pages 833-847.
    21. Flouri, Maria & Karakosta, Charikleia & Kladouchou, Charikleia & Psarras, John, 2015. "How does a natural gas supply interruption affect the EU gas security? A Monte Carlo simulation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 44(C), pages 785-796.
    22. Zhao, Xin & Han, Meng & Ding, Lili & Kang, Wanglin, 2018. "Usefulness of economic and energy data at different frequencies for carbon price forecasting in the EU ETS," Applied Energy, Elsevier, vol. 216(C), pages 132-141.
    23. Brabec, Marek & Konár, Ondrej & Pelikán, Emil & Malý, Marek, 2008. "A nonlinear mixed effects model for the prediction of natural gas consumption by individual customers," International Journal of Forecasting, Elsevier, vol. 24(4), pages 659-678.
    24. Modjtahedi, Bagher & Movassagh, Nahid, 2005. "Natural-gas futures: Bias, predictive performance, and the theory of storage," Energy Economics, Elsevier, vol. 27(4), pages 617-637, July.
    25. Qu, Jiaqi & Qian, Zheng & Pei, Yan, 2021. "Day-ahead hourly photovoltaic power forecasting using attention-based CNN-LSTM neural network embedded with multiple relevant and target variables prediction pattern," Energy, Elsevier, vol. 232(C).
    26. Su, Huai & Zio, Enrico & Zhang, Jinjun & Xu, Mingjing & Li, Xueyi & Zhang, Zongjie, 2019. "A hybrid hourly natural gas demand forecasting method based on the integration of wavelet transform and enhanced Deep-RNN model," Energy, Elsevier, vol. 178(C), pages 585-597.
    27. Huang, Yumeng & Dai, Xingyu & Wang, Qunwei & Zhou, Dequn, 2021. "A hybrid model for carbon price forecastingusing GARCH and long short-term memory network," Applied Energy, Elsevier, vol. 285(C).
    28. Zhang, Xingmin & Zhang, Shuai, 2021. "Optimal time-varying tail risk network with a rolling window approach," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 580(C).
    29. Zhang, Lihong & Wang, Jun & Wang, Bin, 2020. "Energy market prediction with novel long short-term memory network: Case study of energy futures index volatility," Energy, Elsevier, vol. 211(C).
    30. Wang, Jujie & Li, Yaning, 2018. "Multi-step ahead wind speed prediction based on optimal feature extraction, long short term memory neural network and error correction strategy," Applied Energy, Elsevier, vol. 230(C), pages 429-443.
    31. Wang, Bin & Wang, Jun, 2021. "Energy futures price prediction and evaluation model with deep bidirectional gated recurrent unit neural network and RIF-based algorithm," Energy, Elsevier, vol. 216(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Haider A. Khan & Shahryar Ghorbani & Elham Shabani & Shahab S. Band, 2024. "Enhancement of Neural Networks Model’s Predictions of Currencies Exchange Rates by Phase Space Reconstruction and Harris Hawks’ Optimization," Computational Economics, Springer;Society for Computational Economics, vol. 63(2), pages 835-860, February.
    2. Guici Chen & Tingting Zhang & Wenyu Qu & Wenbo Wang, 2023. "Photovoltaic Power Prediction Based on VMD-BRNN-TSP," Mathematics, MDPI, vol. 11(4), pages 1-14, February.
    3. Junhao Wu & Yuan Hu & Daqing Wu & Zhengyong Yang, 2022. "An Aquatic Product Price Forecast Model Using VMD-IBES-LSTM Hybrid Approach," Agriculture, MDPI, vol. 12(8), pages 1-26, August.
    4. Alexandru Matei & Stefan-Alexandru Precup & Dragos Circa & Arpad Gellert & Constantin-Bala Zamfirescu, 2023. "Estimating Travel Time for Autonomous Mobile Robots through Long Short-Term Memory," Mathematics, MDPI, vol. 11(7), pages 1-19, April.
    5. Ma, Yilin & Wang, Yudong & Wang, Weizhong & Zhang, Chong, 2023. "Portfolios with return and volatility prediction for the energy stock market," Energy, Elsevier, vol. 270(C).
    6. Beibei Hu & Yunhe Cheng, 2023. "Prediction of Regional Carbon Price in China Based on Secondary Decomposition and Nonlinear Error Correction," Energies, MDPI, vol. 16(11), pages 1-22, May.
    7. Balaji Natesan & Anandakumar Singaravelan & Jia-Lien Hsu & Yi-Hsien Lin & Baiying Lei & Chuan-Ming Liu, 2022. "Channel–Spatial Segmentation Network for Classifying Leaf Diseases," Agriculture, MDPI, vol. 12(11), pages 1-20, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qin Lu & Jingwen Liao & Kechi Chen & Yanhui Liang & Yu Lin, 2024. "Predicting Natural Gas Prices Based on a Novel Hybrid Model with Variational Mode Decomposition," Computational Economics, Springer;Society for Computational Economics, vol. 63(2), pages 639-678, February.
    2. Li, Jingmiao & Wang, Jun, 2020. "Forcasting of energy futures market and synchronization based on stochastic gated recurrent unit model," Energy, Elsevier, vol. 213(C).
    3. Li, Dan & Li, Yijun & Wang, Chaoqun & Chen, Min & Wu, Qi, 2023. "Forecasting carbon prices based on real-time decomposition and causal temporal convolutional networks," Applied Energy, Elsevier, vol. 331(C).
    4. Lago, Jesus & De Ridder, Fjo & Vrancx, Peter & De Schutter, Bart, 2018. "Forecasting day-ahead electricity prices in Europe: The importance of considering market integration," Applied Energy, Elsevier, vol. 211(C), pages 890-903.
    5. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    6. Lu, Hongfang & Ma, Xin & Huang, Kun & Azimi, Mohammadamin, 2020. "Prediction of offshore wind farm power using a novel two-stage model combining kernel-based nonlinear extension of the Arps decline model with a multi-objective grey wolf optimizer," Renewable and Sustainable Energy Reviews, Elsevier, vol. 127(C).
    7. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    8. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    9. Yang, Wendong & Wang, Jianzhou & Niu, Tong & Du, Pei, 2019. "A hybrid forecasting system based on a dual decomposition strategy and multi-objective optimization for electricity price forecasting," Applied Energy, Elsevier, vol. 235(C), pages 1205-1225.
    10. Peng Chen & Andrew Vivian & Cheng Ye, 2022. "Forecasting carbon futures price: a hybrid method incorporating fuzzy entropy and extreme learning machine," Annals of Operations Research, Springer, vol. 313(1), pages 559-601, June.
    11. Wang, Jujie & Zhuang, Zhenzhen & Gao, Dongming, 2023. "An enhanced hybrid model based on multiple influencing factors and divide-conquer strategy for carbon price prediction," Omega, Elsevier, vol. 120(C).
    12. Xiaolu Wei & Hongbing Ouyang, 2023. "Forecasting Carbon Price Using Double Shrinkage Methods," IJERPH, MDPI, vol. 20(2), pages 1-20, January.
    13. Zhao, Yuan & Zhang, Weiguo & Gong, Xue & Wang, Chao, 2021. "A novel method for online real-time forecasting of crude oil price," Applied Energy, Elsevier, vol. 303(C).
    14. Ciaran O'Connor & Joseph Collins & Steven Prestwich & Andrea Visentin, 2024. "Electricity Price Forecasting in the Irish Balancing Market," Papers 2402.06714, arXiv.org.
    15. Wang, Jun & Cao, Junxing & Yuan, Shan & Cheng, Ming, 2021. "Short-term forecasting of natural gas prices by using a novel hybrid method based on a combination of the CEEMDAN-SE-and the PSO-ALS-optimized GRU network," Energy, Elsevier, vol. 233(C).
    16. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    17. Halužan, Marko & Verbič, Miroslav & Zorić, Jelena, 2020. "Performance of alternative electricity price forecasting methods: Findings from the Greek and Hungarian power exchanges," Applied Energy, Elsevier, vol. 277(C).
    18. Yumin Li & Ruiqi Yang & Xiaoman Wang & Jiaming Zhu & Nan Song, 2023. "Carbon Price Combination Forecasting Model Based on Lasso Regression and Optimal Integration," Sustainability, MDPI, vol. 15(12), pages 1-26, June.
    19. Kaijian He & Qian Yang & Lei Ji & Jingcheng Pan & Yingchao Zou, 2023. "Financial Time Series Forecasting with the Deep Learning Ensemble Model," Mathematics, MDPI, vol. 11(4), pages 1-15, February.
    20. Moreno-Carbonell, Santiago & Sánchez-Úbeda, Eugenio F. & Muñoz, Antonio, 2020. "Rethinking weather station selection for electric load forecasting using genetic algorithms," International Journal of Forecasting, Elsevier, vol. 36(2), pages 695-712.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:246:y:2022:i:c:s0360544222002699. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.