IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v237y2021ics0360544221017916.html
   My bibliography  Save this article

Day-ahead electricity price prediction applying hybrid models of LSTM-based deep learning methods and feature selection algorithms under consideration of market coupling

Author

Listed:
  • Li, Wei
  • Becker, Denis Mike

Abstract

The availability of accurate day-ahead electricity price forecasts is pivotal for electricity market participants. In the context of trade liberalisation and market harmonisation in the European markets, accurate price forecasting becomes difficult for electricity market participants to obtain because electricity forecasting requires the consideration of features from ever-growing coupling markets. This study provides a method of exploring the influence of market coupling on electricity price prediction. We apply state-of-the-art long short-term memory (LSTM) deep neural networks combined with feature selection algorithms for electricity price prediction under the consideration of market coupling. LSTM models have a good performance in handling nonlinear and complex problems and processing time series data. In our empirical study of the Nordic market, the proposed models obtain considerably accurate results. The results show that feature selection is essential to achieving accurate prediction, and features from integrated markets have an impact on prediction. The feature importance analysis implies that the German market has a salient role in the price generation of Nord Pool.

Suggested Citation

  • Li, Wei & Becker, Denis Mike, 2021. "Day-ahead electricity price prediction applying hybrid models of LSTM-based deep learning methods and feature selection algorithms under consideration of market coupling," Energy, Elsevier, vol. 237(C).
  • Handle: RePEc:eee:energy:v:237:y:2021:i:c:s0360544221017916
    DOI: 10.1016/j.energy.2021.121543
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221017916
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2021.121543?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bartosz Uniejewski & Jakub Nowotarski & Rafał Weron, 2016. "Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 9(8), pages 1-22, August.
    2. Chang, Zihan & Zhang, Yang & Chen, Wenbo, 2019. "Electricity price prediction based on hybrid model of adam optimized LSTM neural network and wavelet transform," Energy, Elsevier, vol. 187(C).
    3. Misiorek Adam & Trueck Stefan & Weron Rafal, 2006. "Point and Interval Forecasting of Spot Electricity Prices: Linear vs. Non-Linear Time Series Models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 10(3), pages 1-36, September.
    4. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    5. Florian Ziel & Rick Steinert & Sven Husmann, 2015. "Forecasting day ahead electricity spot prices: The impact of the EXAA to other European electricity markets," Papers 1501.00818, arXiv.org, revised Dec 2015.
    6. Panapakidis, Ioannis P. & Dagoumas, Athanasios S., 2016. "Day-ahead electricity price forecasting via the application of artificial neural network based models," Applied Energy, Elsevier, vol. 172(C), pages 132-151.
    7. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    8. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    9. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    10. Lago, Jesus & De Ridder, Fjo & Vrancx, Peter & De Schutter, Bart, 2018. "Forecasting day-ahead electricity prices in Europe: The importance of considering market integration," Applied Energy, Elsevier, vol. 211(C), pages 890-903.
    11. Rafal Weron, 2014. "A review of electricity price forecasting: The past, the present and the future," HSC Research Reports HSC/14/02, Hugo Steinhaus Center, Wroclaw University of Technology.
    12. Conejo, Antonio J. & Contreras, Javier & Espinola, Rosa & Plazas, Miguel A., 2005. "Forecasting electricity prices for a day-ahead pool-based electric energy market," International Journal of Forecasting, Elsevier, vol. 21(3), pages 435-462.
    13. Keles, Dogan & Scelle, Jonathan & Paraschiv, Florentina & Fichtner, Wolf, 2016. "Extended forecast methods for day-ahead electricity spot prices applying artificial neural networks," Applied Energy, Elsevier, vol. 162(C), pages 218-230.
    14. Somu, Nivethitha & Raman M R, Gauthama & Ramamritham, Krithi, 2021. "A deep learning framework for building energy consumption forecast," Renewable and Sustainable Energy Reviews, Elsevier, vol. 137(C).
    15. Weron, Rafal & Misiorek, Adam, 2008. "Forecasting spot electricity prices: A comparison of parametric and semiparametric time series models," International Journal of Forecasting, Elsevier, vol. 24(4), pages 744-763.
    16. Leerbeck, Kenneth & Bacher, Peder & Junker, Rune Grønborg & Goranović, Goran & Corradi, Olivier & Ebrahimy, Razgar & Tveit, Anna & Madsen, Henrik, 2020. "Short-term forecasting of CO2 emission intensity in power grids by machine learning," Applied Energy, Elsevier, vol. 277(C).
    17. Shao, Zhen & Yang, ShanLin & Gao, Fei & Zhou, KaiLe & Lin, Peng, 2017. "A new electricity price prediction strategy using mutual information-based SVM-RFE classification," Renewable and Sustainable Energy Reviews, Elsevier, vol. 70(C), pages 330-341.
    18. Zhou, Yi & Zhou, Nanrun & Gong, Lihua & Jiang, Minlin, 2020. "Prediction of photovoltaic power output based on similar day analysis, genetic algorithm and extreme learning machine," Energy, Elsevier, vol. 204(C).
    19. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    20. Grzegorz Marcjasz & Jesus Lago & Rafa{l} Weron, 2020. "Neural networks in day-ahead electricity price forecasting: Single vs. multiple outputs," Papers 2008.08006, arXiv.org.
    21. Ventosa, Mariano & Baillo, Alvaro & Ramos, Andres & Rivier, Michel, 2005. "Electricity market modeling trends," Energy Policy, Elsevier, vol. 33(7), pages 897-913, May.
    22. Li, Liang & Yuan, Zhiming & Gao, Yan, 2018. "Maximization of energy absorption for a wave energy converter using the deep machine learning," Energy, Elsevier, vol. 165(PA), pages 340-349.
    23. J. J. Jamian & M. N. Abdullah & H. Mokhlis & M. W. Mustafa & A. H. A. Bakar, 2014. "Global Particle Swarm Optimization for High Dimension Numerical Functions Analysis," Journal of Applied Mathematics, Hindawi, vol. 2014, pages 1-14, February.
    24. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    25. Adam Misiorek & Rafal Weron, 2006. "Interval forecasting of spot electricity prices," HSC Research Reports HSC/06/05, Hugo Steinhaus Center, Wroclaw University of Technology.
    26. Mukund Sundararajan & Amir Najmi, 2019. "The many Shapley values for model explanation," Papers 1908.08474, arXiv.org, revised Feb 2020.
    27. Ziel, Florian & Steinert, Rick & Husmann, Sven, 2015. "Forecasting day ahead electricity spot prices: The impact of the EXAA to other European electricity markets," Energy Economics, Elsevier, vol. 51(C), pages 430-444.
    28. Islyaev, Suren & Date, Paresh, 2015. "Electricity futures price models: Calibration and forecasting," European Journal of Operational Research, Elsevier, vol. 247(1), pages 144-154.
    29. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    30. Rafal Weron, 2006. "Modeling and Forecasting Electricity Loads and Prices: A Statistical Approach," HSC Books, Hugo Steinhaus Center, Wroclaw University of Technology, number hsbook0601.
    31. Ping-Huan Kuo & Chiou-Jye Huang, 2018. "An Electricity Price Forecasting Model by Hybrid Structured Deep Neural Networks," Sustainability, MDPI, vol. 10(4), pages 1-17, April.
    32. Uribe, Jorge M. & Mosquera-López, Stephanía & Guillen, Montserrat, 2020. "Characterizing electricity market integration in Nord Pool," Energy, Elsevier, vol. 208(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Meng, Anbo & Wang, Peng & Zhai, Guangsong & Zeng, Cong & Chen, Shun & Yang, Xiaoyi & Yin, Hao, 2022. "Electricity price forecasting with high penetration of renewable energy using attention-based LSTM network trained by crisscross optimization," Energy, Elsevier, vol. 254(PA).
    2. Xiong, Xiaoping & Qing, Guohua, 2023. "A hybrid day-ahead electricity price forecasting framework based on time series," Energy, Elsevier, vol. 264(C).
    3. Olivares, Kin G. & Challu, Cristian & Marcjasz, Grzegorz & Weron, Rafał & Dubrawski, Artur, 2023. "Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx," International Journal of Forecasting, Elsevier, vol. 39(2), pages 884-900.
    4. Gonçalves, Rui & Ribeiro, Vitor Miguel & Pereira, Fernando Lobo, 2023. "Variable Split Convolutional Attention: A novel Deep Learning model applied to the household electric power consumption," Energy, Elsevier, vol. 274(C).
    5. Daniel Manfre Jaimes & Manuel Zamudio López & Hamidreza Zareipour & Mike Quashie, 2023. "A Hybrid Model for Multi-Day-Ahead Electricity Price Forecasting considering Price Spikes," Forecasting, MDPI, vol. 5(3), pages 1-23, July.
    6. Sergio Cantillo-Luna & Ricardo Moreno-Chuquen & Jesus Lopez-Sotelo & David Celeita, 2023. "An Intra-Day Electricity Price Forecasting Based on a Probabilistic Transformer Neural Network Architecture," Energies, MDPI, vol. 16(19), pages 1-24, September.
    7. Haokun Su & Xiangang Peng & Hanyu Liu & Huan Quan & Kaitong Wu & Zhiwen Chen, 2022. "Multi-Step-Ahead Electricity Price Forecasting Based on Temporal Graph Convolutional Network," Mathematics, MDPI, vol. 10(14), pages 1-16, July.
    8. Shu-Chu Liu & Quan-Ying Jian & Hsien-Yin Wen & Chih-Hung Chung, 2022. "A Crop Harvest Time Prediction Model for Better Sustainability, Integrating Feature Selection and Artificial Intelligence Methods," Sustainability, MDPI, vol. 14(21), pages 1-13, October.
    9. Hakan Acaroğlu & Fausto Pedro García Márquez, 2021. "Comprehensive Review on Electricity Market Price and Load Forecasting Based on Wind Energy," Energies, MDPI, vol. 14(22), pages 1-23, November.
    10. Tovar Rosas, Mario A. & Pérez, Miguel Robles & Martínez Pérez, E. Rafael, 2022. "Itineraries for charging and discharging a BESS using energy predictions based on a CNN-LSTM neural network model in BCS, Mexico," Renewable Energy, Elsevier, vol. 188(C), pages 1141-1165.
    11. Cheng Zhang & Nilam Nur Amir Sjarif & Roslina Ibrahim, 2023. "Deep learning models for price forecasting of financial time series: A review of recent advancements: 2020-2022," Papers 2305.04811, arXiv.org, revised Sep 2023.
    12. Sharma, Abhishek & Jain, Sachin Kumar, 2022. "A novel seasonal segmentation approach for day-ahead load forecasting," Energy, Elsevier, vol. 257(C).
    13. Kılıç Depren, Serpil & Kartal, Mustafa Tevfik & Ertuğrul, Hasan Murat & Depren, Özer, 2022. "The role of data frequency and method selection in electricity price estimation: Comparative evidence from Turkey in pre-pandemic and pandemic periods," Renewable Energy, Elsevier, vol. 186(C), pages 217-225.
    14. Ciaran O'Connor & Joseph Collins & Steven Prestwich & Andrea Visentin, 2024. "Electricity Price Forecasting in the Irish Balancing Market," Papers 2402.06714, arXiv.org.
    15. Wang, Jianzhou & Xing, Qianyi & Zeng, Bo & Zhao, Weigang, 2022. "An ensemble forecasting system for short-term power load based on multi-objective optimizer and fuzzy granulation," Applied Energy, Elsevier, vol. 327(C).
    16. Shi, Tao & Li, Chongyang & Zhang, Wei & Zhang, Yi, 2023. "Forecasting on metal resource spot settlement price: New evidence from the machine learning model," Resources Policy, Elsevier, vol. 81(C).
    17. Wei Li & Wolfgang Karl Hardle & Stefan Lessmann, 2022. "A Data-driven Case-based Reasoning in Bankruptcy Prediction," Papers 2211.00921, arXiv.org.
    18. Dounia El Bourakadi & Hiba Ramadan & Ali Yahyaouy & Jaouad Boumhidi, 2023. "A robust energy management approach in two-steps ahead using deep learning BiLSTM prediction model and type-2 fuzzy decision-making controller," Fuzzy Optimization and Decision Making, Springer, vol. 22(4), pages 645-667, December.
    19. Halužan, Marko & Verbič, Miroslav & Zorić, Jelena, 2022. "An integrated model for electricity market coupling simulations: Evidence from the European power market crossroad," Utilities Policy, Elsevier, vol. 79(C).
    20. Fang Guo & Shangyun Deng & Weijia Zheng & An Wen & Jinfeng Du & Guangshan Huang & Ruiyang Wang, 2022. "Short-Term Electricity Price Forecasting Based on the Two-Layer VMD Decomposition Technique and SSA-LSTM," Energies, MDPI, vol. 15(22), pages 1-20, November.
    21. Bikeri Adline & Kazushi Ikeda, 2023. "A Hawkes Model Approach to Modeling Price Spikes in the Japanese Electricity Market," Energies, MDPI, vol. 16(4), pages 1-20, February.
    22. Schneider, Nicolas & Strielkowski, Wadim, 2023. "Modelling the unit root properties of electricity data—A general note on time-domain applications," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 618(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    2. Özen, Kadir & Yıldırım, Dilem, 2021. "Application of bagging in day-ahead electricity price forecasting and factor augmentation," Energy Economics, Elsevier, vol. 103(C).
    3. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    4. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    5. Brusaferri, Alessandro & Matteucci, Matteo & Portolani, Pietro & Vitali, Andrea, 2019. "Bayesian deep learning based method for probabilistic forecast of day-ahead electricity prices," Applied Energy, Elsevier, vol. 250(C), pages 1158-1175.
    6. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    7. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    8. Florian Ziel & Rafal Weron, 2016. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate models," HSC Research Reports HSC/16/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    9. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    10. Halužan, Marko & Verbič, Miroslav & Zorić, Jelena, 2020. "Performance of alternative electricity price forecasting methods: Findings from the Greek and Hungarian power exchanges," Applied Energy, Elsevier, vol. 277(C).
    11. Grzegorz Marcjasz & Bartosz Uniejewski & Rafal Weron, 2017. "Importance of the long-term seasonal component in day-ahead electricity price forecasting revisited: Neural network models," HSC Research Reports HSC/17/03, Hugo Steinhaus Center, Wroclaw University of Technology.
    12. Kadir Özen & Dilem Yıldırım, 2021. "Application of Bagging in Day-Ahead Electricity Price Forecasting and Factor Augmentation," ERC Working Papers 2101, ERC - Economic Research Center, Middle East Technical University, revised Apr 2021.
    13. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    14. Umut Ugurlu & Ilkay Oksuz & Oktay Tas, 2018. "Electricity Price Forecasting Using Recurrent Neural Networks," Energies, MDPI, vol. 11(5), pages 1-23, May.
    15. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    16. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    17. Gianfreda, Angelica & Ravazzolo, Francesco & Rossini, Luca, 2020. "Comparing the forecasting performances of linear models for electricity prices with high RES penetration," International Journal of Forecasting, Elsevier, vol. 36(3), pages 974-986.
    18. Grzegorz Marcjasz, 2020. "Forecasting Electricity Prices Using Deep Neural Networks: A Robust Hyper-Parameter Selection Scheme," Energies, MDPI, vol. 13(18), pages 1-18, September.
    19. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    20. F. Cordoni, 2020. "A comparison of modern deep neural network architectures for energy spot price forecasting," Digital Finance, Springer, vol. 2(3), pages 189-210, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:237:y:2021:i:c:s0360544221017916. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.