IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v17y2024i7p1625-d1365892.html
   My bibliography  Save this article

Data-Driven Techniques for Short-Term Electricity Price Forecasting through Novel Deep Learning Approaches with Attention Mechanisms

Author

Listed:
  • Vasileios Laitsos

    (Department of Electrical and Computer Engineering, University of Thessaly, 383 34 Volos, Greece)

  • Georgios Vontzos

    (Department of Electrical and Computer Engineering, University of Thessaly, 383 34 Volos, Greece)

  • Dimitrios Bargiotas

    (Department of Electrical and Computer Engineering, University of Thessaly, 383 34 Volos, Greece)

  • Aspassia Daskalopulu

    (Department of Electrical and Computer Engineering, University of Thessaly, 383 34 Volos, Greece)

  • Lefteri H. Tsoukalas

    (Center for Intelligent Energy Systems (CiENS), School of Nuclear Engineering, Purdue University, West Lafayette, IN 47906, USA)

Abstract

The electricity market is constantly evolving, being driven by factors such as market liberalization, the increasing use of renewable energy sources (RESs), and various economic and political influences. These dynamics make it challenging to predict wholesale electricity prices. Accurate short-term forecasting is crucial to maintaining system balance and addressing anomalies such as negative prices and deviations from predictions. This paper investigates short-term electricity price forecasting using historical time series data and employs advanced deep learning algorithms. First, four deep learning models are implemented and proposed, which are a convolutional neural network (CNN) with an integrated attention mechanism, a hybrid CNN followed by a gated recurrent unit model (CNN-GRU) with an attention mechanism, and two ensemble learning models, which are a soft voting ensemble and a stacking ensemble model. Also, the optimized version of a transformer model, the Multi-Head Attention model, is introduced. Finally, the perceptron model is used as a benchmark for comparison. Our results show excellent prediction accuracy, particularly in the hybrid CNN-GRU model with attention, thereby achieving a mean absolute percentage error (MAPE) of 6.333%. The soft voting ensemble model and the Multi-Head Attention model also performed well, with MAPEs of 6.125% and 6.889%, respectively. These findings are significant, as previous studies have not shown high performance with transformer models and attention mechanisms. The presented results offer promising insights for future research in this field.

Suggested Citation

  • Vasileios Laitsos & Georgios Vontzos & Dimitrios Bargiotas & Aspassia Daskalopulu & Lefteri H. Tsoukalas, 2024. "Data-Driven Techniques for Short-Term Electricity Price Forecasting through Novel Deep Learning Approaches with Attention Mechanisms," Energies, MDPI, vol. 17(7), pages 1-27, March.
  • Handle: RePEc:gam:jeners:v:17:y:2024:i:7:p:1625-:d:1365892
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/17/7/1625/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/17/7/1625/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Brusaferri, Alessandro & Matteucci, Matteo & Portolani, Pietro & Vitali, Andrea, 2019. "Bayesian deep learning based method for probabilistic forecast of day-ahead electricity prices," Applied Energy, Elsevier, vol. 250(C), pages 1158-1175.
    2. Beltrán, Sergio & Castro, Alain & Irizar, Ion & Naveran, Gorka & Yeregui, Imanol, 2022. "Framework for collaborative intelligence in forecasting day-ahead electricity price," Applied Energy, Elsevier, vol. 306(PA).
    3. Athanasios Ioannis Arvanitidis & Dimitrios Bargiotas & Dimitrios Kontogiannis & Athanasios Fevgas & Miltiadis Alamaniotis, 2022. "Optimized Data-Driven Models for Short-Term Electricity Price Forecasting Based on Signal Decomposition and Clustering Techniques," Energies, MDPI, vol. 15(21), pages 1-24, October.
    4. Laiqing Yan & Zutai Yan & Zhenwen Li & Ning Ma & Ran Li & Jian Qin, 2023. "Electricity Market Price Prediction Based on Quadratic Hybrid Decomposition and THPO Algorithm," Energies, MDPI, vol. 16(13), pages 1-18, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gao, Yuan & Miyata, Shohei & Akashi, Yasunori, 2022. "Interpretable deep learning models for hourly solar radiation prediction based on graph neural network and attention," Applied Energy, Elsevier, vol. 321(C).
    2. Zhao, Yincheng & Zhang, Guozhou & Hu, Weihao & Huang, Qi & Chen, Zhe & Blaabjerg, Frede, 2023. "Meta-learning based voltage control strategy for emergency faults of active distribution networks," Applied Energy, Elsevier, vol. 349(C).
    3. Wang, Ran & Lu, Shilei & Feng, Wei, 2020. "A novel improved model for building energy consumption prediction based on model integration," Applied Energy, Elsevier, vol. 262(C).
    4. Ethem Çanakoğlu & Esra Adıyeke, 2020. "Comparison of Electricity Spot Price Modelling and Risk Management Applications," Energies, MDPI, vol. 13(18), pages 1-22, September.
    5. Jun Dong & Xihao Dou & Aruhan Bao & Yaoyu Zhang & Dongran Liu, 2022. "Day-Ahead Spot Market Price Forecast Based on a Hybrid Extreme Learning Machine Technique: A Case Study in China," Sustainability, MDPI, vol. 14(13), pages 1-24, June.
    6. Kılıç Depren, Serpil & Kartal, Mustafa Tevfik & Ertuğrul, Hasan Murat & Depren, Özer, 2022. "The role of data frequency and method selection in electricity price estimation: Comparative evidence from Turkey in pre-pandemic and pandemic periods," Renewable Energy, Elsevier, vol. 186(C), pages 217-225.
    7. Wagner, Andreas & Ramentol, Enislay & Schirra, Florian & Michaeli, Hendrik, 2022. "Short- and long-term forecasting of electricity prices using embedding of calendar information in neural networks," Journal of Commodity Markets, Elsevier, vol. 28(C).
    8. Sheybanivaziri, Samaneh & Le Dréau, Jérôme & Kazmi, Hussain, 2024. "Forecasting price spikes in day-ahead electricity markets: techniques, challenges, and the road ahead," Discussion Papers 2024/1, Norwegian School of Economics, Department of Business and Management Science.
    9. Venkatraj, V. & Dixit, M.K., 2022. "Challenges in implementing data-driven approaches for building life cycle energy assessment: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    10. Sergio Cantillo-Luna & Ricardo Moreno-Chuquen & Jesus Lopez-Sotelo & David Celeita, 2023. "An Intra-Day Electricity Price Forecasting Based on a Probabilistic Transformer Neural Network Architecture," Energies, MDPI, vol. 16(19), pages 1-24, September.
    11. Wang, Yanjia & Xu, Chao & Xie, Da & Gu, Chenghong & Zhao, Pengfei & Gong, Jinxia & Pan, Mingjie & Wang, Xitian, 2023. "A novel scheduling strategy for virtual power plant based on power market dynamic triggers," Applied Energy, Elsevier, vol. 350(C).
    12. Mauro Bernardi & Francesco Lisi, 2020. "Point and Interval Forecasting of Zonal Electricity Prices and Demand Using Heteroscedastic Models: The IPEX Case," Energies, MDPI, vol. 13(23), pages 1-34, November.
    13. Harri Aaltonen & Seppo Sierla & Ville Kyrki & Mahdi Pourakbari-Kasmaei & Valeriy Vyatkin, 2022. "Bidding a Battery on Electricity Markets and Minimizing Battery Aging Costs: A Reinforcement Learning Approach," Energies, MDPI, vol. 15(14), pages 1-19, July.
    14. Zhang, Xiaokong & Chai, Jian & Tian, Lingyue & Yang, Ying & Zhang, Zhe George & Pan, Yue, 2023. "Forecast and structural characteristics of China's oil product consumption embedded in bottom-line thinking," Energy, Elsevier, vol. 278(PA).
    15. Jiang, Ping & Nie, Ying & Wang, Jianzhou & Huang, Xiaojia, 2023. "Multivariable short-term electricity price forecasting using artificial intelligence and multi-input multi-output scheme," Energy Economics, Elsevier, vol. 117(C).
    16. Lima, Marcello Anderson F.B. & Carvalho, Paulo C.M. & Fernández-Ramírez, Luis M. & Braga, Arthur P.S., 2020. "Improving solar forecasting using Deep Learning and Portfolio Theory integration," Energy, Elsevier, vol. 195(C).
    17. Yin, Linfei & Qiu, Yao, 2022. "Neural network dynamic differential control for long-term price guidance mechanism of flexible energy service providers," Energy, Elsevier, vol. 255(C).
    18. Heidarpanah, Mohammadreza & Hooshyaripor, Farhad & Fazeli, Meysam, 2023. "Daily electricity price forecasting using artificial intelligence models in the Iranian electricity market," Energy, Elsevier, vol. 263(PE).
    19. Saâdaoui, Foued & Ben Jabeur, Sami, 2023. "Analyzing the influence of geopolitical risks on European power prices using a multiresolution causal neural network," Energy Economics, Elsevier, vol. 124(C).
    20. Jasiński, Tomasz, 2020. "Use of new variables based on air temperature for forecasting day-ahead spot electricity prices using deep neural networks: A new approach," Energy, Elsevier, vol. 213(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:17:y:2024:i:7:p:1625-:d:1365892. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.