IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i19p6767-d1245577.html
   My bibliography  Save this article

An Intra-Day Electricity Price Forecasting Based on a Probabilistic Transformer Neural Network Architecture

Author

Listed:
  • Sergio Cantillo-Luna

    (Faculty of Engineering, Universidad Autónoma de Occidente, Cali 760030, Colombia)

  • Ricardo Moreno-Chuquen

    (Faculty of Engineering and Design, Universidad Icesi, Cali 760031, Colombia)

  • Jesus Lopez-Sotelo

    (Faculty of Engineering, Universidad Autónoma de Occidente, Cali 760030, Colombia)

  • David Celeita

    (School of Engineering, Science and Technology, Universidad del Rosario, Bogotá 111221, Colombia)

Abstract

This paper describes the development of a deep neural network architecture based on transformer encoder blocks and Time2Vec layers for the prediction of electricity prices several steps ahead (8 h), from a probabilistic approach, to feed future decision-making tools in the context of the widespread use of intra-day DERs and new market perspectives. The proposed model was tested with hourly wholesale electricity price data from Colombia, and the results were compared with different state-of-the-art forecasting baseline-tuned models such as Holt–Winters, XGBoost, Stacked LSTM, and Attention-LSTM. The findings show that the proposed model outperforms these baselines by effectively incorporating nonlinearity and explicitly modeling the underlying data’s behavior, all of this under four operating scenarios and different performance metrics. This allows it to handle high-, medium-, and low-variability scenarios while maintaining the accuracy and reliability of its predictions. The proposed framework shows potential for significantly improving the accuracy of electricity price forecasts, which can have significant benefits for making informed decisions in the energy sector.

Suggested Citation

  • Sergio Cantillo-Luna & Ricardo Moreno-Chuquen & Jesus Lopez-Sotelo & David Celeita, 2023. "An Intra-Day Electricity Price Forecasting Based on a Probabilistic Transformer Neural Network Architecture," Energies, MDPI, vol. 16(19), pages 1-24, September.
    • Handle: RePEc:gam:jeners:v:16:y:2023:i:19:p:6767-:d:1245577
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/19/6767/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/19/6767/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Brusaferri, Alessandro & Matteucci, Matteo & Portolani, Pietro & Vitali, Andrea, 2019. "Bayesian deep learning based method for probabilistic forecast of day-ahead electricity prices," Applied Energy, Elsevier, vol. 250(C), pages 1158-1175.
    2. Zhang, Jinliang & Tan, Zhongfu & Wei, Yiming, 2020. "An adaptive hybrid model for short term electricity price forecasting," Applied Energy, Elsevier, vol. 258(C).
    3. Jorge Barrientos Marin & Elkin Tabares Orozco & Esteban Velilla, 2018. "Forecasting electricity price in Colombia: A comparison between Neural Network, ARMA process and Hybrid Models," International Journal of Energy Economics and Policy, Econjournals, vol. 8(3), pages 97-106.
    4. Lu, Xin & Qiu, Jing & Lei, Gang & Zhu, Jianguo, 2022. "Scenarios modelling for forecasting day-ahead electricity prices: Case studies in Australia," Applied Energy, Elsevier, vol. 308(C).
    5. Grossi, Luigi & Nan, Fany, 2019. "Robust forecasting of electricity prices: Simulations, models and the impact of renewable sources," Technological Forecasting and Social Change, Elsevier, vol. 141(C), pages 305-318.
    6. Demir, Sumeyra & Mincev, Krystof & Kok, Koen & Paterakis, Nikolaos G., 2021. "Data augmentation for time series regression: Applying transformations, autoencoders and adversarial networks to electricity price forecasting," Applied Energy, Elsevier, vol. 304(C).
    7. Li, Wei & Becker, Denis Mike, 2021. "Day-ahead electricity price prediction applying hybrid models of LSTM-based deep learning methods and feature selection algorithms under consideration of market coupling," Energy, Elsevier, vol. 237(C).
    8. Javier Pórtoles & Camino González & Javier M. Moguerza, 2018. "Electricity Price Forecasting with Dynamic Trees: A Benchmark Against the Random Forest Approach," Energies, MDPI, vol. 11(6), pages 1-21, June.
    9. Meng, Anbo & Wang, Peng & Zhai, Guangsong & Zeng, Cong & Chen, Shun & Yang, Xiaoyi & Yin, Hao, 2022. "Electricity price forecasting with high penetration of renewable energy using attention-based LSTM network trained by crisscross optimization," Energy, Elsevier, vol. 254(PA).
    10. Burger, Scott P. & Luke, Max, 2017. "Business models for distributed energy resources: A review and empirical analysis," Energy Policy, Elsevier, vol. 109(C), pages 230-248.
    11. Hagfors, Lars Ivar & Bunn, Derek & Kristoffersen, Eline & Staver, Tiril Toftdahl & Westgaard, Sjur, 2016. "Modeling the UK electricity price distributions using quantile regression," Energy, Elsevier, vol. 102(C), pages 231-243.
    12. Vasudharini Sridharan & Mingjian Tuo & Xingpeng Li, 2022. "Wholesale Electricity Price Forecasting Using Integrated Long-Term Recurrent Convolutional Network Model," Energies, MDPI, vol. 15(20), pages 1-16, October.
    13. Wang, Jianzhou & Zhou, Yilin & Li, Zhiwu, 2022. "Hour-ahead photovoltaic generation forecasting method based on machine learning and multi objective optimization algorithm," Applied Energy, Elsevier, vol. 312(C).
    14. Sergio Cantillo-Luna & Ricardo Moreno-Chuquen & David Celeita & George Anders, 2023. "Deep and Machine Learning Models to Forecast Photovoltaic Power Generation," Energies, MDPI, vol. 16(10), pages 1-24, May.
    15. Lago, Jesus & De Ridder, Fjo & Vrancx, Peter & De Schutter, Bart, 2018. "Forecasting day-ahead electricity prices in Europe: The importance of considering market integration," Applied Energy, Elsevier, vol. 211(C), pages 890-903.
    16. Rohit Trivedi & Sandipan Patra & Yousra Sidqi & Benjamin Bowler & Fiona Zimmermann & Geert Deconinck & Antonios Papaemmanouil & Shafi Khadem, 2022. "Community-Based Microgrids: Literature Review and Pathways to Decarbonise the Local Electricity Network," Energies, MDPI, vol. 15(3), pages 1-30, January.
    17. Peng, Lu & Wang, Lin & Xia, De & Gao, Qinglu, 2022. "Effective energy consumption forecasting using empirical wavelet transform and long short-term memory," Energy, Elsevier, vol. 238(PB).
    18. Umut Ugurlu & Ilkay Oksuz & Oktay Tas, 2018. "Electricity Price Forecasting Using Recurrent Neural Networks," Energies, MDPI, vol. 11(5), pages 1-23, May.
    19. Haokun Su & Xiangang Peng & Hanyu Liu & Huan Quan & Kaitong Wu & Zhiwen Chen, 2022. "Multi-Step-Ahead Electricity Price Forecasting Based on Temporal Graph Convolutional Network," Mathematics, MDPI, vol. 10(14), pages 1-16, July.
    20. Wang, Deyun & Luo, Hongyuan & Grunder, Olivier & Lin, Yanbing & Guo, Haixiang, 2017. "Multi-step ahead electricity price forecasting using a hybrid model based on two-layer decomposition technique and BP neural network optimized by firefly algorithm," Applied Energy, Elsevier, vol. 190(C), pages 390-407.
    21. Chitalia, Gopal & Pipattanasomporn, Manisa & Garg, Vishal & Rahman, Saifur, 2020. "Robust short-term electrical load forecasting framework for commercial buildings using deep recurrent neural networks," Applied Energy, Elsevier, vol. 278(C).
    22. Yang, Zhang & Ce, Li & Lian, Li, 2017. "Electricity price forecasting by a hybrid model, combining wavelet transform, ARMA and kernel-based extreme learning machine methods," Applied Energy, Elsevier, vol. 190(C), pages 291-305.
    23. Wei Li & Denis Mike Becker, 2021. "Day-ahead electricity price prediction applying hybrid models of LSTM-based deep learning methods and feature selection algorithms under consideration of market coupling," Papers 2101.05249, arXiv.org, revised Jul 2021.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Meng, Anbo & Wang, Peng & Zhai, Guangsong & Zeng, Cong & Chen, Shun & Yang, Xiaoyi & Yin, Hao, 2022. "Electricity price forecasting with high penetration of renewable energy using attention-based LSTM network trained by crisscross optimization," Energy, Elsevier, vol. 254(PA).
    2. Fang Guo & Shangyun Deng & Weijia Zheng & An Wen & Jinfeng Du & Guangshan Huang & Ruiyang Wang, 2022. "Short-Term Electricity Price Forecasting Based on the Two-Layer VMD Decomposition Technique and SSA-LSTM," Energies, MDPI, vol. 15(22), pages 1-20, November.
    3. Jiang, Ping & Nie, Ying & Wang, Jianzhou & Huang, Xiaojia, 2023. "Multivariable short-term electricity price forecasting using artificial intelligence and multi-input multi-output scheme," Energy Economics, Elsevier, vol. 117(C).
    4. Xiong, Xiaoping & Qing, Guohua, 2023. "A hybrid day-ahead electricity price forecasting framework based on time series," Energy, Elsevier, vol. 264(C).
    5. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    6. Daniel Manfre Jaimes & Manuel Zamudio López & Hamidreza Zareipour & Mike Quashie, 2023. "A Hybrid Model for Multi-Day-Ahead Electricity Price Forecasting considering Price Spikes," Forecasting, MDPI, vol. 5(3), pages 1-23, July.
    7. Halužan, Marko & Verbič, Miroslav & Zorić, Jelena, 2022. "An integrated model for electricity market coupling simulations: Evidence from the European power market crossroad," Utilities Policy, Elsevier, vol. 79(C).
    8. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    9. Olivares, Kin G. & Challu, Cristian & Marcjasz, Grzegorz & Weron, Rafał & Dubrawski, Artur, 2023. "Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx," International Journal of Forecasting, Elsevier, vol. 39(2), pages 884-900.
    10. Yin, Linfei & Qiu, Yao, 2022. "Neural network dynamic differential control for long-term price guidance mechanism of flexible energy service providers," Energy, Elsevier, vol. 255(C).
    11. Jasiński, Tomasz, 2020. "Use of new variables based on air temperature for forecasting day-ahead spot electricity prices using deep neural networks: A new approach," Energy, Elsevier, vol. 213(C).
    12. Demir, Sumeyra & Mincev, Krystof & Kok, Koen & Paterakis, Nikolaos G., 2021. "Data augmentation for time series regression: Applying transformations, autoencoders and adversarial networks to electricity price forecasting," Applied Energy, Elsevier, vol. 304(C).
    13. Singh, Priyanka & Kottath, Rahul, 2022. "Influencer-defaulter mutation-based optimization algorithms for predicting electricity prices," Utilities Policy, Elsevier, vol. 79(C).
    14. Yang, Haolin & Schell, Kristen R., 2021. "Real-time electricity price forecasting of wind farms with deep neural network transfer learning and hybrid datasets," Applied Energy, Elsevier, vol. 299(C).
    15. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    16. Bikeri Adline & Kazushi Ikeda, 2023. "A Hawkes Model Approach to Modeling Price Spikes in the Japanese Electricity Market," Energies, MDPI, vol. 16(4), pages 1-20, February.
    17. Stefenon, Stefano Frizzo & Seman, Laio Oriel & Aquino, Luiza Scapinello & Coelho, Leandro dos Santos, 2023. "Wavelet-Seq2Seq-LSTM with attention for time series forecasting of level of dams in hydroelectric power plants," Energy, Elsevier, vol. 274(C).
    18. Yang, Haolin & Schell, Kristen R., 2022. "GHTnet: Tri-Branch deep learning network for real-time electricity price forecasting," Energy, Elsevier, vol. 238(PC).
    19. Gonçalves, Rui & Ribeiro, Vitor Miguel & Pereira, Fernando Lobo, 2023. "Variable Split Convolutional Attention: A novel Deep Learning model applied to the household electric power consumption," Energy, Elsevier, vol. 274(C).
    20. Yuehjen E. Shao & Yi-Shan Tsai, 2018. "Electricity Sales Forecasting Using Hybrid Autoregressive Integrated Moving Average and Soft Computing Approaches in the Absence of Explanatory Variables," Energies, MDPI, vol. 11(7), pages 1-22, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:19:p:6767-:d:1245577. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.