IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v244y2022ipbs036054422200010x.html
   My bibliography  Save this article

Data-driven modeling for long-term electricity price forecasting

Author

Listed:
  • Gabrielli, Paolo
  • Wüthrich, Moritz
  • Blume, Steffen
  • Sansavini, Giovanni

Abstract

Estimating the financial viability of renewable energy investments requires the availability of long-term, finely-resolved electricity prices over the investment lifespan. This entails, however, two major challenges: (i) the combination of extensive time horizons and fine time resolutions, and (ii) the prediction of out-of-sample electricity prices in future energy and market scenarios, or shifts in pricing regime, that were not observed in the past. This paper tackles such challenges by proposing a data-driven model for the long-term prediction of electricity market prices that is based on Fourier analysis. The electricity price is decomposed into components leading to its base evolution, which are described through the amplitudes of the main frequencies of the Fourier series, and components leading to high price volatility, which are described by the residual frequencies. The former are predicted via a regression model that uses as input annual values of relevant energy and market quantities, such as electricity generation, prices and demands. The proposed method shows capable of (i) predicting the most relevant dynamics of the electricity price; (ii) generalization by capturing the market mechanisms of previously unseen electricity markets. These findings support the relevance and validity of data-driven, finely-resolved, long-term predictions and highlight the potential for hybrid data-driven and market-based models.

Suggested Citation

  • Gabrielli, Paolo & Wüthrich, Moritz & Blume, Steffen & Sansavini, Giovanni, 2022. "Data-driven modeling for long-term electricity price forecasting," Energy, Elsevier, vol. 244(PB).
    • Handle: RePEc:eee:energy:v:244:y:2022:i:pb:s036054422200010x
    DOI: 10.1016/j.energy.2022.123107
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S036054422200010X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2022.123107?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chan, Kam Fong & Gray, Philip & van Campen, Bart, 2008. "A new approach to characterizing and forecasting electricity price volatility," International Journal of Forecasting, Elsevier, vol. 24(4), pages 728-743.
    2. Chang, Zihan & Zhang, Yang & Chen, Wenbo, 2019. "Electricity price prediction based on hybrid model of adam optimized LSTM neural network and wavelet transform," Energy, Elsevier, vol. 187(C).
    3. Niu, Hongli & Xu, Kunliang & Liu, Cheng, 2021. "A decomposition-ensemble model with regrouping method and attention-based gated recurrent unit network for energy price prediction," Energy, Elsevier, vol. 231(C).
    4. Singh, Nitin & Mohanty, Soumya Ranjan & Dev Shukla, Rishabh, 2017. "Short term electricity price forecast based on environmentally adapted generalized neuron," Energy, Elsevier, vol. 125(C), pages 127-139.
    5. Coester, Andreas & Hofkes, Marjan W. & Papyrakis, Elissaios, 2018. "Economics of renewable energy expansion and security of supply: A dynamic simulation of the German electricity market," Applied Energy, Elsevier, vol. 231(C), pages 1268-1284.
    6. Panapakidis, Ioannis P. & Dagoumas, Athanasios S., 2016. "Day-ahead electricity price forecasting via the application of artificial neural network based models," Applied Energy, Elsevier, vol. 172(C), pages 132-151.
    7. Kristiansen, Tarjei, 2012. "Forecasting Nord Pool day-ahead prices with an autoregressive model," Energy Policy, Elsevier, vol. 49(C), pages 328-332.
    8. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    9. Hagfors, Lars Ivar & Bunn, Derek & Kristoffersen, Eline & Staver, Tiril Toftdahl & Westgaard, Sjur, 2016. "Modeling the UK electricity price distributions using quantile regression," Energy, Elsevier, vol. 102(C), pages 231-243.
    10. Tan, Zhongfu & Zhang, Jinliang & Wang, Jianhui & Xu, Jun, 2010. "Day-ahead electricity price forecasting using wavelet transform combined with ARIMA and GARCH models," Applied Energy, Elsevier, vol. 87(11), pages 3606-3610, November.
    11. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    12. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    13. He, Kaijian & Yu, Lean & Tang, Ling, 2015. "Electricity price forecasting with a BED (Bivariate EMD Denoising) methodology," Energy, Elsevier, vol. 91(C), pages 601-609.
    14. Lago, Jesus & De Ridder, Fjo & Vrancx, Peter & De Schutter, Bart, 2018. "Forecasting day-ahead electricity prices in Europe: The importance of considering market integration," Applied Energy, Elsevier, vol. 211(C), pages 890-903.
    15. Gjorgiev, Blazhe & Garrison, Jared B. & Han, Xuejiao & Landis, Florian & van Nieuwkoop, Renger & Raycheva, Elena & Schwarz, Marius & Yan, Xuqian & Demiray, Turhan & Hug, Gabriela & Sansavini, Giovanni, 2022. "Nexus-e: A platform of interfaced high-resolution models for energy-economic assessments of future electricity systems," Applied Energy, Elsevier, vol. 307(C).
    16. Bello, Antonio & Reneses, Javier & Muñoz, Antonio & Delgadillo, Andrés, 2016. "Probabilistic forecasting of hourly electricity prices in the medium-term using spatial interpolation techniques," International Journal of Forecasting, Elsevier, vol. 32(3), pages 966-980.
    17. Mohamed, Zaid & Bodger, Pat, 2005. "Forecasting electricity consumption in New Zealand using economic and demographic variables," Energy, Elsevier, vol. 30(10), pages 1833-1843.
    18. López Prol, Javier & Steininger, Karl W. & Zilberman, David, 2020. "The cannibalization effect of wind and solar in the California wholesale electricity market," Energy Economics, Elsevier, vol. 85(C).
    19. Aatola, Piia & Ollikainen, Markku & Toppinen, Anne, 2013. "Impact of the carbon price on the integrating European electricity market," Energy Policy, Elsevier, vol. 61(C), pages 1236-1251.
    20. Antonio Bello & Derek Bunn & Javier Reneses & Antonio Muñoz, 2016. "Parametric Density Recalibration of a Fundamental Market Model to Forecast Electricity Prices," Energies, MDPI, vol. 9(11), pages 1-15, November.
    21. Yukseltan, Ergun & Yucekaya, Ahmet & Bilge, Ayse Humeyra, 2017. "Forecasting electricity demand for Turkey: Modeling periodic variations and demand segregation," Applied Energy, Elsevier, vol. 193(C), pages 287-296.
    22. Amjady, N. & Keynia, F., 2009. "Short-term load forecasting of power systems by combination of wavelet transform and neuro-evolutionary algorithm," Energy, Elsevier, vol. 34(1), pages 46-57.
    23. Qiao, Weibiao & Yang, Zhe, 2020. "Forecast the electricity price of U.S. using a wavelet transform-based hybrid model," Energy, Elsevier, vol. 193(C).
    24. Florian Ziel & Rick Steinert, 2017. "Probabilistic Mid- and Long-Term Electricity Price Forecasting," Papers 1703.10806, arXiv.org, revised May 2018.
    25. Peng, Lu & Liu, Shan & Liu, Rui & Wang, Lin, 2018. "Effective long short-term memory with differential evolution algorithm for electricity price prediction," Energy, Elsevier, vol. 162(C), pages 1301-1314.
    26. Paraschiv, Florentina & Erni, David & Pietsch, Ralf, 2014. "The impact of renewable energies on EEX day-ahead electricity prices," Energy Policy, Elsevier, vol. 73(C), pages 196-210.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yin, Linfei & Qiu, Yao, 2022. "Neural network dynamic differential control for long-term price guidance mechanism of flexible energy service providers," Energy, Elsevier, vol. 255(C).
    2. Scheben, Heike & Hufendiek, Kai, 2023. "Modelling power prices in markets with high shares of renewable energies and storages—The Norwegian example," Energy, Elsevier, vol. 267(C).
    3. Gabrielli, Paolo & Aboutalebi, Reyhaneh & Sansavini, Giovanni, 2022. "Mitigating financial risk of corporate power purchase agreements via portfolio optimization," Energy Economics, Elsevier, vol. 109(C).
    4. Caputo, Antonio C. & Federici, Alessandro & Pelagagge, Pacifico M. & Salini, Paolo, 2023. "Offshore wind power system economic evaluation framework under aleatory and epistemic uncertainty," Applied Energy, Elsevier, vol. 350(C).
    5. Hamed, Mohammad M. & Ali, Hesham & Abdelal, Qasem, 2022. "Forecasting annual electric power consumption using a random parameters model with heterogeneity in means and variances," Energy, Elsevier, vol. 255(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Luyao & Bai, Feifei & Su, Chenyu & Ma, Cuiping & Yan, Ruifeng & Li, Hailong & Sun, Qie & Wennersten, Ronald, 2022. "Forecasting the occurrence of extreme electricity prices using a multivariate logistic regression model," Energy, Elsevier, vol. 247(C).
    2. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    3. Qiao, Weibiao & Yang, Zhe, 2020. "Forecast the electricity price of U.S. using a wavelet transform-based hybrid model," Energy, Elsevier, vol. 193(C).
    4. Hakan Acaroğlu & Fausto Pedro García Márquez, 2021. "Comprehensive Review on Electricity Market Price and Load Forecasting Based on Wind Energy," Energies, MDPI, vol. 14(22), pages 1-23, November.
    5. Díaz, Guzmán & Coto, José & Gómez-Aleixandre, Javier, 2019. "Prediction and explanation of the formation of the Spanish day-ahead electricity price through machine learning regression," Applied Energy, Elsevier, vol. 239(C), pages 610-625.
    6. Brusaferri, Alessandro & Matteucci, Matteo & Portolani, Pietro & Vitali, Andrea, 2019. "Bayesian deep learning based method for probabilistic forecast of day-ahead electricity prices," Applied Energy, Elsevier, vol. 250(C), pages 1158-1175.
    7. Elmore, Clay T. & Dowling, Alexander W., 2021. "Learning spatiotemporal dynamics in wholesale energy markets with dynamic mode decomposition," Energy, Elsevier, vol. 232(C).
    8. Chang, Zihan & Zhang, Yang & Chen, Wenbo, 2019. "Electricity price prediction based on hybrid model of adam optimized LSTM neural network and wavelet transform," Energy, Elsevier, vol. 187(C).
    9. Fang Guo & Shangyun Deng & Weijia Zheng & An Wen & Jinfeng Du & Guangshan Huang & Ruiyang Wang, 2022. "Short-Term Electricity Price Forecasting Based on the Two-Layer VMD Decomposition Technique and SSA-LSTM," Energies, MDPI, vol. 15(22), pages 1-20, November.
    10. Sheybanivaziri, Samaneh & Le Dréau, Jérôme & Kazmi, Hussain, 2024. "Forecasting price spikes in day-ahead electricity markets: techniques, challenges, and the road ahead," Discussion Papers 2024/1, Norwegian School of Economics, Department of Business and Management Science.
    11. Li, Wei & Becker, Denis Mike, 2021. "Day-ahead electricity price prediction applying hybrid models of LSTM-based deep learning methods and feature selection algorithms under consideration of market coupling," Energy, Elsevier, vol. 237(C).
    12. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    13. Umut Ugurlu & Ilkay Oksuz & Oktay Tas, 2018. "Electricity Price Forecasting Using Recurrent Neural Networks," Energies, MDPI, vol. 11(5), pages 1-23, May.
    14. Rodrigo A. de Marcos & Derek W. Bunn & Antonio Bello & Javier Reneses, 2020. "Short-Term Electricity Price Forecasting with Recurrent Regimes and Structural Breaks," Energies, MDPI, vol. 13(20), pages 1-14, October.
    15. Gianfreda, Angelica & Ravazzolo, Francesco & Rossini, Luca, 2020. "Comparing the forecasting performances of linear models for electricity prices with high RES penetration," International Journal of Forecasting, Elsevier, vol. 36(3), pages 974-986.
    16. Ismael Ahrazem Dfuf & José Manuel Mira McWilliams & María Camino González Fernández, 2019. "Multi-Output Conditional Inference Trees Applied to the Electricity Market: Variable Importance Analysis," Energies, MDPI, vol. 12(6), pages 1-24, March.
    17. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    18. Yang, Haolin & Schell, Kristen R., 2022. "GHTnet: Tri-Branch deep learning network for real-time electricity price forecasting," Energy, Elsevier, vol. 238(PC).
    19. Derek W. Bunn & Angelica Gianfreda & Stefan Kermer, 2018. "A Trading-Based Evaluation of Density Forecasts in a Real-Time Electricity Market," Energies, MDPI, vol. 11(10), pages 1-13, October.
    20. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:244:y:2022:i:pb:s036054422200010x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.