IDEAS home Printed from https://ideas.repec.org/p/hhs/nhhfms/2024_001.html
   My bibliography  Save this paper

Forecasting price spikes in day-ahead electricity markets: techniques, challenges, and the road ahead

Author

Listed:

Abstract

Due to the increase in renewable energy production and global socioeconomic turmoil, the volatility in electricity prices has considerably increased in recent years, leading to extreme positive and negative price spikes in many electricity markets. Forecasting (the risk of) these prices accurately in advance can enable risk-informed decision-making by both consumers and generators, as well as by the grid operators. In this work, focusing on day-ahead markets, we review recent developments in how price spikes are defined, as well as which explanatory factors and methodologies have been used to forecast them. The paper identifies seven categories of influencing factors, which come with over 30 sub-classifications that can cause price spikes. In terms of methodologies, probabilistic models are being increasingly utilized to capture uncertainty in the price forecast. The review uncovers a wide range in all of these choices as well as others, which makes it difficult to compare methods and select best practices for predicting price spikes.

Suggested Citation

  • Sheybanivaziri, Samaneh & Le Dréau, Jérôme & Kazmi, Hussain, 2024. "Forecasting price spikes in day-ahead electricity markets: techniques, challenges, and the road ahead," Discussion Papers 2024/1, Norwegian School of Economics, Department of Business and Management Science.
    • Handle: RePEc:hhs:nhhfms:2024_001
    as

    Download full text from publisher

    File URL: https://hdl.handle.net/11250/3112109
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Katarzyna Hubicka & Grzegorz Marcjasz & Rafal Weron, 2018. "A note on averaging day-ahead electricity price forecasts across calibration windows," HSC Research Reports HSC/18/03, Hugo Steinhaus Center, Wroclaw University of Technology.
    2. Brusaferri, Alessandro & Matteucci, Matteo & Portolani, Pietro & Vitali, Andrea, 2019. "Bayesian deep learning based method for probabilistic forecast of day-ahead electricity prices," Applied Energy, Elsevier, vol. 250(C), pages 1158-1175.
    3. Woo, Chi-Keung, 2001. "What went wrong in California's electricity market?," Energy, Elsevier, vol. 26(8), pages 747-758.
    4. Dudek, Grzegorz, 2016. "Multilayer perceptron for GEFCom2014 probabilistic electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1057-1060.
    5. Doering, Kenji & Sendelbach, Luke & Steinschneider, Scott & Lindsay Anderson, C., 2021. "The effects of wind generation and other market determinants on price spikes," Applied Energy, Elsevier, vol. 300(C).
    6. Zhang, Yao & Wang, Jianxue & Wang, Xifan, 2014. "Review on probabilistic forecasting of wind power generation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 32(C), pages 255-270.
    7. Bartosz Uniejewski & Jakub Nowotarski & Rafał Weron, 2016. "Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 9(8), pages 1-22, August.
    8. Markus Burger & Bernhard Klar & Alfred Muller & Gero Schindlmayr, 2004. "A spot market model for pricing derivatives in electricity markets," Quantitative Finance, Taylor & Francis Journals, vol. 4(1), pages 109-122.
    9. Mount, Timothy D. & Ning, Yumei & Cai, Xiaobin, 2006. "Predicting price spikes in electricity markets using a regime-switching model with time-varying parameters," Energy Economics, Elsevier, vol. 28(1), pages 62-80, January.
    10. Mork, Erling, 2001. "Emergence of financial markets for electricity: a European perspective," Energy Policy, Elsevier, vol. 29(1), pages 7-15, January.
    11. Florian Ziel & Rick Steinert, 2015. "Electricity Price Forecasting using Sale and Purchase Curves: The X-Model," Papers 1509.00372, arXiv.org, revised Aug 2016.
    12. Yuru Guan & Jin Yan & Yuli Shan & Yannan Zhou & Ye Hang & Ruoqi Li & Yu Liu & Binyuan Liu & Qingyun Nie & Benedikt Bruckner & Kuishuang Feng & Klaus Hubacek, 2023. "Burden of the global energy price crisis on households," Nature Energy, Nature, vol. 8(3), pages 304-316, March.
    13. Lu, Xin & Qiu, Jing & Lei, Gang & Zhu, Jianguo, 2022. "Scenarios modelling for forecasting day-ahead electricity prices: Case studies in Australia," Applied Energy, Elsevier, vol. 308(C).
    14. Alexandre Lucas & Konstantinos Pegios & Evangelos Kotsakis & Dan Clarke, 2020. "Price Forecasting for the Balancing Energy Market Using Machine-Learning Regression," Energies, MDPI, vol. 13(20), pages 1-16, October.
    15. Nicolosi, Marco, 2010. "Wind power integration and power system flexibility-An empirical analysis of extreme events in Germany under the new negative price regime," Energy Policy, Elsevier, vol. 38(11), pages 7257-7268, November.
    16. Clements, A.E. & Herrera, R. & Hurn, A.S., 2015. "Modelling interregional links in electricity price spikes," Energy Economics, Elsevier, vol. 51(C), pages 383-393.
    17. Woo, Chi-Keung & Lloyd, Debra & Tishler, Asher, 2003. "Electricity market reform failures: UK, Norway, Alberta and California," Energy Policy, Elsevier, vol. 31(11), pages 1103-1115, September.
    18. Galarneau-Vincent, Rémi & Gauthier, Geneviève & Godin, Frédéric, 2023. "Foreseeing the worst: Forecasting electricity DART spikes," Energy Economics, Elsevier, vol. 119(C).
    19. Anna Cretì & Fulvio Fontini, 2019. "Economics of Electricity. Markets, Competition and Rules," Post-Print hal-02304345, HAL.
    20. Kyritsis, Evangelos & Andersson, Jonas & Serletis, Apostolos, 2017. "Electricity prices, large-scale renewable integration, and policy implications," Energy Policy, Elsevier, vol. 101(C), pages 550-560.
    21. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    22. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    23. Panapakidis, Ioannis P. & Dagoumas, Athanasios S., 2016. "Day-ahead electricity price forecasting via the application of artificial neural network based models," Applied Energy, Elsevier, vol. 172(C), pages 132-151.
    24. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    25. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting with NARX neural networks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1520-1532.
    26. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    27. Tao Hong & Pierre Pinson & Yi Wang & Rafal Weron & Dazhi Yang & Hamidreza Zareipour, 2020. "Energy forecasting: A review and outlook," WORking papers in Management Science (WORMS) WORMS/20/08, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    28. Afanasyev, Dmitriy O. & Fedorova, Elena A., 2019. "On the impact of outlier filtering on the electricity price forecasting accuracy," Applied Energy, Elsevier, vol. 236(C), pages 196-210.
    29. Tomasz Serafin & Bartosz Uniejewski & Rafał Weron, 2019. "Averaging Predictive Distributions Across Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 12(13), pages 1-12, July.
    30. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    31. Ziel, Florian & Steinert, Rick, 2018. "Probabilistic mid- and long-term electricity price forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 94(C), pages 251-266.
    32. repec:qut:auncer:2012_5 is not listed on IDEAS
    33. Lago, Jesus & De Ridder, Fjo & Vrancx, Peter & De Schutter, Bart, 2018. "Forecasting day-ahead electricity prices in Europe: The importance of considering market integration," Applied Energy, Elsevier, vol. 211(C), pages 890-903.
    34. Halbrügge, Stephanie & Schott, Paul & Weibelzahl, Martin & Buhl, Hans Ulrich & Fridgen, Gilbert & Schöpf, Michael, 2021. "How did the German and other European electricity systems react to the COVID-19 pandemic?," Applied Energy, Elsevier, vol. 285(C).
    35. Christoph Bergmeir, 2023. "Common Pitfalls and Better Practices in Forecast Evaluation for Data Scientists," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 70, pages 5-12, Q3.
    36. Florian Ziel & Rick Steinert, 2017. "Probabilistic Mid- and Long-Term Electricity Price Forecasting," Papers 1703.10806, arXiv.org, revised May 2018.
    37. Maciejowska, Katarzyna & Nowotarski, Jakub & Weron, Rafał, 2016. "Probabilistic forecasting of electricity spot prices using Factor Quantile Regression Averaging," International Journal of Forecasting, Elsevier, vol. 32(3), pages 957-965.
    38. Karakoyun, Ece Cigdem & Avci, Harun & Kocaman, Ayse Selin & Nadar, Emre, 2023. "Deviations from commitments: Markov decision process formulations for the role of energy storage," International Journal of Production Economics, Elsevier, vol. 255(C).
    39. Kath, Christopher & Ziel, Florian, 2021. "Conformal prediction interval estimation and applications to day-ahead and intraday power markets," International Journal of Forecasting, Elsevier, vol. 37(2), pages 777-799.
    40. Trujillo-Baute, Elisa & del Río, Pablo & Mir-Artigues, Pere, 2018. "Analysing the impact of renewable energy regulation on retail electricity prices," Energy Policy, Elsevier, vol. 114(C), pages 153-164.
    41. Kazmi, Hussain & Tao, Zhenmin, 2022. "How good are TSO load and renewable generation forecasts: Learning curves, challenges, and the road ahead," Applied Energy, Elsevier, vol. 323(C).
    42. Fanone, Enzo & Gamba, Andrea & Prokopczuk, Marcel, 2013. "The case of negative day-ahead electricity prices," Energy Economics, Elsevier, vol. 35(C), pages 22-34.
    43. Bartosz Uniejewski & Rafal Weron & Florian Ziel, 2017. "Variance stabilizing transformations for electricity spot price forecasting," HSC Research Reports HSC/17/01, Hugo Steinhaus Center, Wroclaw University of Technology.
    44. Numminen, Sini & Ruggiero, Salvatore & Jalas, Mikko, 2022. "Locked in flat tariffs? An analysis of electricity retailers’ dynamic price offerings and attitudes to consumer engagement in demand response," Applied Energy, Elsevier, vol. 326(C).
    45. Herrera, Rodrigo & González, Nicolás, 2014. "The modeling and forecasting of extreme events in electricity spot markets," International Journal of Forecasting, Elsevier, vol. 30(3), pages 477-490.
    46. Janczura, Joanna & Trück, Stefan & Weron, Rafał & Wolff, Rodney C., 2013. "Identifying spikes and seasonal components in electricity spot price data: A guide to robust modeling," Energy Economics, Elsevier, vol. 38(C), pages 96-110.
    47. Bartosz Uniejewski, 2023. "Electricity price forecasting with Smoothing Quantile Regression Averaging: Quantifying economic benefits of probabilistic forecasts," Papers 2302.00411, arXiv.org, revised Jan 2024.
    48. Anwar, Muhammad Bashar & Stephen, Gord & Dalvi, Sourabh & Frew, Bethany & Ericson, Sean & Brown, Maxwell & O’Malley, Mark, 2022. "Modeling investment decisions from heterogeneous firms under imperfect information and risk in wholesale electricity markets," Applied Energy, Elsevier, vol. 306(PA).
    49. Stuart Thomas & Vikash Ramiah & Heather Mitchell & Richard Heaney, 2011. "Seasonal factors and outlier effects in rate of return on electricity spot prices in Australia's National Electricity Market," Applied Economics, Taylor & Francis Journals, vol. 43(3), pages 355-369.
    50. Gaillard, Pierre & Goude, Yannig & Nedellec, Raphaël, 2016. "Additive models and robust aggregation for GEFCom2014 probabilistic electric load and electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1038-1050.
    51. Paraschiv, Florentina & Erni, David & Pietsch, Ralf, 2014. "The impact of renewable energies on EEX day-ahead electricity prices," Energy Policy, Elsevier, vol. 73(C), pages 196-210.
    52. Huisman, Ronald & Mahieu, Ronald, 2003. "Regime jumps in electricity prices," Energy Economics, Elsevier, vol. 25(5), pages 425-434, September.
    53. Muniain, Peru & Ziel, Florian, 2020. "Probabilistic forecasting in day-ahead electricity markets: Simulating peak and off-peak prices," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1193-1210.
    54. Antonio Bello & Javier Reneses & Antonio Muñoz, 2016. "Medium-Term Probabilistic Forecasting of Extremely Low Prices in Electricity Markets: Application to the Spanish Case," Energies, MDPI, vol. 9(3), pages 1-27, March.
    55. Rintamäki, Tuomas & Siddiqui, Afzal S. & Salo, Ahti, 2017. "Does renewable energy generation decrease the volatility of electricity prices? An analysis of Denmark and Germany," Energy Economics, Elsevier, vol. 62(C), pages 270-282.
    56. Usman Zafar & Neil Kellard & Dmitri Vinogradov, 2022. "Multistage optimization filter for trend‐based short‐term forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(2), pages 345-360, March.
    57. Jin, Xiaolong & Wu, Qiuwei & Jia, Hongjie, 2020. "Local flexibility markets: Literature review on concepts, models and clearing methods," Applied Energy, Elsevier, vol. 261(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    3. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    4. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    5. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    6. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    7. Stephen Haben & Julien Caudron & Jake Verma, 2021. "Probabilistic Day-Ahead Wholesale Price Forecast: A Case Study in Great Britain," Forecasting, MDPI, vol. 3(3), pages 1-37, August.
    8. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    9. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    10. Bartosz Uniejewski, 2023. "Electricity price forecasting with Smoothing Quantile Regression Averaging: Quantifying economic benefits of probabilistic forecasts," Papers 2302.00411, arXiv.org, revised Jan 2024.
    11. Tomasz Serafin & Bartosz Uniejewski & Rafał Weron, 2019. "Averaging Predictive Distributions Across Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 12(13), pages 1-12, July.
    12. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    13. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    14. Mira Watermeyer & Thomas Mobius & Oliver Grothe & Felix Musgens, 2023. "A hybrid model for day-ahead electricity price forecasting: Combining fundamental and stochastic modelling," Papers 2304.09336, arXiv.org.
    15. Hakan Acaroğlu & Fausto Pedro García Márquez, 2021. "Comprehensive Review on Electricity Market Price and Load Forecasting Based on Wind Energy," Energies, MDPI, vol. 14(22), pages 1-23, November.
    16. Olivares, Kin G. & Challu, Cristian & Marcjasz, Grzegorz & Weron, Rafał & Dubrawski, Artur, 2023. "Neural basis expansion analysis with exogenous variables: Forecasting electricity prices with NBEATSx," International Journal of Forecasting, Elsevier, vol. 39(2), pages 884-900.
    17. Arkadiusz Jędrzejewski & Grzegorz Marcjasz & Rafał Weron, 2021. "Importance of the Long-Term Seasonal Component in Day-Ahead Electricity Price Forecasting Revisited: Parameter-Rich Models Estimated via the LASSO," Energies, MDPI, vol. 14(11), pages 1-17, June.
    18. Katarzyna Maciejowska & Weronika Nitka & Tomasz Weron, 2019. "Enhancing load, wind and solar generation forecasts in day-ahead forecasting of spot and intraday electricity prices," HSC Research Reports HSC/19/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    19. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting with NARX neural networks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1520-1532.
    20. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.

    More about this item

    Keywords

    Spikes; Electricity markets; Day-ahead market; Point forecast; Probabilistic forecasts;
    All these keywords.

    JEL classification:

    • C00 - Mathematical and Quantitative Methods - - General - - - General
    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hhs:nhhfms:2024_001. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Stein Fossen (email available below). General contact details of provider: https://edirc.repec.org/data/dfnhhno.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.