IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v346y2023ics0306261923007341.html
   My bibliography  Save this article

Multivariate probabilistic forecasting of intraday electricity prices using normalizing flows

Author

Listed:
  • Cramer, Eike
  • Witthaut, Dirk
  • Mitsos, Alexander
  • Dahmen, Manuel

Abstract

Electricity is traded on various markets with different time horizons and regulations. Short-term intraday trading becomes increasingly important due to the higher penetration of renewables. In Germany, the intraday electricity price typically fluctuates around the day-ahead price of the European Power EXchange (EPEX) spot markets in a distinct hourly pattern. This work proposes a probabilistic modeling approach that models the intraday price difference to the day-ahead contracts. The model captures the emerging hourly pattern by considering the four 15min intervals in each day-ahead price interval as a four-dimensional joint probability distribution. The resulting nontrivial, multivariate price difference distribution is learned using a normalizing flow, i.e., a deep generative model that combines conditional multivariate density estimation and probabilistic regression. Furthermore, this work discusses the influence of different external impact factors based on literature insights and impact analysis using explainable artificial intelligence (XAI). The normalizing flow is compared to an informed selection of historical data and probabilistic forecasts using a Gaussian copula and a Gaussian regression model. Among the different models, the normalizing flow identifies the trends with the highest accuracy and has the narrowest prediction intervals. Both the XAI analysis and the empirical experiments highlight that the immediate history of the price difference realization and the increments of the day-ahead price have the most substantial impact on the price difference.

Suggested Citation

  • Cramer, Eike & Witthaut, Dirk & Mitsos, Alexander & Dahmen, Manuel, 2023. "Multivariate probabilistic forecasting of intraday electricity prices using normalizing flows," Applied Energy, Elsevier, vol. 346(C).
  • Handle: RePEc:eee:appene:v:346:y:2023:i:c:s0306261923007341
    DOI: 10.1016/j.apenergy.2023.121370
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923007341
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2023.121370?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Panagiotelis, Anastasios & Smith, Michael, 2008. "Bayesian density forecasting of intraday electricity prices using multivariate skew t distributions," International Journal of Forecasting, Elsevier, vol. 24(4), pages 710-727.
    2. Narajewski, Michał & Ziel, Florian, 2020. "Econometric modelling and forecasting of intraday electricity prices," Journal of Commodity Markets, Elsevier, vol. 19(C).
    3. Arkadiusz Jk{e}drzejewski & Jesus Lago & Grzegorz Marcjasz & Rafa{l} Weron, 2022. "Electricity Price Forecasting: The Dawn of Machine Learning," Papers 2204.00883, arXiv.org.
    4. Mayer, Klaus & Trück, Stefan, 2018. "Electricity markets around the world," Journal of Commodity Markets, Elsevier, vol. 9(C), pages 77-100.
    5. Kiesel, Rüdiger & Paraschiv, Florentina, 2017. "Econometric analysis of 15-minute intraday electricity prices," Energy Economics, Elsevier, vol. 64(C), pages 77-90.
    6. Galina Alova & Philipp A. Trotter & Alex Money, 2021. "A machine-learning approach to predicting Africa’s electricity mix based on planned power plants and their chances of success," Nature Energy, Nature, vol. 6(2), pages 158-166, February.
    7. Dumas, Jonathan & Wehenkel, Antoine & Lanaspeze, Damien & Cornélusse, Bertrand & Sutera, Antonio, 2022. "A deep generative model for probabilistic energy forecasting in power systems: normalizing flows," Applied Energy, Elsevier, vol. 305(C).
    8. Weron, Rafał, 2014. "Electricity price forecasting: A review of the state-of-the-art with a look into the future," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1030-1081.
    9. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    10. Serafin, Tomasz & Marcjasz, Grzegorz & Weron, Rafał, 2022. "Trading on short-term path forecasts of intraday electricity prices," Energy Economics, Elsevier, vol. 112(C).
    11. Huisman, Ronald & Huurman, Christian & Mahieu, Ronald, 2007. "Hourly electricity prices in day-ahead markets," Energy Economics, Elsevier, vol. 29(2), pages 240-248, March.
    12. José R. Andrade & Jorge Filipe & Marisa Reis & Ricardo J. Bessa, 2017. "Probabilistic Price Forecasting for Day-Ahead and Intraday Markets: Beyond the Statistical Model," Sustainability, MDPI, vol. 9(11), pages 1-29, October.
    13. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    14. Sensfuß, Frank & Ragwitz, Mario & Genoese, Massimo, 2008. "The merit-order effect: A detailed analysis of the price effect of renewable electricity generation on spot market prices in Germany," Energy Policy, Elsevier, vol. 36(8), pages 3076-3084, August.
    15. Jihoon Moon & Sungwoo Park & Seungmin Rho & Eenjun Hwang, 2019. "A comparative analysis of artificial neural network architectures for building energy consumption forecasting," International Journal of Distributed Sensor Networks, , vol. 15(9), pages 15501477198, September.
    16. Sergei Kulakov & Florian Ziel, 2019. "The Impact of Renewable Energy Forecasts on Intraday Electricity Prices," Papers 1903.09641, arXiv.org, revised Nov 2019.
    17. Pinson, P. & Girard, R., 2012. "Evaluating the quality of scenarios of short-term wind power generation," Applied Energy, Elsevier, vol. 96(C), pages 12-20.
    18. Tryggvi Jónsson & Pierre Pinson & Henrik Madsen & Henrik Aalborg Nielsen, 2014. "Predictive Densities for Day-Ahead Electricity Prices Using Time-Adaptive Quantile Regression," Energies, MDPI, vol. 7(9), pages 1-25, August.
    19. Serinaldi, Francesco, 2011. "Distributional modeling and short-term forecasting of electricity prices by Generalized Additive Models for Location, Scale and Shape," Energy Economics, Elsevier, vol. 33(6), pages 1216-1226.
    20. Tilmann Gneiting & Larissa Stanberry & Eric Grimit & Leonhard Held & Nicholas Johnson, 2008. "Rejoinder on: Assessing probabilistic forecasts of multivariate quantities, with an application to ensemble predictions of surface winds," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 17(2), pages 256-264, August.
    21. Spodniak, Petr & Ollikka, Kimmo & Honkapuro, Samuli, 2021. "The impact of wind power and electricity demand on the relevance of different short-term electricity markets: The Nordic case," Applied Energy, Elsevier, vol. 283(C).
    22. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    23. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    24. Tilmann Gneiting & Larissa Stanberry & Eric Grimit & Leonhard Held & Nicholas Johnson, 2008. "Assessing probabilistic forecasts of multivariate quantities, with an application to ensemble predictions of surface winds," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 17(2), pages 211-235, August.
    25. Conor Sweeney & Ricardo J. Bessa & Jethro Browell & Pierre Pinson, 2020. "The future of forecasting for renewable energy," Wiley Interdisciplinary Reviews: Energy and Environment, Wiley Blackwell, vol. 9(2), March.
    26. Gürtler, Marc & Paulsen, Thomas, 2018. "The effect of wind and solar power forecasts on day-ahead and intraday electricity prices in Germany," Energy Economics, Elsevier, vol. 75(C), pages 150-162.
    27. Bartosz Uniejewski & Rafal Weron & Florian Ziel, 2017. "Variance stabilizing transformations for electricity spot price forecasting," HSC Research Reports HSC/17/01, Hugo Steinhaus Center, Wroclaw University of Technology.
    28. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    29. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    30. Bublitz, Andreas & Keles, Dogan & Zimmermann, Florian & Fraunholz, Christoph & Fichtner, Wolf, 2019. "A survey on electricity market design: Insights from theory and real-world implementations of capacity remuneration mechanisms," Energy Economics, Elsevier, vol. 80(C), pages 1059-1078.
    31. Koch, Christopher & Hirth, Lion, 2019. "Short-term electricity trading for system balancing: An empirical analysis of the role of intraday trading in balancing Germany's electricity system," Renewable and Sustainable Energy Reviews, Elsevier, vol. 113(C), pages 1-1.
    32. Uniejewski, Bartosz & Weron, Rafał, 2021. "Regularized quantile regression averaging for probabilistic electricity price forecasting," Energy Economics, Elsevier, vol. 95(C).
    33. Badesa, Luis & Strbac, Goran & Magill, Matt & Stojkovska, Biljana, 2021. "Ancillary services in Great Britain during the COVID-19 lockdown: A glimpse of the carbon-free future," Applied Energy, Elsevier, vol. 285(C).
    34. Huurman, Christian & Ravazzolo, Francesco & Zhou, Chen, 2012. "The power of weather," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3793-3807.
    35. Pape, Christian & Hagemann, Simon & Weber, Christoph, 2016. "Are fundamentals enough? Explaining price variations in the German day-ahead and intraday power market," Energy Economics, Elsevier, vol. 54(C), pages 376-387.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Narajewski, Michał & Ziel, Florian, 2020. "Ensemble forecasting for intraday electricity prices: Simulating trajectories," Applied Energy, Elsevier, vol. 279(C).
    2. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    3. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    4. Michał Narajewski, 2022. "Probabilistic Forecasting of German Electricity Imbalance Prices," Energies, MDPI, vol. 15(14), pages 1-17, July.
    5. Micha{l} Narajewski & Florian Ziel, 2020. "Ensemble Forecasting for Intraday Electricity Prices: Simulating Trajectories," Papers 2005.01365, arXiv.org, revised Aug 2020.
    6. Micha{l} Narajewski & Florian Ziel, 2021. "Optimal bidding in hourly and quarter-hourly electricity price auctions: trading large volumes of power with market impact and transaction costs," Papers 2104.14204, arXiv.org, revised Feb 2022.
    7. Serafin, Tomasz & Marcjasz, Grzegorz & Weron, Rafał, 2022. "Trading on short-term path forecasts of intraday electricity prices," Energy Economics, Elsevier, vol. 112(C).
    8. Micha{l} Narajewski, 2022. "Probabilistic forecasting of German electricity imbalance prices," Papers 2205.11439, arXiv.org.
    9. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    10. Janczura, Joanna & Wójcik, Edyta, 2022. "Dynamic short-term risk management strategies for the choice of electricity market based on probabilistic forecasts of profit and risk measures. The German and the Polish market case study," Energy Economics, Elsevier, vol. 110(C).
    11. Narajewski, Michał & Ziel, Florian, 2022. "Optimal bidding in hourly and quarter-hourly electricity price auctions: Trading large volumes of power with market impact and transaction costs," Energy Economics, Elsevier, vol. 110(C).
    12. Gianfreda, Angelica & Ravazzolo, Francesco & Rossini, Luca, 2020. "Comparing the forecasting performances of linear models for electricity prices with high RES penetration," International Journal of Forecasting, Elsevier, vol. 36(3), pages 974-986.
    13. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Technology.
    14. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "Understanding intraday electricity markets: Variable selection and very short-term price forecasting using LASSO," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1533-1547.
    15. Grothe, Oliver & Kächele, Fabian & Krüger, Fabian, 2023. "From point forecasts to multivariate probabilistic forecasts: The Schaake shuffle for day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 120(C).
    16. Hakan Acaroğlu & Fausto Pedro García Márquez, 2021. "Comprehensive Review on Electricity Market Price and Load Forecasting Based on Wind Energy," Energies, MDPI, vol. 14(22), pages 1-23, November.
    17. Bartosz Uniejewski, 2023. "Electricity price forecasting with Smoothing Quantile Regression Averaging: Quantifying economic benefits of probabilistic forecasts," Papers 2302.00411, arXiv.org, revised Jan 2024.
    18. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    19. Li, Wei & Paraschiv, Florentina, 2022. "Modelling the evolution of wind and solar power infeed forecasts," Journal of Commodity Markets, Elsevier, vol. 25(C).
    20. Simon Hirsch & Florian Ziel, 2022. "Simulation-based Forecasting for Intraday Power Markets: Modelling Fundamental Drivers for Location, Shape and Scale of the Price Distribution," Papers 2211.13002, arXiv.org.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:346:y:2023:i:c:s0306261923007341. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.