IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2403.05743.html

Probabilistic Forecasting of Real-Time Electricity Market Signals via Interpretable Generative AI

Author

Listed:
  • Xinyi Wang
  • Qing Zhao
  • Lang Tong

Abstract

This paper introduces a generative AI approach to probabilistic forecasting of real-time electricity market signals, including locational marginal prices, interregional price spreads, and demand-supply imbalances. We present WIAE-GPF, a Weak Innovation AutoEncoder-based Generative Probabilistic Forecasting architecture that generates future samples of multivariate time series. Unlike traditional black-box models, WIAE-GPF offers interpretability through the Wiener-Kallianpur innovation representation for nonparametric time series, making it a nonparametric generalization of the Wiener/Kalman filter-based forecasting. A novel learning algorithm with structural convergence guarantees is proposed, ensuring that, under ideal training conditions, the generated forecast samples match the ground truth conditional probability distribution. Extensive tests using publicly available data from U.S. independent system operators under various point and probabilistic forecasting metrics demonstrate that WIAE-GPF consistently outperforms classical methods and cutting-edge machine learning techniques.

Suggested Citation

  • Xinyi Wang & Qing Zhao & Lang Tong, 2024. "Probabilistic Forecasting of Real-Time Electricity Market Signals via Interpretable Generative AI," Papers 2403.05743, arXiv.org, revised Sep 2024.
    • Handle: RePEc:arx:papers:2403.05743
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2403.05743
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dudek, Grzegorz, 2016. "Multilayer perceptron for GEFCom2014 probabilistic electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1057-1060.
    2. Weron, Rafal & Misiorek, Adam, 2008. "Forecasting spot electricity prices: A comparison of parametric and semiparametric time series models," International Journal of Forecasting, Elsevier, vol. 24(4), pages 744-763.
    3. Wolfgang Härdle & Helmut Lütkepohl & Rong Chen, 1997. "A Review of Nonparametric Time Series Analysis," International Statistical Review, International Statistical Institute, vol. 65(1), pages 49-72, April.
    4. Gaillard, Pierre & Goude, Yannig & Nedellec, Raphaël, 2016. "Additive models and robust aggregation for GEFCom2014 probabilistic electric load and electricity price forecasting," International Journal of Forecasting, Elsevier, vol. 32(3), pages 1038-1050.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Grzegorz Marcjasz & Tomasz Serafin & Rafał Weron, 2018. "Selection of Calibration Windows for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 11(9), pages 1-20, September.
    2. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting with NARX neural networks," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1520-1532.
    3. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    4. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
    5. Carlo Fezzi & Luca Mosetti, 2020. "Size Matters: Estimation Sample Length and Electricity Price Forecasting Accuracy," The Energy Journal, , vol. 41(4), pages 231-254, July.
    6. Bartosz Uniejewski & Jakub Nowotarski & Rafał Weron, 2016. "Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 9(8), pages 1-22, August.
    7. Ziel, Florian & Weron, Rafał, 2018. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate modeling frameworks," Energy Economics, Elsevier, vol. 70(C), pages 396-420.
    8. Claudio Monteiro & Ignacio J. Ramirez-Rosado & L. Alfredo Fernandez-Jimenez, 2018. "Probabilistic Electricity Price Forecasting Models by Aggregation of Competitive Predictors," Energies, MDPI, vol. 11(5), pages 1-25, April.
    9. Grzegorz Marcjasz & Bartosz Uniejewski & Rafal Weron, 2017. "Importance of the long-term seasonal component in day-ahead electricity price forecasting revisited: Neural network models," HSC Research Reports HSC/17/03, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
    10. Florian Ziel & Rafal Weron, 2016. "Day-ahead electricity price forecasting with high-dimensional structures: Univariate vs. multivariate models," HSC Research Reports HSC/16/08, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
    11. Gunnhildur H. Steinbakk & Alex Lenkoski & Ragnar Bang Huseby & Anders L{o}land & Tor Arne {O}ig{aa}rd, 2018. "Using published bid/ask curves to error dress spot electricity price forecasts," Papers 1812.02433, arXiv.org.
    12. Carlo Fezzi & Luca Mosetti, 2018. "Size matters: Estimation sample length and electricity price forecasting accuracy," DEM Working Papers 2018/10, Department of Economics and Management.
    13. Avci, Ezgi & Ketter, Wolfgang & van Heck, Eric, 2018. "Managing electricity price modeling risk via ensemble forecasting: The case of Turkey," Energy Policy, Elsevier, vol. 123(C), pages 390-403.
    14. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    15. Vijay, Avinash & Fouquet, Nicolas & Staffell, Iain & Hawkes, Adam, 2017. "The value of electricity and reserve services in low carbon electricity systems," Applied Energy, Elsevier, vol. 201(C), pages 111-123.
    16. Ciaran O'Connor & Mohamed Bahloul & Steven Prestwich & Andrea Visentin, 2025. "The Evolution of Probabilistic Price Forecasting Techniques: A Review of the Day-Ahead, Intra-Day, and Balancing Markets," Papers 2511.05523, arXiv.org.
    17. Sheybanivaziri, Samaneh & Le Dréau, Jérôme & Kazmi, Hussain, 2024. "Forecasting price spikes in day-ahead electricity markets: techniques, challenges, and the road ahead," Discussion Papers 2024/1, Norwegian School of Economics, Department of Business and Management Science.
    18. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    19. Ziel, Florian & Steinert, Rick, 2016. "Electricity price forecasting using sale and purchase curves: The X-Model," Energy Economics, Elsevier, vol. 59(C), pages 435-454.
    20. Halužan, Marko & Verbič, Miroslav & Zorić, Jelena, 2020. "Performance of alternative electricity price forecasting methods: Findings from the Greek and Hungarian power exchanges," Applied Energy, Elsevier, vol. 277(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2403.05743. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.