IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v357y2024ics0306261923018020.html
   My bibliography  Save this article

Dependence structure learning and joint probabilistic forecasting of stochastic power grid variables

Author

Listed:
  • Stover, Oliver
  • Nath, Paromita
  • Karve, Pranav
  • Mahadevan, Sankaran
  • Baroud, Hiba

Abstract

Stochastic optimization is a promising approach to support a reliable and cost-efficient transition to a renewable generation-dominated power grid. However, utilization of this approach requires accurate and computationally affordable probabilistic forecasts that rigorously quantify the uncertainty in and the correlation between stochastic grid variables (wind/solar generation and load demand). We investigate and compare two types of probabilistic forecasting model architectures for jointly predicting stochastic variables in a power grid: sequence-to-sequence models and recursive one step ahead prediction models. A long short-term memory (LSTM) neural network model is chosen to represent sequence-to-sequence deep learning models and a periodic vector autoregressive (PVAR) model is chosen to represent the one step ahead recursive models. For each model architecture, we consider three forecasting approaches: predicting each time series variable separately, jointly predicting all time series variables of a given type (e.g., wind generation or load), or jointly predicting all time series variables. We quantify the predictive capability of these forecasting models with respect to accuracy degradation with increasing prediction horizon, ability to characterize uncertainty, and ability to capture cross-variable dependence structure. We train and test the forecasting models using publicly available zonal power supply and demand time series data for the French power grid. We find that different modeling architectures/approaches show superior forecasting capability for different prediction horizons. Our results show that in general, one step-ahead recursive (PVAR) models have high prediction accuracy for short forecast horizons, and sequence-to-sequence (LSTM) models have slower performance degradation for longer forecast horizons.

Suggested Citation

  • Stover, Oliver & Nath, Paromita & Karve, Pranav & Mahadevan, Sankaran & Baroud, Hiba, 2024. "Dependence structure learning and joint probabilistic forecasting of stochastic power grid variables," Applied Energy, Elsevier, vol. 357(C).
  • Handle: RePEc:eee:appene:v:357:y:2024:i:c:s0306261923018020
    DOI: 10.1016/j.apenergy.2023.122438
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923018020
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2023.122438?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bingqing Huang & Haonan Zheng & Xinbo Guo & Yi Yang & Ximing Liu, 2021. "A Novel Model Based on DA-RNN Network and Skip Gated Recurrent Neural Network for Periodic Time Series Forecasting," Sustainability, MDPI, vol. 14(1), pages 1-14, December.
    2. Philippe Lauret & Mathieu David & Hugo T. C. Pedro, 2017. "Probabilistic Solar Forecasting Using Quantile Regression Models," Energies, MDPI, vol. 10(10), pages 1-17, October.
    3. Stover, Oliver & Karve, Pranav & Mahadevan, Sankaran, 2023. "Reliability and risk metrics to assess operational adequacy and flexibility of power grids," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    4. Hong, Tao & Pinson, Pierre & Fan, Shu & Zareipour, Hamidreza & Troccoli, Alberto & Hyndman, Rob J., 2016. "Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond," International Journal of Forecasting, Elsevier, vol. 32(3), pages 896-913.
    5. Eugen Ursu & Pierre Duchesne, 2009. "On modelling and diagnostic checking of vector periodic autoregressive time series models," Journal of Time Series Analysis, Wiley Blackwell, vol. 30(1), pages 70-96, January.
    6. Wei, Danxiang & Wang, Jianzhou & Niu, Xinsong & Li, Zhiwu, 2021. "Wind speed forecasting system based on gated recurrent units and convolutional spiking neural networks," Applied Energy, Elsevier, vol. 292(C).
    7. Guo, Zhenhai & Zhao, Jing & Zhang, Wenyu & Wang, Jianzhou, 2011. "A corrected hybrid approach for wind speed prediction in Hexi Corridor of China," Energy, Elsevier, vol. 36(3), pages 1668-1679.
    8. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268, April.
    9. Mashlakov, Aleksei & Kuronen, Toni & Lensu, Lasse & Kaarna, Arto & Honkapuro, Samuli, 2021. "Assessing the performance of deep learning models for multivariate probabilistic energy forecasting," Applied Energy, Elsevier, vol. 285(C).
    10. Heo, Jae & Song, Kwonsik & Han, SangUk & Lee, Dong-Eun, 2021. "Multi-channel convolutional neural network for integration of meteorological and geographical features in solar power forecasting," Applied Energy, Elsevier, vol. 295(C).
    11. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    12. Daraeepour, Ali & Patino-Echeverri, Dalia & Conejo, Antonio J., 2019. "Economic and environmental implications of different approaches to hedge against wind production uncertainty in two-settlement electricity markets: A PJM case study," Energy Economics, Elsevier, vol. 80(C), pages 336-354.
    13. Nguyen, H.D. & Tran, K.P. & Thomassey, S. & Hamad, M., 2021. "Forecasting and Anomaly Detection approaches using LSTM and LSTM Autoencoder techniques with the applications in supply chain management," International Journal of Information Management, Elsevier, vol. 57(C).
    14. Liu, Yongqi & Qin, Hui & Zhang, Zhendong & Pei, Shaoqian & Jiang, Zhiqiang & Feng, Zhongkai & Zhou, Jianzhong, 2020. "Probabilistic spatiotemporal wind speed forecasting based on a variational Bayesian deep learning model," Applied Energy, Elsevier, vol. 260(C).
    15. Sloughter, J. McLean & Gneiting, Tilmann & Raftery, Adrian E., 2010. "Probabilistic Wind Speed Forecasting Using Ensembles and Bayesian Model Averaging," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 25-35.
    16. Zhang, Menghan & Yang, Zhifang & Lin, Wei & Yu, Juan & Li, Wenyuan, 2022. "Internalization of reliability unit commitment in day-ahead market: Analysis and interpretation," Applied Energy, Elsevier, vol. 326(C).
    17. Tilmann Gneiting & Larissa Stanberry & Eric Grimit & Leonhard Held & Nicholas Johnson, 2008. "Rejoinder on: Assessing probabilistic forecasts of multivariate quantities, with an application to ensemble predictions of surface winds," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 17(2), pages 256-264, August.
    18. Tilmann Gneiting & Larissa Stanberry & Eric Grimit & Leonhard Held & Nicholas Johnson, 2008. "Assessing probabilistic forecasts of multivariate quantities, with an application to ensemble predictions of surface winds," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 17(2), pages 211-235, August.
    19. Gao, Bixuan & Huang, Xiaoqiao & Shi, Junsheng & Tai, Yonghang & Zhang, Jun, 2020. "Hourly forecasting of solar irradiance based on CEEMDAN and multi-strategy CNN-LSTM neural networks," Renewable Energy, Elsevier, vol. 162(C), pages 1665-1683.
    20. Florian Ziel & Kevin Berk, 2019. "Multivariate Forecasting Evaluation: On Sensitive and Strictly Proper Scoring Rules," Papers 1910.07325, arXiv.org.
    21. Tianhe Sun & Tieyan Zhang & Yun Teng & Zhe Chen & Jiakun Fang, 2019. "Monthly Electricity Consumption Forecasting Method Based on X12 and STL Decomposition Model in an Integrated Energy System," Mathematical Problems in Engineering, Hindawi, vol. 2019, pages 1-16, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Gensler, André & Sick, Bernhard & Vogt, Stephan, 2018. "A review of uncertainty representations and metaverification of uncertainty assessment techniques for renewable energies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 96(C), pages 352-379.
    3. Zhang, Yao & Wang, Jianxue & Wang, Xifan, 2014. "Review on probabilistic forecasting of wind power generation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 32(C), pages 255-270.
    4. Malte Knuppel & Fabian Kruger & Marc-Oliver Pohle, 2022. "Score-based calibration testing for multivariate forecast distributions," Papers 2211.16362, arXiv.org, revised Dec 2023.
    5. Dumas, Jonathan & Wehenkel, Antoine & Lanaspeze, Damien & Cornélusse, Bertrand & Sutera, Antonio, 2022. "A deep generative model for probabilistic energy forecasting in power systems: normalizing flows," Applied Energy, Elsevier, vol. 305(C).
    6. Florian Ziel & Kevin Berk, 2019. "Multivariate Forecasting Evaluation: On Sensitive and Strictly Proper Scoring Rules," Papers 1910.07325, arXiv.org.
    7. Braun, Julia & Sabanés Bové, Daniel & Held, Leonhard, 2014. "Choice of generalized linear mixed models using predictive crossvalidation," Computational Statistics & Data Analysis, Elsevier, vol. 75(C), pages 190-202.
    8. Grothe, Oliver & Kächele, Fabian & Krüger, Fabian, 2023. "From point forecasts to multivariate probabilistic forecasts: The Schaake shuffle for day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 120(C).
    9. Thordis L. Thorarinsdottir & Tilmann Gneiting, 2010. "Probabilistic forecasts of wind speed: ensemble model output statistics by using heteroscedastic censored regression," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(2), pages 371-388, April.
    10. van der Meer, Dennis & Wang, Guang Chao & Munkhammar, Joakim, 2021. "An alternative optimal strategy for stochastic model predictive control of a residential battery energy management system with solar photovoltaic," Applied Energy, Elsevier, vol. 283(C).
    11. Yang, Dazhi & Wang, Wenting & Gueymard, Christian A. & Hong, Tao & Kleissl, Jan & Huang, Jing & Perez, Marc J. & Perez, Richard & Bright, Jamie M. & Xia, Xiang’ao & van der Meer, Dennis & Peters, Ian , 2022. "A review of solar forecasting, its dependence on atmospheric sciences and implications for grid integration: Towards carbon neutrality," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    12. Warne, Anders, 2023. "DSGE model forecasting: rational expectations vs. adaptive learning," Working Paper Series 2768, European Central Bank.
    13. Jenny Brynjarsdottir & Jonathan Hobbs & Amy Braverman & Lukas Mandrake, 2018. "Optimal Estimation Versus MCMC for $$\mathrm{{CO}}_{2}$$ CO 2 Retrievals," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 23(2), pages 297-316, June.
    14. Oliver Grothe & Fabian Kachele & Fabian Kruger, 2022. "From point forecasts to multivariate probabilistic forecasts: The Schaake shuffle for day-ahead electricity price forecasting," Papers 2204.10154, arXiv.org.
    15. Arrieta-Prieto, Mario & Schell, Kristen R., 2022. "Spatio-temporal probabilistic forecasting of wind power for multiple farms: A copula-based hybrid model," International Journal of Forecasting, Elsevier, vol. 38(1), pages 300-320.
    16. L. Held & K. Rufibach & F. Balabdaoui, 2010. "A Score Regression Approach to Assess Calibration of Continuous Probabilistic Predictions," Biometrics, The International Biometric Society, vol. 66(4), pages 1295-1305, December.
    17. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    18. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    19. Fabian Krüger & Sebastian Lerch & Thordis Thorarinsdottir & Tilmann Gneiting, 2021. "Predictive Inference Based on Markov Chain Monte Carlo Output," International Statistical Review, International Statistical Institute, vol. 89(2), pages 274-301, August.
    20. Marcin Jurek & Matthias Katzfuss, 2023. "Scalable spatio‐temporal smoothing via hierarchical sparse Cholesky decomposition," Environmetrics, John Wiley & Sons, Ltd., vol. 34(1), February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:357:y:2024:i:c:s0306261923018020. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.