IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v353y2024ipbs0306261923014733.html
   My bibliography  Save this article

Probabilistic forecast-based portfolio optimization of electricity demand at low aggregation levels

Author

Listed:
  • Park, Jungyeon
  • Alvarenga, Estêvão
  • Jeon, Jooyoung
  • Li, Ran
  • Petropoulos, Fotios
  • Kim, Hokyun
  • Ahn, Kwangwon

Abstract

In the effort to achieve carbon neutrality through a decentralized electricity market, accurate short-term load forecasting at low aggregation levels has become increasingly crucial for various market participants' strategies. Accurate probabilistic forecasts at low aggregation levels can improve peer-to-peer energy sharing, demand response, and the operation of reliable distribution networks. However, these applications require not only probabilistic demand forecasts, which involve quantification of the forecast uncertainty, but also determining which consumers to include in the aggregation to meet electricity supply at the forecast lead time. While research papers have been proposed on the supply side, no similar research has been conducted on the demand side. This paper presents a method for creating a portfolio that optimally aggregates demand for a given energy demand, minimizing forecast inaccuracy of overall low-level aggregation. Using probabilistic load forecasts produced by either ARMA-GARCH models or kernel density estimation (KDE), we propose three approaches to creating a portfolio of residential households' demand: Forecast Validated, Seasonal Residual, and Seasonal Similarity. An evaluation of probabilistic load forecasts demonstrates that all three approaches enhance the accuracy of forecasts produced by random portfolios, with the Seasonal Residual approach for Korea and Ireland outperforming the others in terms of accuracy and computational efficiency.

Suggested Citation

  • Park, Jungyeon & Alvarenga, Estêvão & Jeon, Jooyoung & Li, Ran & Petropoulos, Fotios & Kim, Hokyun & Ahn, Kwangwon, 2024. "Probabilistic forecast-based portfolio optimization of electricity demand at low aggregation levels," Applied Energy, Elsevier, vol. 353(PB).
    • Handle: RePEc:eee:appene:v:353:y:2024:i:pb:s0306261923014733
    DOI: 10.1016/j.apenergy.2023.122109
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923014733
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2023.122109?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jeon, Jooyoung & Taylor, James W., 2016. "Short-term density forecasting of wave energy using ARMA-GARCH models and kernel density estimation," International Journal of Forecasting, Elsevier, vol. 32(3), pages 991-1004.
    2. Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    3. Jeon, Jooyoung & Panagiotelis, Anastasios & Petropoulos, Fotios, 2019. "Probabilistic forecast reconciliation with applications to wind power and electric load," European Journal of Operational Research, Elsevier, vol. 279(2), pages 364-379.
    4. G. R. Jafari & A. Bahraminasab & P. Norouzzadeh, 2007. "Why Does The Standard Garch(1, 1) Model Work Well?," International Journal of Modern Physics C (IJMPC), World Scientific Publishing Co. Pte. Ltd., vol. 18(07), pages 1223-1230.
    5. Tao Hong & Pierre Pinson & Yi Wang & Rafal Weron & Dazhi Yang & Hamidreza Zareipour, 2020. "Energy forecasting: A review and outlook," WORking papers in Management Science (WORMS) WORMS/20/08, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    6. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    7. P. Bonami & M. A. Lejeune, 2009. "An Exact Solution Approach for Portfolio Optimization Problems Under Stochastic and Integer Constraints," Operations Research, INFORMS, vol. 57(3), pages 650-670, June.
    8. Salinas, David & Flunkert, Valentin & Gasthaus, Jan & Januschowski, Tim, 2020. "DeepAR: Probabilistic forecasting with autoregressive recurrent networks," International Journal of Forecasting, Elsevier, vol. 36(3), pages 1181-1191.
    9. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    10. Mashlakov, Aleksei & Kuronen, Toni & Lensu, Lasse & Kaarna, Arto & Honkapuro, Samuli, 2021. "Assessing the performance of deep learning models for multivariate probabilistic energy forecasting," Applied Energy, Elsevier, vol. 285(C).
    11. Jooyoung Jeon & James W. Taylor, 2012. "Using Conditional Kernel Density Estimation for Wind Power Density Forecasting," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 66-79, March.
    12. Taylor, James W. & Jeon, Jooyoung, 2015. "Forecasting wind power quantiles using conditional kernel estimation," Renewable Energy, Elsevier, vol. 80(C), pages 370-379.
    13. Na (Nora) Wang, 2018. "Transactive control for connected homes and neighbourhoods," Nature Energy, Nature, vol. 3(11), pages 907-909, November.
    14. Liu, Heping & Shi, Jing, 2013. "Applying ARMA–GARCH approaches to forecasting short-term electricity prices," Energy Economics, Elsevier, vol. 37(C), pages 152-166.
    15. Thomas Morstyn & Niall Farrell & Sarah J. Darby & Malcolm D. McCulloch, 2018. "Using peer-to-peer energy-trading platforms to incentivize prosumers to form federated power plants," Nature Energy, Nature, vol. 3(2), pages 94-101, February.
    16. Josue Campos do Prado & Wei Qiao & Liyan Qu & Julio Romero Agüero, 2019. "The Next-Generation Retail Electricity Market in the Context of Distributed Energy Resources: Vision and Integrating Framework," Energies, MDPI, vol. 12(3), pages 1-24, February.
    17. Vlaar, Peter J G & Palm, Franz C, 1993. "The Message in Weekly Exchange Rates in the European Monetary System: Mean Reversion, Conditional Heteroscedasticity, and Jumps," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(3), pages 351-360, July.
    18. Wang, Yi & Gan, Dahua & Sun, Mingyang & Zhang, Ning & Lu, Zongxiang & Kang, Chongqing, 2019. "Probabilistic individual load forecasting using pinball loss guided LSTM," Applied Energy, Elsevier, vol. 235(C), pages 10-20.
    19. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    20. Pierre Bonami & Miguel A. Lejeune, 2009. "An Exact Solution Approach for Integer Constrained Portfolio Optimization Problems Under Stochastic Constraints," Post-Print hal-00421756, HAL.
    21. Shahriari, Mehdi & Blumsack, Seth, 2018. "The capacity value of optimal wind and solar portfolios," Energy, Elsevier, vol. 148(C), pages 992-1005.
    22. Haben, Stephen & Giasemidis, Georgios & Ziel, Florian & Arora, Siddharth, 2019. "Short term load forecasting and the effect of temperature at the low voltage level," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1469-1484.
    23. Han, Chanok & Vinel, Alexander, 2022. "Reducing forecasting error by optimally pooling wind energy generation sources through portfolio optimization," Energy, Elsevier, vol. 239(PB).
    24. Pérez Odeh, Rodrigo & Watts, David & Flores, Yarela, 2018. "Planning in a changing environment: Applications of portfolio optimisation to deal with risk in the electricity sector," Renewable and Sustainable Energy Reviews, Elsevier, vol. 82(P3), pages 3808-3823.
    25. Guo, Zhifeng & Zhou, Kaile & Zhang, Xiaoling & Yang, Shanlin, 2018. "A deep learning model for short-term power load and probability density forecasting," Energy, Elsevier, vol. 160(C), pages 1186-1200.
    26. Mebane Jr., Walter R. & Sekhon, Jasjeet S., 2011. "Genetic Optimization Using Derivatives: The rgenoud Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i11).
    27. Xiao, Liye & Shao, Wei & Liang, Tulu & Wang, Chen, 2016. "A combined model based on multiple seasonal patterns and modified firefly algorithm for electrical load forecasting," Applied Energy, Elsevier, vol. 167(C), pages 135-153.
    28. Arora, Siddharth & Taylor, James W., 2016. "Forecasting electricity smart meter data using conditional kernel density estimation," Omega, Elsevier, vol. 59(PA), pages 47-59.
    29. Haben, Stephen & Arora, Siddharth & Giasemidis, Georgios & Voss, Marcus & Vukadinović Greetham, Danica, 2021. "Review of low voltage load forecasting: Methods, applications, and recommendations," Applied Energy, Elsevier, vol. 304(C).
    30. Souhaib Ben Taieb & James W. Taylor & Rob J. Hyndman, 2021. "Hierarchical Probabilistic Forecasting of Electricity Demand With Smart Meter Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 116(533), pages 27-43, March.
    31. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268, April.
    32. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Haben, Stephen & Arora, Siddharth & Giasemidis, Georgios & Voss, Marcus & Vukadinović Greetham, Danica, 2021. "Review of low voltage load forecasting: Methods, applications, and recommendations," Applied Energy, Elsevier, vol. 304(C).
    3. Dumas, Jonathan & Wehenkel, Antoine & Lanaspeze, Damien & Cornélusse, Bertrand & Sutera, Antonio, 2022. "A deep generative model for probabilistic energy forecasting in power systems: normalizing flows," Applied Energy, Elsevier, vol. 305(C).
    4. Mikkel L. Sørensen & Peter Nystrup & Mathias B. Bjerregård & Jan K. Møller & Peder Bacher & Henrik Madsen, 2023. "Recent developments in multivariate wind and solar power forecasting," Wiley Interdisciplinary Reviews: Energy and Environment, Wiley Blackwell, vol. 12(2), March.
    5. Yang, Dazhi & van der Meer, Dennis, 2021. "Post-processing in solar forecasting: Ten overarching thinking tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 140(C).
    6. Jeon, Jooyoung & Panagiotelis, Anastasios & Petropoulos, Fotios, 2019. "Probabilistic forecast reconciliation with applications to wind power and electric load," European Journal of Operational Research, Elsevier, vol. 279(2), pages 364-379.
    7. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    8. Pesantez, Jorge E. & Li, Binbin & Lee, Christopher & Zhao, Zhizhen & Butala, Mark & Stillwell, Ashlynn S., 2023. "A Comparison Study of Predictive Models for Electricity Demand in a Diverse Urban Environment," Energy, Elsevier, vol. 283(C).
    9. Wen, Honglin & Pinson, Pierre & Gu, Jie & Jin, Zhijian, 2024. "Wind energy forecasting with missing values within a fully conditional specification framework," International Journal of Forecasting, Elsevier, vol. 40(1), pages 77-95.
    10. Jonathan Roth & Jayashree Chadalawada & Rishee K. Jain & Clayton Miller, 2021. "Uncertainty Matters: Bayesian Probabilistic Forecasting for Residential Smart Meter Prediction, Segmentation, and Behavioral Measurement and Verification," Energies, MDPI, vol. 14(5), pages 1-22, March.
    11. Antonio Bracale & Pasquale De Falco, 2015. "An Advanced Bayesian Method for Short-Term Probabilistic Forecasting of the Generation of Wind Power," Energies, MDPI, vol. 8(9), pages 1-22, September.
    12. Zhu, Jizhong & Dong, Hanjiang & Zheng, Weiye & Li, Shenglin & Huang, Yanting & Xi, Lei, 2022. "Review and prospect of data-driven techniques for load forecasting in integrated energy systems," Applied Energy, Elsevier, vol. 321(C).
    13. Lu, Shixiang & Xu, Qifa & Jiang, Cuixia & Liu, Yezheng & Kusiak, Andrew, 2022. "Probabilistic load forecasting with a non-crossing sparse-group Lasso-quantile regression deep neural network," Energy, Elsevier, vol. 242(C).
    14. Wang, Xiaoqian & Hyndman, Rob J. & Li, Feng & Kang, Yanfei, 2023. "Forecast combinations: An over 50-year review," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1518-1547.
    15. Grothe, Oliver & Kächele, Fabian & Krüger, Fabian, 2023. "From point forecasts to multivariate probabilistic forecasts: The Schaake shuffle for day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 120(C).
    16. Massol, Olivier & Banal-Estañol, Albert, 2014. "Export diversification through resource-based industrialization: The case of natural gas," European Journal of Operational Research, Elsevier, vol. 237(3), pages 1067-1082.
    17. Souhaib Ben Taieb & James W. Taylor & Rob J. Hyndman, 2017. "Coherent Probabilistic Forecasts for Hierarchical Time Series," Monash Econometrics and Business Statistics Working Papers 3/17, Monash University, Department of Econometrics and Business Statistics.
    18. Marcjasz, Grzegorz & Narajewski, Michał & Weron, Rafał & Ziel, Florian, 2023. "Distributional neural networks for electricity price forecasting," Energy Economics, Elsevier, vol. 125(C).
    19. Gensler, André & Sick, Bernhard & Vogt, Stephan, 2018. "A review of uncertainty representations and metaverification of uncertainty assessment techniques for renewable energies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 96(C), pages 352-379.
    20. Philipp Baumann & Norbert Trautmann, 2013. "Portfolio-optimization models for small investors," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 77(3), pages 345-356, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:353:y:2024:i:pb:s0306261923014733. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.