IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v382y2025ics0306261924025522.html
   My bibliography  Save this article

A global probabilistic approach for short-term forecasting of individual households electricity consumption

Author

Listed:
  • Botman, Lola
  • Lago, Jesus
  • Becker, Thijs
  • Vanthournout, Koen
  • Moor, Bart De

Abstract

Accurate short-term prediction of individual residential load is essential for various applications and low-voltage grid stakeholders. Distribution system operators can utilize these forecasts in grid simulations, operation planning, and to anticipate unusual or varying consumption in certain neighborhoods, which can help to avoid congestions caused by peaks. Furthermore, these predictions can be used to optimize the low-voltage grid for renewable energy sources and potential battery storage. Due to the highly stochastic nature of household consumption, point forecasting is not optimal. We apply state-of-the-art probabilistic methods from other applications, and we propose a novel probabilistic global approach. It is based on a selection of similar normalized household consumption time series, which are then used to compute empirical quantiles. The proposed method has been evaluated on two different open datasets from different countries, and it outperforms state-of-the-art models in both cases. It has also been applied to a private Belgian dataset. In all three cases, the proposed method consistently outperforms the state-of-the-art methods on highly stochastic and changing households, i.e., households experiencing concept drift. This method is scalable, with low computational requirements, requires only seven days of historical data of the target household to make predictions and does not require household-specific or weather information.

Suggested Citation

  • Botman, Lola & Lago, Jesus & Becker, Thijs & Vanthournout, Koen & Moor, Bart De, 2025. "A global probabilistic approach for short-term forecasting of individual households electricity consumption," Applied Energy, Elsevier, vol. 382(C).
  • Handle: RePEc:eee:appene:v:382:y:2025:i:c:s0306261924025522
    DOI: 10.1016/j.apenergy.2024.125168
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924025522
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2024.125168?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Samya Tajmouati & Bouazza E. L. Wahbi & Adel Bedoui & Abdallah Abarda & Mohamed Dakkon, 2024. "Applying k‐nearest neighbors to time series forecasting: Two new approaches," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(5), pages 1559-1574, August.
    2. Bartosz Uniejewski & Jakub Nowotarski & Rafał Weron, 2016. "Automated Variable Selection and Shrinkage for Day-Ahead Electricity Price Forecasting," Energies, MDPI, vol. 9(8), pages 1-22, August.
    3. Ben Taieb, Souhaib & Hyndman, Rob J., 2014. "A gradient boosting approach to the Kaggle load forecasting competition," International Journal of Forecasting, Elsevier, vol. 30(2), pages 382-394.
    4. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    5. Bessec, Marie & Fouquau, Julien, 2008. "The non-linear link between electricity consumption and temperature in Europe: A threshold panel approach," Energy Economics, Elsevier, vol. 30(5), pages 2705-2721, September.
    6. Jain, Rishee K. & Smith, Kevin M. & Culligan, Patricia J. & Taylor, John E., 2014. "Forecasting energy consumption of multi-family residential buildings using support vector regression: Investigating the impact of temporal and spatial monitoring granularity on performance accuracy," Applied Energy, Elsevier, vol. 123(C), pages 168-178.
    7. Johannes Bracher & Evan L Ray & Tilmann Gneiting & Nicholas G Reich, 2021. "Evaluating epidemic forecasts in an interval format," PLOS Computational Biology, Public Library of Science, vol. 17(2), pages 1-15, February.
    8. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    9. repec:dau:papers:123456789/8180 is not listed on IDEAS
    10. Hong, Tao & Pinson, Pierre & Fan, Shu & Zareipour, Hamidreza & Troccoli, Alberto & Hyndman, Rob J., 2016. "Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond," International Journal of Forecasting, Elsevier, vol. 32(3), pages 896-913.
    11. Räsänen, Teemu & Voukantsis, Dimitrios & Niska, Harri & Karatzas, Kostas & Kolehmainen, Mikko, 2010. "Data-based method for creating electricity use load profiles using large amount of customer-specific hourly measured electricity use data," Applied Energy, Elsevier, vol. 87(11), pages 3538-3545, November.
    12. Shepero, Mahmoud & van der Meer, Dennis & Munkhammar, Joakim & Widén, Joakim, 2018. "Residential probabilistic load forecasting: A method using Gaussian process designed for electric load data," Applied Energy, Elsevier, vol. 218(C), pages 159-172.
    13. Kang, Jieyi & Reiner, David M., 2022. "What is the effect of weather on household electricity consumption? Empirical evidence from Ireland," Energy Economics, Elsevier, vol. 111(C).
    14. Roger Koenker & Kevin F. Hallock, 2001. "Quantile Regression," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 143-156, Fall.
    15. Sanlei Dang & Long Peng & Jingming Zhao & Jiajie Li & Zhengmin Kong, 2022. "A Quantile Regression Random Forest-Based Short-Term Load Probabilistic Forecasting Method," Energies, MDPI, vol. 15(2), pages 1-20, January.
    16. Hong, Tao & Fan, Shu, 2016. "Probabilistic electric load forecasting: A tutorial review," International Journal of Forecasting, Elsevier, vol. 32(3), pages 914-938.
    17. Wang, Yi & Gan, Dahua & Sun, Mingyang & Zhang, Ning & Lu, Zongxiang & Kang, Chongqing, 2019. "Probabilistic individual load forecasting using pinball loss guided LSTM," Applied Energy, Elsevier, vol. 235(C), pages 10-20.
    18. Haben, Stephen & Ward, Jonathan & Vukadinovic Greetham, Danica & Singleton, Colin & Grindrod, Peter, 2014. "A new error measure for forecasts of household-level, high resolution electrical energy consumption," International Journal of Forecasting, Elsevier, vol. 30(2), pages 246-256.
    19. Francis X. Diebold, 2015. "Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 1-1, January.
    20. Haben, Stephen & Giasemidis, Georgios & Ziel, Florian & Arora, Siddharth, 2019. "Short term load forecasting and the effect of temperature at the low voltage level," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1469-1484.
    21. Guo, Zhifeng & Zhou, Kaile & Zhang, Xiaoling & Yang, Shanlin, 2018. "A deep learning model for short-term power load and probability density forecasting," Energy, Elsevier, vol. 160(C), pages 1186-1200.
    22. Haben, Stephen & Arora, Siddharth & Giasemidis, Georgios & Voss, Marcus & Vukadinović Greetham, Danica, 2021. "Review of low voltage load forecasting: Methods, applications, and recommendations," Applied Energy, Elsevier, vol. 304(C).
    23. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268, April.
    24. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    25. Alexis Gerossier & Robin Girard & Alexis Bocquet & George Kariniotakis, 2018. "Robust Day-Ahead Forecasting of Household Electricity Demand and Operational Challenges," Energies, MDPI, vol. 11(12), pages 1-18, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    2. Park, Jungyeon & Alvarenga, Estêvão & Jeon, Jooyoung & Li, Ran & Petropoulos, Fotios & Kim, Hokyun & Ahn, Kwangwon, 2024. "Probabilistic forecast-based portfolio optimization of electricity demand at low aggregation levels," Applied Energy, Elsevier, vol. 353(PB).
    3. Haben, Stephen & Arora, Siddharth & Giasemidis, Georgios & Voss, Marcus & Vukadinović Greetham, Danica, 2021. "Review of low voltage load forecasting: Methods, applications, and recommendations," Applied Energy, Elsevier, vol. 304(C).
    4. Rafal Weron & Florian Ziel, 2018. "Electricity price forecasting," HSC Research Reports HSC/18/08, Hugo Steinhaus Center, Wroclaw University of Science and Technology.
    5. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    6. Haben, Stephen & Giasemidis, Georgios & Ziel, Florian & Arora, Siddharth, 2019. "Short term load forecasting and the effect of temperature at the low voltage level," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1469-1484.
    7. Cornell, Cameron & Dinh, Nam Trong & Pourmousavi, S. Ali, 2024. "A probabilistic forecast methodology for volatile electricity prices in the Australian National Electricity Market," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1421-1437.
    8. Brusaferri, Alessandro & Matteucci, Matteo & Spinelli, Stefano & Vitali, Andrea, 2022. "Probabilistic electric load forecasting through Bayesian Mixture Density Networks," Applied Energy, Elsevier, vol. 309(C).
    9. Florian Ziel & Kevin Berk, 2019. "Multivariate Forecasting Evaluation: On Sensitive and Strictly Proper Scoring Rules," Papers 1910.07325, arXiv.org.
    10. Uniejewski, Bartosz & Marcjasz, Grzegorz & Weron, Rafał, 2019. "On the importance of the long-term seasonal component in day-ahead electricity price forecasting: Part II — Probabilistic forecasting," Energy Economics, Elsevier, vol. 79(C), pages 171-182.
    11. Rostami-Tabar, Bahman & Ziel, Florian, 2022. "Anticipating special events in Emergency Department forecasting," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1197-1213.
    12. Zhang, Shu & Wang, Yi & Zhang, Yutian & Wang, Dan & Zhang, Ning, 2020. "Load probability density forecasting by transforming and combining quantile forecasts," Applied Energy, Elsevier, vol. 277(C).
    13. Katarzyna Maciejowska & Bartosz Uniejewski & Rafa{l} Weron, 2022. "Forecasting Electricity Prices," Papers 2204.11735, arXiv.org.
    14. Wang, Yi & Gan, Dahua & Sun, Mingyang & Zhang, Ning & Lu, Zongxiang & Kang, Chongqing, 2019. "Probabilistic individual load forecasting using pinball loss guided LSTM," Applied Energy, Elsevier, vol. 235(C), pages 10-20.
    15. Yang, Dazhi & van der Meer, Dennis, 2021. "Post-processing in solar forecasting: Ten overarching thinking tools," Renewable and Sustainable Energy Reviews, Elsevier, vol. 140(C).
    16. Lago, Jesus & Marcjasz, Grzegorz & De Schutter, Bart & Weron, Rafał, 2021. "Forecasting day-ahead electricity prices: A review of state-of-the-art algorithms, best practices and an open-access benchmark," Applied Energy, Elsevier, vol. 293(C).
    17. Marcjasz, Grzegorz & Uniejewski, Bartosz & Weron, Rafał, 2020. "Probabilistic electricity price forecasting with NARX networks: Combine point or probabilistic forecasts?," International Journal of Forecasting, Elsevier, vol. 36(2), pages 466-479.
    18. Stephen Haben & Julien Caudron & Jake Verma, 2021. "Probabilistic Day-Ahead Wholesale Price Forecast: A Case Study in Great Britain," Forecasting, MDPI, vol. 3(3), pages 1-37, August.
    19. Wen, Honglin & Pinson, Pierre & Gu, Jie & Jin, Zhijian, 2024. "Wind energy forecasting with missing values within a fully conditional specification framework," International Journal of Forecasting, Elsevier, vol. 40(1), pages 77-95.
    20. Buzna, Luboš & De Falco, Pasquale & Ferruzzi, Gabriella & Khormali, Shahab & Proto, Daniela & Refa, Nazir & Straka, Milan & van der Poel, Gijs, 2021. "An ensemble methodology for hierarchical probabilistic electric vehicle load forecasting at regular charging stations," Applied Energy, Elsevier, vol. 283(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:382:y:2025:i:c:s0306261924025522. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.