IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i18p4994-d1753724.html

Short-Term Forecasting of Unplanned Power Outages Using Machine Learning Algorithms: A Robust Feature Engineering Strategy Against Multicollinearity and Nonlinearity

Author

Listed:
  • Khathutshelo Steven Sivhugwana

    (Department of Statistics, University of South Africa, Florida Campus, Johannesburg 1709, South Africa)

  • Edmore Ranganai

    (Department of Statistics, University of South Africa, Florida Campus, Johannesburg 1709, South Africa)

Abstract

Efficient power grid operations and effective business strategies require accurate prediction of power outages. However, predicting outages is a difficult task due to the large amount of heterogeneous, random, intermittent, and non-linear power grid data characterised by highly complex variable relationships. Attempting to simultaneously quantify these characteristics using a conventional single (linear or nonlinear) model may lead to inaccurate and costly results. To address this, we propose a hybrid RVM-WT-AdaBoostRT-RF framework using power grid data from the Electricity Supply Commission (Eskom) of South Africa. To achieve model interpretability, the least absolute shrinkage and selection operator (LASSO) is first applied to remedy the adverse effects of multicollinearity through regularisation and variable selection. Secondly, a random forest (RF) is used to select the top 10 most influential variables for each season for further analysis. A relevance vector machine (RVM) captures complex nonlinear relationships separately for each season, while the wavelet transform (WT) decomposes residuals generated from RVM into different frequency subseries (with reduced noise). These subseries are predicted with minimal bias using AdaBoost with regression and threshold (AdaBoostRT). Finally, we stack RVM, AdaBoostRT, RF, and residual individual predictions using RF as a meta-model to produce the final forecast with minimal error accumulation and efficiency. The comparative study, based on point forecast metrics, the Diebold-Mariano test, and prediction interval widths, shows that the proposed model outperforms vector autoregressive (VAR), RF, AdaBoostRT, RVM, and Naïve models. The study results can be utilised for optimising resource allocation, effective power grid management, and customer alerts.

Suggested Citation

  • Khathutshelo Steven Sivhugwana & Edmore Ranganai, 2025. "Short-Term Forecasting of Unplanned Power Outages Using Machine Learning Algorithms: A Robust Feature Engineering Strategy Against Multicollinearity and Nonlinearity," Energies, MDPI, vol. 18(18), pages 1-38, September.
  • Handle: RePEc:gam:jeners:v:18:y:2025:i:18:p:4994-:d:1753724
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/18/4994/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/18/18/4994/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sanjoy Das & Padmavathy Kankanala & Anil Pahwa, 2021. "Outage Estimation in Electric Power Distribution Systems Using a Neural Network Ensemble," Energies, MDPI, vol. 14(16), pages 1-18, August.
    2. Seung‐Ryong Han & Seth D. Guikema & Steven M. Quiring, 2009. "Improving the Predictive Accuracy of Hurricane Power Outage Forecasts Using Generalized Additive Models," Risk Analysis, John Wiley & Sons, vol. 29(10), pages 1443-1453, October.
    3. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    4. Adeniyi Kehinde Onaolapo & Rudiren Pillay Carpanen & David George Dorrell & Evans Eshiemogie Ojo, 2022. "A Comparative Assessment of Conventional and Artificial Neural Networks Methods for Electricity Outage Forecasting," Energies, MDPI, vol. 15(2), pages 1-21, January.
    5. Khathutshelo Steven Sivhugwana & Edmore Ranganai, 2025. "Wind Speed Forecasting with Differentially Evolved Minimum-Bandwidth Filters and Gated Recurrent Units," Forecasting, MDPI, vol. 7(2), pages 1-27, June.
    6. Inglesi, Roula, 2010. "Aggregate electricity demand in South Africa: Conditional forecasts to 2030," Applied Energy, Elsevier, vol. 87(1), pages 197-204, January.
    7. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    8. Karatzoglou, Alexandros & Smola, Alexandros & Hornik, Kurt & Zeileis, Achim, 2004. "kernlab - An S4 Package for Kernel Methods in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 11(i09).
    9. Fluri, Thomas P., 2009. "The potential of concentrating solar power in South Africa," Energy Policy, Elsevier, vol. 37(12), pages 5075-5080, December.
    10. Seth D. Guikema & Steven M. Quiring & Seung‐Ryong Han, 2010. "Prestorm Estimation of Hurricane Damage to Electric Power Distribution Systems," Risk Analysis, John Wiley & Sons, vol. 30(12), pages 1744-1752, December.
    11. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    12. Xueying Sun & Zhuo Wang & Jingtao Hu, 2017. "Prediction Interval Construction for Byproduct Gas Flow Forecasting Using Optimized Twin Extreme Learning Machine," Mathematical Problems in Engineering, Hindawi, vol. 2017, pages 1-12, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hauzenberger, Niko & Huber, Florian & Klieber, Karin & Marcellino, Massimiliano, 2025. "Bayesian neural networks for macroeconomic analysis," Journal of Econometrics, Elsevier, vol. 249(PC).
    2. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    3. Chuliá, Helena & Garrón, Ignacio & Uribe, Jorge M., 2024. "Daily growth at risk: Financial or real drivers? The answer is not always the same," International Journal of Forecasting, Elsevier, vol. 40(2), pages 762-776.
    4. Joseph, Andreas & Potjagailo, Galina & Chakraborty, Chiranjit & Kapetanios, George, 2024. "Forecasting UK inflation bottom up," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1521-1538.
    5. Christopher Kath & Florian Ziel, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Papers 1811.08604, arXiv.org.
    6. Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87, April.
    7. Lin, Hai & Tao, Xinyuan & Wu, Chunchi, 2022. "Forecasting earnings with combination of analyst forecasts," Journal of Empirical Finance, Elsevier, vol. 68(C), pages 133-159.
    8. d'Aspremont, Alexandre & Ben Arous, Simon & Bricongne, Jean-Charles & Lietti, Benjamin & Meunier, Baptiste, 2025. "Satellites turn “concrete”: Tracking cement with satellite data and neural networks," Journal of Econometrics, Elsevier, vol. 249(PC).
    9. Dennis Kant & Andreas Pick & Jasper de Winter, 2025. "Nowcasting GDP using machine learning methods," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 109(1), pages 1-24, March.
    10. Richard Schnorrenberger & Aishameriane Schmidt & Guilherme Valle Moura, 2024. "Harnessing Machine Learning for Real-Time Inflation Nowcasting," Working Papers 806, DNB.
    11. Karin Wolffhechel & Amanda C Hahn & Hanne Jarmer & Claire I Fisher & Benedict C Jones & Lisa M DeBruine, 2015. "Testing the Utility of a Data-Driven Approach for Assessing BMI from Face Images," PLOS ONE, Public Library of Science, vol. 10(10), pages 1-10, October.
    12. Borup, Daniel & Christensen, Bent Jesper & Mühlbach, Nicolaj Søndergaard & Nielsen, Mikkel Slot, 2023. "Targeting predictors in random forest regression," International Journal of Forecasting, Elsevier, vol. 39(2), pages 841-868.
    13. Kim Christensen & Mathias Siggaard & Bezirgen Veliyev, 2023. "A Machine Learning Approach to Volatility Forecasting," Journal of Financial Econometrics, Oxford University Press, vol. 21(5), pages 1680-1727.
    14. Gerg, Isaac D. & Tashie, Arik M. & Patanaik, Amiya & Koester, Evan & Gupta, Himanshu & Farnham, David J., 2026. "The substantial role of weather data in consumer spending prediction: A robust machine learning assessment," Journal of Retailing and Consumer Services, Elsevier, vol. 90(C).
    15. Paap, Richard & Franses, Philip Hans, 2025. "Shrinkage estimators for periodic autoregressions," Journal of Econometrics, Elsevier, vol. 247(C).
    16. Kath, Christopher & Ziel, Florian, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Energy Economics, Elsevier, vol. 76(C), pages 411-423.
    17. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    18. Barbara Rossi, 2021. "Forecasting in the Presence of Instabilities: How We Know Whether Models Predict Well and How to Improve Them," Journal of Economic Literature, American Economic Association, vol. 59(4), pages 1135-1190, December.
    19. Narajewski, Michał & Ziel, Florian, 2020. "Econometric modelling and forecasting of intraday electricity prices," Journal of Commodity Markets, Elsevier, vol. 19(C).
    20. Stig Vinther Møller & Thomas Pedersen & Erik Christian Montes Schütte & Allan Timmermann, 2024. "Search and Predictability of Prices in the Housing Market," Management Science, INFORMS, vol. 70(1), pages 415-438, January.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:18:p:4994-:d:1753724. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager The email address of this maintainer does not seem to be valid anymore. Please ask MDPI Indexing Manager to update the entry or send us the correct address (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.