IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v330y2023ipas0306261922015367.html
   My bibliography  Save this article

A real-time electrical load forecasting and unsupervised anomaly detection framework

Author

Listed:
  • Wang, Xinlin
  • Yao, Zhihao
  • Papaefthymiou, Marios

Abstract

We propose a unified machine learning (ML) framework for simultaneously performing electrical load forecasting and unsupervised anomaly detection in real time. For load forecasting, we introduce a training data generator (TDG) and a look-back optimizer (LBO) to enhance the performance of a baseline ML-driven prediction approach. The proposed TDG selects a subset of the entire historical dataset of power consumption to derive a relatively small training dataset that is used for forecasting using ML. It is designed to operate on raw meter data, without requiring any input data conditioning or additional information (e.g., weather, building occupancy), thus providing a data-efficient training approach. The proposed LBO optimizes prediction performance by tracking the accuracy of prior forecasts and automatically adjusting the framework to improve prediction outcomes. For the problem of anomaly detection, the proposed framework is unsupervised and determines abnormality by comparing fluctuations in the current load with power consumption changes in the training dataset. Therefore, in addition to not requiring any data-labeling, it circumvents the problem of imbalanced classes associated with ML-based anomaly detection methods. The proposed framework is evaluated using a real-world power consumption dataset from a large US-based university campus with considerable power usage complexity. Twelve different evaluation metrics are used to comprehensively assess the effectiveness of our approach. Our evaluation results show that compared with alternative methods, the proposed framework consistently achieves superior outcomes with regard to both load forecasting and anomaly detection, representing a promising approach to electrical load forecasting and anomaly detection in practice.

Suggested Citation

  • Wang, Xinlin & Yao, Zhihao & Papaefthymiou, Marios, 2023. "A real-time electrical load forecasting and unsupervised anomaly detection framework," Applied Energy, Elsevier, vol. 330(PA).
  • Handle: RePEc:eee:appene:v:330:y:2023:i:pa:s0306261922015367
    DOI: 10.1016/j.apenergy.2022.120279
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261922015367
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2022.120279?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fan, Cheng & Xiao, Fu & Zhao, Yang, 2017. "A short-term building cooling load prediction method using deep learning algorithms," Applied Energy, Elsevier, vol. 195(C), pages 222-233.
    2. Massaoudi, Mohamed & Refaat, Shady S. & Chihi, Ines & Trabelsi, Mohamed & Oueslati, Fakhreddine S. & Abu-Rub, Haitham, 2021. "A novel stacked generalization ensemble-based hybrid LGBM-XGB-MLP model for Short-Term Load Forecasting," Energy, Elsevier, vol. 214(C).
    3. Hu, Jianming & Luo, Qingxi & Tang, Jingwei & Heng, Jiani & Deng, Yuwen, 2022. "Conformalized temporal convolutional quantile regression networks for wind power interval forecasting," Energy, Elsevier, vol. 248(C).
    4. Wang, Xinlin & Flores, Robert & Brouwer, Jack & Papaefthymiou, Marios, 2022. "Real-time detection of electrical load anomalies through hyperdimensional computing," Energy, Elsevier, vol. 261(PA).
    5. Davut Solyali, 2020. "A Comparative Analysis of Machine Learning Approaches for Short-/Long-Term Electricity Load Forecasting in Cyprus," Sustainability, MDPI, vol. 12(9), pages 1-34, April.
    6. Wang, Fu-Kwun & Amogne, Zemenu Endalamaw & Chou, Jia-Hong & Tseng, Cheng, 2022. "Online remaining useful life prediction of lithium-ion batteries using bidirectional long short-term memory with attention mechanism," Energy, Elsevier, vol. 254(PB).
    7. Sabri Boughorbel & Fethi Jarray & Mohammed El-Anbari, 2017. "Optimal classifier for imbalanced data using Matthews Correlation Coefficient metric," PLOS ONE, Public Library of Science, vol. 12(6), pages 1-17, June.
    8. Zhang, Wenjie & Quan, Hao & Srinivasan, Dipti, 2018. "Parallel and reliable probabilistic load forecasting via quantile regression forest and quantile determination," Energy, Elsevier, vol. 160(C), pages 810-819.
    9. Li, Ao & Xiao, Fu & Zhang, Chong & Fan, Cheng, 2021. "Attention-based interpretable neural network for building cooling load prediction," Applied Energy, Elsevier, vol. 299(C).
    10. Xue-Bo Jin & Wei-Zhen Zheng & Jian-Lei Kong & Xiao-Yi Wang & Yu-Ting Bai & Ting-Li Su & Seng Lin, 2021. "Deep-Learning Forecasting Method for Electric Power Load via Attention-Based Encoder-Decoder with Bayesian Optimization," Energies, MDPI, vol. 14(6), pages 1-18, March.
    11. Wang, Xinlin & Ahn, Sung-Hoon, 2020. "Real-time prediction and anomaly detection of electrical load in a residential community," Applied Energy, Elsevier, vol. 259(C).
    12. Fan, Cheng & Xiao, Fu & Zhao, Yang & Wang, Jiayuan, 2018. "Analytical investigation of autoencoder-based methods for unsupervised anomaly detection in building energy data," Applied Energy, Elsevier, vol. 211(C), pages 1123-1135.
    13. Wang, Xinlin & Wang, Hao & Ahn, Sung-Hoon, 2021. "Demand-side management for off-grid solar-powered microgrids: A case study of rural electrification in Tanzania," Energy, Elsevier, vol. 224(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Saima Akhtar & Sulman Shahzad & Asad Zaheer & Hafiz Sami Ullah & Heybet Kilic & Radomir Gono & Michał Jasiński & Zbigniew Leonowicz, 2023. "Short-Term Load Forecasting Models: A Review of Challenges, Progress, and the Road Ahead," Energies, MDPI, vol. 16(10), pages 1-29, May.
    2. Stracqualursi, Erika & Rosato, Antonello & Di Lorenzo, Gianfranco & Panella, Massimo & Araneo, Rodolfo, 2023. "Systematic review of energy theft practices and autonomous detection through artificial intelligence methods," Renewable and Sustainable Energy Reviews, Elsevier, vol. 184(C).
    3. Tulin Guzel & Hakan Cinar & Mehmet Nabi Cenet & Kamil Doruk Oguz & Ahmet Yucekaya & Mustafa Hekimoglu, 2023. "A Framework to Forecast Electricity Consumption of Meters using Automated Ranking and Data Preprocessing," International Journal of Energy Economics and Policy, Econjournals, vol. 13(5), pages 179-193, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Xinlin & Flores, Robert & Brouwer, Jack & Papaefthymiou, Marios, 2022. "Real-time detection of electrical load anomalies through hyperdimensional computing," Energy, Elsevier, vol. 261(PA).
    2. Fan, Cheng & Sun, Yongjun & Zhao, Yang & Song, Mengjie & Wang, Jiayuan, 2019. "Deep learning-based feature engineering methods for improved building energy prediction," Applied Energy, Elsevier, vol. 240(C), pages 35-45.
    3. Liang, Xinbin & Zhu, Xu & Chen, Kang & Chen, Siliang & Jin, Xinqiao & Du, Zhimin, 2023. "Endowing data-driven models with rejection ability: Out-of-distribution detection and confidence estimation for black-box models of building energy systems," Energy, Elsevier, vol. 263(PC).
    4. Hernandez-Matheus, Alejandro & Löschenbrand, Markus & Berg, Kjersti & Fuchs, Ida & Aragüés-Peñalba, Mònica & Bullich-Massagué, Eduard & Sumper, Andreas, 2022. "A systematic review of machine learning techniques related to local energy communities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 170(C).
    5. Hany Habbak & Mohamed Mahmoud & Khaled Metwally & Mostafa M. Fouda & Mohamed I. Ibrahem, 2023. "Load Forecasting Techniques and Their Applications in Smart Grids," Energies, MDPI, vol. 16(3), pages 1-33, February.
    6. Zhang, Dongxue & Wang, Shuai & Liang, Yuqiu & Du, Zhiyuan, 2023. "A novel combined model for probabilistic load forecasting based on deep learning and improved optimizer," Energy, Elsevier, vol. 264(C).
    7. Himeur, Yassine & Ghanem, Khalida & Alsalemi, Abdullah & Bensaali, Faycal & Amira, Abbes, 2021. "Artificial intelligence based anomaly detection of energy consumption in buildings: A review, current trends and new perspectives," Applied Energy, Elsevier, vol. 287(C).
    8. Kong, Jun & Jiang, Wen & Tian, Qing & Jiang, Min & Liu, Tianshan, 2023. "Anomaly detection based on joint spatio-temporal learning for building electricity consumption," Applied Energy, Elsevier, vol. 334(C).
    9. Huang, Tian-en & Guo, Qinglai & Sun, Hongbin & Tan, Chin-Woo & Hu, Tianyu, 2019. "A deep spatial-temporal data-driven approach considering microclimates for power system security assessment," Applied Energy, Elsevier, vol. 237(C), pages 36-48.
    10. Li, Guannan & Li, Fan & Ahmad, Tanveer & Liu, Jiangyan & Li, Tao & Fang, Xi & Wu, Yubei, 2022. "Performance evaluation of sequence-to-sequence-Attention model for short-term multi-step ahead building energy predictions," Energy, Elsevier, vol. 259(C).
    11. Wang, Zeyu & Liu, Jian & Zhang, Yuanxin & Yuan, Hongping & Zhang, Ruixue & Srinivasan, Ravi S., 2021. "Practical issues in implementing machine-learning models for building energy efficiency: Moving beyond obstacles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 143(C).
    12. Fan, Cheng & Wang, Jiayuan & Gang, Wenjie & Li, Shenghan, 2019. "Assessment of deep recurrent neural network-based strategies for short-term building energy predictions," Applied Energy, Elsevier, vol. 236(C), pages 700-710.
    13. Chen, Zhiwen & Deng, Qiao & Ren, Hao & Zhao, Zhengrun & Peng, Tao & Yang, Chunhua & Gui, Weihua, 2022. "A new energy consumption prediction method for chillers based on GraphSAGE by combining empirical knowledge and operating data," Applied Energy, Elsevier, vol. 310(C).
    14. Yu, Min & Niu, Dongxiao & Zhao, Jinqiu & Li, Mingyu & Sun, Lijie & Yu, Xiaoyu, 2023. "Building cooling load forecasting of IES considering spatiotemporal coupling based on hybrid deep learning model," Applied Energy, Elsevier, vol. 349(C).
    15. Jia, Lizhi & Liu, Junjie & Chong, Adrian & Dai, Xilei, 2022. "Deep learning and physics-based modeling for the optimization of ice-based thermal energy systems in cooling plants," Applied Energy, Elsevier, vol. 322(C).
    16. Nadia Jahanafroozi & Saman Shokrpour & Fatemeh Nejati & Omrane Benjeddou & Mohammad Worya Khordehbinan & Afshin Marani & Moncef L. Nehdi, 2022. "New Heuristic Methods for Sustainable Energy Performance Analysis of HVAC Systems," Sustainability, MDPI, vol. 14(21), pages 1-14, November.
    17. Simona-Vasilica Oprea & Adela Bâra & Florina Camelia Puican & Ioan Cosmin Radu, 2021. "Anomaly Detection with Machine Learning Algorithms and Big Data in Electricity Consumption," Sustainability, MDPI, vol. 13(19), pages 1-20, October.
    18. Chen, Zhelun & O’Neill, Zheng & Wen, Jin & Pradhan, Ojas & Yang, Tao & Lu, Xing & Lin, Guanjing & Miyata, Shohei & Lee, Seungjae & Shen, Chou & Chiosa, Roberto & Piscitelli, Marco Savino & Capozzoli, , 2023. "A review of data-driven fault detection and diagnostics for building HVAC systems," Applied Energy, Elsevier, vol. 339(C).
    19. Mirza Rizwan Sajid & Bader A. Almehmadi & Waqas Sami & Mansour K. Alzahrani & Noryanti Muhammad & Christophe Chesneau & Asif Hanif & Arshad Ali Khan & Ahmad Shahbaz, 2021. "Development of Nonlaboratory-Based Risk Prediction Models for Cardiovascular Diseases Using Conventional and Machine Learning Approaches," IJERPH, MDPI, vol. 18(23), pages 1-16, November.
    20. Sun, Alexander Y., 2020. "Optimal carbon storage reservoir management through deep reinforcement learning," Applied Energy, Elsevier, vol. 278(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:330:y:2023:i:pa:s0306261922015367. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.