IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i2p582-d1024541.html
   My bibliography  Save this article

Detection of Outliers in Time Series Power Data Based on Prediction Errors

Author

Listed:
  • Changzhi Li

    (College of Electronics and Information Engineering, Shanghai University of Electric Power, No. 185, Hucheng Ring Road, Pudong New Area District, Shanghai 201306, China)

  • Dandan Liu

    (College of Electronics and Information Engineering, Shanghai University of Electric Power, No. 185, Hucheng Ring Road, Pudong New Area District, Shanghai 201306, China)

  • Mao Wang

    (College of Electronics and Information Engineering, Shanghai University of Electric Power, No. 185, Hucheng Ring Road, Pudong New Area District, Shanghai 201306, China)

  • Hanlin Wang

    (College of Electronics and Information Engineering, Shanghai University of Electric Power, No. 185, Hucheng Ring Road, Pudong New Area District, Shanghai 201306, China)

  • Shuai Xu

    (College of Electronics and Information Engineering, Shanghai University of Electric Power, No. 185, Hucheng Ring Road, Pudong New Area District, Shanghai 201306, China)

Abstract

The primary focus of smart grid power analysis is on power load forecasting and data anomaly detection. Efficient and accurate power load prediction and data anomaly detection enable energy companies to develop reasonable production and scheduling plans and reduce waste. Since traditional anomaly detection algorithms are typically for symmetrically distributed time series data, the distribution of energy consumption data features uncertainty. To this end, a time series outlier detection approach based on prediction errors is proposed in this paper, which starts by using an attention mechanism-based convolutional neural network (CNN)-gated recursive unit (GRU) method to obtain the residual between the measured value and its predicted value, and the residual data generally conform to a symmetric distribution. Subsequently, for these residual data, a random forest classification algorithm based on grid search optimization is used to identify outliers in the power consumption data. The model proposed in this paper is applied to both classical and real energy consumption datasets, and the performance is evaluated using different metrics. As shown in the results, the average accuracy of the model is improved by 25.2% and the average precision is improved by 17.2%, with an average recall improvement of 16.4% and an average F1 score improvement of 26.8% compared to the mainstream algorithms.

Suggested Citation

  • Changzhi Li & Dandan Liu & Mao Wang & Hanlin Wang & Shuai Xu, 2023. "Detection of Outliers in Time Series Power Data Based on Prediction Errors," Energies, MDPI, vol. 16(2), pages 1-19, January.
  • Handle: RePEc:gam:jeners:v:16:y:2023:i:2:p:582-:d:1024541
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/2/582/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/16/2/582/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yuanying Chi & Yangyi Zhang & Guozheng Li & Yongke Yuan, 2022. "Prediction Method of Beijing Electric-Energy Substitution Potential Based on a Grid-Search Support Vector Machine," Energies, MDPI, vol. 15(11), pages 1-11, May.
    2. Tej Bahadur Shahi & Ashish Shrestha & Arjun Neupane & William Guo, 2020. "Stock Price Forecasting with Deep Learning: A Comparative Study," Mathematics, MDPI, vol. 8(9), pages 1-15, August.
    3. Yong Sun & Huakun Que & Qianqian Cai & Jingming Zhao & Jingru Li & Zhengmin Kong & Shuai Wang, 2022. "Borderline SMOTE Algorithm and Feature Selection-Based Network Anomalies Detection Strategy," Energies, MDPI, vol. 15(13), pages 1-13, June.
    4. Lijun Zhang & Kai Liu & Yufeng Wang & Zachary Bosire Omariba, 2018. "Ice Detection Model of Wind Turbine Blades Based on Random Forest Classifier," Energies, MDPI, vol. 11(10), pages 1-15, September.
    5. Grzegorz Dudek, 2022. "A Comprehensive Study of Random Forest for Short-Term Load Forecasting," Energies, MDPI, vol. 15(20), pages 1-19, October.
    6. Gustavo Felipe Martin Nascimento & Frédéric Wurtz & Patrick Kuo-Peng & Benoit Delinchant & Nelson Jhoe Batistela, 2021. "Outlier Detection in Buildings’ Power Consumption Data Using Forecast Error," Energies, MDPI, vol. 14(24), pages 1-15, December.
    7. Yiqi Lu & Yongpan Li & Da Xie & Enwei Wei & Xianlu Bao & Huafeng Chen & Xiancheng Zhong, 2018. "The Application of Improved Random Forest Algorithm on the Prediction of Electric Vehicle Charging Load," Energies, MDPI, vol. 11(11), pages 1-16, November.
    8. Nasir Ayub & Muhammad Irfan & Muhammad Awais & Usman Ali & Tariq Ali & Mohammed Hamdi & Abdullah Alghamdi & Fazal Muhammad, 2020. "Big Data Analytics for Short and Medium-Term Electricity Load Forecasting Using an AI Techniques Ensembler," Energies, MDPI, vol. 13(19), pages 1-21, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tej Bahadur Shahi & Chiranjibi Sitaula & Arjun Neupane & William Guo, 2022. "Fruit classification using attention-based MobileNetV2 for industrial applications," PLOS ONE, Public Library of Science, vol. 17(2), pages 1-21, February.
    2. Chen, Wanqiu & Qiu, Yingning & Feng, Yanhui & Li, Ye & Kusiak, Andrew, 2021. "Diagnosis of wind turbine faults with transfer learning algorithms," Renewable Energy, Elsevier, vol. 163(C), pages 2053-2067.
    3. Ilia Zaznov & Julian Kunkel & Alfonso Dufour & Atta Badii, 2022. "Predicting Stock Price Changes Based on the Limit Order Book: A Survey," Mathematics, MDPI, vol. 10(8), pages 1-33, April.
    4. Jorge Maldonado-Correa & Sergio Martín-Martínez & Estefanía Artigao & Emilio Gómez-Lázaro, 2020. "Using SCADA Data for Wind Turbine Condition Monitoring: A Systematic Literature Review," Energies, MDPI, vol. 13(12), pages 1-21, June.
    5. Gustavo Felipe Martin Nascimento & Frédéric Wurtz & Patrick Kuo-Peng & Benoit Delinchant & Nelson Jhoe Batistela, 2022. "Quantifying Compressed Air Leakage through Non-Intrusive Load Monitoring Techniques in the Context of Energy Audits," Energies, MDPI, vol. 15(9), pages 1-24, April.
    6. Zhou, Kaile & Hu, Dingding & Li, Fangyi, 2022. "Impact of COVID-19 on private driving behavior: Evidence from electric vehicle charging data," Transport Policy, Elsevier, vol. 125(C), pages 164-178.
    7. Zhang, Jing & Yan, Jie & Liu, Yongqian & Zhang, Haoran & Lv, Guoliang, 2020. "Daily electric vehicle charging load profiles considering demographics of vehicle users," Applied Energy, Elsevier, vol. 274(C).
    8. Sajawal ur Rehman Khan & Israa Adil Hayder & Muhammad Asif Habib & Mudassar Ahmad & Syed Muhammad Mohsin & Farrukh Aslam Khan & Kainat Mustafa, 2022. "Enhanced Machine-Learning Techniques for Medium-Term and Short-Term Electric-Load Forecasting in Smart Grids," Energies, MDPI, vol. 16(1), pages 1-16, December.
    9. Shahzad Aslam & Nasir Ayub & Umer Farooq & Muhammad Junaid Alvi & Fahad R. Albogamy & Gul Rukh & Syed Irtaza Haider & Ahmad Taher Azar & Rasool Bukhsh, 2021. "Towards Electric Price and Load Forecasting Using CNN-Based Ensembler in Smart Grid," Sustainability, MDPI, vol. 13(22), pages 1-28, November.
    10. Wang, Shengyou & Zhuge, Chengxiang & Shao, Chunfu & Wang, Pinxi & Yang, Xiong & Wang, Shiqi, 2023. "Short-term electric vehicle charging demand prediction: A deep learning approach," Applied Energy, Elsevier, vol. 340(C).
    11. Richmond, M. & Sobey, A. & Pandit, R. & Kolios, A., 2020. "Stochastic assessment of aerodynamics within offshore wind farms based on machine-learning," Renewable Energy, Elsevier, vol. 161(C), pages 650-661.
    12. Silvia Zarkova & Dimitar Kostov & Petko Angelov & Tsvetan Pavlov & Andrey Zahariev, 2023. "Machine Learning Algorithm for Mid-Term Projection of the EU Member States’ Indebtedness," Risks, MDPI, vol. 11(4), pages 1-17, April.
    13. Tamás Storcz & Géza Várady & István Kistelegdi & Zsolt Ercsey, 2023. "Regression Models and Shape Descriptors for Building Energy Demand and Comfort Estimation," Energies, MDPI, vol. 16(16), pages 1-20, August.
    14. Grzegorz Dudek & Paweł Piotrowski & Dariusz Baczyński, 2023. "Intelligent Forecasting and Optimization in Electrical Power Systems: Advances in Models and Applications," Energies, MDPI, vol. 16(7), pages 1-11, March.
    15. Ankit Kumar Srivastava & Ajay Shekhar Pandey & Mohamad Abou Houran & Varun Kumar & Dinesh Kumar & Saurabh Mani Tripathi & Sivasankar Gangatharan & Rajvikram Madurai Elavarasan, 2023. "A Day-Ahead Short-Term Load Forecasting Using M5P Machine Learning Algorithm along with Elitist Genetic Algorithm (EGA) and Random Forest-Based Hybrid Feature Selection," Energies, MDPI, vol. 16(2), pages 1-23, January.
    16. Harsimrat Kaeley & Ye Qiao & Nader Bagherzadeh, 2023. "Support for Stock Trend Prediction Using Transformers and Sentiment Analysis," Papers 2305.14368, arXiv.org.
    17. Wenjie Wang & Yu Xue & Chengkuan He & Yongnian Zhao, 2022. "Review of the Typical Damage and Damage-Detection Methods of Large Wind Turbine Blades," Energies, MDPI, vol. 15(15), pages 1-31, August.
    18. Marcin Blachnik & Sławomir Walkowiak & Adam Kula, 2023. "Large Scale, Mid Term Wind Farms Power Generation Prediction," Energies, MDPI, vol. 16(5), pages 1-15, March.
    19. Winita Sulandari & Yudho Yudhanto & Paulo Canas Rodrigues, 2022. "The Use of Singular Spectrum Analysis and K-Means Clustering-Based Bootstrap to Improve Multistep Ahead Load Forecasting," Energies, MDPI, vol. 15(16), pages 1-22, August.
    20. Qin Chen & Komla Agbenyo Folly, 2022. "Application of Artificial Intelligence for EV Charging and Discharging Scheduling and Dynamic Pricing: A Review," Energies, MDPI, vol. 16(1), pages 1-26, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:2:p:582-:d:1024541. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.