IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v182y2023ics1364032123002216.html
   My bibliography  Save this article

Deep dive into hybrid networks: A comparative study and novel architecture for efficient power prediction

Author

Listed:
  • Khan, Noman
  • Khan, Samee Ullah
  • Baik, Sung Wook

Abstract

The prediction of electric power consumption (PC) and power generation (PG) plays an important role in the management, trading, and storage of energy, and in saving resources. Traditional approaches based on machine learning (ML) are subject to several issues arising from the use of handcrafted feature extraction, the requirement to learn the nonlinear relationships between output and input sequences, and inadequate adjustability to real-world scenarios. Similarly, the performance of deep-plane hybrid networks decreases when their depth increases. There is a need for more robust models in the energy forecasting domain that have high accuracy and strong generalizability to real-world implementations. To tackle the problems described above and to obtain a robust model, we propose a hybrid network based on a dilated depthwise separable convolutional neural network (DDSCNN) and a bidirectional gated recurrent unit (BGRU) in which a skip connection strategy is used to forecast short-term power production and consumption. In our framework, the obtained data are passed through a preprocessing stage for cleaning, and the refined data are input to the residual DDSCNN block to extract spatial features. These features are then fed to the residual BGRU block to learn the sequential and temporal patterns from them, and finally, dense layers are included at the end of the model to forecast the power. A comprehensive ablation study is conducted on various spatiotemporal hybrid models, and the best performer in terms of accuracy is selected using six power datasets. The root mean square error (RMSE) values obtained by the proposed model for the Korea south east solar power (KSESP), Australia Alice Springs solar power (AASSP), and Korea Yeongam solar power (KYSP) datasets are 0.8335, 0.2317, and 0.0954, respectively. Similarly, the RMSE values for the Korea south east wind power (KSEWP), individual household electric power consumption (IHEPC), and advanced institute of convergence technology (AICT) datasets are recorded as 0.5596, 0.1054, and 0.1068, respectively.

Suggested Citation

  • Khan, Noman & Khan, Samee Ullah & Baik, Sung Wook, 2023. "Deep dive into hybrid networks: A comparative study and novel architecture for efficient power prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
  • Handle: RePEc:eee:rensus:v:182:y:2023:i:c:s1364032123002216
    DOI: 10.1016/j.rser.2023.113364
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032123002216
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.rser.2023.113364?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ahmad, Tanveer & Madonski, Rafal & Zhang, Dongdong & Huang, Chao & Mujeeb, Asad, 2022. "Data-driven probabilistic machine learning in sustainable smart energy/smart energy systems: Key developments, challenges, and future research opportunities in the context of smart grid paradigm," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    2. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    3. Kapp, Sean & Choi, Jun-Ki & Hong, Taehoon, 2023. "Predicting industrial building energy consumption with statistical and machine-learning models informed by physical system parameters," Renewable and Sustainable Energy Reviews, Elsevier, vol. 172(C).
    4. Zheng, Jianqin & Du, Jian & Wang, Bohong & Klemeš, Jiří Jaromír & Liao, Qi & Liang, Yongtu, 2023. "A hybrid framework for forecasting power generation of multiple renewable energy sources," Renewable and Sustainable Energy Reviews, Elsevier, vol. 172(C).
    5. Lei, Jinhao & Liu, Chao & Jiang, Dongxiang, 2019. "Fault diagnosis of wind turbine based on Long Short-term memory networks," Renewable Energy, Elsevier, vol. 133(C), pages 422-432.
    6. Guo, Fei & Wu, Xiongwei & Liu, Lili & Ye, Jilei & Wang, Tao & Fu, Lijun & Wu, Yuping, 2023. "Prediction of remaining useful life and state of health of lithium batteries based on time series feature and Savitzky-Golay filter combined with gated recurrent unit neural network," Energy, Elsevier, vol. 270(C).
    7. Chen, Yongbao & Xu, Peng & Chu, Yiyi & Li, Weilin & Wu, Yuntao & Ni, Lizhou & Bao, Yi & Wang, Kun, 2017. "Short-term electrical load forecasting using the Support Vector Regression (SVR) model to calculate the demand response baseline for office buildings," Applied Energy, Elsevier, vol. 195(C), pages 659-670.
    8. Noman Khan & Fath U Min Ullah & Ijaz Ul Haq & Samee Ullah Khan & Mi Young Lee & Sung Wook Baik, 2021. "AB-Net: A Novel Deep Learning Assisted Framework for Renewable Energy Generation Forecasting," Mathematics, MDPI, vol. 9(19), pages 1-18, October.
    9. Kim, Suwon & Kim, Seongcheol, 2016. "A multi-criteria approach toward discovering killer IoT application in Korea," Technological Forecasting and Social Change, Elsevier, vol. 102(C), pages 143-155.
    10. Sehrish Malik & DoHyeun Kim, 2018. "Prediction-Learning Algorithm for Efficient Energy Consumption in Smart Buildings Based on Particle Regeneration and Velocity Boost in Particle Swarm Optimization Neural Networks," Energies, MDPI, vol. 11(5), pages 1-21, May.
    11. Fumo, Nelson & Rafe Biswas, M.A., 2015. "Regression analysis for prediction of residential energy consumption," Renewable and Sustainable Energy Reviews, Elsevier, vol. 47(C), pages 332-343.
    12. Nejat, Payam & Jomehzadeh, Fatemeh & Taheri, Mohammad Mahdi & Gohari, Mohammad & Abd. Majid, Muhd Zaimi, 2015. "A global review of energy consumption, CO2 emissions and policy in the residential sector (with an overview of the top ten CO2 emitting countries)," Renewable and Sustainable Energy Reviews, Elsevier, vol. 43(C), pages 843-862.
    13. Cao, Sunliang & Sirén, Kai, 2014. "Impact of simulation time-resolution on the matching of PV production and household electric demand," Applied Energy, Elsevier, vol. 128(C), pages 192-208.
    14. Qin, Yong & Li, Kun & Liang, Zhanhao & Lee, Brendan & Zhang, Fuyong & Gu, Yongcheng & Zhang, Lei & Wu, Fengzhi & Rodriguez, Dragan, 2019. "Hybrid forecasting model based on long short term memory network and deep learning neural network for wind signal," Applied Energy, Elsevier, vol. 236(C), pages 262-272.
    15. Moriarty, Patrick & Honnery, Damon, 2019. "Ecosystem maintenance energy and the need for a green EROI," Energy Policy, Elsevier, vol. 131(C), pages 229-234.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fath U Min Ullah & Noman Khan & Tanveer Hussain & Mi Young Lee & Sung Wook Baik, 2021. "Diving Deep into Short-Term Electricity Load Forecasting: Comparative Analysis and a Novel Framework," Mathematics, MDPI, vol. 9(6), pages 1-22, March.
    2. Hamid R. Khosravani & María Del Mar Castilla & Manuel Berenguel & Antonio E. Ruano & Pedro M. Ferreira, 2016. "A Comparison of Energy Consumption Prediction Models Based on Neural Networks of a Bioclimatic Building," Energies, MDPI, vol. 9(1), pages 1-24, January.
    3. Gonçalves, Rui & Ribeiro, Vitor Miguel & Pereira, Fernando Lobo, 2023. "Variable Split Convolutional Attention: A novel Deep Learning model applied to the household electric power consumption," Energy, Elsevier, vol. 274(C).
    4. Muhammad Ali & Krishneel Prakash & Carlos Macana & Ali Kashif Bashir & Alireza Jolfaei & Awais Bokhari & Jiří Jaromír Klemeš & Hemanshu Pota, 2022. "Modeling Residential Electricity Consumption from Public Demographic Data for Sustainable Cities," Energies, MDPI, vol. 15(6), pages 1-16, March.
    5. Lawal, Abiola S. & Servadio, Joseph L. & Davis, Tate & Ramaswami, Anu & Botchwey, Nisha & Russell, Armistead G., 2021. "Orthogonalization and machine learning methods for residential energy estimation with social and economic indicators," Applied Energy, Elsevier, vol. 283(C).
    6. Liu, Gang & Wang, Kun & Hao, Xiaochen & Zhang, Zhipeng & Zhao, Yantao & Xu, Qingquan, 2022. "SA-LSTMs: A new advance prediction method of energy consumption in cement raw materials grinding system," Energy, Elsevier, vol. 241(C).
    7. Somu, Nivethitha & M R, Gauthama Raman & Ramamritham, Krithi, 2020. "A hybrid model for building energy consumption forecasting using long short term memory networks," Applied Energy, Elsevier, vol. 261(C).
    8. Ding, Zhikun & Chen, Weilin & Hu, Ting & Xu, Xiaoxiao, 2021. "Evolutionary double attention-based long short-term memory model for building energy prediction: Case study of a green building," Applied Energy, Elsevier, vol. 288(C).
    9. Salam, Abdulwahed & El Hibaoui, Abdelaaziz, 2021. "Energy consumption prediction model with deep inception residual network inspiration and LSTM," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 190(C), pages 97-109.
    10. Zhou, Cheng & Chen, Xiyang, 2019. "Predicting energy consumption: A multiple decomposition-ensemble approach," Energy, Elsevier, vol. 189(C).
    11. Minkyu Kim & Chankook Park, 2021. "Academic Topics Related to Household Energy Consumption Using the Future Sign Detection Technique," Energies, MDPI, vol. 14(24), pages 1-24, December.
    12. Mumin Zhang & Yuzhi Wang & Haochen Zhang & Zhiyun Peng & Junjie Tang, 2023. "A Novel and Robust Wind Speed Prediction Method Based on Spatial Features of Wind Farm Cluster," Mathematics, MDPI, vol. 11(3), pages 1-17, January.
    13. Hyojoo Son & Changwan Kim, 2020. "A Deep Learning Approach to Forecasting Monthly Demand for Residential–Sector Electricity," Sustainability, MDPI, vol. 12(8), pages 1-16, April.
    14. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    15. Satre-Meloy, Aven, 2019. "Investigating structural and occupant drivers of annual residential electricity consumption using regularization in regression models," Energy, Elsevier, vol. 174(C), pages 148-168.
    16. Seyed Azad Nabavi & Alireza Aslani & Martha A. Zaidan & Majid Zandi & Sahar Mohammadi & Naser Hossein Motlagh, 2020. "Machine Learning Modeling for Energy Consumption of Residential and Commercial Sectors," Energies, MDPI, vol. 13(19), pages 1-22, October.
    17. Richter, Lucas & Lehna, Malte & Marchand, Sophie & Scholz, Christoph & Dreher, Alexander & Klaiber, Stefan & Lenk, Steve, 2022. "Artificial Intelligence for Electricity Supply Chain automation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 163(C).
    18. Zhang, Wenyu & Chen, Qian & Yan, Jianyong & Zhang, Shuai & Xu, Jiyuan, 2021. "A novel asynchronous deep reinforcement learning model with adaptive early forecasting method and reward incentive mechanism for short-term load forecasting," Energy, Elsevier, vol. 236(C).
    19. Xiao Wang & Zheng Zheng & Guoqian Jiang & Qun He & Ping Xie, 2022. "Detecting Wind Turbine Blade Icing with a Multiscale Long Short-Term Memory Network," Energies, MDPI, vol. 15(8), pages 1-19, April.
    20. Le Hoang Anh & Gwang-Hyun Yu & Dang Thanh Vu & Hyoung-Gook Kim & Jin-Young Kim, 2023. "DelayNet: Enhancing Temporal Feature Extraction for Electronic Consumption Forecasting with Delayed Dilated Convolution," Energies, MDPI, vol. 16(22), pages 1-18, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:182:y:2023:i:c:s1364032123002216. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.