IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v324y2022ics0306261922010388.html
   My bibliography  Save this article

EGD-SNet: A computational search engine for predicting an end-to-end machine learning pipeline for Energy Generation & Demand Forecasting

Author

Listed:
  • Mehmood, Faiza
  • Ghani, Muhammad Usman
  • Ghafoor, Hina
  • Shahzadi, Rehab
  • Asim, Muhammad Nabeel
  • Mahmood, Waqar

Abstract

Load forecasting avoids energy wastage by accurately estimating the future quantity of energy generation and demand. Existing load forecasting approaches do not utilize the potential of feature selection and dimensionality reduction approaches that remove irrelevant/redundant features and improve the performance of machine learning (ML) regressors. This research presents an end-to-end framework named Energy Generation and Demand forecasting Search Net (EGD-SNet) capable of predicting energy generation, demand and temperature in multiple regions. EGD-SNet framework contains 13 different feature selection and 11 dimensionality reduction algorithms along with 10 most widely used ML regressors. It makes use of Particle Swarm Optimizer (PSO) to smartly train regressors by finding optimal hyperparameters. Further, it has potential to design an end to end pipeline by finding appropriate combination of regressor and feature selection or dimensionality reduction approaches for precisely predicting energy generation or demand for a particular regional data based on the characteristics of data. EGD-SNet as web service is accessible here. http://111.68.102.19:8000/

Suggested Citation

  • Mehmood, Faiza & Ghani, Muhammad Usman & Ghafoor, Hina & Shahzadi, Rehab & Asim, Muhammad Nabeel & Mahmood, Waqar, 2022. "EGD-SNet: A computational search engine for predicting an end-to-end machine learning pipeline for Energy Generation & Demand Forecasting," Applied Energy, Elsevier, vol. 324(C).
    • Handle: RePEc:eee:appene:v:324:y:2022:i:c:s0306261922010388
    DOI: 10.1016/j.apenergy.2022.119754
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261922010388
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2022.119754?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    2. Yagli, Gokhan Mert & Yang, Dazhi & Srinivasan, Dipti, 2019. "Automatic hourly solar forecasting using machine learning models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 105(C), pages 487-498.
    3. Mehmood, Faiza & Ghani, Muhammad Usman & Asim, Muhammad Nabeel & Shahzadi, Rehab & Mehmood, Aamir & Mahmood, Waqar, 2021. "MPF-Net: A computational multi-regional solar power forecasting framework," Renewable and Sustainable Energy Reviews, Elsevier, vol. 151(C).
    4. Zhang, Wenyu & Chen, Qian & Yan, Jianyong & Zhang, Shuai & Xu, Jiyuan, 2021. "A novel asynchronous deep reinforcement learning model with adaptive early forecasting method and reward incentive mechanism for short-term load forecasting," Energy, Elsevier, vol. 236(C).
    5. Arash Moradzadeh & Sahar Zakeri & Maryam Shoaran & Behnam Mohammadi-Ivatloo & Fazel Mohammadi, 2020. "Short-Term Load Forecasting of Microgrid via Hybrid Support Vector Regression and Long Short-Term Memory Algorithms," Sustainability, MDPI, vol. 12(17), pages 1-17, August.
    6. Andrés M. Alonso & Francisco J. Nogales & Carlos Ruiz, 2020. "A Single Scalable LSTM Model for Short-Term Forecasting of Massive Electricity Time Series," Energies, MDPI, vol. 13(20), pages 1-19, October.
    7. Hu, Shuai & Xiang, Yue & Zhang, Hongcai & Xie, Shanyi & Li, Jianhua & Gu, Chenghong & Sun, Wei & Liu, Junyong, 2021. "Hybrid forecasting method for wind power integrating spatial correlation and corrected numerical weather prediction," Applied Energy, Elsevier, vol. 293(C).
    8. Davut Solyali, 2020. "A Comparative Analysis of Machine Learning Approaches for Short-/Long-Term Electricity Load Forecasting in Cyprus," Sustainability, MDPI, vol. 12(9), pages 1-34, April.
    9. Tahir, Zia ul Rehman & Azhar, Muhammad & Blanc, Philippe & Asim, Muhammad & Imran, Shahid & Hayat, Nasir & Shahid, Hamza & Ali, Hasnain, 2020. "The evaluation of reanalysis and analysis products of solar radiation for Sindh province, Pakistan," Renewable Energy, Elsevier, vol. 145(C), pages 347-362.
    10. Fouilloy, Alexis & Voyant, Cyril & Notton, Gilles & Motte, Fabrice & Paoli, Christophe & Nivet, Marie-Laure & Guillot, Emmanuel & Duchaud, Jean-Laurent, 2018. "Solar irradiation prediction with machine learning: Forecasting models selection method depending on weather variability," Energy, Elsevier, vol. 165(PA), pages 620-629.
    11. Xiaorui Shao & Chang-Soo Kim & Palash Sontakke, 2020. "Accurate Deep Model for Electricity Consumption Forecasting Using Multi-Channel and Multi-Scale Feature Fusion CNN–LSTM," Energies, MDPI, vol. 13(8), pages 1-22, April.
    12. Arpita Samanta Santra & Jun-Lin Lin, 2019. "Integrating Long Short-Term Memory and Genetic Algorithm for Short-Term Load Forecasting," Energies, MDPI, vol. 12(11), pages 1-11, May.
    13. Marzo, A. & Trigo-Gonzalez, M. & Alonso-Montesinos, J. & Martínez-Durbán, M. & López, G. & Ferrada, P. & Fuentealba, E. & Cortés, M. & Batlles, F.J., 2017. "Daily global solar radiation estimation in desert areas using daily extreme temperatures and extraterrestrial radiation," Renewable Energy, Elsevier, vol. 113(C), pages 303-311.
    14. Aneeque A. Mir & Mohammed Alghassab & Kafait Ullah & Zafar A. Khan & Yuehong Lu & Muhammad Imran, 2020. "A Review of Electricity Demand Forecasting in Low and Middle Income Countries: The Demand Determinants and Horizons," Sustainability, MDPI, vol. 12(15), pages 1-35, July.
    15. Xian, Huafeng & Che, Jinxing, 2022. "Multi-space collaboration framework based optimal model selection for power load forecasting," Applied Energy, Elsevier, vol. 314(C).
    16. Li, Lechen & Meinrenken, Christoph J. & Modi, Vijay & Culligan, Patricia J., 2021. "Short-term apartment-level load forecasting using a modified neural network with selected auto-regressive features," Applied Energy, Elsevier, vol. 287(C).
    17. Fatma Yaprakdal & M. Berkay Yılmaz & Mustafa Baysal & Amjad Anvari-Moghaddam, 2020. "A Deep Neural Network-Assisted Approach to Enhance Short-Term Optimal Operational Scheduling of a Microgrid," Sustainability, MDPI, vol. 12(4), pages 1-27, February.
    18. Carneiro, Tatiane C. & Rocha, Paulo A.C. & Carvalho, Paulo C.M. & Fernández-Ramírez, Luis M., 2022. "Ridge regression ensemble of machine learning models applied to solar and wind forecasting in Brazil and Spain," Applied Energy, Elsevier, vol. 314(C).
    19. Salah Bouktif & Ali Fiaz & Ali Ouni & Mohamed Adel Serhani, 2019. "Single and Multi-Sequence Deep Learning Models for Short and Medium Term Electric Load Forecasting," Energies, MDPI, vol. 12(1), pages 1-21, January.
    20. Khazaei, Sahra & Ehsan, Mehdi & Soleymani, Soodabeh & Mohammadnezhad-Shourkaei, Hosein, 2022. "A high-accuracy hybrid method for short-term wind power forecasting," Energy, Elsevier, vol. 238(PC).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rao, Congjun & Zhang, Yue & Wen, Jianghui & Xiao, Xinping & Goh, Mark, 2023. "Energy demand forecasting in China: A support vector regression-compositional data second exponential smoothing model," Energy, Elsevier, vol. 263(PC).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dana-Mihaela Petroșanu & Alexandru Pîrjan, 2020. "Electricity Consumption Forecasting Based on a Bidirectional Long-Short-Term Memory Artificial Neural Network," Sustainability, MDPI, vol. 13(1), pages 1-31, December.
    2. Mehmood, Faiza & Ghani, Muhammad Usman & Asim, Muhammad Nabeel & Shahzadi, Rehab & Mehmood, Aamir & Mahmood, Waqar, 2021. "MPF-Net: A computational multi-regional solar power forecasting framework," Renewable and Sustainable Energy Reviews, Elsevier, vol. 151(C).
    3. Bibi Ibrahim & Luis Rabelo & Edgar Gutierrez-Franco & Nicolas Clavijo-Buritica, 2022. "Machine Learning for Short-Term Load Forecasting in Smart Grids," Energies, MDPI, vol. 15(21), pages 1-19, October.
    4. Ghadah Alkhayat & Syed Hamid Hasan & Rashid Mehmood, 2022. "SENERGY: A Novel Deep Learning-Based Auto-Selective Approach and Tool for Solar Energy Forecasting," Energies, MDPI, vol. 15(18), pages 1-55, September.
    5. Hongchao Zhang & Tengteng Zhu, 2022. "Stacking Model for Photovoltaic-Power-Generation Prediction," Sustainability, MDPI, vol. 14(9), pages 1-16, May.
    6. Zizhen Cheng & Li Wang & Yumeng Yang, 2023. "A Hybrid Feature Pyramid CNN-LSTM Model with Seasonal Inflection Month Correction for Medium- and Long-Term Power Load Forecasting," Energies, MDPI, vol. 16(7), pages 1-18, March.
    7. Hernandez-Matheus, Alejandro & Löschenbrand, Markus & Berg, Kjersti & Fuchs, Ida & Aragüés-Peñalba, Mònica & Bullich-Massagué, Eduard & Sumper, Andreas, 2022. "A systematic review of machine learning techniques related to local energy communities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 170(C).
    8. Brucke, Karoline & Arens, Stefan & Telle, Jan-Simon & Steens, Thomas & Hanke, Benedikt & von Maydell, Karsten & Agert, Carsten, 2021. "A non-intrusive load monitoring approach for very short-term power predictions in commercial buildings," Applied Energy, Elsevier, vol. 292(C).
    9. Gonçalves, Rui & Ribeiro, Vitor Miguel & Pereira, Fernando Lobo, 2023. "Variable Split Convolutional Attention: A novel Deep Learning model applied to the household electric power consumption," Energy, Elsevier, vol. 274(C).
    10. Zhang, Wenyu & Chen, Qian & Yan, Jianyong & Zhang, Shuai & Xu, Jiyuan, 2021. "A novel asynchronous deep reinforcement learning model with adaptive early forecasting method and reward incentive mechanism for short-term load forecasting," Energy, Elsevier, vol. 236(C).
    11. Cecilia Martinez-Castillo & Gonzalo Astray & Juan Carlos Mejuto, 2021. "Modelling and Prediction of Monthly Global Irradiation Using Different Prediction Models," Energies, MDPI, vol. 14(8), pages 1-16, April.
    12. Dai, Xiaoran & Liu, Guo-Ping & Hu, Wenshan, 2023. "An online-learning-enabled self-attention-based model for ultra-short-term wind power forecasting," Energy, Elsevier, vol. 272(C).
    13. Bo Hu & Jian Xu & Zuoxia Xing & Pengfei Zhang & Jia Cui & Jinglu Liu, 2022. "Short-Term Combined Forecasting Method of Park Load Based on CEEMD-MLR-LSSVR-SBO," Energies, MDPI, vol. 15(8), pages 1-14, April.
    14. Salam, Abdulwahed & El Hibaoui, Abdelaaziz, 2021. "Energy consumption prediction model with deep inception residual network inspiration and LSTM," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 190(C), pages 97-109.
    15. Tyler McCandless & Susan Dettling & Sue Ellen Haupt, 2020. "Comparison of Implicit vs. Explicit Regime Identification in Machine Learning Methods for Solar Irradiance Prediction," Energies, MDPI, vol. 13(3), pages 1-14, February.
    16. Yixiang Ma & Lean Yu & Guoxing Zhang, 2022. "A Hybrid Short-Term Load Forecasting Model Based on a Multi-Trait-Driven Methodology and Secondary Decomposition," Energies, MDPI, vol. 15(16), pages 1-20, August.
    17. Che, Jinxing & Yuan, Fang & Zhu, Suling & Yang, Youlong, 2022. "An adaptive ensemble framework with representative subset based weight correction for short-term forecast of peak power load," Applied Energy, Elsevier, vol. 328(C).
    18. Li, Min & Yang, Yi & He, Zhaoshuang & Guo, Xinbo & Zhang, Ruisheng & Huang, Bingqing, 2023. "A wind speed forecasting model based on multi-objective algorithm and interpretability learning," Energy, Elsevier, vol. 269(C).
    19. Trigo-González, Mauricio & Batlles, F.J. & Alonso-Montesinos, Joaquín & Ferrada, Pablo & del Sagrado, J. & Martínez-Durbán, M. & Cortés, Marcelo & Portillo, Carlos & Marzo, Aitor, 2019. "Hourly PV production estimation by means of an exportable multiple linear regression model," Renewable Energy, Elsevier, vol. 135(C), pages 303-312.
    20. Ayub, Yousaf & Ren, Jingzheng & Shi, Tao & Shen, Weifeng & He, Chang, 2023. "Poultry litter valorization: Development and optimization of an electro-chemical and thermal tri-generation process using an extreme gradient boosting algorithm," Energy, Elsevier, vol. 263(PC).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:324:y:2022:i:c:s0306261922010388. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.