IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v231y2021ics0360544221011592.html
   My bibliography  Save this article

Methodological framework for short-and medium-term energy, solar and wind power forecasting with stochastic-based machine learning approach to monetary and energy policy applications

Author

Listed:
  • Ahmad, Tanveer
  • Zhang, Dongdong
  • Huang, Chao

Abstract

Anomalous seasons such as low-wind summers and extremely cold winters can seriously disrupt energy reliability and productivity. Better short/medium-term forecasts that provide reliable and strategic planning insights will allow the energy industry to plan for these extremes. In order to efficiently quantify uncertainty, this study proposes a Gaussian stochastic-based machine learning process model (GPR) for short/medium-term energy, solar, and wind (ESW) power forecasts using two different temporal resolutions of data. Four experimental steps (EXMS) were designed. Each EXMS is designed with four distinct fitting and predicting methods, and the GPR model uses seven kernel covariance functions for hyperparameter optimization. Real-time data is used for the forecasting analysis at three different locations. The forecasting results are validated using three existing models. The percent coefficient of variation of CVGPR1 and CVGPR2 of EXMS-1 and EXMS-3 for ESW power forecasts is 0.017%, 0.057%, 0.025%, and 0.223%, 0.225%, 0.170%, respectively. Accuracy has shown that the proposed model can predict ESW power simultaneously at two different temporal resolution data. The GPR accuracy with four EXMS methodologies is promising by addressing ESW power forecasts under the GPR framework of significant utilities, independent power producers, and public interest.

Suggested Citation

  • Ahmad, Tanveer & Zhang, Dongdong & Huang, Chao, 2021. "Methodological framework for short-and medium-term energy, solar and wind power forecasting with stochastic-based machine learning approach to monetary and energy policy applications," Energy, Elsevier, vol. 231(C).
  • Handle: RePEc:eee:energy:v:231:y:2021:i:c:s0360544221011592
    DOI: 10.1016/j.energy.2021.120911
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221011592
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2021.120911?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhou, Yuekuan & Zheng, Siqian & Zhang, Guoqiang, 2020. "Machine learning-based optimal design of a phase change material integrated renewable system with on-site PV, radiative cooling and hybrid ventilations—study of modelling and application in five clima," Energy, Elsevier, vol. 192(C).
    2. Zafar, Muhammad Wasif & Shahbaz, Muhammad & Sinha, Avik & Sengupta, Tuhin & Qin, Quande, 2020. "How Renewable Energy Consumption Contribute to Environmental Quality? The Role of Education in OECD Countries," MPRA Paper 100259, University Library of Munich, Germany, revised 08 May 2020.
    3. Liu, Hui & Chen, Chao, 2019. "Data processing strategies in wind energy forecasting models and applications: A comprehensive review," Applied Energy, Elsevier, vol. 249(C), pages 392-408.
    4. Mertzanis, Charilaos, 2018. "Institutions, development and energy constraints," Energy, Elsevier, vol. 142(C), pages 962-982.
    5. Ahmad, Tanveer & Chen, Huanxin & Huang, Ronggeng & Yabin, Guo & Wang, Jiangyu & Shair, Jan & Azeem Akram, Hafiz Muhammad & Hassnain Mohsan, Syed Agha & Kazim, Muhammad, 2018. "Supervised based machine learning models for short, medium and long-term energy prediction in distinct building environment," Energy, Elsevier, vol. 158(C), pages 17-32.
    6. Prado, Francisco & Minutolo, Marcel C. & Kristjanpoller, Werner, 2020. "Forecasting based on an ensemble Autoregressive Moving Average - Adaptive neuro - Fuzzy inference system – Neural network - Genetic Algorithm Framework," Energy, Elsevier, vol. 197(C).
    7. Alizamir, Meysam & Kim, Sungwon & Kisi, Ozgur & Zounemat-Kermani, Mohammad, 2020. "A comparative study of several machine learning based non-linear regression methods in estimating solar radiation: Case studies of the USA and Turkey regions," Energy, Elsevier, vol. 197(C).
    8. Luo, Xing & Zhang, Dongxiao & Zhu, Xu, 2021. "Deep learning based forecasting of photovoltaic power generation by incorporating domain knowledge," Energy, Elsevier, vol. 225(C).
    9. Kakran, Sandeep & Chanana, Saurabh, 2018. "Smart operations of smart grids integrated with distributed generation: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 524-535.
    10. Dai, Yeming & Zhao, Pei, 2020. "A hybrid load forecasting model based on support vector machine with intelligent methods for feature selection and parameter optimization," Applied Energy, Elsevier, vol. 279(C).
    11. Massaoudi, Mohamed & Refaat, Shady S. & Chihi, Ines & Trabelsi, Mohamed & Oueslati, Fakhreddine S. & Abu-Rub, Haitham, 2021. "A novel stacked generalization ensemble-based hybrid LGBM-XGB-MLP model for Short-Term Load Forecasting," Energy, Elsevier, vol. 214(C).
    12. Debnath, Kumar Biswajit & Mourshed, Monjur, 2018. "Forecasting methods in energy planning models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 88(C), pages 297-325.
    13. Moreira, M.O. & Balestrassi, P.P. & Paiva, A.P. & Ribeiro, P.F. & Bonatto, B.D., 2021. "Design of experiments using artificial neural network ensemble for photovoltaic generation forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    14. Boland, John & David, Mathieu & Lauret, Philippe, 2016. "Short term solar radiation forecasting: Island versus continental sites," Energy, Elsevier, vol. 113(C), pages 186-192.
    15. Das, Saborni & Basu, Mousumi, 2020. "Day-ahead optimal bidding strategy of microgrid with demand response program considering uncertainties and outages of renewable energy resources," Energy, Elsevier, vol. 190(C).
    16. Kaytez, Fazil, 2020. "A hybrid approach based on autoregressive integrated moving average and least-square support vector machine for long-term forecasting of net electricity consumption," Energy, Elsevier, vol. 197(C).
    17. Evan D. Sherwin & Max Henrion & Inês M. L. Azevedo, 2018. "Estimation of the year-on-year volatility and the unpredictability of the United States energy system," Nature Energy, Nature, vol. 3(4), pages 341-346, April.
    18. Lebotsa, Moshoko Emily & Sigauke, Caston & Bere, Alphonce & Fildes, Robert & Boylan, John E., 2018. "Short term electricity demand forecasting using partially linear additive quantile regression with an application to the unit commitment problem," Applied Energy, Elsevier, vol. 222(C), pages 104-118.
    19. Ahmad, Tanveer & Chen, Huanxin, 2018. "Potential of three variant machine-learning models for forecasting district level medium-term and long-term energy demand in smart grid environment," Energy, Elsevier, vol. 160(C), pages 1008-1020.
    20. Chahkoutahi, Fatemeh & Khashei, Mehdi, 2017. "A seasonal direct optimal hybrid model of computational intelligence and soft computing techniques for electricity load forecasting," Energy, Elsevier, vol. 140(P1), pages 988-1004.
    21. Chen, S.X. & Gooi, H.B. & Wang, M.Q., 2013. "Solar radiation forecast based on fuzzy logic and neural networks," Renewable Energy, Elsevier, vol. 60(C), pages 195-201.
    22. Zhao, Wei & Zhang, Haoran & Zheng, Jianqin & Dai, Yuanhao & Huang, Liqiao & Shang, Wenlong & Liang, Yongtu, 2021. "A point prediction method based automatic machine learning for day-ahead power output of multi-region photovoltaic plants," Energy, Elsevier, vol. 223(C).
    23. Sharma, Amandeep & Kakkar, Ajay, 2018. "Forecasting daily global solar irradiance generation using machine learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 82(P3), pages 2254-2269.
    24. Vaibhav Chaturvedi, 2016. "Energy security and climate change: Friends with asymmetric benefits," Nature Energy, Nature, vol. 1(6), pages 1-2, June.
    25. Howell, Shaun & Rezgui, Yacine & Hippolyte, Jean-Laurent & Jayan, Bejay & Li, Haijiang, 2017. "Towards the next generation of smart grids: Semantic and holonic multi-agent management of distributed energy resources," Renewable and Sustainable Energy Reviews, Elsevier, vol. 77(C), pages 193-214.
    26. Ahmad, Tanveer & Zhang, Hongcai, 2020. "Novel deep supervised ML models with feature selection approach for large-scale utilities and buildings short and medium-term load requirement forecasts," Energy, Elsevier, vol. 209(C).
    27. Fathi, Soheil & Srinivasan, Ravi & Fenner, Andriel & Fathi, Sahand, 2020. "Machine learning applications in urban building energy performance forecasting: A systematic review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 133(C).
    28. Kong, Weicong & Jia, Youwei & Dong, Zhao Yang & Meng, Ke & Chai, Songjian, 2020. "Hybrid approaches based on deep whole-sky-image learning to photovoltaic generation forecasting," Applied Energy, Elsevier, vol. 280(C).
    29. Vatanpour, Mohsen & Sadeghi Yazdankhah, Ahmad, 2018. "The impact of energy storage modeling in coordination with wind farm and thermal units on security and reliability in a stochastic unit commitment," Energy, Elsevier, vol. 162(C), pages 476-490.
    30. Trapero, Juan R. & Kourentzes, Nikolaos & Martin, A., 2015. "Short-term solar irradiation forecasting based on Dynamic Harmonic Regression," Energy, Elsevier, vol. 84(C), pages 289-295.
    31. Herrera, Gabriel Paes & Constantino, Michel & Tabak, Benjamin Miranda & Pistori, Hemerson & Su, Jen-Je & Naranpanawa, Athula, 2019. "Long-term forecast of energy commodities price using machine learning," Energy, Elsevier, vol. 179(C), pages 214-221.
    32. Fouilloy, Alexis & Voyant, Cyril & Notton, Gilles & Motte, Fabrice & Paoli, Christophe & Nivet, Marie-Laure & Guillot, Emmanuel & Duchaud, Jean-Laurent, 2018. "Solar irradiation prediction with machine learning: Forecasting models selection method depending on weather variability," Energy, Elsevier, vol. 165(PA), pages 620-629.
    33. Zhang, Liang & Wen, Jin & Li, Yanfei & Chen, Jianli & Ye, Yunyang & Fu, Yangyang & Livingood, William, 2021. "A review of machine learning in building load prediction," Applied Energy, Elsevier, vol. 285(C).
    34. Song, Wanqing & Cattani, Carlo & Chi, Chi-Hung, 2020. "Multifractional Brownian motion and quantum-behaved particle swarm optimization for short term power load forecasting: An integrated approach," Energy, Elsevier, vol. 194(C).
    35. Sharadga, Hussein & Hajimirza, Shima & Balog, Robert S., 2020. "Time series forecasting of solar power generation for large-scale photovoltaic plants," Renewable Energy, Elsevier, vol. 150(C), pages 797-807.
    36. Ahmad, Tanveer & Huanxin, Chen & Zhang, Dongdong & Zhang, Hongcai, 2020. "Smart energy forecasting strategy with four machine learning models for climate-sensitive and non-climate sensitive conditions," Energy, Elsevier, vol. 198(C).
    37. Wang, Jianzhou & Hu, Jianming, 2015. "A robust combination approach for short-term wind speed forecasting and analysis – Combination of the ARIMA (Autoregressive Integrated Moving Average), ELM (Extreme Learning Machine), SVM (Support Vec," Energy, Elsevier, vol. 93(P1), pages 41-56.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sabarathinam Srinivasan & Suresh Kumarasamy & Zacharias E. Andreadakis & Pedro G. Lind, 2023. "Artificial Intelligence and Mathematical Models of Power Grids Driven by Renewable Energy Sources: A Survey," Energies, MDPI, vol. 16(14), pages 1-56, July.
    2. Shafiekhani, Morteza & Ahmadi, Abdollah & Homaee, Omid & Shafie-khah, Miadreza & Catalão, João P.S., 2022. "Optimal bidding strategy of a renewable-based virtual power plant including wind and solar units and dispatchable loads," Energy, Elsevier, vol. 239(PD).
    3. Ana Lagos & Joaquín E. Caicedo & Gustavo Coria & Andrés Romero Quete & Maximiliano Martínez & Gastón Suvire & Jesús Riquelme, 2022. "State-of-the-Art Using Bibliometric Analysis of Wind-Speed and -Power Forecasting Methods Applied in Power Systems," Energies, MDPI, vol. 15(18), pages 1-40, September.
    4. Mahmoud, Montaser & Alkhedher, Mohammad & Ramadan, Mohamad & Naher, Sumsun & Pullen, Keith, 2022. "An investigation on organic Rankine cycle incorporating a ground-cooled condenser: Working fluid selection and regeneration," Energy, Elsevier, vol. 249(C).
    5. Li, Yunzhu & Liu, Tianyuan & Wang, Yuqi & Xie, Yonghui, 2022. "Deep learning based real-time energy extraction system modeling for flapping foil," Energy, Elsevier, vol. 246(C).
    6. Xiaoxun, Zhu & Zixu, Xu & Yu, Wang & Xiaoxia, Gao & Xinyu, Hang & Hongkun, Lu & Ruizhang, Liu & Yao, Chen & Huaxin, Liu, 2023. "Research on wind speed behavior prediction method based on multi-feature and multi-scale integrated learning," Energy, Elsevier, vol. 263(PA).
    7. Liu, Jia & Zhou, Yuekuan & Yang, Hongxing & Wu, Huijun, 2022. "Uncertainty energy planning of net-zero energy communities with peer-to-peer energy trading and green vehicle storage considering climate changes by 2050 with machine learning methods," Applied Energy, Elsevier, vol. 321(C).
    8. Moradzadeh, Arash & Moayyed, Hamed & Mohammadi-Ivatloo, Behnam & Vale, Zita & Ramos, Carlos & Ghorbani, Reza, 2023. "A novel cyber-Resilient solar power forecasting model based on secure federated deep learning and data visualization," Renewable Energy, Elsevier, vol. 211(C), pages 697-705.
    9. Adam Krechowicz & Maria Krechowicz & Katarzyna Poczeta, 2022. "Machine Learning Approaches to Predict Electricity Production from Renewable Energy Sources," Energies, MDPI, vol. 15(23), pages 1-41, December.
    10. Ahmad, Tanveer & Zhang, Dongdong, 2022. "A data-driven deep sequence-to-sequence long-short memory method along with a gated recurrent neural network for wind power forecasting," Energy, Elsevier, vol. 239(PB).
    11. Ma, Huixin & Zhang, Chu & Peng, Tian & Nazir, Muhammad Shahzad & Li, Yiman, 2022. "An integrated framework of gated recurrent unit based on improved sine cosine algorithm for photovoltaic power forecasting," Energy, Elsevier, vol. 256(C).
    12. Yifei Chen & Zhihan Fu, 2023. "Multi-Step Ahead Forecasting of the Energy Consumed by the Residential and Commercial Sectors in the United States Based on a Hybrid CNN-BiLSTM Model," Sustainability, MDPI, vol. 15(3), pages 1-21, January.
    13. Abou Houran, Mohamad & Salman Bukhari, Syed M. & Zafar, Muhammad Hamza & Mansoor, Majad & Chen, Wenjie, 2023. "COA-CNN-LSTM: Coati optimization algorithm-based hybrid deep learning model for PV/wind power forecasting in smart grid applications," Applied Energy, Elsevier, vol. 349(C).
    14. Polasek, Tomas & Čadík, Martin, 2023. "Predicting photovoltaic power production using high-uncertainty weather forecasts," Applied Energy, Elsevier, vol. 339(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mohammad Mahdi Forootan & Iman Larki & Rahim Zahedi & Abolfazl Ahmadi, 2022. "Machine Learning and Deep Learning in Energy Systems: A Review," Sustainability, MDPI, vol. 14(8), pages 1-49, April.
    2. Cheng, Lilin & Zang, Haixiang & Wei, Zhinong & Zhang, Fengchun & Sun, Guoqiang, 2022. "Evaluation of opaque deep-learning solar power forecast models towards power-grid applications," Renewable Energy, Elsevier, vol. 198(C), pages 960-972.
    3. Ahmad, Tanveer & Zhang, Hongcai, 2020. "Novel deep supervised ML models with feature selection approach for large-scale utilities and buildings short and medium-term load requirement forecasts," Energy, Elsevier, vol. 209(C).
    4. Ahmad, Tanveer & Madonski, Rafal & Zhang, Dongdong & Huang, Chao & Mujeeb, Asad, 2022. "Data-driven probabilistic machine learning in sustainable smart energy/smart energy systems: Key developments, challenges, and future research opportunities in the context of smart grid paradigm," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    5. Qu, Zhijian & Xu, Juan & Wang, Zixiao & Chi, Rui & Liu, Hanxin, 2021. "Prediction of electricity generation from a combined cycle power plant based on a stacking ensemble and its hyperparameter optimization with a grid-search method," Energy, Elsevier, vol. 227(C).
    6. Rodríguez, Fermín & Martín, Fernando & Fontán, Luis & Galarza, Ainhoa, 2021. "Ensemble of machine learning and spatiotemporal parameters to forecast very short-term solar irradiation to compute photovoltaic generators’ output power," Energy, Elsevier, vol. 229(C).
    7. Haizhou Fang & Hongwei Tan & Ningfang Dai & Zhaohui Liu & Risto Kosonen, 2023. "Hourly Building Energy Consumption Prediction Using a Training Sample Selection Method Based on Key Feature Search," Sustainability, MDPI, vol. 15(9), pages 1-23, May.
    8. Venkatraj, V. & Dixit, M.K., 2022. "Challenges in implementing data-driven approaches for building life cycle energy assessment: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    9. Karol Bot & Samira Santos & Inoussa Laouali & Antonio Ruano & Maria da Graça Ruano, 2021. "Design of Ensemble Forecasting Models for Home Energy Management Systems," Energies, MDPI, vol. 14(22), pages 1-37, November.
    10. Alabi, Tobi Michael & Aghimien, Emmanuel I. & Agbajor, Favour D. & Yang, Zaiyue & Lu, Lin & Adeoye, Adebusola R. & Gopaluni, Bhushan, 2022. "A review on the integrated optimization techniques and machine learning approaches for modeling, prediction, and decision making on integrated energy systems," Renewable Energy, Elsevier, vol. 194(C), pages 822-849.
    11. Paul Anton Verwiebe & Stephan Seim & Simon Burges & Lennart Schulz & Joachim Müller-Kirchenbauer, 2021. "Modeling Energy Demand—A Systematic Literature Review," Energies, MDPI, vol. 14(23), pages 1-58, November.
    12. Ping-Huan Kuo & Chiou-Jye Huang, 2018. "A Green Energy Application in Energy Management Systems by an Artificial Intelligence-Based Solar Radiation Forecasting Model," Energies, MDPI, vol. 11(4), pages 1-15, April.
    13. Zheng, Lingwei & Su, Ran & Sun, Xinyu & Guo, Siqi, 2023. "Historical PV-output characteristic extraction based weather-type classification strategy and its forecasting method for the day-ahead prediction of PV output," Energy, Elsevier, vol. 271(C).
    14. Lee, Yoonjae & Ha, Byeongmin & Hwangbo, Soonho, 2022. "Generative model-based hybrid forecasting model for renewable electricity supply using long short-term memory networks: A case study of South Korea's energy transition policy," Renewable Energy, Elsevier, vol. 200(C), pages 69-87.
    15. Larisa Vazhenina & Elena Magaril & Igor Mayburov, 2022. "Resource Conservation as the Main Factor in Increasing the Resource Efficiency of Russian Gas Companies," Resources, MDPI, vol. 11(12), pages 1-14, December.
    16. Ahmad, Tanveer & Chen, Huanxin, 2019. "Deep learning for multi-scale smart energy forecasting," Energy, Elsevier, vol. 175(C), pages 98-112.
    17. Faheem Jan & Ismail Shah & Sajid Ali, 2022. "Short-Term Electricity Prices Forecasting Using Functional Time Series Analysis," Energies, MDPI, vol. 15(9), pages 1-15, May.
    18. Hongchao Zhang & Tengteng Zhu, 2022. "Stacking Model for Photovoltaic-Power-Generation Prediction," Sustainability, MDPI, vol. 14(9), pages 1-16, May.
    19. Yu, Min & Niu, Dongxiao & Wang, Keke & Du, Ruoyun & Yu, Xiaoyu & Sun, Lijie & Wang, Feiran, 2023. "Short-term photovoltaic power point-interval forecasting based on double-layer decomposition and WOA-BiLSTM-Attention and considering weather classification," Energy, Elsevier, vol. 275(C).
    20. Pedregal, Diego J. & Trapero, Juan R., 2021. "Adjusted combination of moving averages: A forecasting system for medium-term solar irradiance," Applied Energy, Elsevier, vol. 298(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:231:y:2021:i:c:s0360544221011592. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.