IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i13p5099-d1184903.html
   My bibliography  Save this article

A Reinforcement Learning Approach for Ensemble Machine Learning Models in Peak Electricity Forecasting

Author

Listed:
  • Warut Pannakkong

    (School of Manufacturing Systems and Mechanical Engineering, Sirindhorn International Institute of Technology, Pathum Thani 12120, Thailand)

  • Vu Thanh Vinh

    (School of Manufacturing Systems and Mechanical Engineering, Sirindhorn International Institute of Technology, Pathum Thani 12120, Thailand)

  • Nguyen Ngoc Minh Tuyen

    (School of Manufacturing Systems and Mechanical Engineering, Sirindhorn International Institute of Technology, Pathum Thani 12120, Thailand)

  • Jirachai Buddhakulsomsiri

    (School of Manufacturing Systems and Mechanical Engineering, Sirindhorn International Institute of Technology, Pathum Thani 12120, Thailand)

Abstract

Electricity peak load forecasting plays an important role in electricity generation capacity planning to ensure reliable power supplies. To achieve high forecast accuracy, multiple machine learning models have been implemented to forecast the monthly peak load in Thailand over the past few years, yielding promising results. One approach to further improve forecast accuracy is to effectively select the most accurate forecast value for each period from among the forecast values generated by these models. This article presents a novel reinforcement learning approach using the double deep Q-network (Double DQN), which acts as a model selector from a pool of available models. The monthly electricity peak load data of Thailand from 2004 to 2017 are used to demonstrate the effectiveness of the proposed method. A hyperparameter tuning methodology using a fractional factorial design is implemented to significantly reduce the number of required experimental runs. The results indicate that the proposed selection model using Double DQN outperforms all tested individual machine learning models in terms of mean square error.

Suggested Citation

  • Warut Pannakkong & Vu Thanh Vinh & Nguyen Ngoc Minh Tuyen & Jirachai Buddhakulsomsiri, 2023. "A Reinforcement Learning Approach for Ensemble Machine Learning Models in Peak Electricity Forecasting," Energies, MDPI, vol. 16(13), pages 1-20, July.
  • Handle: RePEc:gam:jeners:v:16:y:2023:i:13:p:5099-:d:1184903
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/13/5099/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/16/13/5099/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fumo, Nelson & Rafe Biswas, M.A., 2015. "Regression analysis for prediction of residential energy consumption," Renewable and Sustainable Energy Reviews, Elsevier, vol. 47(C), pages 332-343.
    2. Perera, A.T.D. & Wickramasinghe, P.U. & Nik, Vahid M. & Scartezzini, Jean-Louis, 2020. "Introducing reinforcement learning to the energy system design process," Applied Energy, Elsevier, vol. 262(C).
    3. Saxena, Harshit & Aponte, Omar & McConky, Katie T., 2019. "A hybrid machine learning model for forecasting a billing period’s peak electric load days," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1288-1303.
    4. Liu, Hui & Yu, Chengqing & Wu, Haiping & Duan, Zhu & Yan, Guangxi, 2020. "A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting," Energy, Elsevier, vol. 202(C).
    5. Rallapalli, Srinivasa Rao & Ghosh, Sajal, 2012. "Forecasting monthly peak demand of electricity in India—A critique," Energy Policy, Elsevier, vol. 45(C), pages 516-520.
    6. Sheffrin, Anjali & Yoshimura, Henry & LaPlante, David & Neenan, Bernard, 2008. "Harnessing the Power of Demand," The Electricity Journal, Elsevier, vol. 21(2), pages 39-50, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shao, Zhen & Chao, Fu & Yang, Shan-Lin & Zhou, Kai-Le, 2017. "A review of the decomposition methodology for extracting and identifying the fluctuation characteristics in electricity demand forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 75(C), pages 123-136.
    2. Wang, Zhengchao & Perera, A.T.D., 2020. "Integrated platform to design robust energy internet," Applied Energy, Elsevier, vol. 269(C).
    3. Mardones, Cristian, 2021. "Ex-post evaluation and cost-benefit analysis of a heater replacement program implemented in southern Chile," Energy, Elsevier, vol. 227(C).
    4. Liang, Tao & Zhao, Qing & Lv, Qingzhao & Sun, Hexu, 2021. "A novel wind speed prediction strategy based on Bi-LSTM, MOOFADA and transfer learning for centralized control centers," Energy, Elsevier, vol. 230(C).
    5. Anna Kipping & Erik Trømborg, 2017. "Modeling Aggregate Hourly Energy Consumption in a Regional Building Stock," Energies, MDPI, vol. 11(1), pages 1-20, December.
    6. Bingjie Jin & Guihua Zeng & Zhilin Lu & Hongqiao Peng & Shuxin Luo & Xinhe Yang & Haojun Zhu & Mingbo Liu, 2022. "Hybrid LSTM–BPNN-to-BPNN Model Considering Multi-Source Information for Forecasting Medium- and Long-Term Electricity Peak Load," Energies, MDPI, vol. 15(20), pages 1-20, October.
    7. Acikgoz, Hakan & Budak, Umit & Korkmaz, Deniz & Yildiz, Ceyhun, 2021. "WSFNet: An efficient wind speed forecasting model using channel attention-based densely connected convolutional neural network," Energy, Elsevier, vol. 233(C).
    8. Gholami, M. & Barbaresi, A. & Torreggiani, D. & Tassinari, P., 2020. "Upscaling of spatial energy planning, phases, methods, and techniques: A systematic review through meta-analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 132(C).
    9. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    10. Rafael de Arce & Ramón Mahía, 2019. "Drivers of Electricity Poverty in Spanish Dwellings: A Quantile Regression Approach," Energies, MDPI, vol. 12(11), pages 1-18, May.
    11. Chou, Jui-Sheng & Tran, Duc-Son, 2018. "Forecasting energy consumption time series using machine learning techniques based on usage patterns of residential householders," Energy, Elsevier, vol. 165(PB), pages 709-726.
    12. Qu, Zhijian & Xu, Juan & Wang, Zixiao & Chi, Rui & Liu, Hanxin, 2021. "Prediction of electricity generation from a combined cycle power plant based on a stacking ensemble and its hyperparameter optimization with a grid-search method," Energy, Elsevier, vol. 227(C).
    13. Zeng, Sheng & Su, Bin & Zhang, Minglong & Gao, Yuan & Liu, Jun & Luo, Song & Tao, Qingmei, 2021. "Analysis and forecast of China's energy consumption structure," Energy Policy, Elsevier, vol. 159(C).
    14. Mastrucci, Alessio & Marvuglia, Antonino & Leopold, Ulrich & Benetto, Enrico, 2017. "Life Cycle Assessment of building stocks from urban to transnational scales: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 74(C), pages 316-332.
    15. Sareen, Karan & Panigrahi, Bijaya Ketan & Shikhola, Tushar & Sharma, Rajneesh, 2023. "An imputation and decomposition algorithms based integrated approach with bidirectional LSTM neural network for wind speed prediction," Energy, Elsevier, vol. 278(C).
    16. Chabouni, Naima & Belarbi, Yacine & Benhassine, Wassim, 2020. "Electricity load dynamics, temperature and seasonality Nexus in Algeria," Energy, Elsevier, vol. 200(C).
    17. Sánchez, Gustavo Crespo & Monteagudo Yanes, José Pedro & Pérez, Milagros Montesino & Cabrera Sánchez, Jorge Luis & Padrón, Arturo Padrón & Haeseldonckx, Dries, 2020. "Efficiency in electromechanical drive motors and energy performance indicators for implementing a management system in balanced animal feed manufacturing," Energy, Elsevier, vol. 194(C).
    18. Li, Gang & Du, Yuqing, 2018. "Performance investigation and economic benefits of new control strategies for heat pump-gas fired water heater hybrid system," Applied Energy, Elsevier, vol. 232(C), pages 101-118.
    19. Ahmad, Tanveer & Chen, Huanxin & Huang, Ronggeng & Yabin, Guo & Wang, Jiangyu & Shair, Jan & Azeem Akram, Hafiz Muhammad & Hassnain Mohsan, Syed Agha & Kazim, Muhammad, 2018. "Supervised based machine learning models for short, medium and long-term energy prediction in distinct building environment," Energy, Elsevier, vol. 158(C), pages 17-32.
    20. Christoph Sejkora & Lisa Kühberger & Fabian Radner & Alexander Trattner & Thomas Kienberger, 2020. "Exergy as Criteria for Efficient Energy Systems—A Spatially Resolved Comparison of the Current Exergy Consumption, the Current Useful Exergy Demand and Renewable Exergy Potential," Energies, MDPI, vol. 13(4), pages 1-51, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:13:p:5099-:d:1184903. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.