IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v246y2022ics0360544222002535.html
   My bibliography  Save this article

District heater load forecasting based on machine learning and parallel CNN-LSTM attention

Author

Listed:
  • Chung, Won Hee
  • Gu, Yeong Hyeon
  • Yoo, Seong Joon

Abstract

Accurate heat load forecast is important to operate combined heat and power (CHP) efficiently. This paper proposes a parallel convolutional neural network (CNN) - long short-term memory (LSTM) attention (PCLA) model that extracts spatiotemporal characteristics and then intensively learns importance. PCLA learns by derived spatial and temporal features parallelly from CNNs and LSTMs. The novelty of this paper lies in the following three aspects: 1) a PCLA model for heat load forecasting is proposed; 2) it is demonstrated that the performance is superior to 12 models including the serial coupled model; 3) the model using CNNs and LSTMs is better than the one using principal component analysis. The dataset includes district heater related variables, heat load-derived variables, weather forecasts and time factors that affect heat loads. The forecasting accuracy of the PCLA is reflected by the lowest values of the mean absolute and mean squared errors of 0.571 and 0.662, respectively, and the highest R-squared value of 0.942. The performance of the PCLA is therefore better than the previously proposed heat load and demand forecasting models and is expected to be useful for CHP plant management.

Suggested Citation

  • Chung, Won Hee & Gu, Yeong Hyeon & Yoo, Seong Joon, 2022. "District heater load forecasting based on machine learning and parallel CNN-LSTM attention," Energy, Elsevier, vol. 246(C).
    • Handle: RePEc:eee:energy:v:246:y:2022:i:c:s0360544222002535
    DOI: 10.1016/j.energy.2022.123350
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544222002535
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2022.123350?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    2. Hahn, Heiko & Meyer-Nieberg, Silja & Pickl, Stefan, 2009. "Electric load forecasting methods: Tools for decision making," European Journal of Operational Research, Elsevier, vol. 199(3), pages 902-907, December.
    3. Ren, Fang-rong & Tian, Ze & Liu, Jingjing & Shen, Yu-ting, 2020. "Analysis of CO2 emission reduction contribution and efficiency of China’s solar photovoltaic industry: Based on Input-output perspective," Energy, Elsevier, vol. 199(C).
    4. Wang, Zhe & Hong, Tianzhen & Piette, Mary Ann, 2020. "Building thermal load prediction through shallow machine learning and deep learning," Applied Energy, Elsevier, vol. 263(C).
    5. Xue, Puning & Jiang, Yi & Zhou, Zhigang & Chen, Xin & Fang, Xiumu & Liu, Jing, 2019. "Multi-step ahead forecasting of heat load in district heating systems using machine learning algorithms," Energy, Elsevier, vol. 188(C).
    6. Wei, Ziqing & Zhang, Tingwei & Yue, Bao & Ding, Yunxiao & Xiao, Ran & Wang, Ruzhu & Zhai, Xiaoqiang, 2021. "Prediction of residential district heating load based on machine learning: A case study," Energy, Elsevier, vol. 231(C).
    7. Sarwar, Riasat & Cho, Heejin & Cox, Sam J. & Mago, Pedro J. & Luck, Rogelio, 2017. "Field validation study of a time and temperature indexed autoregressive with exogenous (ARX) model for building thermal load prediction," Energy, Elsevier, vol. 119(C), pages 483-496.
    8. Vogler–Finck, P.J.C. & Bacher, P. & Madsen, H., 2017. "Online short-term forecast of greenhouse heat load using a weather forecast service," Applied Energy, Elsevier, vol. 205(C), pages 1298-1310.
    9. Juyong Lee & Youngsang Cho, 2021. "National-scale electricity peak load forecasting: Traditional, machine learning, or hybrid model?," Papers 2107.06174, arXiv.org.
    10. Sun, Lei & Liu, Tianyuan & Xie, Yonghui & Zhang, Di & Xia, Xinlei, 2021. "Real-time power prediction approach for turbine using deep learning techniques," Energy, Elsevier, vol. 233(C).
    11. Suryanarayana, Gowri & Lago, Jesus & Geysen, Davy & Aleksiejuk, Piotr & Johansson, Christian, 2018. "Thermal load forecasting in district heating networks using deep learning and advanced feature selection methods," Energy, Elsevier, vol. 157(C), pages 141-149.
    12. Xue, Guixiang & Qi, Chengying & Li, Han & Kong, Xiangfei & Song, Jiancai, 2020. "Heating load prediction based on attention long short term memory: A case study of Xingtai," Energy, Elsevier, vol. 203(C).
    13. Dahl, Magnus & Brun, Adam & Andresen, Gorm B., 2017. "Using ensemble weather predictions in district heating operation and load forecasting," Applied Energy, Elsevier, vol. 193(C), pages 455-465.
    14. Kurek, Teresa & Bielecki, Artur & Świrski, Konrad & Wojdan, Konrad & Guzek, Michał & Białek, Jakub & Brzozowski, Rafał & Serafin, Rafał, 2021. "Heat demand forecasting algorithm for a Warsaw district heating network," Energy, Elsevier, vol. 217(C).
    15. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    16. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Huang, Yaohui & Zhao, Yuan & Wang, Zhijin & Liu, Xiufeng & Liu, Hanjing & Fu, Yonggang, 2023. "Explainable district heat load forecasting with active deep learning," Applied Energy, Elsevier, vol. 350(C).
    2. Aygun, Hakan & Dursun, Omer Osman & Toraman, Suat, 2023. "Machine learning based approach for forecasting emission parameters of mixed flow turbofan engine at high power modes," Energy, Elsevier, vol. 271(C).
    3. Gonçalves, Rui & Ribeiro, Vitor Miguel & Pereira, Fernando Lobo, 2023. "Variable Split Convolutional Attention: A novel Deep Learning model applied to the household electric power consumption," Energy, Elsevier, vol. 274(C).
    4. Sekhar, Charan & Dahiya, Ratna, 2023. "Robust framework based on hybrid deep learning approach for short term load forecasting of building electricity demand," Energy, Elsevier, vol. 268(C).
    5. Huang, Guizao & Wu, Guangning & Yang, Zefeng & Chen, Xing & Wei, Wenfu, 2023. "Development of surrogate models for evaluating energy transfer quality of high-speed railway pantograph-catenary system using physics-based model and machine learning," Applied Energy, Elsevier, vol. 333(C).
    6. Zhang, Dongxue & Wang, Shuai & Liang, Yuqiu & Du, Zhiyuan, 2023. "A novel combined model for probabilistic load forecasting based on deep learning and improved optimizer," Energy, Elsevier, vol. 264(C).
    7. Mario Pérez-Gomariz & Antonio López-Gómez & Fernando Cerdán-Cartagena, 2023. "Artificial Neural Networks as Artificial Intelligence Technique for Energy Saving in Refrigeration Systems—A Review," Clean Technol., MDPI, vol. 5(1), pages 1-21, January.
    8. Wang, Chang & Zheng, Jianqin & Liang, Yongtu & Wang, Bohong & Klemeš, Jiří Jaromír & Zhu, Zhu & Liao, Qi, 2022. "Deeppipe: An intelligent monitoring framework for operating condition of multi-product pipelines," Energy, Elsevier, vol. 261(PB).
    9. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    10. Pengfei Wang & Yang Liu & Qinqin Sun & Yingqi Bai & Chaopeng Li, 2022. "Research on Data Cleaning Algorithm Based on Multi Type Construction Waste," Sustainability, MDPI, vol. 14(19), pages 1-16, September.
    11. Runge, Jason & Saloux, Etienne, 2023. "A comparison of prediction and forecasting artificial intelligence models to estimate the future energy demand in a district heating system," Energy, Elsevier, vol. 269(C).
    12. Chen, Minghao & Xie, Zhiyuan & Sun, Yi & Zheng, Shunlin, 2023. "The predictive management in campus heating system based on deep reinforcement learning and probabilistic heat demands forecasting," Applied Energy, Elsevier, vol. 350(C).
    13. Li, Guannan & Chen, Liang & Liu, Jiangyan & Fang, Xi, 2023. "Comparative study on deep transfer learning strategies for cross-system and cross-operation-condition building energy systems fault diagnosis," Energy, Elsevier, vol. 263(PD).
    14. Zhuang, Dian & Gan, Vincent J.L. & Duygu Tekler, Zeynep & Chong, Adrian & Tian, Shuai & Shi, Xing, 2023. "Data-driven predictive control for smart HVAC system in IoT-integrated buildings with time-series forecasting and reinforcement learning," Applied Energy, Elsevier, vol. 338(C).
    15. Dongyu Wang & Xiwen Cui & Dongxiao Niu, 2022. "Wind Power Forecasting Based on LSTM Improved by EMD-PCA-RF," Sustainability, MDPI, vol. 14(12), pages 1-23, June.
    16. Mahdi Khodayar & Jacob Regan, 2023. "Deep Neural Networks in Power Systems: A Review," Energies, MDPI, vol. 16(12), pages 1-38, June.
    17. Ling, Jihong & Zhang, Bingyang & Dai, Na & Xing, Jincheng, 2023. "Coupling input feature construction methods and machine learning algorithms for hourly secondary supply temperature prediction," Energy, Elsevier, vol. 278(C).
    18. Kostadin Yotov & Emil Hadzhikolev & Stanka Hadzhikoleva & Stoyan Cheresharov, 2022. "Neuro-Cybernetic System for Forecasting Electricity Consumption in the Bulgarian National Power System," Sustainability, MDPI, vol. 14(17), pages 1-18, September.
    19. Shakeel, Asim & Chong, Daotong & Wang, Jinshi, 2023. "Load forecasting of district heating system based on improved FB-Prophet model," Energy, Elsevier, vol. 278(C).
    20. Li, Guannan & Li, Fan & Ahmad, Tanveer & Liu, Jiangyan & Li, Tao & Fang, Xi & Wu, Yubei, 2022. "Performance evaluation of sequence-to-sequence-Attention model for short-term multi-step ahead building energy predictions," Energy, Elsevier, vol. 259(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuan, Jianjuan & Huang, Ke & Han, Zhao & Wang, Chendong & Lu, Shilei & Zhou, Zhihua, 2022. "Evaluation of the operation data for improving the prediction accuracy of heating parameters in heating substation," Energy, Elsevier, vol. 238(PB).
    2. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    3. Runge, Jason & Saloux, Etienne, 2023. "A comparison of prediction and forecasting artificial intelligence models to estimate the future energy demand in a district heating system," Energy, Elsevier, vol. 269(C).
    4. Lange, Jelto & Kaltschmitt, Martin, 2022. "Probabilistic day-ahead forecast of available thermal storage capacities in residential households," Applied Energy, Elsevier, vol. 306(PA).
    5. Gong, Mingju & Zhao, Yin & Sun, Jiawang & Han, Cuitian & Sun, Guannan & Yan, Bo, 2022. "Load forecasting of district heating system based on Informer," Energy, Elsevier, vol. 253(C).
    6. Zhang, Yunfei & Zhou, Zhihua & Liu, Junwei & Yuan, Jianjuan, 2022. "Data augmentation for improving heating load prediction of heating substation based on TimeGAN," Energy, Elsevier, vol. 260(C).
    7. Huang, Ke & Yuan, Jianjuan & Zhou, Zhihua & Zheng, Xuejing, 2022. "Analysis and evaluation of heat source data of large-scale heating system based on descriptive data mining techniques," Energy, Elsevier, vol. 251(C).
    8. Yuan, Jianjuan & Huang, Ke & Lu, Shilei & Zhang, Ji & Han, Zhao & Zhou, Zhihua, 2022. "Analysis of influencing factors on heat consumption of large residential buildings with different occupancy rates-Tianjin case study," Energy, Elsevier, vol. 238(PC).
    9. Satre-Meloy, Aven, 2019. "Investigating structural and occupant drivers of annual residential electricity consumption using regularization in regression models," Energy, Elsevier, vol. 174(C), pages 148-168.
    10. Tulin Guzel & Hakan Cinar & Mehmet Nabi Cenet & Kamil Doruk Oguz & Ahmet Yucekaya & Mustafa Hekimoglu, 2023. "A Framework to Forecast Electricity Consumption of Meters using Automated Ranking and Data Preprocessing," International Journal of Energy Economics and Policy, Econjournals, vol. 13(5), pages 179-193, September.
    11. Gao, Lei & Liu, Tianyuan & Cao, Tao & Hwang, Yunho & Radermacher, Reinhard, 2021. "Comparing deep learning models for multi energy vectors prediction on multiple types of building," Applied Energy, Elsevier, vol. 301(C).
    12. Sun, Chunhua & Liu, Yanan & Gao, Xiaoyu & Wang, Jinda & Yang, Lan & Qi, Chengyong, 2022. "Research on control strategy integrated with characteristics of user's energy-saving behavior of district heating system," Energy, Elsevier, vol. 245(C).
    13. Cui, Mianshan, 2022. "District heating load prediction algorithm based on bidirectional long short-term memory network model," Energy, Elsevier, vol. 254(PA).
    14. Chen, Minghao & Xie, Zhiyuan & Sun, Yi & Zheng, Shunlin, 2023. "The predictive management in campus heating system based on deep reinforcement learning and probabilistic heat demands forecasting," Applied Energy, Elsevier, vol. 350(C).
    15. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    16. Oxana Babecka Kucharcukova & Jan Bruha, 2016. "Nowcasting the Czech Trade Balance," Working Papers 2016/11, Czech National Bank.
    17. Carstensen, Kai & Heinrich, Markus & Reif, Magnus & Wolters, Maik H., 2020. "Predicting ordinary and severe recessions with a three-state Markov-switching dynamic factor model," International Journal of Forecasting, Elsevier, vol. 36(3), pages 829-850.
    18. Hou-Tai Chang & Ping-Huai Wang & Wei-Fang Chen & Chen-Ju Lin, 2022. "Risk Assessment of Early Lung Cancer with LDCT and Health Examinations," IJERPH, MDPI, vol. 19(8), pages 1-12, April.
    19. Margherita Giuzio, 2017. "Genetic algorithm versus classical methods in sparse index tracking," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 40(1), pages 243-256, November.
    20. Nicolaj N. Mühlbach, 2020. "Tree-based Synthetic Control Methods: Consequences of moving the US Embassy," CREATES Research Papers 2020-04, Department of Economics and Business Economics, Aarhus University.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:246:y:2022:i:c:s0360544222002535. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.