IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v177y2019icp530-542.html
   My bibliography  Save this article

Toward efficient energy systems based on natural gas consumption prediction with LSTM Recurrent Neural Networks

Author

Listed:
  • Laib, Oussama
  • Khadir, Mohamed Tarek
  • Mihaylova, Lyudmila

Abstract

Finding suitable forecasting methods for an effective management of energy resources is of paramount importance for improving the efficiency in energy consumption and decreasing its impact on the environment. Natural gas is one of the main sources of electrical energy in Algeria and worldwide. To address this demand, this paper introduces a novel hybrid forecasting approach that resolves the two-stage method's deficiency, by designing a Multi Layered Perceptron (MLP) neural network as a nonlinear forecasting monitor. This model estimates the next day gas consumption profile and selects one of several local models to perform the forecast. The study focuses firstly on an analysis and clustering of natural gas daily consumption profiles, and secondly on building a comprehensive Long Short Term Memory (LSTM) recurrent models according to load behavior. The results are compared with four benchmark approaches: the MLP neural network approach, LSTM, seasonal time series with exogenous variables models and multiple linear regression models. Compared with these alternative approaches and their high dependence on historical loads, the proposed approach presents a new efficient functionality. It estimates the next day consumption profile, which leads to a significant improvement of the forecasting accuracy, especially for days with exceptional customers consumption behavior change.

Suggested Citation

  • Laib, Oussama & Khadir, Mohamed Tarek & Mihaylova, Lyudmila, 2019. "Toward efficient energy systems based on natural gas consumption prediction with LSTM Recurrent Neural Networks," Energy, Elsevier, vol. 177(C), pages 530-542.
    • Handle: RePEc:eee:energy:v:177:y:2019:i:c:p:530-542
    DOI: 10.1016/j.energy.2019.04.075
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544219307054
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2019.04.075?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Elamin, Niematallah & Fukushige, Mototsugu, 2018. "Modeling and forecasting hourly electricity demand by SARIMAX with interactions," Energy, Elsevier, vol. 165(PB), pages 257-268.
    2. Yu, Feng & Xu, Xiaozhong, 2014. "A short-term load forecasting model of natural gas based on optimized genetic algorithm and improved BP neural network," Applied Energy, Elsevier, vol. 134(C), pages 102-113.
    3. Deb, Chirag & Zhang, Fan & Yang, Junjing & Lee, Siew Eang & Shah, Kwok Wei, 2017. "A review on time series forecasting techniques for building energy consumption," Renewable and Sustainable Energy Reviews, Elsevier, vol. 74(C), pages 902-924.
    4. Szoplik, Jolanta, 2015. "Forecasting of natural gas consumption with artificial neural networks," Energy, Elsevier, vol. 85(C), pages 208-220.
    5. Potočnik, Primož & Soldo, Božidar & Šimunović, Goran & Šarić, Tomislav & Jeromen, Andrej & Govekar, Edvard, 2014. "Comparison of static and adaptive models for short-term residential natural gas forecasting in Croatia," Applied Energy, Elsevier, vol. 129(C), pages 94-103.
    6. Xiao, Jin & Li, Yuxi & Xie, Ling & Liu, Dunhu & Huang, Jing, 2018. "A hybrid model based on selective ensemble for energy consumption forecasting in China," Energy, Elsevier, vol. 159(C), pages 534-546.
    7. Luis Hernández & Carlos Baladrón & Javier M. Aguiar & Lorena Calavia & Belén Carro & Antonio Sánchez-Esguevillas & Javier Sanjuán & Álvaro González & Jaime Lloret, 2013. "Improved Short-Term Load Forecasting Based on Two-Stage Predictions with Artificial Neural Networks in a Microgrid Environment," Energies, MDPI, vol. 6(9), pages 1-19, August.
    8. Zhang, Jinliang & Wei, Yi-Ming & Li, Dezhi & Tan, Zhongfu & Zhou, Jianhua, 2018. "Short term electricity load forecasting using a hybrid model," Energy, Elsevier, vol. 158(C), pages 774-781.
    9. Lusis, Peter & Khalilpour, Kaveh Rajab & Andrew, Lachlan & Liebman, Ariel, 2017. "Short-term residential load forecasting: Impact of calendar effects and forecast granularity," Applied Energy, Elsevier, vol. 205(C), pages 654-669.
    10. Chen, Ying & Chua, Wee Song & Koch, Thorsten, 2018. "Forecasting day-ahead high-resolution natural-gas demand and supply in Germany," Applied Energy, Elsevier, vol. 228(C), pages 1091-1110.
    11. Robert Thorndike, 1953. "Who belongs in the family?," Psychometrika, Springer;The Psychometric Society, vol. 18(4), pages 267-276, December.
    12. Zhu, L. & Li, M.S. & Wu, Q.H. & Jiang, L., 2015. "Short-term natural gas demand prediction based on support vector regression with false neighbours filtered," Energy, Elsevier, vol. 80(C), pages 428-436.
    13. Du, Pei & Wang, Jianzhou & Yang, Wendong & Niu, Tong, 2018. "Multi-step ahead forecasting in electrical power system using a hybrid forecasting system," Renewable Energy, Elsevier, vol. 122(C), pages 533-550.
    14. Özmen, Ayşe & Yılmaz, Yavuz & Weber, Gerhard-Wilhelm, 2018. "Natural gas consumption forecast with MARS and CMARS models for residential users," Energy Economics, Elsevier, vol. 70(C), pages 357-381.
    15. Soldo, Božidar, 2012. "Forecasting natural gas consumption," Applied Energy, Elsevier, vol. 92(C), pages 26-37.
    16. Krzysztof Gajowniczek & Tomasz Ząbkowski, 2017. "Two-Stage Electricity Demand Modeling Using Machine Learning Algorithms," Energies, MDPI, vol. 10(10), pages 1-25, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Li, Jingmiao & Wang, Jun, 2020. "Forcasting of energy futures market and synchronization based on stochastic gated recurrent unit model," Energy, Elsevier, vol. 213(C).
    2. Konstantinos Papageorgiou & Elpiniki I. Papageorgiou & Katarzyna Poczeta & Dionysis Bochtis & George Stamoulis, 2020. "Forecasting of Day-Ahead Natural Gas Consumption Demand in Greece Using Adaptive Neuro-Fuzzy Inference System," Energies, MDPI, vol. 13(9), pages 1-32, May.
    3. Chen, Sai & Song, Yan & Ding, Yueting & Zhang, Ming & Nie, Rui, 2021. "Using long short-term memory model to study risk assessment and prediction of China’s oil import from the perspective of resilience theory," Energy, Elsevier, vol. 215(PB).
    4. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    5. Qi, Chu & Zeng, Xianglong & Wang, Yongjian & Li, Hongguang, 2022. "Adaptive time window convolutional neural networks concerning multiple operation modes with applications in energy efficiency predictions," Energy, Elsevier, vol. 240(C).
    6. Ma, Tai-Yu & Faye, Sébastien, 2022. "Multistep electric vehicle charging station occupancy prediction using hybrid LSTM neural networks," Energy, Elsevier, vol. 244(PB).
    7. Saima Akhtar & Sulman Shahzad & Asad Zaheer & Hafiz Sami Ullah & Heybet Kilic & Radomir Gono & Michał Jasiński & Zbigniew Leonowicz, 2023. "Short-Term Load Forecasting Models: A Review of Challenges, Progress, and the Road Ahead," Energies, MDPI, vol. 16(10), pages 1-29, May.
    8. Cui, Mianshan, 2022. "District heating load prediction algorithm based on bidirectional long short-term memory network model," Energy, Elsevier, vol. 254(PA).
    9. Guo, Zixi & Zhao, Jinzhou & You, Zhenjiang & Li, Yongming & Zhang, Shu & Chen, Yiyu, 2021. "Prediction of coalbed methane production based on deep learning," Energy, Elsevier, vol. 230(C).
    10. Xie, Yiwei & Hu, Pingfang & Peng, Donggen & Zhu, Na & Lei, Fei, 2023. "Development of a group control strategy based on multi-step load forecasting and its application in hybrid ground source heat pump," Energy, Elsevier, vol. 273(C).
    11. Yang, Qingqing & Li, Jianwei & Cao, Wanke & Li, Shuangqi & Lin, Jie & Huo, Da & He, Hongwen, 2020. "An improved vehicle to the grid method with battery longevity management in a microgrid application," Energy, Elsevier, vol. 198(C).
    12. Xie, Yiwei & Hu, Pingfang & Zhu, Na & Lei, Fei & Xing, Lu & Xu, Linghong & Sun, Qiming, 2020. "A hybrid short-term load forecasting model and its application in ground source heat pump with cooling storage system," Renewable Energy, Elsevier, vol. 161(C), pages 1244-1259.
    13. Ding, Jia & Zhao, Yuxuan & Jin, Junyang, 2023. "Forecasting natural gas consumption with multiple seasonal patterns," Applied Energy, Elsevier, vol. 337(C).
    14. Jiang, Wei & Wang, Xin & Zhang, Shu, 2023. "Integrating multi-modal data into AFSA-LSTM model for real-time oil production prediction," Energy, Elsevier, vol. 279(C).
    15. AL-Alimi, Dalal & AlRassas, Ayman Mutahar & Al-qaness, Mohammed A.A. & Cai, Zhihua & Aseeri, Ahmad O. & Abd Elaziz, Mohamed & Ewees, Ahmed A., 2023. "TLIA: Time-series forecasting model using long short-term memory integrated with artificial neural networks for volatile energy markets," Applied Energy, Elsevier, vol. 343(C).
    16. Zeng, Huibin & Shao, Bilin & Dai, Hongbin & Yan, Yichuan & Tian, Ning, 2023. "Prediction of fluctuation loads based on GARCH family-CatBoost-CNNLSTM," Energy, Elsevier, vol. 263(PE).
    17. Longfeng Zhang & Xin Ma & Hui Zhang & Gaoxun Zhang & Peng Zhang, 2022. "Multi-Step Ahead Natural Gas Consumption Forecasting Based on a Hybrid Model: Case Studies in The Netherlands and the United Kingdom," Energies, MDPI, vol. 15(19), pages 1-26, October.
    18. Zhongfei Li & Kai Gan & Shaolong Sun & Shouyang Wang, 2023. "A new PM2.5 concentration forecasting system based on AdaBoost‐ensemble system with deep learning approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(1), pages 154-175, January.
    19. Su, Huai & Chi, Lixun & Zio, Enrico & Li, Zhenlin & Fan, Lin & Yang, Zhe & Liu, Zhe & Zhang, Jinjun, 2021. "An integrated, systematic data-driven supply-demand side management method for smart integrated energy systems," Energy, Elsevier, vol. 235(C).
    20. Zeng, Huibin & Shao, Bilin & Dai, Hongbin & Yan, Yichuan & Tian, Ning, 2023. "Natural gas demand response strategy considering user satisfaction and load volatility under dynamic pricing," Energy, Elsevier, vol. 277(C).
    21. Liu, Jinyuan & Wang, Shouxi & Wei, Nan & Qiao, Weibiao & Li, Ze & Zeng, Fanhua, 2023. "A clustering-based feature enhancement method for short-term natural gas consumption forecasting," Energy, Elsevier, vol. 278(PB).
    22. Maciej Slowik & Wieslaw Urban, 2022. "Machine Learning Short-Term Energy Consumption Forecasting for Microgrids in a Manufacturing Plant," Energies, MDPI, vol. 15(9), pages 1-16, May.
    23. Kumari, Pratima & Toshniwal, Durga, 2021. "Long short term memory–convolutional neural network based deep hybrid approach for solar irradiance forecasting," Applied Energy, Elsevier, vol. 295(C).
    24. Zhang, Lihong & Wang, Jun & Wang, Bin, 2020. "Energy market prediction with novel long short-term memory network: Case study of energy futures index volatility," Energy, Elsevier, vol. 211(C).
    25. Paul Anton Verwiebe & Stephan Seim & Simon Burges & Lennart Schulz & Joachim Müller-Kirchenbauer, 2021. "Modeling Energy Demand—A Systematic Literature Review," Energies, MDPI, vol. 14(23), pages 1-58, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Fengyun & Zheng, Haofeng & Li, Xingmei & Yang, Fei, 2021. "Day-ahead city natural gas load forecasting based on decomposition-fusion technique and diversified ensemble learning model," Applied Energy, Elsevier, vol. 303(C).
    2. Wei, Nan & Yin, Lihua & Li, Chao & Liu, Jinyuan & Li, Changjun & Huang, Yuanyuan & Zeng, Fanhua, 2022. "Data complexity of daily natural gas consumption: Measurement and impact on forecasting performance," Energy, Elsevier, vol. 238(PC).
    3. Beyca, Omer Faruk & Ervural, Beyzanur Cayir & Tatoglu, Ekrem & Ozuyar, Pinar Gokcin & Zaim, Selim, 2019. "Using machine learning tools for forecasting natural gas consumption in the province of Istanbul," Energy Economics, Elsevier, vol. 80(C), pages 937-949.
    4. Chen, Ying & Koch, Thorsten & Zakiyeva, Nazgul & Zhu, Bangzhu, 2020. "Modeling and forecasting the dynamics of the natural gas transmission network in Germany with the demand and supply balance constraint," Applied Energy, Elsevier, vol. 278(C).
    5. Lu, Hongfang & Ma, Xin & Azimi, Mohammadamin, 2020. "US natural gas consumption prediction using an improved kernel-based nonlinear extension of the Arps decline model," Energy, Elsevier, vol. 194(C).
    6. Wei, Nan & Yin, Lihua & Li, Chao & Li, Changjun & Chan, Christine & Zeng, Fanhua, 2021. "Forecasting the daily natural gas consumption with an accurate white-box model," Energy, Elsevier, vol. 232(C).
    7. Wei, Nan & Li, Changjun & Peng, Xiaolong & Li, Yang & Zeng, Fanhua, 2019. "Daily natural gas consumption forecasting via the application of a novel hybrid model," Applied Energy, Elsevier, vol. 250(C), pages 358-368.
    8. Mustafa Akpinar & Nejat Yumusak, 2016. "Year Ahead Demand Forecast of City Natural Gas Using Seasonal Time Series Methods," Energies, MDPI, vol. 9(9), pages 1-17, September.
    9. Su, Huai & Zio, Enrico & Zhang, Jinjun & Xu, Mingjing & Li, Xueyi & Zhang, Zongjie, 2019. "A hybrid hourly natural gas demand forecasting method based on the integration of wavelet transform and enhanced Deep-RNN model," Energy, Elsevier, vol. 178(C), pages 585-597.
    10. Jean Gaston Tamba & Salom Ndjakomo Essiane & Emmanuel Flavian Sapnken & Francis Djanna Koffi & Jean Luc Nsouand l & Bozidar Soldo & Donatien Njomo, 2018. "Forecasting Natural Gas: A Literature Survey," International Journal of Energy Economics and Policy, Econjournals, vol. 8(3), pages 216-249.
    11. Konstantinos Papageorgiou & Elpiniki I. Papageorgiou & Katarzyna Poczeta & Dionysis Bochtis & George Stamoulis, 2020. "Forecasting of Day-Ahead Natural Gas Consumption Demand in Greece Using Adaptive Neuro-Fuzzy Inference System," Energies, MDPI, vol. 13(9), pages 1-32, May.
    12. Chen, Ying & Xu, Xiuqin & Koch, Thorsten, 2020. "Day-ahead high-resolution forecasting of natural gas demand and supply in Germany with a hybrid model," Applied Energy, Elsevier, vol. 262(C).
    13. Deng, Yanqiao & Ma, Xin & Zhang, Peng & Cai, Yubin, 2022. "Multi-step ahead forecasting of daily urban gas load in Chengdu using a Tanimoto kernel-based NAR model and Whale optimization," Energy, Elsevier, vol. 260(C).
    14. Ravnik, J. & Hriberšek, M., 2019. "A method for natural gas forecasting and preliminary allocation based on unique standard natural gas consumption profiles," Energy, Elsevier, vol. 180(C), pages 149-162.
    15. Yukseltan, Ergun & Yucekaya, Ahmet & Bilge, Ayse Humeyra & Agca Aktunc, Esra, 2021. "Forecasting models for daily natural gas consumption considering periodic variations and demand segregation," Socio-Economic Planning Sciences, Elsevier, vol. 74(C).
    16. Du, Jian & Zheng, Jianqin & Liang, Yongtu & Lu, Xinyi & Klemeš, Jiří Jaromír & Varbanov, Petar Sabev & Shahzad, Khurram & Rashid, Muhammad Imtiaz & Ali, Arshid Mahmood & Liao, Qi & Wang, Bohong, 2022. "A hybrid deep learning framework for predicting daily natural gas consumption," Energy, Elsevier, vol. 257(C).
    17. Tomasz Cieślik & Piotr Narloch & Adam Szurlej & Krzysztof Kogut, 2022. "Indirect Impact of the COVID-19 Pandemic on Natural Gas Consumption by Commercial Consumers in a Selected City in Poland," Energies, MDPI, vol. 15(4), pages 1-18, February.
    18. Panapakidis, Ioannis P. & Dagoumas, Athanasios S., 2017. "Day-ahead natural gas demand forecasting based on the combination of wavelet transform and ANFIS/genetic algorithm/neural network model," Energy, Elsevier, vol. 118(C), pages 231-245.
    19. Askari, S. & Montazerin, N. & Fazel Zarandi, M.H., 2016. "Gas networks simulation from disaggregation of low frequency nodal gas consumption," Energy, Elsevier, vol. 112(C), pages 1286-1298.
    20. Guo-Feng Fan & An Wang & Wei-Chiang Hong, 2018. "Combining Grey Model and Self-Adapting Intelligent Grey Model with Genetic Algorithm and Annual Share Changes in Natural Gas Demand Forecasting," Energies, MDPI, vol. 11(7), pages 1-21, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:177:y:2019:i:c:p:530-542. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.