IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v238y2022ipcs0360544221023380.html
   My bibliography  Save this article

Data complexity of daily natural gas consumption: Measurement and impact on forecasting performance

Author

Listed:
  • Wei, Nan
  • Yin, Lihua
  • Li, Chao
  • Liu, Jinyuan
  • Li, Changjun
  • Huang, Yuanyuan
  • Zeng, Fanhua

Abstract

Data complexity has a great impact on daily natural gas consumption forecasting. However, due to the existence of irregular data, complex periodic change, and volatility data, the conventional methods, such as Lyapunov exponent and sample entropy, are failed to assess the complexity of the consumption data. Thus, this paper proposes a hybrid method of complexity measure, named CMLS. The novel method combined correlation coefficient analysis, missing data detect, Lyapunov exponent, and skewness analysis. Compared with Lyapunov exponent and sample entropy, CMLS is more stable and insensitive to the length of data in complexity measures. Additionally, for revealing the relationship between data complexity and forecasting performance, we design three case studies including 56 sets of daily natural gas consumption, and forecast with three advanced models. The results show that the forecasting performance various a lot in different complexity level. Particularly in very hard level, the daily natural gas consumption data is very hard to be forecasted and the R2 of forecasts are all negative. This paper serves as an initial study seeks to reveal the impact of data complexity on forecasting performance. The findings can help forecasters to evaluate the performance and difficulty of natural gas consumption forecasting.

Suggested Citation

  • Wei, Nan & Yin, Lihua & Li, Chao & Liu, Jinyuan & Li, Changjun & Huang, Yuanyuan & Zeng, Fanhua, 2022. "Data complexity of daily natural gas consumption: Measurement and impact on forecasting performance," Energy, Elsevier, vol. 238(PC).
    • Handle: RePEc:eee:energy:v:238:y:2022:i:pc:s0360544221023380
    DOI: 10.1016/j.energy.2021.122090
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221023380
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2021.122090?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kang, Huan & Zhang, Xiaofeng & Zhang, Guangbin, 2021. "Phase permutation entropy: A complexity measure for nonlinear time series incorporating phase information," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 568(C).
    2. Yu, Feng & Xu, Xiaozhong, 2014. "A short-term load forecasting model of natural gas based on optimized genetic algorithm and improved BP neural network," Applied Energy, Elsevier, vol. 134(C), pages 102-113.
    3. Szoplik, Jolanta, 2015. "Forecasting of natural gas consumption with artificial neural networks," Energy, Elsevier, vol. 85(C), pages 208-220.
    4. Kovačič, Miha & Šarler, Božidar, 2014. "Genetic programming prediction of the natural gas consumption in a steel plant," Energy, Elsevier, vol. 66(C), pages 273-284.
    5. Potočnik, Primož & Soldo, Božidar & Šimunović, Goran & Šarić, Tomislav & Jeromen, Andrej & Govekar, Edvard, 2014. "Comparison of static and adaptive models for short-term residential natural gas forecasting in Croatia," Applied Energy, Elsevier, vol. 129(C), pages 94-103.
    6. Zhang, Chi & Wei, Haikun & Zhao, Junsheng & Liu, Tianhong & Zhu, Tingting & Zhang, Kanjian, 2016. "Short-term wind speed forecasting using empirical mode decomposition and feature selection," Renewable Energy, Elsevier, vol. 96(PA), pages 727-737.
    7. Huiting Zheng & Jiabin Yuan & Long Chen, 2017. "Short-Term Load Forecasting Using EMD-LSTM Neural Networks with a Xgboost Algorithm for Feature Importance Evaluation," Energies, MDPI, vol. 10(8), pages 1-20, August.
    8. Chen, Ying & Chua, Wee Song & Koch, Thorsten, 2018. "Forecasting day-ahead high-resolution natural-gas demand and supply in Germany," Applied Energy, Elsevier, vol. 228(C), pages 1091-1110.
    9. Mihailović, Dragutin T. & Nikolić-Đorić, Emilija & Arsenić, Ilija & Malinović-Milićević, Slavica & Singh, Vijay P. & Stošić, Tatijana & Stošić, Borko, 2019. "Analysis of daily streamflow complexity by Kolmogorov measures and Lyapunov exponent," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 525(C), pages 290-303.
    10. Ghandar, Adam & Michalewicz, Zbigniew & Zurbruegg, Ralf, 2016. "The relationship between model complexity and forecasting performance for computer intelligence optimization in finance," International Journal of Forecasting, Elsevier, vol. 32(3), pages 598-613.
    11. Zhu, L. & Li, M.S. & Wu, Q.H. & Jiang, L., 2015. "Short-term natural gas demand prediction based on support vector regression with false neighbours filtered," Energy, Elsevier, vol. 80(C), pages 428-436.
    12. Shang, Binbin & Shang, Pengjian, 2020. "Binary indices of time series complexity measures and entropy plane," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 558(C).
    13. Vaidya, Omkarprasad S. & Kumar, Sushil, 2006. "Analytic hierarchy process: An overview of applications," European Journal of Operational Research, Elsevier, vol. 169(1), pages 1-29, February.
    14. Yin, Yi & Wang, Xi & Li, Qiang & Shang, Pengjian, 2020. "Generalized multivariate multiscale sample entropy for detecting the complexity in complex systems," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 545(C).
    15. Ferreira, R.B. & Vieira, V.M. & Gleria, Iram & Lyra, M.L., 2009. "Correlation and complexity analysis of well logs via Lyapunov, Hurst, Lempel–Ziv and neural network algorithms," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 388(5), pages 747-754.
    16. Panapakidis, Ioannis P. & Dagoumas, Athanasios S., 2017. "Day-ahead natural gas demand forecasting based on the combination of wavelet transform and ANFIS/genetic algorithm/neural network model," Energy, Elsevier, vol. 118(C), pages 231-245.
    17. Paquette, Laurence & Kida, Thomas, 1988. "The effect of decision strategy and task complexity on decision performance," Organizational Behavior and Human Decision Processes, Elsevier, vol. 41(1), pages 128-142, February.
    18. Sanchez-Ubeda, Eugenio Fco. & Berzosa, Ana, 2007. "Modeling and forecasting industrial end-use natural gas consumption," Energy Economics, Elsevier, vol. 29(4), pages 710-742, July.
    19. Chen, Ying & Xu, Xiuqin & Koch, Thorsten, 2020. "Day-ahead high-resolution forecasting of natural gas demand and supply in Germany with a hybrid model," Applied Energy, Elsevier, vol. 262(C).
    20. Feng, Cong & Cui, Mingjian & Hodge, Bri-Mathias & Zhang, Jie, 2017. "A data-driven multi-model methodology with deep feature selection for short-term wind forecasting," Applied Energy, Elsevier, vol. 190(C), pages 1245-1257.
    21. Özmen, Ayşe & Yılmaz, Yavuz & Weber, Gerhard-Wilhelm, 2018. "Natural gas consumption forecast with MARS and CMARS models for residential users," Energy Economics, Elsevier, vol. 70(C), pages 357-381.
    22. Beyca, Omer Faruk & Ervural, Beyzanur Cayir & Tatoglu, Ekrem & Ozuyar, Pinar Gokcin & Zaim, Selim, 2019. "Using machine learning tools for forecasting natural gas consumption in the province of Istanbul," Energy Economics, Elsevier, vol. 80(C), pages 937-949.
    23. Soldo, Božidar, 2012. "Forecasting natural gas consumption," Applied Energy, Elsevier, vol. 92(C), pages 26-37.
    24. Nan Wei & Changjun Li & Jiehao Duan & Jinyuan Liu & Fanhua Zeng, 2019. "Daily Natural Gas Load Forecasting Based on a Hybrid Deep Learning Model," Energies, MDPI, vol. 12(2), pages 1-15, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pala, Zeydin, 2023. "Comparative study on monthly natural gas vehicle fuel consumption and industrial consumption using multi-hybrid forecast models," Energy, Elsevier, vol. 263(PC).
    2. Wei, Nan & Yin, Lihua & Li, Chao & Wang, Wei & Qiao, Weibiao & Li, Changjun & Zeng, Fanhua & Fu, Lingdi, 2022. "Short-term load forecasting using detrend singular spectrum fluctuation analysis," Energy, Elsevier, vol. 256(C).
    3. Jinyuan Liu & Shouxi Wang & Nan Wei & Yi Yang & Yihao Lv & Xu Wang & Fanhua Zeng, 2023. "An Enhancement Method Based on Long Short-Term Memory Neural Network for Short-Term Natural Gas Consumption Forecasting," Energies, MDPI, vol. 16(3), pages 1-14, January.
    4. Liu, Jinyuan & Wang, Shouxi & Wei, Nan & Qiao, Weibiao & Li, Ze & Zeng, Fanhua, 2023. "A clustering-based feature enhancement method for short-term natural gas consumption forecasting," Energy, Elsevier, vol. 278(PB).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wei, Nan & Yin, Lihua & Li, Chao & Li, Changjun & Chan, Christine & Zeng, Fanhua, 2021. "Forecasting the daily natural gas consumption with an accurate white-box model," Energy, Elsevier, vol. 232(C).
    2. Wei, Nan & Li, Changjun & Peng, Xiaolong & Li, Yang & Zeng, Fanhua, 2019. "Daily natural gas consumption forecasting via the application of a novel hybrid model," Applied Energy, Elsevier, vol. 250(C), pages 358-368.
    3. Beyca, Omer Faruk & Ervural, Beyzanur Cayir & Tatoglu, Ekrem & Ozuyar, Pinar Gokcin & Zaim, Selim, 2019. "Using machine learning tools for forecasting natural gas consumption in the province of Istanbul," Energy Economics, Elsevier, vol. 80(C), pages 937-949.
    4. Chen, Ying & Koch, Thorsten & Zakiyeva, Nazgul & Zhu, Bangzhu, 2020. "Modeling and forecasting the dynamics of the natural gas transmission network in Germany with the demand and supply balance constraint," Applied Energy, Elsevier, vol. 278(C).
    5. Lu, Hongfang & Ma, Xin & Azimi, Mohammadamin, 2020. "US natural gas consumption prediction using an improved kernel-based nonlinear extension of the Arps decline model," Energy, Elsevier, vol. 194(C).
    6. Su, Huai & Zio, Enrico & Zhang, Jinjun & Xu, Mingjing & Li, Xueyi & Zhang, Zongjie, 2019. "A hybrid hourly natural gas demand forecasting method based on the integration of wavelet transform and enhanced Deep-RNN model," Energy, Elsevier, vol. 178(C), pages 585-597.
    7. Tomasz Cieślik & Piotr Narloch & Adam Szurlej & Krzysztof Kogut, 2022. "Indirect Impact of the COVID-19 Pandemic on Natural Gas Consumption by Commercial Consumers in a Selected City in Poland," Energies, MDPI, vol. 15(4), pages 1-18, February.
    8. Jean Gaston Tamba & Salom Ndjakomo Essiane & Emmanuel Flavian Sapnken & Francis Djanna Koffi & Jean Luc Nsouand l & Bozidar Soldo & Donatien Njomo, 2018. "Forecasting Natural Gas: A Literature Survey," International Journal of Energy Economics and Policy, Econjournals, vol. 8(3), pages 216-249.
    9. Laib, Oussama & Khadir, Mohamed Tarek & Mihaylova, Lyudmila, 2019. "Toward efficient energy systems based on natural gas consumption prediction with LSTM Recurrent Neural Networks," Energy, Elsevier, vol. 177(C), pages 530-542.
    10. Mustafa Akpinar & Nejat Yumusak, 2016. "Year Ahead Demand Forecast of City Natural Gas Using Seasonal Time Series Methods," Energies, MDPI, vol. 9(9), pages 1-17, September.
    11. Li, Fengyun & Zheng, Haofeng & Li, Xingmei & Yang, Fei, 2021. "Day-ahead city natural gas load forecasting based on decomposition-fusion technique and diversified ensemble learning model," Applied Energy, Elsevier, vol. 303(C).
    12. Du, Jian & Zheng, Jianqin & Liang, Yongtu & Lu, Xinyi & Klemeš, Jiří Jaromír & Varbanov, Petar Sabev & Shahzad, Khurram & Rashid, Muhammad Imtiaz & Ali, Arshid Mahmood & Liao, Qi & Wang, Bohong, 2022. "A hybrid deep learning framework for predicting daily natural gas consumption," Energy, Elsevier, vol. 257(C).
    13. Chen, Ying & Xu, Xiuqin & Koch, Thorsten, 2020. "Day-ahead high-resolution forecasting of natural gas demand and supply in Germany with a hybrid model," Applied Energy, Elsevier, vol. 262(C).
    14. Meira, Erick & Cyrino Oliveira, Fernando Luiz & de Menezes, Lilian M., 2022. "Forecasting natural gas consumption using Bagging and modified regularization techniques," Energy Economics, Elsevier, vol. 106(C).
    15. Szoplik, Jolanta, 2015. "Forecasting of natural gas consumption with artificial neural networks," Energy, Elsevier, vol. 85(C), pages 208-220.
    16. Ravnik, J. & Hriberšek, M., 2019. "A method for natural gas forecasting and preliminary allocation based on unique standard natural gas consumption profiles," Energy, Elsevier, vol. 180(C), pages 149-162.
    17. Reza Hafezi & Amir Naser Akhavan & Mazdak Zamani & Saeed Pakseresht & Shahaboddin Shamshirband, 2019. "Developing a Data Mining Based Model to Extract Predictor Factors in Energy Systems: Application of Global Natural Gas Demand," Energies, MDPI, vol. 12(21), pages 1-22, October.
    18. Song, Jiancai & Zhang, Liyi & Jiang, Qingling & Ma, Yunpeng & Zhang, Xinxin & Xue, Guixiang & Shen, Xingliang & Wu, Xiangdong, 2022. "Estimate the daily consumption of natural gas in district heating system based on a hybrid seasonal decomposition and temporal convolutional network model," Applied Energy, Elsevier, vol. 309(C).
    19. Nan Wei & Changjun Li & Jiehao Duan & Jinyuan Liu & Fanhua Zeng, 2019. "Daily Natural Gas Load Forecasting Based on a Hybrid Deep Learning Model," Energies, MDPI, vol. 12(2), pages 1-15, January.
    20. Ding, Lili & Zhao, Zhongchao & Wang, Lei, 2022. "Probability density forecasts for natural gas demand in China: Do mixed-frequency dynamic factors matter?," Applied Energy, Elsevier, vol. 312(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:238:y:2022:i:pc:s0360544221023380. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.