IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v290y2024ics0360544223035788.html
   My bibliography  Save this article

TimeNet: Time2Vec attention-based CNN-BiGRU neural network for predicting production in shale and sandstone gas reservoirs

Author

Listed:
  • Fargalla, Mandella Ali M.
  • Yan, Wei
  • Deng, Jingen
  • Wu, Tao
  • Kiyingi, Wyclif
  • Li, Guangcong
  • Zhang, Wei

Abstract

With the continuous growth in global population and productivity, the demand for natural gas, the cleanest fossil fuel, is expected to increase significantly. Accurate daily gas production forecasting of shale and sandstone reservoirs ensures a reliable gas supply. However, the complex and non-linear gas data (reservoir and production data) makes this difficult. To address these challenges, we propose a novel model named TimeNet, which utilizes a mix of convolutional neural networks (CNN), bidirectional gated recurrent units (BiGRU), attention mechanisms (AM), and Time2Vec. Time2Vec is integrated to automatically capture important complex and non-linear temporal information and mitigate burdensome time series pre-processing. The CNN layer extracts spatial features influencing gas production, while the BiGRU captures high-level temporal features and irregular trends in the time series data. The AM helps in understanding embedded information for accurate learning. Each component of the TimeNet model serves a distinct function in the prediction task, optimizing its strengths. Testing on two real-world datasets from the Fenchuganj conventional sandstone gas field and the Marcellus shale gas field confirms the proposed model's effectiveness. Comparative analysis demonstrates the superior performance of the proposed model on the two datasets, exhibiting an R2 of 97.25 % and 97.57 % in shale and sandstone gas, respectively.

Suggested Citation

  • Fargalla, Mandella Ali M. & Yan, Wei & Deng, Jingen & Wu, Tao & Kiyingi, Wyclif & Li, Guangcong & Zhang, Wei, 2024. "TimeNet: Time2Vec attention-based CNN-BiGRU neural network for predicting production in shale and sandstone gas reservoirs," Energy, Elsevier, vol. 290(C).
  • Handle: RePEc:eee:energy:v:290:y:2024:i:c:s0360544223035788
    DOI: 10.1016/j.energy.2023.130184
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223035788
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2023.130184?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Niu, Wente & Lu, Jialiang & Sun, Yuping & Guo, Wei & Liu, Yuyang & Mu, Ying, 2022. "Development of visual prediction model for shale gas wells production based on screening main controlling factors," Energy, Elsevier, vol. 250(C).
    2. Xu, Huanwei & Wu, Lingfeng & Xiong, Shizhe & Li, Wei & Garg, Akhil & Gao, Liang, 2023. "An improved CNN-LSTM model-based state-of-health estimation approach for lithium-ion batteries," Energy, Elsevier, vol. 276(C).
    3. Jebli, Imane & Belouadha, Fatima-Zahra & Kabbaj, Mohammed Issam & Tilioua, Amine, 2021. "Prediction of solar energy guided by pearson correlation using machine learning," Energy, Elsevier, vol. 224(C).
    4. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    5. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    6. Wang, Hui & Chen, Li & Qu, Zhiguo & Yin, Ying & Kang, Qinjun & Yu, Bo & Tao, Wen-Quan, 2020. "Modeling of multi-scale transport phenomena in shale gas production — A critical review," Applied Energy, Elsevier, vol. 262(C).
    7. Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).
    8. Hui, Gang & Chen, Zhangxin & Wang, Youjing & Zhang, Dongmei & Gu, Fei, 2023. "An integrated machine learning-based approach to identifying controlling factors of unconventional shale productivity," Energy, Elsevier, vol. 266(C).
    9. Fan, Dongyan & Sun, Hai & Yao, Jun & Zhang, Kai & Yan, Xia & Sun, Zhixue, 2021. "Well production forecasting based on ARIMA-LSTM model considering manual operations," Energy, Elsevier, vol. 220(C).
    10. Lyu, Wenjing & Liu, Jin, 2021. "Artificial Intelligence and emerging digital technologies in the energy sector," Applied Energy, Elsevier, vol. 303(C).
    11. Zha, Wenshu & Liu, Yuping & Wan, Yujin & Luo, Ruilan & Li, Daolun & Yang, Shan & Xu, Yanmei, 2022. "Forecasting monthly gas field production based on the CNN-LSTM model," Energy, Elsevier, vol. 260(C).
    12. Dongkwon Han & Sunil Kwon, 2021. "Application of Machine Learning Method of Data-Driven Deep Learning Model to Predict Well Production Rate in the Shale Gas Reservoirs," Energies, MDPI, vol. 14(12), pages 1-24, June.
    13. Du, Shuyi & Wang, Jiulong & Wang, Meizhu & Yang, Jiaosheng & Zhang, Cong & Zhao, Yang & Song, Hongqing, 2023. "A systematic data-driven approach for production forecasting of coalbed methane incorporating deep learning and ensemble learning adapted to complex production patterns," Energy, Elsevier, vol. 263(PE).
    14. Niu, Dongxiao & Yu, Min & Sun, Lijie & Gao, Tian & Wang, Keke, 2022. "Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism," Applied Energy, Elsevier, vol. 313(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).
    2. Bhagwan, N. & Evans, M., 2023. "A review of industry 4.0 technologies used in the production of energy in China, Germany, and South Africa," Renewable and Sustainable Energy Reviews, Elsevier, vol. 173(C).
    3. Jian Zhu & Zhiyuan Zhao & Xiaoran Zheng & Zhao An & Qingwu Guo & Zhikai Li & Jianling Sun & Yuanjun Guo, 2023. "Time-Series Power Forecasting for Wind and Solar Energy Based on the SL-Transformer," Energies, MDPI, vol. 16(22), pages 1-15, November.
    4. Stefenon, Stefano Frizzo & Seman, Laio Oriel & Aquino, Luiza Scapinello & Coelho, Leandro dos Santos, 2023. "Wavelet-Seq2Seq-LSTM with attention for time series forecasting of level of dams in hydroelectric power plants," Energy, Elsevier, vol. 274(C).
    5. Hu, Yue & Liu, Hanjing & Wu, Senzhen & Zhao, Yuan & Wang, Zhijin & Liu, Xiufeng, 2024. "Temporal collaborative attention for wind power forecasting," Applied Energy, Elsevier, vol. 357(C).
    6. Niu, Wente & Lu, Jialiang & Sun, Yuping & Zhang, Xiaowei & Li, Qiaojing & Cao, Xu & Liang, Pingping & Zhan, Hongming, 2024. "Techno-economic integration evaluation in shale gas development based on ensemble learning," Applied Energy, Elsevier, vol. 357(C).
    7. Li, Daolun & Zhou, Xia & Xu, Yanmei & Wan, Yujin & Zha, Wenshu, 2023. "Deep learning-based analysis of the main controlling factors of different gas-fields recovery rate," Energy, Elsevier, vol. 285(C).
    8. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    9. Zhong, Lingshu & Wu, Pan & Pei, Mingyang, 2024. "Wind power generation prediction during the COVID-19 epidemic based on novel hybrid deep learning techniques," Renewable Energy, Elsevier, vol. 222(C).
    10. Dong, Juan & Xing, Liwen & Cui, Ningbo & Zhao, Lu & Guo, Li & Wang, Zhihui & Du, Taisheng & Tan, Mingdong & Gong, Daozhi, 2024. "Estimating reference crop evapotranspiration using improved convolutional bidirectional long short-term memory network by multi-head attention mechanism in the four climatic zones of China," Agricultural Water Management, Elsevier, vol. 292(C).
    11. Xiaoshuang Huang & Yinbao Zhang & Jianzhong Liu & Xinjia Zhang & Sicong Liu, 2023. "A Short-Term Wind Power Forecasting Model Based on 3D Convolutional Neural Network–Gated Recurrent Unit," Sustainability, MDPI, vol. 15(19), pages 1-13, September.
    12. Zhao, Hongqian & Chen, Zheng & Shu, Xing & Shen, Jiangwei & Lei, Zhenzhen & Zhang, Yuanjian, 2023. "State of health estimation for lithium-ion batteries based on hybrid attention and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    13. Zhou, Wei & Li, Xiangchengzhen & Qi, ZhongLi & Zhao, HaiHang & Yi, Jun, 2024. "A shale gas production prediction model based on masked convolutional neural network," Applied Energy, Elsevier, vol. 353(PA).
    14. Xiangming Kong & Yuetian Liu & Liang Xue & Guanlin Li & Dongdong Zhu, 2023. "A Hybrid Oil Production Prediction Model Based on Artificial Intelligence Technology," Energies, MDPI, vol. 16(3), pages 1-16, January.
    15. Yang, Run & Liu, Xiangui & Yu, Rongze & Hu, Zhiming & Duan, Xianggang, 2022. "Long short-term memory suggests a model for predicting shale gas production," Applied Energy, Elsevier, vol. 322(C).
    16. Meng, Anbo & Xie, Zhifeng & Luo, Jianqiang & Zeng, Ying & Xu, Xuancong & Li, Yidian & Wu, Zhenbo & Zhang, Zhan & Zhu, Jianbin & Xian, Zikang & Li, Chen & Yan, Baiping & Yin, Hao, 2023. "An adaptive variational mode decomposition for wind power prediction using convolutional block attention deep learning network," Energy, Elsevier, vol. 282(C).
    17. Shi, Changfeng & Zhi, Jiaqi & Yao, Xiao & Zhang, Hong & Yu, Yue & Zeng, Qingshun & Li, Luji & Zhang, Yuxi, 2023. "How can China achieve the 2030 carbon peak goal—a crossover analysis based on low-carbon economics and deep learning," Energy, Elsevier, vol. 269(C).
    18. Li, Min & Yang, Yi & He, Zhaoshuang & Guo, Xinbo & Zhang, Ruisheng & Huang, Bingqing, 2023. "A wind speed forecasting model based on multi-objective algorithm and interpretability learning," Energy, Elsevier, vol. 269(C).
    19. Omoyele, Olalekan & Hoffmann, Maximilian & Koivisto, Matti & Larrañeta, Miguel & Weinand, Jann Michael & Linßen, Jochen & Stolten, Detlef, 2024. "Increasing the resolution of solar and wind time series for energy system modeling: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    20. Yuxuan Yang & Zhigang Wen & Weichao Tian & Yunpeng Fan & Heting Gao, 2024. "A New Model for Predicting Permeability of Chang 7 Tight Sandstone Based on Fractal Characteristics from High-Pressure Mercury Injection," Energies, MDPI, vol. 17(4), pages 1-16, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:290:y:2024:i:c:s0360544223035788. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.