IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v284y2023ics0360544223020959.html
   My bibliography  Save this article

Oil well production prediction based on CNN-LSTM model with self-attention mechanism

Author

Listed:
  • Pan, Shaowei
  • Yang, Bo
  • Wang, Shukai
  • Guo, Zhi
  • Wang, Lin
  • Liu, Jinhua
  • Wu, Siyu

Abstract

To overcome the shortcomings in current study of oil well production prediction, we propose a combined model (CNN-LSTM-SA) with the convolutional neural network (CNN), the long short-term memory (LSTM) neural network and the self-attention mechanism (SA). The CNN-LSTM-SA model consists of five parts: input layer, CNN module, LSTM layer, self-attention layer and output layer. In this model, CNN is used to extract the spatiotemporal features of the input data, LSTM is used to extract the correlation information, and SA is used to capture the internal correlation. Compared with the traditional machine learning methods, such as linear regression (LR), support vector machine (SVM), random forest (RF), XGBoost and back propagation (BP) neural network; and deep learning methods, such as LSTM, LSTM-SA and CNN-LSTM, the CNN-LSTM-SA model can extract the spatial-temporal features that are hidden in oil well production data more comprehensively. It is enable to mine the internal correlation in oil well production data more precisely, thereby improving the accuracy of oil well production prediction. More specifically, among the existing methods, the CNN-LSTM-SA model achieves the best performance in terms of adaptation to the basic trend of oil well production and the prediction of specific values of oil well production.

Suggested Citation

  • Pan, Shaowei & Yang, Bo & Wang, Shukai & Guo, Zhi & Wang, Lin & Liu, Jinhua & Wu, Siyu, 2023. "Oil well production prediction based on CNN-LSTM model with self-attention mechanism," Energy, Elsevier, vol. 284(C).
  • Handle: RePEc:eee:energy:v:284:y:2023:i:c:s0360544223020959
    DOI: 10.1016/j.energy.2023.128701
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223020959
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2023.128701?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kim, Tae-Young & Cho, Sung-Bae, 2019. "Predicting residential energy consumption using CNN-LSTM neural networks," Energy, Elsevier, vol. 182(C), pages 72-81.
    2. Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    3. Zhang, Yishuo & Li, Gang & Muskat, Birgit & Law, Rob & Yang, Yating, 2020. "Group pooling for deep tourism demand forecasting," Annals of Tourism Research, Elsevier, vol. 82(C).
    4. Xuechen Li & Xinfang Ma & Fengchao Xiao & Fei Wang & Shicheng Zhang, 2020. "Application of Gated Recurrent Unit (GRU) Neural Network for Smart Batch Production Prediction," Energies, MDPI, vol. 13(22), pages 1-22, November.
    5. Huiping Jiang & Rui Jiao & Zequn Wang & Ting Zhang & Licheng Wu & Ning Cai, 2021. "Construction and Analysis of Emotion Computing Model Based on LSTM," Complexity, Hindawi, vol. 2021, pages 1-12, February.
    6. Wang, Qiang & Song, Xiaoxing & Li, Rongrong, 2018. "A novel hybridization of nonlinear grey model and linear ARIMA residual correction for forecasting U.S. shale oil production," Energy, Elsevier, vol. 165(PB), pages 1320-1331.
    7. Fan, Dongyan & Sun, Hai & Yao, Jun & Zhang, Kai & Yan, Xia & Sun, Zhixue, 2021. "Well production forecasting based on ARIMA-LSTM model considering manual operations," Energy, Elsevier, vol. 220(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Jun & Cao, Junxing & Fu, Jingcheng & Xu, Hanqing, 2022. "Missing well logs prediction using deep learning integrated neural network with the self-attention mechanism," Energy, Elsevier, vol. 261(PB).
    2. Gonçalves, Rui & Ribeiro, Vitor Miguel & Pereira, Fernando Lobo, 2023. "Variable Split Convolutional Attention: A novel Deep Learning model applied to the household electric power consumption," Energy, Elsevier, vol. 274(C).
    3. Wen, Kai & Jiao, Jianfeng & Zhao, Kang & Yin, Xiong & Liu, Yuan & Gong, Jing & Li, Cuicui & Hong, Bingyuan, 2023. "Rapid transient operation control method of natural gas pipeline networks based on user demand prediction," Energy, Elsevier, vol. 264(C).
    4. Yang, Run & Liu, Xiangui & Yu, Rongze & Hu, Zhiming & Duan, Xianggang, 2022. "Long short-term memory suggests a model for predicting shale gas production," Applied Energy, Elsevier, vol. 322(C).
    5. Mingping Liu & Xihao Sun & Qingnian Wang & Suhui Deng, 2022. "Short-Term Load Forecasting Using EMD with Feature Selection and TCN-Based Deep Learning Model," Energies, MDPI, vol. 15(19), pages 1-22, September.
    6. Wang, Yong & Yang, Zhongsen & Wang, Li & Ma, Xin & Wu, Wenqing & Ye, Lingling & Zhou, Ying & Luo, Yongxian, 2022. "Forecasting China's energy production and consumption based on a novel structural adaptive Caputo fractional grey prediction model," Energy, Elsevier, vol. 259(C).
    7. Kandpal, Bakul & Pareek, Parikshit & Verma, Ashu, 2022. "A robust day-ahead scheduling strategy for EV charging stations in unbalanced distribution grid," Energy, Elsevier, vol. 249(C).
    8. Zhao, Xinxing & Li, Kainan & Ang, Candice Ke En & Cheong, Kang Hao, 2023. "A deep learning based hybrid architecture for weekly dengue incidences forecasting," Chaos, Solitons & Fractals, Elsevier, vol. 168(C).
    9. Abubakar Ahmad Musa & Adamu Hussaini & Weixian Liao & Fan Liang & Wei Yu, 2023. "Deep Neural Networks for Spatial-Temporal Cyber-Physical Systems: A Survey," Future Internet, MDPI, vol. 15(6), pages 1-24, May.
    10. Lan, Puzhe & Han, Dong & Xu, Xiaoyuan & Yan, Zheng & Ren, Xijun & Xia, Shiwei, 2022. "Data-driven state estimation of integrated electric-gas energy system," Energy, Elsevier, vol. 252(C).
    11. Ding, Song & Tao, Zui & Zhang, Huahan & Li, Yao, 2022. "Forecasting nuclear energy consumption in China and America: An optimized structure-adaptative grey model," Energy, Elsevier, vol. 239(PA).
    12. Wang, Delu & Gan, Jun & Mao, Jinqi & Chen, Fan & Yu, Lan, 2023. "Forecasting power demand in China with a CNN-LSTM model including multimodal information," Energy, Elsevier, vol. 263(PE).
    13. Ijaz Ul Haq & Amin Ullah & Samee Ullah Khan & Noman Khan & Mi Young Lee & Seungmin Rho & Sung Wook Baik, 2021. "Sequential Learning-Based Energy Consumption Prediction Model for Residential and Commercial Sectors," Mathematics, MDPI, vol. 9(6), pages 1-17, March.
    14. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    15. Sun, Hongchang & Niu, Yanlei & Li, Chengdong & Zhou, Changgeng & Zhai, Wenwen & Chen, Zhe & Wu, Hao & Niu, Lanqiang, 2022. "Energy consumption optimization of building air conditioning system via combining the parallel temporal convolutional neural network and adaptive opposition-learning chimp algorithm," Energy, Elsevier, vol. 259(C).
    16. Luo, X.J. & Oyedele, Lukumon O. & Ajayi, Anuoluwapo O. & Akinade, Olugbenga O. & Owolabi, Hakeem A. & Ahmed, Ashraf, 2020. "Feature extraction and genetic algorithm enhanced adaptive deep neural network for energy consumption prediction in buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 131(C).
    17. Namrye Son, 2021. "Comparison of the Deep Learning Performance for Short-Term Power Load Forecasting," Sustainability, MDPI, vol. 13(22), pages 1-25, November.
    18. Wu, Han & Liang, Yan & Heng, Jiani, 2023. "Pulse-diagnosis-inspired multi-feature extraction deep network for short-term electricity load forecasting," Applied Energy, Elsevier, vol. 339(C).
    19. Zeng, Huibin & Shao, Bilin & Dai, Hongbin & Yan, Yichuan & Tian, Ning, 2023. "Prediction of fluctuation loads based on GARCH family-CatBoost-CNNLSTM," Energy, Elsevier, vol. 263(PE).
    20. Jinyuan Liu & Shouxi Wang & Nan Wei & Yi Yang & Yihao Lv & Xu Wang & Fanhua Zeng, 2023. "An Enhancement Method Based on Long Short-Term Memory Neural Network for Short-Term Natural Gas Consumption Forecasting," Energies, MDPI, vol. 16(3), pages 1-14, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:284:y:2023:i:c:s0360544223020959. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.