IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v253y2022ics036054422201043x.html
   My bibliography  Save this article

An integrated framework based on deep learning algorithm for optimizing thermochemical production in heavy oil reservoirs

Author

Listed:
  • Zhou, Yuhao
  • Wang, Yanwei

Abstract

The development of heavy oil reservoirs with active edge and bottom water is one of the most challenging problems in petroleum engineering. In response to the limited thermal recovery of these reservoirs, a multi-phase and multi-component numerical simulation model for thermal and chemical recovery is proposed. An edge-water assisted chemical flooding (EAC flooding) is proposed, which can improve oil displacement efficiency and sweep efficiency by rational utilization of edge-water energy when compounding multi-component chemical system. Then, a deep reinforcement learning algorithm is proposed to predict dynamic production parameters and determine the optimal working system to maximize the oil recovery according to the above mathematical model. The deep reinforcement learning (DRL) model can predict the dynamic production curves according to given states with optimal strategy. At the same time, the proposed model can determine the best conversion timing from cyclic steam stimulation to EAC flooding. Finally, the DRL model can automatically obtain the optimal working system, effectively improving the oil recovery while considering the economic benefits. Thus, the DRL model can solve traditional numerical simulation's time-consuming and labor-intensive challenges and accurately give the optimal working system for developing heavy oil reservoirs with edge water in the field.

Suggested Citation

  • Zhou, Yuhao & Wang, Yanwei, 2022. "An integrated framework based on deep learning algorithm for optimizing thermochemical production in heavy oil reservoirs," Energy, Elsevier, vol. 253(C).
    • Handle: RePEc:eee:energy:v:253:y:2022:i:c:s036054422201043x
    DOI: 10.1016/j.energy.2022.124140
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S036054422201043X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2022.124140?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhang, Lisong & Li, Jing & Sun, Luning & Yang, Feiyue, 2021. "An influence mechanism of shale barrier on heavy oil recovery using SAGD based on theoretical and numerical analysis," Energy, Elsevier, vol. 216(C).
    2. Zhang, Qichen & Liu, Huiqing & Kang, Xiaodong & Liu, Yisheng & Dong, Xiaohu & Wang, Yanwei & Liu, Siyi & Li, Guangbo, 2021. "An investigation of production performance by cyclic steam stimulation using horizontal well in heavy oil reservoirs," Energy, Elsevier, vol. 218(C).
    3. Jiang, Han & Xi, Zhongli & A. Rahman, Anas & Zhang, Xiaoqing, 2020. "Prediction of output power with artificial neural network using extended datasets for Stirling engines," Applied Energy, Elsevier, vol. 271(C).
    4. Xia, Wenjie & Shen, Weijun & Yu, Li & Zheng, Chenggang & Yu, Weichu & Tang, Yongchun, 2016. "Conversion of petroleum to methane by the indigenous methanogenic consortia for oil recovery in heavy oil reservoir," Applied Energy, Elsevier, vol. 171(C), pages 646-655.
    5. Rangriz Shokri, A. & Babadagli, T., 2017. "Feasibility assessment of heavy-oil recovery by CO2 injection after cold production with sands: Lab-to-field scale modeling considering non-equilibrium foamy oil behavior," Applied Energy, Elsevier, vol. 205(C), pages 615-625.
    6. Luo, Erhui & Fan, Zifei & Hu, Yongle & Zhao, Lun & Bo, Bing & Yu, Wei & Liang, Hongwei & Liu, Minghui & Liu, Yunyang & He, Congge & Wang, Jianjun, 2020. "An efficient optimization framework of cyclic steam stimulation with experimental design in extra heavy oil reservoirs," Energy, Elsevier, vol. 192(C).
    7. Phoebe M. R. DeVries & Fernanda Viégas & Martin Wattenberg & Brendan J. Meade, 2018. "Deep learning of aftershock patterns following large earthquakes," Nature, Nature, vol. 560(7720), pages 632-634, August.
    8. Dong, Xiaohu & Liu, Huiqing & Chen, Zhangxin & Wu, Keliu & Lu, Ning & Zhang, Qichen, 2019. "Enhanced oil recovery techniques for heavy oil and oilsands reservoirs after steam injection," Applied Energy, Elsevier, vol. 239(C), pages 1190-1211.
    9. Afsar, Cansu & Akin, Serhat, 2016. "Solar generated steam injection in heavy oil reservoirs: A case study," Renewable Energy, Elsevier, vol. 91(C), pages 83-89.
    10. David Silver & Julian Schrittwieser & Karen Simonyan & Ioannis Antonoglou & Aja Huang & Arthur Guez & Thomas Hubert & Lucas Baker & Matthew Lai & Adrian Bolton & Yutian Chen & Timothy Lillicrap & Fan , 2017. "Mastering the game of Go without human knowledge," Nature, Nature, vol. 550(7676), pages 354-359, October.
    11. Li, Hao & Misra, Siddharth, 2021. "Reinforcement learning based automated history matching for improved hydrocarbon production forecast," Applied Energy, Elsevier, vol. 284(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fathy, Mohammad & Kazemzadeh Haghighi, Foojan & Ahmadi, Mohammad, 2024. "Uncertainty quantification of reservoir performance using machine learning algorithms and structured expert judgment," Energy, Elsevier, vol. 288(C).
    2. Zhang, Jun, 2023. "Performance of high temperature steam injection in horizontal wells of heavy oil reservoirs," Energy, Elsevier, vol. 282(C).
    3. Du, Shuyi & Wang, Jiulong & Wang, Meizhu & Yang, Jiaosheng & Zhang, Cong & Zhao, Yang & Song, Hongqing, 2023. "A systematic data-driven approach for production forecasting of coalbed methane incorporating deep learning and ensemble learning adapted to complex production patterns," Energy, Elsevier, vol. 263(PE).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Lisong & Li, Jing & Sun, Luning & Yang, Feiyue, 2021. "An influence mechanism of shale barrier on heavy oil recovery using SAGD based on theoretical and numerical analysis," Energy, Elsevier, vol. 216(C).
    2. Liu, Hao & Cheng, Linsong & Wu, Keliu & Huang, Shijun & Maini, Brij B., 2018. "Assessment of energy efficiency and solvent retention inside steam chamber of steam- and solvent-assisted gravity drainage process," Applied Energy, Elsevier, vol. 226(C), pages 287-299.
    3. Zehao Xie & Qihong Feng & Jiyuan Zhang & Xiaoxuan Shao & Xianmin Zhang & Zenglin Wang, 2021. "Prediction of Conformance Control Performance for Cyclic-Steam-Stimulated Horizontal Well Using the XGBoost: A Case Study in the Chunfeng Heavy Oil Reservoir," Energies, MDPI, vol. 14(23), pages 1-22, December.
    4. Matteo Picozzi & Antonio Giovanni Iaccarino, 2021. "Forecasting the Preparatory Phase of Induced Earthquakes by Recurrent Neural Network," Forecasting, MDPI, vol. 3(1), pages 1-20, January.
    5. Yuchen Zhang & Wei Yang, 2022. "Breakthrough invention and problem complexity: Evidence from a quasi‐experiment," Strategic Management Journal, Wiley Blackwell, vol. 43(12), pages 2510-2544, December.
    6. Hemmatabady, Hoofar & Welsch, Bastian & Formhals, Julian & Sass, Ingo, 2022. "AI-based enviro-economic optimization of solar-coupled and standalone geothermal systems for heating and cooling," Applied Energy, Elsevier, vol. 311(C).
    7. Daníelsson, Jón & Macrae, Robert & Uthemann, Andreas, 2022. "Artificial intelligence and systemic risk," Journal of Banking & Finance, Elsevier, vol. 140(C).
    8. Wang, Sijia & Jiang, Lanlan & Cheng, Zucheng & Liu, Yu & Zhao, Jiafei & Song, Yongchen, 2021. "Experimental study on the CO2-decane displacement front behavior in high permeability sand evaluated by magnetic resonance imaging," Energy, Elsevier, vol. 217(C).
    9. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    10. Huang, Chang & Hou, Hongjuan & Yu, Gang & Zhang, Le & Hu, Eric, 2020. "Energy solutions for producing shale oil: Characteristics of energy demand and economic analysis of energy supply options," Energy, Elsevier, vol. 192(C).
    11. Ostheimer, Julia & Chowdhury, Soumitra & Iqbal, Sarfraz, 2021. "An alliance of humans and machines for machine learning: Hybrid intelligent systems and their design principles," Technology in Society, Elsevier, vol. 66(C).
    12. Jarosław Ziółkowski & Mateusz Oszczypała & Jerzy Małachowski & Joanna Szkutnik-Rogoż, 2021. "Use of Artificial Neural Networks to Predict Fuel Consumption on the Basis of Technical Parameters of Vehicles," Energies, MDPI, vol. 14(9), pages 1-23, May.
    13. Boute, Robert N. & Gijsbrechts, Joren & van Jaarsveld, Willem & Vanvuchelen, Nathalie, 2022. "Deep reinforcement learning for inventory control: A roadmap," European Journal of Operational Research, Elsevier, vol. 298(2), pages 401-412.
    14. Qiu, Hao & Wang, Kai & Yu, Peifeng & Ni, Mingjiang & Xiao, Gang, 2021. "A third-order numerical model and transient characterization of a β-type Stirling engine," Energy, Elsevier, vol. 222(C).
    15. Omar S. Alolayan & Abdullah O. Alomar & John R. Williams, 2023. "Parallel Automatic History Matching Algorithm Using Reinforcement Learning," Energies, MDPI, vol. 16(2), pages 1-27, January.
    16. Li, Jing & Zhang, Lisong & Yang, Feiyue & Sun, Luning, 2020. "Positive measure and potential implication for heavy oil recovery of dip reservoir using SAGD based on numerical analysis," Energy, Elsevier, vol. 193(C).
    17. Mandal, Ankit & Tiwari, Yash & Panigrahi, Prasanta K. & Pal, Mayukha, 2022. "Physics aware analytics for accurate state prediction of dynamical systems," Chaos, Solitons & Fractals, Elsevier, vol. 164(C).
    18. Adnan Jafar & Alessandra Kobayati & Michael A. Tsoukas & Ahmad Haidar, 2024. "Personalized insulin dosing using reinforcement learning for high-fat meals and aerobic exercises in type 1 diabetes: a proof-of-concept trial," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    19. Anufriev, I.S. & Kopyev, E.P. & Alekseenko, S.V. & Sharypov, O.V. & Vigriyanov, M.S., 2022. "New ecology safe waste-to-energy technology of liquid fuel combustion with superheated steam," Energy, Elsevier, vol. 250(C).
    20. Elahi, Ehsan & Zhang, Zhixin & Khalid, Zainab & Xu, Haiyun, 2022. "Application of an artificial neural network to optimise energy inputs: An energy- and cost-saving strategy for commercial poultry farms," Energy, Elsevier, vol. 244(PB).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:253:y:2022:i:c:s036054422201043x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.