IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v325y2025ics0360544225018158.html
   My bibliography  Save this article

Research on multi-objective optimization control of diesel engine combustion process based on model predictive control-guided reinforcement learning method

Author

Listed:
  • Chen, Ziqiang
  • Ju, Peng
  • Wang, Zhe
  • Shi, Lei
  • Deng, Kangyao

Abstract

As environmental protection regulations become increasingly stringent, traditional control strategies for diesel engines often struggle to simultaneously satisfy real-time performance, fuel economy, and low emission requirements during transient processes. Consequently, this study presents a multi-objective real-time optimization control method that integrates model predictive control (MPC) with reinforcement learning (RL) to regulate rail pressure and injection timing for the synergistic optimization of nitrogen oxide (NOx) emissions and indicated mean effective pressure (IMEP). The results indicate that while the MPC algorithm demonstrates strong performance in short-term optimization during simulation validation, its reliance on limited short-term predictions leads to substantial fluctuations in control parameters. Conversely, the RL algorithm exhibits superior synergistic optimization capabilities, however, it suffers from poor training stability. After incorporating superior samples from the MPC to inform RL training, both stability and training efficiency were significantly enhanced, resulting in a NOx emission reduction of 31.4 %, which markedly surpasses the 19.25 % improvement achieved by the MPC alone. Furthermore, the RL algorithm demonstrated higher real-time computational efficiency. In experimental validation, compared to the original control map settings, the MPC-guided RL algorithm reduced NOx emissions by 16 % and increased IMEP by 0.32 %, thereby achieving multi-objective real-time optimization of the diesel engine combustion process.

Suggested Citation

  • Chen, Ziqiang & Ju, Peng & Wang, Zhe & Shi, Lei & Deng, Kangyao, 2025. "Research on multi-objective optimization control of diesel engine combustion process based on model predictive control-guided reinforcement learning method," Energy, Elsevier, vol. 325(C).
  • Handle: RePEc:eee:energy:v:325:y:2025:i:c:s0360544225018158
    DOI: 10.1016/j.energy.2025.136173
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225018158
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.136173?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Wenyu Gu & Wanhua Su, 2023. "Study on the Effects of Exhaust Gas Recirculation and Fuel Injection Strategy on Transient Process Performance of Diesel Engines," Sustainability, MDPI, vol. 15(16), pages 1-21, August.
    2. Dong, Pengbo & Liu, Kunlong & Zhang, Lenan & Zhang, Zhenxian & Long, Wuqiang & Tian, Hua, 2024. "Study on the synergistic control of nitrogenous emissions and greenhouse gas of ammonia/diesel dual direct injection two-stroke engine," Energy, Elsevier, vol. 307(C).
    3. Zhongchang Liu & Xing Yuan & Jing Tian & Yongqiang Han & Runzhao Li & Guanlong Gao, 2018. "Investigation of Sectional-Stage Loading Strategies on a Two-Stage Turbocharged Heavy-Duty Diesel Engine under Transient Operation with EGR," Energies, MDPI, vol. 11(1), pages 1-19, January.
    4. Ma, Yinjie & Zhao, Yuanhao & Yang, Dong & E, Jiaqiang & Zhao, Jialuo & Pan, Mingzhang, 2024. "Parametric study of combustion characteristics of diesel/methanol dual fuel engine using global sensitivity analysis and multi-objective optimization," Renewable Energy, Elsevier, vol. 237(PB).
    5. Hall, Carrie & Kassa, Mateos, 2021. "Advances in combustion control for natural gas–diesel dual fuel compression ignition engines in automotive applications: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 148(C).
    6. Arroyo, Javier & Manna, Carlo & Spiessens, Fred & Helsen, Lieve, 2022. "Reinforced model predictive control (RL-MPC) for building energy management," Applied Energy, Elsevier, vol. 309(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nweye, Kingsley & Sankaranarayanan, Siva & Nagy, Zoltan, 2023. "MERLIN: Multi-agent offline and transfer learning for occupant-centric operation of grid-interactive communities," Applied Energy, Elsevier, vol. 346(C).
    2. Jacobs, Stef & Ghane, Sara & Houben, Pieter Jan & Kabbara, Zakarya & Huybrechts, Thomas & Hellinckx, Peter & Verhaert, Ivan, 2025. "Improving the learning process of deep reinforcement learning agents operating in collective heating environments," Applied Energy, Elsevier, vol. 384(C).
    3. Fu, Yangyang & Xu, Shichao & Zhu, Qi & O’Neill, Zheng & Adetola, Veronica, 2023. "How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system," Energy, Elsevier, vol. 273(C).
    4. Wang, Xuezheng & Dong, Bing, 2024. "Long-term experimental evaluation and comparison of advanced controls for HVAC systems," Applied Energy, Elsevier, vol. 371(C).
    5. Pinto, G.M. & da Costa, R.B.R. & de Souza, T.A.Z. & Rosa, A.J.A.C. & Raats, O.O. & Roque, L.F.A. & Frez, G.V. & Coronado, C.J.R., 2023. "Experimental investigation of performance and emissions of a CI engine operating with HVO and farnesane in dual-fuel mode with natural gas and biogas," Energy, Elsevier, vol. 277(C).
    6. Wenyu Gu & Wanhua Su, 2023. "Study on the Effects of Exhaust Gas Recirculation and Fuel Injection Strategy on Transient Process Performance of Diesel Engines," Sustainability, MDPI, vol. 15(16), pages 1-21, August.
    7. Zhou, Xinlei & Xue, Shan & Du, Han & Ma, Zhenjun, 2023. "Optimization of building demand flexibility using reinforcement learning and rule-based expert systems," Applied Energy, Elsevier, vol. 350(C).
    8. Siran Tian & Lina Zhang & Yi Wang & Haozhong Huang, 2025. "Impact of Post-Injection Strategies on Combustion and Emissions in a CTL–Ammonia Dual-Fuel Engine," Energies, MDPI, vol. 18(12), pages 1-22, June.
    9. Wang, Hao & Chen, Xiwen & Vital, Natan & Duffy, Edward & Razi, Abolfazl, 2024. "Energy optimization for HVAC systems in multi-VAV open offices: A deep reinforcement learning approach," Applied Energy, Elsevier, vol. 356(C).
    10. Amal Azzi & Mohamed Tabaa & Badr Chegari & Hanaa Hachimi, 2024. "Balancing Sustainability and Comfort: A Holistic Study of Building Control Strategies That Meet the Global Standards for Efficiency and Thermal Comfort," Sustainability, MDPI, vol. 16(5), pages 1-36, March.
    11. Tian, Erlin & Lv, Guoning & Li, Zuhe, 2024. "Evaluation of emission of the hydrogen-enriched diesel engine through machine learning," Energy, Elsevier, vol. 307(C).
    12. Li, Yuqiang & Huang, Long & Chen, Yong & Tang, Wei, 2024. "Design and optimization of combustion chamber geometry and fuel spray targeting of a natural gas/biodiesel dual direct injection engine," Energy, Elsevier, vol. 311(C).
    13. Mbungu, Nsilulu T. & Siti, Mukwanga W. & Bansal, Ramesh C. & Naidoo, Raj M. & Elnady, A. & Ismail, Ali A. Adam & Abokhali, Ahmed G. & Hamid, Abdul-Kadir, 2025. "A dynamic coordination of microgrids," Applied Energy, Elsevier, vol. 377(PD).
    14. Wang, Xiaoyu & Jia, Hongjie & Jin, Xiaolong & Mu, Yunfei & Wei, Wei & Yu, Xiaodan & Liang, Shuo, 2024. "Bi-level optimal operations for grid operator and low-carbon building prosumers with peer-to-peer energy sharing," Applied Energy, Elsevier, vol. 359(C).
    15. Wu, Yue & Liu, Long & Wang, Lifeng & Wu, Jie, 2025. "Investigation of performance and emission characteristics in natural gas dual fuel marine engines with a novel Burned Zone Ammonia Combustion strategy," Energy, Elsevier, vol. 324(C).
    16. Wang, Zixuan & Xiao, Fu & Ran, Yi & Li, Yanxue & Xu, Yang, 2024. "Scalable energy management approach of residential hybrid energy system using multi-agent deep reinforcement learning," Applied Energy, Elsevier, vol. 367(C).
    17. Panagiotis Michailidis & Iakovos Michailidis & Socratis Gkelios & Elias Kosmatopoulos, 2024. "Artificial Neural Network Applications for Energy Management in Buildings: Current Trends and Future Directions," Energies, MDPI, vol. 17(3), pages 1-47, January.
    18. Zhijian Wang & Shijin Shuai & Zhijie Li & Wenbin Yu, 2021. "A Review of Energy Loss Reduction Technologies for Internal Combustion Engines to Improve Brake Thermal Efficiency," Energies, MDPI, vol. 14(20), pages 1-18, October.
    19. Zhang, Yan & Wu, Dawei & Nadimi, Ebrahim & Tsolakis, Athanasios & Przybyla, Grzegorz & Adamczyk, Wojciech, 2025. "Genetic algorithm-assisted multi-objective optimization for developing a Multi-Wiebe Combustion model in ammonia-diesel dual fuel engines," Energy, Elsevier, vol. 325(C).
    20. Sun, Luning & Hu, Zehuan & Mae, Masayuki & Imaizumi, Taiji, 2025. "Deep transfer learning strategy based on TimesBlock-CDAN for predicting thermal environment and air conditioner energy consumption in residential buildings," Applied Energy, Elsevier, vol. 381(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:325:y:2025:i:c:s0360544225018158. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.