IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v325y2025ics0360544225018158.html

Research on multi-objective optimization control of diesel engine combustion process based on model predictive control-guided reinforcement learning method

Author

Listed:
  • Chen, Ziqiang
  • Ju, Peng
  • Wang, Zhe
  • Shi, Lei
  • Deng, Kangyao

Abstract

As environmental protection regulations become increasingly stringent, traditional control strategies for diesel engines often struggle to simultaneously satisfy real-time performance, fuel economy, and low emission requirements during transient processes. Consequently, this study presents a multi-objective real-time optimization control method that integrates model predictive control (MPC) with reinforcement learning (RL) to regulate rail pressure and injection timing for the synergistic optimization of nitrogen oxide (NOx) emissions and indicated mean effective pressure (IMEP). The results indicate that while the MPC algorithm demonstrates strong performance in short-term optimization during simulation validation, its reliance on limited short-term predictions leads to substantial fluctuations in control parameters. Conversely, the RL algorithm exhibits superior synergistic optimization capabilities, however, it suffers from poor training stability. After incorporating superior samples from the MPC to inform RL training, both stability and training efficiency were significantly enhanced, resulting in a NOx emission reduction of 31.4 %, which markedly surpasses the 19.25 % improvement achieved by the MPC alone. Furthermore, the RL algorithm demonstrated higher real-time computational efficiency. In experimental validation, compared to the original control map settings, the MPC-guided RL algorithm reduced NOx emissions by 16 % and increased IMEP by 0.32 %, thereby achieving multi-objective real-time optimization of the diesel engine combustion process.

Suggested Citation

  • Chen, Ziqiang & Ju, Peng & Wang, Zhe & Shi, Lei & Deng, Kangyao, 2025. "Research on multi-objective optimization control of diesel engine combustion process based on model predictive control-guided reinforcement learning method," Energy, Elsevier, vol. 325(C).
  • Handle: RePEc:eee:energy:v:325:y:2025:i:c:s0360544225018158
    DOI: 10.1016/j.energy.2025.136173
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225018158
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.136173?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Wenyu Gu & Wanhua Su, 2023. "Study on the Effects of Exhaust Gas Recirculation and Fuel Injection Strategy on Transient Process Performance of Diesel Engines," Sustainability, MDPI, vol. 15(16), pages 1-21, August.
    2. Zhongchang Liu & Xing Yuan & Jing Tian & Yongqiang Han & Runzhao Li & Guanlong Gao, 2018. "Investigation of Sectional-Stage Loading Strategies on a Two-Stage Turbocharged Heavy-Duty Diesel Engine under Transient Operation with EGR," Energies, MDPI, vol. 11(1), pages 1-19, January.
    3. Ma, Yinjie & Zhao, Yuanhao & Yang, Dong & E, Jiaqiang & Zhao, Jialuo & Pan, Mingzhang, 2024. "Parametric study of combustion characteristics of diesel/methanol dual fuel engine using global sensitivity analysis and multi-objective optimization," Renewable Energy, Elsevier, vol. 237(PB).
    4. Arroyo, Javier & Manna, Carlo & Spiessens, Fred & Helsen, Lieve, 2022. "Reinforced model predictive control (RL-MPC) for building energy management," Applied Energy, Elsevier, vol. 309(C).
    5. Hall, Carrie & Kassa, Mateos, 2021. "Advances in combustion control for natural gas–diesel dual fuel compression ignition engines in automotive applications: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 148(C).
    6. Dong, Pengbo & Liu, Kunlong & Zhang, Lenan & Zhang, Zhenxian & Long, Wuqiang & Tian, Hua, 2024. "Study on the synergistic control of nitrogenous emissions and greenhouse gas of ammonia/diesel dual direct injection two-stroke engine," Energy, Elsevier, vol. 307(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liu, Long & Liu, Haoyu & Jiao, Huichao & Liu, Dai & Xue, Ranran & Liu, Xiao & Wang, Xin & Wang, Zhanguang & Mu, Hongyu & Wang, Huaiyu & Wu, Yunke, 2026. "Data-driven based ignition strategy optimization for hydrogen rotary engines," Energy, Elsevier, vol. 343(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guo, Zelin & Li, Yiyan & Ping, Jian & Zhu, Jiayi & Yan, Zheng & Chow, Mo-Yuen, 2026. "A self-adaptive modeling and control framework for HVAC systems considering user stochasticity," Applied Energy, Elsevier, vol. 409(C).
    2. Li, Tao & Wang, Chunguang & Chen, Zhanming & Luo, Ding & Chen, Hao, 2025. "A numerical and experimental study of the spray and combustion characteristics of a diesel and ammonia dual-fuel engine with direct injection," Energy, Elsevier, vol. 338(C).
    3. Zhao, Jing & Yang, Zilan & Shi, Linyu & Liu, Dehan & Li, Haonan & Mi, Yumiao & Wang, Hongbin & Feng, Meili & Hutagaol, Timothy Joseph, 2024. "Photovoltaic capacity dynamic tracking model predictive control strategy of air-conditioning systems with consideration of flexible loads," Applied Energy, Elsevier, vol. 356(C).
    4. Lee, Jeongwoo & Park, Cheolwoong & Jang, Ilpum & Kim, Minki & Park, Gyeongtae & Kim, Yongrae, 2025. "Experimental research on the effect of diesel post-injection conditions on the efficiency and global warming potential in a single-cylinder four-stroke marine engine fueled with ammonia and diesel," Energy, Elsevier, vol. 314(C).
    5. Cui, Jingchen & Chen, Weize & Liu, Shuo & Sun, Xilei & Wang, Yang & Long, Wuqiang & Tian, Hua & Yang, Yong, 2026. "Controlling environmental adaptability in marine engines: The coupling effects of injector position, injection timing, and intake temperature under low-load, high-ammonia conditions," Energy, Elsevier, vol. 346(C).
    6. Nweye, Kingsley & Sankaranarayanan, Siva & Nagy, Zoltan, 2023. "MERLIN: Multi-agent offline and transfer learning for occupant-centric operation of grid-interactive communities," Applied Energy, Elsevier, vol. 346(C).
    7. Luna, José Diogo Forte de Oliveira & Naspolini, Amir & Reis, Guilherme Nascimento Gouvêa dos & Mendes, Paulo Renato da Costa & Normey-Rico, Julio Elias, 2024. "A novel joint energy and demand management system for smart houses based on model predictive control, hybrid storage system and quality of experience concepts," Applied Energy, Elsevier, vol. 369(C).
    8. Chen, Zhanming & Zhao, Pengyun & Wang, Xiaochen & He, Haibin & Wu, Jie & Chen, Hao, 2026. "An optical study the spray and combustion characteristics of green and renewable ammonia with diesel pilot ignition under dual direct injection," Renewable Energy, Elsevier, vol. 256(PG).
    9. Tian, Xiaoyu & Zhang, Hanwen & Liu, Lin & Huang, Jiahao & Liu, Liru & Liu, Jing, 2024. "Establishment of LCZ-based urban building energy consumption dataset in hot and humid subtropical regions through a bottom-up method," Applied Energy, Elsevier, vol. 368(C).
    10. Siwei Li & Congxiang Tian & Ahmed N. Abdalla, 2025. "Energy Regulation-Aware Layered Control Architecture for Building Energy Systems Using Constraint-Aware Deep Reinforcement Learning and Virtual Energy Storage Modeling," Energies, MDPI, vol. 18(17), pages 1-23, September.
    11. Avisek Naug & Marcos Quinones-Grueiro & Gautam Biswas, 2025. "An End-to-End Relearning Framework for Building Energy Optimization," Energies, MDPI, vol. 18(6), pages 1-23, March.
    12. Jacobs, Stef & Ghane, Sara & Houben, Pieter Jan & Kabbara, Zakarya & Huybrechts, Thomas & Hellinckx, Peter & Verhaert, Ivan, 2025. "Improving the learning process of deep reinforcement learning agents operating in collective heating environments," Applied Energy, Elsevier, vol. 384(C).
    13. Gao, Yuan & Hu, Zehuan & Yamate, Shun & Otomo, Junichiro & Chen, Wei-An & Liu, Mingzhe & Xu, Tingting & Ruan, Yingjun & Shang, Juan, 2025. "Unlocking predictive insights and interpretability in deep reinforcement learning for Building-Integrated Photovoltaic and Battery (BIPVB) systems," Applied Energy, Elsevier, vol. 384(C).
    14. Fu, Yangyang & Xu, Shichao & Zhu, Qi & O’Neill, Zheng & Adetola, Veronica, 2023. "How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system," Energy, Elsevier, vol. 273(C).
    15. Lanxin Li & Wenhui Pei & Qi Zhang, 2025. "Research on Intelligent Vehicle Tracking Control and Energy Consumption Optimization Based on Dilated Convolutional Model Predictive Control," Energies, MDPI, vol. 18(10), pages 1-22, May.
    16. Wang, Xuezheng & Dong, Bing, 2024. "Long-term experimental evaluation and comparison of advanced controls for HVAC systems," Applied Energy, Elsevier, vol. 371(C).
    17. Rezapour, Mojtaba & Deymi-Dashtebayaz, Mahdi, 2025. "Numerical optimization of natural gas composition effects on dual-fuel diesel engine performance and emissions," Energy, Elsevier, vol. 322(C).
    18. Pinto, G.M. & da Costa, R.B.R. & de Souza, T.A.Z. & Rosa, A.J.A.C. & Raats, O.O. & Roque, L.F.A. & Frez, G.V. & Coronado, C.J.R., 2023. "Experimental investigation of performance and emissions of a CI engine operating with HVO and farnesane in dual-fuel mode with natural gas and biogas," Energy, Elsevier, vol. 277(C).
    19. Wenyu Gu & Wanhua Su, 2023. "Study on the Effects of Exhaust Gas Recirculation and Fuel Injection Strategy on Transient Process Performance of Diesel Engines," Sustainability, MDPI, vol. 15(16), pages 1-21, August.
    20. Davide Fop & Ali Reza Yaghoubi & Alfonso Capozzoli, 2024. "Validation of a Model Predictive Control Strategy on a High Fidelity Building Emulator," Energies, MDPI, vol. 17(20), pages 1-20, October.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:325:y:2025:i:c:s0360544225018158. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.