IDEAS home Printed from https://ideas.repec.org/a/eee/matcom/v247y2026icp110-136.html

Dynamic path planning for certain mobile robots in the 3D rough terrain: Fusion of the Q-learning enhanced MOPSO and improved DWA

Author

Listed:
  • Duan, Zhaoxia
  • Zhang, Yi
  • Zhao, Qian
  • Qin, Qian
  • Xiang, Zhengrong

Abstract

Targeting the standard particle swarm optimization (PSO) approach that tends to converge to the local optimum and struggles to solve the path planning problem in dynamic environments, a novel hybrid path planning algorithm is proposed for mobile robots operating in intricate 3D terrain, which is a fusion algorithm called MOQLPSO-ADWA, combining the Q-learning (QL) based multi-objective particle swarm optimization (MOPSO) and the adaptive dynamic window approach (ADWA). Firstly, QL is introduced into MOPSO to update the inertia weights and acceleration parameters of the MOPSO online to improve the ability of the current particles to converge to the Pareto front. Secondly, the crossover operator is introduced to increase the explorability and diversity of the population during the iteration process. Thirdly, the obstacle avoidance strategy in DWA is modified where the weighting coefficients of the dynamic window evaluation function of the DWA algorithm are dynamically designed based on global optimization, and adjusted according to the information of targets and obstacles, to improve the adaptive ability of mobile robots to different environments. After that, the planned path points of the MOQLPSO algorithm are extracted as the temporary target points of the ADWA algorithm, and the fusion of MOQLPSO and ADWA algorithms is realized on the basis of the global optimum. The fusion algorithm is confirmed to be able to successfully avoid obstacles and achieve a significant improvement in planning efficiency and path safety through the comparison of simulation results, which is more in line with the motion characteristics of mobile robots. Both the problem and the obtained results exhibit significant nonlinear characteristics, which play a crucial role in the complexity of the search space and the diversity of solutions.

Suggested Citation

  • Duan, Zhaoxia & Zhang, Yi & Zhao, Qian & Qin, Qian & Xiang, Zhengrong, 2026. "Dynamic path planning for certain mobile robots in the 3D rough terrain: Fusion of the Q-learning enhanced MOPSO and improved DWA," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 247(C), pages 110-136.
    • Handle: RePEc:eee:matcom:v:247:y:2026:i:c:p:110-136
    DOI: 10.1016/j.matcom.2026.03.018
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S037847542600100X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.matcom.2026.03.018?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Sedighizadeh, Davoud & Masehian, Ellips & Sedighizadeh, Mostafa & Akbaripour, Hossein, 2021. "GEPSO: A new generalized particle swarm optimization algorithm," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 179(C), pages 194-212.
    2. Yan, Zheping & Yan, Jinyu & Wu, Yifan & Cai, Sijia & Wang, Hongxing, 2023. "A novel reinforcement learning based tuna swarm optimization algorithm for autonomous underwater vehicle path planning," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 209(C), pages 55-86.
    3. Zhang, Hongkang & Huang, Shao-Lun, 2025. "Improved fuzzy C-means clustering algorithm based on fuzzy particle swarm optimization for solving data clustering problems," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 233(C), pages 311-329.
    4. Akay, Rustu & Yildirim, Mustafa Yusuf, 2025. "SBA*: An efficient method for 3D path planning of unmanned vehicles," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 231(C), pages 294-317.
    5. Gautam Reddy & Jerome Wong-Ng & Antonio Celani & Terrence J. Sejnowski & Massimo Vergassola, 2018. "Glider soaring via reinforcement learning in the field," Nature, Nature, vol. 562(7726), pages 236-239, October.
    6. Yang, Xu & Li, Hongru, 2023. "Multi-sample learning particle swarm optimization with adaptive crossover operation," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 208(C), pages 246-282.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kezong Tang & Xiong-Fei Wei & Yuan-Hao Jiang & Zi-Wei Chen & Lihua Yang, 2023. "An Adaptive Ant Colony Optimization for Solving Large-Scale Traveling Salesman Problem," Mathematics, MDPI, vol. 11(21), pages 1-26, October.
    2. González-Parra, Gilberto & Villanueva-Oller, Javier & Navarro-González, F.J. & Ceberio, Josu & Luebben, Giulia, 2024. "A network-based model to assess vaccination strategies for the COVID-19 pandemic by using Bayesian optimization," Chaos, Solitons & Fractals, Elsevier, vol. 181(C).
    3. Yu Chang & Dengxu He & Liangdong Qu, 2024. "An improved tuna swarm optimization algorithm based on behavior evaluation for wireless sensor network coverage optimization," Telecommunication Systems: Modelling, Analysis, Design and Management, Springer, vol. 86(4), pages 829-851, August.
    4. Yang, Hong & Lai, Minyang & Li, Guohui, 2025. "Novel underwater acoustic signal denoising: Combined optimization secondary decomposition coupled with original component processing algorithms," Chaos, Solitons & Fractals, Elsevier, vol. 193(C).
    5. Haina Jiang & Haijun Li & Guoxing Cai, 2025. "Design and Development of an Intelligent Robotic Feeding Control System for Sheep," Agriculture, MDPI, vol. 15(18), pages 1-20, September.
    6. Sun, Sanya & Shao, Zhuang & Xu, Xiaoping & Zhou, Zhou, 2026. "Enhancing UAV endurance: coupled optimization of dynamic soaring trajectory and high-fidelity powertrain energy management," Applied Energy, Elsevier, vol. 416(C).
    7. Joshua D. McGraw & Donsuk Lee & Justin N. Wood, 2024. "Parallel development of social behavior in biological and artificial fish," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    8. Owen M. Nyandieka & Davies R. Segera, 2023. "A Chaotic Multi‐Objective Runge–Kutta Optimization Algorithm for Optimized Circuit Design," Mathematical Problems in Engineering, John Wiley & Sons, vol. 2023(1).
    9. Abd-Elhaleem, Sameh & Shoeib, Walaa & Sobaih, Abdel Azim, 2023. "A new power management strategy for plug-in hybrid electric vehicles based on an intelligent controller integrated with CIGPSO algorithm," Energy, Elsevier, vol. 265(C).
    10. Chou, Jui-Sheng & Pham, Tran-Bao-Quyen, 2026. "Advancing hierarchical optimization: A-Cubed algorithm for adaptive agent collaboration," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 240(C), pages 1041-1070.
    11. Pan, Jeng-Shyang & Zhang, Zhen & Chu, Shu-Chuan & Zhang, Si-Qi & Wu, Jimmy Ming-Tai, 2024. "A parallel compact Marine Predators Algorithm applied in time series prediction of Backpropagation neural network (BNN) and engineering optimization," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 220(C), pages 65-88.
    12. Yang, Xu & Li, Hongru, 2023. "Multi-sample learning particle swarm optimization with adaptive crossover operation," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 208(C), pages 246-282.
    13. Martín Montes Rivera & Carlos Guerrero-Mendez & Daniela Lopez-Betancur & Tonatiuh Saucedo-Anaya, 2024. "Dynamical Sphere Regrouping Particle Swarm Optimization Programming: An Automatic Programming Algorithm Avoiding Premature Convergence," Mathematics, MDPI, vol. 12(19), pages 1-53, September.
    14. Yoav Flato & Roi Harel & Aviv Tamar & Ran Nathan & Tsevi Beatus, 2024. "Revealing principles of autonomous thermal soaring in windy conditions using vulture-inspired deep reinforcement-learning," Nature Communications, Nature, vol. 15(1), pages 1-14, December.
    15. Yusheng Jiao & Haotian Hang & Josh Merel & Eva Kanso, 2025. "Sensing flow gradients is necessary for learning autonomous underwater navigation," Nature Communications, Nature, vol. 16(1), pages 1-15, December.
    16. Martín Montes Rivera & Carlos Guerrero-Mendez & Daniela Lopez-Betancur & Tonatiuh Saucedo-Anaya, 2023. "Dynamical Sphere Regrouping Particle Swarm Optimization: A Proposed Algorithm for Dealing with PSO Premature Convergence in Large-Scale Global Optimization," Mathematics, MDPI, vol. 11(20), pages 1-40, October.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:matcom:v:247:y:2026:i:c:p:110-136. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/mathematics-and-computers-in-simulation/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.