IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v404y2026ics0306261925018999.html

Adaptive energy scheduling strategy for port logistics systems: A dual-consolidation continual reinforcement learning approach

Author

Listed:
  • Wang, Shiyu
  • Zheng, Yujing
  • Chen, Jing
  • Li, Zhaoxiang
  • Ji, Yuxiong
  • Du, Yuchuan

Abstract

The utilization of clean energy and microgrids offers significant opportunities for the green transition of port logistics systems. However, the dual uncertainties in energy generation and consumption pose challenges for typical rule- or model-based energy scheduling methods. This study investigates the dynamic interactions among clean energy generation, energy storage, the main grid, and energy consumption within a port microgrid, and proposes a dual-consolidation continual reinforcement learning (DC-CRL) framework for adaptive energy scheduling in real time. The framework incorporates elastic weight consolidation to protect core parameters of the value function and policy distillation to regularize policy outputs, mitigating catastrophic forgetting and enhancing long-term adaptability. Meanwhile, a rolling reward window is introduced to improve decision quality by encouraging globally optimal behavior, and a dynamic action space is employed to ensure physical feasibility, allowing the agent to adjust its actions in real time according to the state of the storage device. To verify the performance of the proposed approach, we construct key baselines, including a rule-based allocation strategy and a system-optimal strategy with perfect foresight. Experimental results based on Shanghai Yangshan Port demonstrate that DC-CRL achieves a 5.90 % improvement in economic and environmental performance and a 15.0 % enhancement in convergence speed compared with the baseline methods. The case study further provides wind–solar configuration recommendations to support intelligent microgrid control and green port development.

Suggested Citation

  • Wang, Shiyu & Zheng, Yujing & Chen, Jing & Li, Zhaoxiang & Ji, Yuxiong & Du, Yuchuan, 2026. "Adaptive energy scheduling strategy for port logistics systems: A dual-consolidation continual reinforcement learning approach," Applied Energy, Elsevier, vol. 404(C).
  • Handle: RePEc:eee:appene:v:404:y:2026:i:c:s0306261925018999
    DOI: 10.1016/j.apenergy.2025.127169
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925018999
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2025.127169?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Zhang, Yue & Liang, Chengji & Shi, Jian & Lim, Gino & Wu, Yiwei, 2022. "Optimal Port Microgrid Scheduling Incorporating Onshore Power Supply and Berth Allocation Under Uncertainty," Applied Energy, Elsevier, vol. 313(C).
    2. Douglas, Christopher M. & Shanbhogue, Santosh & Ghoniem, Ahmed & Zang, Guiyan, 2025. "Well-to-wake cost and emissions assessments for the Western Australia–East Asia green shipping corridor," Applied Energy, Elsevier, vol. 384(C).
    3. Rick M A Hollen & Frans A J van den Bosch & Henk W Volberda, 2015. "Strategic levers of port authorities for industrial ecosystem development," Maritime Economics & Logistics, Palgrave Macmillan;International Association of Maritime Economists (IAME), vol. 17(1), pages 79-96, March.
    4. Jiang, Haoran & Hong, Shaozhi & Wang, Zeling & Yu, Qing, 2025. "Integrated charging scheduling and energy management for electrified-autonomous flexible transit with energy storage systems design," Applied Energy, Elsevier, vol. 392(C).
    5. K. H. Wu & J. Wu & L. Feng & B. Yang & R. Liang & S. Q. Yang & R. Zhao, 2020. "Study on Optimal Dispatching Strategy of Regional Energy Microgrid," Mathematical Problems in Engineering, Hindawi, vol. 2020, pages 1-23, October.
    6. Li, Yang & Bu, Fanjin & Li, Yuanzheng & Long, Chao, 2023. "Optimal scheduling of island integrated energy systems considering multi-uncertainties and hydrothermal simultaneous transmission: A deep reinforcement learning approach," Applied Energy, Elsevier, vol. 333(C).
    7. Li, Zhaoxiang & Ma, Xu & Pan, Ruixu & Yang, Chao & Yuan, Quan, 2025. "Explaining the dynamics and identifying potential risks of hazardous materials truck movements," Journal of Transport Geography, Elsevier, vol. 123(C).
    8. Wu, Nianyuan & Zhang, Fang & Zhang, Fuzheng & Jiang, Chenxing & Lin, Jian & Xie, Shan & Jing, Rui & Zhao, Yingru, 2024. "An integrated multi-objective optimization, evaluation, and decision-making method for ship energy system," Applied Energy, Elsevier, vol. 373(C).
    9. Zhang, Chao & Yin, Wanjun & Wen, Tao, 2024. "An advanced multi-objective collaborative scheduling strategy for large scale EV charging and discharging connected to the predictable wind power grid," Energy, Elsevier, vol. 287(C).
    10. Lv, Chaoxian & Yu, Hao & Li, Peng & Wang, Chengshan & Xu, Xiandong & Li, Shuquan & Wu, Jianzhong, 2019. "Model predictive control based robust scheduling of community integrated energy system with operational flexibility," Applied Energy, Elsevier, vol. 243(C), pages 250-265.
    11. Li, Yang & Ma, Wenjie & Li, Yuanzheng & Li, Sen & Chen, Zhe & Shahidehpour, Mohammad, 2025. "Enhancing cyber-resilience in integrated energy system scheduling with demand response using deep reinforcement learning," Applied Energy, Elsevier, vol. 379(C).
    12. Liang, Tao & Chai, Lulu & Cao, Xin & Tan, Jianxin & Jing, Yanwei & Lv, Liangnian, 2024. "Real-time optimization of large-scale hydrogen production systems using off-grid renewable energy: Scheduling strategy based on deep reinforcement learning," Renewable Energy, Elsevier, vol. 224(C).
    13. Liang, Tao & Chai, Lulu & Tan, Jianxin & Jing, Yanwei & Lv, Liangnian, 2024. "Dynamic optimization of an integrated energy system with carbon capture and power-to-gas interconnection: A deep reinforcement learning-based scheduling strategy," Applied Energy, Elsevier, vol. 367(C).
    14. Zhang, Xizheng & Wang, Zeyu & Lu, Zhangyu, 2022. "Multi-objective load dispatch for microgrid with electric vehicles using modified gravitational search and particle swarm optimization algorithm," Applied Energy, Elsevier, vol. 306(PA).
    15. Pengjun Zhao & Zhaoxiang Li & Zhangyuan He & Yilin Chen & Zuopeng Xiao, 2025. "Reducing the road freight emissions through integrated strategy in the port cities," Nature Communications, Nature, vol. 16(1), pages 1-14, December.
    16. Elgamal, M. & Korovkin, Nikolay & Abdel Menaem, A. & Elmitwally, Akram, 2022. "Day-ahead complex power scheduling in a reconfigurable hybrid-energy islanded microgrid with responsive demand considering uncertainty and different load models," Applied Energy, Elsevier, vol. 309(C).
    17. Huang, Hongxu & Liang, Rui & Lv, Chaoxian & Lu, Mengtian & Gong, Dunwei & Yin, Shulin, 2021. "Two-stage robust stochastic scheduling for energy recovery in coal mine integrated energy system," Applied Energy, Elsevier, vol. 290(C).
    18. Ruan, Jiageng & Xia, Jing & Hu, Jingjing & Wan, He & Li, Ying & Qin, Yike, 2025. "Continuous learning energy management strategy design based on EWC-DDPG for electric vehicles," Energy, Elsevier, vol. 335(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gao, Xianhui & Wang, Sheng & Sun, Ying & Zhai, Junyi & Chen, Nan & Zhang, Xiao-Ping, 2024. "Low-carbon energy scheduling for integrated energy systems considering offshore wind power hydrogen production and dynamic hydrogen doping strategy," Applied Energy, Elsevier, vol. 376(PA).
    2. Su, Kehan & Yang, Chao & Shao, Yuhao & Jiang, Dalin & Zhou, Can & Wang, Lijie & Liu, Dazheng & Zhu, Peiqi & Ding, Yi & Zheng, Chenghang & Gao, Xiang, 2025. "Accelerating multi-energy system online optimization via integer state variable prediction with operation strategy learning," Energy, Elsevier, vol. 341(C).
    3. Ren, Lina & Zhang, Kunpeng & Mehran, Kamyar & Ma, Kai, 2025. "Low-carbon economic dispatch of a hydrogen-based integrated energy system considering the coordinated operation of CHP-ORC-CSP and P2G-CCS," Energy, Elsevier, vol. 340(C).
    4. Jiankai Gao & Yang Li & Bin Wang & Haibo Wu, 2023. "Multi-Microgrid Collaborative Optimization Scheduling Using an Improved Multi-Agent Soft Actor-Critic Algorithm," Energies, MDPI, vol. 16(7), pages 1-21, April.
    5. Cui, Feifei & An, Dou & Xi, Huan & Ren, Zhigang, 2025. "Collaborative scheduling optimization of hydrogen-enhanced integrated energy system via goal-conditioned hierarchical reinforcement learning," Energy, Elsevier, vol. 338(C).
    6. Fan, Guozhu & Peng, Chunhua & Wang, Xuekui & Wu, Peng & Yang, Yifan & Sun, Huijuan, 2024. "Optimal scheduling of integrated energy system considering renewable energy uncertainties based on distributionally robust adaptive MPC," Renewable Energy, Elsevier, vol. 226(C).
    7. Han, Fengwu & Zeng, Jianfeng & Lin, Junjie & Gao, Chong & Ma, Zeyang, 2023. "A novel two-layer nested optimization method for a zero-carbon island integrated energy system, incorporating tidal current power generation," Renewable Energy, Elsevier, vol. 218(C).
    8. Li, Yang & Zhao, Bingsong & Li, Yuanzheng & Long, Chao & Li, Sen & Dong, Zhaoyang & Shahidehpour, Mohammad, 2025. "Safe-AutoSAC: AutoML-enhanced safe deep reinforcement learning for integrated energy system scheduling with multi-channel informer forecasting and electric vehicle demand response," Applied Energy, Elsevier, vol. 399(C).
    9. Wei, Ying'an & Fan, Jingjing & Meng, Qinglong & Debnath, Kumar Biswajit & Yang, Yuqin & Liu, Jiao & Lei, Yu, 2025. "EOLD: A reinforcement learning-based energy-optimised load disaggregation framework for demand-side energy management," Renewable Energy, Elsevier, vol. 252(C).
    10. Han, Chunwei & Wu, Zhimin, 2025. "Cooperative robust optimization of hydrogen integrated energy systems for economic dispatch under uncertainty with bidirectional power conversion and progressive stepwise carbon emission trading mechanisms," Energy, Elsevier, vol. 335(C).
    11. Cheng, Hangyu & Chen, Jiahui & Jung, Seunghun & Kim, Young-Bae, 2025. "Hierarchical rolling optimization strategy for hybrid electric-hydrogen system based on deep reinforcement learning," Energy, Elsevier, vol. 338(C).
    12. Yin, Linfei & Xiong, Yi, 2024. "Incremental learning user profile and deep reinforcement learning for managing building energy in heating water," Energy, Elsevier, vol. 313(C).
    13. Paulo M. De Oliveira-De Jesus & Jose M. Yusta, 2024. "Optimal Power Dispatch for Maximum Energy Community Welfare by Considering Closed Distribution Systems and Renewable Sources," Energies, MDPI, vol. 17(18), pages 1-21, September.
    14. Zhou, Xizhen & Meng, Qiang & Ji, Yanjie, 2025. "Optimal charging schedules for EV charging stations considering hybrid smart and uncontrolled charging: A scalable framework," Applied Energy, Elsevier, vol. 398(C).
    15. Xu, Jing & Wang, Xiaoying & Gu, Yujiong & Ma, Suxia, 2023. "A data-based day-ahead scheduling optimization approach for regional integrated energy systems with varying operating conditions," Energy, Elsevier, vol. 283(C).
    16. Wang, Jinggai & Li, Huanhuan & Yang, Zaili & Ge, Ying-En, 2024. "Shore power for reduction of shipping emission in port: A bibliometric analysis," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 188(C).
    17. Zhao, Jing & Yang, Zilan & Shi, Linyu & Liu, Dehan & Li, Haonan & Mi, Yumiao & Wang, Hongbin & Feng, Meili & Hutagaol, Timothy Joseph, 2024. "Photovoltaic capacity dynamic tracking model predictive control strategy of air-conditioning systems with consideration of flexible loads," Applied Energy, Elsevier, vol. 356(C).
    18. Vasilikis, Nikolaos & Geertsma, Rinze & Coraddu, Andrea, 2025. "A multi-objective optimisation framework for the design of ship energy systems under operational and environmental uncertainty," Applied Energy, Elsevier, vol. 402(PA).
    19. Tan, Bifei & Lin, Zhenjia & Zheng, Xiaodong & Xiao, Fu & Wu, Qiuwei & Yan, Jinyue, 2023. "Distributionally robust energy management for multi-microgrids with grid-interactive EVs considering the multi-period coupling effect of user behaviors," Applied Energy, Elsevier, vol. 350(C).
    20. Shi, Jie & Wang, Luhao & Lee, Wei-Jen & Cheng, Xingong & Zong, Xiju, 2019. "Hybrid Energy Storage System (HESS) optimization enabling very short-term wind power generation scheduling based on output feature extraction," Applied Energy, Elsevier, vol. 256(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:404:y:2026:i:c:s0306261925018999. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.