IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v415y2026ics0306261926005180.html

Energy-efficient real-time workflow scheduling in edge–cloud environments based on multi-agent reinforcement learning

Author

Listed:
  • Wen, Mengyao
  • Ning, Xin
  • Pu, Mengyang
  • Liu, Cong
  • Wang, Qingle
  • Chen, Xiaomin
  • Cheng, Long

Abstract

With the widespread deployment of Internet of Things devices, the complexity of resource-intensive workloads and the associated pressures on energy consumption are steadily increasing. This trend necessitates an efficient workflow scheduling mechanism between edge nodes and the central cloud to strike a dynamic balance between low latency and low energy consumption. Traditional heuristic or meta-heuristic-based scheduling methods struggle to address the challenges posed by dynamic environments and high computational complexity. To tackle these challenges, we propose MAES, a novel real-time workflow scheduling method based on Multi-Agent Deep Reinforcement Learning for edge-cloud collaborative computing environments. MAES adopts a multi-agent system architecture, where each virtual machine acts as an agent, optimizing workflow allocation through a collaborative approach of centralized training and decentralized execution. Experimental evaluations using real scientific workflows were conducted across different scenarios, including varying task numbers and types, workflow arrival intervals, edge-cloud VM ratios, and network jitter. Specifically, MAES reduces average latency and cost, while significantly lowering total system energy consumption, providing a highly energy-efficient solution for workflow scheduling in edge-cloud collaborative environments.

Suggested Citation

  • Wen, Mengyao & Ning, Xin & Pu, Mengyang & Liu, Cong & Wang, Qingle & Chen, Xiaomin & Cheng, Long, 2026. "Energy-efficient real-time workflow scheduling in edge–cloud environments based on multi-agent reinforcement learning," Applied Energy, Elsevier, vol. 415(C).
  • Handle: RePEc:eee:appene:v:415:y:2026:i:c:s0306261926005180
    DOI: 10.1016/j.apenergy.2026.127866
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261926005180
    Download Restriction: Full text may be restricted for ScienceDirect subscribers

    File URL: https://libkey.io/10.1016/j.apenergy.2026.127866?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Hui, Hongxun & Ding, Yi & Shi, Qingxin & Li, Fangxing & Song, Yonghua & Yan, Jinyue, 2020. "5G network-based Internet of Things for demand response in smart grid: A survey on application potential," Applied Energy, Elsevier, vol. 257(C).
    2. Guo, Fangzhou & Ham, Sang woo & Kim, Donghun & Moon, Hyeun Jun, 2025. "Deep reinforcement learning control for co-optimizing energy consumption, thermal comfort, and indoor air quality in an office building," Applied Energy, Elsevier, vol. 377(PA).
    3. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    4. Xia, Qinqin & Wang, Yu & Zou, Yao & Yan, Ziming & Zhou, Niancheng & Chi, Yuan & Wang, Qianggang, 2024. "Regional-privacy-preserving operation of networked microgrids: Edge-cloud cooperative learning with differentiated policies," Applied Energy, Elsevier, vol. 370(C).
    5. Rajeev, T. & Ashok, S., 2015. "Dynamic load-shifting program based on a cloud computing framework to support the integration of renewable energy sources," Applied Energy, Elsevier, vol. 146(C), pages 141-149.
    6. Ma, Liya & Hui, Hongxun & Wang, Sheng & Song, Yonghua, 2024. "Coordinated optimization of power-communication coupling networks for dispatching large-scale flexible loads to provide operating reserve," Applied Energy, Elsevier, vol. 359(C).
    7. Ying Ji & Jianhui Wang & Jiacan Xu & Donglin Li, 2021. "Data-Driven Online Energy Scheduling of a Microgrid Based on Deep Reinforcement Learning," Energies, MDPI, vol. 14(8), pages 1-19, April.
    8. Hui, Hongxun & Ding, Yi & Song, Yonghua & Rahman, Saifur, 2019. "Modeling and control of flexible loads for frequency regulation services considering compensation of communication latency and detection error," Applied Energy, Elsevier, vol. 250(C), pages 161-174.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hui, Hongxun & Ding, Yi & Song, Yonghua, 2020. "Adaptive time-delay control of flexible loads in power systems facing accidental outages," Applied Energy, Elsevier, vol. 275(C).
    2. Lyu, Wenjing & Liu, Jin, 2021. "Artificial Intelligence and emerging digital technologies in the energy sector," Applied Energy, Elsevier, vol. 303(C).
    3. Qiu, Dawei & Wang, Yi & Sun, Mingyang & Strbac, Goran, 2022. "Multi-service provision for electric vehicles in power-transportation networks towards a low-carbon transition: A hierarchical and hybrid multi-agent reinforcement learning approach," Applied Energy, Elsevier, vol. 313(C).
    4. Razzak, Abdur & Islam, Md. Tariqul & Roy, Palash & Razzaque, Md. Abdur & Hassan, Md. Rafiul & Hassan, Mohammad Mehedi, 2024. "Leveraging Deep Q-Learning to maximize consumer quality of experience in smart grid," Energy, Elsevier, vol. 290(C).
    5. Hongxin Yu & Lihui Zhang & Meng Zhang & Fengyue Jin & Yibing Wang, 2024. "Coordinated Ramp Metering Considering the Dynamics of Mixed-Autonomy Traffic," Sustainability, MDPI, vol. 16(22), pages 1-26, November.
    6. Daniel Russo, 2023. "Approximation Benefits of Policy Gradient Methods with Aggregated States," Management Science, INFORMS, vol. 69(11), pages 6898-6911, November.
    7. Tulika Saha & Sriparna Saha & Pushpak Bhattacharyya, 2020. "Towards sentiment aided dialogue policy learning for multi-intent conversations using hierarchical reinforcement learning," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-28, July.
    8. Ma, Liya & Hui, Hongxun & Wang, Sheng & Song, Yonghua, 2024. "Coordinated optimization of power-communication coupling networks for dispatching large-scale flexible loads to provide operating reserve," Applied Energy, Elsevier, vol. 359(C).
    9. Hamid Ebrahimi, 2026. "A Novel Evidential Uncertainty Framework for Hybrid Models in Rainfall Simulation," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 40(2), pages 1-24, January.
    10. Hu, Maomao & Xiao, Fu & Wang, Lingshi, 2017. "Investigation of demand response potentials of residential air conditioners in smart grids using grey-box room thermal model," Applied Energy, Elsevier, vol. 207(C), pages 324-335.
    11. Shan, Kui & Wang, Shengwei & Zhuang, Chaoqun, 2021. "Controlling a large constant speed centrifugal chiller to provide grid frequency regulation: A validation based on onsite tests," Applied Energy, Elsevier, vol. 300(C).
    12. Mahmoud Mahfouz & Angelos Filos & Cyrine Chtourou & Joshua Lockhart & Samuel Assefa & Manuela Veloso & Danilo Mandic & Tucker Balch, 2019. "On the Importance of Opponent Modeling in Auction Markets," Papers 1911.12816, arXiv.org.
    13. Lixiang Zhang & Yan Yan & Yaoguang Hu, 2024. "Deep reinforcement learning for dynamic scheduling of energy-efficient automated guided vehicles," Journal of Intelligent Manufacturing, Springer, vol. 35(8), pages 3875-3888, December.
    14. Imen Azzouz & Wiem Fekih Hassen, 2023. "Optimization of Electric Vehicles Charging Scheduling Based on Deep Reinforcement Learning: A Decentralized Approach," Energies, MDPI, vol. 16(24), pages 1-18, December.
    15. Benjamin Heinbach & Peter Burggräf & Johannes Wagner, 2024. "gym-flp: A Python Package for Training Reinforcement Learning Algorithms on Facility Layout Problems," SN Operations Research Forum, Springer, vol. 5(1), pages 1-26, March.
    16. Jacob W. Crandall & Mayada Oudah & Tennom & Fatimah Ishowo-Oloko & Sherief Abdallah & Jean-François Bonnefon & Manuel Cebrian & Azim Shariff & Michael A. Goodrich & Iyad Rahwan, 2018. "Cooperating with machines," Nature Communications, Nature, vol. 9(1), pages 1-12, December.
      • Abdallah, Sherief & Bonnefon, Jean-François & Cebrian, Manuel & Crandall, Jacob W. & Ishowo-Oloko, Fatimah & Oudah, Mayada & Rahwan, Iyad & Shariff, Azim & Tennom,, 2017. "Cooperating with Machines," TSE Working Papers 17-806, Toulouse School of Economics (TSE).
      • Abdallah, Sherief & Bonnefon, Jean-François & Cebrian, Manuel & Crandall, Jacob W. & Ishowo-Oloko, Fatimah & Oudah, Mayada & Rahwan, Iyad & Shariff, Azim & Tennom,, 2017. "Cooperating with Machines," IAST Working Papers 17-68, Institute for Advanced Study in Toulouse (IAST).
    17. Sun, Alexander Y., 2020. "Optimal carbon storage reservoir management through deep reinforcement learning," Applied Energy, Elsevier, vol. 278(C).
    18. Turki Alsuwian & Aiman Shahid Butt & Arslan Ahmed Amin, 2022. "Smart Grid Cyber Security Enhancement: Challenges and Solutions—A Review," Sustainability, MDPI, vol. 14(21), pages 1-21, October.
    19. Konstantin Avrachenkov & Vivek S. Borkar & Pratik Shah, 2026. "Lagrangian index policy for restless bandits with average reward," Queueing Systems: Theory and Applications, Springer, vol. 110(1), pages 1-34, March.
    20. Yassine Chemingui & Adel Gastli & Omar Ellabban, 2020. "Reinforcement Learning-Based School Energy Management System," Energies, MDPI, vol. 13(23), pages 1-21, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:415:y:2026:i:c:s0306261926005180. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.