IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i17p4622-d1738369.html
   My bibliography  Save this article

Real-Time Energy Management of a Microgrid Using MPC-DDQN-Controlled V2H and H2V Operations with Renewable Energy Integration

Author

Listed:
  • Mohammed Alsolami

    (Department of Electrical Engineering, College of Engineering, Taibah University, Madinah 41411, Saudi Arabia)

  • Ahmad Alferidi

    (Department of Electrical Engineering, College of Engineering, Taibah University, Madinah 41411, Saudi Arabia)

  • Badr Lami

    (Department of Electrical Engineering, College of Engineering, Taibah University, Madinah 41411, Saudi Arabia)

Abstract

This paper presents the design and implementation of an Intelligent Home Energy Management System in a smart home. The system is based on an economically decentralized hybrid concept that includes photovoltaic technology, a proton exchange membrane fuel cell, and a hydrogen refueling station, which together provide a reliable, secure, and clean power supply for smart homes. The proposed design enables power transfer between Vehicle-to-Home (V2H) and Home-to-Vehicle (H2V) systems, allowing electric vehicles to function as mobile energy storage devices at the grid level, facilitating a more adaptable and autonomous network. Our approach employs Double Deep Q-networks for adaptive control and forecasting. A Multi-Agent System coordinates actions between home appliances, energy storage systems, electric vehicles, and hydrogen power devices to ensure effective and cost-saving energy distribution for users of the smart grid. The design validation is carried out through MATLAB/Simulink-based simulations using meteorological data from Tunis. Ultimately, the V2H/H2V system enhances the utilization, reliability, and cost-effectiveness of residential energy systems compared with other management systems and conventional networks.

Suggested Citation

  • Mohammed Alsolami & Ahmad Alferidi & Badr Lami, 2025. "Real-Time Energy Management of a Microgrid Using MPC-DDQN-Controlled V2H and H2V Operations with Renewable Energy Integration," Energies, MDPI, vol. 18(17), pages 1-26, August.
    • Handle: RePEc:gam:jeners:v:18:y:2025:i:17:p:4622-:d:1738369
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/17/4622/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/18/17/4622/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Wang, Wei & Li, Yan & Shi, Man & Song, Yuling, 2021. "Optimization and control of battery-flywheel compound energy storage system during an electric vehicle braking," Energy, Elsevier, vol. 226(C).
    2. Stennikov, Valery & Barakhtenko, Evgeny & Mayorov, Gleb & Sokolov, Dmitry & Zhou, Bin, 2022. "Coordinated management of centralized and distributed generation in an integrated energy system using a multi-agent approach," Applied Energy, Elsevier, vol. 309(C).
    3. Song, Ge & Xie, Hongbin & Zhang, Jingyuan & Fu, Hongdi & Shi, Zhuoran & Feng, Defan & Song, Xuan & Zhang, Haoran, 2025. "Long-term efficient energy management for multi-station collaborative electric vehicle charging: A transformer-based multi-agent reinforcement learning approach," Applied Energy, Elsevier, vol. 397(C).
    4. Jafari, Mohammad & Malekjamshidi, Zahra, 2020. "Optimal energy management of a residential-based hybrid renewable energy system using rule-based real-time control and 2D dynamic programming optimization method," Renewable Energy, Elsevier, vol. 146(C), pages 254-266.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xu, Xiao & Hu, Weihao & Cao, Di & Liu, Wen & Huang, Qi & Hu, Yanting & Chen, Zhe, 2021. "Enhanced design of an offgrid PV-battery-methanation hybrid energy system for power/gas supply," Renewable Energy, Elsevier, vol. 167(C), pages 440-456.
    2. Vitale, F. & Rispoli, N. & Sorrentino, M. & Rosen, M.A. & Pianese, C., 2021. "On the use of dynamic programming for optimal energy management of grid-connected reversible solid oxide cell-based renewable microgrids," Energy, Elsevier, vol. 225(C).
    3. Bai, Zhang & Yuan, Yu & Kong, Debin & Zhou, Shengdong & Li, Qi & Wang, Shuoshuo, 2023. "Potential of applying the thermochemical recuperation in combined cooling, heating and power generation: Off-design operation performance," Applied Energy, Elsevier, vol. 348(C).
    4. Talha, Muhammad & Raihan, S.R.S. & Rahim, N Abd, 2020. "PV inverter with decoupled active and reactive power control to mitigate grid faults," Renewable Energy, Elsevier, vol. 162(C), pages 877-892.
    5. Alexandre De Bernardinis & Richard Lallemand & Abdelfatah Kolli, 2023. "Highly Efficient Three-Phase Bi-Directional SiC DC–AC Inverter for Electric Vehicle Flywheel Emulator," Energies, MDPI, vol. 16(12), pages 1-15, June.
    6. Pinciroli, Luca & Baraldi, Piero & Compare, Michele & Zio, Enrico, 2023. "Optimal operation and maintenance of energy storage systems in grid-connected microgrids by deep reinforcement learning," Applied Energy, Elsevier, vol. 352(C).
    7. Kai Xu & Youguang Guo & Gang Lei & Jianguo Zhu, 2023. "A Review of Flywheel Energy Storage System Technologies," Energies, MDPI, vol. 16(18), pages 1-32, September.
    8. Shayan, Mostafa Esmaeili & Najafi, Gholamhassan & Ghobadian, Barat & Gorjian, Shiva & Mamat, Rizalman & Ghazali, Mohd Fairusham, 2022. "Multi-microgrid optimization and energy management under boost voltage converter with Markov prediction chain and dynamic decision algorithm," Renewable Energy, Elsevier, vol. 201(P2), pages 179-189.
    9. Ligang Zhao & Hua Zheng & Hongyue Zhen & Li Xie & Yuan Xu & Xianchao Huang, 2023. "Improvement of Fuzzy Newton Power Flow Convergence," Energies, MDPI, vol. 16(24), pages 1-14, December.
    10. Chutian Yu & Xinyi Lai & Fei Chen & Chenwei Jiang & Yikai Sun & Lijun Zhang & Fushuan Wen & Donglian Qi, 2022. "Multi-Time Period Optimal Dispatch Strategy for Integrated Energy System Considering Renewable Energy Generation Accommodation," Energies, MDPI, vol. 15(12), pages 1-18, June.
    11. Mohammed, Nooriya A. & Al-Bazi, Ammar, 2021. "Management of renewable energy production and distribution planning using agent-based modelling," Renewable Energy, Elsevier, vol. 164(C), pages 509-520.
    12. Necmi Altin & Süleyman Emre Eyimaya & Adel Nasiri, 2023. "Multi-Agent-Based Controller for Microgrids: An Overview and Case Study," Energies, MDPI, vol. 16(5), pages 1-18, March.
    13. Abdollah Younesi & Hossein Shayeghi & Pierluigi Siano, 2020. "Assessing the Use of Reinforcement Learning for Integrated Voltage/Frequency Control in AC Microgrids," Energies, MDPI, vol. 13(5), pages 1-22, March.
    14. Huang, Ruchen & He, Hongwen & Su, Qicong, 2024. "Smart energy management for hybrid electric bus via improved soft actor-critic algorithm in a heuristic learning framework," Energy, Elsevier, vol. 309(C).
    15. Lü, Xueqin & Meng, Ruidong & Deng, Ruiyu & Long, Liyuan & Wu, Yinbo, 2022. "Energy economy optimization and comprehensive performance improvement for PEMFC/LIB hybrid system based on hierarchical optimization," Renewable Energy, Elsevier, vol. 193(C), pages 1132-1149.
    16. Yin, Cheng & Zeng, Xiangrui & Yin, Zhouping, 2024. "An improved data-driven predictive optimal control approach for designing hybrid electric vehicle energy management strategies," Applied Energy, Elsevier, vol. 375(C).
    17. Zewen Meng & Tiezhu Zhang & Hongxin Zhang & Qinghai Zhao & Jian Yang, 2021. "Energy Management Strategy for an Electromechanical-Hydraulic Coupled Power Electric Vehicle Considering the Optimal Speed Threshold," Energies, MDPI, vol. 14(17), pages 1-12, August.
    18. Aqib Khan & Mathieu Bressel & Arnaud Davigny & Dhaker Abbes & Belkacem Ould Bouamama, 2025. "Comprehensive Review of Hybrid Energy Systems: Challenges, Applications, and Optimization Strategies," Energies, MDPI, vol. 18(10), pages 1-34, May.
    19. Álex Omar Topa Gavilema & José Domingo Álvarez & José Luis Torres Moreno & Manuel Pérez García, 2021. "Towards Optimal Management in Microgrids: An Overview," Energies, MDPI, vol. 14(16), pages 1-25, August.
    20. Alberto Fichera & Elisa Marrasso & Maurizio Sasso & Rosaria Volpe, 2020. "Energy, Environmental and Economic Performance of an Urban Community Hybrid Distributed Energy System," Energies, MDPI, vol. 13(10), pages 1-19, May.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:17:p:4622-:d:1738369. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.