IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v387y2025ics0306261925002156.html
   My bibliography  Save this article

Holistic mutual benefits aware P2P2G market among microgrids in a distribution network: A decentralized data-driven approach

Author

Listed:
  • Liu, Xiao
  • Li, Sinan
  • Zhang, Cuo
  • Liu, Meng
  • Zhu, Jianguo

Abstract

In contrast to the traditional peer-to-grid (P2G) market, the emerging decentralized peer-to-peer-to-grid (P2P2G) trading can generate enormous potential to reduce the overall operational costs of microgrids (MGs) further. However, it is challenging to incorporate this decentralized market framework directly into the distribution network (DN) trading framework to account for mutual benefits holistically, impeding progress toward future smart electricity markets. This paper proposes an online non-iterative method based on data-driven multi-agent deep reinforcement learning. The decentralized P2P2G trading framework is formulated as partially observable Markov games (POMGs) to consider mutual benefits efficiently and make it compatible for DN operations. It is further integrated with a novel adaptive margin update (AMU) method to protect DN's topology information and return differential rewards to improve training efficiency and operation safety. Comprehensive numerical simulations on a modified IEEE test system demonstrate the superiority of the proposed method, outperforming other data-driven algorithms and a model-based optimization approach in smart electricity market applications.

Suggested Citation

  • Liu, Xiao & Li, Sinan & Zhang, Cuo & Liu, Meng & Zhu, Jianguo, 2025. "Holistic mutual benefits aware P2P2G market among microgrids in a distribution network: A decentralized data-driven approach," Applied Energy, Elsevier, vol. 387(C).
  • Handle: RePEc:eee:appene:v:387:y:2025:i:c:s0306261925002156
    DOI: 10.1016/j.apenergy.2025.125485
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925002156
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2025.125485?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Ullah, Md Habib & Park, Jae-Do, 2022. "DLMP integrated P2P2G energy trading in distribution-level grid-interactive transactive energy systems," Applied Energy, Elsevier, vol. 312(C).
    2. Michaelis, Anne & Hanny, Lisa & Körner, Marc-Fabian & Strüker, Jens & Weibelzahl, Martin, 2024. "Consumer-centric electricity markets: Six design principles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 191(C).
    3. Samende, Cephas & Cao, Jun & Fan, Zhong, 2022. "Multi-agent deep deterministic policy gradient algorithm for peer-to-peer energy trading considering distribution network constraints," Applied Energy, Elsevier, vol. 317(C).
    4. Filipe Bandeiras & Álvaro Gomes & Mário Gomes & Paulo Coelho, 2023. "Exploring Energy Trading Markets in Smart Grid and Microgrid Systems and Their Implications for Sustainability in Smart Cities," Energies, MDPI, vol. 16(2), pages 1-41, January.
    5. Tushar, Wayes & Yuen, Chau & Saha, Tapan K. & Morstyn, Thomas & Chapman, Archie C. & Alam, M. Jan E. & Hanif, Sarmad & Poor, H. Vincent, 2021. "Peer-to-peer energy systems for connected communities: A review of recent advances and emerging challenges," Applied Energy, Elsevier, vol. 282(PA).
    6. Botelho, D.F. & de Oliveira, L.W. & Dias, B.H. & Soares, T.A. & Moraes, C.A., 2022. "Integrated prosumers–DSO approach applied in peer-to-peer energy and reserve tradings considering network constraints," Applied Energy, Elsevier, vol. 317(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Meng, Yuan & Qiu, Jing & Zhang, Cuo & Lei, Gang & Zhu, Jianguo, 2024. "A Holistic P2P market for active and reactive energy trading in VPPs considering both financial benefits and network constraints," Applied Energy, Elsevier, vol. 356(C).
    2. Azim, M. Imran & Tushar, Wayes & Saha, Tapan K. & Yuen, Chau & Smith, David, 2022. "Peer-to-peer kilowatt and negawatt trading: A review of challenges and recent advances in distribution networks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 169(C).
    3. Dong, Lei & Zhang, Shiming & Zhang, Tao & Wang, Zibo & Qiao, Ji & Pu, Tianjiao, 2024. "DSO-prosumers dual-layer game optimization based on risk price guidance in a P2P energy market environment," Applied Energy, Elsevier, vol. 361(C).
    4. Hosseini Dolatabadi, Sayed Hamid & Bhuiyan, Tanveer Hossain & Chen, Yang & Morales, Jose Luis, 2024. "A stochastic game-theoretic optimization approach for managing local electricity markets with electric vehicles and renewable sources," Applied Energy, Elsevier, vol. 368(C).
    5. Guo, Yurun & Wang, Shugang & Wang, Jihong & Zhang, Tengfei & Ma, Zhenjun & Jiang, Shuang, 2024. "Key district heating technologies for building energy flexibility: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    6. Jihed Hmad & Azeddine Houari & Allal El Moubarek Bouzid & Abdelhakim Saim & Hafedh Trabelsi, 2023. "A Review on Mode Transition Strategies between Grid-Connected and Standalone Operation of Voltage Source Inverters-Based Microgrids," Energies, MDPI, vol. 16(13), pages 1-41, June.
    7. Zhou, Yuekuan & Lund, Peter D., 2023. "Peer-to-peer energy sharing and trading of renewable energy in smart communities ─ trading pricing models, decision-making and agent-based collaboration," Renewable Energy, Elsevier, vol. 207(C), pages 177-193.
    8. Mukherjee, Monish & Hardy, Trevor & Fuller, Jason C. & Bose, Anjan, 2022. "Implementing multi-settlement decentralized electricity market design for transactive communities with imperfect communication," Applied Energy, Elsevier, vol. 306(PA).
    9. Félix González & Paul Arévalo & Luis Ramirez, 2025. "Game Theory and Robust Predictive Control for Peer-to-Peer Energy Management: A Pathway to a Low-Carbon Economy," Sustainability, MDPI, vol. 17(5), pages 1-23, February.
    10. Botelho, D.F. & de Oliveira, L.W. & Dias, B.H. & Soares, T.A. & Moraes, C.A., 2022. "Integrated prosumers–DSO approach applied in peer-to-peer energy and reserve tradings considering network constraints," Applied Energy, Elsevier, vol. 317(C).
    11. Han, Fengwu & Zeng, Jianfeng & Lin, Junjie & Zhao, Yunlong & Gao, Chong, 2023. "A stochastic hierarchical optimization and revenue allocation approach for multi-regional integrated energy systems based on cooperative games," Applied Energy, Elsevier, vol. 350(C).
    12. Feng, Chen & Liu, Andrew L., 2025. "Peer-to-peer energy trading of solar and energy storage: A networked multiagent reinforcement learning approach," Applied Energy, Elsevier, vol. 383(C).
    13. Jayachandran, M. & Rao, K. Prasada & Gatla, Ranjith Kumar & Kalaivani, C. & Kalaiarasy, C. & Logasabarirajan, C., 2022. "Operational concerns and solutions in smart electricity distribution systems," Utilities Policy, Elsevier, vol. 74(C).
    14. Hasan, Amena & Dowla, Asif-Ud & Tarannum, Ramisa, 2024. "Financial Inclusion and Economic Growth in Developing Nations: A Case Study of Bangladesh," MPRA Paper 120213, University Library of Munich, Germany, revised 08 Feb 2024.
    15. Mahuze, Richard A. & Amadeh, Ali & Yuan, Bo & Zhang, K. Max, 2025. "Collaborative optimization framework for capacity planning of a prosumer-based peer-to-peer electricity trading community," Applied Energy, Elsevier, vol. 384(C).
    16. Li, Ruizhi & Yan, Xiaohe & Liu, Nian, 2022. "Hybrid energy sharing considering network cost for prosumers in integrated energy systems," Applied Energy, Elsevier, vol. 323(C).
    17. Hu, Qian & Zhu, Ziqing & Bu, Siqi & Wing Chan, Ka & Li, Fangxing, 2021. "A multi-market nanogrid P2P energy and ancillary service trading paradigm: Mechanisms and implementations," Applied Energy, Elsevier, vol. 293(C).
    18. Kaiss, Mateus & Wan, Yihao & Gebbran, Daniel & Vila, Clodomiro Unsihuay & Dragičević, Tomislav, 2025. "Review on Virtual Power Plants/Virtual Aggregators: Concepts, applications, prospects and operation strategies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 211(C).
    19. Xie, Xuehua & Qian, Tong & Li, Weiwei & Tang, Wenhu & Xu, Zhao, 2024. "An individualized adaptive distributed approach for fast energy-carbon coordination in transactive multi-community integrated energy systems considering power transformer loading capacity," Applied Energy, Elsevier, vol. 375(C).
    20. Mahfuzur Rahman & Solaiman Chowdhury & Mohammad Shorfuzzaman & Mohammad Kamal Hossain & Mohammad Hammoudeh, 2023. "Peer-to-Peer Power Energy Trading in Blockchain Using Efficient Machine Learning Model," Sustainability, MDPI, vol. 15(18), pages 1-15, September.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:387:y:2025:i:c:s0306261925002156. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.