IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v343y2026ics0360544225054374.html

An uncertainty information-guided optimization method for economic scheduling of PV–BESS systems

Author

Listed:
  • Wang, Yong
  • Zuo, Hui
  • Cao, Lifeng
  • Ren, He
  • Wang, Jinquan
  • Yan, Gaowei
  • Ma, Suxia

Abstract

With the increasing penetration of photovoltaic (PV) power in the power system, the uncertainty and fluctuation of its output exacerbate the difficulty of grid scheduling. Existing prediction models are insufficient in characterizing disturbances, leading to charging and discharging strategies of energy storage in day-ahead scheduling that are difficult to match with actual output, thereby causing power limit violations and operational risks. Although reinforcement learning shows potential in PV–BESS scheduling, it still suffers from limitations in uncertainty modeling, policy stability, and computational efficiency. To address the above issues, this paper proposes an uncertainty information-driven reservoir computing reinforcement learning framework. The core idea is to use PV interval prediction results as prior knowledge, incorporate them into reservoir construction, and combine them with compressed sensing theory to generate a sparse weight matrix, thereby embedding the uncertainty information of future disturbances at the structural level. During the proximal policy optimization process, the reservoir replaces traditional deep neural networks for state mapping, enabling reservoir states to not only reflect the current environment but also carry prior knowledge of future disturbances, thus providing structured guidance for policy and value learning. This method effectively addresses the problems of insufficient adaptability, large policy fluctuations, and high computational overhead of traditional models in uncertain environments. Simulation results show that under typical high-fluctuation scenarios, the proposed method significantly reduces operational risks and economic losses: the average violation amplitude decreases from 91.89% to 29.52%, the compensation cost for violations decreases by about 67%, and the operational revenue increases by 81.72%. Benefiting from the lightweight design, the number of model parameters and computational overhead are significantly reduced, further improving scheduling efficiency and deployment flexibility. In summary, this paper provides an efficient, robust, and secure solution for the economic scheduling of PV–BESS systems under uncertain environments.

Suggested Citation

  • Wang, Yong & Zuo, Hui & Cao, Lifeng & Ren, He & Wang, Jinquan & Yan, Gaowei & Ma, Suxia, 2026. "An uncertainty information-guided optimization method for economic scheduling of PV–BESS systems," Energy, Elsevier, vol. 343(C).
  • Handle: RePEc:eee:energy:v:343:y:2026:i:c:s0360544225054374
    DOI: 10.1016/j.energy.2025.139794
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225054374
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.139794?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Gabriel Pesántez & Wilian Guamán & José Córdova & Miguel Torres & Pablo Benalcazar, 2024. "Reinforcement Learning for Efficient Power Systems Planning: A Review of Operational and Expansion Strategies," Energies, MDPI, vol. 17(9), pages 1-25, May.
    2. Yang, Hongming & Liang, Rui & Yuan, Yuan & Chen, Bowen & Xiang, Sheng & Liu, Junpeng & Zhao, Huan & Ackom, Emmanuel, 2022. "Distributionally robust optimal dispatch in the power system with high penetration of wind power based on net load fluctuation data," Applied Energy, Elsevier, vol. 313(C).
    3. Kebede, Abraham Alem & Kalogiannis, Theodoros & Van Mierlo, Joeri & Berecibar, Maitane, 2022. "A comprehensive review of stationary energy storage devices for large scale renewable energy sources grid integration," Renewable and Sustainable Energy Reviews, Elsevier, vol. 159(C).
    4. Ying Ji & Jianhui Wang & Jiacan Xu & Xiaoke Fang & Huaguang Zhang, 2019. "Real-Time Energy Management of a Microgrid Using Deep Reinforcement Learning," Energies, MDPI, vol. 12(12), pages 1-21, June.
    5. Zhao, Haoran & Wu, Qiuwei & Hu, Shuju & Xu, Honghua & Rasmussen, Claus Nygaard, 2015. "Review of energy storage system for wind power integration support," Applied Energy, Elsevier, vol. 137(C), pages 545-553.
    6. Guo, Chenyu & Wang, Xin & Zheng, Yihui & Zhang, Feng, 2022. "Real-time optimal energy management of microgrid with uncertainties based on deep reinforcement learning," Energy, Elsevier, vol. 238(PC).
    7. Reveles-Miranda, María & Ramirez-Rivera, Victor & Pacheco-Catalán, Daniella, 2024. "Hybrid energy storage: Features, applications, and ancillary benefits," Renewable and Sustainable Energy Reviews, Elsevier, vol. 192(C).
    8. Cai, Jun & Fu, Maowen & Yan, Ying & Chen, Zhong & Zhang, Xin, 2025. "Deep Q-network based battery energy storage system control strategy with charging/discharging times considered," Applied Energy, Elsevier, vol. 398(C).
    9. Qu, Kai & Si, Gangquan & Wang, Qianyue & Xu, Minglin & Shan, Zihan, 2025. "Improving economic operation of a microgrid through expert behaviors and prediction intervals," Applied Energy, Elsevier, vol. 383(C).
    10. Yang, Yuqing & Bremner, Stephen & Menictas, Chris & Kay, Merlinde, 2018. "Battery energy storage system size determination in renewable energy systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 91(C), pages 109-125.
    11. Li, Hongze & Sun, Dongyang & Li, Bingkang & Wang, Xuejie & Zhao, Yihang & Wei, Mengru & Dang, Xiaolu, 2023. "Collaborative optimization of VRB-PS hybrid energy storage system for large-scale wind power grid integration," Energy, Elsevier, vol. 265(C).
    12. Akulker, Handan & Aydin, Erdal, 2023. "Optimal design and operation of a multi-energy microgrid using mixed-integer nonlinear programming: Impact of carbon cap and trade system and taxing on equipment selections," Applied Energy, Elsevier, vol. 330(PA).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qu, Kai & Si, Gangquan & Wang, Qianyue & Xu, Minglin & Shan, Zihan, 2025. "Improving economic operation of a microgrid through expert behaviors and prediction intervals," Applied Energy, Elsevier, vol. 383(C).
    2. Li, Hongze & Sun, Dongyang & Li, Bingkang & Wang, Xuejie & Zhao, Yihang & Wei, Mengru & Dang, Xiaolu, 2023. "Collaborative optimization of VRB-PS hybrid energy storage system for large-scale wind power grid integration," Energy, Elsevier, vol. 265(C).
    3. Wang, Yi & Qiu, Dawei & Sun, Mingyang & Strbac, Goran & Gao, Zhiwei, 2023. "Secure energy management of multi-energy microgrid: A physical-informed safe reinforcement learning approach," Applied Energy, Elsevier, vol. 335(C).
    4. Nasir, M. & Bansal, R.C. & Saloumi, M., 2025. "Reinforcement learning algorithms in AC, DC, and hybrid microgrids applications: A comprehensive review," Applied Energy, Elsevier, vol. 401(PC).
    5. Reveles-Miranda, María & Ramirez-Rivera, Victor & Pacheco-Catalán, Daniella, 2024. "Hybrid energy storage: Features, applications, and ancillary benefits," Renewable and Sustainable Energy Reviews, Elsevier, vol. 192(C).
    6. Zhu, Ziqing & Hu, Ze & Chan, Ka Wing & Bu, Siqi & Zhou, Bin & Xia, Shiwei, 2023. "Reinforcement learning in deregulated energy market: A comprehensive review," Applied Energy, Elsevier, vol. 329(C).
    7. Siavash Asiaban & Nezmin Kayedpour & Arash E. Samani & Dimitar Bozalakov & Jeroen D. M. De Kooning & Guillaume Crevecoeur & Lieven Vandevelde, 2021. "Wind and Solar Intermittency and the Associated Integration Challenges: A Comprehensive Review Including the Status in the Belgian Power System," Energies, MDPI, vol. 14(9), pages 1-41, May.
    8. Barra, P.H.A. & Coury, D.V. & Fernandes, R.A.S., 2020. "A survey on adaptive protection of microgrids and distribution systems with distributed generators," Renewable and Sustainable Energy Reviews, Elsevier, vol. 118(C).
    9. Bio Gassi, Karim & Baysal, Mustafa, 2023. "Improving real-time energy decision-making model with an actor-critic agent in modern microgrids with energy storage devices," Energy, Elsevier, vol. 263(PE).
    10. Khaled Alawasa & Adib Allahham & Ala’aldeen Al-Halhouli & Mohammed Al-Mahmodi & Musab Hamdan & Yara Khawaja & Hani Muhsen & Saqer Alja’afreh & Abdullah Al-Odienat & Ali Al-Dmour & Ahmad Aljaafreh & Ah, 2025. "Techno-Socio-Economic Framework for Energy Storage System Selection in Jordan," Energies, MDPI, vol. 18(12), pages 1-26, June.
    11. Tee, Wei Hown & Gan, Chin Kim & Sardi, Junainah, 2024. "Benefits of energy storage systems and its potential applications in Malaysia: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 192(C).
    12. Maria Symeonidou & Agis M. Papadopoulos, 2022. "Selection and Dimensioning of Energy Storage Systems for Standalone Communities: A Review," Energies, MDPI, vol. 15(22), pages 1-28, November.
    13. Hao Yu & Yibo Wang & Chuang Liu & Shunjiang Wang & Chunyang Hao & Jian Xiong, 2024. "Optimization and Scheduling Method for Power Systems Considering Wind Power Forward/Reverse Peaking Scenarios," Energies, MDPI, vol. 17(5), pages 1-18, March.
    14. Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.
    15. Shi, Jing & Xu, Ying & Liao, Meng & Guo, Shuqiang & Li, Yuanyuan & Ren, Li & Su, Rongyu & Li, Shujian & Zhou, Xiao & Tang, Yuejin, 2019. "Integrated design method for superconducting magnetic energy storage considering the high frequency pulse width modulation pulse voltage on magnet," Applied Energy, Elsevier, vol. 248(C), pages 1-17.
    16. Zhao, Chunyang & Andersen, Peter Bach & Træholt, Chresten & Hashemi, Seyedmostafa, 2023. "Grid-connected battery energy storage system: a review on application and integration," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
    17. Van-Hai Bui & Xuan Quynh Nguyen & Akhtar Hussain & Wencong Su, 2021. "Optimal Sizing of Energy Storage System for Operation of Wind Farms Considering Grid-Code Constraints," Energies, MDPI, vol. 14(17), pages 1-19, September.
    18. Khawaja Haider Ali & Mohammad Abusara & Asif Ali Tahir & Saptarshi Das, 2023. "Dual-Layer Q-Learning Strategy for Energy Management of Battery Storage in Grid-Connected Microgrids," Energies, MDPI, vol. 16(3), pages 1-17, January.
    19. Kosmadakis, Ioannis E. & Elmasides, Costas & Koulinas, Georgios & Tsagarakis, Konstantinos P., 2021. "Energy unit cost assessment of six photovoltaic-battery configurations," Renewable Energy, Elsevier, vol. 173(C), pages 24-41.
    20. Yang, Yuqing & Bremner, Stephen & Menictas, Chris & Kay, Merlinde, 2022. "Modelling and optimal energy management for battery energy storage systems in renewable energy systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:343:y:2026:i:c:s0360544225054374. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.