IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i18p4919-d1750563.html
   My bibliography  Save this article

A Markov Decision Process and Adapted Particle Swarm Optimization-Based Approach for the Hydropower Dispatch Problem—Jirau Hydropower Plant Case Study

Author

Listed:
  • Mateus Santos

    (Systems Engineering and Information Technology Institute, Itajubá Federal University, Itajubá 37500-903, Brazil)

  • Marcelo Fonseca

    (JIRAU ENERGIA, Distrito de Jaci-Paraná, Porto Velho 76840-000, Brazil)

  • José Bernardes

    (Electric and Energy Systems Institute, Itajubá Federal University, Itajubá 37500-903, Brazil)

  • Lenio Prado

    (Systems Engineering and Information Technology Institute, Itajubá Federal University, Itajubá 37500-903, Brazil)

  • Thiago Abreu

    (Electric and Energy Systems Institute, Itajubá Federal University, Itajubá 37500-903, Brazil)

  • Edson Bortoni

    (Electric and Energy Systems Institute, Itajubá Federal University, Itajubá 37500-903, Brazil)

  • Guilherme Bastos

    (Systems Engineering and Information Technology Institute, Itajubá Federal University, Itajubá 37500-903, Brazil)

Abstract

This work focuses on optimizing energy dispatch in a hydroelectric power plant (HPP) with a large number of generating units (GUs) and uncertainties caused by sediment accumulation in the water intakes. The study was realized at Jirau HPP, and integrates Markov Decision Processes (MDPs) and Particle Swarm Optimization (PSO) to minimize losses and enhance the performance of the plant’s GUs. Given the complexity of managing the huge number of units (50) and mitigating load losses from sediment accumulation, this approach enables real-time decision-making and optimizes energy dispatch. The methodology involves modeling the operational characteristics of the GUs, developing an objective function to minimize water consumption and maximize energy efficiency, and utilizing MDPs and PSO to find globally optimal solutions. Our results show that this methodology improves efficiency, reducing the turbinated flow by 0.9 % while increasing energy generation by 0.34 % and overall yield by 0.33 % compared to the HPP traditional method of dispatch over the analyzed period. This strategy could be adapted to varying operational conditions, and could provide a reliable framework for hydropower dispatch optimization.

Suggested Citation

  • Mateus Santos & Marcelo Fonseca & José Bernardes & Lenio Prado & Thiago Abreu & Edson Bortoni & Guilherme Bastos, 2025. "A Markov Decision Process and Adapted Particle Swarm Optimization-Based Approach for the Hydropower Dispatch Problem—Jirau Hydropower Plant Case Study," Energies, MDPI, vol. 18(18), pages 1-34, September.
  • Handle: RePEc:gam:jeners:v:18:y:2025:i:18:p:4919-:d:1750563
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/18/4919/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/18/18/4919/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Cervone, A. & Carbone, G. & Santini, E. & Teodori, S., 2016. "Optimization of the battery size for PV systems under regulatory rules using a Markov-Chains approach," Renewable Energy, Elsevier, vol. 85(C), pages 657-665.
    2. Bortoni, Edson C. & Bastos, Guilherme S. & Abreu, Thiago M. & Kawkabani, Basile, 2015. "Online optimal power distribution between units of a hydro power plant," Renewable Energy, Elsevier, vol. 75(C), pages 30-36.
    3. Aguirre, Carlos Andrés & Ramirez Camacho, Ramiro Gustavo & de Oliveira, Waldir & Avellan, François, 2019. "Numerical analysis for detecting head losses in trifurcations of high head in hydropower plants," Renewable Energy, Elsevier, vol. 131(C), pages 197-207.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Toopshekan, Ashkan & Abedian, Ali & Azizi, Arian & Ahmadi, Esmaeil & Vaziri Rad, Mohammad Amin, 2023. "Optimization of a CHP system using a forecasting dispatch and teaching-learning-based optimization algorithm," Energy, Elsevier, vol. 285(C).
    2. Parrado, C. & Girard, A. & Simon, F. & Fuentealba, E., 2016. "2050 LCOE (Levelized Cost of Energy) projection for a hybrid PV (photovoltaic)-CSP (concentrated solar power) plant in the Atacama Desert, Chile," Energy, Elsevier, vol. 94(C), pages 422-430.
    3. Prasad, Abhnil Amtesh & Yang, Yuqing & Kay, Merlinde & Menictas, Chris & Bremner, Stephen, 2021. "Synergy of solar photovoltaics-wind-battery systems in Australia," Renewable and Sustainable Energy Reviews, Elsevier, vol. 152(C).
    4. Yuqing Yang & Stephen Bremner & Chris Menictas & Merlinde Kay, 2019. "A Mixed Receding Horizon Control Strategy for Battery Energy Storage System Scheduling in a Hybrid PV and Wind Power Plant with Different Forecast Techniques," Energies, MDPI, vol. 12(12), pages 1-25, June.
    5. Kiattisak Sakulphan & Erik L. J. Bohez, 2018. "A New Optimal Selection Method with Seasonal Flow and Irrigation Variability for Hydro Turbine Type and Size," Energies, MDPI, vol. 11(11), pages 1-16, November.
    6. de Oliveira, Glauber Cardoso & Bertone, Edoardo & Stewart, Rodney A., 2022. "Optimisation modelling tools and solving techniques for integrated precinct-scale energy–water system planning," Applied Energy, Elsevier, vol. 318(C).
    7. Cheng, Qian & Ming, Bo & Liu, Pan & Huang, Kangdi & Gong, Yu & Li, Xiao & Zheng, Yalian, 2021. "Solving hydro unit commitment problems with multiple hydraulic heads based on a two-layer nested optimization method," Renewable Energy, Elsevier, vol. 172(C), pages 317-326.
    8. Yang, Yuqing & Bremner, Stephen & Menictas, Chris & Kay, Merlinde, 2022. "Modelling and optimal energy management for battery energy storage systems in renewable energy systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    9. Yang, Yuqing & Bremner, Stephen & Menictas, Chris & Kay, Merlinde, 2018. "Battery energy storage system size determination in renewable energy systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 91(C), pages 109-125.
    10. Feng, Ran & Wang, Kai & Xu, Xu & Yu, Zi-Tao & Lin, Qingyang, 2024. "Triple-layer optimization of distributed photovoltaic energy storage capacity for manufacturing enterprises considering carbon emissions and load management," Applied Energy, Elsevier, vol. 364(C).
    11. de Oliveira, Glauber Cardoso & Bertone, Edoardo & Stewart, Rodney A., 2022. "Challenges, opportunities, and strategies for undertaking integrated precinct-scale energy–water system planning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    12. Zamani, Ali Ghahgharaee & Zakariazadeh, Alireza & Jadid, Shahram, 2016. "Day-ahead resource scheduling of a renewable energy based virtual power plant," Applied Energy, Elsevier, vol. 169(C), pages 324-340.
    13. Mohammad Rayati & Pasquale De Falco & Daniela Proto & Mokhtar Bozorg & Mauro Carpita, 2021. "Generation Data of Synthetic High Frequency Solar Irradiance for Data-Driven Decision-Making in Electrical Distribution Grids," Energies, MDPI, vol. 14(16), pages 1-21, August.
    14. Wang, Zhongliang & Zhu, Hongyu & Zhang, Dongdong & Goh, Hui Hwang & Dong, Yunxuan & Wu, Thomas, 2023. "Modelling of wind and photovoltaic power output considering dynamic spatio-temporal correlation," Applied Energy, Elsevier, vol. 352(C).
    15. Pavani Ponnaganti & Birgitte Bak-Jensen & Brian Vejrum Wæhrens & Jesper Asmussen, 2021. "Assessment of Energy Arbitrage Using Energy Storage Systems: A Wind Park’s Perspective," Energies, MDPI, vol. 14(16), pages 1-20, August.
    16. Pflaum, Peter & Alamir, M. & Lamoudi, M.Y., 2017. "Battery sizing for PV power plants under regulations using randomized algorithms," Renewable Energy, Elsevier, vol. 113(C), pages 596-607.
    17. Lamedica, Regina & Santini, Ezio & Ruvio, Alessandro & Palagi, Laura & Rossetta, Irene, 2018. "A MILP methodology to optimize sizing of PV - Wind renewable energy systems," Energy, Elsevier, vol. 165(PB), pages 385-398.
    18. Hina Fathima A & Kaliannan Palanisamy & Sanjeevikumar Padmanaban & Umashankar Subramaniam, 2018. "Intelligence-Based Battery Management and Economic Analysis of an Optimized Dual-Vanadium Redox Battery (VRB) for a Wind-PV Hybrid System," Energies, MDPI, vol. 11(10), pages 1-18, October.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:18:p:4919-:d:1750563. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.