IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v321y2025i3p814-836.html
   My bibliography  Save this article

Stochastic dual dynamic programming for optimal power flow problems under uncertainty

Author

Listed:
  • Kiszka, Adriana
  • Wozabal, David

Abstract

Planning in the power sector has to take into account the physical laws of alternating current (AC) power flows as well as uncertainty in the data of the problems, both of which greatly complicate optimal decision making. We propose a computationally tractable framework to solve multi-stage stochastic optimal power flow (OPF) problems in AC power systems. Our approach uses recent results on dual convex semi-definite programming (SDP) relaxations of OPF problems in order to adapt the stochastic dual dynamic programming (SDDP) algorithm for problems with a Markovian structure. We show that the usual SDDP lower bound remains valid and that the algorithm converges to a globally optimal policy of the stochastic AC-OPF problem as long as the SDP relaxations are tight. To test the practical viability of our approach, we set up a case study of a storage siting, sizing, and operations problem. We show that the convex SDP relaxation of the stochastic problem is usually tight and discuss ways to obtain near-optimal physically feasible solutions when this is not the case. The algorithm finds a physically feasible policy with an optimality gap of 3% and yields a significant added value of 27% over a rolling deterministic policy, which leads to overly optimistic policies and underinvestment in flexibility. This suggests that the common industry practice of assuming direct current and deterministic problems should be reevaluated by considering models that incorporate realistic AC flows and stochastic elements in the data as potentially more realistic alternatives.

Suggested Citation

  • Kiszka, Adriana & Wozabal, David, 2025. "Stochastic dual dynamic programming for optimal power flow problems under uncertainty," European Journal of Operational Research, Elsevier, vol. 321(3), pages 814-836.
  • Handle: RePEc:eee:ejores:v:321:y:2025:i:3:p:814-836
    DOI: 10.1016/j.ejor.2024.09.045
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221724007483
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2024.09.045?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Niina Helistö & Juha Kiviluoma & Jussi Ikäheimo & Topi Rasku & Erkka Rinne & Ciara O’Dwyer & Ran Li & Damian Flynn, 2019. "Backbone—An Adaptable Energy Systems Modelling Framework," Energies, MDPI, vol. 12(17), pages 1-34, September.
    2. Stephen Frank & Steffen Rebennack, 2016. "An introduction to optimal power flow: Theory, formulation, and examples," IISE Transactions, Taylor & Francis Journals, vol. 48(12), pages 1172-1197, December.
    3. Fattahi, Salar & Ashraphijuo, Morteza & Lavaei, Javad & Atamtürk, Alper, 2017. "Conic relaxations of the unit commitment problem," Energy, Elsevier, vol. 134(C), pages 1079-1095.
    4. Nils Löhndorf & David Wozabal & Stefan Minner, 2013. "Optimizing Trading Decisions for Hydro Storage Systems Using Approximate Dual Dynamic Programming," Operations Research, INFORMS, vol. 61(4), pages 810-823, August.
    5. Zohrizadeh, Fariba & Josz, Cedric & Jin, Ming & Madani, Ramtin & Lavaei, Javad & Sojoudi, Somayeh, 2020. "A survey on conic relaxations of optimal power flow problem," European Journal of Operational Research, Elsevier, vol. 287(2), pages 391-409.
    6. Anthony Papavasiliou & Yuting Mou & Léopold Cambier & Damien Scieur, 2018. "Application of stochastic dual dynamic programming to the real-time dispatch of storage under renewable supply uncertainty," LIDAM Reprints CORE 2943, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    7. Shapiro, Alexander, 2011. "Analysis of stochastic dual dynamic programming method," European Journal of Operational Research, Elsevier, vol. 209(1), pages 63-72, February.
    8. Wim Ackooij & Welington Oliveira & Yongjia Song, 2019. "On level regularization with normal solutions in decomposition methods for multistage stochastic programming problems," Computational Optimization and Applications, Springer, vol. 74(1), pages 1-42, September.
    9. Georg Ch Pflug & Werner Römisch, 2007. "Modeling, Measuring and Managing Risk," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number 6478, April.
    10. Gonçalo Terça & David Wozabal, 2021. "Envelope Theorems for Multistage Linear Stochastic Optimization," Operations Research, INFORMS, vol. 69(5), pages 1608-1629, September.
    11. Powell, Warren B., 2019. "A unified framework for stochastic optimization," European Journal of Operational Research, Elsevier, vol. 275(3), pages 795-821.
    12. Anthony Papavasiliou & Yuting Mou & Léopold Cambier & Damien Scieur, 2018. "Application of stochastic dual dynamic programming to the real-time dispatch of storage under renewable supply uncertainty," LIDAM Reprints CORE 3044, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    13. Löhndorf, Nils & Wozabal, David, 2021. "Gas storage valuation in incomplete markets," European Journal of Operational Research, Elsevier, vol. 288(1), pages 318-330.
    14. Philpott, A.B. & de Matos, V.L., 2012. "Dynamic sampling algorithms for multi-stage stochastic programs with risk aversion," European Journal of Operational Research, Elsevier, vol. 218(2), pages 470-483.
    15. P. Girardeau & V. Leclere & A. B. Philpott, 2015. "On the Convergence of Decomposition Methods for Multistage Stochastic Convex Programs," Mathematics of Operations Research, INFORMS, vol. 40(1), pages 130-145, February.
    16. Bucciarelli, Martina & Paoletti, Simone & Vicino, Antonio, 2018. "Optimal sizing of energy storage systems under uncertain demand and generation," Applied Energy, Elsevier, vol. 225(C), pages 611-621.
    17. Marija Miletić & Hrvoje Pandžić & Dechang Yang, 2020. "Operating and Investment Models for Energy Storage Systems," Energies, MDPI, vol. 13(18), pages 1-33, September.
    18. Diego Larrahondo & Ricardo Moreno & Harold R. Chamorro & Francisco Gonzalez-Longatt, 2021. "Comparative Performance of Multi-Period ACOPF and Multi-Period DCOPF under High Integration of Wind Power," Energies, MDPI, vol. 14(15), pages 1-15, July.
    19. Carleton Coffrin & Pascal Van Hentenryck, 2014. "A Linear-Programming Approximation of AC Power Flows," INFORMS Journal on Computing, INFORMS, vol. 26(4), pages 718-734, November.
    20. Schildbach, Georg & Morari, Manfred, 2016. "Scenario-based model predictive control for multi-echelon supply chain management," European Journal of Operational Research, Elsevier, vol. 252(2), pages 540-549.
    21. Wenlei Bai & Duehee Lee & Kwang Y. Lee, 2017. "Stochastic Dynamic AC Optimal Power Flow Based on a Multivariate Short-Term Wind Power Scenario Forecasting Model," Energies, MDPI, vol. 10(12), pages 1-19, December.
    22. Khazaei, Sahra & Ehsan, Mehdi & Soleymani, Soodabeh & Mohammadnezhad-Shourkaei, Hosein, 2022. "A high-accuracy hybrid method for short-term wind power forecasting," Energy, Elsevier, vol. 238(PC).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. W. Ackooij & X. Warin, 2020. "On conditional cuts for stochastic dual dynamic programming," EURO Journal on Computational Optimization, Springer;EURO - The Association of European Operational Research Societies, vol. 8(2), pages 173-199, June.
    2. Zhou, Shaorui & Zhang, Hui & Shi, Ning & Xu, Zhou & Wang, Fan, 2020. "A new convergent hybrid learning algorithm for two-stage stochastic programs," European Journal of Operational Research, Elsevier, vol. 283(1), pages 33-46.
    3. D. Ávila & A. Papavasiliou & N. Löhndorf, 2022. "Parallel and distributed computing for stochastic dual dynamic programming," Computational Management Science, Springer, vol. 19(2), pages 199-226, June.
    4. Lee, Jinkyu & Bae, Sanghyeon & Kim, Woo Chang & Lee, Yongjae, 2023. "Value function gradient learning for large-scale multistage stochastic programming problems," European Journal of Operational Research, Elsevier, vol. 308(1), pages 321-335.
    5. Street, Alexandre & Valladão, Davi & Lawson, André & Velloso, Alexandre, 2020. "Assessing the cost of the Hazard-Decision simplification in multistage stochastic hydrothermal scheduling," Applied Energy, Elsevier, vol. 280(C).
    6. Alejandra Tabares & Pablo Cortés, 2024. "Using Stochastic Dual Dynamic Programming to Solve the Multi-Stage Energy Management Problem in Microgrids," Energies, MDPI, vol. 17(11), pages 1-24, May.
    7. Murwan Siddig & Yongjia Song, 2022. "Adaptive partition-based SDDP algorithms for multistage stochastic linear programming with fixed recourse," Computational Optimization and Applications, Springer, vol. 81(1), pages 201-250, January.
    8. Vincent Guigues & Renato D. C. Monteiro, 2021. "Stochastic Dynamic Cutting Plane for Multistage Stochastic Convex Programs," Journal of Optimization Theory and Applications, Springer, vol. 189(2), pages 513-559, May.
    9. Wim Ackooij & Welington Oliveira & Yongjia Song, 2019. "On level regularization with normal solutions in decomposition methods for multistage stochastic programming problems," Computational Optimization and Applications, Springer, vol. 74(1), pages 1-42, September.
    10. Liu, Rui Peng & Shapiro, Alexander, 2020. "Risk neutral reformulation approach to risk averse stochastic programming," European Journal of Operational Research, Elsevier, vol. 286(1), pages 21-31.
    11. Jitka Dupačová & Václav Kozmík, 2017. "SDDP for multistage stochastic programs: preprocessing via scenario reduction," Computational Management Science, Springer, vol. 14(1), pages 67-80, January.
    12. Yıldıran, Uğur, 2023. "Robust multi-stage economic dispatch with renewable generation and storage," European Journal of Operational Research, Elsevier, vol. 309(2), pages 890-909.
    13. Soares, Murilo Pereira & Street, Alexandre & Valladão, Davi Michel, 2017. "On the solution variability reduction of Stochastic Dual Dynamic Programming applied to energy planning," European Journal of Operational Research, Elsevier, vol. 258(2), pages 743-760.
    14. Bakker, Hannah & Dunke, Fabian & Nickel, Stefan, 2020. "A structuring review on multi-stage optimization under uncertainty: Aligning concepts from theory and practice," Omega, Elsevier, vol. 96(C).
    15. Lucas Merabet & Bernardo Freitas Paulo Costa & Vincent Leclere, 2024. "Policy with guaranteed risk-adjusted performance for multistage stochastic linear problems," Computational Management Science, Springer, vol. 21(2), pages 1-25, December.
    16. Pritchard, Geoffrey, 2015. "Stochastic inflow modeling for hydropower scheduling problems," European Journal of Operational Research, Elsevier, vol. 246(2), pages 496-504.
    17. Powell, Warren B., 2019. "A unified framework for stochastic optimization," European Journal of Operational Research, Elsevier, vol. 275(3), pages 795-821.
    18. Luckny Zéphyr & C. Lindsay Anderson, 2018. "Stochastic dynamic programming approach to managing power system uncertainty with distributed storage," Computational Management Science, Springer, vol. 15(1), pages 87-110, January.
    19. Sander Claeys & Marta Vanin & Frederik Geth & Geert Deconinck, 2021. "Applications of optimization models for electricity distribution networks," Wiley Interdisciplinary Reviews: Energy and Environment, Wiley Blackwell, vol. 10(5), September.
    20. de Queiroz, Anderson Rodrigo, 2016. "Stochastic hydro-thermal scheduling optimization: An overview," Renewable and Sustainable Energy Reviews, Elsevier, vol. 62(C), pages 382-395.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:321:y:2025:i:3:p:814-836. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.