IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v198y2020ics0360544220304540.html
   My bibliography  Save this article

Risk-averse real-time dispatch of integrated electricity and heat system using a modified approximate dynamic programming approach

Author

Listed:
  • Pan, Zhenning
  • Yu, Tao
  • Li, Jie
  • Qu, Kaiping
  • Yang, Bo

Abstract

Coordinated operation of integrated electricity and heat system can improve operation flexibility and reduce cost. However, multiple uncertainties challenge its optimal operation. This paper aims at developing a risk-averse and computationally efficient policy for real-time stochastic dispatch of integrated electricity and heat system, which improves the economy as well as avoiding the risk of high costs in critical scenarios. First, real-time dispatch of integrated electricity and heat system is formulated as a multistage risk-averse stochastic sequential optimization problem with dynamic risk measure, where combined heat and power unit, energy storage, flexible electricity and heat load are jointly utilized to minimize the risk-adjusted total costs. Next, a risk-averse dynamic programming formulation of the original problem is presented, upon which a data-driven risk-averse approximate dynamic programming is employed to address computational challenge, and develop almost optimal and computationally efficient policy. By exploiting information from training samples in off-line learning, the proposed algorithm can efficiently responses to the stochastic exogenous information. Comparative simulations with different risk-aversion preferences and different methods verify the effectiveness of the proposed algorithm.

Suggested Citation

  • Pan, Zhenning & Yu, Tao & Li, Jie & Qu, Kaiping & Yang, Bo, 2020. "Risk-averse real-time dispatch of integrated electricity and heat system using a modified approximate dynamic programming approach," Energy, Elsevier, vol. 198(C).
    • Handle: RePEc:eee:energy:v:198:y:2020:i:c:s0360544220304540
    DOI: 10.1016/j.energy.2020.117347
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544220304540
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2020.117347?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Shapiro, Alexander & Tekaya, Wajdi & da Costa, Joari Paulo & Soares, Murilo Pereira, 2013. "Risk neutral and risk averse Stochastic Dual Dynamic Programming method," European Journal of Operational Research, Elsevier, vol. 224(2), pages 375-391.
    2. Jing, Z.X. & Jiang, X.S. & Wu, Q.H. & Tang, W.H. & Hua, B., 2014. "Modelling and optimal operation of a small-scale integrated energy based district heating and cooling system," Energy, Elsevier, vol. 73(C), pages 399-415.
    3. Wang, Dan & Hu, Qing'e & Jia, Hongjie & Hou, Kai & Du, Wei & Chen, Ning & Wang, Xudong & Fan, Menghua, 2019. "Integrated demand response in district electricity-heating network considering double auction retail energy market based on demand-side energy stations," Applied Energy, Elsevier, vol. 248(C), pages 656-678.
    4. Richard Bellman, 1957. "On a Dynamic Programming Approach to the Caterer Problem--I," Management Science, INFORMS, vol. 3(3), pages 270-278, April.
    5. Pan, Zhaoguang & Guo, Qinglai & Sun, Hongbin, 2017. "Feasible region method based integrated heat and electricity dispatch considering building thermal inertia," Applied Energy, Elsevier, vol. 192(C), pages 395-407.
    6. Huang, Shaojun & Tang, Weichu & Wu, Qiuwei & Li, Canbing, 2019. "Network constrained economic dispatch of integrated heat and electricity systems through mixed integer conic programming," Energy, Elsevier, vol. 179(C), pages 464-474.
    7. Urbanucci, Luca & Bruno, Joan Carles & Testi, Daniele, 2019. "Thermodynamic and economic analysis of the integration of high-temperature heat pumps in trigeneration systems," Applied Energy, Elsevier, vol. 238(C), pages 516-533.
    8. Jiang, X.S. & Jing, Z.X. & Li, Y.Z. & Wu, Q.H. & Tang, W.H., 2014. "Modelling and operation optimization of an integrated energy based direct district water-heating system," Energy, Elsevier, vol. 64(C), pages 375-388.
    9. Li, Xue & Li, Wenming & Zhang, Rufeng & Jiang, Tao & Chen, Houhe & Li, Guoqing, 2020. "Collaborative scheduling and flexibility assessment of integrated electricity and district heating systems utilizing thermal inertia of district heating network and aggregated buildings," Applied Energy, Elsevier, vol. 258(C).
    10. Yang, Bo & Yu, Tao & Shu, Hongchun & Zhang, Yuming & Chen, Jian & Sang, Yiyan & Jiang, Lin, 2018. "Passivity-based sliding-mode control design for optimal power extraction of a PMSG based variable speed wind turbine," Renewable Energy, Elsevier, vol. 119(C), pages 577-589.
    11. Yang, Bo & Yu, Tao & Shu, Hongchun & Dong, Jun & Jiang, Lin, 2018. "Robust sliding-mode control of wind energy conversion systems for optimal power extraction via nonlinear perturbation observers," Applied Energy, Elsevier, vol. 210(C), pages 711-723.
    12. Tan, Jin & Wu, Qiuwei & Hu, Qinran & Wei, Wei & Liu, Feng, 2020. "Adaptive robust energy and reserve co-optimization of integrated electricity and heating system considering wind uncertainty," Applied Energy, Elsevier, vol. 260(C).
    13. Qin, Xin & Sun, Hongbin & Shen, Xinwei & Guo, Ye & Guo, Qinglai & Xia, Tian, 2019. "A generalized quasi-dynamic model for electric-heat coupling integrated energy system with distributed energy resources," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    14. Huang, Jinbo & Li, Zhigang & Wu, Q.H., 2017. "Coordinated dispatch of electric power and district heating networks: A decentralized solution using optimality condition decomposition," Applied Energy, Elsevier, vol. 206(C), pages 1508-1522.
    15. Philpott, A.B. & de Matos, V.L., 2012. "Dynamic sampling algorithms for multi-stage stochastic programs with risk aversion," European Journal of Operational Research, Elsevier, vol. 218(2), pages 470-483.
    16. Hast, Aira & Rinne, Samuli & Syri, Sanna & Kiviluoma, Juha, 2017. "The role of heat storages in facilitating the adaptation of district heating systems to large amount of variable renewable electricity," Energy, Elsevier, vol. 137(C), pages 775-788.
    17. Liu, Xuezhi & Mancarella, Pierluigi, 2016. "Modelling, assessment and Sankey diagrams of integrated electricity-heat-gas networks in multi-vector district energy systems," Applied Energy, Elsevier, vol. 167(C), pages 336-352.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Menglin & Wu, Qiuwei & Wen, Jinyu & Xue, Xizhen & Lin, Zhongwei & Fang, Fang, 2021. "Real-time optimal operation of integrated electricity and heat system considering reserve provision of large-scale heat pumps," Energy, Elsevier, vol. 237(C).
    2. Yin, Linfei & Luo, Shikui & Ma, Chenxiao, 2021. "Expandable depth and width adaptive dynamic programming for economic smart generation control of smart grids," Energy, Elsevier, vol. 232(C).
    3. Zheng, Lingwei & Wu, Hao & Guo, Siqi & Sun, Xinyu, 2023. "Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy," Energy, Elsevier, vol. 277(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Menglin & Wu, Qiuwei & Wen, Jinyu & Lin, Zhongwei & Fang, Fang & Chen, Qun, 2021. "Optimal operation of integrated electricity and heat system: A review of modeling and solution methods," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    2. Wang, Lixiao & Jing, Z.X. & Zheng, J.H. & Wu, Q.H. & Wei, Feng, 2018. "Decentralized optimization of coordinated electrical and thermal generations in hierarchical integrated energy systems considering competitive individuals," Energy, Elsevier, vol. 158(C), pages 607-622.
    3. Sun, Weijia & Wang, Qi & Ye, Yujian & Tang, Yi, 2022. "Unified modelling of gas and thermal inertia for integrated energy system and its application to multitype reserve procurement," Applied Energy, Elsevier, vol. 305(C).
    4. Chen, Yuwei & Guo, Qinglai & Sun, Hongbin & Li, Zhengshuo & Pan, Zhaoguang & Wu, Wenchuan, 2019. "A water mass method and its application to integrated heat and electricity dispatch considering thermal inertias," Energy, Elsevier, vol. 181(C), pages 840-852.
    5. Golmohamadi, Hessam & Larsen, Kim Guldstrand & Jensen, Peter Gjøl & Hasrat, Imran Riaz, 2022. "Integration of flexibility potentials of district heating systems into electricity markets: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 159(C).
    6. Song, William Hasung & Wang, Yang & Gillich, Aaron & Ford, Andy & Hewitt, Mark, 2019. "Modelling development and analysis on the Balanced Energy Networks (BEN) in London," Applied Energy, Elsevier, vol. 233, pages 114-125.
    7. Chen, Dongwen & Li, Yong & Abbas, Zulkarnain & Li, Dehong & Wang, Ruzhu, 2022. "Network flow calculation based on the directional nodal potential method for meshed heating networks," Energy, Elsevier, vol. 243(C).
    8. Jiajia Li & Jinfu Liu & Peigang Yan & Xingshuo Li & Guowen Zhou & Daren Yu, 2021. "Operation Optimization of Integrated Energy System under a Renewable Energy Dominated Future Scene Considering Both Independence and Benefit: A Review," Energies, MDPI, vol. 14(4), pages 1-36, February.
    9. Zhang, Menglin & Wu, Qiuwei & Wen, Jinyu & Xue, Xizhen & Lin, Zhongwei & Fang, Fang, 2021. "Real-time optimal operation of integrated electricity and heat system considering reserve provision of large-scale heat pumps," Energy, Elsevier, vol. 237(C).
    10. Zhang, Menglin & Wu, Qiuwei & Wen, Jinyu & Pan, Bo & Qi, Shiqiang, 2020. "Two-stage stochastic optimal operation of integrated electricity and heat system considering reserve of flexible devices and spatial-temporal correlation of wind power," Applied Energy, Elsevier, vol. 275(C).
    11. Huang, Jinbo & Li, Zhigang & Wu, Q.H., 2017. "Coordinated dispatch of electric power and district heating networks: A decentralized solution using optimality condition decomposition," Applied Energy, Elsevier, vol. 206(C), pages 1508-1522.
    12. Zheng, Jinfu & Zhou, Zhigang & Zhao, Jianing & Wang, Jinda, 2018. "Effects of the operation regulation modes of district heating system on an integrated heat and power dispatch system for wind power integration," Applied Energy, Elsevier, vol. 230(C), pages 1126-1139.
    13. Schur, Rouven & Gönsch, Jochen & Hassler, Michael, 2019. "Time-consistent, risk-averse dynamic pricing," European Journal of Operational Research, Elsevier, vol. 277(2), pages 587-603.
    14. Wang, Dan & Zhi, Yun-qiang & Jia, Hong-jie & Hou, Kai & Zhang, Shen-xi & Du, Wei & Wang, Xu-dong & Fan, Meng-hua, 2019. "Optimal scheduling strategy of district integrated heat and power system with wind power and multiple energy stations considering thermal inertia of buildings under different heating regulation modes," Applied Energy, Elsevier, vol. 240(C), pages 341-358.
    15. Bakker, Hannah & Dunke, Fabian & Nickel, Stefan, 2020. "A structuring review on multi-stage optimization under uncertainty: Aligning concepts from theory and practice," Omega, Elsevier, vol. 96(C).
    16. Zhang, Menglin & Wu, Qiuwei & Wen, Jinyu & Zhou, Bo & Guan, Qinyue & Tan, Jin & Lin, Zhongwei & Fang, Fang, 2022. "Day-ahead stochastic scheduling of integrated electricity and heat system considering reserve provision by large-scale heat pumps," Applied Energy, Elsevier, vol. 307(C).
    17. Tan, Jin & Wu, Qiuwei & Wei, Wei & Liu, Feng & Li, Canbing & Zhou, Bin, 2020. "Decentralized robust energy and reserve Co-optimization for multiple integrated electricity and heating systems," Energy, Elsevier, vol. 205(C).
    18. Luo, Xi & Liu, Yanfeng & Feng, Pingan & Gao, Yuan & Guo, Zhenxiang, 2021. "Optimization of a solar-based integrated energy system considering interaction between generation, network, and demand side," Applied Energy, Elsevier, vol. 294(C).
    19. Li, Xue & Li, Wenming & Zhang, Rufeng & Jiang, Tao & Chen, Houhe & Li, Guoqing, 2020. "Collaborative scheduling and flexibility assessment of integrated electricity and district heating systems utilizing thermal inertia of district heating network and aggregated buildings," Applied Energy, Elsevier, vol. 258(C).
    20. Ping Li & Haixia Wang & Quan Lv & Weidong Li, 2017. "Combined Heat and Power Dispatch Considering Heat Storage of Both Buildings and Pipelines in District Heating System for Wind Power Integration," Energies, MDPI, vol. 10(7), pages 1-19, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:198:y:2020:i:c:s0360544220304540. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.