IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v10y2017i5p638-d97735.html
   My bibliography  Save this article

Bacteria Foraging Reinforcement Learning for Risk-Based Economic Dispatch via Knowledge Transfer

Author

Listed:
  • Chuanjia Han

    (School of Electric Power, South China University of Technology, Guangzhou 510640, China)

  • Bo Yang

    (Faculty of Electric Power Engineering, Kunming University of Science and Technology, Kunming 650500, China)

  • Tao Bao

    (School of Electric Power, South China University of Technology, Guangzhou 510640, China)

  • Tao Yu

    (School of Electric Power, South China University of Technology, Guangzhou 510640, China)

  • Xiaoshun Zhang

    (School of Electric Power, South China University of Technology, Guangzhou 510640, China)

Abstract

This paper proposes a novel bacteria foraging reinforcement learning with knowledge transfer method for risk-based economic dispatch, in which the economic dispatch is integrated with risk assessment theory to represent the uncertainties of active power demand and contingencies during power system operations. Moreover, a multi-agent collaboration is employed to accelerate the convergence of knowledge matrix, which is decomposed into several lower dimension sub-matrices via a knowledge extension, thus the curse of dimension can be effectively avoided. Besides, the convergence rate of bacteria foraging reinforcement learning is increased dramatically through a knowledge transfer after obtaining the optimal knowledge matrices of source tasks in pre-learning. The performance of bacteria foraging reinforcement learning has been thoroughly evaluated on IEEE RTS-79 system. Simulation results demonstrate that it can outperform conventional artificial intelligence algorithms in terms of global convergence and convergence rate.

Suggested Citation

  • Chuanjia Han & Bo Yang & Tao Bao & Tao Yu & Xiaoshun Zhang, 2017. "Bacteria Foraging Reinforcement Learning for Risk-Based Economic Dispatch via Knowledge Transfer," Energies, MDPI, vol. 10(5), pages 1-24, May.
  • Handle: RePEc:gam:jeners:v:10:y:2017:i:5:p:638-:d:97735
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/10/5/638/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/10/5/638/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Whei-Min Lin & Chia-Sheng Tu & Ming-Tang Tsai, 2015. "Energy Management Strategy for Microgrids by Using Enhanced Bee Colony Optimization," Energies, MDPI, vol. 9(1), pages 1-16, December.
    2. Y. Liu & K.M. Passino, 2002. "Biomimicry of Social Foraging Bacteria for Distributed Optimization: Models, Principles, and Emergent Behaviors," Journal of Optimization Theory and Applications, Springer, vol. 115(3), pages 603-628, December.
    3. Holmberg, Henrik & Tuomaala, Mari & Haikonen, Turo & Ahtila, Pekka, 2012. "Allocation of fuel costs and CO2-emissions to heat and power in an industrial CHP plant: Case integrated pulp and paper mill," Applied Energy, Elsevier, vol. 93(C), pages 614-623.
    4. Zhang, Xiaoshun & Chen, Yixuan & Yu, Tao & Yang, Bo & Qu, Kaiping & Mao, Senmao, 2017. "Equilibrium-inspired multiagent optimizer with extreme transfer learning for decentralized optimal carbon-energy combined-flow of large-scale power systems," Applied Energy, Elsevier, vol. 189(C), pages 157-176.
    5. Zhou, Wei & Lou, Chengzhi & Li, Zhongshi & Lu, Lin & Yang, Hongxing, 2010. "Current status of research on optimum sizing of stand-alone hybrid solar-wind power generation systems," Applied Energy, Elsevier, vol. 87(2), pages 380-389, February.
    6. Huiru Zhao & Yuwei Wang & Sen Guo & Mingrui Zhao & Chao Zhang, 2016. "Application of a Gradient Descent Continuous Actor-Critic Algorithm for Double-Side Day-Ahead Electricity Market Modeling," Energies, MDPI, vol. 9(9), pages 1-20, September.
    7. Zeyu Chen & Rui Xiong & Kunyu Wang & Bin Jiao, 2015. "Optimal Energy Management Strategy of a Plug-in Hybrid Electric Vehicle Based on a Particle Swarm Optimization Algorithm," Energies, MDPI, vol. 8(5), pages 1-18, April.
    8. Cheng Lin & Zhifeng Xu, 2015. "Wheel Torque Distribution of Four-Wheel-Drive Electric Vehicles Based on Multi-Objective Optimization," Energies, MDPI, vol. 8(5), pages 1-17, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhu, Ziqing & Hu, Ze & Chan, Ka Wing & Bu, Siqi & Zhou, Bin & Xia, Shiwei, 2023. "Reinforcement learning in deregulated energy market: A comprehensive review," Applied Energy, Elsevier, vol. 329(C).
    2. Zhang, Ning & Sun, Qiuye & Yang, Lingxiao, 2021. "A two-stage multi-objective optimal scheduling in the integrated energy system with We-Energy modeling," Energy, Elsevier, vol. 215(PB).
    3. Xiaoya Shang & Zhigang Li & Tianyao Ji & P. Z. Wu & Qinghua Wu, 2017. "Online Area Load Modeling in Power Systems Using Enhanced Reinforcement Learning," Energies, MDPI, vol. 10(11), pages 1-17, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fethi Khlifi & Habib Cherif & Jamel Belhadj, 2021. "Environmental and Economic Optimization and Sizing of a Micro-Grid with Battery Storage for an Industrial Application," Energies, MDPI, vol. 14(18), pages 1-17, September.
    2. Zhang, Wei & Zhu, Rui & Liu, Bin & Ramakrishna, Seeram, 2012. "High-performance hybrid solar cells employing metal-free organic dye modified TiO2 as photoelectrode," Applied Energy, Elsevier, vol. 90(1), pages 305-308.
    3. Mwaka I. Juma & Bakari M. M. Mwinyiwiwa & Consalva J. Msigwa & Aviti T. Mushi, 2021. "Design of a Hybrid Energy System with Energy Storage for Standalone DC Microgrid Application," Energies, MDPI, vol. 14(18), pages 1-15, September.
    4. Yiqi Chu & Chengcai Li & Yefang Wang & Jing Li & Jian Li, 2016. "A Long-Term Wind Speed Ensemble Forecasting System with Weather Adapted Correction," Energies, MDPI, vol. 9(11), pages 1-20, October.
    5. Du, Guodong & Zou, Yuan & Zhang, Xudong & Kong, Zehui & Wu, Jinlong & He, Dingbo, 2019. "Intelligent energy management for hybrid electric tracked vehicles using online reinforcement learning," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    6. Xiangyuan Zheng & Huadong Zheng & Yu Lei & Yi Li & Wei Li, 2020. "An Offshore Floating Wind–Solar–Aquaculture System: Concept Design and Extreme Response in Survival Conditions," Energies, MDPI, vol. 13(3), pages 1-23, January.
    7. Segurado, R. & Madeira, J.F.A. & Costa, M. & Duić, N. & Carvalho, M.G., 2016. "Optimization of a wind powered desalination and pumped hydro storage system," Applied Energy, Elsevier, vol. 177(C), pages 487-499.
    8. Akhlaque Ahmad Khan & Ahmad Faiz Minai & Rupendra Kumar Pachauri & Hasmat Malik, 2022. "Optimal Sizing, Control, and Management Strategies for Hybrid Renewable Energy Systems: A Comprehensive Review," Energies, MDPI, vol. 15(17), pages 1-29, August.
    9. Du, Guodong & Zou, Yuan & Zhang, Xudong & Liu, Teng & Wu, Jinlong & He, Dingbo, 2020. "Deep reinforcement learning based energy management for a hybrid electric vehicle," Energy, Elsevier, vol. 201(C).
    10. Ma, Tao & Yang, Hongxing & Lu, Lin & Peng, Jinqing, 2014. "Technical feasibility study on a standalone hybrid solar-wind system with pumped hydro storage for a remote island in Hong Kong," Renewable Energy, Elsevier, vol. 69(C), pages 7-15.
    11. Sampaio, Henrique César & Dias, Rubens Alves & Balestieri, José Antônio Perrella, 2013. "Sustainable urban energy planning: The case study of a tropical city," Applied Energy, Elsevier, vol. 104(C), pages 924-935.
    12. Pina, Eduardo A. & Lozano, Miguel A. & Serra, Luis M., 2018. "Thermoeconomic cost allocation in simple trigeneration systems including thermal energy storage," Energy, Elsevier, vol. 153(C), pages 170-184.
    13. Mudasser, Muhammad & Yiridoe, Emmanuel K. & Corscadden, Kenneth, 2015. "Cost-benefit analysis of grid-connected wind–biogas hybrid energy production, by turbine capacity and site," Renewable Energy, Elsevier, vol. 80(C), pages 573-582.
    14. Lisicki, Michal & Lubitz, William & Taylor, Graham W., 2016. "Optimal design and operation of Archimedes screw turbines using Bayesian optimization," Applied Energy, Elsevier, vol. 183(C), pages 1404-1417.
    15. Fan Li & Jingxi Su & Bo Sun, 2023. "An Optimal Scheduling Method for an Integrated Energy System Based on an Improved k-Means Clustering Algorithm," Energies, MDPI, vol. 16(9), pages 1-22, April.
    16. Yin, Linfei & Wang, Tao & Zheng, Baomin, 2021. "Analytical adaptive distributed multi-objective optimization algorithm for optimal power flow problems," Energy, Elsevier, vol. 216(C).
    17. Caballero, F. & Sauma, E. & Yanine, F., 2013. "Business optimal design of a grid-connected hybrid PV (photovoltaic)-wind energy system without energy storage for an Easter Island's block," Energy, Elsevier, vol. 61(C), pages 248-261.
    18. Zhang, Kai & Li, Jingzhi & He, Zhubin & Yan, Wanfeng, 2018. "Microgrid energy dispatching for industrial zones with renewable generations and electric vehicles via stochastic optimization and learning," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 501(C), pages 356-369.
    19. Kaabeche, A. & Belhamel, M. & Ibtiouen, R., 2011. "Sizing optimization of grid-independent hybrid photovoltaic/wind power generation system," Energy, Elsevier, vol. 36(2), pages 1214-1222.
    20. Qi, Chunyang & Zhu, Yiwen & Song, Chuanxue & Yan, Guangfu & Xiao, Feng & Da wang, & Zhang, Xu & Cao, Jingwei & Song, Shixin, 2022. "Hierarchical reinforcement learning based energy management strategy for hybrid electric vehicle," Energy, Elsevier, vol. 238(PA).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:10:y:2017:i:5:p:638-:d:97735. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.