IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v189y2019ics0360544219319401.html
   My bibliography  Save this article

A battery management strategy in microgrid for personalized customer requirements

Author

Listed:
  • Chen, Pengzhan
  • Liu, Mengchao
  • Chen, Chuanxi
  • Shang, Xin

Abstract

Different microgrid (MG) users possess different preferences, which effectively stimulates the energy management needs of MG. Based upon different preferences, this paper proposes a battery management strategy in MG for personalized customer requirements, aiming to lower the cost of electricity and stabilize the state of charge (SOC) of energy-storage devices. Firstly, the Long Short Term Memory (LSTM) algorithm is used to predict the user’s load power and generation power of renewable energy, followed by the construction of a corresponding reward function for different preferences of users. Secondly, according to the prediction, the Deep Deterministic Policy Gradient (DDPG) algorithm is used to carry out massive and intensive trainings on the decision model. Furthermore, the L2 regularization correction is introduced to avoid over-fitting during neural network training. Then, based on the predicted power data for the forecast day, an optimal control strategy of battery that meets the needs of differently preferred users is obtained. Finally, comparative experiments have been conducted in four scenarios for economic user, conservative user, compromised user, and user who did not adopt a decision-making framework. The results show that the battery management strategy proposed in this paper can meet the needs of differently preferred users, among whom, the profit of compromised user using the framework has increased by 55.19% and the fluctuation range of SOC have decreased by 67.05% compared with user who did not adopt the decision-making framework.

Suggested Citation

  • Chen, Pengzhan & Liu, Mengchao & Chen, Chuanxi & Shang, Xin, 2019. "A battery management strategy in microgrid for personalized customer requirements," Energy, Elsevier, vol. 189(C).
    • Handle: RePEc:eee:energy:v:189:y:2019:i:c:s0360544219319401
    DOI: 10.1016/j.energy.2019.116245
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544219319401
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2019.116245?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ahmad Khan, Aftab & Naeem, Muhammad & Iqbal, Muhammad & Qaisar, Saad & Anpalagan, Alagan, 2016. "A compendium of optimization objectives, constraints, tools and algorithms for energy management in microgrids," Renewable and Sustainable Energy Reviews, Elsevier, vol. 58(C), pages 1664-1683.
    2. Kofinas, P. & Dounis, A.I. & Vouros, G.A., 2018. "Fuzzy Q-Learning for multi-agent decentralized energy management in microgrids," Applied Energy, Elsevier, vol. 219(C), pages 53-67.
    3. Tabar, Vahid Sohrabi & Jirdehi, Mehdi Ahmadi & Hemmati, Reza, 2017. "Energy management in microgrid based on the multi objective stochastic programming incorporating portable renewable energy resource as demand response option," Energy, Elsevier, vol. 118(C), pages 827-839.
    4. Askarzadeh, Alireza, 2017. "Distribution generation by photovoltaic and diesel generator systems: Energy management and size optimization by a new approach for a stand-alone application," Energy, Elsevier, vol. 122(C), pages 542-551.
    5. Tarroja, Brian & Zhang, Li & Wifvat, Van & Shaffer, Brendan & Samuelsen, Scott, 2016. "Assessing the stationary energy storage equivalency of vehicle-to-grid charging battery electric vehicles," Energy, Elsevier, vol. 106(C), pages 673-690.
    6. Brida V. Mbuwir & Frederik Ruelens & Fred Spiessens & Geert Deconinck, 2017. "Battery Energy Management in a Microgrid Using Batch Reinforcement Learning," Energies, MDPI, vol. 10(11), pages 1-19, November.
    7. Zahra Pooranian & Jemal H. Abawajy & Vinod P & Mauro Conti, 2018. "Scheduling Distributed Energy Resource Operation and Daily Power Consumption for a Smart Building to Optimize Economic and Environmental Parameters," Energies, MDPI, vol. 11(6), pages 1-17, May.
    8. Kuznetsova, Elizaveta & Li, Yan-Fu & Ruiz, Carlos & Zio, Enrico & Ault, Graham & Bell, Keith, 2013. "Reinforcement learning for microgrid energy management," Energy, Elsevier, vol. 59(C), pages 133-146.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Miseta, Tamás & Fodor, Attila & Vathy-Fogarassy, Ágnes, 2022. "Energy trading strategy for storage-based renewable power plants," Energy, Elsevier, vol. 250(C).
    2. Grace Muriithi & Sunetra Chowdhury, 2021. "Optimal Energy Management of a Grid-Tied Solar PV-Battery Microgrid: A Reinforcement Learning Approach," Energies, MDPI, vol. 14(9), pages 1-24, May.
    3. Khawaja Haider Ali & Mohammad Abusara & Asif Ali Tahir & Saptarshi Das, 2023. "Dual-Layer Q-Learning Strategy for Energy Management of Battery Storage in Grid-Connected Microgrids," Energies, MDPI, vol. 16(3), pages 1-17, January.
    4. Mudhafar Al-Saadi & Maher Al-Greer & Michael Short, 2021. "Strategies for Controlling Microgrid Networks with Energy Storage Systems: A Review," Energies, MDPI, vol. 14(21), pages 1-45, November.
    5. Guo, Chenyu & Wang, Xin & Zheng, Yihui & Zhang, Feng, 2022. "Real-time optimal energy management of microgrid with uncertainties based on deep reinforcement learning," Energy, Elsevier, vol. 238(PC).
    6. Jakub Jasiński & Mariusz Kozakiewicz & Maciej Sołtysik, 2021. "The Effectiveness of Energy Cooperatives Operating on the Capacity Market," Energies, MDPI, vol. 14(11), pages 1-20, May.
    7. Tukymbekov, Didar & Saymbetov, Ahmet & Nurgaliyev, Madiyar & Kuttybay, Nurzhigit & Dosymbetova, Gulbakhar & Svanbayev, Yeldos, 2021. "Intelligent autonomous street lighting system based on weather forecast using LSTM," Energy, Elsevier, vol. 231(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nyong-Bassey, Bassey Etim & Giaouris, Damian & Patsios, Charalampos & Papadopoulou, Simira & Papadopoulos, Athanasios I. & Walker, Sara & Voutetakis, Spyros & Seferlis, Panos & Gadoue, Shady, 2020. "Reinforcement learning based adaptive power pinch analysis for energy management of stand-alone hybrid energy storage systems considering uncertainty," Energy, Elsevier, vol. 193(C).
    2. Zia, Muhammad Fahad & Elbouchikhi, Elhoussin & Benbouzid, Mohamed, 2018. "Microgrids energy management systems: A critical review on methods, solutions, and prospects," Applied Energy, Elsevier, vol. 222(C), pages 1033-1055.
    3. Fausto Calderon-Obaldia & Jordi Badosa & Anne Migan-Dubois & Vincent Bourdin, 2020. "A Two-Step Energy Management Method Guided by Day-Ahead Quantile Solar Forecasts: Cross-Impacts on Four Services for Smart-Buildings," Energies, MDPI, vol. 13(22), pages 1-29, November.
    4. Van-Hai Bui & Akhtar Hussain & Hak-Man Kim, 2019. "Q-Learning-Based Operation Strategy for Community Battery Energy Storage System (CBESS) in Microgrid System," Energies, MDPI, vol. 12(9), pages 1-17, May.
    5. Harrold, Daniel J.B. & Cao, Jun & Fan, Zhong, 2022. "Data-driven battery operation for energy arbitrage using rainbow deep reinforcement learning," Energy, Elsevier, vol. 238(PC).
    6. Zhu, Ziqing & Hu, Ze & Chan, Ka Wing & Bu, Siqi & Zhou, Bin & Xia, Shiwei, 2023. "Reinforcement learning in deregulated energy market: A comprehensive review," Applied Energy, Elsevier, vol. 329(C).
    7. Harrold, Daniel J.B. & Cao, Jun & Fan, Zhong, 2022. "Renewable energy integration and microgrid energy trading using multi-agent deep reinforcement learning," Applied Energy, Elsevier, vol. 318(C).
    8. de la Hoz, Jordi & Martín, Helena & Alonso, Alex & Carolina Luna, Adriana & Matas, José & Vasquez, Juan C. & Guerrero, Josep M., 2019. "Regulatory-framework-embedded energy management system for microgrids: The case study of the Spanish self-consumption scheme," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    9. Zheng, Lingwei & Wu, Hao & Guo, Siqi & Sun, Xinyu, 2023. "Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy," Energy, Elsevier, vol. 277(C).
    10. Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.
    11. Juan D. Velásquez & Lorena Cadavid & Carlos J. Franco, 2023. "Intelligence Techniques in Sustainable Energy: Analysis of a Decade of Advances," Energies, MDPI, vol. 16(19), pages 1-45, October.
    12. Grace Muriithi & Sunetra Chowdhury, 2021. "Optimal Energy Management of a Grid-Tied Solar PV-Battery Microgrid: A Reinforcement Learning Approach," Energies, MDPI, vol. 14(9), pages 1-24, May.
    13. Tsianikas, Stamatis & Yousefi, Nooshin & Zhou, Jian & Rodgers, Mark D. & Coit, David, 2021. "A storage expansion planning framework using reinforcement learning and simulation-based optimization," Applied Energy, Elsevier, vol. 290(C).
    14. Álex Omar Topa Gavilema & José Domingo Álvarez & José Luis Torres Moreno & Manuel Pérez García, 2021. "Towards Optimal Management in Microgrids: An Overview," Energies, MDPI, vol. 14(16), pages 1-25, August.
    15. Lilia Tightiz & Joon Yoo, 2022. "A Review on a Data-Driven Microgrid Management System Integrating an Active Distribution Network: Challenges, Issues, and New Trends," Energies, MDPI, vol. 15(22), pages 1-24, November.
    16. Vázquez-Canteli, José R. & Nagy, Zoltán, 2019. "Reinforcement learning for demand response: A review of algorithms and modeling techniques," Applied Energy, Elsevier, vol. 235(C), pages 1072-1089.
    17. Yamashita, Daniela Yassuda & Vechiu, Ionel & Gaubert, Jean-Paul, 2020. "A review of hierarchical control for building microgrids," Renewable and Sustainable Energy Reviews, Elsevier, vol. 118(C).
    18. Kafetzis, A. & Ziogou, C. & Panopoulos, K.D. & Papadopoulou, S. & Seferlis, P. & Voutetakis, S., 2020. "Energy management strategies based on hybrid automata for islanded microgrids with renewable sources, batteries and hydrogen," Renewable and Sustainable Energy Reviews, Elsevier, vol. 134(C).
    19. Fontenot, Hannah & Dong, Bing, 2019. "Modeling and control of building-integrated microgrids for optimal energy management – A review," Applied Energy, Elsevier, vol. 254(C).
    20. Liu, Yixin & Shi, Haoqi & Guo, Li & Xu, Tao & Zhao, Bo & Wang, Chengshan, 2022. "Towards long-period operational reliability of independent microgrid: A risk-aware energy scheduling and stochastic optimization method," Energy, Elsevier, vol. 254(PB).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:189:y:2019:i:c:s0360544219319401. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.