IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v13y2020i10p2632-d361431.html
   My bibliography  Save this article

Optimal Operation Control of PV-Biomass Gasifier-Diesel-Hybrid Systems Using Reinforcement Learning Techniques

Author

Listed:
  • Alexander N. Kozlov

    (Energy Systems Institute of Siberian Branch of Russian Academy of Sciences, 664033 Irkutsk, Russia)

  • Nikita V. Tomin

    (Energy Systems Institute of Siberian Branch of Russian Academy of Sciences, 664033 Irkutsk, Russia)

  • Denis N. Sidorov

    (Energy Systems Institute of Siberian Branch of Russian Academy of Sciences, 664033 Irkutsk, Russia
    Baikal School of BRICS, Irkutsk National Research Technical University, 664074 Irkutsk, Russia)

  • Electo E. S. Lora

    (Mechanical Engineering Institute, Federal University of Itajuba, Itajuba 37500-103, Brazil)

  • Victor G. Kurbatsky

    (Energy Systems Institute of Siberian Branch of Russian Academy of Sciences, 664033 Irkutsk, Russia)

Abstract

The importance of efficient utilization of biomass as renewable energy in terms of global warming and resource shortages are well known and documented. Biomass gasification is a promising power technology especially for decentralized energy systems. Decisive progress has been made in the gasification technologies development during the last decade. This paper deals with the control and optimization problems for an isolated microgrid combining the renewable energy sources (solar energy and biomass gasification) with a diesel power plant. The control problem of an isolated microgrid is formulated as a Markov decision process and we studied how reinforcement learning can be employed to address this problem to minimize the total system cost. The most economic microgrid configuration was found, and it uses biomass gasification units with an internal combustion engine operating both in single-fuel mode (producer gas) and in dual-fuel mode (diesel fuel and producer gas).

Suggested Citation

  • Alexander N. Kozlov & Nikita V. Tomin & Denis N. Sidorov & Electo E. S. Lora & Victor G. Kurbatsky, 2020. "Optimal Operation Control of PV-Biomass Gasifier-Diesel-Hybrid Systems Using Reinforcement Learning Techniques," Energies, MDPI, vol. 13(10), pages 1-20, May.
    • Handle: RePEc:gam:jeners:v:13:y:2020:i:10:p:2632-:d:361431
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/13/10/2632/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/13/10/2632/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Luu Ngoc An & Tran Quoc Tuan, 2018. "Dynamic Programming for Optimal Energy Management of Hybrid Wind–PV–Diesel–Battery," Energies, MDPI, vol. 11(11), pages 1-16, November.
    2. Banerjee, Rangan, 2006. "Comparison of options for distributed generation in India," Energy Policy, Elsevier, vol. 34(1), pages 101-111, January.
    3. Cuesta, M.A. & Castillo-Calzadilla, T. & Borges, C.E., 2020. "A critical analysis on hybrid renewable energy modeling tools: An emerging opportunity to include social indicators to optimise systems in small communities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 122(C).
    4. Rajbongshi, Rumi & Borgohain, Devashree & Mahapatra, Sadhan, 2017. "Optimization of PV-biomass-diesel and grid base hybrid energy systems for rural electrification by using HOMER," Energy, Elsevier, vol. 126(C), pages 461-474.
    5. Anvari, Simin & Khalilarya, Sharam & Zare, V., 2018. "Exergoeconomic and environmental analysis of a novel configuration of solar-biomass hybrid power generation system," Energy, Elsevier, vol. 165(PB), pages 776-789.
    6. Ramos, Ana & Monteiro, Eliseu & Silva, Valter & Rouboa, Abel, 2018. "Co-gasification and recent developments on waste-to-energy conversion: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 380-398.
    7. Howaniec, Natalia & Smoliński, Adam & Cempa-Balewicz, Magdalena, 2015. "Experimental study on application of high temperature reactor excess heat in the process of coal and biomass co-gasification to hydrogen-rich gas," Energy, Elsevier, vol. 84(C), pages 455-461.
    8. Sansaniwal, S.K. & Pal, K. & Rosen, M.A. & Tyagi, S.K., 2017. "Recent advances in the development of biomass gasification technology: A comprehensive review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 72(C), pages 363-384.
    9. Li, Lanyu & Yao, Zhiyi & You, Siming & Wang, Chi-Hwa & Chong, Clive & Wang, Xiaonan, 2019. "Optimal design of negative emission hybrid renewable energy systems with biochar production," Applied Energy, Elsevier, vol. 243(C), pages 233-249.
    10. Elsner, Witold & Wysocki, Marian & Niegodajew, Paweł & Borecki, Roman, 2017. "Experimental and economic study of small-scale CHP installation equipped with downdraft gasifier and internal combustion engine," Applied Energy, Elsevier, vol. 202(C), pages 213-227.
    11. Denis Sidorov & Daniil Panasetsky & Nikita Tomin & Dmitriy Karamov & Aleksei Zhukov & Ildar Muftahov & Aliona Dreglea & Fang Liu & Yong Li, 2020. "Toward Zero-Emission Hybrid AC/DC Power Systems with Renewable Energy Sources and Storages: A Case Study from Lake Baikal Region," Energies, MDPI, vol. 13(5), pages 1-18, March.
    12. Arnau González & Jordi-Roger Riba & Antoni Rius, 2015. "Optimal Sizing of a Hybrid Grid-Connected Photovoltaic–Wind–Biomass Power System," Sustainability, MDPI, vol. 7(9), pages 1-20, September.
    13. Munuswamy, Suresh & Nakamura, Keiko & Katta, Ajitha, 2011. "Comparing the cost of electricity sourced from a fuel cell-based renewable energy system and the national grid to electrify a rural health centre in India: A case study," Renewable Energy, Elsevier, vol. 36(11), pages 2978-2983.
    14. Brida V. Mbuwir & Frederik Ruelens & Fred Spiessens & Geert Deconinck, 2017. "Battery Energy Management in a Microgrid Using Batch Reinforcement Learning," Energies, MDPI, vol. 10(11), pages 1-19, November.
    15. Parihar, Amit Kumar Singh & Sethi, Virendra & Banerjee, Rangan, 2019. "Sizing of biomass based distributed hybrid power generation systems in India," Renewable Energy, Elsevier, vol. 134(C), pages 1400-1422.
    16. Siddaiah, Rajanna & Saini, R.P., 2016. "A review on planning, configurations, modeling and optimization techniques of hybrid renewable energy systems for off grid applications," Renewable and Sustainable Energy Reviews, Elsevier, vol. 58(C), pages 376-396.
    17. Ying Ji & Jianhui Wang & Jiacan Xu & Xiaoke Fang & Huaguang Zhang, 2019. "Real-Time Energy Management of a Microgrid Using Deep Reinforcement Learning," Energies, MDPI, vol. 12(12), pages 1-21, June.
    18. Sharma, Mohit & Kaushal, Rajneesh, 2020. "Performance and emission analysis of a dual fuel variable compression ratio (VCR) CI engine utilizing producer gas derived from walnut shells," Energy, Elsevier, vol. 192(C).
    19. González, Arnau & Riba, Jordi-Roger & Rius, Antoni & Puig, Rita, 2015. "Optimal sizing of a hybrid grid-connected photovoltaic and wind power system," Applied Energy, Elsevier, vol. 154(C), pages 752-762.
    20. Pérez-Navarro, A. & Alfonso, D. & Álvarez, C. & Ibáñez, F. & Sánchez, C. & Segura, I., 2010. "Hybrid biomass-wind power plant for reliable energy generation," Renewable Energy, Elsevier, vol. 35(7), pages 1436-1443.
    21. Chauhan, Anurag & Saini, R.P., 2014. "A review on Integrated Renewable Energy System based power generation for stand-alone applications: Configurations, storage options, sizing methodologies and control," Renewable and Sustainable Energy Reviews, Elsevier, vol. 38(C), pages 99-120.
    22. Martínez, Juan Daniel & Mahkamov, Khamid & Andrade, Rubenildo V. & Silva Lora, Electo E., 2012. "Syngas production in downdraft biomass gasifiers and its application using internal combustion engines," Renewable Energy, Elsevier, vol. 38(1), pages 1-9.
    23. Thallam Thattai, A. & Oldenbroek, V. & Schoenmakers, L. & Woudstra, T. & Aravind, P.V., 2016. "Experimental model validation and thermodynamic assessment on high percentage (up to 70%) biomass co-gasification at the 253MWe integrated gasification combined cycle power plant in Buggenum, The Neth," Applied Energy, Elsevier, vol. 168(C), pages 381-393.
    24. Guo, Shaopeng & Liu, Qibin & Sun, Jie & Jin, Hongguang, 2018. "A review on the utilization of hybrid renewable energy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 91(C), pages 1121-1147.
    25. Sawle, Yashwant & Gupta, S.C. & Bohre, Aashish Kumar, 2018. "Socio-techno-economic design of hybrid renewable energy system using optimization techniques," Renewable Energy, Elsevier, vol. 119(C), pages 459-472.
    26. Susastriawan, A.A.P. & Saptoadi, Harwin & Purnomo,, 2017. "Small-scale downdraft gasifiers for biomass gasification: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 76(C), pages 989-1003.
    27. Sutar, Kailasnath B. & Kohli, Sangeeta & Ravi, M.R., 2017. "Design, development and testing of small downdraft gasifiers for domestic cookstoves," Energy, Elsevier, vol. 124(C), pages 447-460.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kafetzis, A. & Ziogou, C. & Panopoulos, K.D. & Papadopoulou, S. & Seferlis, P. & Voutetakis, S., 2020. "Energy management strategies based on hybrid automata for islanded microgrids with renewable sources, batteries and hydrogen," Renewable and Sustainable Energy Reviews, Elsevier, vol. 134(C).
    2. Nadia Cerone & Francesco Zimbardi, 2021. "Effects of Oxygen and Steam Equivalence Ratios on Updraft Gasification of Biomass," Energies, MDPI, vol. 14(9), pages 1-18, May.
    3. Louis Desportes & Inbar Fijalkow & Pierre Andry, 2021. "Deep Reinforcement Learning for Hybrid Energy Storage Systems: Balancing Lead and Hydrogen Storage," Energies, MDPI, vol. 14(15), pages 1-22, August.
    4. Tomin, Nikita & Shakirov, Vladislav & Kozlov, Aleksander & Sidorov, Denis & Kurbatsky, Victor & Rehtanz, Christian & Lora, Electo E.S., 2022. "Design and optimal energy management of community microgrids with flexible renewable energy sources," Renewable Energy, Elsevier, vol. 183(C), pages 903-921.
    5. Lu, Jun & Liu, Tianqi & He, Chuan & Nan, Lu & Hu, Xiaotong, 2021. "Robust day-ahead coordinated scheduling of multi-energy systems with integrated heat-electricity demand response and high penetration of renewable energy," Renewable Energy, Elsevier, vol. 178(C), pages 466-482.
    6. Daniel de Cerqueira Lima e Penalva Santos & Juliana Berendt Ihler & Laene Oliveira Soares & Yana Amaral Alves & Cristina Gomez Souza & Ronney Arismel Mancebo Boloy, 2022. "Global Trends and Opportunities in Hybrid Microgrid Systems Using Renewable Energies," International Journal of Energy Economics and Policy, Econjournals, vol. 12(4), pages 263-273, July.
    7. Lee, Jechan & Kim, Soosan & You, Siming & Park, Young-Kwon, 2023. "Bioenergy generation from thermochemical conversion of lignocellulosic biomass-based integrated renewable energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 178(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rajbongshi, Rumi & Borgohain, Devashree & Mahapatra, Sadhan, 2017. "Optimization of PV-biomass-diesel and grid base hybrid energy systems for rural electrification by using HOMER," Energy, Elsevier, vol. 126(C), pages 461-474.
    2. Thirunavukkarasu, M. & Sawle, Yashwant & Lala, Himadri, 2023. "A comprehensive review on optimization of hybrid renewable energy systems using various optimization techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 176(C).
    3. Akbas, Beste & Kocaman, Ayse Selin & Nock, Destenie & Trotter, Philipp A., 2022. "Rural electrification: An overview of optimization methods," Renewable and Sustainable Energy Reviews, Elsevier, vol. 156(C).
    4. Hameed, Zeeshan & Aslam, Muhammad & Khan, Zakir & Maqsood, Khuram & Atabani, A.E. & Ghauri, Moinuddin & Khurram, Muhammad Shahzad & Rehan, Mohammad & Nizami, Abdul-Sattar, 2021. "Gasification of municipal solid waste blends with biomass for energy production and resources recovery: Current status, hybrid technologies and innovative prospects," Renewable and Sustainable Energy Reviews, Elsevier, vol. 136(C).
    5. Mehrpooya, Mehdi & Khalili, Maryam & Sharifzadeh, Mohammad Mehdi Moftakhari, 2018. "Model development and energy and exergy analysis of the biomass gasification process (Based on the various biomass sources)," Renewable and Sustainable Energy Reviews, Elsevier, vol. 91(C), pages 869-887.
    6. Bhatt, Ankit & Sharma, M.P. & Saini, R.P., 2016. "Feasibility and sensitivity analysis of an off-grid micro hydro–photovoltaic–biomass and biogas–diesel–battery hybrid energy system for a remote area in Uttarakhand state, India," Renewable and Sustainable Energy Reviews, Elsevier, vol. 61(C), pages 53-69.
    7. Laura Canale & Anna Rita Di Fazio & Mario Russo & Andrea Frattolillo & Marco Dell’Isola, 2021. "An Overview on Functional Integration of Hybrid Renewable Energy Systems in Multi-Energy Buildings," Energies, MDPI, vol. 14(4), pages 1-33, February.
    8. Adefarati, T. & Bansal, R.C., 2019. "Reliability, economic and environmental analysis of a microgrid system in the presence of renewable energy resources," Applied Energy, Elsevier, vol. 236(C), pages 1089-1114.
    9. Katheryn Donado & Loraine Navarro & Christian G. Quintero M. & Mauricio Pardo, 2019. "HYRES: A Multi-Objective Optimization Tool for Proper Configuration of Renewable Hybrid Energy Systems," Energies, MDPI, vol. 13(1), pages 1-20, December.
    10. Tomar, Vivek & Tiwari, G.N., 2017. "Techno-economic evaluation of grid connected PV system for households with feed in tariff and time of day tariff regulation in New Delhi – A sustainable approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 70(C), pages 822-835.
    11. Pal, Pikaso & Mukherjee, V., 2021. "Off-grid solar photovoltaic/hydrogen fuel cell system for renewable energy generation: An investigation based on techno-economic feasibility assessment for the application of end-user load demand in N," Renewable and Sustainable Energy Reviews, Elsevier, vol. 149(C).
    12. Seyfettin Vadi & Sanjeevikumar Padmanaban & Ramazan Bayindir & Frede Blaabjerg & Lucian Mihet-Popa, 2019. "A Review on Optimization and Control Methods Used to Provide Transient Stability in Microgrids," Energies, MDPI, vol. 12(18), pages 1-20, September.
    13. Theo, Wai Lip & Lim, Jeng Shiun & Ho, Wai Shin & Hashim, Haslenda & Lee, Chew Tin, 2017. "Review of distributed generation (DG) system planning and optimisation techniques: Comparison of numerical and mathematical modelling methods," Renewable and Sustainable Energy Reviews, Elsevier, vol. 67(C), pages 531-573.
    14. Dmitriy N. Karamov & Pavel V. Ilyushin & Konstantin V. Suslov, 2022. "Electrification of Rural Remote Areas Using Renewable Energy Sources: Literature Review," Energies, MDPI, vol. 15(16), pages 1-13, August.
    15. Guo, Shaopeng & Liu, Qibin & Sun, Jie & Jin, Hongguang, 2018. "A review on the utilization of hybrid renewable energy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 91(C), pages 1121-1147.
    16. Kartal, Furkan & Özveren, Uğur, 2020. "A deep learning approach for prediction of syngas lower heating value from CFB gasifier in Aspen plus®," Energy, Elsevier, vol. 209(C).
    17. Díaz González, Carlos A. & Pacheco Sandoval, Leonardo, 2020. "Sustainability aspects of biomass gasification systems for small power generation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 134(C).
    18. Hassan, Aakash & Al-Abdeli, Yasir M. & Masek, Martin & Bass, Octavian, 2022. "Optimal sizing and energy scheduling of grid-supplemented solar PV systems with battery storage: Sensitivity of reliability and financial constraints," Energy, Elsevier, vol. 238(PA).
    19. Harri Aaltonen & Seppo Sierla & Rakshith Subramanya & Valeriy Vyatkin, 2021. "A Simulation Environment for Training a Reinforcement Learning Agent Trading a Battery Storage," Energies, MDPI, vol. 14(17), pages 1-20, September.
    20. Ramos, Ana & Monteiro, Eliseu & Rouboa, Abel, 2019. "Numerical approaches and comprehensive models for gasification process: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 110(C), pages 188-206.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:13:y:2020:i:10:p:2632-:d:361431. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.