IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v14y2021i17p5334-d623536.html
   My bibliography  Save this article

Q-Learning Neural Controller for Steam Generator Station in Micro Cogeneration Systems

Author

Listed:
  • Krzysztof Lalik

    (Faculty of Mechanical Engineering and Robotics, AGH University of Science and Technology, Al. Mickiewicza 30, 30-059 Krakow, Poland
    These authors contributed equally to this work.)

  • Mateusz Kozek

    (Faculty of Mechanical Engineering and Robotics, AGH University of Science and Technology, Al. Mickiewicza 30, 30-059 Krakow, Poland
    These authors contributed equally to this work.)

  • Szymon Podlasek

    (Faculty of Energy and Fuels, AGH University of Science and Technology, Al. Mickiewicza 30, 30-059 Krakow, Poland
    These authors contributed equally to this work.)

  • Rafał Figaj

    (Faculty of Energy and Fuels, AGH University of Science and Technology, Al. Mickiewicza 30, 30-059 Krakow, Poland)

  • Paweł Gut

    (Faculty of Mechanical Engineering and Robotics, AGH University of Science and Technology, Al. Mickiewicza 30, 30-059 Krakow, Poland)

Abstract

This article presents the results of the optimization of steam generator control systems powered by mixtures of liquid fuels containing biofuels. The numerical model was based on the results of experimental research of steam generator operation in an open system. The numerical model is used to build control algorithms that improve performance, increase efficiency, reduce fuel consumption and increase safety in the full range of operation of the steam generator and the cogeneration system of which it is a component. In this research, the following parameters were monitored: temperature and pressure of the circulating medium, exhaust gas temperature, oxygen content in exhaust gas, percentage control of oil burner power. Two methods of controlling the steam generator were proposed: the classic one, using the PID regulator, and the advanced one, using artificial neural networks. The work shows how the model is adapted to the real system and the impact of the control algorithms on the efficiency of the combustion process. The example is considered for the implementation of advanced control systems in micro-, small- and medium-power cogeneration and trigeneration systems in order to improve their final efficiency and increase the profitability of implementation.

Suggested Citation

  • Krzysztof Lalik & Mateusz Kozek & Szymon Podlasek & Rafał Figaj & Paweł Gut, 2021. "Q-Learning Neural Controller for Steam Generator Station in Micro Cogeneration Systems," Energies, MDPI, vol. 14(17), pages 1-13, August.
    • Handle: RePEc:gam:jeners:v:14:y:2021:i:17:p:5334-:d:623536
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/14/17/5334/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/14/17/5334/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bianco, Vincenzo & Szubel, Mateusz & Matras, Beata & Filipowicz, Mariusz & Papis, Karolina & Podlasek, Szymon, 2021. "CFD analysis and design optimization of an air manifold for a biomass boiler," Renewable Energy, Elsevier, vol. 163(C), pages 2018-2028.
    2. Menon, Ramanunni P. & Paolone, Mario & Maréchal, François, 2013. "Study of optimal design of polygeneration systems in optimal control strategies," Energy, Elsevier, vol. 55(C), pages 134-141.
    3. Sornek, Krzysztof & Filipowicz, Mariusz & Żołądek, Maciej & Kot, Radosław & Mikrut, Małgorzata, 2019. "Comparative analysis of selected thermoelectric generators operating with wood-fired stove," Energy, Elsevier, vol. 166(C), pages 1303-1313.
    4. Homod, Raad Z. & Gaeid, Khalaf S. & Dawood, Suroor M. & Hatami, Alireza & Sahari, Khairul S., 2020. "Evaluation of energy-saving potential for optimal time response of HVAC control system in smart buildings," Applied Energy, Elsevier, vol. 271(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Waseem, Muhammad & Lin, Zhenzhi & Liu, Shengyuan & Zhang, Zhi & Aziz, Tarique & Khan, Danish, 2021. "Fuzzy compromised solution-based novel home appliances scheduling and demand response with optimal dispatch of distributed energy resources," Applied Energy, Elsevier, vol. 290(C).
    2. Bruni, G. & Cordiner, S. & Mulone, V. & Sinisi, V. & Spagnolo, F., 2016. "Energy management in a domestic microgrid by means of model predictive controllers," Energy, Elsevier, vol. 108(C), pages 119-131.
    3. Lee, Minjung & Ham, Jeonggyun & Lee, Jeong-Won & Cho, Honghyun, 2023. "Analysis of thermal comfort, energy consumption, and CO2 reduction of indoor space according to the type of local heating under winter rest conditions," Energy, Elsevier, vol. 268(C).
    4. Homod, Raad Z. & Togun, Hussein & Ateeq, Adnan A. & Al-Mousawi, Fadhel Noraldeen & Yaseen, Zaher Mundher & Al-Kouz, Wael & Hussein, Ahmed Kadhim & Alawi, Omer A. & Goodarzi, Marjan & Ahmadi, Goodarz, 2022. "An innovative clustering technique to generate hybrid modeling of cooling coils for energy analysis: A case study for control performance in HVAC systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 166(C).
    5. Homod, Raad Z. & Togun, Hussein & Kadhim Hussein, Ahmed & Noraldeen Al-Mousawi, Fadhel & Yaseen, Zaher Mundher & Al-Kouz, Wael & Abd, Haider J. & Alawi, Omer A. & Goodarzi, Marjan & Hussein, Omar A., 2022. "Dynamics analysis of a novel hybrid deep clustering for unsupervised learning by reinforcement of multi-agent to energy saving in intelligent buildings," Applied Energy, Elsevier, vol. 313(C).
    6. Chetty, Raju & Nagase, Kazuo & Aihara, Makoto & Jood, Priyanka & Takazawa, Hiroyuki & Ohta, Michihiro & Yamamoto, Atsushi, 2020. "Mechanically durable thermoelectric power generation module made of Ni-based alloy as a reference for reliable testing," Applied Energy, Elsevier, vol. 260(C).
    7. Usón, Sergio & Royo, Javier & Canalís, Paula, 2023. "Integration of thermoelectric generators in a biomass boiler: Experimental tests and study of ash deposition effect," Renewable Energy, Elsevier, vol. 214(C), pages 395-406.
    8. Krzysztof Sornek, 2020. "Prototypical Biomass-Fired Micro-Cogeneration Systems—Energy and Ecological Analysis," Energies, MDPI, vol. 13(15), pages 1-16, July.
    9. Mohamed Amine Zoui & Saïd Bentouba & John G. Stocholm & Mahmoud Bourouis, 2020. "A Review on Thermoelectric Generators: Progress and Applications," Energies, MDPI, vol. 13(14), pages 1-32, July.
    10. Bracco, Stefano & Delfino, Federico & Pampararo, Fabio & Robba, Michela & Rossi, Mansueto, 2014. "A mathematical model for the optimal operation of the University of Genoa Smart Polygeneration Microgrid: Evaluation of technical, economic and environmental performance indicators," Energy, Elsevier, vol. 64(C), pages 912-922.
    11. Mancarella, Pierluigi, 2014. "MES (multi-energy systems): An overview of concepts and evaluation models," Energy, Elsevier, vol. 65(C), pages 1-17.
    12. Calise, Francesco & de Notaristefani di Vastogirardi, Giulio & Dentice d'Accadia, Massimo & Vicidomini, Maria, 2018. "Simulation of polygeneration systems," Energy, Elsevier, vol. 163(C), pages 290-337.
    13. Halhoul Merabet, Ghezlane & Essaaidi, Mohamed & Ben Haddou, Mohamed & Qolomany, Basheer & Qadir, Junaid & Anan, Muhammad & Al-Fuqaha, Ala & Abid, Mohamed Riduan & Benhaddou, Driss, 2021. "Intelligent building control systems for thermal comfort and energy-efficiency: A systematic review of artificial intelligence-assisted techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).
    14. Wang, Haichao & Abdollahi, Elnaz & Lahdelma, Risto & Jiao, Wenling & Zhou, Zhigang, 2015. "Modelling and optimization of the smart hybrid renewable energy for communities (SHREC)," Renewable Energy, Elsevier, vol. 84(C), pages 114-123.
    15. Mirko M. Stojiljković & Mladen M. Stojiljković & Bratislav D. Blagojević, 2014. "Multi-Objective Combinatorial Optimization of Trigeneration Plants Based on Metaheuristics," Energies, MDPI, vol. 7(12), pages 1-28, December.
    16. Yang, Siyu & Yang, Qingchun & Qian, Yu, 2013. "A composite efficiency metrics for evaluation of resource and energy utilization," Energy, Elsevier, vol. 61(C), pages 455-462.
    17. Li, Bei & Roche, Robin & Miraoui, Abdellatif, 2017. "Microgrid sizing with combined evolutionary algorithm and MILP unit commitment," Applied Energy, Elsevier, vol. 188(C), pages 547-562.
    18. Mallikarjun, Sreekanth & Lewis, Herbert F., 2014. "Energy technology allocation for distributed energy resources: A strategic technology-policy framework," Energy, Elsevier, vol. 72(C), pages 783-799.
    19. Li, Guoneng & Zheng, Youqu & Hu, Jiangen & Guo, Wenwen, 2019. "Experiments and a simplified theoretical model for a water-cooled, stove-powered thermoelectric generator," Energy, Elsevier, vol. 185(C), pages 437-448.
    20. Huaibin Gao & Xiaojiang Liu & Chuanwei Zhang & Yu Ma & Hongjun Li & Guanghong Huang, 2023. "Design and Experimental Investigation of a Self-Powered Fan Based on a Thermoelectric System," Energies, MDPI, vol. 16(2), pages 1-12, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:14:y:2021:i:17:p:5334-:d:623536. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.