IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v17y2024i11p2730-d1408250.html
   My bibliography  Save this article

Decision Tree Variations and Online Tuning for Real-Time Control of a Building in a Two-Stage Management Strategy

Author

Listed:
  • Rémy Rigo-Mariani

    (Univ. Grenoble Alpes, CNRS, Grenoble INP, G2Elab, 21 Avenue des Martyrs, 38000 Grenoble, France
    CNRS@CREATE, 1 Create Way, Singapore 138602, Singapore)

  • Alim Yakub

    (CNRS@CREATE, 1 Create Way, Singapore 138602, Singapore)

Abstract

This study examines the use of data-driven controllers for near real-time control of an HVAC and storage system in a residential building. The work is based on a two-stage management with, first, a day-ahead optimal scheduling, and second, a near real-time adaptive control to remain close to the commitments made in the first stage. A Model Predictive Control (MPC) is adopted from previous works from the authors. The aim of this paper is then to explore lightweight controllers for the real-time stage as alternatives to MPC, which relies on computational-intensive modeling and optimization. Decision Trees (DTs) are considered for this purpose, offering understandable solutions by processing input data through explicit tests of the inputs with predefined thresholds. Various DT variations, including regular, regressors, and linear DTs, are studied. Linear DTs, with a minimal number of leaves, exhibit superior performance, especially when trained on historical MPC data, outperforming the reference MPC in terms of energy exchange efficiency. However, due to impracticalities, an offline training approach for the DTs is proposed, which sacrifices performance. An online tuning strategy is then introduced, updating the DT coefficients based on real-time observations, significantly enhancing performance in terms of energy deviation reduction during real-time operation.

Suggested Citation

  • Rémy Rigo-Mariani & Alim Yakub, 2024. "Decision Tree Variations and Online Tuning for Real-Time Control of a Building in a Two-Stage Management Strategy," Energies, MDPI, vol. 17(11), pages 1-17, June.
    • Handle: RePEc:gam:jeners:v:17:y:2024:i:11:p:2730-:d:1408250
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/17/11/2730/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/17/11/2730/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Pinto, Giuseppe & Deltetto, Davide & Capozzoli, Alfonso, 2021. "Data-driven district energy management with surrogate models and deep reinforcement learning," Applied Energy, Elsevier, vol. 304(C).
    2. Moutis, Panayiotis & Skarvelis-Kazakos, Spyros & Brucoli, Maria, 2016. "Decision tree aided planning and energy balancing of planned community microgrids," Applied Energy, Elsevier, vol. 161(C), pages 197-205.
    3. Lork, Clement & Li, Wen-Tai & Qin, Yan & Zhou, Yuren & Yuen, Chau & Tushar, Wayes & Saha, Tapan K., 2020. "An uncertainty-aware deep reinforcement learning framework for residential air conditioning energy management," Applied Energy, Elsevier, vol. 276(C).
    4. Arroyo, Javier & Manna, Carlo & Spiessens, Fred & Helsen, Lieve, 2022. "Reinforced model predictive control (RL-MPC) for building energy management," Applied Energy, Elsevier, vol. 309(C).
    5. Klingler, Anna-Lena, 2017. "Self-consumption with PV+Battery systems: A market diffusion model considering individual consumer behaviour and preferences," Applied Energy, Elsevier, vol. 205(C), pages 1560-1570.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ayas Shaqour & Aya Hagishima, 2022. "Systematic Review on Deep Reinforcement Learning-Based Energy Management for Different Building Types," Energies, MDPI, vol. 15(22), pages 1-27, November.
    2. Gao, Yuan & Matsunami, Yuki & Miyata, Shohei & Akashi, Yasunori, 2022. "Multi-agent reinforcement learning dealing with hybrid action spaces: A case study for off-grid oriented renewable building energy system," Applied Energy, Elsevier, vol. 326(C).
    3. Nweye, Kingsley & Sankaranarayanan, Siva & Nagy, Zoltan, 2023. "MERLIN: Multi-agent offline and transfer learning for occupant-centric operation of grid-interactive communities," Applied Energy, Elsevier, vol. 346(C).
    4. Song, Yuguang & Xia, Mingchao & Chen, Qifang & Chen, Fangjian, 2023. "A data-model fusion dispatch strategy for the building energy flexibility based on the digital twin," Applied Energy, Elsevier, vol. 332(C).
    5. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    6. Charalampos Rafail Lazaridis & Iakovos Michailidis & Georgios Karatzinis & Panagiotis Michailidis & Elias Kosmatopoulos, 2024. "Evaluating Reinforcement Learning Algorithms in Residential Energy Saving and Comfort Management," Energies, MDPI, vol. 17(3), pages 1-33, January.
    7. Seppo Sierla & Heikki Ihasalo & Valeriy Vyatkin, 2022. "A Review of Reinforcement Learning Applications to Control of Heating, Ventilation and Air Conditioning Systems," Energies, MDPI, vol. 15(10), pages 1-25, May.
    8. Panagiotis Michailidis & Iakovos Michailidis & Dimitrios Vamvakas & Elias Kosmatopoulos, 2023. "Model-Free HVAC Control in Buildings: A Review," Energies, MDPI, vol. 16(20), pages 1-45, October.
    9. Hartmann, Bálint & Divényi, Dániel & Vokony, István, 2018. "Evaluation of business possibilities of energy storage at commercial and industrial consumers – A case study," Applied Energy, Elsevier, vol. 222(C), pages 59-66.
    10. Pasta, Edoardo & Faedo, Nicolás & Mattiazzo, Giuliana & Ringwood, John V., 2023. "Towards data-driven and data-based control of wave energy systems: Classification, overview, and critical assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    11. Georg Göhler & Anna-Lena Klingler & Florian Klausmann & Dieter Spath, 2021. "Integrated Modelling of Decentralised Energy Supply in Combination with Electric Vehicle Charging in a Real-Life Case Study," Energies, MDPI, vol. 14(21), pages 1-19, October.
    12. Villa-Arrieta, Manuel & Sumper, Andreas, 2019. "Economic evaluation of Nearly Zero Energy Cities," Applied Energy, Elsevier, vol. 237(C), pages 404-416.
    13. Stute, Judith & Klobasa, Marian, 2024. "How do dynamic electricity tariffs and different grid charge designs interact? - Implications for residential consumers and grid reinforcement requirements," Energy Policy, Elsevier, vol. 189(C).
    14. Jacobs, Stef & Ghane, Sara & Houben, Pieter Jan & Kabbara, Zakarya & Huybrechts, Thomas & Hellinckx, Peter & Verhaert, Ivan, 2025. "Improving the learning process of deep reinforcement learning agents operating in collective heating environments," Applied Energy, Elsevier, vol. 384(C).
    15. Fu, Yangyang & Xu, Shichao & Zhu, Qi & O’Neill, Zheng & Adetola, Veronica, 2023. "How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system," Energy, Elsevier, vol. 273(C).
    16. Guo, Yuxiang & Qu, Shengli & Wang, Chuang & Xing, Ziwen & Duan, Kaiwen, 2024. "Optimal dynamic thermal management for data center via soft actor-critic algorithm with dynamic control interval and combined-value state space," Applied Energy, Elsevier, vol. 373(C).
    17. Wang, Xuezheng & Dong, Bing, 2024. "Long-term experimental evaluation and comparison of advanced controls for HVAC systems," Applied Energy, Elsevier, vol. 371(C).
    18. Ma, Weiwu & Fang, Song & Liu, Gang & Zhou, Ruoyu, 2017. "Modeling of district load forecasting for distributed energy system," Applied Energy, Elsevier, vol. 204(C), pages 181-205.
    19. Zhou, Xinlei & Xue, Shan & Du, Han & Ma, Zhenjun, 2023. "Optimization of building demand flexibility using reinforcement learning and rule-based expert systems," Applied Energy, Elsevier, vol. 350(C).
    20. Byung-Ki Jeon & Eui-Jong Kim, 2022. "White-Model Predictive Control for Balancing Energy Savings and Thermal Comfort," Energies, MDPI, vol. 15(7), pages 1-12, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:17:y:2024:i:11:p:2730-:d:1408250. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.