IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i6p1408-d1610973.html
   My bibliography  Save this article

An End-to-End Relearning Framework for Building Energy Optimization

Author

Listed:
  • Avisek Naug

    (Hewlett Packard Labs (HPE), Milpitas, CA 95035, USA
    These authors contributed equally to this work.)

  • Marcos Quinones-Grueiro

    (Institute for Software Integrated Systems, Vanderbilt University, Nashville, TN 37235, USA
    These authors contributed equally to this work.)

  • Gautam Biswas

    (Institute for Software Integrated Systems, Vanderbilt University, Nashville, TN 37235, USA
    These authors contributed equally to this work.)

Abstract

Building HVAC systems face significant challenges in energy optimization due to changing building characteristics and the need to balance multiple efficiency objectives. Current approaches are limited: physics-based models are expensive and inflexible, while data-driven methods require extensive data collection and ongoing maintenance. This paper introduces a systematic relearning framework for HVAC supervisory control that improves adaptability while reducing operational costs. Our approach features a Reinforcement Learning controller with self-monitoring and adaptation capabilities that responds effectively to changes in building operations and environmental conditions. We simplify the complex hyperparameter optimization process through a structured decomposition method and implement a relearning strategy to handle operational changes over time. We demonstrate our framework’s effectiveness through comprehensive testing on a building testbed, comparing performance against established control methods.

Suggested Citation

  • Avisek Naug & Marcos Quinones-Grueiro & Gautam Biswas, 2025. "An End-to-End Relearning Framework for Building Energy Optimization," Energies, MDPI, vol. 18(6), pages 1-23, March.
    • Handle: RePEc:gam:jeners:v:18:y:2025:i:6:p:1408-:d:1610973
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/6/1408/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/18/6/1408/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Di Natale, L. & Svetozarevic, B. & Heer, P. & Jones, C.N., 2022. "Physically Consistent Neural Networks for building thermal modeling: Theory and analysis," Applied Energy, Elsevier, vol. 325(C).
    2. Fang, Xi & Gong, Guangcai & Li, Guannan & Chun, Liang & Peng, Pei & Li, Wenqiang & Shi, Xing, 2023. "Cross temporal-spatial transferability investigation of deep reinforcement learning control strategy in the building HVAC system level," Energy, Elsevier, vol. 263(PB).
    3. Arroyo, Javier & Manna, Carlo & Spiessens, Fred & Helsen, Lieve, 2022. "Reinforced model predictive control (RL-MPC) for building energy management," Applied Energy, Elsevier, vol. 309(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ding, Yan & Zhang, Haozheng & Yang, Xiaochen & Tian, Zhe & Huang, Chen, 2024. "An adaptive switching control model for air conditioning systems based on information completeness," Applied Energy, Elsevier, vol. 375(C).
    2. Montazeri, Mina & Remlinger, Carl & Bejar Haro, Benjamin & Heer, Philipp, 2025. "Fully data-driven and modular building thermal control with physically consistent modeling," Applied Energy, Elsevier, vol. 390(C).
    3. Liang, Xinbin & Zhu, Xu & Chen, Siliang & Jin, Xinqiao & Xiao, Fu & Du, Zhimin, 2023. "Physics-constrained cooperative learning-based reference models for smart management of chillers considering extrapolation scenarios," Applied Energy, Elsevier, vol. 349(C).
    4. Nweye, Kingsley & Sankaranarayanan, Siva & Nagy, Zoltan, 2023. "MERLIN: Multi-agent offline and transfer learning for occupant-centric operation of grid-interactive communities," Applied Energy, Elsevier, vol. 346(C).
    5. Di Natale, L. & Svetozarevic, B. & Heer, P. & Jones, C.N., 2023. "Towards scalable physically consistent neural networks: An application to data-driven multi-zone thermal building models," Applied Energy, Elsevier, vol. 340(C).
    6. Jacobs, Stef & Ghane, Sara & Houben, Pieter Jan & Kabbara, Zakarya & Huybrechts, Thomas & Hellinckx, Peter & Verhaert, Ivan, 2025. "Improving the learning process of deep reinforcement learning agents operating in collective heating environments," Applied Energy, Elsevier, vol. 384(C).
    7. Fu, Yangyang & Xu, Shichao & Zhu, Qi & O’Neill, Zheng & Adetola, Veronica, 2023. "How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system," Energy, Elsevier, vol. 273(C).
    8. Wang, Xuezheng & Dong, Bing, 2024. "Long-term experimental evaluation and comparison of advanced controls for HVAC systems," Applied Energy, Elsevier, vol. 371(C).
    9. Zhou, Xinlei & Xue, Shan & Du, Han & Ma, Zhenjun, 2023. "Optimization of building demand flexibility using reinforcement learning and rule-based expert systems," Applied Energy, Elsevier, vol. 350(C).
    10. Cui, Can & Xue, Jing, 2024. "Energy and comfort aware operation of multi-zone HVAC system through preference-inspired deep reinforcement learning," Energy, Elsevier, vol. 292(C).
    11. Karim Boubouh & Robert Basmadjian & Omid Ardakanian & Alexandre Maurer & Rachid Guerraoui, 2023. "PePTM : An Efficient and Accurate Personalized P2P Learning Algorithm for Home Thermal Modeling," Energies, MDPI, vol. 16(18), pages 1-22, September.
    12. Xiao, Tianqi & You, Fengqi, 2023. "Building thermal modeling and model predictive control with physically consistent deep learning for decarbonization and energy optimization," Applied Energy, Elsevier, vol. 342(C).
    13. Hua, Pengmin & Wang, Haichao & Xie, Zichan & Lahdelma, Risto, 2024. "Multi-criteria evaluation of novel multi-objective model predictive control method for indoor thermal comfort," Energy, Elsevier, vol. 289(C).
    14. Taboga, Vincent & Gehring, Clement & Cam, Mathieu Le & Dagdougui, Hanane & Bacon, Pierre-Luc, 2024. "Neural differential equations for temperature control in buildings under demand response programs," Applied Energy, Elsevier, vol. 368(C).
    15. Wang, Hao & Chen, Xiwen & Vital, Natan & Duffy, Edward & Razi, Abolfazl, 2024. "Energy optimization for HVAC systems in multi-VAV open offices: A deep reinforcement learning approach," Applied Energy, Elsevier, vol. 356(C).
    16. Amal Azzi & Mohamed Tabaa & Badr Chegari & Hanaa Hachimi, 2024. "Balancing Sustainability and Comfort: A Holistic Study of Building Control Strategies That Meet the Global Standards for Efficiency and Thermal Comfort," Sustainability, MDPI, vol. 16(5), pages 1-36, March.
    17. Xu, Wenjie & Svetozarevic, Bratislav & Di Natale, Loris & Heer, Philipp & Jones, Colin N., 2024. "Data-driven adaptive building thermal controller tuning with constraints: A primal–dual contextual Bayesian optimization approach," Applied Energy, Elsevier, vol. 358(C).
    18. Mbungu, Nsilulu T. & Siti, Mukwanga W. & Bansal, Ramesh C. & Naidoo, Raj M. & Elnady, A. & Ismail, Ali A. Adam & Abokhali, Ahmed G. & Hamid, Abdul-Kadir, 2025. "A dynamic coordination of microgrids," Applied Energy, Elsevier, vol. 377(PD).
    19. Ebbs-Picken, Takiah & Romero, David A. & Da Silva, Carlos M. & Amon, Cristina H., 2024. "Deep encoder–decoder hierarchical convolutional neural networks for conjugate heat transfer surrogate modeling," Applied Energy, Elsevier, vol. 372(C).
    20. Wang, Xiaoyu & Jia, Hongjie & Jin, Xiaolong & Mu, Yunfei & Wei, Wei & Yu, Xiaodan & Liang, Shuo, 2024. "Bi-level optimal operations for grid operator and low-carbon building prosumers with peer-to-peer energy sharing," Applied Energy, Elsevier, vol. 359(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:6:p:1408-:d:1610973. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.