IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i6p1408-d1610973.html
   My bibliography  Save this article

An End-to-End Relearning Framework for Building Energy Optimization

Author

Listed:
  • Avisek Naug

    (Hewlett Packard Labs (HPE), Milpitas, CA 95035, USA
    These authors contributed equally to this work.)

  • Marcos Quinones-Grueiro

    (Institute for Software Integrated Systems, Vanderbilt University, Nashville, TN 37235, USA
    These authors contributed equally to this work.)

  • Gautam Biswas

    (Institute for Software Integrated Systems, Vanderbilt University, Nashville, TN 37235, USA
    These authors contributed equally to this work.)

Abstract

Building HVAC systems face significant challenges in energy optimization due to changing building characteristics and the need to balance multiple efficiency objectives. Current approaches are limited: physics-based models are expensive and inflexible, while data-driven methods require extensive data collection and ongoing maintenance. This paper introduces a systematic relearning framework for HVAC supervisory control that improves adaptability while reducing operational costs. Our approach features a Reinforcement Learning controller with self-monitoring and adaptation capabilities that responds effectively to changes in building operations and environmental conditions. We simplify the complex hyperparameter optimization process through a structured decomposition method and implement a relearning strategy to handle operational changes over time. We demonstrate our framework’s effectiveness through comprehensive testing on a building testbed, comparing performance against established control methods.

Suggested Citation

  • Avisek Naug & Marcos Quinones-Grueiro & Gautam Biswas, 2025. "An End-to-End Relearning Framework for Building Energy Optimization," Energies, MDPI, vol. 18(6), pages 1-23, March.
    • Handle: RePEc:gam:jeners:v:18:y:2025:i:6:p:1408-:d:1610973
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/6/1408/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/18/6/1408/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Di Natale, L. & Svetozarevic, B. & Heer, P. & Jones, C.N., 2022. "Physically Consistent Neural Networks for building thermal modeling: Theory and analysis," Applied Energy, Elsevier, vol. 325(C).
    2. Fang, Xi & Gong, Guangcai & Li, Guannan & Chun, Liang & Peng, Pei & Li, Wenqiang & Shi, Xing, 2023. "Cross temporal-spatial transferability investigation of deep reinforcement learning control strategy in the building HVAC system level," Energy, Elsevier, vol. 263(PB).
    3. Arroyo, Javier & Manna, Carlo & Spiessens, Fred & Helsen, Lieve, 2022. "Reinforced model predictive control (RL-MPC) for building energy management," Applied Energy, Elsevier, vol. 309(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ding, Yan & Zhang, Haozheng & Yang, Xiaochen & Tian, Zhe & Huang, Chen, 2024. "An adaptive switching control model for air conditioning systems based on information completeness," Applied Energy, Elsevier, vol. 375(C).
    2. Zhao, Jing & Yang, Zilan & Shi, Linyu & Liu, Dehan & Li, Haonan & Mi, Yumiao & Wang, Hongbin & Feng, Meili & Hutagaol, Timothy Joseph, 2024. "Photovoltaic capacity dynamic tracking model predictive control strategy of air-conditioning systems with consideration of flexible loads," Applied Energy, Elsevier, vol. 356(C).
    3. Hu, Guoqing & You, Fengqi, 2024. "AI-enabled cyber-physical-biological systems for smart energy management and sustainable food production in a plant factory," Applied Energy, Elsevier, vol. 356(C).
    4. Liang, Xinbin & Zhu, Xu & Chen, Siliang & Jin, Xinqiao & Xiao, Fu & Du, Zhimin, 2023. "Physics-constrained cooperative learning-based reference models for smart management of chillers considering extrapolation scenarios," Applied Energy, Elsevier, vol. 349(C).
    5. Nweye, Kingsley & Sankaranarayanan, Siva & Nagy, Zoltan, 2023. "MERLIN: Multi-agent offline and transfer learning for occupant-centric operation of grid-interactive communities," Applied Energy, Elsevier, vol. 346(C).
    6. Luna, José Diogo Forte de Oliveira & Naspolini, Amir & Reis, Guilherme Nascimento Gouvêa dos & Mendes, Paulo Renato da Costa & Normey-Rico, Julio Elias, 2024. "A novel joint energy and demand management system for smart houses based on model predictive control, hybrid storage system and quality of experience concepts," Applied Energy, Elsevier, vol. 369(C).
    7. Tian, Xiaoyu & Zhang, Hanwen & Liu, Lin & Huang, Jiahao & Liu, Liru & Liu, Jing, 2024. "Establishment of LCZ-based urban building energy consumption dataset in hot and humid subtropical regions through a bottom-up method," Applied Energy, Elsevier, vol. 368(C).
    8. Di Natale, L. & Svetozarevic, B. & Heer, P. & Jones, C.N., 2023. "Towards scalable physically consistent neural networks: An application to data-driven multi-zone thermal building models," Applied Energy, Elsevier, vol. 340(C).
    9. García Vázquez, C.A. & Cotfas, D.T. & González Santos, A.I. & Cotfas, P.A. & León Ávila, B.Y., 2024. "Reduction of electricity consumption in an AHU using mathematical modelling for controller tuning," Energy, Elsevier, vol. 293(C).
    10. Fu, Yangyang & Xu, Shichao & Zhu, Qi & O’Neill, Zheng & Adetola, Veronica, 2023. "How good are learning-based control v.s. model-based control for load shifting? Investigations on a single zone building energy system," Energy, Elsevier, vol. 273(C).
    11. Wang, Xuezheng & Dong, Bing, 2024. "Long-term experimental evaluation and comparison of advanced controls for HVAC systems," Applied Energy, Elsevier, vol. 371(C).
    12. Davide Fop & Ali Reza Yaghoubi & Alfonso Capozzoli, 2024. "Validation of a Model Predictive Control Strategy on a High Fidelity Building Emulator," Energies, MDPI, vol. 17(20), pages 1-20, October.
    13. Jia, Zhiyang & Jin, Xinqiao & Lyu, Yuan & Xue, Qi & Du, Zhimin, 2024. "A novel load allocation strategy based on the adaptive chiller model with data augmentation," Energy, Elsevier, vol. 309(C).
    14. Zhou, Xinlei & Xue, Shan & Du, Han & Ma, Zhenjun, 2023. "Optimization of building demand flexibility using reinforcement learning and rule-based expert systems," Applied Energy, Elsevier, vol. 350(C).
    15. Cui, Can & Xue, Jing, 2024. "Energy and comfort aware operation of multi-zone HVAC system through preference-inspired deep reinforcement learning," Energy, Elsevier, vol. 292(C).
    16. Sulaiman, Mohd Herwan & Mustaffa, Zuriani, 2024. "Chiller energy prediction in commercial building: A metaheuristic-Enhanced deep learning approach," Energy, Elsevier, vol. 297(C).
    17. Karim Boubouh & Robert Basmadjian & Omid Ardakanian & Alexandre Maurer & Rachid Guerraoui, 2023. "PePTM : An Efficient and Accurate Personalized P2P Learning Algorithm for Home Thermal Modeling," Energies, MDPI, vol. 16(18), pages 1-22, September.
    18. Ma, Zhihao & Jiang, Gang & Hu, Yuqing & Chen, Jianli, 2025. "A review of physics-informed machine learning for building energy modeling," Applied Energy, Elsevier, vol. 381(C).
    19. Xiao, Tianqi & You, Fengqi, 2023. "Building thermal modeling and model predictive control with physically consistent deep learning for decarbonization and energy optimization," Applied Energy, Elsevier, vol. 342(C).
    20. Hu, Zehuan & Gao, Yuan & Sun, Luning & Mae, Masayuki & Imaizumi, Taiji, 2024. "Improved robust model predictive control for residential building air conditioning and photovoltaic power generation with battery energy storage system under weather forecast uncertainty," Applied Energy, Elsevier, vol. 371(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:6:p:1408-:d:1610973. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.