IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v308y2022ics0306261921015865.html
   My bibliography  Save this article

Real-time monitoring of occupancy activities and window opening within buildings using an integrated deep learning-based approach for reducing energy demand

Author

Listed:
  • Tien, Paige Wenbin
  • Wei, Shuangyu
  • Calautit, John Kaiser
  • Darkwa, Jo
  • Wood, Christopher

Abstract

Occupancy behaviour in buildings can impact the energy performance and operation of heating, ventilation and air-conditioning (HVAC) systems. HVAC, which uses conventional control strategies or “fixed” setpoint schedules, could not adjust to the conditioned spaces' actual requirements, resulting in building spaces being over or under-conditioned. While the unintended opening of windows can lead to substantial heat loss and consequently raises energy consumption. To optimise building operations, it is necessary to employ solutions such as demand-driven controls, which can monitor the utilisation of indoor spaces and provide the actual thermal comfort requirements of occupants. This study presents a novel vision-based deep learning framework for occupancy activity detection and recognition including the manual window operations in buildings. A region-based Convolutional Neural Network (R-CNN) model was trained and deployed to a camera for real-time detection and recognition. Based on the field experiments conducted within a case study University building, overall accuracy of 85.63% was achieved for occupancy activity detection and 92.20% for window operation detection. Building energy simulation and various scenario-based cases were used to assess the impact of such an approach on the building energy demand and provide insights into how the proposed detection method can enable HVAC systems to respond to dynamic changes within indoor spaces. Results showed that the proposed approach could reduce the over-or under-estimation of occupancy heat gains compared with the use of “fixed” or static profiles. In addition, the approach can help alert building users or managers about windows left open unintentionally, which can reduce unnecessary ventilation heat losses. Furthermore, the approach can also predict the room CO2 concentration and advise occupants about a suitable natural ventilation strategy. The study highlighted the potential of the multi-purpose detection approach, but further development is necessary, including optimisation of the deep learning model, full integration with HVAC controls and further model training and field testing.

Suggested Citation

  • Tien, Paige Wenbin & Wei, Shuangyu & Calautit, John Kaiser & Darkwa, Jo & Wood, Christopher, 2022. "Real-time monitoring of occupancy activities and window opening within buildings using an integrated deep learning-based approach for reducing energy demand," Applied Energy, Elsevier, vol. 308(C).
    • Handle: RePEc:eee:appene:v:308:y:2022:i:c:s0306261921015865
    DOI: 10.1016/j.apenergy.2021.118336
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261921015865
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2021.118336?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Konstantakopoulos, Ioannis C. & Barkan, Andrew R. & He, Shiying & Veeravalli, Tanya & Liu, Huihan & Spanos, Costas, 2019. "A deep learning and gamification approach to improving human-building interaction and energy efficiency in smart infrastructure," Applied Energy, Elsevier, vol. 237(C), pages 810-821.
    2. Oropeza-Perez, Ivan & Østergaard, Poul Alberg, 2014. "Potential of natural ventilation in temperate countries – A case study of Denmark," Applied Energy, Elsevier, vol. 114(C), pages 520-530.
    3. Khalilnejad, Arash & French, Roger H. & Abramson, Alexis R., 2020. "Data-driven evaluation of HVAC operation and savings in commercial buildings," Applied Energy, Elsevier, vol. 278(C).
    4. Wei, Shuangyu & Tien, Paige Wenbin & Calautit, John Kaiser & Wu, Yupeng & Boukhanouf, Rabah, 2020. "Vision-based detection and prediction of equipment heat gains in commercial office buildings using a deep learning method," Applied Energy, Elsevier, vol. 277(C).
    5. Georgios D. Kontes & Georgios I. Giannakis & Víctor Sánchez & Pablo De Agustin-Camacho & Ander Romero-Amorrortu & Natalia Panagiotidou & Dimitrios V. Rovas & Simone Steiger & Christopher Mutschler & G, 2018. "Simulation-Based Evaluation and Optimization of Control Strategies in Buildings," Energies, MDPI, vol. 11(12), pages 1-23, December.
    6. Peng, Yuzhen & Rysanek, Adam & Nagy, Zoltán & Schlüter, Arno, 2018. "Using machine learning techniques for occupancy-prediction-based cooling control in office buildings," Applied Energy, Elsevier, vol. 211(C), pages 1343-1358.
    7. Antonio Paone & Jean-Philippe Bacher, 2018. "The Impact of Building Occupant Behavior on Energy Efficiency and Methods to Influence It: A Review of the State of the Art," Energies, MDPI, vol. 11(4), pages 1-19, April.
    8. Kathirgamanathan, Anjukan & De Rosa, Mattia & Mangina, Eleni & Finn, Donal P., 2021. "Data-driven predictive control for unlocking building energy flexibility: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    9. Li, Wenzhuo & Koo, Choongwan & Hong, Taehoon & Oh, Jeongyoon & Cha, Seung Hyun & Wang, Shengwei, 2020. "A novel operation approach for the energy efficiency improvement of the HVAC system in office spaces through real-time big data analytics," Renewable and Sustainable Energy Reviews, Elsevier, vol. 127(C).
    10. Fadzli Haniff, Mohamad & Selamat, Hazlina & Yusof, Rubiyah & Buyamin, Salinda & Sham Ismail, Fatimah, 2013. "Review of HVAC scheduling techniques for buildings towards energy-efficient and cost-effective operations," Renewable and Sustainable Energy Reviews, Elsevier, vol. 27(C), pages 94-103.
    11. Paige Wenbin Tien & Shuangyu Wei & John Calautit, 2020. "A Computer Vision-Based Occupancy and Equipment Usage Detection Approach for Reducing Building Energy Demand," Energies, MDPI, vol. 14(1), pages 1-28, December.
    12. Amasyali, Kadir & El-Gohary, Nora M., 2018. "A review of data-driven building energy consumption prediction studies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1192-1205.
    13. Misbah Ahmad & Imran Ahmed & Fakhri Alam Khan & Fawad Qayum & Hanan Aljuaid, 2020. "Convolutional neural network–based person tracking using overhead views," International Journal of Distributed Sensor Networks, , vol. 16(6), pages 15501477209, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wei, Zhichen & Calautit, John, 2023. "Predictive control of low-temperature heating system with passive thermal mass energy storage and photovoltaic system: Impact of occupancy patterns and climate change," Energy, Elsevier, vol. 269(C).
    2. Zhang, Wuxia & Wu, Yupeng & Calautit, John Kaiser, 2022. "A review on occupancy prediction through machine learning for enhancing energy efficiency, air quality and thermal comfort in the built environment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Elnour, Mariam & Fadli, Fodil & Himeur, Yassine & Petri, Ioan & Rezgui, Yacine & Meskin, Nader & Ahmad, Ahmad M., 2022. "Performance and energy optimization of building automation and management systems: Towards smart sustainable carbon-neutral sports facilities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 162(C).
    2. Panagiotis Michailidis & Iakovos Michailidis & Dimitrios Vamvakas & Elias Kosmatopoulos, 2023. "Model-Free HVAC Control in Buildings: A Review," Energies, MDPI, vol. 16(20), pages 1-45, October.
    3. Luo, X.J. & Oyedele, Lukumon O. & Ajayi, Anuoluwapo O. & Akinade, Olugbenga O. & Owolabi, Hakeem A. & Ahmed, Ashraf, 2020. "Feature extraction and genetic algorithm enhanced adaptive deep neural network for energy consumption prediction in buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 131(C).
    4. Gautham Krishnadas & Aristides Kiprakis, 2020. "A Machine Learning Pipeline for Demand Response Capacity Scheduling," Energies, MDPI, vol. 13(7), pages 1-25, April.
    5. Amasyali, Kadir & El-Gohary, Nora M., 2021. "Real data-driven occupant-behavior optimization for reduced energy consumption and improved comfort," Applied Energy, Elsevier, vol. 302(C).
    6. Tien, Paige Wenbin & Wei, Shuangyu & Liu, Tianshu & Calautit, John & Darkwa, Jo & Wood, Christopher, 2021. "A deep learning approach towards the detection and recognition of opening of windows for effective management of building ventilation heat losses and reducing space heating demand," Renewable Energy, Elsevier, vol. 177(C), pages 603-625.
    7. Hany Habbak & Mohamed Mahmoud & Khaled Metwally & Mostafa M. Fouda & Mohamed I. Ibrahem, 2023. "Load Forecasting Techniques and Their Applications in Smart Grids," Energies, MDPI, vol. 16(3), pages 1-33, February.
    8. Md Mijanur Rahman & Mohammad Shakeri & Sieh Kiong Tiong & Fatema Khatun & Nowshad Amin & Jagadeesh Pasupuleti & Mohammad Kamrul Hasan, 2021. "Prospective Methodologies in Hybrid Renewable Energy Systems for Energy Prediction Using Artificial Neural Networks," Sustainability, MDPI, vol. 13(4), pages 1-28, February.
    9. Fernando Cassola & Leonel Morgado & António Coelho & Hugo Paredes & António Barbosa & Helga Tavares & Filipe Soares, 2022. "Using Virtual Choreographies to Identify Office Users’ Behaviors to Target Behavior Change Based on Their Potential to Impact Energy Consumption," Energies, MDPI, vol. 15(12), pages 1-21, June.
    10. Liang, Xinbin & Chen, Siliang & Zhu, Xu & Jin, Xinqiao & Du, Zhimin, 2023. "Domain knowledge decomposition of building energy consumption and a hybrid data-driven model for 24-h ahead predictions," Applied Energy, Elsevier, vol. 344(C).
    11. Bampoulas, Adamantios & Pallonetto, Fabiano & Mangina, Eleni & Finn, Donal P., 2022. "An ensemble learning-based framework for assessing the energy flexibility of residential buildings with multicomponent energy systems," Applied Energy, Elsevier, vol. 315(C).
    12. Yan, Biao & Yang, Wansheng & He, Fuquan & Zeng, Wenhao, 2023. "Occupant behavior impact in buildings and the artificial intelligence-based techniques and data-driven approach solutions," Renewable and Sustainable Energy Reviews, Elsevier, vol. 184(C).
    13. Abdel-Salam, Mohamed R.H. & Fauchoux, Melanie & Ge, Gaoming & Besant, Robert W. & Simonson, Carey J., 2014. "Expected energy and economic benefits, and environmental impacts for liquid-to-air membrane energy exchangers (LAMEEs) in HVAC systems: A review," Applied Energy, Elsevier, vol. 127(C), pages 202-218.
    14. Sun, Ying & Haghighat, Fariborz & Fung, Benjamin C.M., 2022. "Trade-off between accuracy and fairness of data-driven building and indoor environment models: A comparative study of pre-processing methods," Energy, Elsevier, vol. 239(PD).
    15. Grillone, Benedetto & Danov, Stoyan & Sumper, Andreas & Cipriano, Jordi & Mor, Gerard, 2020. "A review of deterministic and data-driven methods to quantify energy efficiency savings and to predict retrofitting scenarios in buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 131(C).
    16. Wang, Zeyu & Liu, Jian & Zhang, Yuanxin & Yuan, Hongping & Zhang, Ruixue & Srinivasan, Ravi S., 2021. "Practical issues in implementing machine-learning models for building energy efficiency: Moving beyond obstacles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 143(C).
    17. Li, Xinyi & Yao, Runming, 2020. "A machine-learning-based approach to predict residential annual space heating and cooling loads considering occupant behaviour," Energy, Elsevier, vol. 212(C).
    18. Ding, Zhikun & Chen, Weilin & Hu, Ting & Xu, Xiaoxiao, 2021. "Evolutionary double attention-based long short-term memory model for building energy prediction: Case study of a green building," Applied Energy, Elsevier, vol. 288(C).
    19. Chen, Yibo & Gao, Junxi & Yang, Jianzhong & Berardi, Umberto & Cui, Guoyou, 2023. "An hour-ahead predictive control strategy for maximizing natural ventilation in passive buildings based on weather forecasting," Applied Energy, Elsevier, vol. 333(C).
    20. Tushar, Wayes & Yuen, Chau & Saha, Tapan K. & Morstyn, Thomas & Chapman, Archie C. & Alam, M. Jan E. & Hanif, Sarmad & Poor, H. Vincent, 2021. "Peer-to-peer energy systems for connected communities: A review of recent advances and emerging challenges," Applied Energy, Elsevier, vol. 282(PA).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:308:y:2022:i:c:s0306261921015865. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.