IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v352y2023ics0306261923013600.html
   My bibliography  Save this article

50% reduction in energy consumption in an actual cold storage facility using a deep reinforcement learning-based control algorithm

Author

Listed:
  • Park, Jong-Whi
  • Ju, Young-Min
  • Kim, You-Gwon
  • Kim, Hak-Sung

Abstract

This study presents a unique application of a temperature control algorithm, specifically modified deep deterministic policy gradient (DDPG), in an actual 2.8 m2 cold storage facility, contrasting the majority of research that leverages theoretical validations using simulation tools. The primary goal was to minimize energy consumption while maintaining the desired temperature range. To achieve this, thermocouples and a watt-hour meter were installed to collect real-time data on temperature and power consumption, subsequently transmitted to a deep-learning computing and control system for processing. Utilizing the gathered data, the algorithm was trained to simultaneously maintain the temperature and minimize power consumption. The temperature setting served as a control variable, and a deep deterministic policy gradient algorithm was used. A hyperparameter with a dominant influence on learning outcomes was optimized. Furthermore, the algorithm was exposed to various complex scenarios that occur during actual cold storage operations, such as door opening, reinforcing its practical viability. The study findings revealed that our real-world application of the DDPG algorithm significantly reduced energy consumption by 47.64% compared to conventional proportional-integral-derivative control algorithms, whilst maintaining the target temperature range.

Suggested Citation

  • Park, Jong-Whi & Ju, Young-Min & Kim, You-Gwon & Kim, Hak-Sung, 2023. "50% reduction in energy consumption in an actual cold storage facility using a deep reinforcement learning-based control algorithm," Applied Energy, Elsevier, vol. 352(C).
    • Handle: RePEc:eee:appene:v:352:y:2023:i:c:s0306261923013600
    DOI: 10.1016/j.apenergy.2023.121996
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923013600
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2023.121996?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Costa, Andrea & Keane, Marcus M. & Torrens, J. Ignacio & Corry, Edward, 2013. "Building operation and energy performance: Monitoring, analysis and optimisation toolkit," Applied Energy, Elsevier, vol. 101(C), pages 310-316.
    2. Du, Yan & Zandi, Helia & Kotevska, Olivera & Kurte, Kuldeep & Munk, Jeffery & Amasyali, Kadir & Mckee, Evan & Li, Fangxing, 2021. "Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning," Applied Energy, Elsevier, vol. 281(C).
    3. Liu, Xiangfei & Ren, Mifeng & Yang, Zhile & Yan, Gaowei & Guo, Yuanjun & Cheng, Lan & Wu, Chengke, 2022. "A multi-step predictive deep reinforcement learning algorithm for HVAC control systems in smart buildings," Energy, Elsevier, vol. 259(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhou, Xinlei & Lin, Wenye & Kumar, Ritunesh & Cui, Ping & Ma, Zhenjun, 2022. "A data-driven strategy using long short term memory models and reinforcement learning to predict building electricity consumption," Applied Energy, Elsevier, vol. 306(PB).
    2. Sinha, Anshuman & Thakkar, Harshul & Rezaei, Fateme & Kawajiri, Yoshiaki & Realff, Matthew J., 2022. "Reduced building energy consumption by combined indoor CO2 and H2O composition control," Applied Energy, Elsevier, vol. 322(C).
    3. Zhuang, Dian & Gan, Vincent J.L. & Duygu Tekler, Zeynep & Chong, Adrian & Tian, Shuai & Shi, Xing, 2023. "Data-driven predictive control for smart HVAC system in IoT-integrated buildings with time-series forecasting and reinforcement learning," Applied Energy, Elsevier, vol. 338(C).
    4. Panagiotis Michailidis & Iakovos Michailidis & Dimitrios Vamvakas & Elias Kosmatopoulos, 2023. "Model-Free HVAC Control in Buildings: A Review," Energies, MDPI, vol. 16(20), pages 1-45, October.
    5. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    6. Ciro Aprea & Laura Canale & Marco Dell’Isola & Giorgio Ficco & Andrea Frattolillo & Angelo Maiorino & Fabio Petruzziello, 2023. "On the Use of Ultrasonic Flowmeters for Cooling Energy Metering and Sub-Metering in Direct Expansion Systems," Energies, MDPI, vol. 16(12), pages 1-16, June.
    7. Zeyue Sun & Mohsen Eskandari & Chaoran Zheng & Ming Li, 2022. "Handling Computation Hardness and Time Complexity Issue of Battery Energy Storage Scheduling in Microgrids by Deep Reinforcement Learning," Energies, MDPI, vol. 16(1), pages 1-20, December.
    8. Sameh Monna & Adel Juaidi & Ramez Abdallah & Aiman Albatayneh & Patrick Dutournie & Mejdi Jeguirim, 2021. "Towards Sustainable Energy Retrofitting, a Simulation for Potential Energy Use Reduction in Residential Buildings in Palestine," Energies, MDPI, vol. 14(13), pages 1-13, June.
    9. Zhang, Bin & Hu, Weihao & Ghias, Amer M.Y.M. & Xu, Xiao & Chen, Zhe, 2022. "Multi-agent deep reinforcement learning-based coordination control for grid-aware multi-buildings," Applied Energy, Elsevier, vol. 328(C).
    10. M. Usman Saleem & Mustafa Shakir & M. Rehan Usman & M. Hamza Tahir Bajwa & Noman Shabbir & Payam Shams Ghahfarokhi & Kamran Daniel, 2023. "Integrating Smart Energy Management System with Internet of Things and Cloud Computing for Efficient Demand Side Management in Smart Grids," Energies, MDPI, vol. 16(12), pages 1-21, June.
    11. Jing Zhao & Yu Shan, 2020. "A Fuzzy Control Strategy Using the Load Forecast for Air Conditioning System," Energies, MDPI, vol. 13(3), pages 1-17, January.
    12. Charalampos Rafail Lazaridis & Iakovos Michailidis & Georgios Karatzinis & Panagiotis Michailidis & Elias Kosmatopoulos, 2024. "Evaluating Reinforcement Learning Algorithms in Residential Energy Saving and Comfort Management," Energies, MDPI, vol. 17(3), pages 1-33, January.
    13. Ruparathna, Rajeev & Hewage, Kasun & Sadiq, Rehan, 2016. "Improving the energy efficiency of the existing building stock: A critical review of commercial and institutional buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 53(C), pages 1032-1045.
    14. Le Cam, M. & Daoud, A. & Zmeureanu, R., 2016. "Forecasting electric demand of supply fan using data mining techniques," Energy, Elsevier, vol. 101(C), pages 541-557.
    15. Doussoulin, Jean Pierre & Bittencourt, Mariana, 2022. "How effective is the construction sector in promoting the circular economy in Brazil and France? : A waste input-output analysis," Structural Change and Economic Dynamics, Elsevier, vol. 60(C), pages 47-58.
    16. Li, Haorong & Yu, Yuebin & Niu, Fuxin & Shafik, Michel & Chen, Bing, 2014. "Performance of a coupled cooling system with earth-to-air heat exchanger and solar chimney," Renewable Energy, Elsevier, vol. 62(C), pages 468-477.
    17. Fei Wang & Yili Yu & Xinkang Wang & Hui Ren & Miadreza Shafie-Khah & João P. S. Catalão, 2018. "Residential Electricity Consumption Level Impact Factor Analysis Based on Wrapper Feature Selection and Multinomial Logistic Regression," Energies, MDPI, vol. 11(5), pages 1-26, May.
    18. Wang, Chongwei & Cheng, Chuanxiao & Jin, Tingxiang & Dong, Hongsheng, 2022. "Water evaporation inspired biomass-based PCM from daisy stem and paraffin for building temperature regulation," Renewable Energy, Elsevier, vol. 194(C), pages 211-219.
    19. Afroz, Zakia & Urmee, Tania & Shafiullah, G.M. & Higgins, Gary, 2018. "Real-time prediction model for indoor temperature in a commercial building," Applied Energy, Elsevier, vol. 231(C), pages 29-53.
    20. Wang, Qiaochu & Ding, Yan & Kong, Xiangfei & Tian, Zhe & Xu, Linrui & He, Qing, 2022. "Load pattern recognition based optimization method for energy flexibility in office buildings," Energy, Elsevier, vol. 254(PC).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:352:y:2023:i:c:s0306261923013600. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.