IDEAS home Printed from https://ideas.repec.org/a/eee/proeco/v280y2025ics0925527324003451.html
   My bibliography  Save this article

Multi-agent reinforcement learning for chiller system prediction and energy-saving optimization in semiconductor manufacturing

Author

Listed:
  • Lee, Chia-Yen
  • Li, Yao-Wen
  • Chang, Chih-Chun

Abstract

Energy consumption in cooling systems is one of the major environmental burdens in semiconductor manufacturing. Energy-saving measures not only help reduce energy costs but also effectively decrease carbon emissions. These improvements enhance the operational efficiency of the entire supply chain and ultimately benefit downstream enterprises, thereby promoting the sustainable development of the semiconductor supply chain. This study aims to optimize the energy savings in chiller systems in the semiconductor manufacturing. We investigate the interactions between various devices and show how the chiller's operational status affects the temperature setpoint. This study proposes a meta-prediction model to simulate the dynamic behavior of the chiller system, and also employ multi-agent reinforcement learning to support the multi-setpoint control for energy optimization. An empirical study of a semiconductor manufacturer in Taiwan was conducted to validate the proposed model. The results indicate that our developed solution successfully reduced the kilowatts per refrigerated ton (KW/RT) by approximately 2.78% in a practical application.

Suggested Citation

  • Lee, Chia-Yen & Li, Yao-Wen & Chang, Chih-Chun, 2025. "Multi-agent reinforcement learning for chiller system prediction and energy-saving optimization in semiconductor manufacturing," International Journal of Production Economics, Elsevier, vol. 280(C).
  • Handle: RePEc:eee:proeco:v:280:y:2025:i:c:s0925527324003451
    DOI: 10.1016/j.ijpe.2024.109488
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0925527324003451
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijpe.2024.109488?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Marchi, B. & Zanoni, S. & Zavanella, L.E. & Jaber, M.Y., 2019. "Supply chain models with greenhouse gases emissions, energy usage, imperfect process under different coordination decisions," International Journal of Production Economics, Elsevier, vol. 211(C), pages 145-153.
    2. Marc A. Rosen, 2009. "Energy Sustainability: A Pragmatic Approach and Illustrations," Sustainability, MDPI, vol. 1(1), pages 1-26, March.
    3. Yuquan Meng & Yuhang Yang & Haseung Chung & Pil-Ho Lee & Chenhui Shao, 2018. "Enhancing Sustainability and Energy Efficiency in Smart Factories: A Review," Sustainability, MDPI, vol. 10(12), pages 1-28, December.
    4. Dababneh, Fadwa & Li, Lin & Sun, Zeyi, 2016. "Peak power demand reduction for combined manufacturing and HVAC system considering heat transfer characteristics," International Journal of Production Economics, Elsevier, vol. 177(C), pages 44-52.
    5. Wolters, W. T. M. & Lambert, A. J. D. & Claus, J., 1995. "Sequencing problems in designing energy efficient production systems," International Journal of Production Economics, Elsevier, vol. 41(1-3), pages 405-410, October.
    6. Zou, Wenke & Sun, Yongjun & Gao, Dian-ce & Cui, Zhitao & You, Zhiqiang & Ma, Xiaowen, 2023. "Robust enhancement of chiller sequencing control for tolerating sensor measurement uncertainties through controlling small-scale thermal energy storage," Energy, Elsevier, vol. 280(C).
    7. Bui, Tat-Dat, 2024. "Assessing sustainable supply chain transparency practices in Taiwan semiconductor industry: A hierarchical interdependence approach," International Journal of Production Economics, Elsevier, vol. 272(C).
    8. Zheng, Deyuan & Song, Hang & Zhao, Chunguang & Liu, Yujiao & Zhao, Wenhao, 2024. "Is it possible for semiconductor companies to reduce carbon emissions through digital transformation? Evidence from China," International Journal of Production Economics, Elsevier, vol. 272(C).
    9. Lazrak, Amine & Boudehenn, François & Bonnot, Sylvain & Fraisse, Gilles & Leconte, Antoine & Papillon, Philippe & Souyri, Bernard, 2016. "Development of a dynamic artificial neural network model of an absorption chiller and its experimental validation," Renewable Energy, Elsevier, vol. 86(C), pages 1009-1022.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sun, Lihua & Bai, Chunguang & Sarkis, Joseph, 2024. "Environmental and social performance relationships to firm efficiency: Evidence from the semiconductor industry," International Journal of Production Economics, Elsevier, vol. 278(C).
    2. Sadiq, Muhammad & Nawaz, Muhammad Atif & Sharif, Arshian & Hanif, Sobia, 2024. "Bridging green supply chain practices and environmental performance in Chinese semiconductor sector: With the role of energy efficiency and green HRM," International Journal of Production Economics, Elsevier, vol. 277(C).
    3. Sarkar, Biswajit & Seok, Hyesung & Jana, Tapas Kumar & Dey, Bikash Koli, 2023. "Is the system reliability profitable for retailing and consumer service of a dynamical system under cross-price elasticity of demand?," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    4. Hajo Terbrack & Thorsten Claus & Frank Herrmann, 2021. "Energy-Oriented Production Planning in Industry: A Systematic Literature Review and Classification Scheme," Sustainability, MDPI, vol. 13(23), pages 1-32, December.
    5. Vandana & Shiv Raj Singh & Mitali Sarkar & Biswajit Sarkar, 2023. "Effect of Learning and Forgetting on Inventory Model under Carbon Emission and Agile Manufacturing," Mathematics, MDPI, vol. 11(2), pages 1-20, January.
    6. Weiwei Cui & Biao Lu, 2020. "A Bi-Objective Approach to Minimize Makespan and Energy Consumption in Flow Shops with Peak Demand Constraint," Sustainability, MDPI, vol. 12(10), pages 1-22, May.
    7. Wu, Si & Yang, Pu & Chen, Guanghao & Wang, Zhe, 2025. "Evaluating seasonal chiller performance using operational data," Applied Energy, Elsevier, vol. 377(PA).
    8. Lee, Jun-Yeon & Choi, Sungyong, 2021. "Supply chain investment and contracting for carbon emissions reduction: A social planner's perspective," International Journal of Production Economics, Elsevier, vol. 231(C).
    9. Sochard, Sabine & Castillo Garcia, Lorenzo & Serra, Sylvain & Vitupier, Yann & Reneaume, Jean-Michel, 2017. "Modelling a solar absorption chiller using positive flash to estimate the physical state of streams and theoretical plate concept for the generator," Renewable Energy, Elsevier, vol. 109(C), pages 121-134.
    10. Saqib Ali & Habib Ullah & Minhas Akbar & Waheed Akhtar & Hasan Zahid, 2019. "Determinants of Consumer Intentions to Purchase Energy-Saving Household Products in Pakistan," Sustainability, MDPI, vol. 11(5), pages 1-20, March.
    11. Waris, Idrees & Hameed, Irfan, 2019. "Using Extended Model of Theory of Planned Behavior to Predict Purchase Intention of Energy Efficient Home Appliances in Pakistan," MPRA Paper 109612, University Library of Munich, Germany.
    12. Annamaria Di Fabio & Marc A. Rosen, 2020. "An Exploratory Study of a New Psychological Instrument for Evaluating Sustainability: The Sustainable Development Goals Psychological Inventory," Sustainability, MDPI, vol. 12(18), pages 1-19, September.
    13. Xia, Jing & Niu, Wenju, 2021. "Carbon-reducing contract design for a supply chain with environmental responsibility under asymmetric information," Omega, Elsevier, vol. 102(C).
    14. Basim S. O. Alsaedi, 2024. "A Sustainable Supply Chain Model with a Setup Cost Reduction Policy for Imperfect Items under Learning in a Cloudy Fuzzy Environment," Mathematics, MDPI, vol. 12(10), pages 1-33, May.
    15. Jonghyuk Kim & Hyunwoo Hwangbo, 2019. "Real-Time Early Warning System for Sustainable and Intelligent Plastic Film Manufacturing," Sustainability, MDPI, vol. 11(5), pages 1-13, March.
    16. Most. Asikha Aktar & Al-Amrani Khadeem Ali Dhahi & Usman Abdullahi, 2024. "Advancing Sustainable Development through the lens of Energy Efficiency: A Systematic Literature Review," International Journal of Energy Economics and Policy, Econjournals, vol. 14(5), pages 168-180, September.
    17. Koray Altintas & Ozalp Vayvay & Sinan Apak & Emine Cobanoglu, 2020. "An Extended GRA Method Integrated with Fuzzy AHP to Construct a Multidimensional Index for Ranking Overall Energy Sustainability Performances," Sustainability, MDPI, vol. 12(4), pages 1-21, February.
    18. Emanuele Leporelli & Giovanni Santi, 2019. "From Psychology of Sustainability to Sustainability of Urban Spaces: Promoting a Primary Prevention Approach for Well-Being in the Healthy City Designing. A Waterfront Case Study in Livorno," Sustainability, MDPI, vol. 11(3), pages 1-18, February.
    19. Hsiao-Yen Mao & Wen-Min Lu & Hsin-Yen Shieh, 2023. "Exploring the Influence of Environmental Investment on Multinational Enterprises’ Performance from the Sustainability and Marketability Efficiency Perspectives," Sustainability, MDPI, vol. 15(10), pages 1-23, May.
    20. Niu Yu & Mengni Xiong & Pin Zhou & Qingguo Bai, 2025. "Contract design for a retailer-dominated supply chain under asymmetric green investment cost information," Operational Research, Springer, vol. 25(1), pages 1-31, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:proeco:v:280:y:2025:i:c:s0925527324003451. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijpe .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.