IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v335y2025ics0360544225037053.html

Pareto local search for a multi-objective demand response problem in residential areas with heat pumps and electric vehicles

Author

Listed:
  • Dengiz, Thomas
  • Raith, Andrea
  • Kleinebrahm, Max
  • Vogl, Jonathan
  • Fichtner, Wolf

Abstract

In future energy systems characterized by significant shares of fluctuating renewable energy sources, there is a need for a fundamental change in electricity consumption. The energy system must adapt to the intermittent generation of renewable energy sources. This can be achieved by using flexible electrical loads, such as heat pumps and electric vehicles, with efficient control methods. In this paper, we introduce the Pareto local search method PALSS which employs heuristic search operations to solve the multi-objective demand response problem in residential areas, resulting in superior performance to existing approaches. Flexible electrical loads are shifted with the objective of minimizing the electricity cost and peak load while maintaining the inhabitants’ comfort in favorable ranges. Furthermore, we extend PALSS by incorporating reinforcement learning into the search operations in the approach RELAPALSS. For the evaluation, we employ the dichotomous method to obtain solutions that are guaranteed to be Pareto-optimal, serving as benchmarks. The results demonstrate that PALSS outperforms state-of-the-art multi-objective evolutionary algorithms by 16% (18% for RELAPALSS) regarding the performance indicator Generational Distance and by 128% (130% for RELAPALSS) for the indicator Hypervolume. The runtime for PALSS and RELAPALSS is reduced by up to 92% compared to exact methods.

Suggested Citation

  • Dengiz, Thomas & Raith, Andrea & Kleinebrahm, Max & Vogl, Jonathan & Fichtner, Wolf, 2025. "Pareto local search for a multi-objective demand response problem in residential areas with heat pumps and electric vehicles," Energy, Elsevier, vol. 335(C).
    • Handle: RePEc:eee:energy:v:335:y:2025:i:c:s0360544225037053
    DOI: 10.1016/j.energy.2025.138063
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544225037053
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.energy.2025.138063?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Pinto, Giuseppe & Piscitelli, Marco Savino & Vázquez-Canteli, José Ramón & Nagy, Zoltán & Capozzoli, Alfonso, 2021. "Coordinated energy management for a cluster of buildings through deep reinforcement learning," Energy, Elsevier, vol. 229(C).
    2. Pinto, Giuseppe & Deltetto, Davide & Capozzoli, Alfonso, 2021. "Data-driven district energy management with surrogate models and deep reinforcement learning," Applied Energy, Elsevier, vol. 304(C).
    3. Kazmi, Hussain & Suykens, Johan & Balint, Attila & Driesen, Johan, 2019. "Multi-agent reinforcement learning for modeling and control of thermostatically controlled loads," Applied Energy, Elsevier, vol. 238(C), pages 1022-1035.
    4. Wei, Xiupeng & Kusiak, Andrew & Li, Mingyang & Tang, Fan & Zeng, Yaohui, 2015. "Multi-objective optimization of the HVAC (heating, ventilation, and air conditioning) system performance," Energy, Elsevier, vol. 83(C), pages 294-306.
    5. Shariatzadeh, Farshid & Mandal, Paras & Srivastava, Anurag K., 2015. "Demand response for sustainable energy systems: A review, application and implementation strategy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 45(C), pages 343-350.
    6. Patteeuw, Dieter & Bruninx, Kenneth & Arteconi, Alessia & Delarue, Erik & D’haeseleer, William & Helsen, Lieve, 2015. "Integrated modeling of active demand response with electric heating systems coupled to thermal energy storage systems," Applied Energy, Elsevier, vol. 151(C), pages 306-319.
    7. Wang, Jiangjiang & Liu, Yi & Ren, Fukang & Lu, Shuaikang, 2020. "Multi-objective optimization and selection of hybrid combined cooling, heating and power systems considering operational flexibility," Energy, Elsevier, vol. 197(C).
    8. Gomes, A. & Antunes, C. Henggeler & Martinho, J., 2013. "A physically-based model for simulating inverter type air conditioners/heat pumps," Energy, Elsevier, vol. 50(C), pages 110-119.
    9. Dileep, G., 2020. "A survey on smart grid technologies and applications," Renewable Energy, Elsevier, vol. 146(C), pages 2589-2625.
    10. Misconel, S. & Zimmermann, F. & Mikurda, J. & Möst, D. & Kunze, R. & Gnann, T. & Kühnbach, M. & Speth, D. & Pelka, S. & Yu, S., 2024. "Model coupling and comparison on optimal load shifting of battery electric vehicles and heat pumps focusing on generation adequacy," Energy, Elsevier, vol. 305(C).
    11. Terlouw, Tom & AlSkaif, Tarek & Bauer, Christian & van Sark, Wilfried, 2019. "Multi-objective optimization of energy arbitrage in community energy storage systems using different battery technologies," Applied Energy, Elsevier, vol. 239(C), pages 356-372.
    12. Sane Lei Lei Wynn & Watcharakorn Pinthurat & Boonruang Marungsri, 2022. "Multi-Objective Optimization for Peak Shaving with Demand Response under Renewable Generation Uncertainty," Energies, MDPI, vol. 15(23), pages 1-19, November.
    13. Dengiz, Thomas & Jochem, Patrick & Fichtner, Wolf, 2021. "Demand response through decentralized optimization in residential areas with wind and photovoltaics," Energy, Elsevier, vol. 223(C).
    14. Matthias Ehrgott, 2005. "Multicriteria Optimization," Springer Books, Springer, edition 0, number 978-3-540-27659-3, January.
    15. Dengiz, Thomas & Jochem, Patrick, 2020. "Decentralized optimization approaches for using the load flexibility of electric heating devices," Energy, Elsevier, vol. 193(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    2. Dengiz, Thomas & Jochem, Patrick & Fichtner, Wolf, 2021. "Demand response through decentralized optimization in residential areas with wind and photovoltaics," Energy, Elsevier, vol. 223(C).
    3. Pinto, Giuseppe & Kathirgamanathan, Anjukan & Mangina, Eleni & Finn, Donal P. & Capozzoli, Alfonso, 2022. "Enhancing energy management in grid-interactive buildings: A comparison among cooperative and coordinated architectures," Applied Energy, Elsevier, vol. 310(C).
    4. Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.
    5. Charalampos Rafail Lazaridis & Iakovos Michailidis & Georgios Karatzinis & Panagiotis Michailidis & Elias Kosmatopoulos, 2024. "Evaluating Reinforcement Learning Algorithms in Residential Energy Saving and Comfort Management," Energies, MDPI, vol. 17(3), pages 1-33, January.
    6. Nweye, Kingsley & Sankaranarayanan, Siva & Nagy, Zoltan, 2023. "MERLIN: Multi-agent offline and transfer learning for occupant-centric operation of grid-interactive communities," Applied Energy, Elsevier, vol. 346(C).
    7. Lankeshwara, Gayan & Sharma, Rahul & Yan, Ruifeng & Saha, Tapan K., 2022. "A hierarchical control scheme for residential air-conditioning loads to provide real-time market services under uncertainties," Energy, Elsevier, vol. 250(C).
    8. C Kalaivani & L Umasankar & Chandrashekhar Badachi & K Karthikumar, 2025. "An enhanced approach-based grid flexibility analysis for combined heat and power systems with variable renewable energy systems," Energy & Environment, , vol. 36(1), pages 3-31, February.
    9. Chen, Minghao & Sun, Yi & Xie, Zhiyuan & Lin, Nvgui & Wu, Peng, 2023. "An efficient and privacy-preserving algorithm for multiple energy hubs scheduling with federated and matching deep reinforcement learning," Energy, Elsevier, vol. 284(C).
    10. Barbosa, Aglaucibelly Maciel & Rotella Junior, Paulo & Peruchi, Rogério Santana & Pires, Arthur Leandro Guerra & Barbosa, Anrafel de Souza & Aquila, Giancarlo, 2026. "Robust parameter optimization of a hybrid wind-solar photovoltaic system with battery energy storage," Renewable Energy, Elsevier, vol. 259(C).
    11. Song, Yuguang & Xia, Mingchao & Chen, Qifang & Chen, Fangjian, 2023. "A data-model fusion dispatch strategy for the building energy flexibility based on the digital twin," Applied Energy, Elsevier, vol. 332(C).
    12. Panagiotis Michailidis & Iakovos Michailidis & Elias Kosmatopoulos, 2025. "Reinforcement Learning for Optimizing Renewable Energy Utilization in Buildings: A Review on Applications and Innovations," Energies, MDPI, vol. 18(7), pages 1-40, March.
    13. Coraci, Davide & Brandi, Silvio & Hong, Tianzhen & Capozzoli, Alfonso, 2023. "Online transfer learning strategy for enhancing the scalability and deployment of deep reinforcement learning control in smart buildings," Applied Energy, Elsevier, vol. 333(C).
    14. Silvestri, Alberto & Coraci, Davide & Brandi, Silvio & Capozzoli, Alfonso & Borkowski, Esther & Köhler, Johannes & Wu, Duan & Zeilinger, Melanie N. & Schlueter, Arno, 2024. "Real building implementation of a deep reinforcement learning controller to enhance energy efficiency and indoor temperature control," Applied Energy, Elsevier, vol. 368(C).
    15. Chen, Minghao & Xie, Zhiyuan & Sun, Yi & Zheng, Shunlin, 2023. "The predictive management in campus heating system based on deep reinforcement learning and probabilistic heat demands forecasting," Applied Energy, Elsevier, vol. 350(C).
    16. Seppo Sierla & Heikki Ihasalo & Valeriy Vyatkin, 2022. "A Review of Reinforcement Learning Applications to Control of Heating, Ventilation and Air Conditioning Systems," Energies, MDPI, vol. 15(10), pages 1-25, May.
    17. Leehter Yao & Jin-Hao Huang, 2019. "Multi-Objective Optimization of Energy Saving Control for Air Conditioning System in Data Center," Energies, MDPI, vol. 12(8), pages 1-16, April.
    18. T. D. Chuong & V. Jeyakumar, 2025. "Adjustable robust multiobjective linear optimization: Pareto optimal solutions via conic programming," Annals of Operations Research, Springer, vol. 346(2), pages 895-916, March.
    19. Wang, Jiangjiang & Deng, Hongda & Qi, Xiaoling, 2022. "Cost-based site and capacity optimization of multi-energy storage system in the regional integrated energy networks," Energy, Elsevier, vol. 261(PA).
    20. Razzano, Giuseppe & Brandi, Silvio & Piscitelli, Marco Savino & Capozzoli, Alfonso, 2025. "Rule extraction from deep reinforcement learning controller and comparative analysis with ASHRAE control sequences for the optimal management of Heating, Ventilation, and Air Conditioning (HVAC) systems in multizone buildings," Applied Energy, Elsevier, vol. 381(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:335:y:2025:i:c:s0360544225037053. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.