IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i9p3753-d1134680.html
   My bibliography  Save this article

Reinforcement-Learning-Based Multi-Objective Differential Evolution Algorithm for Large-Scale Combined Heat and Power Economic Emission Dispatch

Author

Listed:
  • Xu Chen

    (School of Electrical and Information Engineering, Jiangsu University, Zhenjiang 212013, China)

  • Shuai Fang

    (School of Electrical and Information Engineering, Jiangsu University, Zhenjiang 212013, China)

  • Kangji Li

    (School of Electrical and Information Engineering, Jiangsu University, Zhenjiang 212013, China)

Abstract

As social and environmental issues become increasingly serious, both fuel costs and environmental impacts should be considered in the cogeneration process. In recent years, combined heat and power economic emission dispatch (CHPEED) has become a crucial optimization problem in power system management. In this paper, a novel reinforcement-learning-based multi-objective differential evolution (RLMODE) algorithm is suggested to deal with the CHPEED problem considering large-scale systems. In RLMODE, a Q -learning-based technique is adopted to automatically adjust the control parameters of the multi-objective algorithm. Specifically, the Pareto domination relationship between the offspring solution and the parent solution is used to determine the action reward, and the most-suitable algorithm parameter values for the environment model are adjusted through the Q -learning process. The proposed RLMODE was applied to solve four CHPEED problems: 5, 7, 100, and 140 generating units. The simulation results showed that, compared with four well-established multi-objective algorithms, the RLMODE algorithm achieved the smallest cost and smallest emission values for all four CHPEED problems. In addition, the RLMODE algorithm acquired better Pareto-optimal frontiers in terms of convergence and diversity. The superiority of RLMODE was particularly significant for two large-scale CHPEED problems.

Suggested Citation

  • Xu Chen & Shuai Fang & Kangji Li, 2023. "Reinforcement-Learning-Based Multi-Objective Differential Evolution Algorithm for Large-Scale Combined Heat and Power Economic Emission Dispatch," Energies, MDPI, vol. 16(9), pages 1-23, April.
    • Handle: RePEc:gam:jeners:v:16:y:2023:i:9:p:3753-:d:1134680
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/9/3753/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/9/3753/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Shi, Bin & Yan, Lie-Xiang & Wu, Wei, 2013. "Multi-objective optimization for combined heat and power economic dispatch with power transmission loss and emission reduction," Energy, Elsevier, vol. 56(C), pages 135-143.
    2. Shaheen, Abdullah M. & El-Sehiemy, Ragab A. & Elattar, Ehab & Ginidi, Ahmed R., 2022. "An Amalgamated Heap and Jellyfish Optimizer for economic dispatch in Combined heat and power systems including N-1 Unit outages," Energy, Elsevier, vol. 246(C).
    3. Zou, Dexuan & Li, Steven & Kong, Xiangyong & Ouyang, Haibin & Li, Zongyan, 2019. "Solving the combined heat and power economic dispatch problems by an improved genetic algorithm and a new constraint handling strategy," Applied Energy, Elsevier, vol. 237(C), pages 646-670.
    4. Niknam, Taher & Azizipanah-Abarghooee, Rasoul & Roosta, Alireza & Amiri, Babak, 2012. "A new multi-objective reserve constrained combined heat and power dynamic economic emission dispatch," Energy, Elsevier, vol. 42(1), pages 530-545.
    5. Xiong, Guojiang & Shuai, Maohang & Hu, Xiao, 2022. "Combined heat and power economic emission dispatch using improved bare-bone multi-objective particle swarm optimization," Energy, Elsevier, vol. 244(PB).
    6. A. M. Elaiw & X. Xia & A. M. Shehata, 2013. "Combined Heat and Power Dynamic Economic Dispatch with Emission Limitations Using Hybrid DE-SQP Method," Abstract and Applied Analysis, Hindawi, vol. 2013, pages 1-10, November.
    7. Rong, Aiying & Lahdelma, Risto, 2007. "An efficient envelope-based Branch and Bound algorithm for non-convex combined heat and power production planning," European Journal of Operational Research, Elsevier, vol. 183(1), pages 412-431, November.
    8. Rizk-Allah, Rizk M. & Hassanien, Aboul Ella & Snášel, Václav, 2022. "A hybrid chameleon swarm algorithm with superiority of feasible solutions for optimal combined heat and power economic dispatch problem," Energy, Elsevier, vol. 254(PC).
    9. Li, Yang & Wang, Jinlong & Zhao, Dongbo & Li, Guoqing & Chen, Chen, 2018. "A two-stage approach for combined heat and power economic emission dispatch: Combining multi-objective optimization with integrated decision making," Energy, Elsevier, vol. 162(C), pages 237-254.
    10. Kumar Jadoun, Vinay & Rahul Prashanth, G & Suhas Joshi, Siddharth & Narayanan, K. & Malik, Hasmat & García Márquez, Fausto Pedro, 2022. "Optimal fuzzy based economic emission dispatch of combined heat and power units using dynamically controlled Whale Optimization Algorithm," Applied Energy, Elsevier, vol. 315(C).
    11. Zou, Dexuan & Gong, Dunwei, 2022. "Differential evolution based on migrating variables for the combined heat and power dynamic economic dispatch," Energy, Elsevier, vol. 238(PA).
    12. Chen, Xu & Tang, Guowei, 2022. "Solving static and dynamic multi-area economic dispatch problems using an improved competitive swarm optimization algorithm," Energy, Elsevier, vol. 238(PC).
    13. Sadeghian, H.R. & Ardehali, M.M., 2016. "A novel approach for optimal economic dispatch scheduling of integrated combined heat and power systems for maximum economic profit and minimum environmental emissions based on Benders decomposition," Energy, Elsevier, vol. 102(C), pages 10-23.
    14. Yang, Qiangda & Liu, Peng & Zhang, Jie & Dong, Ning, 2022. "Combined heat and power economic dispatch using an adaptive cuckoo search with differential evolution mutation," Applied Energy, Elsevier, vol. 307(C).
    15. Dariush Khezrimotlagh & Yao Chen, 2018. "The Optimization Approach," International Series in Operations Research & Management Science, in: Decision Making and Performance Evaluation Using Data Envelopment Analysis, chapter 0, pages 107-134, Springer.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Urazel, Burak & Keskin, Kemal, 2023. "A new solution approach for non-convex combined heat and power economic dispatch problem considering power loss," Energy, Elsevier, vol. 278(PB).
    2. Shaheen, Abdullah M. & El-Sehiemy, Ragab A. & Elattar, Ehab & Ginidi, Ahmed R., 2022. "An Amalgamated Heap and Jellyfish Optimizer for economic dispatch in Combined heat and power systems including N-1 Unit outages," Energy, Elsevier, vol. 246(C).
    3. Ali Sulaiman Alsagri & Abdulrahman A. Alrobaian, 2022. "Optimization of Combined Heat and Power Systems by Meta-Heuristic Algorithms: An Overview," Energies, MDPI, vol. 15(16), pages 1-34, August.
    4. Nazari-Heris, M. & Mohammadi-Ivatloo, B. & Gharehpetian, G.B., 2018. "A comprehensive review of heuristic optimization algorithms for optimal combined heat and power dispatch from economic and environmental perspectives," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P2), pages 2128-2143.
    5. Ragab El-Sehiemy & Abdullah Shaheen & Ahmed Ginidi & Mostafa Elhosseini, 2022. "A Honey Badger Optimization for Minimizing the Pollutant Environmental Emissions-Based Economic Dispatch Model Integrating Combined Heat and Power Units," Energies, MDPI, vol. 15(20), pages 1-22, October.
    6. Paramjeet Kaur & Krishna Teerth Chaturvedi & Mohan Lal Kolhe, 2023. "Combined Heat and Power Economic Dispatching within Energy Network using Hybrid Metaheuristic Technique," Energies, MDPI, vol. 16(3), pages 1-17, January.
    7. Lai, Wenhao & Zheng, Xiaoliang & Song, Qi & Hu, Feng & Tao, Qiong & Chen, Hualiang, 2022. "Multi-objective membrane search algorithm: A new solution for economic emission dispatch," Applied Energy, Elsevier, vol. 326(C).
    8. Shahenda Sarhan & Abdullah Shaheen & Ragab El-Sehiemy & Mona Gafar, 2022. "A Multi-Objective Teaching–Learning Studying-Based Algorithm for Large-Scale Dispatching of Combined Electrical Power and Heat Energies," Mathematics, MDPI, vol. 10(13), pages 1-26, June.
    9. Rizk-Allah, Rizk M. & Hassanien, Aboul Ella & Snášel, Václav, 2022. "A hybrid chameleon swarm algorithm with superiority of feasible solutions for optimal combined heat and power economic dispatch problem," Energy, Elsevier, vol. 254(PC).
    10. Li, Yang & Wang, Jinlong & Zhao, Dongbo & Li, Guoqing & Chen, Chen, 2018. "A two-stage approach for combined heat and power economic emission dispatch: Combining multi-objective optimization with integrated decision making," Energy, Elsevier, vol. 162(C), pages 237-254.
    11. Kumar Jadoun, Vinay & Rahul Prashanth, G & Suhas Joshi, Siddharth & Narayanan, K. & Malik, Hasmat & García Márquez, Fausto Pedro, 2022. "Optimal fuzzy based economic emission dispatch of combined heat and power units using dynamically controlled Whale Optimization Algorithm," Applied Energy, Elsevier, vol. 315(C).
    12. Zhou, Tianmin & Chen, Jiamin & Xu, Xuancong & Ou, Zuhong & Yin, Hao & Luo, Jianqiang & Meng, Anbo, 2023. "A novel multi-agent based crisscross algorithm with hybrid neighboring topology for combined heat and power economic dispatch," Applied Energy, Elsevier, vol. 342(C).
    13. Lai, Wenhao & Song, Qi & Zheng, Xiaoliang & Tao, Qiong & Chen, Hualiang, 2023. "A new version of membrane search algorithm for hybrid renewable energy systems dynamic scheduling," Renewable Energy, Elsevier, vol. 209(C), pages 262-276.
    14. Hossein Nourianfar & Hamdi Abdi, 2022. "Environmental/Economic Dispatch Using a New Hybridizing Algorithm Integrated with an Effective Constraint Handling Technique," Sustainability, MDPI, vol. 14(6), pages 1-26, March.
    15. Rong, Aiying & Figueira, José Rui & Lahdelma, Risto, 2015. "A two phase approach for the bi-objective non-convex combined heat and power production planning problem," European Journal of Operational Research, Elsevier, vol. 245(1), pages 296-308.
    16. Jabari, Farkhondeh & Jabari, Hamid & Mohammadi-ivatloo, Behnam & Ghafouri, Jafar, 2019. "Optimal short-term coordination of water-heat-power nexus incorporating plug-in electric vehicles and real-time demand response programs," Energy, Elsevier, vol. 174(C), pages 708-723.
    17. Nazari-Heris, Morteza & Mohammadi-Ivatloo, Behnam & Zare, Kazem & Siano, Pierluigi, 2020. "Optimal generation scheduling of large-scale multi-zone combined heat and power systems," Energy, Elsevier, vol. 210(C).
    18. Changyu Zhou & Guohe Huang & Jiapei Chen, 2019. "A Type-2 Fuzzy Chance-Constrained Fractional Integrated Modeling Method for Energy System Management of Uncertainties and Risks," Energies, MDPI, vol. 12(13), pages 1-21, June.
    19. Li, Yang & Wang, Bin & Yang, Zhen & Li, Jiazheng & Chen, Chen, 2022. "Hierarchical stochastic scheduling of multi-community integrated energy systems in uncertain environments via Stackelberg game," Applied Energy, Elsevier, vol. 308(C).
    20. Sheng, Wanxing & Li, Rui & Yan, Tao & Tseng, Ming-Lang & Lou, Jiale & Li, Lingling, 2023. "A hybrid dynamic economics emissions dispatch model: Distributed renewable power systems based on improved COOT optimization algorithm," Renewable Energy, Elsevier, vol. 204(C), pages 493-506.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:9:p:3753-:d:1134680. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.