IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v348y2023ics0306261923009054.html
   My bibliography  Save this article

Incentive-based demand response strategies for natural gas considering carbon emissions and load volatility

Author

Listed:
  • Zeng, Huibin
  • Shao, Bilin
  • Dai, Hongbin
  • Tian, Ning
  • Zhao, Wei

Abstract

With the continuous development of the global economy, the demand for natural gas is increasing year by year. At the same time, the widespread adoption of emission reduction measures around the world prompts many countries to switch to cleaner energy sources, which is driving the growth in demand for natural gas. In order to regulate the balance of natural gas supply and demand, maintain the stable operation of natural gas systems and reduce environmental pollution, this paper proposes an incentive-based demand respond (DR) model for natural gas, which takes carbon emissions and load volatility into account, and in the end, it concludes an effective response strategy. In order to get the multi-objective incentive-based DR, first of all, the reward function is constructed by adopting the TOPSIS method, and then it is solved by using the DQN algorithm, in the end, a multi-objective reinforcement learning method based on DQN is proposed. The DR model is evaluated by adopting a real load data from Xi'an city and DR strategies are proposed for different gas users in two periods: the heating and non-heating periods. The DR strategy proposed in this paper can effectively increase gas users motivation, reduce peak loads, maximize the revenue of gas suppliers and gas users, mitigate load volatility and reduce carbon emissions.

Suggested Citation

  • Zeng, Huibin & Shao, Bilin & Dai, Hongbin & Tian, Ning & Zhao, Wei, 2023. "Incentive-based demand response strategies for natural gas considering carbon emissions and load volatility," Applied Energy, Elsevier, vol. 348(C).
  • Handle: RePEc:eee:appene:v:348:y:2023:i:c:s0306261923009054
    DOI: 10.1016/j.apenergy.2023.121541
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923009054
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2023.121541?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jordehi, A. Rezaee, 2019. "Optimisation of demand response in electric power systems, a review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 103(C), pages 308-319.
    2. Wen, Lulu & Zhou, Kaile & Li, Jun & Wang, Shanyong, 2020. "Modified deep learning and reinforcement learning for an incentive-based demand response model," Energy, Elsevier, vol. 205(C).
    3. Yu, Mengmeng & Hong, Seung Ho, 2017. "Incentive-based demand response considering hierarchical electricity market: A Stackelberg game approach," Applied Energy, Elsevier, vol. 203(C), pages 267-279.
    4. Yang, Hongming & Xiong, Tonglin & Qiu, Jing & Qiu, Duo & Dong, Zhao Yang, 2016. "Optimal operation of DES/CCHP based regional multi-energy prosumer with demand response," Applied Energy, Elsevier, vol. 167(C), pages 353-365.
    5. Vázquez-Canteli, José R. & Nagy, Zoltán, 2019. "Reinforcement learning for demand response: A review of algorithms and modeling techniques," Applied Energy, Elsevier, vol. 235(C), pages 1072-1089.
    6. Lu, Renzhi & Hong, Seung Ho & Zhang, Xiongfeng, 2018. "A Dynamic pricing demand response algorithm for smart grid: Reinforcement learning approach," Applied Energy, Elsevier, vol. 220(C), pages 220-230.
    7. Huibin Zeng & Bilin Shao & Genqing Bian & Hongbin Dai & Fangyu Zhou, 2022. "Analysis of Influencing Factors and Trend Forecast of CO 2 Emission in Chengdu-Chongqing Urban Agglomeration," Sustainability, MDPI, vol. 14(3), pages 1-30, January.
    8. Kong, Xiangyu & Kong, Deqian & Yao, Jingtao & Bai, Linquan & Xiao, Jie, 2020. "Online pricing of demand response based on long short-term memory and reinforcement learning," Applied Energy, Elsevier, vol. 271(C).
    9. Montuori, Lina & Alcázar-Ortega, Manuel & Álvarez-Bel, Carlos, 2021. "Methodology for the evaluation of demand response strategies for the management of natural gas systems," Energy, Elsevier, vol. 234(C).
    10. Lu, Renzhi & Hong, Seung Ho, 2019. "Incentive-based demand response for smart grid with reinforcement learning and deep neural network," Applied Energy, Elsevier, vol. 236(C), pages 937-949.
    11. Montuori, Lina & Alcázar-Ortega, Manuel, 2021. "Demand response strategies for the balancing of natural gas systems: Application to a local network located in The Marches (Italy)," Energy, Elsevier, vol. 225(C).
    12. Zeng, Huibin & Shao, Bilin & Dai, Hongbin & Yan, Yichuan & Tian, Ning, 2023. "Prediction of fluctuation loads based on GARCH family-CatBoost-CNNLSTM," Energy, Elsevier, vol. 263(PE).
    13. Ren, Kezheng & Liu, Jun & Liu, Xinglei & Nie, Yongxin, 2023. "Reinforcement Learning-Based Bi-Level strategic bidding model of Gas-fired unit in integrated electricity and natural gas markets preventing market manipulation," Applied Energy, Elsevier, vol. 336(C).
    14. Tsoumalis, Georgios I. & Bampos, Zafeirios N. & Biskas, Pandelis N. & Keranidis, Stratos D. & Symeonidis, Polychronis A. & Voulgarakis, Dimitrios K., 2022. "A novel system for providing explicit demand response from domestic natural gas boilers," Applied Energy, Elsevier, vol. 317(C).
    15. Wang, Jianxiao & Zhong, Haiwang & Ma, Ziming & Xia, Qing & Kang, Chongqing, 2017. "Review and prospect of integrated demand response in the multi-energy system," Applied Energy, Elsevier, vol. 202(C), pages 772-782.
    16. Aalami, H.A. & Moghaddam, M. Parsa & Yousefi, G.R., 2010. "Demand response modeling considering Interruptible/Curtailable loads and capacity market programs," Applied Energy, Elsevier, vol. 87(1), pages 243-250, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ma, Siyu & Liu, Hui & Wang, Ni & Huang, Lidong & Su, Jinshuo & Zhao, Teyang, 2024. "Incentive-based integrated demand response with multi-energy time-varying carbon emission factors," Applied Energy, Elsevier, vol. 359(C).
    2. Wu, Jiaman & Lu, Chenbei & Wu, Chenye & Shi, Jian & Gonzalez, Marta C. & Wang, Dan & Han, Zhu, 2024. "A cluster-based appliance-level-of-use demand response program design," Applied Energy, Elsevier, vol. 362(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zeng, Huibin & Shao, Bilin & Dai, Hongbin & Yan, Yichuan & Tian, Ning, 2023. "Natural gas demand response strategy considering user satisfaction and load volatility under dynamic pricing," Energy, Elsevier, vol. 277(C).
    2. Antonopoulos, Ioannis & Robu, Valentin & Couraud, Benoit & Kirli, Desen & Norbu, Sonam & Kiprakis, Aristides & Flynn, David & Elizondo-Gonzalez, Sergio & Wattam, Steve, 2020. "Artificial intelligence and machine learning approaches to energy demand-side response: A systematic review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 130(C).
    3. Eduardo J. Salazar & Mauro Jurado & Mauricio E. Samper, 2023. "Reinforcement Learning-Based Pricing and Incentive Strategy for Demand Response in Smart Grids," Energies, MDPI, vol. 16(3), pages 1-33, February.
    4. Zhang, Xiongfeng & Lu, Renzhi & Jiang, Junhui & Hong, Seung Ho & Song, Won Seok, 2021. "Testbed implementation of reinforcement learning-based demand response energy management system," Applied Energy, Elsevier, vol. 297(C).
    5. Ma, Siyu & Liu, Hui & Wang, Ni & Huang, Lidong & Goh, Hui Hwang, 2023. "Incentive-based demand response under incomplete information based on the deep deterministic policy gradient," Applied Energy, Elsevier, vol. 351(C).
    6. Xie, Jiahan & Ajagekar, Akshay & You, Fengqi, 2023. "Multi-Agent attention-based deep reinforcement learning for demand response in grid-responsive buildings," Applied Energy, Elsevier, vol. 342(C).
    7. Lu, Renzhi & Li, Yi-Chang & Li, Yuting & Jiang, Junhui & Ding, Yuemin, 2020. "Multi-agent deep reinforcement learning based demand response for discrete manufacturing systems energy management," Applied Energy, Elsevier, vol. 276(C).
    8. Gao, Jianwei & Ma, Zeyang & Guo, Fengjia, 2019. "The influence of demand response on wind-integrated power system considering participation of the demand side," Energy, Elsevier, vol. 178(C), pages 723-738.
    9. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    10. Wen, Lulu & Zhou, Kaile & Li, Jun & Wang, Shanyong, 2020. "Modified deep learning and reinforcement learning for an incentive-based demand response model," Energy, Elsevier, vol. 205(C).
    11. Kong, Xiangyu & Kong, Deqian & Yao, Jingtao & Bai, Linquan & Xiao, Jie, 2020. "Online pricing of demand response based on long short-term memory and reinforcement learning," Applied Energy, Elsevier, vol. 271(C).
    12. Tsaousoglou, Georgios & Giraldo, Juan S. & Paterakis, Nikolaos G., 2022. "Market Mechanisms for Local Electricity Markets: A review of models, solution concepts and algorithmic techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 156(C).
    13. Zhou, Kaile & Peng, Ning & Yin, Hui & Hu, Rong, 2023. "Urban virtual power plant operation optimization with incentive-based demand response," Energy, Elsevier, vol. 282(C).
    14. Barja-Martinez, Sara & Aragüés-Peñalba, Mònica & Munné-Collado, Íngrid & Lloret-Gallego, Pau & Bullich-Massagué, Eduard & Villafafila-Robles, Roberto, 2021. "Artificial intelligence techniques for enabling Big Data services in distribution networks: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 150(C).
    15. Georgios I. Tsoumalis & Zafeirios N. Bampos & Georgios V. Chatzis & Pandelis N. Biskas, 2022. "Overview of Natural Gas Boiler Optimization Technologies and Potential Applications on Gas Load Balancing Services," Energies, MDPI, vol. 15(22), pages 1-24, November.
    16. Ibrahim, Muhammad Sohail & Dong, Wei & Yang, Qiang, 2020. "Machine learning driven smart electric power systems: Current trends and new perspectives," Applied Energy, Elsevier, vol. 272(C).
    17. Zhu, Ziqing & Hu, Ze & Chan, Ka Wing & Bu, Siqi & Zhou, Bin & Xia, Shiwei, 2023. "Reinforcement learning in deregulated energy market: A comprehensive review," Applied Energy, Elsevier, vol. 329(C).
    18. Lu, Qing & Lü, Shuaikang & Leng, Yajun, 2019. "A Nash-Stackelberg game approach in regional energy market considering users’ integrated demand response," Energy, Elsevier, vol. 175(C), pages 456-470.
    19. Seongwoo Lee & Joonho Seon & Byungsun Hwang & Soohyun Kim & Youngghyu Sun & Jinyoung Kim, 2024. "Recent Trends and Issues of Energy Management Systems Using Machine Learning," Energies, MDPI, vol. 17(3), pages 1-24, January.
    20. Park, Keonwoo & Moon, Ilkyeong, 2022. "Multi-agent deep reinforcement learning approach for EV charging scheduling in a smart grid," Applied Energy, Elsevier, vol. 328(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:348:y:2023:i:c:s0306261923009054. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.