IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v251y2019ic29.html
   My bibliography  Save this article

Welfare-aware strategic demand control in an intelligent market-based framework: Move towards sustainable smart grid

Author

Listed:
  • Taheri Tehrani, Mohammad
  • Afshin Hemmatyar, Ali Mohammad

Abstract

To address sustainability challenges appeared in today’s power grids, it is essential for emerging demand control paradigm to be adapted more to the lifestyle of the customers. In this paper, due to the ever-growing interconnectivity of the grids, a distributed Commodity Market (CM) framework is proposed in which intelligent agents embedded inside of customers want to maximize their preferred welfare through real-time demand of power from an energy market. Since there is not a comprehensive model for the grids, utilizing Reinforcement Learning (RL) proves that the global optimal performance is achieved in the Nash Equilibrium (NE) of the proposed framework. This solution not only maximizes the resource utilization of the market, but also allocates strategically optimal demands of the customers who have budget constraints. Considering buying power and diverse assumption-free interests of the customers are two of the novelties offered. To consider social objectives for the communities that may give priority to social values, a socially intelligent ability is added to the proposed framework as an option. In this case, social concepts such as social welfare and social fairness will be met among the customers. Finally, a framework is developed for the customers who have the aim to consider economic goals such as cost minimization in addition to welfare maximization. Considering simultaneous quantitative and qualitative goals in a joint optimization form for the budget-constrained customers without any restrictions on the customers’ preferences or the supply side is another novelty offered. The simulation results confirm that not only can the developed frameworks significantly improve the welfare in a stable manner, but also they are more successful in obtaining the demand during peak hours than just the economic frameworks proposed in the literature.

Suggested Citation

  • Taheri Tehrani, Mohammad & Afshin Hemmatyar, Ali Mohammad, 2019. "Welfare-aware strategic demand control in an intelligent market-based framework: Move towards sustainable smart grid," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    • Handle: RePEc:eee:appene:v:251:y:2019:i:c:29
    DOI: 10.1016/j.apenergy.2019.113325
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261919309997
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2019.113325?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. William C. Brainard & Herbert E. Scarf, 2005. "How to Compute Equilibrium Prices in 1891," American Journal of Economics and Sociology, Wiley Blackwell, vol. 64(1), pages 57-83, January.
    2. Li, Pei-Hao & Pye, Steve, 2018. "Assessing the benefits of demand-side flexibility in residential and transport sectors from an integrated energy systems perspective," Applied Energy, Elsevier, vol. 228(C), pages 965-979.
    3. Anvari-Moghaddam, Amjad & Rahimi-Kian, Ashkan & Mirian, Maryam S. & Guerrero, Josep M., 2017. "A multi-agent based energy management solution for integrated buildings and microgrid system," Applied Energy, Elsevier, vol. 203(C), pages 41-56.
    4. Hu, Maomao & Xiao, Fu, 2018. "Price-responsive model-based optimal demand response control of inverter air conditioners using genetic algorithm," Applied Energy, Elsevier, vol. 219(C), pages 151-164.
    5. Kofinas, P. & Dounis, A.I. & Vouros, G.A., 2018. "Fuzzy Q-Learning for multi-agent decentralized energy management in microgrids," Applied Energy, Elsevier, vol. 219(C), pages 53-67.
    6. Abdulaal, Ahmed & Moghaddass, Ramin & Asfour, Shihab, 2017. "Two-stage discrete-continuous multi-objective load optimization: An industrial consumer utility approach to demand response," Applied Energy, Elsevier, vol. 206(C), pages 206-221.
    7. Saffari, Mohammad & de Gracia, Alvaro & Fernández, Cèsar & Belusko, Martin & Boer, Dieter & Cabeza, Luisa F., 2018. "Optimized demand side management (DSM) of peak electricity demand by coupling low temperature thermal energy storage (TES) and solar PV," Applied Energy, Elsevier, vol. 211(C), pages 604-616.
    8. Kelley, Morgan T. & Pattison, Richard C. & Baldick, Ross & Baldea, Michael, 2018. "An MILP framework for optimizing demand response operation of air separation units," Applied Energy, Elsevier, vol. 222(C), pages 951-966.
    9. E. Eisenberg, 1961. "Aggregation of Utility Functions," Management Science, INFORMS, vol. 7(4), pages 337-350, July.
    10. Herve Moulin, 2004. "Fair Division and Collective Welfare," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262633116, December.
    11. Lu, Renzhi & Hong, Seung Ho & Zhang, Xiongfeng, 2018. "A Dynamic pricing demand response algorithm for smart grid: Reinforcement learning approach," Applied Energy, Elsevier, vol. 220(C), pages 220-230.
    12. Wu, Jingda & He, Hongwen & Peng, Jiankun & Li, Yuecheng & Li, Zhanjiang, 2018. "Continuous reinforcement learning of energy management with deep Q network for a power split hybrid electric bus," Applied Energy, Elsevier, vol. 222(C), pages 799-811.
    13. Malik, Anam & Ravishankar, Jayashri, 2018. "A hybrid control approach for regulating frequency through demand response," Applied Energy, Elsevier, vol. 210(C), pages 1347-1362.
    14. Wang, Jianxiao & Zhong, Haiwang & Lai, Xiaowen & Xia, Qing & Shu, Chang & Kang, Chongqing, 2017. "Distributed real-time demand response based on Lagrangian multiplier optimal selection approach," Applied Energy, Elsevier, vol. 190(C), pages 949-959.
    15. Ogunjuyigbe, A.S.O. & Ayodele, T.R. & Akinola, O.A., 2017. "User satisfaction-induced demand side load management in residential buildings with user budget constraint," Applied Energy, Elsevier, vol. 187(C), pages 352-366.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ibrahim, Muhammad Sohail & Dong, Wei & Yang, Qiang, 2020. "Machine learning driven smart electric power systems: Current trends and new perspectives," Applied Energy, Elsevier, vol. 272(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jordehi, A. Rezaee, 2019. "Optimisation of demand response in electric power systems, a review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 103(C), pages 308-319.
    2. Sun, Alexander Y., 2020. "Optimal carbon storage reservoir management through deep reinforcement learning," Applied Energy, Elsevier, vol. 278(C).
    3. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    4. Nikhil Garg & Ashish Goel & Benjamin Plaut, 2021. "Markets for public decision-making," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 56(4), pages 755-801, May.
    5. Ortega, Josué, 2020. "Multi-unit assignment under dichotomous preferences," Mathematical Social Sciences, Elsevier, vol. 103(C), pages 15-24.
    6. Denizalp Goktas & Jiayi Zhao & Amy Greenwald, 2023. "T\^atonnement in Homothetic Fisher Markets," Papers 2306.04890, arXiv.org.
    7. Lu, Renzhi & Bai, Ruichang & Ding, Yuemin & Wei, Min & Jiang, Junhui & Sun, Mingyang & Xiao, Feng & Zhang, Hai-Tao, 2021. "A hybrid deep learning-based online energy management scheme for industrial microgrid," Applied Energy, Elsevier, vol. 304(C).
    8. Kirchem, Dana & Lynch, Muireann Á & Casey, Eoin & Bertsch, Valentin, 2019. "Demand response within the energy-for-water-nexus: A review," Papers WP637, Economic and Social Research Institute (ESRI).
    9. Tina, Giuseppe Marco & Aneli, Stefano & Gagliano, Antonio, 2022. "Technical and economic analysis of the provision of ancillary services through the flexibility of HVAC system in shopping centers," Energy, Elsevier, vol. 258(C).
    10. Heydarian-Forushani, Ehsan & Golshan, Mohamad Esmail Hamedani & Shafie-khah, Miadreza & Catalão, João P.S., 2020. "A comprehensive linear model for demand response optimization problem," Energy, Elsevier, vol. 209(C).
    11. Lu, Xiaoxing & Li, Kangping & Xu, Hanchen & Wang, Fei & Zhou, Zhenyu & Zhang, Yagang, 2020. "Fundamentals and business model for resource aggregator of demand response in electricity markets," Energy, Elsevier, vol. 204(C).
    12. Amit Shewale & Anil Mokhade & Nitesh Funde & Neeraj Dhanraj Bokde, 2022. "A Survey of Efficient Demand-Side Management Techniques for the Residential Appliance Scheduling Problem in Smart Homes," Energies, MDPI, vol. 15(8), pages 1-34, April.
    13. Baldi, Simone & Korkas, Christos D. & Lv, Maolong & Kosmatopoulos, Elias B., 2018. "Automating occupant-building interaction via smart zoning of thermostatic loads: A switched self-tuning approach," Applied Energy, Elsevier, vol. 231(C), pages 1246-1258.
    14. Luo, Zhe & Hong, SeungHo & Ding, YueMin, 2019. "A data mining-driven incentive-based demand response scheme for a virtual power plant," Applied Energy, Elsevier, vol. 239(C), pages 549-559.
    15. Yi Kuang & Xiuli Wang & Hongyang Zhao & Yijun Huang & Xianlong Chen & Xifan Wang, 2020. "Agent-Based Energy Sharing Mechanism Using Deep Deterministic Policy Gradient Algorithm," Energies, MDPI, vol. 13(19), pages 1-20, September.
    16. Marcel García & Jose Aguilar & María D. R-Moreno, 2024. "An Autonomous Distributed Coordination Strategy for Sustainable Consumption in a Microgrid Based on a Bio-Inspired Approach," Energies, MDPI, vol. 17(3), pages 1-28, February.
    17. Ashish Goel & Reyna Hulett & Benjamin Plaut, 2018. "Markets Beyond Nash Welfare for Leontief Utilities," Papers 1807.05293, arXiv.org, revised Dec 2019.
    18. Kong, Xiangyu & Kong, Deqian & Yao, Jingtao & Bai, Linquan & Xiao, Jie, 2020. "Online pricing of demand response based on long short-term memory and reinforcement learning," Applied Energy, Elsevier, vol. 271(C).
    19. Qiu, Dawei & Ye, Yujian & Papadaskalopoulos, Dimitrios & Strbac, Goran, 2021. "Scalable coordinated management of peer-to-peer energy trading: A multi-cluster deep reinforcement learning approach," Applied Energy, Elsevier, vol. 292(C).
    20. Álex Omar Topa Gavilema & José Domingo Álvarez & José Luis Torres Moreno & Manuel Pérez García, 2021. "Towards Optimal Management in Microgrids: An Overview," Energies, MDPI, vol. 14(16), pages 1-25, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:251:y:2019:i:c:29. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.