IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v355y2024ics0306261923017130.html
   My bibliography  Save this article

Energy management for demand response in networked greenhouses with multi-agent deep reinforcement learning

Author

Listed:
  • Ajagekar, Akshay
  • Decardi-Nelson, Benjamin
  • You, Fengqi

Abstract

Greenhouses are key to ensuring food security and realizing a sustainable future for agriculture. However, to ensure crop growth efficiency, greenhouses consume a significant amount of energy, primarily through climate control and artificial lighting systems. Owing to this high energy consumption, a network of greenhouses exhibits immense potential to participate in demand response programs for power grid stability. In this work, a multi-agent deep reinforcement learning (MADRL) control framework utilizing an actor-critic algorithm with a shared attention mechanism is proposed for energy management in networked greenhouses. A network of renewable energy integrated greenhouses is constructed to interact with the power grid, when necessary, to address the fluctuations associated with renewable energy generation and dynamic electricity prices. The viability and scalability of this multi-agent approach is demonstrated by evaluating its capabilities for a network of five greenhouses of varying capacities. The proposed MADRL-based control approach for demand-side energy management in networked greenhouses demonstrates efficiency in maintaining indoor climate in all greenhouses while ensuring a 28% reduction in net load demand as compared to well-known algorithms.

Suggested Citation

  • Ajagekar, Akshay & Decardi-Nelson, Benjamin & You, Fengqi, 2024. "Energy management for demand response in networked greenhouses with multi-agent deep reinforcement learning," Applied Energy, Elsevier, vol. 355(C).
    • Handle: RePEc:eee:appene:v:355:y:2024:i:c:s0306261923017130
    DOI: 10.1016/j.apenergy.2023.122349
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923017130
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2023.122349?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. van Beveren, P.J.M. & Bontsema, J. & van Straten, G. & van Henten, E.J., 2015. "Optimal control of greenhouse climate using minimal energy and grower defined bounds," Applied Energy, Elsevier, vol. 159(C), pages 509-519.
    2. Niu, Jide & Tian, Zhe & Lu, Yakai & Zhao, Hongfang, 2019. "Flexible dispatch of a building energy system using building thermal storage and battery energy storage," Applied Energy, Elsevier, vol. 243(C), pages 274-287.
    3. Sengupta, Manajit & Xie, Yu & Lopez, Anthony & Habte, Aron & Maclaurin, Galen & Shelby, James, 2018. "The National Solar Radiation Data Base (NSRDB)," Renewable and Sustainable Energy Reviews, Elsevier, vol. 89(C), pages 51-60.
    4. Lu, Renzhi & Hong, Seung Ho, 2019. "Incentive-based demand response for smart grid with reinforcement learning and deep neural network," Applied Energy, Elsevier, vol. 236(C), pages 937-949.
    5. Filippos Bantis & Athanasios Koukounaras, 2023. "Impact of Light on Horticultural Crops," Agriculture, MDPI, vol. 13(4), pages 1-4, April.
    6. Chen, Jiaoliao & Xu, Fang & Tan, Dapeng & Shen, Zheng & Zhang, Libin & Ai, Qinglin, 2015. "A control method for agricultural greenhouses heating based on computational fluid dynamics and energy prediction model," Applied Energy, Elsevier, vol. 141(C), pages 106-118.
    7. Yang, Shiyu & Oliver Gao, H. & You, Fengqi, 2022. "Model predictive control for Demand- and Market-Responsive building energy management by leveraging active latent heat storage," Applied Energy, Elsevier, vol. 327(C).
    8. Yang, Shiyu & Oliver Gao, H. & You, Fengqi, 2022. "Model predictive control in phase-change-material-wallboard-enhanced building energy management considering electricity price dynamics," Applied Energy, Elsevier, vol. 326(C).
    9. Xie, Jiahan & Ajagekar, Akshay & You, Fengqi, 2023. "Multi-Agent attention-based deep reinforcement learning for demand response in grid-responsive buildings," Applied Energy, Elsevier, vol. 342(C).
    10. Lu, Renzhi & Li, Yi-Chang & Li, Yuting & Jiang, Junhui & Ding, Yuemin, 2020. "Multi-agent deep reinforcement learning based demand response for discrete manufacturing systems energy management," Applied Energy, Elsevier, vol. 276(C).
    11. Singh, Devesh & Basu, Chandrajit & Meinhardt-Wollweber, Merve & Roth, Bernhard, 2015. "LEDs for energy efficient greenhouse lighting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 49(C), pages 139-147.
    12. Vázquez-Canteli, José R. & Nagy, Zoltán, 2019. "Reinforcement learning for demand response: A review of algorithms and modeling techniques," Applied Energy, Elsevier, vol. 235(C), pages 1072-1089.
    13. Babonneau, Frédéric & Caramanis, Michael & Haurie, Alain, 2016. "A linear programming model for power distribution with demand response and variable renewable energy," Applied Energy, Elsevier, vol. 181(C), pages 83-95.
    14. Hu, Guoqing & You, Fengqi, 2022. "Renewable energy-powered semi-closed greenhouse for sustainable crop production using model predictive control and machine learning for energy management," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    15. Chen, Wei-Han & Mattson, Neil S. & You, Fengqi, 2022. "Intelligent control and energy optimization in controlled environment agriculture via nonlinear model predictive control of semi-closed greenhouse," Applied Energy, Elsevier, vol. 320(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hu, Guoqing & You, Fengqi, 2024. "AI-enabled cyber-physical-biological systems for smart energy management and sustainable food production in a plant factory," Applied Energy, Elsevier, vol. 356(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xie, Jiahan & Ajagekar, Akshay & You, Fengqi, 2023. "Multi-Agent attention-based deep reinforcement learning for demand response in grid-responsive buildings," Applied Energy, Elsevier, vol. 342(C).
    2. Hu, Guoqing & You, Fengqi, 2023. "An AI framework integrating physics-informed neural network with predictive control for energy-efficient food production in the built environment," Applied Energy, Elsevier, vol. 348(C).
    3. Xiao, Tianqi & You, Fengqi, 2023. "Building thermal modeling and model predictive control with physically consistent deep learning for decarbonization and energy optimization," Applied Energy, Elsevier, vol. 342(C).
    4. Eduardo J. Salazar & Mauro Jurado & Mauricio E. Samper, 2023. "Reinforcement Learning-Based Pricing and Incentive Strategy for Demand Response in Smart Grids," Energies, MDPI, vol. 16(3), pages 1-33, February.
    5. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    6. Zeng, Lanting & Qiu, Dawei & Sun, Mingyang, 2022. "Resilience enhancement of multi-agent reinforcement learning-based demand response against adversarial attacks," Applied Energy, Elsevier, vol. 324(C).
    7. Ibrahim, Muhammad Sohail & Dong, Wei & Yang, Qiang, 2020. "Machine learning driven smart electric power systems: Current trends and new perspectives," Applied Energy, Elsevier, vol. 272(C).
    8. Pinto, Giuseppe & Deltetto, Davide & Capozzoli, Alfonso, 2021. "Data-driven district energy management with surrogate models and deep reinforcement learning," Applied Energy, Elsevier, vol. 304(C).
    9. Lu, Renzhi & Bai, Ruichang & Ding, Yuemin & Wei, Min & Jiang, Junhui & Sun, Mingyang & Xiao, Feng & Zhang, Hai-Tao, 2021. "A hybrid deep learning-based online energy management scheme for industrial microgrid," Applied Energy, Elsevier, vol. 304(C).
    10. Seongwoo Lee & Joonho Seon & Byungsun Hwang & Soohyun Kim & Youngghyu Sun & Jinyoung Kim, 2024. "Recent Trends and Issues of Energy Management Systems Using Machine Learning," Energies, MDPI, vol. 17(3), pages 1-24, January.
    11. Chao-Chung Hsu & Bi-Hai Jiang & Chun-Cheng Lin, 2023. "A Survey on Recent Applications of Artificial Intelligence and Optimization for Smart Grids in Smart Manufacturing," Energies, MDPI, vol. 16(22), pages 1-15, November.
    12. Magdalena Krystyna Wyrwicka & Ewa Więcek-Janka & Łukasz Brzeziński, 2023. "Transition to Sustainable Energy System for Smart Cities—Literature Review," Energies, MDPI, vol. 16(21), pages 1-26, October.
    13. Park, Keonwoo & Moon, Ilkyeong, 2022. "Multi-agent deep reinforcement learning approach for EV charging scheduling in a smart grid," Applied Energy, Elsevier, vol. 328(C).
    14. Máximo A. Domínguez-Garabitos & Víctor S. Ocaña-Guevara & Félix Santos-García & Adriana Arango-Manrique & Miguel Aybar-Mejía, 2022. "A Methodological Proposal for Implementing Demand-Shifting Strategies in the Wholesale Electricity Market," Energies, MDPI, vol. 15(4), pages 1-28, February.
    15. Antonopoulos, Ioannis & Robu, Valentin & Couraud, Benoit & Kirli, Desen & Norbu, Sonam & Kiprakis, Aristides & Flynn, David & Elizondo-Gonzalez, Sergio & Wattam, Steve, 2020. "Artificial intelligence and machine learning approaches to energy demand-side response: A systematic review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 130(C).
    16. Charbonnier, Flora & Morstyn, Thomas & McCulloch, Malcolm D., 2022. "Coordination of resources at the edge of the electricity grid: Systematic review and taxonomy," Applied Energy, Elsevier, vol. 318(C).
    17. Parajuli, Samvid & Narayan Bhattarai, Tek & Gorjian, Shiva & Vithanage, Meththika & Raj Paudel, Shukra, 2023. "Assessment of potential renewable energy alternatives for a typical greenhouse aquaponics in Himalayan Region of Nepal," Applied Energy, Elsevier, vol. 344(C).
    18. Chen, Wei-Han & You, Fengqi, 2022. "Sustainable building climate control with renewable energy sources using nonlinear model predictive control," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    19. Carlos Cruz & Esther Palomar & Ignacio Bravo & Alfredo Gardel, 2020. "Cooperative Demand Response Framework for a Smart Community Targeting Renewables: Testbed Implementation and Performance Evaluation," Energies, MDPI, vol. 13(11), pages 1-20, June.
    20. Perera, A.T.D. & Kamalaruban, Parameswaran, 2021. "Applications of reinforcement learning in energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 137(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:355:y:2024:i:c:s0306261923017130. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.