IDEAS home Printed from https://ideas.repec.org/a/eee/agiwat/v250y2021ics0378377421001037.html
   My bibliography  Save this article

A reinforcement learning approach to irrigation decision-making for rice using weather forecasts

Author

Listed:
  • Chen, Mengting
  • Cui, Yuanlai
  • Wang, Xiaonan
  • Xie, Hengwang
  • Liu, Fangping
  • Luo, Tongyuan
  • Zheng, Shizong
  • Luo, Yufeng

Abstract

Improving efficiency with the use of rainfall is one of the effective ways to conserve water in agriculture. At present, weather forecasting can be used to potentially conserve irrigation water, but the risks of unnecessary irrigation and the yield loss due to the uncertainty of weather forecasts should be avoided. Thus, a deep Q-learning (DQN) irrigation decision-making strategy based on short-term weather forecasts was proposed to determine the optimal irrigation decision. The utility of the method is demonstrated for paddy rice grown in Nanchang, China. The short-term weather forecasts and observed meteorological data of the paddy rice growth period from 2012 to 2019 were collected from stations near Nanchang. Irrigation was decided for two irrigation decision-making strategies, namely, conventional irrigation (i.e., flooded irrigation commonly used by local farmers) and DQN irrigation, and their performance in water conservation was evaluated. The results showed that the daily rainfall forecasting performance was acceptable, with potential space for learning and exploitation. The DQN irrigation strategy had strong generalization ability after training and can be used to make irrigation decisions using weather forecasts. In our case, simulation results indicated that compared with conventional irrigation decisions, DQN irrigation took advantage of water conservation from unnecessary irrigation, resulting in irrigation water savings of 23 mm and reducing drainage by 21 mm and irrigation timing by 1.0 times on average, without significant yield reduction. The DQN irrigation strategy of learning from past irrigation experiences and the uncertainties in weather forecasts avoided the risks of imperfect weather forecasting.

Suggested Citation

  • Chen, Mengting & Cui, Yuanlai & Wang, Xiaonan & Xie, Hengwang & Liu, Fangping & Luo, Tongyuan & Zheng, Shizong & Luo, Yufeng, 2021. "A reinforcement learning approach to irrigation decision-making for rice using weather forecasts," Agricultural Water Management, Elsevier, vol. 250(C).
  • Handle: RePEc:eee:agiwat:v:250:y:2021:i:c:s0378377421001037
    DOI: 10.1016/j.agwat.2021.106838
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378377421001037
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.agwat.2021.106838?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mondaca-Duarte, F.D. & van Mourik, S. & Balendonck, J. & Voogt, W. & Heinen, M. & van Henten, E.J., 2020. "Irrigation, crop stress and drainage reduction under uncertainty: A scenario study," Agricultural Water Management, Elsevier, vol. 230(C).
    2. Yang, Yang & Cui, Yuanlai & Luo, Yufeng & Lyu, Xinwei & Traore, Seydou & Khan, Shahbaz & Wang, Weiguang, 2016. "Short-term forecasting of daily reference evapotranspiration using the Penman-Monteith model and public weather forecasts," Agricultural Water Management, Elsevier, vol. 177(C), pages 329-339.
    3. Luo, Yufeng & Chang, Xiaomin & Peng, Shizhang & Khan, Shahbaz & Wang, Weiguang & Zheng, Qiang & Cai, Xueliang, 2014. "Short-term forecasting of daily reference evapotranspiration using the Hargreaves–Samani model and temperature forecasts," Agricultural Water Management, Elsevier, vol. 136(C), pages 42-51.
    4. Longo-Minnolo, G. & Vanella, D. & Consoli, S. & Intrigliolo, D.S. & Ramírez-Cuesta, J.M., 2020. "Integrating forecast meteorological data into the ArcDualKc model for estimating spatially distributed evapotranspiration rates of a citrus orchard," Agricultural Water Management, Elsevier, vol. 231(C).
    5. Traore, Seydou & Luo, Yufeng & Fipps, Guy, 2016. "Deployment of artificial neural network for short-term forecasting of evapotranspiration using public weather forecast restricted messages," Agricultural Water Management, Elsevier, vol. 163(C), pages 363-379.
    6. Wu, Jingda & He, Hongwen & Peng, Jiankun & Li, Yuecheng & Li, Zhanjiang, 2018. "Continuous reinforcement learning of energy management with deep Q network for a power split hybrid electric bus," Applied Energy, Elsevier, vol. 222(C), pages 799-811.
    7. Mishra, Ashok & Siderius, Christian & Aberson, Kenny & van der Ploeg, Martine & Froebrich, Jochen, 2013. "Short-term rainfall forecasts as a soft adaptation to climate change in irrigation management in North-East India," Agricultural Water Management, Elsevier, vol. 127(C), pages 97-106.
    8. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    9. Blaney, Harry F. & Criddle, Wayne D., 1962. "Determining Consumptive Use and Irrigation Water Requirements," Technical Bulletins 171000, United States Department of Agriculture, Economic Research Service.
    10. Cao, Jingjing & Tan, Junwei & Cui, Yuanlai & Luo, Yufeng, 2019. "Irrigation scheduling of paddy rice using short-term weather forecast data," Agricultural Water Management, Elsevier, vol. 213(C), pages 714-723.
    11. Gowing, J. W. & Ejieji, C. J., 2001. "Real-time scheduling of supplemental irrigation for potatoes using a decision model and short-term weather forecasts," Agricultural Water Management, Elsevier, vol. 47(2), pages 137-153, March.
    12. Lee, E. S. & Raju, K. S. & Biere, Arlo W., 1991. "Dynamic irrigation scheduling with stochastic rainfall," Agricultural Water Management, Elsevier, vol. 19(3), pages 253-270, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen, Mengting & Linker, Raphael & Wu, Conglin & Xie, Hua & Cui, Yuanlai & Luo, Yufeng & Lv, Xinwei & Zheng, Shizong, 2022. "Multi-objective optimization of rice irrigation modes using ACOP-Rice model and historical meteorological data," Agricultural Water Management, Elsevier, vol. 272(C).
    2. Li, Xiumei & Zhao, Weixia & Li, Jiusheng & Li, Yanfeng, 2021. "Effects of irrigation strategies and soil properties on the characteristics of deep percolation and crop water requirements for a variable rate irrigation system," Agricultural Water Management, Elsevier, vol. 257(C).
    3. Zhao, Xueyin & Chen, Mengting & Xie, Hua & Luo, Wanqi & Wei, Guangfei & Zheng, Shizong & Wu, Conglin & Khan, Shahbaz & Cui, Yuanlai & Luo, Yufeng, 2023. "Analysis of irrigation demands of rice: Irrigation decision-making needs to consider future rainfall," Agricultural Water Management, Elsevier, vol. 280(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Seydou Traore & Yufeng Luo & Guy Fipps, 2017. "Gene-Expression Programming for Short-Term Forecasting of Daily Reference Evapotranspiration Using Public Weather Forecast Information," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 31(15), pages 4891-4908, December.
    2. Cao, Jingjing & Tan, Junwei & Cui, Yuanlai & Luo, Yufeng, 2019. "Irrigation scheduling of paddy rice using short-term weather forecast data," Agricultural Water Management, Elsevier, vol. 213(C), pages 714-723.
    3. Longo-Minnolo, G. & Vanella, D. & Consoli, S. & Intrigliolo, D.S. & Ramírez-Cuesta, J.M., 2020. "Integrating forecast meteorological data into the ArcDualKc model for estimating spatially distributed evapotranspiration rates of a citrus orchard," Agricultural Water Management, Elsevier, vol. 231(C).
    4. Yang, Yang & Luo, Yufeng & Wu, Conglin & Zheng, Hezhen & Zhang, Lei & Cui, Yuanlai & Sun, Ningning & Wang, Li, 2019. "Evaluation of six equations for daily reference evapotranspiration estimating using public weather forecast message for different climate regions across China," Agricultural Water Management, Elsevier, vol. 222(C), pages 386-399.
    5. Sun, Alexander Y., 2020. "Optimal carbon storage reservoir management through deep reinforcement learning," Applied Energy, Elsevier, vol. 278(C).
    6. Yang, Yang & Cui, Yuanlai & Luo, Yufeng & Lyu, Xinwei & Traore, Seydou & Khan, Shahbaz & Wang, Weiguang, 2016. "Short-term forecasting of daily reference evapotranspiration using the Penman-Monteith model and public weather forecasts," Agricultural Water Management, Elsevier, vol. 177(C), pages 329-339.
    7. Daniel Egan & Qilun Zhu & Robert Prucka, 2023. "A Review of Reinforcement Learning-Based Powertrain Controllers: Effects of Agent Selection for Mixed-Continuity Control and Reward Formulation," Energies, MDPI, vol. 16(8), pages 1-31, April.
    8. Wu, Yuankai & Tan, Huachun & Peng, Jiankun & Zhang, Hailong & He, Hongwen, 2019. "Deep reinforcement learning of energy management with continuous control strategy and traffic information for a series-parallel plug-in hybrid electric bus," Applied Energy, Elsevier, vol. 247(C), pages 454-466.
    9. Qi, Chunyang & Zhu, Yiwen & Song, Chuanxue & Yan, Guangfu & Xiao, Feng & Da wang, & Zhang, Xu & Cao, Jingwei & Song, Shixin, 2022. "Hierarchical reinforcement learning based energy management strategy for hybrid electric vehicle," Energy, Elsevier, vol. 238(PA).
    10. Qiu, Rangjian & Luo, Yufeng & Wu, Jingwei & Zhang, Baozhong & Liu, Zhihe & Agathokleous, Evgenios & Yang, Xiumei & Hu, Wei & Clothier, Brent, 2023. "Short–term forecasting of daily evapotranspiration from rice using a modified Priestley–Taylor model and public weather forecasts," Agricultural Water Management, Elsevier, vol. 277(C).
    11. Zhang, Lei & Traore, Seydou & Cui, Yuanlai & Luo, Yufeng & Zhu, Ge & Liu, Bo & Fipps, Guy & Karthikeyan, R. & Singh, Vijay, 2019. "Assessment of spatiotemporal variability of reference evapotranspiration and controlling climate factors over decades in China using geospatial techniques," Agricultural Water Management, Elsevier, vol. 213(C), pages 499-511.
    12. Qiu, Rangjian & Li, Longan & Liu, Chunwei & Wang, Zhenchang & Zhang, Baozhong & Liu, Zhandong, 2022. "Evapotranspiration estimation using a modified crop coefficient model in a rotated rice-winter wheat system," Agricultural Water Management, Elsevier, vol. 264(C).
    13. Gavilán, Pedro & Ruiz, Natividad & Lozano, David, 2015. "Daily forecasting of reference and strawberry crop evapotranspiration in greenhouses in a Mediterranean climate based on solar radiation estimates," Agricultural Water Management, Elsevier, vol. 159(C), pages 307-317.
    14. Zhengyu Yao & Hwan-Sik Yoon & Yang-Ki Hong, 2023. "Control of Hybrid Electric Vehicle Powertrain Using Offline-Online Hybrid Reinforcement Learning," Energies, MDPI, vol. 16(2), pages 1-18, January.
    15. Qin, Shujing & Liu, Zhihe & Qiu, Rangjian & Luo, Yufeng & Wu, Jingwei & Zhang, Baozhong & Wu, Lifeng & Agathokleous, Evgenios, 2023. "Short–term global solar radiation forecasting based on an improved method for sunshine duration prediction and public weather forecasts," Applied Energy, Elsevier, vol. 343(C).
    16. Kunyu Wang & Rong Yang & Yongjian Zhou & Wei Huang & Song Zhang, 2022. "Design and Improvement of SD3-Based Energy Management Strategy for a Hybrid Electric Urban Bus," Energies, MDPI, vol. 15(16), pages 1-21, August.
    17. Zhang, Bin & Hu, Weihao & Xu, Xiao & Li, Tao & Zhang, Zhenyuan & Chen, Zhe, 2022. "Physical-model-free intelligent energy management for a grid-connected hybrid wind-microturbine-PV-EV energy system via deep reinforcement learning approach," Renewable Energy, Elsevier, vol. 200(C), pages 433-448.
    18. Wei, Hongqian & Zhang, Nan & Liang, Jun & Ai, Qiang & Zhao, Wenqiang & Huang, Tianyi & Zhang, Youtong, 2022. "Deep reinforcement learning based direct torque control strategy for distributed drive electric vehicles considering active safety and energy saving performance," Energy, Elsevier, vol. 238(PB).
    19. Zhang, Kang & Xie, Xianhong & Zhu, Bowen & Meng, Shanshan & Yao, Yi, 2019. "Unexpected groundwater recovery with decreasing agricultural irrigation in the Yellow River Basin," Agricultural Water Management, Elsevier, vol. 213(C), pages 858-867.
    20. Xu, Bin & Rathod, Dhruvang & Zhang, Darui & Yebi, Adamu & Zhang, Xueyu & Li, Xiaoya & Filipi, Zoran, 2020. "Parametric study on reinforcement learning optimized energy management strategy for a hybrid electric vehicle," Applied Energy, Elsevier, vol. 259(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:agiwat:v:250:y:2021:i:c:s0378377421001037. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/agwat .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.