IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v17y2025i12p5255-d1673581.html
   My bibliography  Save this article

Deep Learning in Multimodal Fusion for Sustainable Plant Care: A Comprehensive Review

Author

Listed:
  • Zhi-Xiang Yang

    (China Agricultural University, Qinghua East Road No. 17, Haidian, Beijing 100083, China
    These authors contributed equally to this work.)

  • Yusi Li

    (China Agricultural University, Qinghua East Road No. 17, Haidian, Beijing 100083, China
    These authors contributed equally to this work.)

  • Rui-Feng Wang

    (China Agricultural University, Qinghua East Road No. 17, Haidian, Beijing 100083, China
    These authors contributed equally to this work.)

  • Pingfan Hu

    (Artie McFerrin Department of Chemical Engineering, Texas A&M University, College Station, TX 77843-3122, USA)

  • Wen-Hao Su

    (China Agricultural University, Qinghua East Road No. 17, Haidian, Beijing 100083, China)

Abstract

With the advancement of Agriculture 4.0 and the ongoing transition toward sustainable and intelligent agricultural systems, deep learning-based multimodal fusion technologies have emerged as a driving force for crop monitoring, plant management, and resource conservation. This article systematically reviews research progress from three perspectives: technical frameworks, application scenarios, and sustainability-driven challenges. At the technical framework level, it outlines an integrated system encompassing data acquisition, feature fusion, and decision optimization, thereby covering the full pipeline of perception, analysis, and decision making essential for sustainable practices. Regarding application scenarios, it focuses on three major tasks—disease diagnosis, maturity and yield prediction, and weed identification—evaluating how deep learning-driven multisource data integration enhances precision and efficiency in sustainable farming operations. It further discusses the efficient translation of detection outcomes into eco-friendly field practices through agricultural navigation systems, harvesting and plant protection robots, and intelligent resource management strategies based on feedback-driven monitoring. In addressing challenges and future directions, the article highlights key bottlenecks such as data heterogeneity, real-time processing limitations, and insufficient model generalization, and proposes potential solutions including cross-modal generative models and federated learning to support more resilient, sustainable agricultural systems. This work offers a comprehensive three-dimensional analysis across technology, application, and sustainability challenges, providing theoretical insights and practical guidance for the intelligent and sustainable transformation of modern agriculture through multimodal fusion.

Suggested Citation

  • Zhi-Xiang Yang & Yusi Li & Rui-Feng Wang & Pingfan Hu & Wen-Hao Su, 2025. "Deep Learning in Multimodal Fusion for Sustainable Plant Care: A Comprehensive Review," Sustainability, MDPI, vol. 17(12), pages 1-33, June.
  • Handle: RePEc:gam:jsusta:v:17:y:2025:i:12:p:5255-:d:1673581
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/17/12/5255/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/17/12/5255/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rui-Feng Wang & Wen-Hao Su, 2024. "The Application of Deep Learning in the Whole Potato Production Chain: A Comprehensive Review," Agriculture, MDPI, vol. 14(8), pages 1-30, July.
    2. Te-Wei Wang & Kenneth E. Murphy, 2004. "Semantic Heterogeneity in Multidatabase Systems: A Review and a Proposed Meta-Data Structure," Journal of Database Management (JDM), IGI Global, vol. 15(4), pages 71-87, October.
    3. Yi-Ming Qin & Yu-Hao Tu & Tao Li & Yao Ni & Rui-Feng Wang & Haihua Wang, 2025. "Deep Learning for Sustainable Agriculture: A Systematic Review on Applications in Lettuce Cultivation," Sustainability, MDPI, vol. 17(7), pages 1-33, April.
    4. Kaiqiang Ye & Gang Hu & Zijie Tong & Youlin Xu & Jiaqiang Zheng, 2025. "Key Intelligent Pesticide Prescription Spraying Technologies for the Control of Pests, Diseases, and Weeds: A Review," Agriculture, MDPI, vol. 15(1), pages 1-37, January.
    5. Qi Dong & Tomoaki Murakami & Yasuhiro Nakashima, 2018. "Recalculating the agricultural labor force in China," China Economic Journal, Taylor & Francis Journals, vol. 11(2), pages 151-169, May.
    6. Chen, Mengting & Cui, Yuanlai & Wang, Xiaonan & Xie, Hengwang & Liu, Fangping & Luo, Tongyuan & Zheng, Shizong & Luo, Yufeng, 2021. "A reinforcement learning approach to irrigation decision-making for rice using weather forecasts," Agricultural Water Management, Elsevier, vol. 250(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haoxin Li & Tianci Chen & Yingmei Chen & Chongyang Han & Jinhong Lv & Zhiheng Zhou & Weibin Wu, 2025. "Instance Segmentation and 3D Pose Estimation of Tea Bud Leaves for Autonomous Harvesting Robots," Agriculture, MDPI, vol. 15(2), pages 1-23, January.
    2. An-Qi Wu & Ke-Lei Li & Zi-Yu Song & Xiuhua Lou & Pingfan Hu & Weijun Yang & Rui-Feng Wang, 2025. "Deep Learning for Sustainable Aquaculture: Opportunities and Challenges," Sustainability, MDPI, vol. 17(11), pages 1-29, June.
    3. Jiaming Zheng & Genki Suzuki & Hiroyuki Shioya, 2025. "Sustainable Sewage Treatment Prediction Using Integrated KAN-LSTM with Multi-Head Attention," Sustainability, MDPI, vol. 17(10), pages 1-17, May.
    4. Hanen Ben Rjeb & Layth Sliman & Hela Zorgati & Raoudha Ben Djemaa & Amine Dhraief, 2025. "Optimizing Internet of Things Services Placement in Fog Computing Using Hybrid Recommendation System," Future Internet, MDPI, vol. 17(5), pages 1-32, April.
    5. Imran Ali Lakhiar & Haofang Yan & Chuan Zhang & Guoqing Wang & Bin He & Beibei Hao & Yujing Han & Biyu Wang & Rongxuan Bao & Tabinda Naz Syed & Junaid Nawaz Chauhdary & Md. Rakibuzzaman, 2024. "A Review of Precision Irrigation Water-Saving Technology under Changing Climate for Enhancing Water Use Efficiency, Crop Yield, and Environmental Footprints," Agriculture, MDPI, vol. 14(7), pages 1-40, July.
    6. Chen, Yi & Lin, Meiwei & Yu, Zhuo & Sun, Weihong & Fu, Weiguo & He, Liang, 2025. "Enhancing cotton irrigation with distributional actor–critic reinforcement learning," Agricultural Water Management, Elsevier, vol. 307(C).
    7. Xiying Wang, 2025. "The artificial intelligence-based agricultural field irrigation warning system using GA-BP neural network under smart agriculture," PLOS ONE, Public Library of Science, vol. 20(1), pages 1-21, January.
    8. Zhang, Jia & Ding, Yimin & Zhu, Lei & Wan, Yukuai & Chai, Mingtang & Ding, Pengpeng, 2025. "Estimating and forecasting daily reference crop evapotranspiration in China with temperature-driven deep learning models," Agricultural Water Management, Elsevier, vol. 307(C).
    9. Chen, Mengting & Linker, Raphael & Wu, Conglin & Xie, Hua & Cui, Yuanlai & Luo, Yufeng & Lv, Xinwei & Zheng, Shizong, 2022. "Multi-objective optimization of rice irrigation modes using ACOP-Rice model and historical meteorological data," Agricultural Water Management, Elsevier, vol. 272(C).
    10. Hambur Wang, 2024. "Can education correct appearance discrimination in the labor market?," Papers 2411.01621, arXiv.org.
    11. Gao, Zitian & Guo, Danlu & Ryu, Dongryeol & Western, Andrew W., 2024. "Exploring key factors driving farm-level seasonal irrigation water usage with Bayesian hierarchical modelling," Agricultural Water Management, Elsevier, vol. 294(C).
    12. Hambur Wang, 2024. "Design and Analysis of Intellectual Property Protection Strategies Based on Differential Equations," Papers 2411.00981, arXiv.org.
    13. Li, Xiumei & Zhao, Weixia & Li, Jiusheng & Li, Yanfeng, 2021. "Effects of irrigation strategies and soil properties on the characteristics of deep percolation and crop water requirements for a variable rate irrigation system," Agricultural Water Management, Elsevier, vol. 257(C).
    14. Hambur Wang, 2024. "Can ESG Investment and the Implementation of the New Environmental Protection Law Enhance Public Subjective Well-being?," Papers 2411.06110, arXiv.org.
    15. Wu, Haitao & Wang, Bingjie & Lu, Mingyue & Irfan, Muhammad & Miao, Xin & Luo, Shiyue & Hao, Yu, 2023. "The strategy to achieve zero‑carbon in agricultural sector: Does digitalization matter under the background of COP26 targets?," Energy Economics, Elsevier, vol. 126(C).
    16. Hambur Wang, 2024. "The Impact of Farmers' Borrowing Behavior on Agricultural Production Technical Efficiency," Papers 2411.00500, arXiv.org.
    17. Mai, Zijun & He, Yupu & Feng, Chen & Han, Congying & Shi, Yuanzhi & Qi, Wei, 2024. "Multi-objective modeling and optimization of water distribution for canal system considering irrigation coverage in artesian irrigation district," Agricultural Water Management, Elsevier, vol. 301(C).
    18. Ziyu Qin & Jia Wang & Yunhan Wang & Lihao Liu & Junye Zhou & Xinyu Fu, 2025. "Assessing the Impacts of New Quality Productivity on Sustainable Agriculture: Structural Mechanisms and Optimization Strategies—Empirical Evidence from China," Sustainability, MDPI, vol. 17(6), pages 1-47, March.
    19. Muhammad Alkaff & Abdullah Basuhail & Yuslena Sari, 2025. "Optimizing Water Use in Maize Irrigation with Reinforcement Learning," Mathematics, MDPI, vol. 13(4), pages 1-21, February.
    20. Umutoni, Lisa & Samadi, Vidya, 2024. "Application of machine learning approaches in supporting irrigation decision making: A review," Agricultural Water Management, Elsevier, vol. 294(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:17:y:2025:i:12:p:5255-:d:1673581. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.