IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v17y2025i12p5255-d1673581.html

Deep Learning in Multimodal Fusion for Sustainable Plant Care: A Comprehensive Review

Author

Listed:
  • Zhi-Xiang Yang

    (China Agricultural University, Qinghua East Road No. 17, Haidian, Beijing 100083, China
    These authors contributed equally to this work.)

  • Yusi Li

    (China Agricultural University, Qinghua East Road No. 17, Haidian, Beijing 100083, China
    These authors contributed equally to this work.)

  • Rui-Feng Wang

    (China Agricultural University, Qinghua East Road No. 17, Haidian, Beijing 100083, China
    These authors contributed equally to this work.)

  • Pingfan Hu

    (Artie McFerrin Department of Chemical Engineering, Texas A&M University, College Station, TX 77843-3122, USA)

  • Wen-Hao Su

    (China Agricultural University, Qinghua East Road No. 17, Haidian, Beijing 100083, China)

Abstract

With the advancement of Agriculture 4.0 and the ongoing transition toward sustainable and intelligent agricultural systems, deep learning-based multimodal fusion technologies have emerged as a driving force for crop monitoring, plant management, and resource conservation. This article systematically reviews research progress from three perspectives: technical frameworks, application scenarios, and sustainability-driven challenges. At the technical framework level, it outlines an integrated system encompassing data acquisition, feature fusion, and decision optimization, thereby covering the full pipeline of perception, analysis, and decision making essential for sustainable practices. Regarding application scenarios, it focuses on three major tasks—disease diagnosis, maturity and yield prediction, and weed identification—evaluating how deep learning-driven multisource data integration enhances precision and efficiency in sustainable farming operations. It further discusses the efficient translation of detection outcomes into eco-friendly field practices through agricultural navigation systems, harvesting and plant protection robots, and intelligent resource management strategies based on feedback-driven monitoring. In addressing challenges and future directions, the article highlights key bottlenecks such as data heterogeneity, real-time processing limitations, and insufficient model generalization, and proposes potential solutions including cross-modal generative models and federated learning to support more resilient, sustainable agricultural systems. This work offers a comprehensive three-dimensional analysis across technology, application, and sustainability challenges, providing theoretical insights and practical guidance for the intelligent and sustainable transformation of modern agriculture through multimodal fusion.

Suggested Citation

  • Zhi-Xiang Yang & Yusi Li & Rui-Feng Wang & Pingfan Hu & Wen-Hao Su, 2025. "Deep Learning in Multimodal Fusion for Sustainable Plant Care: A Comprehensive Review," Sustainability, MDPI, vol. 17(12), pages 1-33, June.
  • Handle: RePEc:gam:jsusta:v:17:y:2025:i:12:p:5255-:d:1673581
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/17/12/5255/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/17/12/5255/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rui-Feng Wang & Wen-Hao Su, 2024. "The Application of Deep Learning in the Whole Potato Production Chain: A Comprehensive Review," Agriculture, MDPI, vol. 14(8), pages 1-30, July.
    2. Yi-Ming Qin & Yu-Hao Tu & Tao Li & Yao Ni & Rui-Feng Wang & Haihua Wang, 2025. "Deep Learning for Sustainable Agriculture: A Systematic Review on Applications in Lettuce Cultivation," Sustainability, MDPI, vol. 17(7), pages 1-33, April.
    3. Qi Dong & Tomoaki Murakami & Yasuhiro Nakashima, 2018. "Recalculating the agricultural labor force in China," China Economic Journal, Taylor & Francis Journals, vol. 11(2), pages 151-169, May.
    4. Te-Wei Wang & Kenneth E. Murphy, 2004. "Semantic Heterogeneity in Multidatabase Systems: A Review and a Proposed Meta-Data Structure," Journal of Database Management (JDM), IGI Global, vol. 15(4), pages 71-87, October.
    5. Kaiqiang Ye & Gang Hu & Zijie Tong & Youlin Xu & Jiaqiang Zheng, 2025. "Key Intelligent Pesticide Prescription Spraying Technologies for the Control of Pests, Diseases, and Weeds: A Review," Agriculture, MDPI, vol. 15(1), pages 1-37, January.
    6. Chen, Mengting & Cui, Yuanlai & Wang, Xiaonan & Xie, Hengwang & Liu, Fangping & Luo, Tongyuan & Zheng, Shizong & Luo, Yufeng, 2021. "A reinforcement learning approach to irrigation decision-making for rice using weather forecasts," Agricultural Water Management, Elsevier, vol. 250(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shuwei Han & Haihua Wang, 2025. "Application of Deep Learning Technology in Monitoring Plant Attribute Changes," Sustainability, MDPI, vol. 17(17), pages 1-29, August.
    2. Yuluxin Fu & Chen Shi, 2025. "ProtoLeafNet: A Prototype Attention-Based Leafy Vegetable Disease Detection and Segmentation Network for Sustainable Agriculture," Sustainability, MDPI, vol. 17(16), pages 1-24, August.
    3. George Chirita & Riana Iren Radu & Mioara Chirita, 2025. "Multimodal Deep Learning – IoT Systems for Tomato Crops: A Systematic Review," Journal of Agriculture and Rural Development Studies, "Dunarea de Jos" University of Galati, Doctoral Field Engineering and Management in Agriculture and Rural Development, issue 4, pages 189-201.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haoxin Li & Tianci Chen & Yingmei Chen & Chongyang Han & Jinhong Lv & Zhiheng Zhou & Weibin Wu, 2025. "Instance Segmentation and 3D Pose Estimation of Tea Bud Leaves for Autonomous Harvesting Robots," Agriculture, MDPI, vol. 15(2), pages 1-23, January.
    2. Yuluxin Fu & Chen Shi, 2025. "ProtoLeafNet: A Prototype Attention-Based Leafy Vegetable Disease Detection and Segmentation Network for Sustainable Agriculture," Sustainability, MDPI, vol. 17(16), pages 1-24, August.
    3. An-Qi Wu & Ke-Lei Li & Zi-Yu Song & Xiuhua Lou & Pingfan Hu & Weijun Yang & Rui-Feng Wang, 2025. "Deep Learning for Sustainable Aquaculture: Opportunities and Challenges," Sustainability, MDPI, vol. 17(11), pages 1-29, June.
    4. Shuwei Han & Haihua Wang, 2025. "Application of Deep Learning Technology in Monitoring Plant Attribute Changes," Sustainability, MDPI, vol. 17(17), pages 1-29, August.
    5. Jiaming Zheng & Genki Suzuki & Hiroyuki Shioya, 2025. "Sustainable Sewage Treatment Prediction Using Integrated KAN-LSTM with Multi-Head Attention," Sustainability, MDPI, vol. 17(10), pages 1-17, May.
    6. Hanen Ben Rjeb & Layth Sliman & Hela Zorgati & Raoudha Ben Djemaa & Amine Dhraief, 2025. "Optimizing Internet of Things Services Placement in Fog Computing Using Hybrid Recommendation System," Future Internet, MDPI, vol. 17(5), pages 1-32, April.
    7. Imran Ali Lakhiar & Haofang Yan & Chuan Zhang & Guoqing Wang & Bin He & Beibei Hao & Yujing Han & Biyu Wang & Rongxuan Bao & Tabinda Naz Syed & Junaid Nawaz Chauhdary & Md. Rakibuzzaman, 2024. "A Review of Precision Irrigation Water-Saving Technology under Changing Climate for Enhancing Water Use Efficiency, Crop Yield, and Environmental Footprints," Agriculture, MDPI, vol. 14(7), pages 1-40, July.
    8. Chen, Yi & Lin, Meiwei & Yu, Zhuo & Sun, Weihong & Fu, Weiguo & He, Liang, 2025. "Enhancing cotton irrigation with distributional actor–critic reinforcement learning," Agricultural Water Management, Elsevier, vol. 307(C).
    9. Xiying Wang, 2025. "The artificial intelligence-based agricultural field irrigation warning system using GA-BP neural network under smart agriculture," PLOS ONE, Public Library of Science, vol. 20(1), pages 1-21, January.
    10. Zhang, Jia & Ding, Yimin & Zhu, Lei & Wan, Yukuai & Chai, Mingtang & Ding, Pengpeng, 2025. "Estimating and forecasting daily reference crop evapotranspiration in China with temperature-driven deep learning models," Agricultural Water Management, Elsevier, vol. 307(C).
    11. Chen, Mengting & Linker, Raphael & Wu, Conglin & Xie, Hua & Cui, Yuanlai & Luo, Yufeng & Lv, Xinwei & Zheng, Shizong, 2022. "Multi-objective optimization of rice irrigation modes using ACOP-Rice model and historical meteorological data," Agricultural Water Management, Elsevier, vol. 272(C).
    12. Hambur Wang, 2024. "Can education correct appearance discrimination in the labor market?," Papers 2411.01621, arXiv.org.
    13. Yu, Jingxin & Qu, Qinglin & Peng, Shuyi & Wei, Xiaoming & Li, Yinkun & Sun, Congcong, 2025. "Deep learning for intelligent irrigation decision-making: A review," Agricultural Water Management, Elsevier, vol. 320(C).
    14. Gao, Zitian & Guo, Danlu & Ryu, Dongryeol & Western, Andrew W., 2024. "Exploring key factors driving farm-level seasonal irrigation water usage with Bayesian hierarchical modelling," Agricultural Water Management, Elsevier, vol. 294(C).
    15. Ding, Yimin & Wang, Mingyu & Jin, Jianxin & Sun, Zhengyuan & Zhang, Jia & Zhu, Lei, 2025. "Risk of real-time irrigation decision-making system for farmland in arid irrigation districts: Methodology and case study," Agricultural Water Management, Elsevier, vol. 320(C).
    16. Hambur Wang, 2024. "Design and Analysis of Intellectual Property Protection Strategies Based on Differential Equations," Papers 2411.00981, arXiv.org.
    17. Lin, En & Qiu, Rangjian & Li, Xinxin & Chen, Mengting & Zheng, Shizong & Ren, Fei & Xiang, Xiaoming & Ji, Chenglong & Cui, Yuanlai & Luo, Yufeng, 2025. "Dynamic control of upper limit for rainfall storing and effective use in rice paddies based on improved AquaCrop model," Agricultural Water Management, Elsevier, vol. 316(C).
    18. Li, Xiumei & Zhao, Weixia & Li, Jiusheng & Li, Yanfeng, 2021. "Effects of irrigation strategies and soil properties on the characteristics of deep percolation and crop water requirements for a variable rate irrigation system," Agricultural Water Management, Elsevier, vol. 257(C).
    19. Hambur Wang, 2024. "Can ESG Investment and the Implementation of the New Environmental Protection Law Enhance Public Subjective Well-being?," Papers 2411.06110, arXiv.org.
    20. Wu, Haitao & Wang, Bingjie & Lu, Mingyue & Irfan, Muhammad & Miao, Xin & Luo, Shiyue & Hao, Yu, 2023. "The strategy to achieve zero‑carbon in agricultural sector: Does digitalization matter under the background of COP26 targets?," Energy Economics, Elsevier, vol. 126(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:17:y:2025:i:12:p:5255-:d:1673581. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.