IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i2p901-d1024724.html
   My bibliography  Save this article

Enhancing Image Annotation Technique of Fruit Classification Using a Deep Learning Approach

Author

Listed:
  • Normaisharah Mamat

    (Department of Electronic System Engineering, Malaysia-Japan International Institute of Technology, Universiti Teknologi Malaysia, Jalan Sultan Yahya Petra, Kuala Lumpur 54100, Malaysia)

  • Mohd Fauzi Othman

    (Department of Electronic System Engineering, Malaysia-Japan International Institute of Technology, Universiti Teknologi Malaysia, Jalan Sultan Yahya Petra, Kuala Lumpur 54100, Malaysia)

  • Rawad Abdulghafor

    (Computational Intelligence Group Research, Faculty of Information and Communication Technology, International Islamic University Malaysia, Kuala Lumpur 53100, Malaysia)

  • Ali A. Alwan

    (Schools of Theoretical and Applied Science, Ramapo College of New Jersey, Mahwah, NJ 07430, USA)

  • Yonis Gulzar

    (Department of Management Information Systems, College of Business Administration, King Faisal University, Al-Ahsa 31982, Saudi Arabia)

Abstract

An accurate image retrieval technique is required due to the rapidly increasing number of images. It is important to implement image annotation techniques that are fast, simple, and, most importantly, automatically annotate. Image annotation has recently received much attention due to the massive rise in image data volume. Focusing on the agriculture field, this study implements automatic image annotation, namely, a repetitive annotation task technique, to classify the ripeness of oil palm fruit and recognize a variety of fruits. This approach assists farmers to enhance the classification of fruit methods and increase their production. This study proposes simple and effective models using a deep learning approach with You Only Look Once (YOLO) versions. The models were developed through transfer learning where the dataset was trained with 100 images of oil fruit palm and 400 images of a variety of fruit in RGB images. Model performance and accuracy of automatically annotating the images with 3500 fruits were examined. The results show that the annotation technique successfully annotated a large number of images accurately. The mAP result achieved for oil palm fruit was 98.7% and the variety of fruit was 99.5%.

Suggested Citation

  • Normaisharah Mamat & Mohd Fauzi Othman & Rawad Abdulghafor & Ali A. Alwan & Yonis Gulzar, 2023. "Enhancing Image Annotation Technique of Fruit Classification Using a Deep Learning Approach," Sustainability, MDPI, vol. 15(2), pages 1-19, January.
  • Handle: RePEc:gam:jsusta:v:15:y:2023:i:2:p:901-:d:1024724
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/2/901/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/15/2/901/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Khalied Albarrak & Yonis Gulzar & Yasir Hamid & Abid Mehmood & Arjumand Bano Soomro, 2022. "A Deep Learning-Based Model for Date Fruit Classification," Sustainability, MDPI, vol. 14(10), pages 1-16, May.
    2. Hangzhou Yang & Huiying Gao, 2018. "Toward Sustainable Virtualized Healthcare: Extracting Medical Entities from Chinese Online Health Consultations Using Deep Neural Networks," Sustainability, MDPI, vol. 10(9), pages 1-18, September.
    3. Siqi Liu & Yishu Jin & Zhiwen Ruan & Zheng Ma & Rui Gao & Zhongbin Su, 2022. "Real-Time Detection of Seedling Maize Weeds in Sustainable Agriculture," Sustainability, MDPI, vol. 14(22), pages 1-20, November.
    4. Haiqing Wang & Shuqi Shang & Dongwei Wang & Xiaoning He & Kai Feng & Hao Zhu, 2022. "Plant Disease Detection and Classification Method Based on the Optimized Lightweight YOLOv5 Model," Agriculture, MDPI, vol. 12(7), pages 1-23, June.
    5. Normaisharah Mamat & Mohd Fauzi Othman & Rawad Abdoulghafor & Samir Brahim Belhaouari & Normahira Mamat & Shamsul Faisal Mohd Hussein, 2022. "Advanced Technology in Agriculture Industry by Implementing Image Annotation Technique and Deep Learning Approach: A Review," Agriculture, MDPI, vol. 12(7), pages 1-35, July.
    6. Hail Jung & Jeongjin Rhee, 2022. "Application of YOLO and ResNet in Heat Staking Process Inspection," Sustainability, MDPI, vol. 14(23), pages 1-14, November.
    7. Artur Janowski & Rafał Kaźmierczak & Cezary Kowalczyk & Jakub Szulwic, 2021. "Detecting Apples in the Wild: Potential for Harvest Quantity Estimation," Sustainability, MDPI, vol. 13(14), pages 1-15, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yonis Gulzar, 2023. "Fruit Image Classification Model Based on MobileNetV2 with Deep Transfer Learning Technique," Sustainability, MDPI, vol. 15(3), pages 1-14, January.
    2. Shahnawaz Ayoub & Yonis Gulzar & Jaloliddin Rustamov & Abdoh Jabbari & Faheem Ahmad Reegu & Sherzod Turaev, 2023. "Adversarial Approaches to Tackle Imbalanced Data in Machine Learning," Sustainability, MDPI, vol. 15(9), pages 1-17, April.
    3. Bashar Igried & Shadi AlZu’bi & Darah Aqel & Ala Mughaid & Iyad Ghaith & Laith Abualigah, 2023. "An Intelligent and Precise Agriculture Model in Sustainable Cities Based on Visualized Symptoms," Agriculture, MDPI, vol. 13(4), pages 1-20, April.
    4. Poonam Dhiman & Amandeep Kaur & V. R. Balasaraswathi & Yonis Gulzar & Ali A. Alwan & Yasir Hamid, 2023. "Image Acquisition, Preprocessing and Classification of Citrus Fruit Diseases: A Systematic Literature Review," Sustainability, MDPI, vol. 15(12), pages 1-23, June.
    5. Yane Li & Ying Wang & Dayu Xu & Jiaojiao Zhang & Jun Wen, 2023. "An Improved Mask RCNN Model for Segmentation of ‘Kyoho’ ( Vitis labruscana ) Grape Bunch and Detection of Its Maturity Level," Agriculture, MDPI, vol. 13(4), pages 1-18, April.
    6. Mohammed Al-Naeem & M M Hafizur Rahman & Anuradha Banerjee & Abu Sufian, 2023. "Support Vector Machine-Based Energy Efficient Management of UAV Locations for Aerial Monitoring of Crops over Large Agriculture Lands," Sustainability, MDPI, vol. 15(8), pages 1-17, April.
    7. Yujia Zhang & Luteng Zhong & Yu Ding & Hongfeng Yu & Zhaoyu Zhai, 2023. "ResViT-Rice: A Deep Learning Model Combining Residual Module and Transformer Encoder for Accurate Detection of Rice Diseases," Agriculture, MDPI, vol. 13(6), pages 1-17, June.
    8. Yanlei Xu & Zhiyuan Gao & Yuting Zhai & Qi Wang & Zongmei Gao & Zhao Xu & Yang Zhou, 2023. "A CNNA-Based Lightweight Multi-Scale Tomato Pest and Disease Classification Method," Sustainability, MDPI, vol. 15(11), pages 1-17, May.
    9. Ali Hakem Alsaeedi & Ali Mohsin Al-juboori & Haider Hameed R. Al-Mahmood & Suha Mohammed Hadi & Husam Jasim Mohammed & Mohammad R. Aziz & Mayas Aljibawi & Riyadh Rahef Nuiaa, 2023. "Dynamic Clustering Strategies Boosting Deep Learning in Olive Leaf Disease Diagnosis," Sustainability, MDPI, vol. 15(18), pages 1-20, September.
    10. Ewa Ropelewska & Dorota E. Kruczyńska & Ahmed M. Rady & Krzysztof P. Rutkowski & Dorota Konopacka & Karolina Celejewska & Monika Mieszczakowska-Frąc, 2023. "Evaluating the Classification of Freeze-Dried Slices and Cubes of Red-Fleshed Apple Genotypes Using Image Textures, Color Parameters, and Machine Learning," Agriculture, MDPI, vol. 13(3), pages 1-16, February.
    11. Xinyu Jia & Xueqin Jiang & Zhiyong Li & Jiong Mu & Yuchao Wang & Yupeng Niu, 2023. "Application of Deep Learning in Image Recognition of Citrus Pests," Agriculture, MDPI, vol. 13(5), pages 1-19, May.
    12. Yanxin Hu & Gang Liu & Zhiyu Chen & Jiaqi Liu & Jianwei Guo, 2023. "Lightweight One-Stage Maize Leaf Disease Detection Model with Knowledge Distillation," Agriculture, MDPI, vol. 13(9), pages 1-22, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yang Chen & Xiaoyulong Chen & Jianwu Lin & Renyong Pan & Tengbao Cao & Jitong Cai & Dianzhi Yu & Tomislav Cernava & Xin Zhang, 2022. "DFCANet: A Novel Lightweight Convolutional Neural Network Model for Corn Disease Identification," Agriculture, MDPI, vol. 12(12), pages 1-22, November.
    2. Rui Ma & Jia Wang & Wei Zhao & Hongjie Guo & Dongnan Dai & Yuliang Yun & Li Li & Fengqi Hao & Jinqiang Bai & Dexin Ma, 2022. "Identification of Maize Seed Varieties Using MobileNetV2 with Improved Attention Mechanism CBAM," Agriculture, MDPI, vol. 13(1), pages 1-16, December.
    3. Lu Lu & Wei Liu & Wenbo Yang & Manyu Zhao & Tinghao Jiang, 2022. "Lightweight Corn Seed Disease Identification Method Based on Improved ShuffleNetV2," Agriculture, MDPI, vol. 12(11), pages 1-18, November.
    4. Mahdieh Parsaeian & Mohammad Rahimi & Abbas Rohani & Shaneka S. Lawson, 2022. "Towards the Modeling and Prediction of the Yield of Oilseed Crops: A Multi-Machine Learning Approach," Agriculture, MDPI, vol. 12(10), pages 1-23, October.
    5. Zejin Sun & Hui Yang & Zhifu Zhang & Junxiao Liu & Xirui Zhang, 2022. "An Improved YOLOv5-Based Tapping Trajectory Detection Method for Natural Rubber Trees," Agriculture, MDPI, vol. 12(9), pages 1-19, August.
    6. Hamna Waheed & Waseem Akram & Saif ul Islam & Abdul Hadi & Jalil Boudjadar & Noureen Zafar, 2023. "A Mobile-Based System for Detecting Ginger Leaf Disorders Using Deep Learning," Future Internet, MDPI, vol. 15(3), pages 1-23, February.
    7. Kadir Sabanci & Muhammet Fatih Aslan & Vanya Slavova & Stefka Genova, 2022. "The Use of Fluorescence Spectroscopic Data and Machine-Learning Algorithms to Discriminate Red Onion Cultivar and Breeding Line," Agriculture, MDPI, vol. 12(10), pages 1-11, October.
    8. Guk-Jin Son & Dong-Hoon Kwak & Mi-Kyung Park & Young-Duk Kim & Hee-Chul Jung, 2021. "U-Net-Based Foreign Object Detection Method Using Effective Image Acquisition System: A Case of Almond and Green Onion Flake Food Process," Sustainability, MDPI, vol. 13(24), pages 1-20, December.
    9. Sonam Aggarwal & Sheifali Gupta & Deepali Gupta & Yonis Gulzar & Sapna Juneja & Ali A. Alwan & Ali Nauman, 2023. "An Artificial Intelligence-Based Stacked Ensemble Approach for Prediction of Protein Subcellular Localization in Confocal Microscopy Images," Sustainability, MDPI, vol. 15(2), pages 1-20, January.
    10. Boris Duralija, 2022. "Sustainable Fruit Growing: From Orchard to Table-Editorial Commentary," Sustainability, MDPI, vol. 14(3), pages 1-4, January.
    11. Yonis Gulzar & Zeynep Ünal & Hakan Aktaş & Mohammad Shuaib Mir, 2023. "Harnessing the Power of Transfer Learning in Sunflower Disease Detection: A Comparative Study," Agriculture, MDPI, vol. 13(8), pages 1-17, July.
    12. Ewa Ropelewska & Kadir Sabanci & Muhammet Fatih Aslan & Necati Çetin, 2023. "Rapid Detection of Changes in Image Textures of Carrots Caused by Freeze-Drying using Image Processing Techniques and Machine Learning Algorithms," Sustainability, MDPI, vol. 15(8), pages 1-14, April.
    13. Younés Noutfia & Ewa Ropelewska, 2022. "Comprehensive Characterization of Date Palm Fruit ‘Mejhoul’ ( Phoenix dactylifera L.) Using Image Analysis and Quality Attribute Measurements," Agriculture, MDPI, vol. 13(1), pages 1-12, December.
    14. Shanxin Zhang & Hao Feng & Shaoyu Han & Zhengkai Shi & Haoran Xu & Yang Liu & Haikuan Feng & Chengquan Zhou & Jibo Yue, 2022. "Monitoring of Soybean Maturity Using UAV Remote Sensing and Deep Learning," Agriculture, MDPI, vol. 13(1), pages 1-21, December.
    15. Jiapeng Cui & Feng Tan, 2023. "Rice Plaque Detection and Identification Based on an Improved Convolutional Neural Network," Agriculture, MDPI, vol. 13(1), pages 1-15, January.
    16. Rodrigo Cupertino Bernardes & André De Medeiros & Laercio da Silva & Leo Cantoni & Gustavo Ferreira Martins & Thiago Mastrangelo & Arthur Novikov & Clíssia Barboza Mastrangelo, 2022. "Deep-Learning Approach for Fusarium Head Blight Detection in Wheat Seeds Using Low-Cost Imaging Technology," Agriculture, MDPI, vol. 12(11), pages 1-14, October.
    17. Maged Mohammed & Ramasamy Srinivasagan & Ali Alzahrani & Nashi K. Alqahtani, 2023. "Machine-Learning-Based Spectroscopic Technique for Non-Destructive Estimation of Shelf Life and Quality of Fresh Fruits Packaged under Modified Atmospheres," Sustainability, MDPI, vol. 15(17), pages 1-24, August.
    18. Yan Gao & Yandong Wang & Patrick Wang & Lei Gu, 2020. "Medical Named Entity Extraction from Chinese Resident Admit Notes Using Character and Word Attention-Enhanced Neural Network," IJERPH, MDPI, vol. 17(5), pages 1-17, March.
    19. Xinle Zhang & Jian Cui & Huanjun Liu & Yongqi Han & Hongfu Ai & Chang Dong & Jiaru Zhang & Yunxiang Chu, 2023. "Weed Identification in Soybean Seedling Stage Based on Optimized Faster R-CNN Algorithm," Agriculture, MDPI, vol. 13(1), pages 1-16, January.
    20. Changqing Wang & Maoxuan Sun & Yuan Cao & Kunyu He & Bei Zhang & Zhonghao Cao & Meng Wang, 2023. "Lightweight Network-Based Surface Defect Detection Method for Steel Plates," Sustainability, MDPI, vol. 15(4), pages 1-12, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:2:p:901-:d:1024724. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.